Digital video

This article is about digital techniques applied to video. For the standard format for storing digital video, see DV. For other uses, see Digital video (disambiguation).

Digital video is an electronic representation of moving visual images (video) in the form of encoded digital data. This is in contrast to analog video, which represents moving visual images in the form of analog signals. Digital video comprises a series of digital images displayed in rapid succession, usually at 24 frames per second. Digital video has many advantages such as easy copying, multicasting, sharing and storage.

Sony digital video camera used for recording content.

Digital video was first introduced commercially in 1986 with the Sony D1 format,^[1] which recorded an uncompressed standard-definition component video signal in digital form. In addition to uncompressed formats, popular compressed digital video formats today include H.264 and MPEG-4. Modern interconnect standards used for playback of digital video include HDMI, DisplayPort, Digital Visual Interface (DVI) and serial digital interface (SDI).

Digital video can be copied and reproduced with no degradation in quality. In contrast, when analog sources are copied, they experience generation loss. Digital video can be stored on digital media such as Blu-ray Disc, on computer data storage, or streamed over the Internet to end users who watch content on a desktop computer screen or a digital smart TV. Today, digital video content such as TV shows and movies also include a digital audio soundtrack.

History

Digital video cameras

Further information: Digital cinematography, Image sensor, and Video camera

The basis for digital video cameras are metal–oxide–semiconductor (MOS) image sensors.^[2] The first practical semiconductor image sensor was the charge-coupled device (CCD), invented in 1969^[3] by Willard S. Boyle, who won a Nobel Prize for his work in physics.^[4] Following the commercialization of CCD sensors during the late 1970s to early 1980s, the entertainment industry slowly began transitioning to digital imaging and digital video over from analog video the next two decades.^[5] The CCD was followed by the CMOS active-pixel sensor (CMOS sensor),^[6] developed in the 1990s.^[7][8] CMOS are beneficial because of their small size, high speed, and low power usage. CMOS are most commonly found today in the digital cameras in iPhones, used as the image censor for the device.^[9]

 

A Betacam SP camera, originally developed in 1986 by Sony.

Digital video coding

Further information: Video coding format § History

In the 1970s, pulse-code modulation (PCM) induced the birth of digital video coding, demanding high bitrates of 45-140 Mbps for standard-definition (SD) content.^[1] By the 1980s, the discrete cosine transform (DCT) became the standard for digital video compression.^[10]

The first digital video coding standard was H.120, created by the (International Telegraph and Telephone Consultative Committee) or CCITT (now ITU-T) in 1984. H.120 was not practical due to weak performance.^[11] H.120 was based on differential pulse-code modulation (DPCM), a compression algorithm that was inefficient for video coding. During the late 1980s, a number of companies began experimenting with DCT, a much more efficient form of compression for video coding. The CCITT received 14 proposals for DCT-based video compression formats, in contrast to a single proposal based on vector quantization (VQ) compression. The H.261 standard was developed based on DCT compression,^[12] becoming first practical video coding standard.^[11] Since H.261, DCT compression has been adopted by all the major video coding standards that followed.^[12]

MPEG-1, developed by the Motion Picture Experts Group (MPEG), followed in 1991, and it was designed to compress VHS-quality video. It was succeeded in 1994 by MPEG-2/H.262,^[11] which became the standard video format for DVD and SD digital television.^[11] It was followed by MPEG-4/H.263 in 1999, and then in 2003 it was followed by H.264/MPEG-4 AVC, which has become the most widely used video coding standard.^[13]

Digital video production

Starting in the late 1970s to the early 1980s, video production equipment that was digital in its internal workings was introduced. These included time base correctors (TBC)^[a] and digital video effects (DVE) units.^[b] They operated by taking a standard analog composite video input and digitizing it internally. This made it easier to either correct or enhance the video signal, as in the case of a TBC, or to manipulate and add effects to the video, in the case of a DVE unit. The digitized and processed video information was then converted back to standard analog video for output.

Later on in the 1970s, manufacturers of professional video broadcast equipment, such as Bosch (through their Fernseh division) and Ampex developed prototype digital videotape recorders (VTR) in their research and development labs. Bosch's machine used a modified 1 inch type B videotape transport and recorded an early form of CCIR 601 digital video. Ampex's prototype digital video recorder used a modified 2-inch quadruplex videotape VTR (an Ampex AVR-3) fitted with custom digital video electronics and a special "octaplex" 8-head headwheel (regular analog 2" quad machines only used 4 heads). Like standard 2" quad, the audio on the Ampex prototype digital machine, nicknamed by its developers as "Annie," still recorded the audio in analog as linear tracks on the tape. None of these machines from these manufacturers were ever marketed commercially.

Digital video was first introduced commercially in 1986 with the Sony D1 format, which recorded an uncompressed standard definition component video signal in digital form. Component video connections required 3 cables, but most television facilities were wired for composite NTSC or PAL video using one cable. Due this incompatibility the cost of the recorder, D1 was used primarily by large television networks and other component-video capable video studios.

 

A professional television studio set in Chile.

In 1988, Sony and Ampex co-developed and released the D2 digital videocassette format, which recorded video digitally without compression in ITU-601 format, much like D1. In comparison, D2 had the major difference of encoding the video in composite form to the NTSC standard, thereby only requiring single-cable composite video connections to and from a D2 VCR. This made it a perfect fit for the majority of television facilities at the time. D2 was a successful format in the television broadcast industry throughout the late '80s and the '90s. D2 was also widely used in that era as the master tape format for mastering laserdiscs.^[c]

D1 & D2 would eventually be replaced by cheaper systems using video compression, most notably Sony's Digital Betacam,^[d] that were introduced into the network's television studios. Other examples of digital video formats utilizing compression were Ampex's DCT (the first to employ such when introduced in 1992), the industry-standard DV and MiniDV and its professional variations, Sony's DVCAM and Panasonic's DVCPRO, and Betacam SX, a lower-cost variant of Digital Betacam using MPEG-2 compression.^[14]

 

The Sony logo, creator of the Betacam.

One of the first digital video products to run on personal computers was PACo: The PICS Animation Compiler from The Company of Science & Art in Providence, RI. It was developed starting in 1990 and first shipped in May 1991. PACo could stream unlimited-length video with synchronized sound from a single file (with the ".CAV" file extension) on CD-ROM. Creation required a Mac, and playback was possible on Macs, PCs, and Sun SPARCstations.^[15]

QuickTime, Apple Computer's multimedia framework, was released in June 1991. Audio Video Interleave from Microsoft followed in 1992. Initial consumer-level content creation tools were crude, requiring an analog video source to be digitized to a computer-readable format. While low-quality at first, consumer digital video increased rapidly in quality, first with the introduction of playback standards such as MPEG-1 and MPEG-2 (adopted for use in television transmission and DVD media), and the introduction of the DV tape format allowing recordings in the format to be transferred directly to digital video files using a FireWire port on an editing computer. This simplified the process, allowing non-linear editing systems (NLE) to be deployed cheaply and widely on desktop computers with no external playback or recording equipment needed.

The widespread adoption of digital video and accompanying compression formats has reduced the bandwidth needed for a high-definition video signal (with HDV and AVCHD, as well as several commercial variants such as DVCPRO-HD, all using less bandwidth than a standard definition analog signal). These savings have increased the number of channels available on cable television and direct broadcast satellite systems, created opportunities for spectrum reallocation of terrestrial television broadcast frequencies, and made tapeless camcorders based on flash memory possible, among other innovations and efficiencies.

Digital video and culture

Culturally, digital video has allowed video and film to become widely available and popular, beneficial to entertainment, education, and research.^[16] Digital video is increasingly common in schools, with students and teachers taking an interest in learning how to use it in relevant ways.^[17] Digital video also has healthcare applications, allowing doctors to track infant heart rates and oxygen levels.^[18]

In addition, the switch from analog to digital video impacted media in various ways, such as in how business use cameras for surveillance. Closed circuit television (CCTV) switched to using digital video recorders (DVR), presenting the issue of how to store recordings for evidence collection. Today, digital video is able to be compressed in order to save storage space.^[19]

Digital television

Digital Television, also known as DTV, is the production and transmission of digital video from networks to consumers. This technique uses digital encoding instead of analog signals used prior to the 1950s.^[20] As compared to analog methods, DTV is faster and provides more capabilities and options for data to be transmitted and shared.^[21]

Overview

Digital video comprises a series of digital images displayed in rapid succession. In the context of video, these images are called frames.^[e] The rate at which frames are displayed is known as the frame rate and is measured in frames per second (FPS). Every frame is a digital image and so comprises a formation of pixels. The color of a pixel is represented by a fixed number of bits of that color where the information of the color is stored within the image.^[22] For example, 8-bit captures 256 levels per channel, and 10-bit captures 1,024 levels per channel.^[23] The more bits, the more subtle variations of colors can be reproduced. This is called the color depth, or bit depth, of the video.

Interlacing

In interlaced video each frame is composed of two halves of an image. The first half contains only the odd-numbered lines of a full frame. The second half contains only the even-numbered lines. These halves are referred to individually as fields. Two consecutive fields compose a full frame. If an interlaced video has a frame rate of 30 frames per second the field rate is 60 fields per second, though both part of interlaced video, frames per second and fields per second are separate numbers.

 

A broadcast television camera at the Pavek Museum in Minnesota.

Bit rate and BPP

By definition, bit rate is a measurement of the rate of information content from the digital video stream. In the case of uncompressed video, bit rate corresponds directly to the quality of the video because bit rate is proportional to every property that affects the video quality. Bit rate is an important property when transmitting video because the transmission link must be capable of supporting that bit rate. Bit rate is also important when dealing with the storage of video because, as shown above, the video size is proportional to the bit rate and the duration. Video compression is used to greatly reduce the bit rate while having little effect on quality.^[24]

Bits per pixel (BPP) is a measure of the efficiency of compression. A true-color video with no compression at all may have a BPP of 24 bits/pixel. Chroma subsampling can reduce the BPP to 16 or 12 bits/pixel. Applying JPEG compression on every frame can reduce the BPP to 8 or even 1 bits/pixel. Applying video compression algorithms like MPEG1, MPEG2 or MPEG4 allows for fractional BPP values to exist.

Constant bit rate versus variable bit rate

BPP represents the average bits per pixel. There are compression algorithms that keep the BPP almost constant throughout the entire duration of the video. In this case, we also get video output with a constant bitrate (CBR). This CBR video is suitable for real-time, non-buffered, fixed bandwidth video streaming (e.g. in videoconferencing). Since not all frames can be compressed at the same level, because quality is more severely impacted for scenes of high complexity, some algorithms try to constantly adjust the BPP. They keep the BPP high while compressing complex scenes and low for less demanding scenes.^[25] This way, it provides the best quality at the smallest average bit rate (and the smallest file size, accordingly). This method produces a variable bitrate because it tracks the variations of the BPP.

Technical overview

Standard film stocks typically record at 24 frames per second. For video, there are two frame rate standards: NTSC, at 30/1.001 (about 29.97) frames per second (about 59.94 fields per second), and PAL, 25 frames per second (50 fields per second). Digital video cameras come in two different image capture formats: interlaced and progressive scan. Interlaced cameras record the image in alternating sets of lines: the odd-numbered lines are scanned, and then the even-numbered lines are scanned, then the odd-numbered lines are scanned again, and so on.

One set of odd or even lines is referred to as a field, and a consecutive pairing of two fields of opposite parity is called a frame. Progressive scan cameras record all lines in each frame as a single unit. Thus, interlaced video captures the scene motion twice as often as progressive video does for the same frame rate. Progressive-scan generally produces a slightly sharper image, however, motion may not be as smooth as interlaced video.

Digital video can be copied with no generation loss; which degrades quality in analog systems. However, a change in parameters like frame size, or a change of the digital format can decrease the quality of the video due to image scaling and transcoding losses. Digital video can be manipulated and edited on non-linear editing systems.

Digital video has a significantly lower cost than 35 mm film. In comparison to the high cost of film stock, the digital media used for digital video recording, such as flash memory or hard disk drive is very inexpensive. Digital video also allows footage to be viewed on location without the expensive and time-consuming chemical processing required by film. Network transfer of digital video makes physical deliveries of tapes and film reels unnecessary.

A short video sequence in native 16K.

 

A diagram of 35 mm film as used in Cinemscope cameras.

Digital television (including higher quality HDTV) was introduced in most developed countries in early 2000s. Today, digital video is used in modern mobile phones and video conferencing systems. Digital video is used for Internet distribution of media, including streaming video and peer-to-peer movie distribution.

Many types of video compression exist for serving digital video over the internet and on optical disks. The file sizes of digital video used for professional editing are generally not practical for these purposes, and the video requires further compression with codecs to be used for recreational purposes.

As of 2017^[update], the highest image resolution demonstrated for digital video generation is 132.7 megapixels (15360 x 8640 pixels).^[26] The highest speed is attained in industrial and scientific high speed cameras that are capable of filming 1024x1024 video at up to 1 million frames per second for brief periods of recording.

Technical Properties

Live digital video consumes bandwidth. Recorded digital video consumes data storage. The amount of bandwidth or storage required is determined by the frame size, color depth and frame rate. Each pixel consumes a number of bits determined by the color depth. The data required to represent a frame of data is determined by multiplying by the number of pixels in the image. The bandwidth is determined by multiplying the storage requirement for a frame by the frame rate. The overall storage requirements for a program can then be determined by multiplying bandwidth by the duration of the program.

These calculations are accurate for uncompressed video, but due to the relatively high bit rate of uncompressed video, video compression is extensively used. In the case of compressed video, each frame requires only a small percentage of the original bits. This reduces the data or bandwidth consumption by a factor of 5 to 12 times when using lossless compression, but more commonly, lossy compression is used due to its reduction of data consumption by factors of 20 to 200.^[27] Note that it is not necessary that all frames are equally compressed by the same percentage. Instead, consider the average factor of compression for all the frames taken together.

Interfaces and cables

Purpose-built digital video interfaces

• Digital component video
• Digital Visual Interface (DVI)
• DisplayPort
• HDBaseT
• High-Definition Multimedia Interface (HDMI)
• Unified Display Interface

General-purpose interfaces use to carry digital video

• FireWire (IEEE 1394)
• Universal Serial Bus (USB)

The following interface has been designed for carrying MPEG-Transport compressed video:

• DVB-ASI

Compressed video is also carried using UDP-IP over Ethernet. Two approaches exist for this:

• Using RTP as a wrapper for video packets as with SMPTE 2022
• 1–7 MPEG Transport Packets are placed directly in the UDP packet

Other methods of carrying video over IP

• Network Device Interface
• SMPTE 2110

Storage formats

Encoding

See also: Video coding format and Video codec

• CCIR 601 used for broadcast stations
• VC-2 also known as Dirac Pro
• MPEG-4 good for online distribution of large videos and video recorded to flash memory
• MPEG-2 used for DVDs, Super-VCDs, and many broadcast television formats
• MPEG-1 used for video CDs
• H.261
• H.263
• H.264 also known as MPEG-4 Part 10, or as AVC, used for Blu-ray Discs and some broadcast television formats
• H.265 also known as MPEG-H Part 2, or as HEVC
• MOV used for QuickTime framework
• Theora used for video on Wikipedia

Tapes

Main article: Videotape

• Betacam SX, Betacam IMX, Digital Betacam, or DigiBeta — commercial video systems by Sony, based on original Betamax technology
• D-VHS — MPEG-2 format data recorded on a tape similar to S-VHS
   

  An archived B-format video tape used in Danish broadcasting.
• D1, D2, D3, D5, D9 (also known as Digital-S) — various SMPTE commercial digital video standards
• Digital8 — DV-format data recorded on Hi8-compatible cassettes; largely a consumer format
• DV, MiniDV — used in most of today's videotape-based consumer camcorders; designed for high quality and easy editing; can also record high-definition data (HDV) in MPEG-2 format
• DVCAM, DVCPRO — used in professional broadcast operations; similar to DV but generally considered more robust; though DV-compatible, these formats have better audio handling.
• DVCPRO50, DVCPROHD support higher bandwidths as compared to Panasonic's DVCPRO.
• HDCAM was introduced by Sony as a high-definition alternative to DigiBeta.
• MicroMV — MPEG-2-format data recorded on a very small, matchbook-sized cassette; obsolete
• ProHD — name used by JVC for its MPEG-2-based professional camcorders

Discs

 

The Blu-ray disc, a type of optical disc used for media storage.

See also: Optical disc

• Blu-ray Disc
• DVD
• VCD

See also

• Digital audio
• Digital cinematography
• Display aspect ratio
• Display resolution
• Index of video-related articles
• Internet video
• Online video platform
• Video coding format
• Video editing software
• Webcam

Notes

1. For example the Thomson-CSF 9100 Digital Video Processor, an internally all-digital full-frame TBC introduced in 1980.
2. For example the Ampex ADO, and the Nippon Electric Corporation (NEC) DVE.
3. Prior to D2, most laserdiscs were mastered using analog 1" Type C videotape
4. Digital Betacam is still heavily used as an electronic field production (EFP) recording format by professional television producers
5. In fact the still images correspond to frames only in the case of progressive scan video. In interlaced video they correspond to fields. See section about interlacing for clarification.

References

1. Hussain, Tariq (2020). Multimedia Computing. India: Booksclinic Publishing. ISBN 9789390192984.
2. Williams, J. B. (2017). The Electronics Revolution: Inventing the Future. Springer. pp. 245–8. ISBN 9783319490885.
3. James R. Janesick (2001). Scientific charge-coupled devices. SPIE Press. pp. 3–4. ISBN 978-0-8194-3698-6.
4. "2009 Nobel Prize in Physics awarded to Kao, Boyle, and Smith". Physics Today. 2009. doi:10.1063/pt.5.023739. ISSN 1945-0699.
5. Stump, David (2014). Digital Cinematography: Fundamentals, Tools, Techniques, and Workflows. CRC Press. pp. 83–5. ISBN 978-1-136-04042-9.
6. Stump, David (2014). Digital Cinematography: Fundamentals, Tools, Techniques, and Workflows. CRC Press. pp. 19–22. ISBN 978-1-136-04042-9.
7. Fossum, Eric R.; Hondongwa, D. B. (2014). "A Review of the Pinned Photodiode for CCD and CMOS Image Sensors". IEEE Journal of the Electron Devices Society. 2 (3): 33–43. doi:10.1109/JEDS.2014.2306412.
8. Fossum, Eric R. (12 July 1993). Blouke, Morley M. (ed.). "Active pixel sensors: are CCDs dinosaurs?". SPIE Proceedings Vol. 1900: Charge-Coupled Devices and Solid State Optical Sensors III. International Society for Optics and Photonics. 1900: 2–14. Bibcode:1993SPIE.1900....2F. CiteSeerX 10.1.1.408.6558. doi:10.1117/12.148585. S2CID 10556755.
9. "The Heart of a Phone Camera: The CMOS Active Pixel Image Sensor". large.stanford.edu. Retrieved 2021-03-26.
10. Hanzo, Lajos (2007). Video compression and communications : from basics to H.261, H.263, H.264, MPEG2, MPEG4 for DVB and HSDPA-style adaptive turbo-transceivers. Peter J. Cherriman, Jürgen Streit, Lajos Hanzo (2nd ed.). Hoboken, NJ: IEEE Press. ISBN 978-0-470-51992-9. OCLC 181368622.
11. "The History of Video File Formats Infographic". RealNetworks. 22 April 2012. Retrieved 5 August 2019.
12. Ghanbari, Mohammed (2003). Standard Codecs: Image Compression to Advanced Video Coding. Institution of Engineering and Technology. pp. 1–2. ISBN 9780852967102.
13. Christ, Robert D. (2013). The ROV manual : a user guide for remotely operated vehicles. Robert L. Wernli (2nd ed.). Oxford. ISBN 978-0-08-098291-5. OCLC 861797595.
14. Roger, Jennings (1997). Special Edition Using Desktop Video. Que Books, Macmillan Computer Publishing. ISBN 978-0789702654.
15. "CoSA Lives: The Story of the Company Behind After Effects". from the original on 2011-02-27. Retrieved 2009-11-16.
16. Garrett, Bradley L. (2018). "Videographic geographies: Using digital video for geographic research". Progress in Human Geography. 35 (4): 521–541. doi:10.1177/0309132510388337. ISSN 0309-1325. S2CID 131426433.
17. Bruce, David L.; Chiu, Ming Ming (2015). "Composing With New Technology: Teacher Reflections on Learning Digital Video". Journal of Teacher Education. 66 (3): 272–287. doi:10.1177/0022487115574291. ISSN 0022-4871. S2CID 145361658.
18. Wieler, Matthew E.; Murphy, Thomas G.; Blecherman, Mira; Mehta, Hiral; Bender, G. Jesse (2021-03-01). "Infant heart-rate measurement and oxygen desaturation detection with a digital video camera using imaging photoplethysmography". Journal of Perinatology. 41 (7): 1725–1731. doi:10.1038/s41372-021-00967-1. ISSN 0743-8346. PMID 33649437. S2CID 232070728.
19. Bruehs, Walter E.; Stout, Dorothy (2020). "Quantifying and Ranking Quality for Acquired Recordings on Digital Video Recorders". Journal of Forensic Sciences. 65 (4): 1155–1168. doi:10.1111/1556-4029.14307. ISSN 0022-1198. PMID 32134510. S2CID 212417006.
20. Kruger, Lennard G. (2002). Digital television : an overview. Peter F. Guerrero. New York: Novinka Books. ISBN 1-59033-502-3. OCLC 50684535.
21. Reimers, U. (1998). "Digital video broadcasting". IEEE Communications Magazine. 36 (6): 104–110. doi:10.1109/35.685371.
22. Winkelman, Roy (2018). "TechEase, What is bit depth?". Retrieved 2022-04-18.
23. Steiner, Shawn (12 December 2018). "B&H, 8-Bit, 10-Bit, What Does It All Mean for Your Videos?".
24. Acharya, Tinku (2005). JPEG2000 standard for image compression : concepts, algorithms and VLSI architectures. Ping-Sing Tsai. Hoboken, N.J.: Wiley-Interscience. ISBN 0-471-65375-6. OCLC 57585202.
25. Weise, Marcus (2013). How video works. Diana Weynand (2nd ed.). New York. ISBN 978-1-136-06982-6. OCLC 1295602475.
26. "4K, 8K, 16K – Are You Ready for the Resolution Evolution?". CEPRO. 2017-04-19. Retrieved 2022-04-18.
27. Vatolin, Dmitriy. "Lossless Video Codecs Comparison 2007". www.compression.ru. Retrieved 2022-03-29.

• Sadun, Erica (2006). Digital Video EssentialsTM : Shoot, Transfer, Edit, Share. Hoboken: John Wiley & Sons. ISBN 978-0-470-11319-6. OCLC 630529114.
• "Digital Video (DV)". Techopedia. December 16, 2016. Retrieved March 23, 2021.

External links

• The DV, DVCAM, & DVCPRO Formats – tech details, FAQ, and links