fbpx
Wikipedia

Discrete cosine transform

A discrete cosine transform (DCT) expresses a finite sequence of data points in terms of a sum of cosine functions oscillating at different frequencies. The DCT, first proposed by Nasir Ahmed in 1972, is a widely used transformation technique in signal processing and data compression. It is used in most digital media, including digital images (such as JPEG and HEIF), digital video (such as MPEG and H.26x), digital audio (such as Dolby Digital, MP3 and AAC), digital television (such as SDTV, HDTV and VOD), digital radio (such as AAC+ and DAB+), and speech coding (such as AAC-LD, Siren and Opus). DCTs are also important to numerous other applications in science and engineering, such as digital signal processing, telecommunication devices, reducing network bandwidth usage, and spectral methods for the numerical solution of partial differential equations.

The use of cosine rather than sine functions is critical for compression since fewer cosine functions are needed to approximate a typical signal, whereas for differential equations the cosines express a particular choice of boundary conditions. In particular, a DCT is a Fourier-related transform similar to the discrete Fourier transform (DFT), but using only real numbers. The DCTs are generally related to Fourier series coefficients of a periodically and symmetrically extended sequence whereas DFTs are related to Fourier series coefficients of only periodically extended sequences. DCTs are equivalent to DFTs of roughly twice the length, operating on real data with even symmetry (since the Fourier transform of a real and even function is real and even), whereas in some variants the input or output data are shifted by half a sample. There are eight standard DCT variants, of which four are common.

The most common variant of discrete cosine transform is the type-II DCT, which is often called simply the DCT. This was the original DCT as first proposed by Ahmed. Its inverse, the type-III DCT, is correspondingly often called simply the inverse DCT or the IDCT. Two related transforms are the discrete sine transform (DST), which is equivalent to a DFT of real and odd functions, and the modified discrete cosine transform (MDCT), which is based on a DCT of overlapping data. Multidimensional DCTs (MD DCTs) are developed to extend the concept of DCT to multidimensional signals. A variety of fast algorithms have been developed to reduce the computational complexity of implementing DCT. One of these is the integer DCT (IntDCT),[1] an integer approximation of the standard DCT,[2]: ix, xiii, 1, 141–304  used in several ISO/IEC and ITU-T international standards.[1][2]

DCT compression, also known as block compression, compresses data in sets of discrete DCT blocks.[3] DCT blocks sizes including 8x8 pixels for the standard DCT, and varied integer DCT sizes between 4x4 and 32x32 pixels.[1][4] The DCT has a strong energy compaction property,[5][6] capable of achieving high quality at high data compression ratios.[7][8] However, blocky compression artifacts can appear when heavy DCT compression is applied.

History

The discrete cosine transform (DCT) was first conceived by Nasir Ahmed, T. Natarajan and K. R. Rao while working at Kansas State University, and he proposed the concept to the National Science Foundation in 1972. He originally intended DCT for image compression.[9][1] Ahmed developed a practical DCT algorithm with his PhD students T. Raj Natarajan, Wills Dietrich, and Jeremy Fries, and his friend Dr. K. R. Rao at the University of Texas at Arlington in 1973, and they found that it was the most efficient algorithm for image compression.[9] They presented their results in a January 1974 paper, titled Discrete Cosine Transform.[5][6][10] It described what is now called the type-II DCT (DCT-II),[2]: 51  as well as the type-III inverse DCT (IDCT).[5] It was a benchmark publication,[11][12] and has been cited as a fundamental development in thousands of works since its publication.[13] The basic research work and events that led to the development of the DCT were summarized in a later publication by Ahmed, "How I Came Up with the Discrete Cosine Transform".[9]

Since its introduction in 1974, there has been significant research on the DCT.[10] In 1977, Wen-Hsiung Chen published a paper with C. Harrison Smith and Stanley C. Fralick presenting a fast DCT algorithm.[14][10] Further developments include a 1978 paper by M.J. Narasimha and A.M. Peterson, and a 1984 paper by B.G. Lee.[10] These research papers, along with the original 1974 Ahmed paper and the 1977 Chen paper, were cited by the Joint Photographic Experts Group as the basis for JPEG's lossy image compression algorithm in 1992.[10][15]

In 1975, John A. Roese and Guner S. Robinson adapted the DCT for inter-frame motion-compensated video coding. They experimented with the DCT and the fast Fourier transform (FFT), developing inter-frame hybrid coders for both, and found that the DCT is the most efficient due to its reduced complexity, capable of compressing image data down to 0.25-bit per pixel for a videotelephone scene with image quality comparable to an intra-frame coder requiring 2-bit per pixel.[16][17] In 1979, Anil K. Jain and Jaswant R. Jain further developed motion-compensated DCT video compression,[18][19] also called block motion compensation.[19] This led to Chen developing a practical video compression algorithm, called motion-compensated DCT or adaptive scene coding, in 1981.[19] Motion-compensated DCT later became the standard coding technique for video compression from the late 1980s onwards.[20][21]

The integer DCT is used in Advanced Video Coding (AVC),[22][1] introduced in 2003, and High Efficiency Video Coding (HEVC),[4][1] introduced in 2013. The integer DCT is also used in the High Efficiency Image Format (HEIF), which uses a subset of the HEVC video coding format for coding still images.[4]

A DCT variant, the modified discrete cosine transform (MDCT), was developed by John P. Princen, A.W. Johnson and Alan B. Bradley at the University of Surrey in 1987,[23] following earlier work by Princen and Bradley in 1986.[24] The MDCT is used in most modern audio compression formats, such as Dolby Digital (AC-3),[25][26] MP3 (which uses a hybrid DCT-FFT algorithm),[27] Advanced Audio Coding (AAC),[28] and Vorbis (Ogg).[29]

The discrete sine transform (DST) was derived from the DCT, by replacing the Neumann condition at x=0 with a Dirichlet condition.[2]: 35-36  The DST was described in the 1974 DCT paper by Ahmed, Natarajan and Rao.[5] A type-I DST (DST-I) was later described by Anil K. Jain in 1976, and a type-II DST (DST-II) was then described by H.B. Kekra and J.K. Solanka in 1978.[30]

Nasir Ahmed also developed a lossless DCT algorithm with Giridhar Mandyam and Neeraj Magotra at the University of New Mexico in 1995. This allows the DCT technique to be used for lossless compression of images. It is a modification of the original DCT algorithm, and incorporates elements of inverse DCT and delta modulation. It is a more effective lossless compression algorithm than entropy coding.[31] Lossless DCT is also known as LDCT.[32]

Applications

The DCT is the most widely used transformation technique in signal processing,[33] and by far the most widely used linear transform in data compression.[34] Uncompressed digital media as well as lossless compression had impractically high memory and bandwidth requirements, which was significantly reduced by the highly efficient DCT lossy compression technique,[7][8] capable of achieving data compression ratios from 8:1 to 14:1 for near-studio-quality,[7] up to 100:1 for acceptable-quality content.[8] DCT compression standards are used in digital media technologies, such as digital images, digital photos,[35][36] digital video,[20][37] streaming media,[38] digital television, streaming television, video on demand (VOD),[8] digital cinema,[25] high-definition video (HD video), and high-definition television (HDTV).[7][39]

The DCT, and in particular the DCT-II, is often used in signal and image processing, especially for lossy compression, because it has a strong "energy compaction" property:[5][6] in typical applications, most of the signal information tends to be concentrated in a few low-frequency components of the DCT. For strongly correlated Markov processes, the DCT can approach the compaction efficiency of the Karhunen-Loève transform (which is optimal in the decorrelation sense). As explained below, this stems from the boundary conditions implicit in the cosine functions.

DCTs are also widely employed in solving partial differential equations by spectral methods, where the different variants of the DCT correspond to slightly different even/odd boundary conditions at the two ends of the array.

DCTs are also closely related to Chebyshev polynomials, and fast DCT algorithms (below) are used in Chebyshev approximation of arbitrary functions by series of Chebyshev polynomials, for example in Clenshaw–Curtis quadrature.

The DCT is the coding standard for multimedia telecommunication devices. It is widely used for bit rate reduction, and reducing network bandwidth usage.[1] DCT compression significantly reduces the amount of memory and bandwidth required for digital signals.[8]

General applications

The DCT is widely used in many applications, which include the following.

DCT visual media standards

The DCT-II, also known as simply the DCT, is the most important image compression technique.[citation needed] It is used in image compression standards such as JPEG, and video compression standards such as H.26x, MJPEG, MPEG, DV, Theora and Daala. There, the two-dimensional DCT-II of   blocks are computed and the results are quantized and entropy coded. In this case,   is typically 8 and the DCT-II formula is applied to each row and column of the block. The result is an 8 × 8 transform coefficient array in which the   element (top-left) is the DC (zero-frequency) component and entries with increasing vertical and horizontal index values represent higher vertical and horizontal spatial frequencies.

Advanced Video Coding (AVC) uses the integer DCT[22][1] (IntDCT), an integer approximation of the DCT.[2][1] It uses 4x4 and 8x8 integer DCT blocks. High Efficiency Video Coding (HEVC) and the High Efficiency Image Format (HEIF) use varied integer DCT block sizes between 4x4 and 32x32 pixels.[4][1] As of 2019, AVC is by far the most commonly used format for the recording, compression and distribution of video content, used by 91% of video developers, followed by HEVC which is used by 43% of developers.[47]

Image formats

Image compression standard Year Common applications
JPEG[1] 1992 The most widely used image compression standard[56][57] and digital image format,[50]
JPEG XR 2009 Open XML Paper Specification
WebP 2010 A graphic format that supports the lossy compression of digital images. Developed by Google.
High Efficiency Image Format (HEIF) 2013 Image file format based on HEVC compression. It improves compression over JPEG,[4] and supports animation with much more efficient compression than the animated GIF format.[58]
BPG 2014 Based on HEVC compression
JPEG XL[59] 2020 A royalty-free raster-graphics file format that supports both lossy and lossless compression.

Video formats

Video coding standard Year Common applications
H.261[60][61] 1988 First of a family of video coding standards. Used primarily in older video conferencing and video telephone products.
Motion JPEG (MJPEG)[62] 1992 QuickTime, video editing, non-linear editing, digital cameras
MPEG-1 Video[63] 1993 Digital video distribution on CD or Internet video
MPEG-2 Video (H.262)[63] 1995 Storage and handling of digital images in broadcast applications, digital television, HDTV, cable, satellite, high-speed Internet, DVD video distribution
DV 1995 Camcorders, digital cassettes
H.263 (MPEG-4 Part 2)[60] 1996 Video telephony over public switched telephone network (PSTN), H.320, Integrated Services Digital Network (ISDN)[64][65]
Advanced Video Coding (AVC / H.264 / MPEG-4)[1][22] 2003 Most common HD video recording/compression/distribution format, Internet video, YouTube, Blu-ray Discs, HDTV broadcasts, web browsers, streaming television, mobile devices, consumer devices, Netflix,[46] video telephony, FaceTime[45]
Theora 2004 Internet video, web browsers
VC-1 2006 Windows media, Blu-ray Discs
Apple ProRes 2007 Professional video production.[54]
WebM Video 2010 A multimedia open source format developed by Google intended to be used with HTML5.
High Efficiency Video Coding (HEVC / H.265)[1][4] 2013 The emerging successor to the H.264/MPEG-4 AVC standard, having substantially improved compression capability.
Daala 2013 Research video format by Xiph.org.
AV1[66] 2018 An open source format based on VP10 (VP9's internal successor), Daala and Thor; used by content providers such as YouTube[67][68] and Netflix.[69][70]

MDCT audio standards

General audio

Audio compression standard Year Common applications
Dolby Digital (AC-3)[25][26] 1991 Cinema, digital cinema, DVD, Blu-ray, streaming media, video games
Adaptive Transform Acoustic Coding (ATRAC)[25] 1992 MiniDisc
MPEG Layer III (MP3)[27][1] 1993 Digital audio distribution, MP3 players, portable media players, streaming media
Perceptual Audio Coder (PAC)[25] 1996 Digital audio radio service (DARS)
Advanced Audio Coding (AAC / MP4 Audio)[28][25] 1997 Digital audio distribution, portable media players, streaming media, game consoles, mobile devices, iOS, iTunes, Android, BlackBerry
High-Efficiency Advanced Audio Coding (AAC+)[71][42]: 478  1997 Digital radio, digital audio broadcasting (DAB+),[42] Digital Radio Mondiale (DRM)
Cook Codec 1998 RealAudio
Windows Media Audio (WMA)[25] 1999 Windows Media
Vorbis[29][25] 2000 Digital audio distribution, radio stations, streaming media, video games, Spotify, Wikipedia
High-Definition Coding (HDC)[43] 2002 Digital radio, HD Radio
Dynamic Resolution Adaptation (DRA)[25] 2008 China national audio standard, China Multimedia Mobile Broadcasting, DVB-H
Opus[72] 2012 VoIP,[73] mobile telephony, WhatsApp,[74][75][76] PlayStation 4[77]
Dolby AC-4[78] 2017 ATSC 3.0, ultra-high-definition television (UHD TV)
MPEG-H 3D Audio[79]

Speech coding

Speech coding standard Year Common applications
AAC-LD (LD-MDCT)[80] 1999 Mobile telephony, voice-over-IP (VoIP), iOS, FaceTime[45]
Siren[44] 1999 VoIP, wideband audio, G.722.1
G.722.1[81] 1999 VoIP, wideband audio, G.722
G.729.1[82] 2006 G.729, VoIP, wideband audio,[82] mobile telephony
EVRC-WB[42]: 31, 478]  2007 Wideband audio
G.718[83] 2008 VoIP, wideband audio, mobile telephony
G.719[42] 2008 Teleconferencing, videoconferencing, voice mail
CELT[84] 2011 VoIP,[85][86] mobile telephony
Enhanced Voice Services (EVS)[87] 2014 Mobile telephony, VoIP, wideband audio

MD DCT

Multidimensional DCTs (MD DCTs) have several applications, mainly 3-D DCTs such as the 3-D DCT-II, which has several new applications like Hyperspectral Imaging coding systems,[88] variable temporal length 3-D DCT coding,[89] video coding algorithms,[90] adaptive video coding[91] and 3-D Compression.[92] Due to enhancement in the hardware, software and introduction of several fast algorithms, the necessity of using M-D DCTs is rapidly increasing. DCT-IV has gained popularity for its applications in fast implementation of real-valued polyphase filtering banks,[93] lapped orthogonal transform[94][95] and cosine-modulated wavelet bases.[96]

Digital signal processing

DCT plays a very important role in digital signal processing. By using the DCT, the signals can be compressed. DCT can be used in electrocardiography for the compression of ECG signals. DCT2 provides a better compression ratio than DCT.

The DCT is widely implemented in digital signal processors (DSP), as well as digital signal processing software. Many companies have developed DSPs based on DCT technology. DCTs are widely used for applications such as encoding, decoding, video, audio, multiplexing, control signals, signaling, and analog-to-digital conversion. DCTs are also commonly used for high-definition television (HDTV) encoder/decoder chips.[1]

Compression artifacts

A common issue with DCT compression in digital media are blocky compression artifacts,[97] caused by DCT blocks.[3] The DCT algorithm can cause block-based artifacts when heavy compression is applied. Due to the DCT being used in the majority of digital image and video coding standards (such as the JPEG, H.26x and MPEG formats), DCT-based blocky compression artifacts are widespread in digital media. In a DCT algorithm, an image (or frame in an image sequence) is divided into square blocks which are processed independently from each other, then the DCT of these blocks is taken, and the resulting DCT coefficients are quantized. This process can cause blocking artifacts, primarily at high data compression ratios.[97] This can also cause the "mosquito noise" effect, commonly found in digital video (such as the MPEG formats).[98]

DCT blocks are often used in glitch art.[3] The artist Rosa Menkman makes use of DCT-based compression artifacts in her glitch art,[99] particularly the DCT blocks found in most digital media formats such as JPEG digital images and MP3 digital audio.[3] Another example is Jpegs by German photographer Thomas Ruff, which uses intentional JPEG artifacts as the basis of the picture's style.[100][101]

Informal overview

Like any Fourier-related transform, discrete cosine transforms (DCTs) express a function or a signal in terms of a sum of sinusoids with different frequencies and amplitudes. Like the discrete Fourier transform (DFT), a DCT operates on a function at a finite number of discrete data points. The obvious distinction between a DCT and a DFT is that the former uses only cosine functions, while the latter uses both cosines and sines (in the form of complex exponentials). However, this visible difference is merely a consequence of a deeper distinction: a DCT implies different boundary conditions from the DFT or other related transforms.

The Fourier-related transforms that operate on a function over a finite domain, such as the DFT or DCT or a Fourier series, can be thought of as implicitly defining an extension of that function outside the domain. That is, once you write a function   as a sum of sinusoids, you can evaluate that sum at any  , even for   where the original   was not specified. The DFT, like the Fourier series, implies a periodic extension of the original function. A DCT, like a cosine transform, implies an even extension of the original function.

 
Illustration of the implicit even/odd extensions of DCT input data, for N=11 data points (red dots), for the four most common types of DCT (types I-IV). Note the subtle differences at the interfaces between the data and the extensions: in DCT-II and DCT-IV both the end points are replicated in the extensions but not in DCT-I or DCT-III (and a zero point is inserted at the sign reversal extension in DCT-III).

However, because DCTs operate on finite, discrete sequences, two issues arise that do not apply for the continuous cosine transform. First, one has to specify whether the function is even or odd at both the left and right boundaries of the domain (i.e. the min-n and max-n boundaries in the definitions below, respectively). Second, one has to specify around what point the function is even or odd. In particular, consider a sequence abcd of four equally spaced data points, and say that we specify an even left boundary. There are two sensible possibilities: either the data are even about the sample a, in which case the even extension is dcbabcd, or the data are even about the point halfway between a and the previous point, in which case the even extension is dcbaabcd (a is repeated).

These choices lead to all the standard variations of DCTs and also discrete sine transforms (DSTs). Each boundary can be either even or odd (2 choices per boundary) and can be symmetric about a data point or the point halfway between two data points (2 choices per boundary), for a total of 2 × 2 × 2 × 2 = 16 possibilities. Half of these possibilities, those where the left boundary is even, correspond to the 8 types of DCT; the other half are the 8 types of DST.

These different boundary conditions strongly affect the applications of the transform and lead to uniquely useful properties for the various DCT types. Most directly, when using Fourier-related transforms to solve partial differential equations by spectral methods, the boundary conditions are directly specified as a part of the problem being solved. Or, for the MDCT (based on the type-IV DCT), the boundary conditions are intimately involved in the MDCT's critical property of time-domain aliasing cancellation. In a more subtle fashion, the boundary conditions are responsible for the "energy compactification" properties that make DCTs useful for image and audio compression, because the boundaries affect the rate of convergence of any Fourier-like series.

In particular, it is well known that any discontinuities in a function reduce the rate of convergence of the Fourier series, so that more sinusoids are needed to represent the function with a given accuracy. The same principle governs the usefulness of the DFT and other transforms for signal compression; the smoother a function is, the fewer terms in its DFT or DCT are required to represent it accurately, and the more it can be compressed. (Here, we think of the DFT or DCT as approximations for the Fourier series or cosine series of a function, respectively, in order to talk about its "smoothness".) However, the implicit periodicity of the DFT means that discontinuities usually occur at the boundaries: any random segment of a signal is unlikely to have the same value at both the left and right boundaries. (A similar problem arises for the DST, in which the odd left boundary condition implies a discontinuity for any function that does not happen to be zero at that boundary.) In contrast, a DCT where both boundaries are even always yields a continuous extension at the boundaries (although the slope is generally discontinuous). This is why DCTs, and in particular DCTs of types I, II, V, and VI (the types that have two even boundaries) generally perform better for signal compression than DFTs and DSTs. In practice, a type-II DCT is usually preferred for such applications, in part for reasons of computational convenience.

Formal definition

Formally, the discrete cosine transform is a linear, invertible function   (where   denotes the set of real numbers), or equivalently an invertible N × N square matrix. There are several variants of the DCT with slightly modified definitions. The N real numbers   are transformed into the N real numbers   according to one of the formulas:

DCT-I

 

Some authors further multiply the   and   terms by   and correspondingly multiply the   and   terms by   which makes the DCT-I matrix orthogonal, if one further multiplies by an overall scale factor of   but breaks the direct correspondence with a real-even DFT.

The DCT-I is exactly equivalent (up to an overall scale factor of 2), to a DFT of   real numbers with even symmetry. For example, a DCT-I of   real numbers   is exactly equivalent to a DFT of eight real numbers   (even symmetry), divided by two. (In contrast, DCT types II-IV involve a half-sample shift in the equivalent DFT.)

Note, however, that the DCT-I is not defined for   less than 2, while all other DCT types are defined for any positive  

Thus, the DCT-I corresponds to the boundary conditions:   is even around   and even around  ; similarly for  

DCT-II

 

The DCT-II is probably the most commonly used form, and is often simply referred to as "the DCT".[5][6]

This transform is exactly equivalent (up to an overall scale factor of 2) to a DFT of   real inputs of even symmetry where the even-indexed elements are zero. That is, it is half of the DFT of the   inputs   where     for     and   for   DCT-II transformation is also possible using 2N signal followed by a multiplication by half shift. This is demonstrated by Makhoul.

Some authors further multiply the   term by   and multiply the rest of the matrix by an overall scale factor of   (see below for the corresponding change in DCT-III). This makes the DCT-II matrix orthogonal, but breaks the direct correspondence with a real-even DFT of half-shifted input. This is the normalization used by Matlab, for example, see.[102] In many applications, such as JPEG, the scaling is arbitrary because scale factors can be combined with a subsequent computational step (e.g. the quantization step in JPEG[103]), and a scaling can be chosen that allows the DCT to be computed with fewer multiplications.[104][105]

The DCT-II implies the boundary conditions:   is even around   and even around     is even around   and odd around  

DCT-III

 

Because it is the inverse of DCT-II (up to a scale factor, see below), this form is sometimes simply referred to as "the inverse DCT" ("IDCT").[6]

Some authors divide the   term by   instead of by 2 (resulting in an overall   term) and multiply the resulting matrix by an overall scale factor of   (see above for the corresponding change in DCT-II), so that the DCT-II and DCT-III are transposes of one another. This makes the DCT-III matrix orthogonal, but breaks the direct correspondence with a real-even DFT of half-shifted output.

The DCT-III implies the boundary conditions:   is even around   and odd around     is even around   and even around  

DCT-IV

 

The DCT-IV matrix becomes orthogonal (and thus, being clearly symmetric, its own inverse) if one further multiplies by an overall scale factor of  

A variant of the DCT-IV, where data from different transforms are overlapped, is called the modified discrete cosine transform (MDCT).[106]

The DCT-IV implies the boundary conditions:   is even around   and odd around   similarly for  

DCT V-VIII

DCTs of types I–IV treat both boundaries consistently regarding the point of symmetry: they are even/odd around either a data point for both boundaries or halfway between two data points for both boundaries. By contrast, DCTs of types V-VIII imply boundaries that are even/odd around a data point for one boundary and halfway between two data points for the other boundary.

In other words, DCT types I–IV are equivalent to real-even DFTs of even order (regardless of whether   is even or odd), since the corresponding DFT is of length   (for DCT-I) or   (for DCT-II & III) or   (for DCT-IV). The four additional types of discrete cosine transform[107] correspond essentially to real-even DFTs of logically odd order, which have factors of   in the denominators of the cosine arguments.

However, these variants seem to be rarely used in practice. One reason, perhaps, is that FFT algorithms for odd-length DFTs are generally more complicated than FFT algorithms for even-length DFTs (e.g. the simplest radix-2 algorithms are only for even lengths), and this increased intricacy carries over to the DCTs as described below.

(The trivial real-even array, a length-one DFT (odd length) of a single number a , corresponds to a DCT-V of length  )

Inverse transforms

Using the normalization conventions above, the inverse of DCT-I is DCT-I multiplied by 2/(N − 1). The inverse of DCT-IV is DCT-IV multiplied by 2/N. The inverse of DCT-II is DCT-III multiplied by 2/N and vice versa.[6]

Like for the DFT, the normalization factor in front of these transform definitions is merely a convention and differs between treatments. For example, some authors multiply the transforms by   so that the inverse does not require any additional multiplicative factor. Combined with appropriate factors of 2 (see above), this can be used to make the transform matrix orthogonal.

Multidimensional DCTs

Multidimensional variants of the various DCT types follow straightforwardly from the one-dimensional definitions: they are simply a separable product (equivalently, a composition) of DCTs along each dimension.

M-D DCT-II

For example, a two-dimensional DCT-II of an image or a matrix is simply the one-dimensional DCT-II, from above, performed along the rows and then along the columns (or vice versa). That is, the 2D DCT-II is given by the formula (omitting normalization and other scale factors, as above):

 
The inverse of a multi-dimensional DCT is just a separable product of the inverses of the corresponding one-dimensional DCTs (see above), e.g. the one-dimensional inverses applied along one dimension at a time in a row-column algorithm.

The 3-D DCT-II is only the extension of 2-D DCT-II in three dimensional space and mathematically can be calculated by the formula

 

The inverse of 3-D DCT-II is 3-D DCT-III and can be computed from the formula given by

 

Technically, computing a two-, three- (or -multi) dimensional DCT by sequences of one-dimensional DCTs along each dimension is known as a row-column algorithm. As with multidimensional FFT algorithms, however, there exist other methods to compute the same thing while performing the computations in a different order (i.e. interleaving/combining the algorithms for the different dimensions). Owing to the rapid growth in the applications based on the 3-D DCT, several fast algorithms are developed for the computation of 3-D DCT-II. Vector-Radix algorithms are applied for computing M-D DCT to reduce the computational complexity and to increase the computational speed. To compute 3-D DCT-II efficiently, a fast algorithm, Vector-Radix Decimation in Frequency (VR DIF) algorithm was developed.

3-D DCT-II VR DIF

In order to apply the VR DIF algorithm the input data is to be formulated and rearranged as follows.[108][109] The transform size N × N × N is assumed to be 2.

 
The four basic stages of computing 3-D DCT-II using VR DIF Algorithm.
 
where  

The figure to the adjacent shows the four stages that are involved in calculating 3-D DCT-II using VR DIF algorithm. The first stage is the 3-D reordering using the index mapping illustrated by the above equations. The second stage is the butterfly calculation. Each butterfly calculates eight points together as shown in the figure just below, where  .

The original 3-D DCT-II now can be written as

 

where  

If the even and the odd parts of   and   and are considered, the general formula for the calculation of the 3-D DCT-II can be expressed as

 
The single butterfly stage of VR DIF algorithm.
 

where

 
 
 
 
 
Arithmetic complexity

The whole 3-D DCT calculation needs   stages, and each stage involves   butterflies. The whole 3-D DCT requires   butterflies to be computed. Each butterfly requires seven real multiplications (including trivial multiplications) and 24 real additions (including trivial additions). Therefore, the total number of real multiplications needed for this stage is   and the total number of real additions i.e. including the post-additions (recursive additions) which can be calculated directly after the butterfly stage or after the bit-reverse stage are given by[109]  

The conventional method to calculate MD-DCT-II is using a Row-Column-Frame (RCF) approach which is computationally complex and less productive on most advanced recent hardware platforms. The number of multiplications required to compute VR DIF Algorithm when compared to RCF algorithm are quite a few in number. The number of Multiplications and additions involved in RCF approach are given by   and   respectively. From Table 1, it can be seen that the total number

TABLE 1 Comparison of VR DIF & RCF Algorithms for computing 3D-DCT-II
Transform Size 3D VR Mults RCF Mults 3D VR Adds RCF Adds
8 × 8 × 8 2.625 4.5 10.875 10.875
16 × 16 × 16 3.5 6 15.188 15.188
32 × 32 × 32 4.375 7.5 19.594 19.594
64 × 64 × 64 5.25 9 24.047 24.047

of multiplications associated with the 3-D DCT VR algorithm is less than that associated with the RCF approach by more than 40%. In addition, the RCF approach involves matrix transpose and more indexing and data swapping than the new VR algorithm. This makes the 3-D DCT VR algorithm more efficient and better suited for 3-D applications that involve the 3-D DCT-II such as video compression and other 3-D image processing applications.

The main consideration in choosing a fast algorithm is to avoid computational and structural complexities. As the technology of computers and DSPs advances, the execution time of arithmetic operations (multiplications and additions) is becoming very fast, and regular computational structure becomes the most important factor.[110] Therefore, although the above proposed 3-D VR algorithm does not achieve the theoretical lower bound on the number of multiplications,[111] it has a simpler computational structure as compared to other 3-D DCT algorithms. It can be implemented in place using a single butterfly and possesses the properties of the Cooley–Tukey FFT algorithm in 3-D. Hence, the 3-D VR presents a good choice for reducing arithmetic operations in the calculation of the 3-D DCT-II, while keeping the simple structure that characterize butterfly-style Cooley–Tukey FFT algorithms.

 
Two-dimensional DCT frequencies from the JPEG DCT

The image to the right shows a combination of horizontal and vertical frequencies for an 8 × 8   two-dimensional DCT. Each step from left to right and top to bottom is an increase in frequency by 1/2 cycle. For example, moving right one from the top-left square yields a half-cycle increase in the horizontal frequency. Another move to the right yields two half-cycles. A move down yields two half-cycles horizontally and a half-cycle vertically. The source data ( 8×8 ) is transformed to a linear combination of these 64 frequency squares.

MD-DCT-IV

The M-D DCT-IV is just an extension of 1-D DCT-IV on to M dimensional domain. The 2-D DCT-IV of a matrix or an image is given by

 
for   and  

We can compute the MD DCT-IV using the regular row-column method or we can use the polynomial transform method[112] for the fast and efficient computation. The main idea of this algorithm is to use the Polynomial Transform to convert the multidimensional DCT into a series of 1-D DCTs directly. MD DCT-IV also has several applications in various fields.

Computation

Although the direct application of these formulas would require   operations, it is possible to compute the same thing with only   complexity by factorizing the computation similarly to the fast Fourier transform (FFT). One can also compute DCTs via FFTs combined with   pre- and post-processing steps. In general,   methods to compute DCTs are known as fast cosine transform (FCT) algorithms.

The most efficient algorithms, in principle, are usually those that are specialized directly for the DCT, as opposed to using an ordinary FFT plus   extra operations (see below for an exception). However, even "specialized" DCT algorithms (including all of those that achieve the lowest known arithmetic counts, at least for power-of-two sizes) are typically closely related to FFT algorithms – since DCTs are essentially DFTs of real-even data, one can design a fast DCT algorithm by taking an FFT and eliminating the redundant operations due to this symmetry. This can even be done automatically (Frigo & Johnson 2005). Algorithms based on the Cooley–Tukey FFT algorithm are most common, but any other FFT algorithm is also applicable. For example, the Winograd FFT algorithm leads to minimal-multiplication algorithms for the DFT, albeit generally at the cost of more additions, and a similar algorithm was proposed by (Feig & Winograd 1992a) for the DCT. Because the algorithms for DFTs, DCTs, and similar transforms are all so closely related, any improvement in algorithms for one transform will theoretically lead to immediate gains for the other transforms as well (Duhamel & Vetterli 1990).

While DCT algorithms that employ an unmodified FFT often have some theoretical overhead compared to the best specialized DCT algorithms, the former also have a distinct advantage: Highly optimized FFT programs are widely available. Thus, in practice, it is often easier to obtain high performance for general lengths N with FFT-based algorithms.[a] Specialized DCT algorithms, on the other hand, see widespread use for transforms of small, fixed sizes such as the 8 × 8 DCT-II used in JPEG compression, or the small DCTs (or MDCTs) typically used in audio compression. (Reduced code size may also be a reason to use a specialized DCT for embedded-device applications.)

In fact, even the DCT algorithms using an ordinary FFT are sometimes equivalent to pruning the redundant operations from a larger FFT of real-symmetric data, and they can even be optimal from the perspective of arithmetic counts. For example, a type-II DCT is equivalent to a DFT of size   with real-even symmetry whose even-indexed elements are zero. One of the most common methods for computing this via an FFT (e.g. the method used in FFTPACK and FFTW) was described by Narasimha & Peterson (1978) and Makhoul (1980), and this method in hindsight can be seen as one step of a radix-4 decimation-in-time Cooley–Tukey algorithm applied to the "logical" real-even DFT corresponding to the DCT-II.[b] Because the even-indexed elements are zero, this radix-4 step is exactly the same as a split-radix step. If the subsequent size   real-data FFT is also performed by a real-data split-radix algorithm (as in Sorensen et al. (1987)), then the resulting algorithm actually matches what was long the lowest published arithmetic count for the power-of-two DCT-II (  real-arithmetic operations[c]).

A recent reduction in the operation count to   also uses a real-data FFT.[113] So, there is nothing intrinsically bad about computing the DCT via an FFT from an arithmetic perspective – it is sometimes merely a question of whether the corresponding FFT algorithm is optimal. (As a practical matter, the function-call overhead in invoking a separate FFT routine might be significant for small   but this is an implementation rather than an algorithmic question since it can be solved by unrolling or inlining.)

Example of IDCT

 
An example showing eight different filters applied to a test image (top left) by multiplying its DCT spectrum (top right) with each filter.

Consider this 8x8 grayscale image of capital letter A.

 
Original size, scaled 10x (nearest neighbor), scaled 10x (bilinear).
 
Basis functions of the discrete cosine transformation with corresponding coefficients (specific for our image).
DCT of the image =  .

Each basis function is multiplied by its coefficient and then this product is added to the final image.

 
On the left is the final image. In the middle is the weighted function (multiplied by a coefficient) which is added to the final image. On the right is the current function and corresponding coefficient. Images are scaled (using bilinear interpolation) by factor 10×.

See also

Notes

  1. ^ Algorithmic performance on modern hardware is typically not principally determined by simple arithmetic counts, and optimization requires substantial engineering effort to make best use, within its intrinsic limits, of available built-in hardware optimization.
  2. ^ The radix-4 step reduces the size   DFT to four size   DFTs of real data, two of which are zero, and two of which are equal to one another by the even symmetry. Hence giving a single size   FFT of real data plus   butterflies, once the trivial and / or duplicate parts are eliminated and / or merged.
  3. ^ The precise count of real arithmetic operations, and in particular the count of real multiplications, depends somewhat on the scaling of the transform definition. The   count is for the DCT-II definition shown here; two multiplications can be saved if the transform is scaled by an overall   factor. Additional multiplications can be saved if one permits the outputs of the transform to be rescaled individually, as was shown by Arai, Agui & Nakajima (1988) for the size-8 case used in JPEG.

References

  1. ^ a b c d e f g h i j k l m n o p q r s t u v w x y z aa ab ac Stanković, Radomir S.; Astola, Jaakko T. (2012). "Reminiscences of the Early Work in DCT: Interview with K.R. Rao" (PDF). Reprints from the Early Days of Information Sciences. Tampere International Center for Signal Processing. 60. ISBN 978-9521528187. ISSN 1456-2774. (PDF) from the original on 30 December 2021. Retrieved 30 December 2021 – via ETHW.
  2. ^ a b c d e Britanak, Vladimir; Yip, Patrick C.; Rao, K. R. (6 November 2006). Discrete Cosine and Sine Transforms: General Properties, Fast Algorithms and Integer Approximations. Academic Press. ISBN 978-0123736246. LCCN 2006931102. OCLC 220853454. OL 18495589M. S2CID 118873224.
  3. ^ a b c d Alikhani, Darya (April 1, 2015). "Beyond resolution: Rosa Menkman's glitch art". POSTmatter. Retrieved 19 October 2019.
  4. ^ a b c d e f Thomson, Gavin; Shah, Athar (2017). "Introducing HEIF and HEVC" (PDF). Apple Inc. Retrieved 5 August 2019.
  5. ^ a b c d e f Ahmed, Nasir; Natarajan, T. Raj; Rao, K.R. (1 January 1974). "Discrete Cosine Transform". IEEE Transactions on Computers. IEEE Computer Society. C-23 (1): 90–93. doi:10.1109/T-C.1974.223784. eISSN 1557-9956. ISSN 0018-9340. LCCN 75642478. OCLC 1799331. S2CID 206619973.
  6. ^ a b c d e f Rao, K. Ramamohan; Yip, Patrick C. (11 September 1990). Discrete Cosine Transform: Algorithms, Advantages, Applications. Signal, Image and Speech Processing. Academic Press. arXiv:1109.0337. doi:10.1016/c2009-0-22279-3. ISBN 978-0125802031. LCCN 89029800. OCLC 1008648293. OL 2207570M. S2CID 12270940.
  7. ^ a b c d e f g Barbero, M.; Hofmann, H.; Wells, N. D. (14 November 1991). "DCT source coding and current implementations for HDTV". EBU Technical Review. European Broadcasting Union (251): 22–33. Retrieved 4 November 2019.
  8. ^ a b c d e f Lea, William (1994). "Video on demand: Research Paper 94/68". House of Commons Library. Retrieved 20 September 2019.
  9. ^ a b c Ahmed, Nasir (January 1991). "How I Came Up With the Discrete Cosine Transform". Digital Signal Processing. 1 (1): 4–5. doi:10.1016/1051-2004(91)90086-Z.
  10. ^ a b c d e "T.81 – Digital compression and coding of continuous-tone still images – Requirements and guidelines" (PDF). CCITT. September 1992. Retrieved 12 July 2019.
  11. ^ Selected Papers on Visual Communication: Technology and Applications, (SPIE Press Book), Editors T. Russell Hsing and Andrew G. Tescher, April 1990, pp. 145-149 [1].
  12. ^ Selected Papers and Tutorial in Digital Image Processing and Analysis, Volume 1, Digital Image Processing and Analysis, (IEEE Computer Society Press), Editors R. Chellappa and A. A. Sawchuk, June 1985, p. 47.
  13. ^ DCT citations via Google Scholar [2].
  14. ^ Chen, Wen-Hsiung; Smith, C. H.; Fralick, S. C. (September 1977). "A Fast Computational Algorithm for the Discrete Cosine Transform". IEEE Transactions on Communications. 25 (9): 1004–1009. doi:10.1109/TCOM.1977.1093941.
  15. ^ Smith, C.; Fralick, S. (1977). "A Fast Computational Algorithm for the Discrete Cosine Transform". IEEE Transactions on Communications. 25 (9): 1004–1009. doi:10.1109/TCOM.1977.1093941. ISSN 0090-6778.
  16. ^ Huang, T. S. (1981). Image Sequence Analysis. Springer Science & Business Media. p. 29. ISBN 9783642870378.
  17. ^ Roese, John A.; Robinson, Guner S. (30 October 1975). "Combined Spatial And Temporal Coding Of Digital Image Sequences". Efficient Transmission of Pictorial Information. International Society for Optics and Photonics. 0066: 172–181. Bibcode:1975SPIE...66..172R. doi:10.1117/12.965361. S2CID 62725808.
  18. ^ Cianci, Philip J. (2014). High Definition Television: The Creation, Development and Implementation of HDTV Technology. McFarland. p. 63. ISBN 9780786487974.
  19. ^ a b c "History of Video Compression". ITU-T. Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6). July 2002. pp. 11, 24–9, 33, 40–1, 53–6. Retrieved 3 November 2019.
  20. ^ a b c Ghanbari, Mohammed (2003). Standard Codecs: Image Compression to Advanced Video Coding. Institution of Engineering and Technology. pp. 1–2. ISBN 9780852967102.
  21. ^ Li, Jian Ping (2006). Proceedings of the International Computer Conference 2006 on Wavelet Active Media Technology and Information Processing: Chongqing, China, 29-31 August 2006. World Scientific. p. 847. ISBN 9789812709998.
  22. ^ a b c Wang, Hanli; Kwong, S.; Kok, C. (2006). "Efficient prediction algorithm of integer DCT coefficients for H.264/AVC optimization". IEEE Transactions on Circuits and Systems for Video Technology. 16 (4): 547–552. doi:10.1109/TCSVT.2006.871390. S2CID 2060937.
  23. ^ Princen, John P.; Johnson, A.W.; Bradley, Alan B. (1987). "Subband/Transform coding using filter bank designs based on time domain aliasing cancellation". ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing. 12: 2161–2164. doi:10.1109/ICASSP.1987.1169405. S2CID 58446992.
  24. ^ Princen, J.; Bradley, A. (1986). "Analysis/Synthesis filter bank design based on time domain aliasing cancellation". IEEE Transactions on Acoustics, Speech, and Signal Processing. 34 (5): 1153–1161. doi:10.1109/TASSP.1986.1164954.
  25. ^ a b c d e f g h i j k Luo, Fa-Long (2008). Mobile Multimedia Broadcasting Standards: Technology and Practice. Springer Science & Business Media. p. 590. ISBN 9780387782638.
  26. ^ a b Britanak, V. (2011). "On Properties, Relations, and Simplified Implementation of Filter Banks in the Dolby Digital (Plus) AC-3 Audio Coding Standards". IEEE Transactions on Audio, Speech, and Language Processing. 19 (5): 1231–1241. doi:10.1109/TASL.2010.2087755. S2CID 897622.
  27. ^ a b Guckert, John (Spring 2012). "The Use of FFT and MDCT in MP3 Audio Compression" (PDF). University of Utah. Retrieved 14 July 2019.
  28. ^ a b Brandenburg, Karlheinz (1999). "MP3 and AAC Explained" (PDF). (PDF) from the original on 2017-02-13.
  29. ^ a b Xiph.Org Foundation (2009-06-02). "Vorbis I specification - 1.1.2 Classification". Xiph.Org Foundation. Retrieved 2009-09-22.
  30. ^ Dhamija, Swati; Jain, Priyanka (September 2011). "Comparative Analysis for Discrete Sine Transform as a suitable method for noise estimation". IJCSI International Journal of Computer Science. 8 (5, No. 3): 162–164 (162). Retrieved 4 November 2019.
  31. ^ Mandyam, Giridhar D.; Ahmed, Nasir; Magotra, Neeraj (17 April 1995). "DCT-based scheme for lossless image compression". Digital Video Compression: Algorithms and Technologies 1995. International Society for Optics and Photonics. 2419: 474–478. Bibcode:1995SPIE.2419..474M. doi:10.1117/12.206386. S2CID 13894279.
  32. ^ Komatsu, K.; Sezaki, Kaoru (1998). "Reversible discrete cosine transform". Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181). 3: 1769–1772 vol.3. doi:10.1109/ICASSP.1998.681802. ISBN 0-7803-4428-6. S2CID 17045923.
  33. ^ Muchahary, D.; Mondal, A. J.; Parmar, R. S.; Borah, A. D.; Majumder, A. (2015). "A Simplified Design Approach for Efficient Computation of DCT". 2015 Fifth International Conference on Communication Systems and Network Technologies: 483–487. doi:10.1109/CSNT.2015.134. ISBN 978-1-4799-1797-6. S2CID 16411333.
  34. ^ Chen, Wai Kai (2004). The Electrical Engineering Handbook. Elsevier. p. 906. ISBN 9780080477480.
  35. ^ a b c "What Is a JPEG? The Invisible Object You See Every Day". The Atlantic. 24 September 2013. Retrieved 13 September 2019.
  36. ^ a b c Pessina, Laure-Anne (12 December 2014). "JPEG changed our world". EPFL News. École Polytechnique Fédérale de Lausanne. Retrieved 13 September 2019.
  37. ^ a b Lee, Ruby Bei-Loh; Beck, John P.; Lamb, Joel; Severson, Kenneth E. (April 1995). "Real-time software MPEG video decoder on multimedia-enhanced PA 7100LC processors" (PDF). Hewlett-Packard Journal. 46 (2). ISSN 0018-1153.
  38. ^ a b c Lee, Jack (2005). Scalable Continuous Media Streaming Systems: Architecture, Design, Analysis and Implementation. John Wiley & Sons. p. 25. ISBN 9780470857649.
  39. ^ a b c Shishikui, Yoshiaki; Nakanishi, Hiroshi; Imaizumi, Hiroyuki (October 26–28, 1993). "An HDTV Coding Scheme using Adaptive-Dimension DCT". Signal Processing of HDTV: Proceedings of the International Workshop on HDTV '93, Ottawa, Canada. Elsevier: 611–618. doi:10.1016/B978-0-444-81844-7.50072-3. ISBN 9781483298511.
  40. ^ a b Ochoa-Dominguez, Humberto; Rao, K. R. (2019). Discrete Cosine Transform, Second Edition. CRC Press. pp. 1–3, 129. ISBN 9781351396486.
  41. ^ a b c d e f g h i j k l m n o p q r s t u v w x y z aa ab ac ad ae Ochoa-Dominguez, Humberto; Rao, K. R. (2019). Discrete Cosine Transform, Second Edition. CRC Press. pp. 1–3. ISBN 9781351396486.
  42. ^ a b c d e Britanak, Vladimir; Rao, K. R. (2017). Cosine-/Sine-Modulated Filter Banks: General Properties, Fast Algorithms and Integer Approximations. Springer. p. 478. ISBN 9783319610801.
  43. ^ a b Jones, Graham A.; Layer, David H.; Osenkowsky, Thomas G. (2013). National Association of Broadcasters Engineering Handbook: NAB Engineering Handbook. Taylor & Francis. pp. 558–9. ISBN 978-1-136-03410-7.
  44. ^ a b c Hersent, Olivier; Petit, Jean-Pierre; Gurle, David (2005). Beyond VoIP Protocols: Understanding Voice Technology and Networking Techniques for IP Telephony. John Wiley & Sons. p. 55. ISBN 9780470023631.
  45. ^ a b c d e Daniel Eran Dilger (June 8, 2010). "Inside iPhone 4: FaceTime video calling". AppleInsider. Retrieved June 9, 2010.
  46. ^ a b c d Netflix Technology Blog (19 April 2017). "More Efficient Mobile Encodes for Netflix Downloads". Medium.com. Netflix. Retrieved 20 October 2019.
  47. ^ a b "Video Developer Report 2019" (PDF). Bitmovin. 2019. Retrieved 5 November 2019.
  48. ^ Ochoa-Dominguez, Humberto; Rao, K. R. (2019). Discrete Cosine Transform, Second Edition. CRC Press. p. 186. ISBN 9781351396486.
  49. ^ a b c d McKernan, Brian (2005). Digital cinema: the revolution in cinematography, postproduction, distribution. McGraw-Hill. p. 58. ISBN 978-0-07-142963-4. DCT is used in most of the compression systems standardized by the Moving Picture Experts Group (MPEG), is the dominant technology for image compression. In particular, it is the core technology of MPEG-2, the system used for DVDs, digital television broadcasting, that has been used for many of the trials of digital cinema.
  50. ^ a b Baraniuk, Chris (15 October 2015). "Copy protections could come to JPegs". BBC News. BBC. Retrieved 13 September 2019.
  51. ^ Ascher, Steven; Pincus, Edward (2012). The Filmmaker's Handbook: A Comprehensive Guide for the Digital Age: Fifth Edition. Penguin. pp. 246–7. ISBN 978-1-101-61380-1.
  52. ^ Bertalmio, Marcelo (2014). Image Processing for Cinema. CRC Press. p. 95. ISBN 978-1-4398-9928-1.
  53. ^ Zhang, HongJiang (1998). "Content-Based Video Browsing And Retrieval". In Furht, Borko (ed.). Handbook of Internet and Multimedia Systems and Applications. CRC Press. pp. 83–108 (89). ISBN 9780849318580.
  54. ^ a b "Apple ProRes 422 Codec Family". Library of Congress. 17 November 2014. Retrieved 13 October 2019.
  55. ^ Potluri, U. S.; Madanayake, A.; Cintra, R. J.; Bayer, F. M.; Rajapaksha, N. (17 October 2012). "Multiplier-free DCT approximations for RF multi-beam digital aperture-array space imaging and directional sensing". Measurement Science and Technology. 23 (11): 114003. doi:10.1088/0957-0233/23/11/114003. ISSN 0957-0233. S2CID 119888170.
  56. ^ Hudson, Graham; Léger, Alain; Niss, Birger; Sebestyén, István; Vaaben, Jørgen (31 August 2018). "JPEG-1 standard 25 years: past, present, and future reasons for a success". Journal of Electronic Imaging. 27 (4): 1. doi:10.1117/1.JEI.27.4.040901.
  57. ^ "The JPEG image format explained". BT.com. BT Group. 31 May 2018. Retrieved 5 August 2019.
  58. ^ "HEIF Comparison - High Efficiency Image File Format". Nokia Technologies. Retrieved 5 August 2019.
  59. ^ Alakuijala, Jyrki; Sneyers, Jon; Versari, Luca; Wassenberg, Jan (22 January 2021). "JPEG XL White Paper" (PDF). JPEG Org. (PDF) from the original on 2 May 2021. Retrieved 14 Jan 2022. Variable-sized DCT (square or rectangular from 2x2 to 256x256) serves as a fast approximation of the optimal decorrelating transform.
  60. ^ a b Wang, Yao (2006). (PDF). Archived from the original (PDF) on 2013-01-23.
  61. ^ Wang, Yao (2006). (PDF). Archived from the original (PDF) on 2013-01-23.
  62. ^ Hoffman, Roy (2012). Data Compression in Digital Systems. Springer Science & Business Media. p. 255. ISBN 9781461560319.
  63. ^ a b Rao, K.R.; Hwang, J. J. (18 July 1996). Techniques and Standards for Image, Video, and Audio Coding. Prentice Hall. JPEG: Chapter 8; H.261: Chapter 9; MPEG-1: Chapter 10; MPEG-2: Chapter 11. ISBN 978-0133099072. LCCN 96015550. OCLC 34617596. OL 978319M. S2CID 56983045.
  64. ^ Davis, Andrew (13 June 1997). "The H.320 Recommendation Overview". EE Times. Retrieved 7 November 2019.
  65. ^ IEEE WESCANEX 97: communications, power, and computing : conference proceedings. University of Manitoba, Winnipeg, Manitoba, Canada: Institute of Electrical and Electronics Engineers. May 22–23, 1997. p. 30. ISBN 9780780341470. H.263 is similar to, but more complex than H.261. It is currently the most widely used international video compression standard for video telephony on ISDN (Integrated Services Digital Network) telephone lines.
  66. ^ Peter de Rivaz; Jack Haughton (2018). "AV1 Bitstream & Decoding Process Specification" (PDF). Alliance for Open Media. Retrieved 2022-01-14.
  67. ^ YouTube Developers (15 September 2018). "AV1 Beta Launch Playlist". YouTube. Retrieved 14 January 2022. The first videos to receive YouTube's AV1 transcodes.
  68. ^ Brinkmann, Martin (13 September 2018). "How to enable AV1 support on YouTube". Retrieved 14 January 2022.
  69. ^ Netflix Technology Blog (5 February 2020). "Netflix Now Streaming AV1 on Android". Retrieved 14 January 2022.
  70. ^ Netflix Technology Blog (9 November 2021). "Bringing AV1 Streaming to Netflix Members' TVs". Retrieved 14 January 2022.
  71. ^ Herre, J.; Dietz, M. (2008). "MPEG-4 high-efficiency AAC coding [Standards in a Nutshell]". IEEE Signal Processing Magazine. 25 (3): 137–142. Bibcode:2008ISPM...25..137H. doi:10.1109/MSP.2008.918684.
  72. ^ Valin, Jean-Marc; Maxwell, Gregory; Terriberry, Timothy B.; Vos, Koen (October 2013). High-Quality, Low-Delay Music Coding in the Opus Codec. 135th AES Convention. Audio Engineering Society. arXiv:1602.04845.
  73. ^ "Opus Codec". Opus (Home page). Xiph.org Foundation. Retrieved July 31, 2012.
  74. ^ Leyden, John (27 October 2015). "WhatsApp laid bare: Info-sucking app's innards probed". The Register. Retrieved 19 October 2019.
  75. ^ Hazra, Sudip; Mateti, Prabhaker (September 13–16, 2017). "Challenges in Android Forensics". In Thampi, Sabu M.; Pérez, Gregorio Martínez; Westphall, Carlos Becker; Hu, Jiankun; Fan, Chun I.; Mármol, Félix Gómez (eds.). Security in Computing and Communications: 5th International Symposium, SSCC 2017. Springer. pp. 286–299 (290). doi:10.1007/978-981-10-6898-0_24. ISBN 9789811068980.
  76. ^ Srivastava, Saurabh Ranjan; Dube, Sachin; Shrivastaya, Gulshan; Sharma, Kavita (2019). "Smartphone Triggered Security Challenges: Issues, Case Studies and Prevention". In Le, Dac-Nhuong; Kumar, Raghvendra; Mishra, Brojo Kishore; Chatterjee, Jyotir Moy; Khari, Manju (eds.). Cyber Security in Parallel and Distributed Computing: Concepts, Techniques, Applications and Case Studies. Cyber Security in Parallel and Distributed Computing. John Wiley & Sons. pp. 187–206 (200). doi:10.1002/9781119488330.ch12. ISBN 9781119488057. S2CID 214034702.
  77. ^ "Open Source Software used in PlayStation 4". Sony Interactive Entertainment Inc. Retrieved 2017-12-11.
  78. ^ "Dolby AC-4: Audio Delivery for Next-Generation Entertainment Services" (PDF). Dolby Laboratories. June 2015. Retrieved 11 November 2019.
  79. ^ Bleidt, R. L.; Sen, D.; Niedermeier, A.; Czelhan, B.; Füg, S.; et al. (2017). "Development of the MPEG-H TV Audio System for ATSC 3.0" (PDF). IEEE Transactions on Broadcasting. 63 (1): 202–236. doi:10.1109/TBC.2017.2661258. S2CID 30821673.
  80. ^ Schnell, Markus; Schmidt, Markus; Jander, Manuel; Albert, Tobias; Geiger, Ralf; Ruoppila, Vesa; Ekstrand, Per; Bernhard, Grill (October 2008). MPEG-4 Enhanced Low Delay AAC - A New Standard for High Quality Communication (PDF). 125th AES Convention. Fraunhofer IIS. Audio Engineering Society. Retrieved 20 October 2019.
  81. ^ Lutzky, Manfred; Schuller, Gerald; Gayer, Marc; Krämer, Ulrich; Wabnik, Stefan (May 2004). A guideline to audio codec delay (PDF). 116th AES Convention. Fraunhofer IIS. Audio Engineering Society. Retrieved 24 October 2019.
  82. ^ a b Nagireddi, Sivannarayana (2008). VoIP Voice and Fax Signal Processing. John Wiley & Sons. p. 69. ISBN 9780470377864.
  83. ^ "ITU-T Work Programme". ITU.
  84. ^ Terriberry, Timothy B. Presentation of the CELT codec. Event occurs at 65 minutes., also "CELT codec presentation slides" (PDF).
  85. ^ "Ekiga 3.1.0 available".
  86. ^ "☏ FreeSWITCH". SignalWire.
  87. ^ "Enhanced Voice Services (EVS) Codec" (PDF). Fraunhofer IIS. March 2017. Retrieved 19 October 2019.
  88. ^ Abousleman, G. P.; Marcellin, M. W.; Hunt, B. R. (January 1995), "Compression of hyperspectral imagery using 3-D DCT and hybrid DPCM/DCT", IEEE Trans. Geosci. Remote Sens., 33 (1): 26–34, Bibcode:1995ITGRS..33...26A, doi:10.1109/36.368225
  89. ^ Chan, Y.; Siu, W. (May 1997), "Variable temporal-length 3-D discrete cosine transform coding" (PDF), IEEE Trans. Image Processing., 6 (5): 758–763, Bibcode:1997ITIP....6..758C, CiteSeerX 10.1.1.516.2824, doi:10.1109/83.568933, hdl:10397/1928, PMID 18282969
  90. ^ Song, J.; SXiong, Z.; Liu, X.; Liu, Y., "An algorithm for layered video coding and transmission", Proc. Fourth Int. Conf./Exh. High Performance Comput. Asia-Pacific Region, 2: 700–703
  91. ^ Tai, S.-C; Gi, Y.; Lin, C.-W. (September 2000), "An adaptive 3-D discrete cosine transform coder for medical image compression", IEEE Trans. Inf. Technol. Biomed., 4 (3): 259–263, doi:10.1109/4233.870036, PMID 11026596, S2CID 18016215
  92. ^ Yeo, B.; Liu, B. (May 1995), "Volume rendering of DCT-based compressed 3D scalar data", IEEE Trans. Comput. Graphics., 1: 29–43, doi:10.1109/2945.468390
  93. ^ Chan, S.C.; Liu, W.; Ho, K.I. (2000). "Perfect reconstruction modulated filter banks with sum of powers-of-two coefficients". 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353). Vol. 2. pp. 73–76. doi:10.1109/ISCAS.2000.856261. hdl:10722/46174. ISBN 0-7803-5482-6. S2CID 1757438.
  94. ^ Queiroz, R. L.; Nguyen, T. Q. (1996). "Lapped transforms for efficient transform/subband coding". IEEE Trans. Signal Process. 44 (5): 497–507.
  95. ^ Malvar 1992.
  96. ^ Chan, S. C.; Luo, L.; Ho, K. L. (1998). "M-Channel compactly supported biorthogonal cosine-modulated wavelet bases". IEEE Trans. Signal Process. 46 (2): 1142–1151. Bibcode:1998ITSP...46.1142C. doi:10.1109/78.668566. hdl:10722/42775.
  97. ^ a b Katsaggelos, Aggelos K.; Babacan, S. Derin; Chun-Jen, Tsai (2009). "Chapter 15 - Iterative Image Restoration". The Essential Guide to Image Processing. Academic Press. pp. 349–383. ISBN 9780123744579.
  98. ^ "Mosquito noise". PC Magazine. Retrieved 19 October 2019.
  99. ^ Menkman, Rosa (October 2011). The Glitch Moment(um) (PDF). Institute of Network Cultures. ISBN 978-90-816021-6-7. Retrieved 19 October 2019.
  100. ^ Ruff, Thomas (May 31, 2009). "jpegs". Aperture. p. 132. ISBN 9781597110938.
  101. ^ Colberg, Jörg (April 17, 2009). "Review: jpegs by Thomas Ruff".
  102. ^ "Discrete cosine transform - MATLAB dct". www.mathworks.com. Retrieved 2019-07-11.
  103. ^ Pennebaker, William B.; Mitchell, Joan L. (31 December 1992). JPEG: Still Image Data Compression Standard. ISBN 9780442012724.
  104. ^ Arai, Y.; Agui, T.; Nakajima, M. (1988). "A fast DCT-SQ scheme for images". IEICE Transactions. 71 (11): 1095–1097.
  105. ^ Shao, Xuancheng; Johnson, Steven G. (2008). "Type-II/III DCT/DST algorithms with reduced number of arithmetic operations". Signal Processing. 88 (6): 1553–1564. arXiv:cs/0703150. doi:10.1016/j.sigpro.2008.01.004. S2CID 986733.
  106. ^ Malvar 1992
  107. ^ Martucci 1994
  108. ^ Chan, S.C.; Ho, K.L. (1990). "Direct methods for computing discrete sinusoidal transforms". IEE Proceedings F - Radar and Signal Processing. 137 (6): 433. doi:10.1049/ip-f-2.1990.0063.
  109. ^ a b Alshibami, O.; Boussakta, S. (July 2001). "Three-dimensional algorithm for the 3-D DCT-III". Proc. Sixth Int. Symp. Commun., Theory Applications: 104–107.
  110. ^ Guoan Bi; Gang Li; Kai-Kuang Ma; Tan, T.C. (2000). "On the computation of two-dimensional DCT". IEEE Transactions on Signal Processing. 48 (4): 1171–1183. Bibcode:2000ITSP...48.1171B. doi:10.1109/78.827550.
  111. ^ Feig, E.; Winograd, S. (July 1992a). "On the multiplicative complexity of discrete cosine transforms". IEEE Transactions on Information Theory. 38 (4): 1387–1391. doi:10.1109/18.144722.
  112. ^ Nussbaumer, H.J. (1981). Fast Fourier transform and convolution algorithms (1st ed.). New York: Springer-Verlag.
  113. ^ Shao, Xuancheng; Johnson, Steven G. (2008). "Type-II/III DCT/DST algorithms with reduced number of arithmetic operations". Signal Processing. 88 (6): 1553–1564. arXiv:cs/0703150. doi:10.1016/j.sigpro.2008.01.004. S2CID 986733.

Further reading

  • Narasimha, M.; Peterson, A. (June 1978). "On the Computation of the Discrete Cosine Transform". IEEE Transactions on Communications. 26 (6): 934–936. doi:10.1109/TCOM.1978.1094144.
  • Makhoul, J. (February 1980). "A fast cosine transform in one and two dimensions". IEEE Transactions on Acoustics, Speech, and Signal Processing. 28 (1): 27–34. doi:10.1109/TASSP.1980.1163351.
  • Sorensen, H.; Jones, D.; Heideman, M.; Burrus, C. (June 1987). "Real-valued fast Fourier transform algorithms". IEEE Transactions on Acoustics, Speech, and Signal Processing. 35 (6): 849–863. CiteSeerX 10.1.1.205.4523. doi:10.1109/TASSP.1987.1165220.
  • Plonka, G.; Tasche, M. (January 2005). "Fast and numerically stable algorithms for discrete cosine transforms". Linear Algebra and Its Applications. 394 (1): 309–345. doi:10.1016/j.laa.2004.07.015.
  • Duhamel, P.; Vetterli, M. (April 1990). "Fast fourier transforms: A tutorial review and a state of the art". Signal Processing (Submitted manuscript). 19 (4): 259–299. doi:10.1016/0165-1684(90)90158-U.
  • Ahmed, N. (January 1991). "How I came up with the discrete cosine transform". Digital Signal Processing. 1 (1): 4–9. doi:10.1016/1051-2004(91)90086-Z.
  • Feig, E.; Winograd, S. (September 1992b). "Fast algorithms for the discrete cosine transform". IEEE Transactions on Signal Processing. 40 (9): 2174–2193. Bibcode:1992ITSP...40.2174F. doi:10.1109/78.157218.
  • Malvar, Henrique (1992), Signal Processing with Lapped Transforms, Boston: Artech House, ISBN 978-0-89006-467-2
  • Martucci, S. A. (May 1994). "Symmetric convolution and the discrete sine and cosine transforms". IEEE Transactions on Signal Processing. 42 (5): 1038–1051. Bibcode:1994ITSP...42.1038M. doi:10.1109/78.295213.
  • Oppenheim, Alan; Schafer, Ronald; Buck, John (1999), Discrete-Time Signal Processing (2nd ed.), Upper Saddle River, N.J: Prentice Hall, ISBN 978-0-13-754920-7
  • Frigo, M.; Johnson, S. G. (February 2005). "The Design and Implementation of FFTW3" (PDF). Proceedings of the IEEE. 93 (2): 216–231. CiteSeerX 10.1.1.66.3097. doi:10.1109/JPROC.2004.840301. S2CID 6644892.
  • Boussakta, Said.; Alshibami, Hamoud O. (April 2004). "Fast Algorithm for the 3-D DCT-II" (PDF). IEEE Transactions on Signal Processing. 52 (4): 992–1000. Bibcode:2004ITSP...52..992B. doi:10.1109/TSP.2004.823472. S2CID 3385296.
  • Cheng, L. Z.; Zeng, Y. H. (2003). "New fast algorithm for multidimensional type-IV DCT". IEEE Transactions on Signal Processing. 51 (1): 213–220. doi:10.1109/TSP.2002.806558.
  • Wen-Hsiung Chen; Smith, C.; Fralick, S. (September 1977). "A Fast Computational Algorithm for the Discrete Cosine Transform". IEEE Transactions on Communications. 25 (9): 1004–1009. doi:10.1109/TCOM.1977.1093941.
  • Press, WH; Teukolsky, SA; Vetterling, WT; Flannery, BP (2007), "Section 12.4.2. Cosine Transform", Numerical Recipes: The Art of Scientific Computing (3rd ed.), New York: Cambridge Unive

discrete, cosine, transform, this, article, misquote, misrepresent, many, sources, please, cleanup, page, more, information, editors, please, remove, this, warning, only, after, diffs, listed, wikipedia, talk, requests, comment, jagged, subpage, here, have, be. This article may misquote or misrepresent many of its sources Please see the cleanup page for more information Editors please remove this warning only after the diffs listed Wikipedia talk Requests for comment Jagged 85 subpage here have been checked for accuracy July 2022 A discrete cosine transform DCT expresses a finite sequence of data points in terms of a sum of cosine functions oscillating at different frequencies The DCT first proposed by Nasir Ahmed in 1972 is a widely used transformation technique in signal processing and data compression It is used in most digital media including digital images such as JPEG and HEIF digital video such as MPEG and H 26x digital audio such as Dolby Digital MP3 and AAC digital television such as SDTV HDTV and VOD digital radio such as AAC and DAB and speech coding such as AAC LD Siren and Opus DCTs are also important to numerous other applications in science and engineering such as digital signal processing telecommunication devices reducing network bandwidth usage and spectral methods for the numerical solution of partial differential equations The use of cosine rather than sine functions is critical for compression since fewer cosine functions are needed to approximate a typical signal whereas for differential equations the cosines express a particular choice of boundary conditions In particular a DCT is a Fourier related transform similar to the discrete Fourier transform DFT but using only real numbers The DCTs are generally related to Fourier series coefficients of a periodically and symmetrically extended sequence whereas DFTs are related to Fourier series coefficients of only periodically extended sequences DCTs are equivalent to DFTs of roughly twice the length operating on real data with even symmetry since the Fourier transform of a real and even function is real and even whereas in some variants the input or output data are shifted by half a sample There are eight standard DCT variants of which four are common The most common variant of discrete cosine transform is the type II DCT which is often called simply the DCT This was the original DCT as first proposed by Ahmed Its inverse the type III DCT is correspondingly often called simply the inverse DCT or the IDCT Two related transforms are the discrete sine transform DST which is equivalent to a DFT of real and odd functions and the modified discrete cosine transform MDCT which is based on a DCT of overlapping data Multidimensional DCTs MD DCTs are developed to extend the concept of DCT to multidimensional signals A variety of fast algorithms have been developed to reduce the computational complexity of implementing DCT One of these is the integer DCT IntDCT 1 an integer approximation of the standard DCT 2 ix xiii 1 141 304 used in several ISO IEC and ITU T international standards 1 2 DCT compression also known as block compression compresses data in sets of discrete DCT blocks 3 DCT blocks sizes including 8x8 pixels for the standard DCT and varied integer DCT sizes between 4x4 and 32x32 pixels 1 4 The DCT has a strong energy compaction property 5 6 capable of achieving high quality at high data compression ratios 7 8 However blocky compression artifacts can appear when heavy DCT compression is applied Contents 1 History 2 Applications 2 1 General applications 2 2 DCT visual media standards 2 2 1 Image formats 2 2 2 Video formats 2 3 MDCT audio standards 2 3 1 General audio 2 3 2 Speech coding 2 4 MD DCT 2 5 Digital signal processing 2 6 Compression artifacts 3 Informal overview 4 Formal definition 4 1 DCT I 4 2 DCT II 4 3 DCT III 4 4 DCT IV 4 5 DCT V VIII 5 Inverse transforms 6 Multidimensional DCTs 6 1 M D DCT II 6 1 1 3 D DCT II VR DIF 6 1 1 1 Arithmetic complexity 6 2 MD DCT IV 7 Computation 8 Example of IDCT 9 See also 10 Notes 11 References 12 Further reading 13 External linksHistory EditThe discrete cosine transform DCT was first conceived by Nasir Ahmed T Natarajan and K R Rao while working at Kansas State University and he proposed the concept to the National Science Foundation in 1972 He originally intended DCT for image compression 9 1 Ahmed developed a practical DCT algorithm with his PhD students T Raj Natarajan Wills Dietrich and Jeremy Fries and his friend Dr K R Rao at the University of Texas at Arlington in 1973 and they found that it was the most efficient algorithm for image compression 9 They presented their results in a January 1974 paper titled Discrete Cosine Transform 5 6 10 It described what is now called the type II DCT DCT II 2 51 as well as the type III inverse DCT IDCT 5 It was a benchmark publication 11 12 and has been cited as a fundamental development in thousands of works since its publication 13 The basic research work and events that led to the development of the DCT were summarized in a later publication by Ahmed How I Came Up with the Discrete Cosine Transform 9 Since its introduction in 1974 there has been significant research on the DCT 10 In 1977 Wen Hsiung Chen published a paper with C Harrison Smith and Stanley C Fralick presenting a fast DCT algorithm 14 10 Further developments include a 1978 paper by M J Narasimha and A M Peterson and a 1984 paper by B G Lee 10 These research papers along with the original 1974 Ahmed paper and the 1977 Chen paper were cited by the Joint Photographic Experts Group as the basis for JPEG s lossy image compression algorithm in 1992 10 15 In 1975 John A Roese and Guner S Robinson adapted the DCT for inter frame motion compensated video coding They experimented with the DCT and the fast Fourier transform FFT developing inter frame hybrid coders for both and found that the DCT is the most efficient due to its reduced complexity capable of compressing image data down to 0 25 bit per pixel for a videotelephone scene with image quality comparable to an intra frame coder requiring 2 bit per pixel 16 17 In 1979 Anil K Jain and Jaswant R Jain further developed motion compensated DCT video compression 18 19 also called block motion compensation 19 This led to Chen developing a practical video compression algorithm called motion compensated DCT or adaptive scene coding in 1981 19 Motion compensated DCT later became the standard coding technique for video compression from the late 1980s onwards 20 21 The integer DCT is used in Advanced Video Coding AVC 22 1 introduced in 2003 and High Efficiency Video Coding HEVC 4 1 introduced in 2013 The integer DCT is also used in the High Efficiency Image Format HEIF which uses a subset of the HEVC video coding format for coding still images 4 A DCT variant the modified discrete cosine transform MDCT was developed by John P Princen A W Johnson and Alan B Bradley at the University of Surrey in 1987 23 following earlier work by Princen and Bradley in 1986 24 The MDCT is used in most modern audio compression formats such as Dolby Digital AC 3 25 26 MP3 which uses a hybrid DCT FFT algorithm 27 Advanced Audio Coding AAC 28 and Vorbis Ogg 29 The discrete sine transform DST was derived from the DCT by replacing the Neumann condition at x 0 with a Dirichlet condition 2 35 36 The DST was described in the 1974 DCT paper by Ahmed Natarajan and Rao 5 A type I DST DST I was later described by Anil K Jain in 1976 and a type II DST DST II was then described by H B Kekra and J K Solanka in 1978 30 Nasir Ahmed also developed a lossless DCT algorithm with Giridhar Mandyam and Neeraj Magotra at the University of New Mexico in 1995 This allows the DCT technique to be used for lossless compression of images It is a modification of the original DCT algorithm and incorporates elements of inverse DCT and delta modulation It is a more effective lossless compression algorithm than entropy coding 31 Lossless DCT is also known as LDCT 32 Applications EditThe DCT is the most widely used transformation technique in signal processing 33 and by far the most widely used linear transform in data compression 34 Uncompressed digital media as well as lossless compression had impractically high memory and bandwidth requirements which was significantly reduced by the highly efficient DCT lossy compression technique 7 8 capable of achieving data compression ratios from 8 1 to 14 1 for near studio quality 7 up to 100 1 for acceptable quality content 8 DCT compression standards are used in digital media technologies such as digital images digital photos 35 36 digital video 20 37 streaming media 38 digital television streaming television video on demand VOD 8 digital cinema 25 high definition video HD video and high definition television HDTV 7 39 The DCT and in particular the DCT II is often used in signal and image processing especially for lossy compression because it has a strong energy compaction property 5 6 in typical applications most of the signal information tends to be concentrated in a few low frequency components of the DCT For strongly correlated Markov processes the DCT can approach the compaction efficiency of the Karhunen Loeve transform which is optimal in the decorrelation sense As explained below this stems from the boundary conditions implicit in the cosine functions DCTs are also widely employed in solving partial differential equations by spectral methods where the different variants of the DCT correspond to slightly different even odd boundary conditions at the two ends of the array DCTs are also closely related to Chebyshev polynomials and fast DCT algorithms below are used in Chebyshev approximation of arbitrary functions by series of Chebyshev polynomials for example in Clenshaw Curtis quadrature The DCT is the coding standard for multimedia telecommunication devices It is widely used for bit rate reduction and reducing network bandwidth usage 1 DCT compression significantly reduces the amount of memory and bandwidth required for digital signals 8 General applications Edit The DCT is widely used in many applications which include the following Audio signal processing audio coding audio data compression lossy and lossless 40 surround sound 25 acoustic echo and feedback cancellation phoneme recognition time domain aliasing cancellation TDAC 41 Digital audio 1 Digital radio Digital Audio Broadcasting DAB 42 HD Radio 43 Speech processing speech coding 44 45 speech recognition voice activity detection VAD 41 Digital telephony voice over IP VoIP 44 mobile telephony video telephony 45 teleconferencing videoconferencing 1 Biometrics fingerprint orientation facial recognition systems biometric watermarking fingerprint based biometric watermarking palm print identification recognition 41 Face detection facial recognition 41 Computers and the Internet the World Wide Web social media 35 36 Internet video 46 Network bandwidth usage reducation 1 Consumer electronics 41 multimedia systems 1 multimedia telecommunication devices 1 consumer devices 46 Cryptography encryption steganography copyright protection 41 Data compression transform coding lossy compression lossless compression 40 Encoding operations quantization perceptual weighting entropy encoding variable encoding 1 Digital media 38 digital distribution 47 Streaming media 38 streaming audio streaming video streaming television video on demand VOD 8 Forgery detection 41 Geophysical transient electromagnetics transient EM 41 Images artist identification 41 focus and blurriness measure 41 feature extraction 41 Color formatting formatting luminance and color differences color formats such as YUV444 and YUV411 decoding operations such as the inverse operation between display color formats YIQ YUV RGB 1 Digital imaging digital images digital cameras digital photography 35 36 high dynamic range imaging HDR imaging 48 Image compression 41 49 image file formats 50 multiview image compression progressive image transmission 41 Image processing digital image processing 1 image analysis content based image retrieval corner detection directional block wise image representation edge detection image enhancement image fusion image segmentation interpolation image noise level estimation mirroring rotation just noticeable distortion JND profile spatiotemporal masking effects foveated imaging 41 Image quality assessment DCT based quality degradation metric DCT QM 41 Image reconstruction directional textures auto inspection image restoration inpainting visual recovery 41 Medical technology Electrocardiography ECG vectorcardiography VCG 41 Medical imaging medical image compression image fusion watermarking brain tumor compression classification 41 Pattern recognition 41 Region of interest ROI extraction 41 Signal processing digital signal processing digital signal processors DSP DSP software multiplexing signaling control signals analog to digital conversion ADC 1 compressive sampling DCT pyramid error concealment downsampling upsampling signal to noise ratio SNR estimation transmux Wiener filter 41 Complex cepstrum feature analysis 41 DCT filtering 41 Surveillance 41 Vehicular black box camera 41 Video Digital cinema 49 digital cinematography digital movie cameras video editing film editing 51 52 Dolby Digital audio 1 25 Digital television DTV 7 digital television broadcasting 49 standard definition television SDTV high definition TV HDTV 7 39 HDTV encoder decoder chips ultra HDTV UHDTV 1 Digital video 20 37 digital versatile disc DVD 49 high definition HD video 7 39 Video coding video compression 1 video coding standards 41 motion estimation motion compensation inter frame prediction motion vectors 1 3D video coding local distortion detection probability LDDP model moving object detection Multiview Video Coding MVC 41 Video processing motion analysis 3D DCT motion analysis video content analysis data extraction 41 video browsing 53 professional video production 54 Watermarking digital watermarking image watermarking video watermarking 3D video watermarking reversible data hiding watermarking detection 41 Wireless technology Mobile devices 46 mobile phones smartphones 45 videophones 1 Radio frequency RF technology RF engineering aperture arrays 41 beamforming digital arithmetic circuits directional sensing space imaging 55 Wireless sensor network WSN wireless acoustic sensor networks 41 DCT visual media standards Edit Further information JPEG Discrete cosine transform The DCT II also known as simply the DCT is the most important image compression technique citation needed It is used in image compression standards such as JPEG and video compression standards such as H 26x MJPEG MPEG DV Theora and Daala There the two dimensional DCT II of N N displaystyle N times N blocks are computed and the results are quantized and entropy coded In this case N displaystyle N is typically 8 and the DCT II formula is applied to each row and column of the block The result is an 8 8 transform coefficient array in which the 0 0 displaystyle 0 0 element top left is the DC zero frequency component and entries with increasing vertical and horizontal index values represent higher vertical and horizontal spatial frequencies Advanced Video Coding AVC uses the integer DCT 22 1 IntDCT an integer approximation of the DCT 2 1 It uses 4x4 and 8x8 integer DCT blocks High Efficiency Video Coding HEVC and the High Efficiency Image Format HEIF use varied integer DCT block sizes between 4x4 and 32x32 pixels 4 1 As of 2019 update AVC is by far the most commonly used format for the recording compression and distribution of video content used by 91 of video developers followed by HEVC which is used by 43 of developers 47 Image formats Edit Image compression standard Year Common applicationsJPEG 1 1992 The most widely used image compression standard 56 57 and digital image format 50 JPEG XR 2009 Open XML Paper SpecificationWebP 2010 A graphic format that supports the lossy compression of digital images Developed by Google High Efficiency Image Format HEIF 2013 Image file format based on HEVC compression It improves compression over JPEG 4 and supports animation with much more efficient compression than the animated GIF format 58 BPG 2014 Based on HEVC compressionJPEG XL 59 2020 A royalty free raster graphics file format that supports both lossy and lossless compression Video formats Edit Video coding standard Year Common applicationsH 261 60 61 1988 First of a family of video coding standards Used primarily in older video conferencing and video telephone products Motion JPEG MJPEG 62 1992 QuickTime video editing non linear editing digital camerasMPEG 1 Video 63 1993 Digital video distribution on CD or Internet videoMPEG 2 Video H 262 63 1995 Storage and handling of digital images in broadcast applications digital television HDTV cable satellite high speed Internet DVD video distributionDV 1995 Camcorders digital cassettesH 263 MPEG 4 Part 2 60 1996 Video telephony over public switched telephone network PSTN H 320 Integrated Services Digital Network ISDN 64 65 Advanced Video Coding AVC H 264 MPEG 4 1 22 2003 Most common HD video recording compression distribution format Internet video YouTube Blu ray Discs HDTV broadcasts web browsers streaming television mobile devices consumer devices Netflix 46 video telephony FaceTime 45 Theora 2004 Internet video web browsersVC 1 2006 Windows media Blu ray DiscsApple ProRes 2007 Professional video production 54 WebM Video 2010 A multimedia open source format developed by Google intended to be used with HTML5 High Efficiency Video Coding HEVC H 265 1 4 2013 The emerging successor to the H 264 MPEG 4 AVC standard having substantially improved compression capability Daala 2013 Research video format by Xiph org AV1 66 2018 An open source format based on VP10 VP9 s internal successor Daala and Thor used by content providers such as YouTube 67 68 and Netflix 69 70 MDCT audio standards Edit Further information Modified discrete cosine transform General audio Edit Audio compression standard Year Common applicationsDolby Digital AC 3 25 26 1991 Cinema digital cinema DVD Blu ray streaming media video gamesAdaptive Transform Acoustic Coding ATRAC 25 1992 MiniDiscMPEG Layer III MP3 27 1 1993 Digital audio distribution MP3 players portable media players streaming mediaPerceptual Audio Coder PAC 25 1996 Digital audio radio service DARS Advanced Audio Coding AAC MP4 Audio 28 25 1997 Digital audio distribution portable media players streaming media game consoles mobile devices iOS iTunes Android BlackBerryHigh Efficiency Advanced Audio Coding AAC 71 42 478 1997 Digital radio digital audio broadcasting DAB 42 Digital Radio Mondiale DRM Cook Codec 1998 RealAudioWindows Media Audio WMA 25 1999 Windows MediaVorbis 29 25 2000 Digital audio distribution radio stations streaming media video games Spotify WikipediaHigh Definition Coding HDC 43 2002 Digital radio HD RadioDynamic Resolution Adaptation DRA 25 2008 China national audio standard China Multimedia Mobile Broadcasting DVB HOpus 72 2012 VoIP 73 mobile telephony WhatsApp 74 75 76 PlayStation 4 77 Dolby AC 4 78 2017 ATSC 3 0 ultra high definition television UHD TV MPEG H 3D Audio 79 Speech coding Edit Speech coding standard Year Common applicationsAAC LD LD MDCT 80 1999 Mobile telephony voice over IP VoIP iOS FaceTime 45 Siren 44 1999 VoIP wideband audio G 722 1G 722 1 81 1999 VoIP wideband audio G 722G 729 1 82 2006 G 729 VoIP wideband audio 82 mobile telephonyEVRC WB 42 31 478 2007 Wideband audioG 718 83 2008 VoIP wideband audio mobile telephonyG 719 42 2008 Teleconferencing videoconferencing voice mailCELT 84 2011 VoIP 85 86 mobile telephonyEnhanced Voice Services EVS 87 2014 Mobile telephony VoIP wideband audioMD DCT Edit See also ZPEG Multidimensional DCTs MD DCTs have several applications mainly 3 D DCTs such as the 3 D DCT II which has several new applications like Hyperspectral Imaging coding systems 88 variable temporal length 3 D DCT coding 89 video coding algorithms 90 adaptive video coding 91 and 3 D Compression 92 Due to enhancement in the hardware software and introduction of several fast algorithms the necessity of using M D DCTs is rapidly increasing DCT IV has gained popularity for its applications in fast implementation of real valued polyphase filtering banks 93 lapped orthogonal transform 94 95 and cosine modulated wavelet bases 96 Digital signal processing Edit DCT plays a very important role in digital signal processing By using the DCT the signals can be compressed DCT can be used in electrocardiography for the compression of ECG signals DCT2 provides a better compression ratio than DCT The DCT is widely implemented in digital signal processors DSP as well as digital signal processing software Many companies have developed DSPs based on DCT technology DCTs are widely used for applications such as encoding decoding video audio multiplexing control signals signaling and analog to digital conversion DCTs are also commonly used for high definition television HDTV encoder decoder chips 1 Compression artifacts Edit Further information Compression artifact A common issue with DCT compression in digital media are blocky compression artifacts 97 caused by DCT blocks 3 The DCT algorithm can cause block based artifacts when heavy compression is applied Due to the DCT being used in the majority of digital image and video coding standards such as the JPEG H 26x and MPEG formats DCT based blocky compression artifacts are widespread in digital media In a DCT algorithm an image or frame in an image sequence is divided into square blocks which are processed independently from each other then the DCT of these blocks is taken and the resulting DCT coefficients are quantized This process can cause blocking artifacts primarily at high data compression ratios 97 This can also cause the mosquito noise effect commonly found in digital video such as the MPEG formats 98 DCT blocks are often used in glitch art 3 The artist Rosa Menkman makes use of DCT based compression artifacts in her glitch art 99 particularly the DCT blocks found in most digital media formats such as JPEG digital images and MP3 digital audio 3 Another example is Jpegs by German photographer Thomas Ruff which uses intentional JPEG artifacts as the basis of the picture s style 100 101 Informal overview EditLike any Fourier related transform discrete cosine transforms DCTs express a function or a signal in terms of a sum of sinusoids with different frequencies and amplitudes Like the discrete Fourier transform DFT a DCT operates on a function at a finite number of discrete data points The obvious distinction between a DCT and a DFT is that the former uses only cosine functions while the latter uses both cosines and sines in the form of complex exponentials However this visible difference is merely a consequence of a deeper distinction a DCT implies different boundary conditions from the DFT or other related transforms The Fourier related transforms that operate on a function over a finite domain such as the DFT or DCT or a Fourier series can be thought of as implicitly defining an extension of that function outside the domain That is once you write a function f x displaystyle f x as a sum of sinusoids you can evaluate that sum at any x displaystyle x even for x displaystyle x where the original f x displaystyle f x was not specified The DFT like the Fourier series implies a periodic extension of the original function A DCT like a cosine transform implies an even extension of the original function Illustration of the implicit even odd extensions of DCT input data for N 11 data points red dots for the four most common types of DCT types I IV Note the subtle differences at the interfaces between the data and the extensions in DCT II and DCT IV both the end points are replicated in the extensions but not in DCT I or DCT III and a zero point is inserted at the sign reversal extension in DCT III However because DCTs operate on finite discrete sequences two issues arise that do not apply for the continuous cosine transform First one has to specify whether the function is even or odd at both the left and right boundaries of the domain i e the min n and max n boundaries in the definitions below respectively Second one has to specify around what point the function is even or odd In particular consider a sequence abcd of four equally spaced data points and say that we specify an even left boundary There are two sensible possibilities either the data are even about the sample a in which case the even extension is dcbabcd or the data are even about the point halfway between a and the previous point in which case the even extension is dcbaabcd a is repeated These choices lead to all the standard variations of DCTs and also discrete sine transforms DSTs Each boundary can be either even or odd 2 choices per boundary and can be symmetric about a data point or the point halfway between two data points 2 choices per boundary for a total of 2 2 2 2 16 possibilities Half of these possibilities those where the left boundary is even correspond to the 8 types of DCT the other half are the 8 types of DST These different boundary conditions strongly affect the applications of the transform and lead to uniquely useful properties for the various DCT types Most directly when using Fourier related transforms to solve partial differential equations by spectral methods the boundary conditions are directly specified as a part of the problem being solved Or for the MDCT based on the type IV DCT the boundary conditions are intimately involved in the MDCT s critical property of time domain aliasing cancellation In a more subtle fashion the boundary conditions are responsible for the energy compactification properties that make DCTs useful for image and audio compression because the boundaries affect the rate of convergence of any Fourier like series In particular it is well known that any discontinuities in a function reduce the rate of convergence of the Fourier series so that more sinusoids are needed to represent the function with a given accuracy The same principle governs the usefulness of the DFT and other transforms for signal compression the smoother a function is the fewer terms in its DFT or DCT are required to represent it accurately and the more it can be compressed Here we think of the DFT or DCT as approximations for the Fourier series or cosine series of a function respectively in order to talk about its smoothness However the implicit periodicity of the DFT means that discontinuities usually occur at the boundaries any random segment of a signal is unlikely to have the same value at both the left and right boundaries A similar problem arises for the DST in which the odd left boundary condition implies a discontinuity for any function that does not happen to be zero at that boundary In contrast a DCT where both boundaries are even always yields a continuous extension at the boundaries although the slope is generally discontinuous This is why DCTs and in particular DCTs of types I II V and VI the types that have two even boundaries generally perform better for signal compression than DFTs and DSTs In practice a type II DCT is usually preferred for such applications in part for reasons of computational convenience Formal definition EditFormally the discrete cosine transform is a linear invertible function f R N R N displaystyle f mathbb R N to mathbb R N where R displaystyle mathbb R denotes the set of real numbers or equivalently an invertible N N square matrix There are several variants of the DCT with slightly modified definitions The N real numbers x 0 x N 1 displaystyle x 0 ldots x N 1 are transformed into the N real numbers X 0 X N 1 displaystyle X 0 ldots X N 1 according to one of the formulas DCT I Edit X k 1 2 x 0 1 k x N 1 n 1 N 2 x n cos p N 1 n k for k 0 N 1 displaystyle X k frac 1 2 x 0 1 k x N 1 sum n 1 N 2 x n cos left frac pi N 1 n k right qquad text for k 0 ldots N 1 Some authors further multiply the x 0 displaystyle x 0 and x N 1 displaystyle x N 1 terms by 2 displaystyle sqrt 2 and correspondingly multiply the X 0 displaystyle X 0 and X N 1 displaystyle X N 1 terms by 1 2 displaystyle 1 sqrt 2 which makes the DCT I matrix orthogonal if one further multiplies by an overall scale factor of 2 N 1 displaystyle sqrt tfrac 2 N 1 but breaks the direct correspondence with a real even DFT The DCT I is exactly equivalent up to an overall scale factor of 2 to a DFT of 2 N 1 displaystyle 2 N 1 real numbers with even symmetry For example a DCT I of N 5 displaystyle N 5 real numbers a b c d e displaystyle a b c d e is exactly equivalent to a DFT of eight real numbers a b c d e d c b displaystyle a b c d e d c b even symmetry divided by two In contrast DCT types II IV involve a half sample shift in the equivalent DFT Note however that the DCT I is not defined for N displaystyle N less than 2 while all other DCT types are defined for any positive N displaystyle N Thus the DCT I corresponds to the boundary conditions x n displaystyle x n is even around n 0 displaystyle n 0 and even around n N 1 displaystyle n N 1 similarly for X k displaystyle X k DCT II Edit X k n 0 N 1 x n cos p N n 1 2 k for k 0 N 1 displaystyle X k sum n 0 N 1 x n cos left tfrac pi N left n frac 1 2 right k right qquad text for k 0 dots N 1 The DCT II is probably the most commonly used form and is often simply referred to as the DCT 5 6 This transform is exactly equivalent up to an overall scale factor of 2 to a DFT of 4 N displaystyle 4N real inputs of even symmetry where the even indexed elements are zero That is it is half of the DFT of the 4 N displaystyle 4N inputs y n displaystyle y n where y 2 n 0 displaystyle y 2n 0 y 2 n 1 x n displaystyle y 2n 1 x n for 0 n lt N displaystyle 0 leq n lt N y 2 N 0 displaystyle y 2N 0 and y 4 N n y n displaystyle y 4N n y n for 0 lt n lt 2 N displaystyle 0 lt n lt 2N DCT II transformation is also possible using 2N signal followed by a multiplication by half shift This is demonstrated by Makhoul Some authors further multiply the X 0 displaystyle X 0 term by 1 N displaystyle 1 sqrt N and multiply the rest of the matrix by an overall scale factor of 2 N textstyle sqrt 2 N see below for the corresponding change in DCT III This makes the DCT II matrix orthogonal but breaks the direct correspondence with a real even DFT of half shifted input This is the normalization used by Matlab for example see 102 In many applications such as JPEG the scaling is arbitrary because scale factors can be combined with a subsequent computational step e g the quantization step in JPEG 103 and a scaling can be chosen that allows the DCT to be computed with fewer multiplications 104 105 The DCT II implies the boundary conditions x n displaystyle x n is even around n 1 2 displaystyle n 1 2 and even around n N 1 2 displaystyle n N 1 2 X k displaystyle X k is even around k 0 displaystyle k 0 and odd around k N displaystyle k N DCT III Edit X k 1 2 x 0 n 1 N 1 x n cos p N k 1 2 n for k 0 N 1 displaystyle X k tfrac 1 2 x 0 sum n 1 N 1 x n cos left tfrac pi N left k tfrac 1 2 right n right qquad text for k 0 ldots N 1 Because it is the inverse of DCT II up to a scale factor see below this form is sometimes simply referred to as the inverse DCT IDCT 6 Some authors divide the x 0 displaystyle x 0 term by 2 displaystyle sqrt 2 instead of by 2 resulting in an overall x 0 2 displaystyle x 0 sqrt 2 term and multiply the resulting matrix by an overall scale factor of 2 N textstyle sqrt 2 N see above for the corresponding change in DCT II so that the DCT II and DCT III are transposes of one another This makes the DCT III matrix orthogonal but breaks the direct correspondence with a real even DFT of half shifted output The DCT III implies the boundary conditions x n displaystyle x n is even around n 0 displaystyle n 0 and odd around n N displaystyle n N X k displaystyle X k is even around k 1 2 displaystyle k 1 2 and even around k N 1 2 displaystyle k N 1 2 DCT IV Edit X k n 0 N 1 x n cos p N n 1 2 k 1 2 for k 0 N 1 displaystyle X k sum n 0 N 1 x n cos left tfrac pi N left n tfrac 1 2 right left k tfrac 1 2 right right qquad text for k 0 ldots N 1 The DCT IV matrix becomes orthogonal and thus being clearly symmetric its own inverse if one further multiplies by an overall scale factor of 2 N textstyle sqrt 2 N A variant of the DCT IV where data from different transforms are overlapped is called the modified discrete cosine transform MDCT 106 The DCT IV implies the boundary conditions x n displaystyle x n is even around n 1 2 displaystyle n 1 2 and odd around n N 1 2 displaystyle n N 1 2 similarly for X k displaystyle X k DCT V VIII Edit DCTs of types I IV treat both boundaries consistently regarding the point of symmetry they are even odd around either a data point for both boundaries or halfway between two data points for both boundaries By contrast DCTs of types V VIII imply boundaries that are even odd around a data point for one boundary and halfway between two data points for the other boundary In other words DCT types I IV are equivalent to real even DFTs of even order regardless of whether N displaystyle N is even or odd since the corresponding DFT is of length 2 N 1 displaystyle 2 N 1 for DCT I or 4 N displaystyle 4N for DCT II amp III or 8 N displaystyle 8N for DCT IV The four additional types of discrete cosine transform 107 correspond essentially to real even DFTs of logically odd order which have factors of N 1 2 displaystyle N pm 1 2 in the denominators of the cosine arguments However these variants seem to be rarely used in practice One reason perhaps is that FFT algorithms for odd length DFTs are generally more complicated than FFT algorithms for even length DFTs e g the simplest radix 2 algorithms are only for even lengths and this increased intricacy carries over to the DCTs as described below The trivial real even array a length one DFT odd length of a single number a corresponds to a DCT V of length N 1 displaystyle N 1 Inverse transforms EditUsing the normalization conventions above the inverse of DCT I is DCT I multiplied by 2 N 1 The inverse of DCT IV is DCT IV multiplied by 2 N The inverse of DCT II is DCT III multiplied by 2 N and vice versa 6 Like for the DFT the normalization factor in front of these transform definitions is merely a convention and differs between treatments For example some authors multiply the transforms by 2 N textstyle sqrt 2 N so that the inverse does not require any additional multiplicative factor Combined with appropriate factors of 2 see above this can be used to make the transform matrix orthogonal Multidimensional DCTs EditMultidimensional variants of the various DCT types follow straightforwardly from the one dimensional definitions they are simply a separable product equivalently a composition of DCTs along each dimension M D DCT II Edit For example a two dimensional DCT II of an image or a matrix is simply the one dimensional DCT II from above performed along the rows and then along the columns or vice versa That is the 2D DCT II is given by the formula omitting normalization and other scale factors as above X k 1 k 2 n 1 0 N 1 1 n 2 0 N 2 1 x n 1 n 2 cos p N 2 n 2 1 2 k 2 cos p N 1 n 1 1 2 k 1 n 1 0 N 1 1 n 2 0 N 2 1 x n 1 n 2 cos p N 1 n 1 1 2 k 1 cos p N 2 n 2 1 2 k 2 displaystyle begin aligned X k 1 k 2 amp sum n 1 0 N 1 1 left sum n 2 0 N 2 1 x n 1 n 2 cos left frac pi N 2 left n 2 frac 1 2 right k 2 right right cos left frac pi N 1 left n 1 frac 1 2 right k 1 right amp sum n 1 0 N 1 1 sum n 2 0 N 2 1 x n 1 n 2 cos left frac pi N 1 left n 1 frac 1 2 right k 1 right cos left frac pi N 2 left n 2 frac 1 2 right k 2 right end aligned The inverse of a multi dimensional DCT is just a separable product of the inverses of the corresponding one dimensional DCTs see above e g the one dimensional inverses applied along one dimension at a time in a row column algorithm The 3 D DCT II is only the extension of 2 D DCT II in three dimensional space and mathematically can be calculated by the formula X k 1 k 2 k 3 n 1 0 N 1 1 n 2 0 N 2 1 n 3 0 N 3 1 x n 1 n 2 n 3 cos p N 1 n 1 1 2 k 1 cos p N 2 n 2 1 2 k 2 cos p N 3 n 3 1 2 k 3 for k i 0 1 2 N i 1 displaystyle X k 1 k 2 k 3 sum n 1 0 N 1 1 sum n 2 0 N 2 1 sum n 3 0 N 3 1 x n 1 n 2 n 3 cos left frac pi N 1 left n 1 frac 1 2 right k 1 right cos left frac pi N 2 left n 2 frac 1 2 right k 2 right cos left frac pi N 3 left n 3 frac 1 2 right k 3 right quad text for k i 0 1 2 dots N i 1 The inverse of 3 D DCT II is 3 D DCT III and can be computed from the formula given by x n 1 n 2 n 3 k 1 0 N 1 1 k 2 0 N 2 1 k 3 0 N 3 1 X k 1 k 2 k 3 cos p N 1 n 1 1 2 k 1 cos p N 2 n 2 1 2 k 2 cos p N 3 n 3 1 2 k 3 for n i 0 1 2 N i 1 displaystyle x n 1 n 2 n 3 sum k 1 0 N 1 1 sum k 2 0 N 2 1 sum k 3 0 N 3 1 X k 1 k 2 k 3 cos left frac pi N 1 left n 1 frac 1 2 right k 1 right cos left frac pi N 2 left n 2 frac 1 2 right k 2 right cos left frac pi N 3 left n 3 frac 1 2 right k 3 right quad text for n i 0 1 2 dots N i 1 Technically computing a two three or multi dimensional DCT by sequences of one dimensional DCTs along each dimension is known as a row column algorithm As with multidimensional FFT algorithms however there exist other methods to compute the same thing while performing the computations in a different order i e interleaving combining the algorithms for the different dimensions Owing to the rapid growth in the applications based on the 3 D DCT several fast algorithms are developed for the computation of 3 D DCT II Vector Radix algorithms are applied for computing M D DCT to reduce the computational complexity and to increase the computational speed To compute 3 D DCT II efficiently a fast algorithm Vector Radix Decimation in Frequency VR DIF algorithm was developed 3 D DCT II VR DIF Edit In order to apply the VR DIF algorithm the input data is to be formulated and rearranged as follows 108 109 The transform size N N N is assumed to be 2 The four basic stages of computing 3 D DCT II using VR DIF Algorithm x n 1 n 2 n 3 x 2 n 1 2 n 2 2 n 3 x n 1 n 2 N n 3 1 x 2 n 1 2 n 2 2 n 3 1 x n 1 N n 2 1 n 3 x 2 n 1 2 n 2 1 2 n 3 x n 1 N n 2 1 N n 3 1 x 2 n 1 2 n 2 1 2 n 3 1 x N n 1 1 n 2 n 3 x 2 n 1 1 2 n 2 2 n 3 x N n 1 1 n 2 N n 3 1 x 2 n 1 1 2 n 2 2 n 3 1 x N n 1 1 N n 2 1 n 3 x 2 n 1 1 2 n 2 1 2 n 3 x N n 1 1 N n 2 1 N n 3 1 x 2 n 1 1 2 n 2 1 2 n 3 1 displaystyle begin array lcl tilde x n 1 n 2 n 3 x 2n 1 2n 2 2n 3 tilde x n 1 n 2 N n 3 1 x 2n 1 2n 2 2n 3 1 tilde x n 1 N n 2 1 n 3 x 2n 1 2n 2 1 2n 3 tilde x n 1 N n 2 1 N n 3 1 x 2n 1 2n 2 1 2n 3 1 tilde x N n 1 1 n 2 n 3 x 2n 1 1 2n 2 2n 3 tilde x N n 1 1 n 2 N n 3 1 x 2n 1 1 2n 2 2n 3 1 tilde x N n 1 1 N n 2 1 n 3 x 2n 1 1 2n 2 1 2n 3 tilde x N n 1 1 N n 2 1 N n 3 1 x 2n 1 1 2n 2 1 2n 3 1 end array where 0 n 1 n 2 n 3 N 2 1 displaystyle 0 leq n 1 n 2 n 3 leq frac N 2 1 The figure to the adjacent shows the four stages that are involved in calculating 3 D DCT II using VR DIF algorithm The first stage is the 3 D reordering using the index mapping illustrated by the above equations The second stage is the butterfly calculation Each butterfly calculates eight points together as shown in the figure just below where c f i cos f i displaystyle c varphi i cos varphi i The original 3 D DCT II now can be written as X k 1 k 2 k 3 n 1 1 N 1 n 2 1 N 1 n 3 1 N 1 x n 1 n 2 n 3 cos f k 1 cos f k 2 cos f k 3 displaystyle X k 1 k 2 k 3 sum n 1 1 N 1 sum n 2 1 N 1 sum n 3 1 N 1 tilde x n 1 n 2 n 3 cos varphi k 1 cos varphi k 2 cos varphi k 3 where f i p 2 N 4 N i 1 and i 1 2 3 displaystyle varphi i frac pi 2N 4N i 1 text and i 1 2 3 If the even and the odd parts of k 1 k 2 displaystyle k 1 k 2 and k 3 displaystyle k 3 and are considered the general formula for the calculation of the 3 D DCT II can be expressed as The single butterfly stage of VR DIF algorithm X k 1 k 2 k 3 n 1 1 N 2 1 n 2 1 N 2 1 n 1 1 N 2 1 x i j l n 1 n 2 n 3 cos f 2 k 1 i cos f 2 k 2 j cos f 2 k 3 l displaystyle X k 1 k 2 k 3 sum n 1 1 tfrac N 2 1 sum n 2 1 tfrac N 2 1 sum n 1 1 tfrac N 2 1 tilde x ijl n 1 n 2 n 3 cos varphi 2k 1 i cos varphi 2k 2 j cos varphi 2k 3 l where x i j l n 1 n 2 n 3 x n 1 n 2 n 3 1 l x n 1 n 2 n 3 n 2 displaystyle tilde x ijl n 1 n 2 n 3 tilde x n 1 n 2 n 3 1 l tilde x left n 1 n 2 n 3 frac n 2 right 1 j x n 1 n 2 n 2 n 3 1 j l x n 1 n 2 n 2 n 3 n 2 displaystyle 1 j tilde x left n 1 n 2 frac n 2 n 3 right 1 j l tilde x left n 1 n 2 frac n 2 n 3 frac n 2 right 1 i x n 1 n 2 n 2 n 3 1 i j x n 1 n 2 n 2 n 2 n 3 displaystyle 1 i tilde x left n 1 frac n 2 n 2 n 3 right 1 i j tilde x left n 1 frac n 2 frac n 2 n 2 n 3 right 1 i l x n 1 n 2 n 2 n 3 n 3 displaystyle 1 i l tilde x left n 1 frac n 2 n 2 n 3 frac n 3 right 1 i j l x n 1 n 2 n 2 n 2 n 3 n 2 where i j l 0 or 1 displaystyle 1 i j l tilde x left n 1 frac n 2 n 2 frac n 2 n 3 frac n 2 right text where i j l 0 text or 1 Arithmetic complexity Edit The whole 3 D DCT calculation needs log 2 N displaystyle log 2 N stages and each stage involves 1 8 N 3 displaystyle tfrac 1 8 N 3 butterflies The whole 3 D DCT requires 1 8 N 3 log 2 N displaystyle left tfrac 1 8 N 3 log 2 N right butterflies to be computed Each butterfly requires seven real multiplications including trivial multiplications and 24 real additions including trivial additions Therefore the total number of real multiplications needed for this stage is 7 8 N 3 log 2 N displaystyle left tfrac 7 8 N 3 log 2 N right and the total number of real additions i e including the post additions recursive additions which can be calculated directly after the butterfly stage or after the bit reverse stage are given by 109 3 2 N 3 log 2 N Real 3 2 N 3 log 2 N 3 N 3 3 N 2 Recursive 9 2 N 3 log 2 N 3 N 3 3 N 2 displaystyle underbrace left frac 3 2 N 3 log 2 N right text Real underbrace left frac 3 2 N 3 log 2 N 3N 3 3N 2 right text Recursive left frac 9 2 N 3 log 2 N 3N 3 3N 2 right The conventional method to calculate MD DCT II is using a Row Column Frame RCF approach which is computationally complex and less productive on most advanced recent hardware platforms The number of multiplications required to compute VR DIF Algorithm when compared to RCF algorithm are quite a few in number The number of Multiplications and additions involved in RCF approach are given by 3 2 N 3 log 2 N displaystyle left frac 3 2 N 3 log 2 N right and 9 2 N 3 log 2 N 3 N 3 3 N 2 displaystyle left frac 9 2 N 3 log 2 N 3N 3 3N 2 right respectively From Table 1 it can be seen that the total number TABLE 1 Comparison of VR DIF amp RCF Algorithms for computing 3D DCT II Transform Size 3D VR Mults RCF Mults 3D VR Adds RCF Adds8 8 8 2 625 4 5 10 875 10 87516 16 16 3 5 6 15 188 15 18832 32 32 4 375 7 5 19 594 19 59464 64 64 5 25 9 24 047 24 047of multiplications associated with the 3 D DCT VR algorithm is less than that associated with the RCF approach by more than 40 In addition the RCF approach involves matrix transpose and more indexing and data swapping than the new VR algorithm This makes the 3 D DCT VR algorithm more efficient and better suited for 3 D applications that involve the 3 D DCT II such as video compression and other 3 D image processing applications The main consideration in choosing a fast algorithm is to avoid computational and structural complexities As the technology of computers and DSPs advances the execution time of arithmetic operations multiplications and additions is becoming very fast and regular computational structure becomes the most important factor 110 Therefore although the above proposed 3 D VR algorithm does not achieve the theoretical lower bound on the number of multiplications 111 it has a simpler computational structure as compared to other 3 D DCT algorithms It can be implemented in place using a single butterfly and possesses the properties of the Cooley Tukey FFT algorithm in 3 D Hence the 3 D VR presents a good choice for reducing arithmetic operations in the calculation of the 3 D DCT II while keeping the simple structure that characterize butterfly style Cooley Tukey FFT algorithms Two dimensional DCT frequencies from the JPEG DCT The image to the right shows a combination of horizontal and vertical frequencies for an 8 8 N 1 N 2 8 displaystyle N 1 N 2 8 two dimensional DCT Each step from left to right and top to bottom is an increase in frequency by 1 2 cycle For example moving right one from the top left square yields a half cycle increase in the horizontal frequency Another move to the right yields two half cycles A move down yields two half cycles horizontally and a half cycle vertically The source data 8 8 is transformed to a linear combination of these 64 frequency squares MD DCT IV Edit The M D DCT IV is just an extension of 1 D DCT IV on to M dimensional domain The 2 D DCT IV of a matrix or an image is given by X k ℓ n 0 N 1 m 0 M 1 x n m cos 2 m 1 2 k 1 p 4 N cos 2 n 1 2 ℓ 1 p 4 M displaystyle X k ell sum n 0 N 1 sum m 0 M 1 x n m cos left frac 2m 1 2k 1 pi 4N right cos left frac 2n 1 2 ell 1 pi 4M right for k 0 1 2 N 1 displaystyle k 0 1 2 ldots N 1 and ℓ 0 1 2 M 1 displaystyle ell 0 1 2 ldots M 1 We can compute the MD DCT IV using the regular row column method or we can use the polynomial transform method 112 for the fast and efficient computation The main idea of this algorithm is to use the Polynomial Transform to convert the multidimensional DCT into a series of 1 D DCTs directly MD DCT IV also has several applications in various fields Computation EditAlthough the direct application of these formulas would require O N 2 displaystyle mathcal O N 2 operations it is possible to compute the same thing with only O N log N displaystyle mathcal O N log N complexity by factorizing the computation similarly to the fast Fourier transform FFT One can also compute DCTs via FFTs combined with O N displaystyle mathcal O N pre and post processing steps In general O N log N displaystyle mathcal O N log N methods to compute DCTs are known as fast cosine transform FCT algorithms The most efficient algorithms in principle are usually those that are specialized directly for the DCT as opposed to using an ordinary FFT plus O N displaystyle mathcal O N extra operations see below for an exception However even specialized DCT algorithms including all of those that achieve the lowest known arithmetic counts at least for power of two sizes are typically closely related to FFT algorithms since DCTs are essentially DFTs of real even data one can design a fast DCT algorithm by taking an FFT and eliminating the redundant operations due to this symmetry This can even be done automatically Frigo amp Johnson 2005 Algorithms based on the Cooley Tukey FFT algorithm are most common but any other FFT algorithm is also applicable For example the Winograd FFT algorithm leads to minimal multiplication algorithms for the DFT albeit generally at the cost of more additions and a similar algorithm was proposed by Feig amp Winograd 1992a for the DCT Because the algorithms for DFTs DCTs and similar transforms are all so closely related any improvement in algorithms for one transform will theoretically lead to immediate gains for the other transforms as well Duhamel amp Vetterli 1990 While DCT algorithms that employ an unmodified FFT often have some theoretical overhead compared to the best specialized DCT algorithms the former also have a distinct advantage Highly optimized FFT programs are widely available Thus in practice it is often easier to obtain high performance for general lengths N with FFT based algorithms a Specialized DCT algorithms on the other hand see widespread use for transforms of small fixed sizes such as the 8 8 DCT II used in JPEG compression or the small DCTs or MDCTs typically used in audio compression Reduced code size may also be a reason to use a specialized DCT for embedded device applications In fact even the DCT algorithms using an ordinary FFT are sometimes equivalent to pruning the redundant operations from a larger FFT of real symmetric data and they can even be optimal from the perspective of arithmetic counts For example a type II DCT is equivalent to a DFT of size 4 N displaystyle 4N with real even symmetry whose even indexed elements are zero One of the most common methods for computing this via an FFT e g the method used in FFTPACK and FFTW was described by Narasimha amp Peterson 1978 and Makhoul 1980 and this method in hindsight can be seen as one step of a radix 4 decimation in time Cooley Tukey algorithm applied to the logical real even DFT corresponding to the DCT II b Because the even indexed elements are zero this radix 4 step is exactly the same as a split radix step If the subsequent size N displaystyle N real data FFT is also performed by a real data split radix algorithm as in Sorensen et al 1987 then the resulting algorithm actually matches what was long the lowest published arithmetic count for the power of two DCT II 2 N log 2 N N 2 displaystyle 2N log 2 N N 2 real arithmetic operations c A recent reduction in the operation count to 17 9 N log 2 N O N displaystyle tfrac 17 9 N log 2 N mathcal O N also uses a real data FFT 113 So there is nothing intrinsically bad about computing the DCT via an FFT from an arithmetic perspective it is sometimes merely a question of whether the corresponding FFT algorithm is optimal As a practical matter the function call overhead in invoking a separate FFT routine might be significant for small N displaystyle N but this is an implementation rather than an algorithmic question since it can be solved by unrolling or inlining Example of IDCT Edit An example showing eight different filters applied to a test image top left by multiplying its DCT spectrum top right with each filter Consider this 8x8 grayscale image of capital letter A Original size scaled 10x nearest neighbor scaled 10x bilinear Basis functions of the discrete cosine transformation with corresponding coefficients specific for our image DCT of the image 6 1917 0 3411 1 2418 0 1492 0 1583 0 2742 0 0724 0 0561 0 2205 0 0214 0 4503 0 3947 0 7846 0 4391 0 1001 0 2554 1 0423 0 2214 1 0017 0 2720 0 0789 0 1952 0 2801 0 4713 0 2340 0 0392 0 2617 0 2866 0 6351 0 3501 0 1433 0 3550 0 2750 0 0226 0 1229 0 2183 0 2583 0 0742 0 2042 0 5906 0 0653 0 0428 0 4721 0 2905 0 4745 0 2875 0 0284 0 1311 0 3169 0 0541 0 1033 0 0225 0 0056 0 1017 0 1650 0 1500 0 2970 0 0627 0 1960 0 0644 0 1136 0 1031 0 1887 0 1444 displaystyle begin bmatrix 6 1917 amp 0 3411 amp 1 2418 amp 0 1492 amp 0 1583 amp 0 2742 amp 0 0724 amp 0 0561 0 2205 amp 0 0214 amp 0 4503 amp 0 3947 amp 0 7846 amp 0 4391 amp 0 1001 amp 0 2554 1 0423 amp 0 2214 amp 1 0017 amp 0 2720 amp 0 0789 amp 0 1952 amp 0 2801 amp 0 4713 0 2340 amp 0 0392 amp 0 2617 amp 0 2866 amp 0 6351 amp 0 3501 amp 0 1433 amp 0 3550 0 2750 amp 0 0226 amp 0 1229 amp 0 2183 amp 0 2583 amp 0 0742 amp 0 2042 amp 0 5906 0 0653 amp 0 0428 amp 0 4721 amp 0 2905 amp 0 4745 amp 0 2875 amp 0 0284 amp 0 1311 0 3169 amp 0 0541 amp 0 1033 amp 0 0225 amp 0 0056 amp 0 1017 amp 0 1650 amp 0 1500 0 2970 amp 0 0627 amp 0 1960 amp 0 0644 amp 0 1136 amp 0 1031 amp 0 1887 amp 0 1444 end bmatrix Each basis function is multiplied by its coefficient and then this product is added to the final image On the left is the final image In the middle is the weighted function multiplied by a coefficient which is added to the final image On the right is the current function and corresponding coefficient Images are scaled using bilinear interpolation by factor 10 See also EditDiscrete wavelet transform JPEG Discrete cosine transform Contains a potentially easier to understand example of DCT transformation List of Fourier related transforms Modified discrete cosine transformNotes Edit Algorithmic performance on modern hardware is typically not principally determined by simple arithmetic counts and optimization requires substantial engineering effort to make best use within its intrinsic limits of available built in hardware optimization The radix 4 step reduces the size 4 N displaystyle 4N DFT to four size N displaystyle N DFTs of real data two of which are zero and two of which are equal to one another by the even symmetry Hence giving a single size N displaystyle N FFT of real data plus O N displaystyle mathcal O N butterflies once the trivial and or duplicate parts are eliminated and or merged The precise count of real arithmetic operations and in particular the count of real multiplications depends somewhat on the scaling of the transform definition The 2 N log 2 N N 2 displaystyle 2N log 2 N N 2 count is for the DCT II definition shown here two multiplications can be saved if the transform is scaled by an overall 2 displaystyle sqrt 2 factor Additional multiplications can be saved if one permits the outputs of the transform to be rescaled individually as was shown by Arai Agui amp Nakajima 1988 for the size 8 case used in JPEG References Edit a b c d e f g h i j k l m n o p q r s t u v w x y z aa ab ac Stankovic Radomir S Astola Jaakko T 2012 Reminiscences of the Early Work in DCT Interview with K R Rao PDF Reprints from the Early Days of Information Sciences Tampere International Center for Signal Processing 60 ISBN 978 9521528187 ISSN 1456 2774 Archived PDF from the original on 30 December 2021 Retrieved 30 December 2021 via ETHW a b c d e Britanak Vladimir Yip Patrick C Rao K R 6 November 2006 Discrete Cosine and Sine Transforms General Properties Fast Algorithms and Integer Approximations Academic Press ISBN 978 0123736246 LCCN 2006931102 OCLC 220853454 OL 18495589M S2CID 118873224 a b c d Alikhani Darya April 1 2015 Beyond resolution Rosa Menkman s glitch art POSTmatter Retrieved 19 October 2019 a b c d e f Thomson Gavin Shah Athar 2017 Introducing HEIF and HEVC PDF Apple Inc Retrieved 5 August 2019 a b c d e f Ahmed Nasir Natarajan T Raj Rao K R 1 January 1974 Discrete Cosine Transform IEEE Transactions on Computers IEEE Computer Society C 23 1 90 93 doi 10 1109 T C 1974 223784 eISSN 1557 9956 ISSN 0018 9340 LCCN 75642478 OCLC 1799331 S2CID 206619973 a b c d e f Rao K Ramamohan Yip Patrick C 11 September 1990 Discrete Cosine Transform Algorithms Advantages Applications Signal Image and Speech Processing Academic Press arXiv 1109 0337 doi 10 1016 c2009 0 22279 3 ISBN 978 0125802031 LCCN 89029800 OCLC 1008648293 OL 2207570M S2CID 12270940 a b c d e f g Barbero M Hofmann H Wells N D 14 November 1991 DCT source coding and current implementations for HDTV EBU Technical Review European Broadcasting Union 251 22 33 Retrieved 4 November 2019 a b c d e f Lea William 1994 Video on demand Research Paper 94 68 House of Commons Library Retrieved 20 September 2019 a b c Ahmed Nasir January 1991 How I Came Up With the Discrete Cosine Transform Digital Signal Processing 1 1 4 5 doi 10 1016 1051 2004 91 90086 Z a b c d e T 81 Digital compression and coding of continuous tone still images Requirements and guidelines PDF CCITT September 1992 Retrieved 12 July 2019 Selected Papers on Visual Communication Technology and Applications SPIE Press Book Editors T Russell Hsing and Andrew G Tescher April 1990 pp 145 149 1 Selected Papers and Tutorial in Digital Image Processing and Analysis Volume 1 Digital Image Processing and Analysis IEEE Computer Society Press Editors R Chellappa and A A Sawchuk June 1985 p 47 DCT citations via Google Scholar 2 Chen Wen Hsiung Smith C H Fralick S C September 1977 A Fast Computational Algorithm for the Discrete Cosine Transform IEEE Transactions on Communications 25 9 1004 1009 doi 10 1109 TCOM 1977 1093941 Smith C Fralick S 1977 A Fast Computational Algorithm for the Discrete Cosine Transform IEEE Transactions on Communications 25 9 1004 1009 doi 10 1109 TCOM 1977 1093941 ISSN 0090 6778 Huang T S 1981 Image Sequence Analysis Springer Science amp Business Media p 29 ISBN 9783642870378 Roese John A Robinson Guner S 30 October 1975 Combined Spatial And Temporal Coding Of Digital Image Sequences Efficient Transmission of Pictorial Information International Society for Optics and Photonics 0066 172 181 Bibcode 1975SPIE 66 172R doi 10 1117 12 965361 S2CID 62725808 Cianci Philip J 2014 High Definition Television The Creation Development and Implementation of HDTV Technology McFarland p 63 ISBN 9780786487974 a b c History of Video Compression ITU T Joint Video Team JVT of ISO IEC MPEG amp ITU T VCEG ISO IEC JTC1 SC29 WG11 and ITU T SG16 Q 6 July 2002 pp 11 24 9 33 40 1 53 6 Retrieved 3 November 2019 a b c Ghanbari Mohammed 2003 Standard Codecs Image Compression to Advanced Video Coding Institution of Engineering and Technology pp 1 2 ISBN 9780852967102 Li Jian Ping 2006 Proceedings of the International Computer Conference 2006 on Wavelet Active Media Technology and Information Processing Chongqing China 29 31 August 2006 World Scientific p 847 ISBN 9789812709998 a b c Wang Hanli Kwong S Kok C 2006 Efficient prediction algorithm of integer DCT coefficients for H 264 AVC optimization IEEE Transactions on Circuits and Systems for Video Technology 16 4 547 552 doi 10 1109 TCSVT 2006 871390 S2CID 2060937 Princen John P Johnson A W Bradley Alan B 1987 Subband Transform coding using filter bank designs based on time domain aliasing cancellation ICASSP 87 IEEE International Conference on Acoustics Speech and Signal Processing 12 2161 2164 doi 10 1109 ICASSP 1987 1169405 S2CID 58446992 Princen J Bradley A 1986 Analysis Synthesis filter bank design based on time domain aliasing cancellation IEEE Transactions on Acoustics Speech and Signal Processing 34 5 1153 1161 doi 10 1109 TASSP 1986 1164954 a b c d e f g h i j k Luo Fa Long 2008 Mobile Multimedia Broadcasting Standards Technology and Practice Springer Science amp Business Media p 590 ISBN 9780387782638 a b Britanak V 2011 On Properties Relations and Simplified Implementation of Filter Banks in the Dolby Digital Plus AC 3 Audio Coding Standards IEEE Transactions on Audio Speech and Language Processing 19 5 1231 1241 doi 10 1109 TASL 2010 2087755 S2CID 897622 a b Guckert John Spring 2012 The Use of FFT and MDCT in MP3 Audio Compression PDF University of Utah Retrieved 14 July 2019 a b Brandenburg Karlheinz 1999 MP3 and AAC Explained PDF Archived PDF from the original on 2017 02 13 a b Xiph Org Foundation 2009 06 02 Vorbis I specification 1 1 2 Classification Xiph Org Foundation Retrieved 2009 09 22 Dhamija Swati Jain Priyanka September 2011 Comparative Analysis for Discrete Sine Transform as a suitable method for noise estimation IJCSI International Journal of Computer Science 8 5 No 3 162 164 162 Retrieved 4 November 2019 Mandyam Giridhar D Ahmed Nasir Magotra Neeraj 17 April 1995 DCT based scheme for lossless image compression Digital Video Compression Algorithms and Technologies 1995 International Society for Optics and Photonics 2419 474 478 Bibcode 1995SPIE 2419 474M doi 10 1117 12 206386 S2CID 13894279 Komatsu K Sezaki Kaoru 1998 Reversible discrete cosine transform Proceedings of the 1998 IEEE International Conference on Acoustics Speech and Signal Processing ICASSP 98 Cat No 98CH36181 3 1769 1772 vol 3 doi 10 1109 ICASSP 1998 681802 ISBN 0 7803 4428 6 S2CID 17045923 Muchahary D Mondal A J Parmar R S Borah A D Majumder A 2015 A Simplified Design Approach for Efficient Computation of DCT 2015 Fifth International Conference on Communication Systems and Network Technologies 483 487 doi 10 1109 CSNT 2015 134 ISBN 978 1 4799 1797 6 S2CID 16411333 Chen Wai Kai 2004 The Electrical Engineering Handbook Elsevier p 906 ISBN 9780080477480 a b c What Is a JPEG The Invisible Object You See Every Day The Atlantic 24 September 2013 Retrieved 13 September 2019 a b c Pessina Laure Anne 12 December 2014 JPEG changed our world EPFL News Ecole Polytechnique Federale de Lausanne Retrieved 13 September 2019 a b Lee Ruby Bei Loh Beck John P Lamb Joel Severson Kenneth E April 1995 Real time software MPEG video decoder on multimedia enhanced PA 7100LC processors PDF Hewlett Packard Journal 46 2 ISSN 0018 1153 a b c Lee Jack 2005 Scalable Continuous Media Streaming Systems Architecture Design Analysis and Implementation John Wiley amp Sons p 25 ISBN 9780470857649 a b c Shishikui Yoshiaki Nakanishi Hiroshi Imaizumi Hiroyuki October 26 28 1993 An HDTV Coding Scheme using Adaptive Dimension DCT Signal Processing of HDTV Proceedings of the International Workshop on HDTV 93 Ottawa Canada Elsevier 611 618 doi 10 1016 B978 0 444 81844 7 50072 3 ISBN 9781483298511 a b Ochoa Dominguez Humberto Rao K R 2019 Discrete Cosine Transform Second Edition CRC Press pp 1 3 129 ISBN 9781351396486 a b c d e f g h i j k l m n o p q r s t u v w x y z aa ab ac ad ae Ochoa Dominguez Humberto Rao K R 2019 Discrete Cosine Transform Second Edition CRC Press pp 1 3 ISBN 9781351396486 a b c d e Britanak Vladimir Rao K R 2017 Cosine Sine Modulated Filter Banks General Properties Fast Algorithms and Integer Approximations Springer p 478 ISBN 9783319610801 a b Jones Graham A Layer David H Osenkowsky Thomas G 2013 National Association of Broadcasters Engineering Handbook NAB Engineering Handbook Taylor amp Francis pp 558 9 ISBN 978 1 136 03410 7 a b c Hersent Olivier Petit Jean Pierre Gurle David 2005 Beyond VoIP Protocols Understanding Voice Technology and Networking Techniques for IP Telephony John Wiley amp Sons p 55 ISBN 9780470023631 a b c d e Daniel Eran Dilger June 8 2010 Inside iPhone 4 FaceTime video calling AppleInsider Retrieved June 9 2010 a b c d Netflix Technology Blog 19 April 2017 More Efficient Mobile Encodes for Netflix Downloads Medium com Netflix Retrieved 20 October 2019 a b Video Developer Report 2019 PDF Bitmovin 2019 Retrieved 5 November 2019 Ochoa Dominguez Humberto Rao K R 2019 Discrete Cosine Transform Second Edition CRC Press p 186 ISBN 9781351396486 a b c d McKernan Brian 2005 Digital cinema the revolution in cinematography postproduction distribution McGraw Hill p 58 ISBN 978 0 07 142963 4 DCT is used in most of the compression systems standardized by the Moving Picture Experts Group MPEG is the dominant technology for image compression In particular it is the core technology of MPEG 2 the system used for DVDs digital television broadcasting that has been used for many of the trials of digital cinema a b Baraniuk Chris 15 October 2015 Copy protections could come to JPegs BBC News BBC Retrieved 13 September 2019 Ascher Steven Pincus Edward 2012 The Filmmaker s Handbook A Comprehensive Guide for the Digital Age Fifth Edition Penguin pp 246 7 ISBN 978 1 101 61380 1 Bertalmio Marcelo 2014 Image Processing for Cinema CRC Press p 95 ISBN 978 1 4398 9928 1 Zhang HongJiang 1998 Content Based Video Browsing And Retrieval In Furht Borko ed Handbook of Internet and Multimedia Systems and Applications CRC Press pp 83 108 89 ISBN 9780849318580 a b Apple ProRes 422 Codec Family Library of Congress 17 November 2014 Retrieved 13 October 2019 Potluri U S Madanayake A Cintra R J Bayer F M Rajapaksha N 17 October 2012 Multiplier free DCT approximations for RF multi beam digital aperture array space imaging and directional sensing Measurement Science and Technology 23 11 114003 doi 10 1088 0957 0233 23 11 114003 ISSN 0957 0233 S2CID 119888170 Hudson Graham Leger Alain Niss Birger Sebestyen Istvan Vaaben Jorgen 31 August 2018 JPEG 1 standard 25 years past present and future reasons for a success Journal of Electronic Imaging 27 4 1 doi 10 1117 1 JEI 27 4 040901 The JPEG image format explained BT com BT Group 31 May 2018 Retrieved 5 August 2019 HEIF Comparison High Efficiency Image File Format Nokia Technologies Retrieved 5 August 2019 Alakuijala Jyrki Sneyers Jon Versari Luca Wassenberg Jan 22 January 2021 JPEG XL White Paper PDF JPEG Org Archived PDF from the original on 2 May 2021 Retrieved 14 Jan 2022 Variable sized DCT square or rectangular from 2x2 to 256x256 serves as a fast approximation of the optimal decorrelating transform a b Wang Yao 2006 Video Coding Standards Part I PDF Archived from the original PDF on 2013 01 23 Wang Yao 2006 Video Coding Standards Part II PDF Archived from the original PDF on 2013 01 23 Hoffman Roy 2012 Data Compression in Digital Systems Springer Science amp Business Media p 255 ISBN 9781461560319 a b Rao K R Hwang J J 18 July 1996 Techniques and Standards for Image Video and Audio Coding Prentice Hall JPEG Chapter 8 H 261 Chapter 9 MPEG 1 Chapter 10 MPEG 2 Chapter 11 ISBN 978 0133099072 LCCN 96015550 OCLC 34617596 OL 978319M S2CID 56983045 Davis Andrew 13 June 1997 The H 320 Recommendation Overview EE Times Retrieved 7 November 2019 IEEE WESCANEX 97 communications power and computing conference proceedings University of Manitoba Winnipeg Manitoba Canada Institute of Electrical and Electronics Engineers May 22 23 1997 p 30 ISBN 9780780341470 H 263 is similar to but more complex than H 261 It is currently the most widely used international video compression standard for video telephony on ISDN Integrated Services Digital Network telephone lines Peter de Rivaz Jack Haughton 2018 AV1 Bitstream amp Decoding Process Specification PDF Alliance for Open Media Retrieved 2022 01 14 YouTube Developers 15 September 2018 AV1 Beta Launch Playlist YouTube Retrieved 14 January 2022 The first videos to receive YouTube s AV1 transcodes Brinkmann Martin 13 September 2018 How to enable AV1 support on YouTube Retrieved 14 January 2022 Netflix Technology Blog 5 February 2020 Netflix Now Streaming AV1 on Android Retrieved 14 January 2022 Netflix Technology Blog 9 November 2021 Bringing AV1 Streaming to Netflix Members TVs Retrieved 14 January 2022 Herre J Dietz M 2008 MPEG 4 high efficiency AAC coding Standards in a Nutshell IEEE Signal Processing Magazine 25 3 137 142 Bibcode 2008ISPM 25 137H doi 10 1109 MSP 2008 918684 Valin Jean Marc Maxwell Gregory Terriberry Timothy B Vos Koen October 2013 High Quality Low Delay Music Coding in the Opus Codec 135th AES Convention Audio Engineering Society arXiv 1602 04845 Opus Codec Opus Home page Xiph org Foundation Retrieved July 31 2012 Leyden John 27 October 2015 WhatsApp laid bare Info sucking app s innards probed The Register Retrieved 19 October 2019 Hazra Sudip Mateti Prabhaker September 13 16 2017 Challenges in Android Forensics In Thampi Sabu M Perez Gregorio Martinez Westphall Carlos Becker Hu Jiankun Fan Chun I Marmol Felix Gomez eds Security in Computing and Communications 5th International Symposium SSCC 2017 Springer pp 286 299 290 doi 10 1007 978 981 10 6898 0 24 ISBN 9789811068980 Srivastava Saurabh Ranjan Dube Sachin Shrivastaya Gulshan Sharma Kavita 2019 Smartphone Triggered Security Challenges Issues Case Studies and Prevention In Le Dac Nhuong Kumar Raghvendra Mishra Brojo Kishore Chatterjee Jyotir Moy Khari Manju eds Cyber Security in Parallel and Distributed Computing Concepts Techniques Applications and Case Studies Cyber Security in Parallel and Distributed Computing John Wiley amp Sons pp 187 206 200 doi 10 1002 9781119488330 ch12 ISBN 9781119488057 S2CID 214034702 Open Source Software used in PlayStation 4 Sony Interactive Entertainment Inc Retrieved 2017 12 11 Dolby AC 4 Audio Delivery for Next Generation Entertainment Services PDF Dolby Laboratories June 2015 Retrieved 11 November 2019 Bleidt R L Sen D Niedermeier A Czelhan B Fug S et al 2017 Development of the MPEG H TV Audio System for ATSC 3 0 PDF IEEE Transactions on Broadcasting 63 1 202 236 doi 10 1109 TBC 2017 2661258 S2CID 30821673 Schnell Markus Schmidt Markus Jander Manuel Albert Tobias Geiger Ralf Ruoppila Vesa Ekstrand Per Bernhard Grill October 2008 MPEG 4 Enhanced Low Delay AAC A New Standard for High Quality Communication PDF 125th AES Convention Fraunhofer IIS Audio Engineering Society Retrieved 20 October 2019 Lutzky Manfred Schuller Gerald Gayer Marc Kramer Ulrich Wabnik Stefan May 2004 A guideline to audio codec delay PDF 116th AES Convention Fraunhofer IIS Audio Engineering Society Retrieved 24 October 2019 a b Nagireddi Sivannarayana 2008 VoIP Voice and Fax Signal Processing John Wiley amp Sons p 69 ISBN 9780470377864 ITU T Work Programme ITU Terriberry Timothy B Presentation of the CELT codec Event occurs at 65 minutes also CELT codec presentation slides PDF Ekiga 3 1 0 available FreeSWITCH SignalWire Enhanced Voice Services EVS Codec PDF Fraunhofer IIS March 2017 Retrieved 19 October 2019 Abousleman G P Marcellin M W Hunt B R January 1995 Compression of hyperspectral imagery using 3 D DCT and hybrid DPCM DCT IEEE Trans Geosci Remote Sens 33 1 26 34 Bibcode 1995ITGRS 33 26A doi 10 1109 36 368225 Chan Y Siu W May 1997 Variable temporal length 3 D discrete cosine transform coding PDF IEEE Trans Image Processing 6 5 758 763 Bibcode 1997ITIP 6 758C CiteSeerX 10 1 1 516 2824 doi 10 1109 83 568933 hdl 10397 1928 PMID 18282969 Song J SXiong Z Liu X Liu Y An algorithm for layered video coding and transmission Proc Fourth Int Conf Exh High Performance Comput Asia Pacific Region 2 700 703 Tai S C Gi Y Lin C W September 2000 An adaptive 3 D discrete cosine transform coder for medical image compression IEEE Trans Inf Technol Biomed 4 3 259 263 doi 10 1109 4233 870036 PMID 11026596 S2CID 18016215 Yeo B Liu B May 1995 Volume rendering of DCT based compressed 3D scalar data IEEE Trans Comput Graphics 1 29 43 doi 10 1109 2945 468390 Chan S C Liu W Ho K I 2000 Perfect reconstruction modulated filter banks with sum of powers of two coefficients 2000 IEEE International Symposium on Circuits and Systems Emerging Technologies for the 21st Century Proceedings IEEE Cat No 00CH36353 Vol 2 pp 73 76 doi 10 1109 ISCAS 2000 856261 hdl 10722 46174 ISBN 0 7803 5482 6 S2CID 1757438 Queiroz R L Nguyen T Q 1996 Lapped transforms for efficient transform subband coding IEEE Trans Signal Process 44 5 497 507 Malvar 1992 Chan S C Luo L Ho K L 1998 M Channel compactly supported biorthogonal cosine modulated wavelet bases IEEE Trans Signal Process 46 2 1142 1151 Bibcode 1998ITSP 46 1142C doi 10 1109 78 668566 hdl 10722 42775 a b Katsaggelos Aggelos K Babacan S Derin Chun Jen Tsai 2009 Chapter 15 Iterative Image Restoration The Essential Guide to Image Processing Academic Press pp 349 383 ISBN 9780123744579 Mosquito noise PC Magazine Retrieved 19 October 2019 Menkman Rosa October 2011 The Glitch Moment um PDF Institute of Network Cultures ISBN 978 90 816021 6 7 Retrieved 19 October 2019 Ruff Thomas May 31 2009 jpegs Aperture p 132 ISBN 9781597110938 Colberg Jorg April 17 2009 Review jpegs by Thomas Ruff Discrete cosine transform MATLAB dct www mathworks com Retrieved 2019 07 11 Pennebaker William B Mitchell Joan L 31 December 1992 JPEG Still Image Data Compression Standard ISBN 9780442012724 Arai Y Agui T Nakajima M 1988 A fast DCT SQ scheme for images IEICE Transactions 71 11 1095 1097 Shao Xuancheng Johnson Steven G 2008 Type II III DCT DST algorithms with reduced number of arithmetic operations Signal Processing 88 6 1553 1564 arXiv cs 0703150 doi 10 1016 j sigpro 2008 01 004 S2CID 986733 Malvar 1992 Martucci 1994 Chan S C Ho K L 1990 Direct methods for computing discrete sinusoidal transforms IEE Proceedings F Radar and Signal Processing 137 6 433 doi 10 1049 ip f 2 1990 0063 a b Alshibami O Boussakta S July 2001 Three dimensional algorithm for the 3 D DCT III Proc Sixth Int Symp Commun Theory Applications 104 107 Guoan Bi Gang Li Kai Kuang Ma Tan T C 2000 On the computation of two dimensional DCT IEEE Transactions on Signal Processing 48 4 1171 1183 Bibcode 2000ITSP 48 1171B doi 10 1109 78 827550 Feig E Winograd S July 1992a On the multiplicative complexity of discrete cosine transforms IEEE Transactions on Information Theory 38 4 1387 1391 doi 10 1109 18 144722 Nussbaumer H J 1981 Fast Fourier transform and convolution algorithms 1st ed New York Springer Verlag Shao Xuancheng Johnson Steven G 2008 Type II III DCT DST algorithms with reduced number of arithmetic operations Signal Processing 88 6 1553 1564 arXiv cs 0703150 doi 10 1016 j sigpro 2008 01 004 S2CID 986733 Further reading EditNarasimha M Peterson A June 1978 On the Computation of the Discrete Cosine Transform IEEE Transactions on Communications 26 6 934 936 doi 10 1109 TCOM 1978 1094144 Makhoul J February 1980 A fast cosine transform in one and two dimensions IEEE Transactions on Acoustics Speech and Signal Processing 28 1 27 34 doi 10 1109 TASSP 1980 1163351 Sorensen H Jones D Heideman M Burrus C June 1987 Real valued fast Fourier transform algorithms IEEE Transactions on Acoustics Speech and Signal Processing 35 6 849 863 CiteSeerX 10 1 1 205 4523 doi 10 1109 TASSP 1987 1165220 Plonka G Tasche M January 2005 Fast and numerically stable algorithms for discrete cosine transforms Linear Algebra and Its Applications 394 1 309 345 doi 10 1016 j laa 2004 07 015 Duhamel P Vetterli M April 1990 Fast fourier transforms A tutorial review and a state of the art Signal Processing Submitted manuscript 19 4 259 299 doi 10 1016 0165 1684 90 90158 U Ahmed N January 1991 How I came up with the discrete cosine transform Digital Signal Processing 1 1 4 9 doi 10 1016 1051 2004 91 90086 Z Feig E Winograd S September 1992b Fast algorithms for the discrete cosine transform IEEE Transactions on Signal Processing 40 9 2174 2193 Bibcode 1992ITSP 40 2174F doi 10 1109 78 157218 Malvar Henrique 1992 Signal Processing with Lapped Transforms Boston Artech House ISBN 978 0 89006 467 2 Martucci S A May 1994 Symmetric convolution and the discrete sine and cosine transforms IEEE Transactions on Signal Processing 42 5 1038 1051 Bibcode 1994ITSP 42 1038M doi 10 1109 78 295213 Oppenheim Alan Schafer Ronald Buck John 1999 Discrete Time Signal Processing 2nd ed Upper Saddle River N J Prentice Hall ISBN 978 0 13 754920 7 Frigo M Johnson S G February 2005 The Design and Implementation of FFTW3 PDF Proceedings of the IEEE 93 2 216 231 CiteSeerX 10 1 1 66 3097 doi 10 1109 JPROC 2004 840301 S2CID 6644892 Boussakta Said Alshibami Hamoud O April 2004 Fast Algorithm for the 3 D DCT II PDF IEEE Transactions on Signal Processing 52 4 992 1000 Bibcode 2004ITSP 52 992B doi 10 1109 TSP 2004 823472 S2CID 3385296 Cheng L Z Zeng Y H 2003 New fast algorithm for multidimensional type IV DCT IEEE Transactions on Signal Processing 51 1 213 220 doi 10 1109 TSP 2002 806558 Wen Hsiung Chen Smith C Fralick S September 1977 A Fast Computational Algorithm for the Discrete Cosine Transform IEEE Transactions on Communications 25 9 1004 1009 doi 10 1109 TCOM 1977 1093941 Press WH Teukolsky SA Vetterling WT Flannery BP 2007 Section 12 4 2 Cosine Transform Numerical Recipes The Art of Scientific Computing 3rd ed New York Cambridge Unive, wikipedia, wiki, book, books, library,

article

, read, download, free, free download, mp3, video, mp4, 3gp, jpg, jpeg, gif, png, picture, music, song, movie, book, game, games.