CN101077013A - Scalable picture encoding - Google Patents
Scalable picture encoding Download PDFInfo
- Publication number
- CN101077013A CN101077013A CNA200580042710XA CN200580042710A CN101077013A CN 101077013 A CN101077013 A CN 101077013A CN A200580042710X A CNA200580042710X A CN A200580042710XA CN 200580042710 A CN200580042710 A CN 200580042710A CN 101077013 A CN101077013 A CN 101077013A
- Authority
- CN
- China
- Prior art keywords
- picture signal
- signal
- sampling
- picture
- encoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000005070 sampling Methods 0.000 claims description 81
- 238000000034 method Methods 0.000 claims description 22
- 238000004458 analytical method Methods 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 5
- 230000004048 modification Effects 0.000 claims description 5
- 238000012986 modification Methods 0.000 claims description 5
- 239000002131 composite material Substances 0.000 claims description 2
- 238000012937 correction Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 description 10
- 238000001914 filtration Methods 0.000 description 9
- 230000008901 benefit Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 230000002238 attenuated effect Effects 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000002349 favourable effect Effects 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000011002 quantification Methods 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression Of Band Width Or Redundancy In Fax (AREA)
Abstract
An encoding device (1) for encoding a picture signal (VS) comprises downsampling means (11) for converting the original picture signal into a downsampled picture signal, first encoding means (14) coupled to the downsampling means (11) for encoding the downsampled picture signal so as to provide a first encoded picture signal (BL), upsampling means (16) coupled to the downsampling means (11) for converting the downsampled picture signal into a upsampled picture signal, subtracting means (13) for producing a residual signal (RS) from the original picture signal and the upsampled picture signal, and second encoding means (14) coupled to the subtracting means (13) for encoding the downsampled picture signal so as to provide a second encoded picture signal (EL). The first encoding means (14) are arranged for lossy coding. The encoding device (1) is arranged for increasing the picture sharpness content of the residual signal (RS), and hence of the second encoded picture signal (EL), for example by using a filter (10).
Description
Technical field
The present invention relates to scalable image and video coding.More specifically, the present invention relates to coded image or vision signal so that produce the equipment and the method for at least two code signals with different resolution.
Background technology
Encoding and decoding image (static images (picture)) and video (motion picture) are the technology that people know.Defined widely used coding of graphics type in international MPEG-2 and MPEG-4 standard, it is for example being described in the study course of being write by I.E.G.Richardson and G.J.Sullivan " H.264 andMPEG-4 Video Compression (H.264 with the MPEG-4 video compression) " of publishing in 2003 by John Wiley and Sons Ltd..Typical scalable mpeg compatible encoding device comprises:
-down-sampler (downsampler) is used to produce the picture signal of down-sampling,
-the first encoder is coupled to described down-sampler, and the picture of the down-sampling that is used to encode is so that produce first encoded picture signal (" basic layer ") that expression has the picture of low resolution,
-decoder is coupled to described encoder, is used for reconstructing undersampled picture signal,
-up-sampler (upsampler) is coupled to first decoder, is used to rebuild original picture signal,
-subtracter is used for deducting the picture signal of reconstruction so that produce remaining (residual) (difference) signal from original picture signal, and
-the second encoder, the described residue signal that is used to encode are so that produce second encoded picture signal, and this picture signal is represented with described low resolution picture has high-resolution picture (" enhancement layer ").
The advantage that this known coding techniques has is that decoder can use first picture signal to draw the low resolution picture, perhaps uses two picture signals to draw high-resolution pictures.When first (" basic layer ") picture signal comprised most information, second (" enhancement layer ") picture signal was designed only to comprise the required additional information of enhancing resolution.Yet in fact second picture signal comprises the pseudomorphism of being introduced by (first) encoder (artifact) usually, and it causes the increase of bit rate.
The coding that uses in mpeg compatible equipment is a lossy coding, has promptly lost some information, makes intactly to rebuild original input picture signal.This information loss appears in the quantization step relevant with encoding process usually, and it causes the reduction of picture quality.This reduction can involve the introducing of pseudomorphism and/or the loss of resolution, and in the considerable advantage that provides bit rate to reduce, this reduction is difficult to discover usually.Yet lossy coding causes original picture signal and rebuilds difference between the picture signal, this and then the bit rate that has increased the information content and therefore increased by second (" enhancement layer ") encoded picture signal.
Summary of the invention
An object of the present invention is to overcome these and other problem of prior art, and provide a kind of equipment and method that is used for encoded picture signal, it produces second encoded picture signal of the bit rate with minimizing when keeping lossy coding and acceptable picture quality is provided.
Therefore, the invention provides a kind of encoding device that is used for encoded picture signal, this equipment comprises:
-downsampling device is used for original picture signal is transformed into the picture signal of down-sampling,
-the first code device is coupled to described downsampling device, and the picture signal of the down-sampling that is used to encode is so that provide first encoded picture signal,
-up-sampling device is coupled to described downsampling device, is used for the picture signal of down-sampling is transformed into the picture signal of up-sampling,
-substracting unit is used for producing residual picture signal from the picture signal of original picture signal and up-sampling,
-the second code device, the described residual picture signal that is used to encode be so that provide second encoded picture signal,
Wherein first code device is arranged for lossy coding, and wherein provides correcting device to be used to increase the picture sharpness content of residual picture signal.
By the up-sampling device is coupled to downsampling device, the up-sampling picture signal is not encoded and decodes, and has therefore eliminated any pseudomorphism of being introduced by the Code And Decode step.Because these pseudomorphisms are not included in the residue signal, so this signal comprises few information and therefore has the bit rate that significantly reduces.Yet such residue signal will cause tangible mass loss in many cases.For this reason, encoding device of the present invention is provided with correcting device, is used to increase the picture sharpness content of residue signal.Although the information content of this increase of residue signal must involve the bit rate of the increase of second code signal, the bit rate that obtains at last is lower than the bit rate of the corresponding signal of prior art.
Certainly, might omit correcting device.Yet this will cause having the picture of poor picture quality.Also might substitute lossy coding, but that might not cause the minimizing of bit rate, because it reduces sacrificing relevant with lossy coding usually data with lossless coding.And, will lose and MPEG and the compatibility of other standards such as AVC.
Should be noted that European patent EP 0 577 363 B1 disclose a kind of equipment that is used to compress the radioactivity image, wherein original image is by down-sampling, and is sampled subsequently, and then compares with original image to produce error image.The image of down-sampling stands the differential pulse coding modulation, and this is a kind of lossless coding technique.Therefore the problem of avoiding the bit rate that caused by the lossy coding technology to increase can not occur in this prior art equipment.In addition, the application of this prior art equipment is limited to radiation image, and owing to be lossless coding technique, and the equipment known to from EP 0 577 363B1 is non-mpeg compatible.
In the present invention, can use various correcting devices to increase the picture sharpness content of residue signal.In first embodiment, correcting device comprises that bandwidth reduces the bandwidth that device is used to reduce the up-sampling picture signal.Bandwidth reduces device can be made up of the filter apparatus that is arranged between downsampling device and the substracting unit, is used to reduce the bandwidth of down-sampling picture signal.Because the up-sampling picture signal is deducted from original picture signal to produce residue signal, so the bandwidth that reduces the up-sampling picture signal has just increased the bandwidth of residue signal, and therefore increased the picture sharpness content of residue signal, do not had pseudomorphism and also benefit from simultaneously.
This filter apparatus preferably designs by this way, if promptly first encoding device and decoding device are arranged between downsampling device and the up-sampling device, then the frequency distribution of the picture signal of up-sampling is equal to or is equivalent to the frequency distribution of same signal basically.Like this, kept compatibility with existing encoding device.Certainly, the frequency distribution of up-sampling signal can be different, for example have the filter apparatus of narrower passband by use and narrower than its homologue (counterpart) in the prior art equipment.
Should be noted that conventional codec and decoder comprise filter usually, perhaps show filtering characteristic at least, particularly when coding involves the quantification of picture signal value and/or blocks (truncation).The inventor recognizes: omit encoding apparatus and decoding apparatus from the loop of being made up of downsampling device, up-sampling device and substracting unit, reduce the quantity of the pseudomorphism in the residue signal, and removed the band limit filtering characteristic of Code And Decode device.Therefore, filter apparatus can be added into and finish this band limit effect and need not have the Code And Decode device.
Filter apparatus can combine with the up-sampling device.That is, the up-sampling device comprises (low pass) filter usually, and the characteristic of this filter can be adjusted to provide the frequency distribution of the up-sampling picture signal of wanting.Replacedly, or additionally, this filter apparatus can be arranged to connect with the up-sampling device.That is, can provide the independent filter cell that is coupled to the up-sampling device.
This filter apparatus preferably has low-frequency filter characteristics.That is: higher (space) frequency is attenuated lower (space) frequency of order by this filter apparatus.
Among first embodiment that is discussed in the above, correcting device comprises the filter apparatus that is arranged between downsampling device and the substracting unit, is used to reduce the bandwidth of up-sampling picture signal.In a second embodiment, correcting device comprises decoding device and another up-sampling device, another substracting unit and another adder, wherein this another up-sampling device is used to decode and the picture signal of up-sampling first encoded picture signal with the generation reconstruction, this another substracting unit is used to produce the difference of rebuilding picture signal and original picture signal, and this another adder is used for before coding described difference being added to residue signal.
In this second embodiment, the picture signal that provides two up-sampling devices to be used to produce two up-samplings, one of them is as previous be encoded and decoded subsequently among first embodiment, and one of them does not also have.By from original picture signal, deducting these two up-sampling signals and merging resulting residual picture signal then, obtained to have the new residual picture signal of the information content of increase.That is, do not comprise any pseudomorphism that to introduce by the Code And Decode step in (first) residual picture signal that does not have to produce under the situation of Code And Decode, and have lower picture sharpness content.Use Code And Decode to produce (second) residual picture signal and may comprise pseudomorphism and benefited, and therefore have than higher picture sharpness content from the filter effect of Code And Decode device.Therefore by making up these residual picture signal, reduced the relevant contribution of pseudomorphism and any unfiltered signal component, and obtained a kind ofly to be proved to be gratifying compromise.Second encoded picture signal has information (that is, picture sharpness) content, and therefore has the bit rate that causes improved picture quality, and this bit rate ratio is at the bit rate height that does not have to obtain under the situation of correcting device.Moreover the bit rate of second encoded picture signal is lower than the bit rate of the picture signal in traditional encoding device.
Preferably, encoding device comprises weighting device, is used for the picture signal of weighting respectively by this substracting unit and this another substracting unit output.Advantageously, weighting device comprises that multiplier is used for picture signal and each factor are multiplied each other, and factor sum equals 1 basically or approx.That is, weighting device allows to determine the relevant contribution of two residue signals.Should be appreciated that these two factors all should be greater than 0 in order to obtain benefit of the present invention.
In a second embodiment, the residue signal that provides the additional code device to be used to encode by substracting unit output is favourable so that produce additional encoded signal.The additional code device can be linked to second code device so that encoding process is easier.
First and second embodiment can be by appropriate combination, therefore the equipment of second embodiment is provided, and it comprises that in addition filter apparatus is used for (but be not encoded and decode) picture signal of filtering up-sampling.
Encoding device of the present invention can advantageously further comprise: signal analysis device is used for analyzing the input picture signal and produces quality signal; And multiplier (or suitable controlled amplifier), being used for residue signal and quality signal are multiplied each other so that produce the residual picture signal of revising, it preferably has the amplitude (that is, quality signal preferably is equal to or greater than 1) of increase.This allows residue signal to be attenuated (or amplification) according to the picture signal of using or be encoded.
In another embodiment, encoding device of the present invention may further include composite set, is used for the residual picture signal and skew (offset) signal of residual picture signal or modification are made up so that produce the residual picture signal of average correction.This allows compensation DC skew.
If encoding device of the present invention is arranged for coming the encoded picture image according to international picture compression standard (being preferably mpeg standard or AVC standard), then is particularly preferred.This has guaranteed and compatibility existing and decoding device in the future.Yet, the invention is not restricted to operating such, and can break away from any standard if necessary.
In addition, the invention provides some equipment, such as comprising the consumer device of encoding device as defined above.As non-limitative example, the invention provides and comprise the picture storage device of encoding device as defined above, such as DVD recorder, based on the hard disk of picture storage device, the computer and the equal equipment of the suitable software program of operation.
Another example of equipment above-mentioned is to be used to transmit the network equipment that pictorial information is given remote unit, and this network equipment comprises encoding device as defined above.Such network equipment can for example make in the family and be used for transmitting picture to various display screens, computer and other equipment.
Another example of the top equipment of mentioning is a portable consumer device, and it comprises receiver, transmitter and encoding device as defined above.Such portable consumer device can be mobile (honeycomb) telephone plant, perhaps has the laptop computer or the laptop devices of transceiver arrangement.
Another example of the top equipment of mentioning is a camera apparatus, and it comprises encoding device as defined above.Such camera apparatus can be to be used for image (still picture), motion picture (video) or the camera of the two.
The present invention also provides a kind of picture treatment facility of encoding device as defined above that comprises.The present invention provides in addition: a kind of decoding device, the picture signal that is used to decode and uses the above encoding device that defines to encode; A kind of picture signal, it is encoded by the encoding device of above definition or with undefined method; And a kind of information carrier, it comprises by the encoding device of above definition or with the pictorial information of undefined method coding.Such picture signal can be by any appropriate device for example cable, optical cable, perhaps for example use radio wave or infrared light (infrared light can use bluetooth or similar techniques to transmit), transmit via cable system or by the Internet with wireless mode.Suitable information carrier can be by DVD or similarly optical information carrier or magnetic information carrier are formed such as hard disk.
The present invention also provides a kind of method of encoded picture signal, and this method may further comprise the steps:
-original picture signal is transformed in the picture signal of down-sampling,
-coding down-sampling picture signal so that first encoded picture signal is provided,
-picture signal of down-sampling is transformed in the picture signal of up-sampling,
-from the picture signal of original picture signal and up-sampling, produce residual picture signal by subtraction,
The described residual picture signal of-coding is so that provide second encoded picture signal, and wherein, the step of picture signal of coding down-sampling comprises lossy coding, and wherein this method further comprises the step of the picture sharpness content that increases residual picture signal.
The present invention provides a kind of computer program to be used to carry out method as defined above in addition.Should be noted that and in this text, can integrally or partly be embodied as hardware (for example part of application specific IC) in disclosed any algorithm composition reality or be embodied as the software that operates on dedicated digital signal processor or the general processor.Computer program is appreciated that any physics realization that refers to command set, and wherein this command set enable pass usefulness or application specific processor are carried out any functions peculiar of the present invention after the described loading step of ordering in the processor of a series of loading.Particularly, this computer program may be implemented as at carrier such as resembling data on disk or the tape, be present in data in the memory, connecting the data that transmit or the program code on the paper by (wired or wireless) network.Except program code, the required distinctive data of program can also be presented as computer program.
Description of drawings
Exemplary embodiment is below with reference to accompanying drawings further explained the present invention, wherein:
Fig. 1 has schematically shown the first coding of graphics equipment according to prior art.
Fig. 2 has schematically shown the second coding of graphics equipment according to prior art.
Fig. 3 has schematically shown first embodiment according to coding of graphics equipment of the present invention.
Fig. 4 has schematically shown second embodiment according to coding of graphics equipment of the present invention.
Fig. 5 has schematically shown an embodiment according to picture decoding device of the present invention.
Fig. 6 has schematically shown first embodiment according to filter cell of the present invention.
Fig. 7 has schematically shown second embodiment according to filter cell of the present invention.
Fig. 8 has schematically shown according to filtering characteristic of the present invention.
Fig. 9 has schematically shown the 3rd embodiment according to coding of graphics equipment of the present invention.
Figure 10 has schematically shown the 4th embodiment according to coding of graphics equipment of the present invention.
Specific embodiment
Prior art encoding device 1 ' shown in Fig. 1 comprises down-sampler 11, first coding unit 14, decoding unit 15, up-sampler 12, subtrator 13 and second coding unit 16.Downsampling unit 11 receives original picture signal VS and the picture signal of down-sampling is presented to first encoder 14, and this picture signal is encoded in first encoder 14.The resulting first encoded picture signal BL is output and presents to decoding unit 15.The picture signal of decoding is sampled in up-sampling unit 12, is deducted from original picture signal VS in subtrator 13 then.Resulting residual picture signal RS exports by second coding unit, 16 codings and as the second encoded picture signal EL.In the mpeg compatible system, the first encoded picture signal BL is called " basic layer ", and the second encoded picture signal EL is known as " enhancement layer ".The first encoded picture signal BL and the second encoded picture signal EL form together and are sent out and/or stored encoded picture signal.
In this known arrangement, residue signal RS represents any error by down-sampling, coding, decoding and the introducing of up-sampling step.Yet these steps artifacts cause that residue signal RS comprises undesired information, and it has increased by the bit rate (the information unit quantity of per second) of the second encoded picture signal EL conversely greatly.These pseudomorphisms mainly are to cause owing to lossy coding that first coding unit 14 uses, and it typically comprises the quantification of signal value and/or blocks.
A kind of possible solution has been shown among Fig. 2, and wherein encoding device 1 " also have down-sampler 11, up-sampler 12, first coding unit 14, subtrator 13 and second coding unit 16.Yet in the equipment of Fig. 2, first encoding device 14 has been arranged at outside the loop of being made up of unit 11,12 and 13.In addition, there is not any decoding unit.As a result, residue signal RS does not comprise any pseudomorphism that may be introduced by first cell encoder 14.
The Code And Decode unit of Fig. 1 is not only introduced pseudomorphism but also is had filter function.Such filter function can be operated by the conversion coefficient weighting that helps attenuates higher frequency and cause.The inventor recognizes, by coding unit 14 and decoding unit 15 are placed on outside the loop of being made up of unit 11,12 and 13 (Fig. 2), has lost this filter function.As a result, the bandwidth of the picture signal of up-sampling is broadened, and the bandwidth of residue signal RS is narrowed down, and the picture sharpness content of the second code signal EL is reduced.Find that also this information loss can cause tangible picture degradation.
This problem is solved by the encoding device of the present invention 1 shown in Fig. 3.The only exemplary encoding device 1 of this of Fig. 3 also comprises the comparison loop of being made up of downsampling unit 11, up-sampling unit 12 and subtrator 13, and first encoder 14 and second encoder 16 are placed on outside this loop.The arrangement of comparison diagram 2, filter cell 10 are arranged to connect with up-sampling unit 12.This filter cell 10 has replaced effectively and has been placed on the coding unit 14 in the loop and the filter function of decoding unit 15 in the arrangement of Fig. 1.By this way, kept that cell encoder 14 and decoder element 15 are placed on good effect outside the loop, and their filter function is replaced by filter 10.
In Fig. 3, filter cell 10 is shown in the upstream of up-sampling unit 12.Yet this is optional, and filter cell 10 can also be placed on the downstream of up-sampling unit 12.In other embodiment (not shown), filter cell 10 can be integrated in the up-sampling unit 12.That is, the up-sampling unit generally includes a filter, and it can be adapted to the filtering characteristic with additional filter 10.This is illustrated schematically among Fig. 8, wherein the absolute value of filter transfer function H | and H| is shown schematically as the function of frequency f.The original filter transfer function H of up-sampling unit 12 is indicated with I, and indicates with II as the filter transfer function that filter 10 is included in the modification of the result in the up-sampling unit 12.In an example shown, the effect of integrated filter 10 is the narrowing down of passband of filter in up-sampler 12.
This is by further shown in Fig. 6 and 7.In Fig. 6, more specifically show the exemplary embodiment of downsampling unit 11.Unit 11 is shown as and comprises low pass filter 113 and down-sampler 115.Similarly, up-sampling unit 12 is shown as and comprises interpolation unit 121 and low pass filter 123.Low pass filter 123 obtains its filter factor from convolution unit 127, and wherein convolution unit 127 is arranged to carry out the convolution of two groups of filter factors.The coefficient sc of standard is the coefficient that the low pass filter 10 by the up-sampling unit uses routinely.The coefficient ac of change is the coefficient of the low pass filter 10 of Fig. 3.By carrying out the convolution of these two groups of filter factors, filter 123 has obtained two filtering characteristics (contrast Fig. 8) that filtering characteristic is combined.By this way, can obtain favorable characteristics of the present invention and not need with additional filter (10 among Fig. 3) is cost.
Schematically show the alternative embodiment of encoding device 1 of the present invention among Fig. 4.The embodiment of Fig. 4 comprises signal analysis (SA) unit 17 in addition, is used to detect the feature of picture signal, such as the edge.Margin signal ES and residue signal RS by signal analysis unit 17 outputs multiply each other in multiplier 18.This allows residue signal RS to be exaggerated near the edge of picture signal and other features, causes higher-spatial frequencies (picture sharpness information) content that increases usually.
Near residue signal RS this (smaller) edge and other important picture features is enlarged into any higher frequency components that may lose provides compensation.
The embodiment of Fig. 4 also comprises assembled unit (adder) 19, is used for combination (decay) residue signal RS and shifted signal DC, to adjust the DC level of signal before coding.
Schematically show a kind of decoder of the picture signal that produces by encoding device 1 of the present invention of being used to decode among Fig. 5.The decoding device of Fig. 5 comprises: first decoding unit 44, and the first encoded picture signal BL is used to decode; And second decoding unit 46, the second encoded picture signal EL is used to decode.Up-sampling unit 41 is coupled to first decoding unit 44.From second picture signal of decoding, deduct first picture signal up-sampling and decoding at subtracter 43 places.In an illustrated embodiment, skew is adjusted (shifted signal DC) and is performed before giving subtracter 43 presenting the second decoding picture signal.Signal by subtracter 43 outputs is the picture signal VS that rebuilds ".
Schematically show the alternative embodiment of encoding device 1 of the present invention among Fig. 9.In the embodiment of Fig. 9, first encoder 14 also is placed on outside the loop of being made up of unit 11,12 and 13.Yet decoder 15 and up-sampler 21 are being followed in first encoder, 14 back, to produce the picture signal VS ' that rebuilds.In subtracter 22, from original picture signal VS, deduct the picture signal VS ' of reconstruction, to produce an auxiliary residual signal.As among the embodiment of Fig. 3 and 4, main residue signal RS is produced by subtracter 13.Main residue signal RS and auxiliary residual signal RS ' are combined in assembled unit (adder) 25.The residue signal of this combination is encoded to produce the second encoded picture signal EL by second encoder 16 then.The first encoded picture signal BL and the second encoded picture signal EL form (for example by cable system or the Internet) together and are transmitted and/or (for example light or magnetic information carrier such as DVD on) stored encoded picture signal.
As can seeing from Fig. 9, (master) residue signal RS does not comprise any pseudomorphism that is produced by encoder 14, and (in an illustrated embodiment) its be not to use additional filtering (filter 10 among Fig. 3 and 4) to produce.Auxiliary residual signal RS ' produces (contrast Fig. 1) according to prior art, and can comprise pseudomorphism and be benefited from the filtering that coding unit 14 and decoding unit 15 are carried out.By main residue signal RS of combination and auxiliary residual signal RS ' in assembled unit 25, the residue signal that acquisition obtains at last, it has made up the favorable characteristics of of the present invention and prior art and has alleviated unfavorable feature simultaneously.
In the embodiment of Fig. 9, multiplier 23 and 24 is provided to (master) residue signal RS and auxiliary residual signal RS ' be multiply by weighted factor a and weighted factor b respectively.Preferably, a and b be greater than 0, and a and b sum approximate 1 (a+b ≈ 1).Like this, the residue signal by second encoder, 16 codings is the weighted average of main residual picture signal RS and auxiliary residual picture signal RS '.The exact value of weighted factor a and b can depend on application-specific.
The another embodiment of encoding device 1 of the present invention has been shown among Figure 10.The embodiment of Figure 10 is similar to the embodiment of Fig. 9, and also has first coding unit 14 that is built up in outside the loop of being made up of unit 11,12 and 13.And auxiliary residual picture signal RS ' is produced by subtrator 22.Yet, the embodiment of comparison diagram 9, the embodiment of Figure 10 use first coding unit 14, second coding unit 16 and the 3rd coding unit 29 also to produce the second encoded picture signal EL1 and the 3rd encoded picture signal EL2 respectively except producing the first encoded picture signal EL.The second encoded picture signal EL1 produces by coding (master) residue signal RS, and the difference of the 3rd encoded picture signal EL2 by encode original picture signal RS and auxiliary residual picture signal RS ' produces.This has such advantage, and promptly the second encoded picture signal EL1 provides certain compensation of any high frequency loss and generation are in enhancement layer than low bit rate.Though the frequency compensation of the second encoded picture signal EL1 is an approximation, the 3rd encoded picture signal EL2 will quite accurately compensate any other frequency loss.Second coding unit 16 and the 3rd coding unit 29 can be linked so that avoid the repetition of coded message.For example, any motion vector by second coding unit, 16 codings needn't be included among the 3rd encoded picture signal EL2 that is encoded by the 3rd coding unit 29.As a result, the 3rd encoded picture signal EL2 can have low-down bit rate.
(master) residual picture signal RS can be attenuated by (choosing wantonly) multiplier 23, and wherein multiplier 23 is fed with multiplication factor C.Equally, the picture signal that is sent to the 3rd coding unit 29 can use (choosing wantonly) multiplier 28 to decay, and wherein multiplier 28 is fed with multiplication factor D.Factor C and D can decide according to the content of application-specific and/or picture signal.
Fig. 3 and 4 embodiment can be combined with the embodiment of Fig. 9 and 10.For example, in the embodiment of Fig. 9 and 10, can arrange filter 10 to connect with up-sampling unit 12.Additionally or alternatively, filter 10 can be made up of a series of arrangements of converter unit (for example number cosine converting unit), weighted units, contrary weighted units and inverse transformation block.Other modifications are conspicuous for a person skilled in the art.
Encoding device of the present invention can be used in and for example be used to transmit pictorial information and give the network equipment of remote unit, portable consumer device such as phone that comprises receiver and transmitter and camera apparatus.
The present invention is based on such understanding, promptly, can reduce the bit rate of second (" enhancement layer ") encoded picture signal by from the circuit that produces residue signal, removing lossy encoder and decoder.The present invention benefits from other understanding, promptly by comprising that in described circuit filter can strengthen picture quality greatly, and the residue signal that produces according to the present invention by combination and can reach suitable bit rate according to the residue signal that prior art produces and reduce.
Should be noted that employed any term should not be considered to limiting the scope of the invention in this document.Particularly, word " comprises " any parts that do not mean that eliminating is not specifically stated.Single (circuit) parts can be substituted by a plurality of (circuit) parts or its equivalent.
It will be understood by those of skill in the art that the present invention be not subject to above shown in embodiment, and can under the prerequisite that does not deviate from the scope of the present invention that defines in the claims, make many modifications and increase.
Claims (20)
1. encoding device (1) that is used for encoded picture signal (VS), this equipment comprises:
-downsampling device (11) is used for original picture signal is transformed into the picture signal of down-sampling,
-the first code device (14) is coupled to described downsampling device (11), and the picture signal of the down-sampling that is used to encode is so that provide first encoded picture signal (BL),
-up-sampling device (12) is coupled to described downsampling device (11), is used for the picture signal of down-sampling is transformed into the picture signal of up-sampling,
-substracting unit (13) is used for producing residual picture signal (RS) from the picture signal of original picture signal and up-sampling,
-the second code device (16), the described residual picture signal (RS) that is used to encode be so that provide second encoded picture signal (EL),
Wherein first code device (14) is arranged for lossy coding, and correcting device (10 wherein is provided; 15,21,22) be used to increase the picture sharpness content of residual picture signal (RS).
2. according to the equipment of claim 1, wherein said correcting device comprises that bandwidth reduces device, is used to reduce the bandwidth of up-sampling picture signal.
3. according to the equipment of claim 2, wherein this bandwidth minimizing device comprises the filter apparatus (10) that is arranged between downsampling device (11) and the substracting unit (13), and this filter apparatus (10) preferably has low-frequency filter characteristics.
4. according to the equipment of claim 3, wherein said filter apparatus (10) is incorporated into up-sampling device (12).
5. according to the equipment of claim 3, wherein said filter apparatus (10) is arranged to connect with up-sampling device (12).
6. according to the equipment of claim 1, wherein this correcting device comprises: decoding device (15) and another up-sampling device (21) are used for decoding and up-sampling first encoded picture signal (BL) with the picture signal that produces reconstruction (VS '); Another substracting unit (22) is used for produce rebuilding the difference of picture signal (VS ') and original picture signal (VS); And another adder (25), be used for before coding, described difference being added to residue signal (RS).
7. according to the equipment of claim 6, further comprise weighting device (23,24), be used for the picture signal of weighting respectively by described substracting unit (13) and described another substracting unit (22) output.
8. according to the equipment of claim 6, further comprise additional code device (16), the residue signal by described substracting unit output of being used to encode is so that produce additional encoded signal.
9. according to the equipment of claim 1, further comprise: signal analysis device (17) is used for analyzing input picture signal (VS) and produces quality signal (ES); And multiplier (18), be used for residue signal and quality signal are multiplied each other so that produce the residual picture signal of revising; This quality signal (ES) preferably is equal to or greater than 1.
10. according to the equipment of claim 1, further comprise composite set (19), be used for the residual picture signal and the shifted signal (DC) of residual picture signal or modification are made up so that produce the residual picture signal of average correction.
11. picture storage device that comprises the encoding device according to claim 1 (1).
12. one kind is used to transmit the network equipment that pictorial information is given remote unit, this network equipment comprises the encoding device (1) according to claim 1.
13. a portable consumer device, it comprises receiver, transmitter and according to the encoding device (1) of claim 1.
14. camera apparatus that comprises the encoding device according to claim 1 (1).
15. the method for an encoded picture signal (VS), this method may further comprise the steps:
-original picture signal is transformed in the picture signal of down-sampling,
-coding down-sampling picture signal so that first encoded picture signal (BL) is provided,
-picture signal of down-sampling is transformed in the picture signal of up-sampling,
-from the picture signal of original picture signal and up-sampling, produce residual picture signal (RS) by subtraction,
-described the residual picture signal of encoding (RS) is so that provide second encoded picture signal (EL), the step of picture signal of down-sampling of wherein encoding comprises lossy coding, and wherein this method further comprises the step of the picture sharpness content that increases residual picture signal (RS).
16., further comprise the step of the bandwidth that reduces the up-sampling picture signal according to the method for claim 15.
17. the method according to claim 15 further may further comprise the steps:
-analyze input picture signal (VS) and produce quality signal (ES), and
-residue signal and quality signal are multiplied each other so that produce the residual picture signal of revising, described quality signal (ES) preferably is equal to or greater than 1.
18. a picture signal, it is by encoding according to the encoding device (1) of claim 1 or according to the method for claim 15.
19. an information carrier, it comprises by according to the encoding device (1) of claim 1 or according to the picture of the method coding of claim 15.
20. a computer program is used to carry out the executable step of following processor:
-original picture signal is transformed in the picture signal of down-sampling,
-coding down-sampling picture signal so that first encoded picture signal (BL) is provided,
-picture signal of down-sampling is transformed in the picture signal of up-sampling,
-from the picture signal of original picture signal and up-sampling, produce residual picture signal (RS) by subtraction,
-described the residue signal (RS) of encoding is so that provide second encoded picture signal (EL),
The step of picture signal of down-sampling of wherein encoding comprises lossy coding, and wherein this method further comprises the step of the picture sharpness content that increases residual picture signal (RS).
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP04106509 | 2004-12-13 | ||
| EP04106509.5 | 2004-12-13 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101077013A true CN101077013A (en) | 2007-11-21 |
Family
ID=36263884
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA200580042710XA Pending CN101077013A (en) | 2004-12-13 | 2005-12-08 | Scalable picture encoding |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20090252425A1 (en) |
| EP (1) | EP1829380A1 (en) |
| JP (1) | JP2008523686A (en) |
| KR (1) | KR20070090245A (en) |
| CN (1) | CN101077013A (en) |
| WO (1) | WO2006064422A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104685877A (en) * | 2012-09-28 | 2015-06-03 | Vid拓展公司 | Adaptive upsampling for multi-layer video coding |
| CN106162180A (en) * | 2016-06-30 | 2016-11-23 | 北京奇艺世纪科技有限公司 | A kind of image coding/decoding method and device |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7956930B2 (en) | 2006-01-06 | 2011-06-07 | Microsoft Corporation | Resampling and picture resizing operations for multi-resolution video coding and decoding |
| US8253752B2 (en) * | 2006-07-20 | 2012-08-28 | Qualcomm Incorporated | Method and apparatus for encoder assisted pre-processing |
| US8155454B2 (en) * | 2006-07-20 | 2012-04-10 | Qualcomm Incorporated | Method and apparatus for encoder assisted post-processing |
| US8199812B2 (en) | 2007-01-09 | 2012-06-12 | Qualcomm Incorporated | Adaptive upsampling for scalable video coding |
| US8953673B2 (en) | 2008-02-29 | 2015-02-10 | Microsoft Corporation | Scalable video coding and decoding with sample bit depth and chroma high-pass residual layers |
| US8711948B2 (en) | 2008-03-21 | 2014-04-29 | Microsoft Corporation | Motion-compensated prediction of inter-layer residuals |
| US9571856B2 (en) | 2008-08-25 | 2017-02-14 | Microsoft Technology Licensing, Llc | Conversion operations in scalable video encoding and decoding |
| JP5625342B2 (en) * | 2009-12-10 | 2014-11-19 | ソニー株式会社 | Image processing method, image processing apparatus, and program |
| JP5428886B2 (en) * | 2010-01-19 | 2014-02-26 | ソニー株式会社 | Information processing apparatus, information processing method, and program thereof |
| CN102148959B (en) * | 2010-02-09 | 2016-01-20 | 北京中星微电子有限公司 | The moving target detecting method of a kind of video monitoring system and image thereof |
| US8768140B2 (en) * | 2010-02-15 | 2014-07-01 | Panasonic Corporation | Data processing unit and data encoding device |
| JP5703781B2 (en) | 2010-09-03 | 2015-04-22 | ソニー株式会社 | Image processing apparatus and method |
| GB2492397A (en) * | 2011-06-30 | 2013-01-02 | Canon Kk | Encoding and decoding residual image data using probabilistic models |
| US10873772B2 (en) * | 2011-07-21 | 2020-12-22 | V-Nova International Limited | Transmission of reconstruction data in a tiered signal quality hierarchy |
| US10045089B2 (en) * | 2011-08-02 | 2018-08-07 | Apple Inc. | Selection of encoder and decoder for a video communications session |
| US9324161B2 (en) * | 2013-03-13 | 2016-04-26 | Disney Enterprises, Inc. | Content-aware image compression method |
| US10856023B2 (en) * | 2016-04-12 | 2020-12-01 | Sony Corporation | Transmission apparatus, transmission method, reception apparatus, and reception method |
| GB2623547A (en) * | 2022-10-19 | 2024-04-24 | Sony Interactive Entertainment Europe Ltd | Progressive refinement video enhancement |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5289548A (en) * | 1992-06-30 | 1994-02-22 | Loral Aerospace Corp. | Compression and reconstruction of radiological images |
| CA2406459C (en) * | 2000-04-07 | 2006-06-06 | Demografx | Enhanced temporal and resolution layering in advanced television |
| JP2005506815A (en) * | 2001-10-26 | 2005-03-03 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Method and apparatus for spatially extensible compression |
| US6862372B2 (en) * | 2001-12-27 | 2005-03-01 | Koninklijke Philips Electronics N.V. | System for and method of sharpness enhancement using coding information and local spatial features |
| AU2003283723A1 (en) * | 2002-12-10 | 2004-06-30 | Koninklijke Philips Electronics N.V. | A unified metric for digital video processing (umdvp) |
-
2005
- 2005-12-08 CN CNA200580042710XA patent/CN101077013A/en active Pending
- 2005-12-08 WO PCT/IB2005/054123 patent/WO2006064422A1/en not_active Application Discontinuation
- 2005-12-08 US US11/721,339 patent/US20090252425A1/en not_active Abandoned
- 2005-12-08 JP JP2007545064A patent/JP2008523686A/en not_active Withdrawn
- 2005-12-08 KR KR1020077016109A patent/KR20070090245A/en not_active Application Discontinuation
- 2005-12-08 EP EP05826520A patent/EP1829380A1/en not_active Withdrawn
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104685877A (en) * | 2012-09-28 | 2015-06-03 | Vid拓展公司 | Adaptive upsampling for multi-layer video coding |
| US10218971B2 (en) | 2012-09-28 | 2019-02-26 | Vid Scale, Inc. | Adaptive upsampling for multi-layer video coding |
| CN104685877B (en) * | 2012-09-28 | 2019-03-29 | Vid拓展公司 | Adaptive upsampling for multi-layer video coding |
| CN106162180A (en) * | 2016-06-30 | 2016-11-23 | 北京奇艺世纪科技有限公司 | A kind of image coding/decoding method and device |
| US10819994B2 (en) | 2016-06-30 | 2020-10-27 | Beijing Century Technology., Ltd | Image encoding and decoding methods and devices thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| US20090252425A1 (en) | 2009-10-08 |
| EP1829380A1 (en) | 2007-09-05 |
| KR20070090245A (en) | 2007-09-05 |
| JP2008523686A (en) | 2008-07-03 |
| WO2006064422A1 (en) | 2006-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101077013A (en) | Scalable picture encoding | |
| US9838715B2 (en) | Image processing apparatus and method | |
| CN1303817C (en) | System and method for encoding and decoding residual signal for fine granular scalable video | |
| CN1253009C (en) | Spatial scalable compression | |
| CN1173577C (en) | DCT domain lawer conversion system for compensation of IDCT dismatch | |
| CN1383684A (en) | Color video encoding and decoding method | |
| US20090304273A1 (en) | Information processing apparatus and information processing method | |
| WO2008026896A1 (en) | Video encoding apparatus and method and video decoding apparatus and method | |
| US20150256837A1 (en) | Video compression method | |
| Lee et al. | DPICT: Deep progressive image compression using trit-planes | |
| Agarwal et al. | Multiple image compression in medical imaging techniques using wavelets for speedy transmission and optimal storage | |
| CN1947146A (en) | Method of down-sampling data values | |
| CN1906946A (en) | Device and method for playing back scalable video streams | |
| KR20040023606A (en) | Method and apparatus for three-dimensional wavelet transform | |
| CN116762338A (en) | Video encoding using preprocessing | |
| US7630568B2 (en) | System and method for low-resolution signal rendering from a hierarchical transform representation | |
| Matsuo et al. | Video coding with wavelet image size reduction and wavelet super resolution reconstruction | |
| US7123773B2 (en) | Image coding-decoding method, image coding-decoding system, image coder, image decoder, and storage medium | |
| US20100322305A1 (en) | Arbitrary-resolution, extreme-quality video codec | |
| US8045824B2 (en) | Wavelet transformation-based image encoder, decoder and method for generating thumbnail image | |
| CN1842820A (en) | Method for spatial up-scaling of video frames | |
| CN1310190C (en) | Discrete wavelet transform unit and method for adaptively encoding still image based on energy of each block | |
| CN1949821A (en) | Method for recovering image with removal of noise in frequency image data and apparatus thereof | |
| CN1633814A (en) | Memory-bandwidth efficient FGS encoder | |
| JP2014521273A (en) | Method and apparatus for encoding an image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |