WO2002001883A1 - Image encoder and image encoding method - Google Patents
Image encoder and image encoding method Download PDFInfo
- Publication number
- WO2002001883A1 WO2002001883A1 PCT/JP2000/004263 JP0004263W WO0201883A1 WO 2002001883 A1 WO2002001883 A1 WO 2002001883A1 JP 0004263 W JP0004263 W JP 0004263W WO 0201883 A1 WO0201883 A1 WO 0201883A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- signal
- frame
- encoding
- moving image
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
- G06T9/007—Transform coding, e.g. discrete cosine transform
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/16—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter for a given display mode, e.g. for interlaced or progressive display mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
Definitions
- the present invention relates to an image encoding device and an image encoding method for encoding a moving image signal without affecting a frame rate output on a decoding side.
- Digitizing a moving image signal results in an enormous amount of data, so when storing it on a recording medium such as an optical disk or broadcasting / communicating, the coding process is performed on the moving image signal. The amount of data can be reduced.
- DCT discrete cosine transform
- MC interframe differential coding with measurement
- a motion vector is calculated for each block of a predetermined size from a coded image and an image to be coded, and a difference signal obtained from both images is calculated.
- the motion vector is encoded.
- the image to be coded or the above-mentioned differential signal is transformed from the spatial domain to the frequency domain, and the generated DCT coefficients are quantized according to the quantization step size according to the transfer rate.
- This quantization stepper The size is set to one of a preset range (for example, an integer from 1 to 31 in the case of the MPEG system), and when the quantization step size is increased, the code amount is greatly reduced.
- the image quality deteriorates accordingly.
- the code amount is reduced from about 20/50 to 1/50. It is known that various coding noises such as “block noise” and “mosquito noise” are generated, and the quality of the decoded image is significantly deteriorated.
- Data compression is performed by thinning out some frames according to the characteristics.
- the encoded data is decoded as it is on the decoding side, and the image of the thinned frame is decoded. The image of the previous frame is continuously displayed.
- the encoding method such as the MPEG-2 method, which is defined so that the frame rate of the moving image signal is fixed at the time of decoding and is output.
- the decoding side cannot decode the encoded data as it is and cannot continuously display, for example, the image of the previous frame as an image of the thinned frame.
- the encoding method specified to output the video signal at a fixed frame rate during decoding does not affect the frame rate output on the decoding side, and the image quality deteriorates. There was a problem that it was difficult to achieve overnight compression while suppressing the noise.
- the present invention has been made to solve the above problems, and
- the encoding method is defined to control the frame rate and image size of the moving image signal and to output the moving image signal at a fixed frame rate during decoding, based on the processing information.
- the video signal after the control is coded, and the decoded data suitable for the coding method is output, so that the image rate is degraded without affecting the frame rate output on the decoding side. It is an object of the present invention to provide an image encoding device and an image encoding method capable of realizing data compression while suppressing image compression. Disclosure of the invention
- the image coding apparatus which concerns on this invention, when an input image controller codes by the coding system prescribed
- the moving image signal processed by the image controller is encoded into data suitable for the encoding method based on the processing information.
- the data after encoding according to the encoding method is output, it is possible to reduce the amount of code without changing the configuration of the decoding side, and the effect is obtained.
- the image encoder performs encoding by the MPEG2 system.
- the input image controller removes one field of the frame at a predetermined rate when the moving image signal is an in-lace signal.
- processing information indicating the removed field is output, and the image encoder detects removal of the field based on the processing information, and outputs another field instead of the removed field when decoding.
- the command is added as overhead information to encode the processed video signal.
- the input image controller when the moving image signal is a progressive signal, the input image controller removes frames at a predetermined rate, outputs the processed moving image signal, Then, processing information indicating the removed frame is output, and the image encoder detects removal of the frame based on the processing information, and issues a command to output another frame instead of the removed frame when decoding.
- the processed moving image signal is encoded by adding it as bar head information.
- the input image controller when the moving image signal is an in-lace signal, the input image controller removes one field of the frame at a predetermined rate, and performs processing. In addition to outputting the subsequent moving image signal, it also outputs processing information indicating the removed field, and the image encoder detects removal of the field based on the processing information, and outputs the removed field with another field. Predictive encoding is performed based on the fields to generate encoded data corresponding to the removed fields. As a result, predictive coding is performed on the decimated fields, and the effect that the amount of codes can be reduced can be obtained.
- the image encoder performs predictive encoding by setting all motion vectors in the horizontal direction and the vertical direction to 0.
- the image encoder sets all the horizontal motion vectors to 0 and sets all the vertical motion vectors to zero.
- either the image encoder or the input image controller measures a motion vector from two fields which are fields before and after the removed field. Then, the image encoder interpolates the measured motion vector according to each interval between the two fields and the removed field, and performs predictive coding on the removed field. As a result, an effect is obtained that deterioration of the decoded image can be reduced.
- the input image controller changes the image size of the moving image signal, outputs the processed moving image signal, and outputs processing information indicating that the image size has been changed.
- the image encoder detects, from the processed moving image signal, a frame whose image size has been changed based on the processing information, and intra-frame encodes the frame.
- the input image controller changes the image size of the moving image signal at the beginning of a predetermined image unit, and the image encoder converts the image-sized frame into a frame. Inner encoding.
- an effect is obtained that the frequency of encoding in the intra-frame encoding mode can be reduced.
- the input image controller changes the image size of the frame immediately after the GOP header. This allows The effect is obtained that the frequency of encoding in the intra-frame encoding mode can be reduced.
- the input image controller suppresses the high-frequency component of the moving image signal. This has the effect of reducing the amount of code.
- the input image controller executes a predetermined process according to the picture type of each frame.
- an I-picture which is a reference at the time of predictive coding, is coded as it is as an input video signal, so that the effect of being able to execute coding more faithfully is obtained.
- the input image controller determines, based on at least one of a variance of pixel values in each frame, a difference in pixel values between frames, and a motion vector.
- the data amount of the data encoded by the image encoder is determined, and a predetermined process is executed according to the data amount.
- a predetermined process is executed so as to reduce the code amount, and the effect that the code amount can be made constant can be obtained.
- the input image controller determines the amount of data to be encoded by the image encoder based on the type of the imaging scene, and A predetermined process is executed according to the type. This has the effect of reducing processing delays and circuit scale.
- the amount of data after encoding when encoded by a coding method that is specified so that the moving image signal is output at a constant frame rate during decoding Is performed on the moving image signal, the processed moving image signal is output, and the Processing information indicating the contents is output, and the processed moving image signal is encoded into data suitable for the encoding method based on the processing information.
- the decoded data is output in accordance with the encoding method, the code amount can be reduced without changing the configuration on the decoding side.
- the input image controller sets two fields of each frame to be the same at a predetermined ratio
- An encoding device that outputs a later moving image signal and an image encoder outputs the moving image signal processed by the input image controller at a constant frame rate of the moving image signal during decoding. Encoding with the method. As a result, without changing the frame rate of the video signal to be coded, the correlation between fields (particularly, the correlation in the vertical direction) can be increased to increase the coding efficiency and reduce the amount of code. The effect that it can be obtained is obtained.
- FIG. 1 is a block diagram showing a configuration of an image encoding device according to Embodiment 1 of the present invention.
- FIG. 2 is a diagram showing a configuration of a moving picture signal of an in-lace system.
- FIG. 3 is a diagram showing a configuration of a progressive video signal.
- Fig. 4 shows repeat—first— in the picture coding extension.
- FIG. 3 is a diagram illustrating an example of a signal.
- FIG. 6 is a diagram illustrating an example of a correspondence relationship between an input video signal of an in-lace system, a video signal after control, and a video signal on the decoding side according to the first embodiment.
- FIG. 7 shows that, in Embodiment 2, one of the three fields is thinned out for the input video signal of the in-line race method, and one of the two fields is reduced to two on the decoding side.
- FIG. 7 is a diagram showing an example of a moving image signal when the video signal is repeatedly output.
- FIG. 8 is a diagram showing an example of a controlled moving image signal in the image encoding device according to Embodiment 3.
- FIG. 1 is a block diagram showing a configuration of an image coding apparatus according to Embodiment 1 of the present invention.
- 1 indicates that the frame rate of the moving image signal is constant during decoding, such as the MPEG2 system (IS0 / IEC13818-2) internationally standardized by IS0.
- the MPEG2 system IS0 / IEC13818-2
- An input image controller for outputting and outputting processing information indicating the processing contents, and 2 for processing the post-control moving image signal from the input image controller 1.
- It is an image encoder that encodes data based on information into data suitable for the encoding method.
- an encoder compliant with IS0 / 1EC13818-2 is used for the image encoder 2.
- FIG. 2 is a diagram showing a configuration of a moving image signal of an in-lace system
- FIG. 3 is a diagram showing a configuration of a moving image signal of a progressive system.
- a field is composed of signals scanned every other line, and two fields constitute a moving image signal of one frame.
- one frame is composed of signals sequentially scanned line by line.
- the input image controller 1 executes predetermined processing on the input video signal to reduce the code amount when the video signal is encoded by the MPEG2 method, and processes the processed video signal and the processing content.
- the processing information shown is supplied to the image encoder 2.
- the image encoder 2 encodes the processed video signal from the input image controller 1 into a data stream conforming to the MPEG2 system based on the processing information, and decodes the decoded data stream. Output as bitstream.
- repeat-first-field and top-field-first in the picture coding extension are, for example, to encode a 24 frames / second moving image signal obtained from a movie film at 24 frames per second, and It is provided for use in decoding video signals of the 0-frame / second video signal of the in-line race system or the progressive video signals of 60 frame-seconds.
- FIG. 4 shows a case where the input side video signal of the in-lace system for 4 frames is output in 5 frames on the decoding side using repeat-first-field and top-field-first in the picture coding extension.
- FIG. 6 is a diagram showing a correspondence relationship of each field of FIG.
- the input moving image signals 101-1 to 1004-2 of the in-lace system for four frames are encoded, and at the time of decoding, the repeat-first- Based on fiela and top- ⁇ ⁇ e 1 d-first, video signals for 4 frames are decoded. For example, by repeatedly outputting fields 10 1-1 and 10 3-2, 5 frames are output. A moving image signal for one mu is output.
- FIG. 5 shows the case where the progressive input video signal for 4 frames is output in 9 frames on the decoding side using repeat-first-field and top-field-first in the picture coding extension.
- FIG. 3 is a diagram illustrating an example of a signal.
- the progressive input video signals 101 to 104 for four frames are At the time of decoding, based on the repeat-first-one field or top-field-first in the picture coding extension, a moving image signal for 4 j frames is decoded. For example, frame 101 is repeated three times. The output is returned, frame 102 is output twice, frame 103 is output three times, and frame 104 is output.
- the input video controller 1 thins out the fields of the input video signal so as to be 24 frames / sec.
- the processed moving image signal is supplied to the image encoder 2 together with processing information indicating the thinned field.
- the image encoder 2 sets the overhead information so that the decoded video signal of 24 frames / sec is decoded at 30 frames / sec on the decoding side, and is coded. And outputs the encoded data as a bitstream. That is, the input image controller 1 supplies processing information indicating that the field has been thinned out to the image encoder 2, and the image encoder 2 receives the processing information, and the field is thinned out. Is detected, the decoding side sets overhead information so that another field is output repeatedly instead of the output of the decimated field, and writes it to the picture coding extension.
- FIG. 6 is a diagram showing an example of a correspondence relationship between an input video signal of an interlace system, a video signal after control, and a video signal on the decoding side according to the first embodiment.
- the input image The field 1 102--1 and the field 104--2 are thinned out by the controller 1, the signals of the other fields are supplied to the image encoder 2, and the fields 102-1-1, 1 When 04-2 is thinned out, processing information indicating that is thinned out is supplied to the image encoder 2.
- the moving image signal is encoded by the G2 method, and the encoded data is output as a bit stream. Then, on the decoding side, field 101_1 is repeatedly output as the first field of the next frame based on the overhead information in the picture coding extension, and the field 103-3-2 Is repeatedly output as the second field of the next frame, and the same frame rate as that of the input video signal is maintained.
- the input image controller 1 When the input moving image signal is a progressive signal, the input image controller 1 thins out the frame at a predetermined ratio, and processes the thinned moving image signal together with processing information indicating the thinned frame. Supply to encoder 2. Based on the processing information, the image encoder 2 encodes the controlled moving image signal by adding overhead information so that the decoding side can decode the original moving image signal at the original frame rate. Is output as a bit stream.
- the processing delay can be reduced by thinning the preceding field or frame as much as possible.
- the frame rate of the moving image signal is reduced by the input image controller 1, the controlled moving image having the reduced frame rate is encoded by the MPEG-2 system, and the decoding side refers to the picture encoding extension. Then, the decoded moving image signal is output at the same frame rate as the input moving image signal.
- the frame rate of a moving image signal is controlled as preprocessing, and the controlled moving image signal is encoded based on the processing information in the MPEG-2 system. Outputs encoded data that conforms to the MPEG-2 format, including overhead information, so that it does not affect the frame rate output on the decoding side and suppresses image quality degradation. The effect is that the compression can be realized overnight. .
- An image coding apparatus is one in which the frame rate of the controlled moving image signal is set to another rate. Note that the configuration of the image coding apparatus according to the second embodiment is the same as that according to the first embodiment, and a description thereof will not be repeated.
- FIG. 7 shows that in Embodiment 2, one field of each of the three fields is thinned out from the input video signal of the in-line lace method, and the decoding side has two of the two fields.
- FIG. 4 is a diagram illustrating an example of a moving image signal when one field is repeatedly output twice.
- the frame rate of the input moving image signal is 30 frames / second
- the frame rate of the controlled moving image signal is 20 frames / second.
- the frame rate of the post-control moving image signal may be set to an arbitrary frame rate of 20 frames / sec to 30 frames / sec.
- the decoding side decodes the encoded data with reference to the overhead information, and outputs the decoded video signal at 30 frames Z seconds.
- the decoding side can output one frame repeatedly for three or two frame periods based on the overhead information, so the input image controller 1 determines the frame rate of the video signal after control. Is set to an arbitrary frame rate from 20 frames / second to 60 frames / second, and the image encoder 2 sets overhead information corresponding to the frame rate, and sets the video signal after control. Is encoded by the MPEG 2 system. In this case, on the decoding side, the encoded data is decoded with reference to the overhead information, and the decoded video signal is output at 60 frames Z seconds.
- An image coding apparatus generates a post-control moving image signal by setting the first field and the second field of each frame in the input moving image signal to be the same.
- the frame rate of the subsequent video signal is kept the same as the frame rate of the input video signal.
- the configuration of the image encoding device according to the third embodiment is the same as that according to the first embodiment, and thus description thereof is omitted. However, it is not necessary for the input control device 1 to supply the processing information to the image encoder 2.
- FIG. 8 is a diagram showing an example of a post-control moving image signal in the image encoding device according to the third embodiment.
- the input image controller 1 controls the first field 10 as shown in the first frame and the second frame in FIG. 1-1 and 1 0 2—1 are output as the same signal as the second field of the frame.
- the image encoder 2 encodes the post-control video signal in which the first field and the second field are the same.
- the same signal as the first field may be output as the second field as in the first and second frames in FIG. 8, or the second signal may be output as in the third frame in FIG.
- the same signal as the field may be output as the first field.
- An image coding apparatus is configured such that when a moving image signal is a signal of an infrared race system, an input image controller 1 removes one field of a frame at a predetermined rate. In addition to outputting the processed video signal, it also outputs processing information indicating the removed field, and the image encoder 2 detects the removal of the field based on the processing information and removes it. Predicted coding is performed on the field that has been removed based on the other fields to generate a coded data corresponding to the removed field.
- the configuration of the image coding apparatus according to the fourth embodiment of the present invention is the same as that according to the first embodiment, and a description thereof will be omitted.
- the input image controller 1 removes one field of the frame at a predetermined ratio and outputs the processed moving image signal when the input moving image signal is a signal of an in-line lace method. At the same time, processing information indicating the removed field is output.
- the image encoder 2 selects a field structure that encodes one frame for each field, encodes the non-decimated fields as usual, and decimates them. For the field, one-way prediction is performed from the previously coded field. At this time, the image encoder 2 sets the motion vectors (horizontal component, vertical component) for all macroblocks to (0, 0), and suppresses encoding of the difference signal. By doing so, encoding is not performed on most of the macroblocks in the decimated field, and the amount of code is almost eliminated. In this case, on the decoding side, the signal of the previous field is repeatedly output as the signal of the decimated field.
- the motion vector is set to the same value for the entire field image, or the motion vector is set to the same value in units of slices (regions composed of multiple macro blocks).
- the motion vector used for predictive encoding of the decimated field includes a motion vector between two or more fields, which is a field before and after the removed field.
- a value calculated by interpolation from the vector may be used. That is, for example, if a motion of 10 pixels is detected for the entire screen between the first field to be coded normally and the next field to be coded normally, the intermediate value of 5 pixels
- the predictive coding for the second field is performed in the motion vector.
- the magnitude of the motion can be calculated by adding the function of measuring the motion to the input image controller 1, or the motion vector detected for each macroblock by the image encoder 2 can be calculated over the entire screen or It can be calculated as an average in slice units.
- the input image controller 1 controls one of the fields in the frame at a predetermined rate. , And outputs a processed video signal and outputs processing information indicating the removed field.
- the image encoder 2 detects removal of the field based on the processing information, and removes the field. Predictive coding is performed on the fields that have been removed based on the other fields to generate coded data corresponding to the removed fields. As a result, the code amount can be reduced. Decimate one field In this case, the code amount generated for the frame can be reduced to almost half of the code amount in the case where no thinning is performed.
- An image coding apparatus is configured to determine whether or not to execute a predetermined process on an input moving image signal according to a picture type at the time of coding. Note that the configuration of the image coding apparatus according to the fifth embodiment is the same as that according to the first embodiment, and a description thereof will not be repeated.
- the input image controller 1 reads out the picture type of each frame from the image encoder 2 in advance, and does not thin out a frame that is, for example, an I-picture (intra-frame coded picture). Preferentially thinning out unused B pictures (bidirectional prediction pictures). Note that a P picture (unidirectionally predicted picture) is used for predicting a B picture, so that if the amount of generated code is small, it should not be skipped, otherwise it is preferentially skipped. So that he can be heard.
- Embodiment 6 it is determined whether or not to execute predetermined processing on an input moving image signal according to a picture type at the time of encoding.
- An I-picture which is a reference for predictive coding, is coded as it is in the input video signal, and the effect is obtained that the coding can be executed more faithfully.
- the image coding apparatus determines whether or not to execute a predetermined process on an input moving image signal according to a picture type at the time of coding. Is determined. Note that the configuration of the image coding apparatus according to the sixth embodiment is the same as that according to the first embodiment, and a description thereof will not be repeated.
- the input image controller 1 reads out the picture type of each frame from the image encoder 2 in advance, outputs only one field as a control image signal for the B picture, thins out the other field, and outputs the image code.
- the encoder 2 performs predictive coding on the decimated fields. Since the P picture is used for the prediction of the B picture, if the generated code amount is small, make sure that none of the fields are thinned out, and if not, give priority to one of the fields. To be thinned out. Note that the other operations are the same as those in the first embodiment, and a description thereof will not be repeated.
- An image coding apparatus provides an input image controller 1 in which the variance of pixel values in each frame, the difference in pixel values between frames, and
- the code amount in the image encoder 2 is determined based on at least one of the motion vector and the motion vector, and a predetermined process is executed according to the data amount.
- the configuration of the image coding apparatus according to the seventh embodiment is the same as that according to the first embodiment, and a description thereof will be omitted. Next, an operation will be described.
- the input image controller 1 or the image encoder 2 calculates the variance of the pixel values in each frame, the difference between the pixel values between the frames, and the amount of change in the image contents such as the motion vector, and the input image controller 1 To determine the data amount of the data encoded by the image encoder, and execute a predetermined process according to the data amount.
- the input image controller 1 outputs the input moving image signal as it is as a controlled moving image signal when the amount of fluctuation is small, and performs a predetermined process as described in other embodiments when the amount of fluctuation is large. Execute.
- the input image controller 1 determines at least one of the variance of pixel values in each frame, the difference of pixel values between frames, and the motion vector.
- the code amount in the image encoder 2 is determined based on the code amount, and a predetermined process is executed according to the code amount.Therefore, when the code amount increases, the predetermined process is executed so as to reduce the code amount. As a result, the effect that the code amount can be made constant can be obtained.
- An image coding apparatus includes an input image controller 1 that changes the image size of a moving image signal at predetermined intervals, and an image encoder 2 that changes the image size at predetermined intervals.
- the encoded frame is encoded within the frame. Note that the configuration of the image coding apparatus according to the eighth embodiment is the same as that according to the first embodiment, and thus description thereof will be omitted.
- the input image controller 1 reduces the image size of the frame / field of the input moving image signal.
- the image encoder 2 encodes the processed moving image signal. At this time, since it is difficult to perform a prediction process between images having different image sizes, the image encoder 2 performs intra-frame encoding on the first encoded frame whose image size has been changed.
- the change of the image size in the eighth embodiment may be executed in combination with the predetermined process in another embodiment.
- the eighth embodiment Since the image size of the moving image signal is controlled, the moving image signal after the control is encoded in the MPEG-2 system, and the encoded data conforming to the MPEG-2 system is output, the decoding side is used. The effect is obtained that the data compression can be realized while suppressing the deterioration of the image quality without affecting the output frame rate.
- the image coding apparatus when changing the image size in the image coding apparatus according to the eighth embodiment, changes the image size immediately after a GOP (Group of Picture) header. It is intended to be changed.
- GOP is an image unit used in the MPEG system. Note that the configuration of the image coding apparatus according to the ninth embodiment is the same as that according to the first embodiment, and a description thereof will be omitted.
- a GOP is composed of a GOP header and a plurality of pictures, and the frame immediately after the G0P header is encoded in the intra-frame encoding mode. GOP headers are inserted at appropriate intervals in bit streams from recording media such as digital broadcasts and DVDs (Digital Versatile Discs).
- the input image controller 1 waits until the next G0P header is detected, and when the G0P header is detected from the input video signal, the frame immediately after the G0P header is detected. Change the image size of.
- Embodiment 10 when the image size is changed, the image size of the frame immediately after the G0P header is changed. This has the effect of reducing the frequency of conversion.
- An image coding apparatus according to Embodiment 10 of the present invention provides an input video signal Is suppressed. Note that this embodiment
- the configuration of the image encoding device according to 10 is the same as that according to the first embodiment, and a description thereof will be omitted.
- the input image controller 1 When the code amount generated by the image encoder 2 increases, the input image controller 1 performs low-pass filtering on the input moving image signal to remove high-frequency components. In this case, since the inter-frame predictive coding can be performed on the processed frame, it is not necessary to perform the intra-frame coding as in the case of changing the image size.
- An image encoding device is configured to execute a predetermined process according to a change in a program change sequence. Note that the configuration of the image encoding device according to the eleventh embodiment is the same as that according to the first embodiment, and a description thereof will not be repeated.
- the amount of change in the image content may change in advance, such as when switching to a sports program shot outdoors or when a news program switches from a scene with an announcer in the studio to a busy street scene. You may be aware.
- a control signal indicating the change is supplied to the input image controller 1, and the input image controller 1 responds to the control signal as in the above-described embodiment. Execute a predetermined process.
- the input image controller 1 generates a post-control moving image signal from the input moving image signal without changing the frame rate or the image size in a scene with little motion, and converts the field ⁇ frame in a scene with a large motion. Decimate or reduce image size.
- a predetermined process is executed in response to a change in a program or a change in a scene.
- a control signal indicating the change without measuring the delay time, and to obtain an effect that a processing delay and a circuit size can be reduced.
- the present invention is suitable for encoding a moving image signal at the time of digital broadcasting and encoding a moving image signal at the time of recording moving image data on a recording medium.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Discrete Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2002-7002576A KR100504641B1 (ko) | 2000-06-28 | 2000-06-28 | 화상 부호화 장치 및 화상 부호화 방법 |
AU2000257047A AU2000257047A1 (en) | 2000-06-28 | 2000-06-28 | Image encoder and image encoding method |
EP00942373A EP1296525A4 (en) | 2000-06-28 | 2000-06-28 | IMAGE ENCODER AND IMAGE ENCODING METHOD |
PCT/JP2000/004263 WO2002001883A1 (en) | 2000-06-28 | 2000-06-28 | Image encoder and image encoding method |
US09/764,312 US7215710B2 (en) | 2000-06-28 | 2001-01-19 | Image coding device and method of image coding |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2000/004263 WO2002001883A1 (en) | 2000-06-28 | 2000-06-28 | Image encoder and image encoding method |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/764,312 Continuation US7215710B2 (en) | 2000-06-28 | 2001-01-19 | Image coding device and method of image coding |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2002001883A1 true WO2002001883A1 (en) | 2002-01-03 |
Family
ID=11736198
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2000/004263 WO2002001883A1 (en) | 2000-06-28 | 2000-06-28 | Image encoder and image encoding method |
Country Status (5)
Country | Link |
---|---|
US (1) | US7215710B2 (ja) |
EP (1) | EP1296525A4 (ja) |
KR (1) | KR100504641B1 (ja) |
AU (1) | AU2000257047A1 (ja) |
WO (1) | WO2002001883A1 (ja) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7280708B2 (en) | 2002-03-09 | 2007-10-09 | Samsung Electronics Co., Ltd. | Method for adaptively encoding motion image based on temporal and spatial complexity and apparatus therefor |
JP2009530946A (ja) * | 2006-03-23 | 2009-08-27 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 映画データを符号化する符号化装置及び方法 |
JP2012176115A (ja) * | 2011-02-25 | 2012-09-13 | Aq Interactive Inc | 2次元コードエンコードプログラム、ゲーム装置およびゲームシステム |
US8571388B2 (en) | 2007-02-19 | 2013-10-29 | Canon Kabushiki Kaisha | Apparatuses and methods for processing video signals |
US9518939B2 (en) | 2013-12-10 | 2016-12-13 | Vega Grieshaber Kg | Radiometric density profile measuring arrangement |
Families Citing this family (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030048846A1 (en) * | 2001-07-31 | 2003-03-13 | Myeong-Hwan Lee | Motion image compression apparatus capable of varying frame rate and method of compressing motion image using the same |
KR100485946B1 (ko) * | 2001-07-31 | 2005-04-28 | (주)아이디스 | 프레임 레이트 변환을 이용한 동영상 정보 압축 처리 장치및 그 방법 |
US8582031B2 (en) * | 2002-01-22 | 2013-11-12 | Broadcom Corporation | System and method of transmission and display of progressive video with hints for interlaced display |
US9497452B2 (en) * | 2002-01-22 | 2016-11-15 | Broadcom Corporation | System and method of transmission and reception of video using compressed differential time stamps |
WO2003063464A2 (en) * | 2002-01-22 | 2003-07-31 | Broadcom Corporation | System and method of transmission and reception of video using compressed differential time stamps |
KR100955161B1 (ko) * | 2004-05-04 | 2010-04-28 | 콸콤 인코포레이티드 | 모션 보상된 프레임 레이트 상향 변환을 위한 방법 및 장치 |
KR100913260B1 (ko) | 2004-07-01 | 2009-08-21 | 콸콤 인코포레이티드 | 규모 가변적 비디오 코딩에서 프레임 레이트 업 변환을 이용하는 방법 및 장치 |
JP2008507915A (ja) * | 2004-07-20 | 2008-03-13 | クゥアルコム・インコーポレイテッド | 映像圧縮のための符号器補助式フレーム速度アップコンバージョンのための方法及び装置 |
US8553776B2 (en) * | 2004-07-21 | 2013-10-08 | QUALCOMM Inorporated | Method and apparatus for motion vector assignment |
US8184660B2 (en) * | 2005-09-15 | 2012-05-22 | Lsi Corporation | Transparent methods for altering the video decoder frame-rate in a fixed-frame-rate audio-video multiplex structure |
SG130962A1 (en) * | 2005-09-16 | 2007-04-26 | St Microelectronics Asia | A method and system for adaptive pre-filtering for digital video signals |
US20070230564A1 (en) * | 2006-03-29 | 2007-10-04 | Qualcomm Incorporated | Video processing with scalability |
US8634463B2 (en) * | 2006-04-04 | 2014-01-21 | Qualcomm Incorporated | Apparatus and method of enhanced frame interpolation in video compression |
US8750387B2 (en) * | 2006-04-04 | 2014-06-10 | Qualcomm Incorporated | Adaptive encoder-assisted frame rate up conversion |
US20090052551A1 (en) * | 2007-08-23 | 2009-02-26 | Shinji Kitamura | Method and apparatus for coding moving image and imaging system |
KR101455579B1 (ko) * | 2009-05-29 | 2014-10-29 | 미쓰비시덴키 가부시키가이샤 | 화상 부호화 장치, 화상 복호 장치, 화상 부호화 방법, 및 화상 복호 방법 |
JP5333593B2 (ja) * | 2009-09-16 | 2013-11-06 | 富士通株式会社 | 動画再生装置、動画再生プログラム、および動画再生方法 |
JP5583992B2 (ja) * | 2010-03-09 | 2014-09-03 | パナソニック株式会社 | 信号処理装置 |
WO2012124121A1 (ja) * | 2011-03-17 | 2012-09-20 | 富士通株式会社 | 動画像復号方法、動画像符号化方法、動画像復号装置及び動画像復号プログラム |
KR102430216B1 (ko) * | 2020-07-07 | 2022-08-08 | 주식회사 엘지유플러스 | 영상 처리 장치 및 영상 수신 단말의 동작 방법 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH02298184A (ja) * | 1989-05-12 | 1990-12-10 | Nec Corp | 動き補償付フレーム間予測復号化装置の適応フレーム内挿方式 |
JPH04248787A (ja) * | 1991-02-04 | 1992-09-04 | Fujitsu Ltd | 画像符号化装置 |
JPH0522710A (ja) * | 1991-01-31 | 1993-01-29 | Graphics Commun Technol:Kk | 動画像符号化装置 |
JPH05336511A (ja) * | 1992-06-03 | 1993-12-17 | Toshiba Corp | 動画像符号化装置 |
JPH0723393A (ja) * | 1993-06-18 | 1995-01-24 | Sharp Corp | 画像符号化装置 |
JPH07177511A (ja) * | 1993-12-17 | 1995-07-14 | Nec Corp | 画像符号化装置 |
JPH08163555A (ja) * | 1994-11-30 | 1996-06-21 | Matsushita Electric Ind Co Ltd | テレビジョン信号変換装置 |
JPH0937243A (ja) * | 1995-07-20 | 1997-02-07 | Sanyo Electric Co Ltd | 動画像符号化装置及び復号装置 |
JPH10276430A (ja) * | 1997-03-31 | 1998-10-13 | Nec Corp | 適応型簡易モーションjpeg圧縮装置および適応型簡易モーションjpeg圧縮方法 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH06178274A (ja) * | 1992-11-30 | 1994-06-24 | Sony Corp | 動画像復号化装置 |
JP3206413B2 (ja) | 1995-12-15 | 2001-09-10 | ケイディーディーアイ株式会社 | 可変フレームレート動画像符号化方法 |
US6535558B1 (en) * | 1997-01-24 | 2003-03-18 | Sony Corporation | Picture signal encoding method and apparatus, picture signal decoding method and apparatus and recording medium |
EP0925688B1 (en) * | 1997-07-16 | 2004-12-15 | Koninklijke Philips Electronics N.V. | Video coding method and device, and corresponding decoding device |
WO1999052282A1 (en) * | 1998-04-02 | 1999-10-14 | Sarnoff Corporation | Bursty data transmission of compressed video data |
US6192079B1 (en) * | 1998-05-07 | 2001-02-20 | Intel Corporation | Method and apparatus for increasing video frame rate |
KR100533437B1 (ko) | 1998-08-26 | 2005-12-06 | 소니 가부시끼 가이샤 | 비디오 데이터 처리 장치, 비디오 데이터 부호화 장치 및 그 방법 |
US6831948B1 (en) * | 1999-07-30 | 2004-12-14 | Koninklijke Philips Electronics N.V. | System and method for motion compensation of image planes in color sequential displays |
-
2000
- 2000-06-28 AU AU2000257047A patent/AU2000257047A1/en not_active Abandoned
- 2000-06-28 EP EP00942373A patent/EP1296525A4/en not_active Withdrawn
- 2000-06-28 KR KR10-2002-7002576A patent/KR100504641B1/ko not_active IP Right Cessation
- 2000-06-28 WO PCT/JP2000/004263 patent/WO2002001883A1/ja not_active Application Discontinuation
-
2001
- 2001-01-19 US US09/764,312 patent/US7215710B2/en not_active Expired - Fee Related
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH02298184A (ja) * | 1989-05-12 | 1990-12-10 | Nec Corp | 動き補償付フレーム間予測復号化装置の適応フレーム内挿方式 |
JPH0522710A (ja) * | 1991-01-31 | 1993-01-29 | Graphics Commun Technol:Kk | 動画像符号化装置 |
JPH04248787A (ja) * | 1991-02-04 | 1992-09-04 | Fujitsu Ltd | 画像符号化装置 |
JPH05336511A (ja) * | 1992-06-03 | 1993-12-17 | Toshiba Corp | 動画像符号化装置 |
JPH0723393A (ja) * | 1993-06-18 | 1995-01-24 | Sharp Corp | 画像符号化装置 |
JPH07177511A (ja) * | 1993-12-17 | 1995-07-14 | Nec Corp | 画像符号化装置 |
JPH08163555A (ja) * | 1994-11-30 | 1996-06-21 | Matsushita Electric Ind Co Ltd | テレビジョン信号変換装置 |
JPH0937243A (ja) * | 1995-07-20 | 1997-02-07 | Sanyo Electric Co Ltd | 動画像符号化装置及び復号装置 |
JPH10276430A (ja) * | 1997-03-31 | 1998-10-13 | Nec Corp | 適応型簡易モーションjpeg圧縮装置および適応型簡易モーションjpeg圧縮方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP1296525A4 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7280708B2 (en) | 2002-03-09 | 2007-10-09 | Samsung Electronics Co., Ltd. | Method for adaptively encoding motion image based on temporal and spatial complexity and apparatus therefor |
JP2009530946A (ja) * | 2006-03-23 | 2009-08-27 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 映画データを符号化する符号化装置及び方法 |
US8571388B2 (en) | 2007-02-19 | 2013-10-29 | Canon Kabushiki Kaisha | Apparatuses and methods for processing video signals |
JP2012176115A (ja) * | 2011-02-25 | 2012-09-13 | Aq Interactive Inc | 2次元コードエンコードプログラム、ゲーム装置およびゲームシステム |
US9518939B2 (en) | 2013-12-10 | 2016-12-13 | Vega Grieshaber Kg | Radiometric density profile measuring arrangement |
Also Published As
Publication number | Publication date |
---|---|
US20020001345A1 (en) | 2002-01-03 |
KR20020030100A (ko) | 2002-04-22 |
AU2000257047A1 (en) | 2002-01-08 |
EP1296525A1 (en) | 2003-03-26 |
KR100504641B1 (ko) | 2005-08-01 |
EP1296525A4 (en) | 2006-07-26 |
US7215710B2 (en) | 2007-05-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2002001883A1 (en) | Image encoder and image encoding method | |
JP4014263B2 (ja) | 映像信号変換装置及び映像信号変換方法 | |
US7146056B2 (en) | Efficient spatial scalable compression schemes | |
US7787541B2 (en) | Dynamic pre-filter control with subjective noise detector for video compression | |
US9071844B2 (en) | Motion estimation with motion vector penalty | |
US20030095603A1 (en) | Reduced-complexity video decoding using larger pixel-grid motion compensation | |
JP2001145113A (ja) | 画像情報変換装置及び方法 | |
JP2000059790A (ja) | 動画像符号列変換装置及びその方法 | |
JP3911035B2 (ja) | 動画像符号化方法及び動画像符号化装置 | |
US8903196B2 (en) | Video presentation at fractional speed factor using time domain interpolation | |
JP2002515705A (ja) | ビデオデコーダのコストを低減させる方法および装置 | |
JP3980659B2 (ja) | 動画像符号化方法及び装置、動画像復号化方法及び装置。 | |
JP2933561B2 (ja) | 動画符号変換装置 | |
JP3599942B2 (ja) | 動画像符号化方法、及び動画像符号化装置 | |
JPH07231449A (ja) | 画像信号符号化装置及び画像信号復号化装置 | |
JP4765961B2 (ja) | デジタル動画像記録装置 | |
JP2006054760A (ja) | 画像処理装置及び画像処理方法 | |
JP3416505B2 (ja) | 動画像復号化方法 | |
JP3862479B2 (ja) | ビデオダウンコンバージョンにおけるドリフトエラーを防ぐ方法 | |
JP4596277B2 (ja) | 符号化装置、符号化方法、復号装置及び復号方法 | |
JPH05344491A (ja) | フレーム間予測符号化方式 | |
JP3307379B2 (ja) | 復号化装置及び方法 | |
JPH11252561A (ja) | 動画像復号化方法 | |
JPH08340540A (ja) | 画像フレームの符号化又は復号化の方法及びその装置 | |
JP2005012372A (ja) | 映像符号化装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 09764312 Country of ref document: US |
|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2000942373 Country of ref document: EP |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 1020027002576 Country of ref document: KR |
|
WWP | Wipo information: published in national office |
Ref document number: 1020027002576 Country of ref document: KR |
|
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
WWP | Wipo information: published in national office |
Ref document number: 2000942373 Country of ref document: EP |
|
WWR | Wipo information: refused in national office |
Ref document number: 1020027002576 Country of ref document: KR |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 2000942373 Country of ref document: EP |