WO2003056838A1 - Moving picture compression/coding apparatus and motion vector detection method - Google Patents
Moving picture compression/coding apparatus and motion vector detection method Download PDFInfo
- Publication number
- WO2003056838A1 WO2003056838A1 PCT/JP2002/013413 JP0213413W WO03056838A1 WO 2003056838 A1 WO2003056838 A1 WO 2003056838A1 JP 0213413 W JP0213413 W JP 0213413W WO 03056838 A1 WO03056838 A1 WO 03056838A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- motion vector
- detection range
- vector detection
- motion
- frame
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/223—Analysis of motion using block-matching
- G06T7/238—Analysis of motion using block-matching using non-full search, e.g. three-step search
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/56—Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/57—Motion estimation characterised by a search window with variable size or shape
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Definitions
- the present invention relates to a moving image compression encoding device for compressing and encoding a moving image, a motion vector detection method thereof, a recording medium, and a program.
- the motion vector detection device In a moving image compression encoding device, the motion vector detection device has to increase the hardware scale in order to increase the detection accuracy of the motion vector. For this reason, motion vector detection is performed in a mode in which the detection range is narrow but detection accuracy is high, or in a mode in which the detection range is wide but detection accuracy is low.
- FIG. 10 shows the motion vector detection device.
- Reference numeral 101 denotes a reference frame signal input terminal for inputting a reference frame signal, which is a current frame signal, to the video compression encoder
- reference numeral 102 denotes a previous frame signal to the video compression encoder. This is a predicted frame signal input terminal for inputting a certain predicted frame signal.
- 104 is a wide-area motion vector detector that performs motion vector detection in a mode with a wide detection range but low detection accuracy, and 104 is a motion vector detection mode with a small detection range but high detection accuracy.
- a narrow-range motion vector detector that performs A comparator that compares and evaluates the motion vector detection results obtained with 103 and the narrow-range motion vector detector 104, and 106 is based on the comparison result of the comparator 105
- a switch that outputs either the motion vector detector 103 or the result of motion vector detection from the narrow area motion vector detector 104, and 107 is a wide area motion vector detector.
- Output terminal that outputs the motion vector detected by the detector.
- a reference frame signal input from a reference frame signal input terminal 101 is input to a wide area motion vector detector 103 via a low-pass filter 108 and a downsampling circuit 109.
- the reference frame signal input from the reference frame signal input terminal 101 is also input to the narrow-range motion vector detector 104.
- the predicted frame signal input from the predicted frame signal input terminal 102 is input to the wide area motion vector detector 103 via the low-pass filter 110 and the downsampling circuit 111.
- the predicted frame signal input from the predicted frame signal input terminal 102 is also input to the narrow area motion vector detector 104.
- the motion vectors detected by the motion vector detectors 103 and 104 are compared and evaluated by the comparator 105, and the motion vector with the higher evaluation is switched by the switcher 106. Is output to the output terminal 107.
- the number of motion vector detection ranges (hereinafter referred to as the number of modes) is set to, for example, two in order to detect a more appropriate motion vector, the number of modes is reduced.
- the hardware scale increases compared to one case.
- Detection range is narrow, but detection accuracy Requires two types of hardware, a high-range motion vector detector 104 and a wide-area motion vector detector 103 with a wide detection range but low detection accuracy.
- two motion vector detectors 103 and 104 must have independent motion vector detection circuits. Therefore, there was a problem that the hardware scale of the motion detection circuit and the like became large.
- FIG. 11 shows the video compression encoding apparatus.
- FIG. 11 is a block diagram of a conventional moving picture compression encoding apparatus.
- reference numeral 310 denotes a DCT circuit
- reference numeral 302 denotes a quantizer
- reference numeral 303 denotes an inverse quantizer
- reference numeral 304 denotes an inverse DCT circuit
- reference numeral 304 denotes a frame.
- Reference numeral 306 denotes a motion compensation inter-frame prediction circuit
- 307 A denotes a motion detection device
- 308 denotes an intra-frame / inter-frame switching signal.
- the motion detection device 307A includes a buffer memory 201, an error calculation circuit 202, an error comparison circuit 203, and an address generation circuit 204.
- the operation of the conventional image encoding device configured as described above will be described below.
- the first frame of the encoding that is, the first frame, is switched to the intra-frame encoding by the intra-frame switching signal 308, and is encoded intra-frame by frame without any difference.
- image data is converted into transform coefficients by the DCT circuit 301 in two-dimensional block units, and the transform coefficients are quantized by the quantizer 302. After that, it is sent to the transmission line.
- images have high correlation, when DCT is performed, energy is concentrated on transform coefficients corresponding to low frequency components.
- the quantized transform coefficients transmitted to the transmission path are simultaneously returned to real-time data via an inverse quantizer 303 and an inverse DCT transform circuit 304, and stored in a frame memory 305.
- the images after the second frame are switched to inter-frame coding by the intra-frame inter-frame switching signal 308, and after motion compensation, a difference from the image of the previous frame is obtained.
- the difference between the image signals between the frames is encoded. That is, based on the image data of the previous frame stored in the frame memory 305 and the motion vector of the two-dimensional block unit detected by the motion detection device 307A, the predicted value of the image of the second and subsequent frames moves.
- the prediction error which is the difference between the image after the second frame generated by the inter-compensation inter-frame prediction circuit 306 and the predicted value after the second frame generated by the motion-compensation inter-frame prediction circuit 306, is
- the data is converted into a transform coefficient by the DCT circuit 301 in the unit of a two-dimensional block, and the transform coefficient is quantized by the quantizer 302 before being transmitted to the transmission line.
- the quantized conversion coefficients transmitted to the transmission path are simultaneously returned to real-time data via the inverse quantizer 303 and the inverse DCT conversion circuit 304, and stored in the frame memory 305.
- the motion detection device 307A has a configuration in which a motion vector between frames is obtained for each two-dimensional block using, for example, a well-known full search method.
- FIG. 12 is an explanatory diagram showing the operation of the motion detection device 307A.
- 3 1 1 is the second One 2D block with a frame consists of a rectangular block of m pixels (horizontal direction) X n pixels (vertical direction).
- 312A and 312B are two-dimensional blocks of the first frame for performing error calculation, and have the same size as the two-dimensional block 311.
- Reference numeral 313 denotes a motion vector obtained by the motion detection, which connects the center coordinates of the two-dimensional block 311 and the center coordinates of the two-dimensional block 312B.
- the two-dimensional block 3 1 1 in FIG. 12 is a two-dimensional block having the center coordinates (x, y, 2) in the second frame, and the symbol S (x, y, Represented by 2).
- the two-dimensional blocks 312A and 312B are two-dimensional blocks having the center coordinates (x, y, 1) and (x + mx, y + my, 1) in the first frame, respectively.
- the two-dimensional block is represented by the symbols S (x, y, 2) and S (x + mx, y + my, 1) corresponding to the center coordinates.
- x indicates the pixel coordinates in the horizontal direction starting from the center of the frame
- y indicates the pixel coordinates in the vertical direction starting from the center of the frame
- the numbers 1 and 2 after x and y indicate the frame. Indicates a number.
- 314 is a rectangular (2 h in the horizontal direction, 2 V in the vertical direction) motion vector detection range indicating a two-dimensional block for calculating the motion vector
- X h is the center of the motion vector detection range
- y'v is the center of the motion vector detection range (the coordinates (x, y, l) in the figure).
- the vertical local pixel coordinates as the origin are shown.
- the image data of the second frame is input to the buffer memory 201 at the same time as the inter-frame encoding.
- the image data of the first frame is already stored in the buffer memory 201.
- the reference is a two-dimensional block 311 of the second frame (current frame), and a two-dimensional block 312B of the first frame (previous frame) and a two-dimensional block of the second frame (current frame).
- the motion vector 3 3 between 3 1 1 is detected.
- the images of the first and second frames input to the memory 201 are read out in units of two-dimensional blocks of m ⁇ n pixels, and a motion vector is detected in units of two-dimensional blocks.
- the address generating circuit 204 reads out the image data of the two-dimensional block S (x, y, 2) having the center coordinates (x, y, 2) in the second frame, and reads the two-dimensional block S (x, y). , 2) is used as the reference block, and the motion between this reference block and the first frame is detected by the following procedure.
- the buffer memory 201 also stores the image data of the first frame as described above, and the two-dimensional block S (x, y, l) having the center coordinates (x, y, l) in the first frame is also stored. Read each image data of l).
- the error calculation circuit 202 the sum of the square errors of the amplitudes of the image data in the two two-dimensional blocks S (x, y, 2) and S (x, y, l) (hereinafter simply referred to as error) ) ⁇ ( ⁇ , ⁇ ) (0,0) is calculated by [Equation 1] and sent to the error comparison circuit 203.
- the address generation circuit 204 selects the mXn block next to one pixel in the horizontal direction in the first frame, that is, the two-dimensional block of the center coordinates (x + 1, y, 1). Generates the address S (x + 1, y, 1).
- the error calculation circuit 202 also calculates (x, y) (+ l, 0) and sends it to the error comparison circuit 203.
- the error comparison circuit 2 0 3, ⁇ (x, y) (0, 0) and ⁇ (x, y) (+1 , 0) are compared, and who choose c and so on to be a small one h ⁇ xh ⁇ li, 1 V ⁇ y V ⁇
- the error comparison circuit 203 selects the error ⁇ (x, y) (mx, my) that takes the minimum value from the errors ⁇ (x, y) (xh, yv) calculated above, and at the same time, the address mx , My are output.
- the motion vector 2 13 in the two-dimensional block S (x, y, 2 ) is mv (mx, my).
- the motion vector of all the two-dimensional blocks in the second frame is obtained by repeating the above operation for all of the two-dimensional blocks divided into a plurality.
- the motion-compensated inter-frame prediction circuit 306 generates a motion-compensated predicted value of the second frame in units of two-dimensional blocks using the motion vector detected for each 2D block of the second frame.
- the prediction error is calculated for the image of the second frame.
- the above-described prediction error is encoded for each frame in the same manner as in the first frame.
- the same size as the two-dimensional block that divides the current frame within the predetermined motion vector detection range of the previous frame centered on the position of the two-dimensional block that divides the current frame The image data of the two-dimensional block of the previous frame is extracted while changing the position sequentially, and the image data of each two-dimensional block within the predetermined motion vector detection range of the previous frame and the divided two-dimensional block of the current frame are extracted.
- the image data for the two-dimensional block obtained by dividing the current frame is obtained.
- the prediction error is coded, so that the energy and the energy are reduced as compared with the case where the image data is directly coded, as in the case of intra-frame coding.
- the encoding becomes possible.
- FIG. 13 is a flowchart showing the processing operation of the CPU 5. Referring to Fig. 13, step 21 reads the motion vectors of all two-dimensional blocks of the previous frame (for example, the second frame) in step 21 and step 22 shows the maximum horizontal motion vector detection range for normal motion.
- step 23 it is determined whether the number is 50 or more of all blocks. If the number is 50% or more of all blocks, the motion of the image is assumed to be large and the horizontal motion vector detection range is determined as follows. Expand to 2 h. In order to double the motion vector detection range, as shown in step 24, the input to the error calculation circuit 2 is thinned out for each sample, that is, subsampled to 12 and input. The address generator 4 is controlled. By doing so, the computational complexity per each two-dimensional block becomes 12, so even if the motion vector ⁇ output range is doubled, the total computational complexity does not increase the motion vector detection range It is equal to the case.
- step 25 the number of motion vectors exceeding h / 2 is counted at the same time, and in step 26, the number of motion vectors exceeding hZ2 is counted. Is determined to be 10% or less, and if it is 10% or less, it is assumed that there is little movement and the motion vector detection range is set to! ⁇ / 2. In this case, the data is input to the error calculation circuit 2 without thinning out (step 27). If the motion vector exceeding h is less than 0% and the number of motion vectors exceeding hZ2 exceeds 10%, the detection range of the motion vector is not changed. No sub-sampling is performed.
- the motion vector detection range can be expanded without increasing the calculation amount.
- the accuracy of motion detection decreases, leading to image quality deterioration.
- the image quality degradation due to the motion not following has a greater effect. Therefore, even if the image is a subsampled image, the image quality will be improved by expanding the motion vector detection range.
- motion detection is performed on an image without sub-sampling, so that image quality is not degraded, and the motion vector detection range is narrowed, so that the processing time required for search can be shortened.
- the motion vector detection range can be changed according to the motion of the image, so that a large motion can be handled, the difference between frames can be reduced, and the image quality does not deteriorate. Moreover, the amount of computation for calculating the motion vector does not increase, so that the amount of hardware for calculating the motion vector does not increase.
- the conventional moving image compression encoding apparatus described with reference to FIG. 11 cannot detect an appropriate motion vector for a large moving image, and furthermore, has an appropriate motion vector detection range. Is difficult to set. That is, in the conventional moving picture compression encoding apparatus described with reference to FIG. 11, the motion vector detection range 320 as shown in FIG. The number of motion vectors P on the outer circumference is all blocks The motion vector detection range 320 was expanded when the value exceeded 50% of the number. That is, only the motion vector P on the outermost periphery of the motion vector detection range 320 is detected. However, there is a possibility that a motion vector that is more appropriate than the motion vector P on the outermost periphery of the motion vector detection range 320 may exist outside the motion vector detection range 320. Even in such a case, the conventional video compression encoding apparatus described with reference to FIG. 11 detects and uses the motion vector P instead of detecting the appropriate motion vector.
- the conventional video compression encoding apparatus cannot detect an appropriate motion vector for an image having a large motion, and it is difficult to set an appropriate motion vector detection range. There is a problem that there is. Disclosure of the invention
- a first aspect of the present invention is to generate a macroblock video signal in which an input video image is subdivided into N (where N is a natural number of 2 or more) per frame.
- a motion vector detecting means for detecting a motion vector within a first motion vector detection range from the decoded video signal and the macroblock video signal. Steps (1 2) and
- a first outermost line that is an outermost line of the first motion vector detection range, and a second outermost line that is inside the first motion vector detection range.
- Motion vector counting means (14, 15) for counting the number of motion vectors between the second outermost line, which is the outermost line of the motion vector detection range, as the number of first motion vectors. , 16) and
- the motion vector counting means (14, 15 and 16) is located within a third motion vector detection range inside the second motion vector detection range. Count the number of motion vectors as the number of second motion vectors,
- the motion vector detection range determination means (13) is a moving image according to the first aspect of the present invention, wherein the first motion vector detection range is reduced based on the number of the counted second motion vectors. It is a compression encoding device.
- the motion vector detection range determining means (13) is configured such that, when the number of counted first motion vectors is larger than a predetermined threshold, the first motion vector is determined. If the vector detection range is expanded and smaller than the predetermined threshold value, the first motion vector detection range is not expanded or the first motion vector detection range is not changed. It is a compression encoding device.
- the motion vector detection range determining means (13) expands the first motion vector detection range as the number of counted first motion vectors increases.
- 1 is a moving image compression encoding apparatus according to a first aspect of the present invention for increasing a rate.
- the motion vector detection range determination means (13) includes a reduction ratio of the first motion vector detection range as the number of the counted second motion vectors increases.
- 2 is a moving picture compression encoding apparatus according to a second aspect of the present invention, which increases the size of the video.
- the motion vector detection range determination means (13) has a plurality of types of motion vector detection ranges in advance,
- a motion vector detection range that is larger as the number of the counted first motion vectors is larger is selected, and the second motion vector detection range is set as the first motion vector detection range.
- 1 is a moving image compression encoding apparatus of the present invention.
- the motion vector detection range determining means (13) has a plurality of types of motion vector detection ranges in advance,
- a smaller motion vector detection range is selected as the number of the counted second motion vectors is larger, and is set as the first motion vector detection range.
- 2 is a moving picture compression encoding apparatus according to a second invention.
- the motion vector detection range determining means (13) updates the first motion vector detection range for each P frame, or n P frames ( Where n is a natural number of N)
- the motion vector detection range determination means calculates the number of the first motion vectors that are focused on the P frame or the division unit. When the number divided by the number of macroblock video signals existing in the P frame or in the division unit is equal to or greater than a predetermined threshold, the first motion vector detection range is expanded.
- 1 is a moving image compression encoding apparatus according to the present invention.
- the motion vector detection range determination means (13) updates the first motion vector detection range for each P frame, or n (n) , N ⁇ N).
- the motion vector detection range determination means calculates the number of the second motion vectors counted in the P frame or in the division unit. Reducing the first motion vector detection range when the number divided by the number of macroblock video signals present in the P frame or in the division unit is equal to or greater than a predetermined threshold. Of the present invention.
- the motion vector detecting means may include a first and a second motion vector detection range that expands the second motion vector detection range when expanding the first motion vector detection range. 3, 4, 6, and 8, which are any of the moving picture compression encoding apparatuses according to the present invention.
- the motion vector detecting means may reduce the third motion vector detection range when reducing the first motion vector detection range. , 7, and 9.
- the first and second inventions provide a method for compressing and encoding a macroblock video signal generated by subdividing an input video image into N (where N is a natural number of 2 or more) per frame.
- a first outermost line which is an outermost line of the first motion vector detection range
- a second outermost line which is inside the first motion vector detection range.
- the second outermost line which is the outermost line of the motion vector detection range
- a first outermost line which is the outermost line of the first motion vector detection range, and an outermost line of the second motion vector detection range, which is inside the first motion vector detection range.
- a first outermost line that is the number of motion vectors above one or more second outermost lines adjacent to the first outermost line.
- a motion vector counting step that counts the number of vectors,
- an input video image is generated by subdividing an input video image into N (where N is a natural number of 2 or more) per frame.
- a motion vector within a first motion vector detection range is obtained from a decoded video signal generated by decoding the compressed macroblock video signal after compression encoding the macroblock video signal and the macroblock video signal.
- a first outermost line that is the outermost line of the first motion vector detection range and a second outermost line that is inside the first motion vector detection range a first outermost line that is the outermost line of the first motion vector detection range and a second outermost line that is inside the first motion vector detection range.
- a fourteenth aspect of the present invention is a storage medium storing the program of the thirteenth aspect of the present invention.
- a recording medium that can be processed by a computer.
- FIG. 1 is a block diagram of a moving image compression encoding apparatus according to the first embodiment of the present invention.
- FIG. 2 is a diagram illustrating an example of a motion vector of a macroblock according to the first embodiment of the present invention.
- FIG. 3 is a diagram illustrating an example of a motion vector and a motion vector switching area according to the first embodiment of the present invention.
- FIG. 4A is a diagram showing motion vector detection range candidates according to the first embodiment of the present invention.
- FIG. 4B is a diagram illustrating a motion vector detection range according to the first embodiment of the present invention.
- FIG. 5 (a) is a diagram showing an example of the current motion vector detection range in the first embodiment of the present invention.
- FIG. 5 (b) is a diagram illustrating an example of the motion vector detection range after update according to the first embodiment of the present invention.
- FIG. 6A is a diagram showing an example of the current motion vector detection range in the first embodiment of the present invention.
- FIG. 6B is a diagram illustrating an example of the motion vector detection range after update according to the first embodiment of the present invention.
- FIG. 7 is a diagram showing the timing of updating the motion vector detection range according to the first embodiment of the present invention.
- FIG. 8A is a diagram showing an outline of pixel sampling when detecting a motion vector when the motion vector detection range is large according to the first embodiment of the present invention.
- FIG. 8 (b) is a diagram showing an outline of pixel sampling when detecting a motion vector when the motion vector detection range is medium in the first embodiment of the present invention.
- FIG. 8 (c) is a diagram showing an outline of pixel sampling when detecting a motion vector when the motion vector detection range is small according to the first embodiment of the present invention.
- FIG. 9 is a flowchart of determining a motion vector switching area according to the first embodiment of the present invention.
- FIG. 10 is a block diagram showing a configuration of a conventional motion vector detection device.
- FIG. 11 is a block diagram showing a configuration of a conventional moving picture compression encoding apparatus.
- FIG. 12 is an explanatory diagram showing the operation of the motion estimation device 307A constituting the conventional video compression encoding device.
- FIG. 13 is a flowchart showing the processing operation of CPU 5 constituting the conventional moving picture compression encoding apparatus.
- FIG. 14 is a diagram showing an example of a motion vector detection range and a motion vector of a conventional video compression encoding apparatus.
- the motion vector detection range adaptively obtained based on the motion vector detected by the motion vector detection unit (means) is returned to the motion vector detection unit (means).
- the motion vector detection range for detecting the motion vector by the motion vector detection unit (means) can be set in accordance with the motion of the input video image, and a more appropriate motion vector can be set. Even if there are multiple motion vector detection ranges (that is, the number of modes) for detection, the circuit scale does not increase. In addition, the accuracy in detecting the motion vector can be improved.
- the motion vector detection area can be set appropriately in the motion vector detection unit in accordance with the motion of the input video image in units of the video image, simplifying the setting of the highly accurate motion vector detection range. be able to.
- a motion vector to be actually applied is selected from a plurality of types of motion vector detection ranges provided in advance by referring to the result of the motion vector detection range adaptively obtained. Since there is a configuration to select the detection range, the update of the motion vector detection range set in the motion vector detection unit can be freely adjusted from the plurality of types according to the input moving image. The motion vector detection can be achieved according to the user's intention. Also
- the motion vector detection range set in the motion vector detection unit can be achieved in accordance with the motion of the input video image, for example, motion vector detection in accordance with the user's intention.
- the feedback means returns the motion vector detection range determined by the motion vector detection range determination means to the motion vector detection means and the switching area generation means.
- the setting of the motion vector detection range can be determined by following the speed of the motion of the input video image, and the immediacy of the motion vector detection range according to the motion of the input video image can be improved. it can.
- the motion vector detection range is switched, and the switched motion vector detection range is switched to the motion vector detection means. Since it has a configuration that feeds back to the area generation means, the amount of generated code can be reduced when encoding the input video image, and the speed of motion vector detection in accordance with the motion of the input video image can be further increased. .
- FIG. 1 is a block diagram showing a configuration of a moving picture compression encoding apparatus according to the first embodiment of the present invention, which is an example showing a case of an MPEG (MovingPictCu resExer t ssG roup) method.
- 1 is an input terminal
- 2 is a frame rearranger
- 3 is a discrete cosine transformer (hereinafter referred to as DCT)
- 4 is a quantizer
- 5 is a variable-length encoder.
- 6 is a buffer memory
- 7 is an output terminal
- 8 is a rate controller
- 9 is an inverse quantizer
- 10 is an inverse 0 ⁇ 3
- 11 is a frame memory.
- 1 2 is a predictor
- 13 is a detection range determiner
- 14 is a switching area determiner
- 15 is a comparator
- 16 is a counter
- 17 is A subtractor
- 18 is a switching switch
- 19 is an adder
- 20 is a switch.
- the frame rearranger 2 of the present embodiment is an example of the macroblock generating means of the present invention
- the switch 18, the subtractor 17, the DCT unit 3, the quantizer 4, and the inverse switch 18 of the present embodiment are used.
- the quantizer 9, the inverse DCT unit 10, the adder 19, the switch 20, and the frame scale 11 are examples of the code decoding means of the present invention.
- the switching area determiner 14, the comparator 15, and the force counter 16 of the present embodiment are examples of the motion vector detecting means, and are examples of the motion vector counting means of the present invention.
- the detection range determiner 13 of the embodiment is an example of the motion vector detection range determination means of the present invention.
- the original image signal input from input terminal 1 is divided into audio and video signals in advance among the video and audio signals. This is a separated video signal.
- the video signal is rearranged into frames by the frame rearranger 2
- the original video signal of a unit obtained by subdividing the frame by a predetermined number of pixels (hereinafter referred to as a macroblock unit) is rearranged into a frame.
- Output to the switch 18 in the order rearranged by the detector 2 hereinafter referred to as the decoding order).
- the switching switch 18 outputs the original video signal in macroblock units (hereinafter referred to as a macroblock video signal) as it is, or a subtractor 17 using a motion-compensated prediction video signal or the like from the macroblock video signal. Select whether to subtract.
- macroblock video signal hereinafter referred to as a macroblock video signal
- the switching switch 18 selects the macroblock moving image signal as it is described.
- the macroblock video signal output from the switch 18 is an I picture
- the DCT signal subjected to discrete cosine transform by the DCT unit 3 is output to the quantizer 4.
- the quantizer 4 performs quantization with a predetermined quantization value returned from the rate controller 8, and outputs a quantized signal with a reduced amount of information to the variable-length encoder 5 and the inverse quantizer 9. I do.
- the quantized signal input to the variable-length encoder 5 is output to the buffer memory 6 as an encoded signal that has been encoded by the variable-length encoder 5, and the buffer memory 6 encodes the signal until it is extracted from the output terminal 7.
- the generated code amount is output to the rate controller 8.
- the quantized value based on the generated code amount is fed back to the quantizer 4.
- the encoded signal extracted from the output terminal 7 is multiplexed with an audio signal by a system encoder (not shown).
- the quantized signal input to the inverse quantizer 9 outputs an inverse quantized signal inversely quantized with a predetermined quantization value to the inverse DCT unit 10.
- the inverse DCT unit 10 outputs an inverse DCT signal obtained by subjecting the input quantized signal to inverse discrete cosine processing.
- the switching switch 18 selects the macro block video image signal as it is, as in the case of an I-picture, the switch is linked to the switching switch 18.
- Switch 20 is in the OFF state, and the reference video signal in macro-block units (hereinafter referred to as macro-block reference signal) is stored in frame memory 11 without adding it to the inverse DCT signal by adder 19 until frame 1 becomes 1 frame. Store.
- the difference between the frame-based reference video signal (hereinafter referred to as the frame reference signal) stored for one frame in the frame memory 11 and the macroblock video signal from the frame rearranger 2 is minimized.
- the motion vector is predicted by the predictor 12 and the motion vector detection range is detected, and the motion vector and the video signal after motion compensation prediction (hereinafter, referred to as a predicted video signal) are output.
- the switch 18 is a P picture or a B picture in which the subtracter 17 selects a difference signal between the macroblock moving picture signal and the predicted picture signal
- a difference signal obtained by subtracting a predicted video signal based on the immediately preceding I picture or P picture from the macroblock video signal is output to the DCT unit 3, and the DCT signal is output to the quantizer 4.
- One of the quantized signals output from the quantizer 4 is stored in the buffer memory 7 until it is extracted from the output terminal 7 via the variable length encoder 5 and the buffer memory 6, and the generated code amount is controlled by the rate controller 8. And feeds back the quantized value to the quantizer 4.
- the encoded signal stored in the buffer memory 6 is output from the output terminal 7 to the system encoder in the same manner as described above.
- the other of the quantized signals is input to an adder 19 via an inverse quantizer 9 and an inverse DCT unit 10.
- Switch 20 is turned on in conjunction with switch 18 and the I-picture or P-picture immediately before subtraction by subtracter 17 is added to the inverse DCT signal output from inverse 0 10 Obtain the reference signal.
- the macroblock reference signal added by the adders 1 and 9 is stored in the frame memory 11 until one frame is obtained, and the estimator 12 uses the frame reference signal from the frame memory 11 and the macroblock moving image signal. The motion vector with the smallest difference signal is detected within the motion vector detection range.
- a motion vector and a predicted video signal as shown in FIG. 2 are output.
- the macroblock video signal is a B-picture
- the P-picture is the same as the P-picture except that the difference between the predicted video signal based on the preceding and following I-pictures or P-pictures and the macroblock video signal is calculated by the subtractor 17. is there.
- the subtractor 17. is there.
- B-pictures refer to the preceding and following pictures as described above, so the algorithm for updating the motion vector detection range on a frame-by-frame basis becomes more complicated, but the accuracy is not much improved.
- an algorithm is adopted in which a B picture is ignored until the next P picture is selected.
- One of the signals output from the predictor 12 obtained in this way is used as a predicted video signal for subtracting the next macroblock video signal by the subtractor 17, and the other is, for example, as shown in FIG.
- a motion vector for each macro block is output to the comparator 15.
- Region D in FIG. 3 indicates a region where the detection range of the motion vector is narrowed
- region U indicates a region where the detection range of the motion vector is expanded. That is, the motion vector Vu corresponding to the macroblock C ij detected by the predictor 12 shown in FIG. 2 is determined by the range of the motion vector switching area D or U output from the switching area determiner 14.
- the comparator 15 compares and verifies whether or not the macroblock exists, and adaptively determines a macroblock switching signal, and outputs the signal to the counter 16.
- FIG. 4 is a diagram illustrating the motion vector detection range shown in FIG. 3 in more detail.
- FIG. 4 (a) shows the motion vector detection range candidates. In the present embodiment, five motion vector detection range candidates A1, A2, A3, A4, and A5 are shown. is there. These motion vector detection range candidates are It is stored in the scale 13.
- the motion vector detection ranges used when the motion vector is detected by the predictor 12 and when the motion vector switching area is determined by the switching area determiner 14 are these five motion vectors.
- One of the vector detection range candidates Al, A2, A3, A4, and A5 is selected and used.
- A3 of the motion vector detection range candidates A1, A2, A3, A4, and A5 is actually used as the motion vector detection range.
- the outermost line 13 which is the outermost line of the motion vector detection range A3, and the outermost line 13 of the motion vector detection range A3 inside the motion vector detection range A3.
- the region between the outermost line 13 and the outer line corresponds to the region U described in Fig. 3.
- the area U in FIG. 3 is determined by the switching area determiner 14. Then, as described later, if a predetermined condition is satisfied when a motion vector is in the area U, processing is performed so as to expand the motion vector detection range A3. At this time, processing is performed so that the motion vector detection ranges A3, A3 '' 'are also expanded at the same time.
- the area inside the outermost lines 13, 3, which is the outermost line of the motion vector detection ranges A3,, which is inside the motion vector detection range A3, is shown in the figure. This corresponds to the area D described in 3.
- the area D in FIG. 3 is determined by the switching area determiner 14, and as described later, when the motion is in the area D and the vehicle satisfies a predetermined condition, the motion vector is detected. Processed to reduce range A3. At this time, the motion vector detection ranges A3, A3, A3, are also reduced.
- the switching area determiner 14 determines the area U and the area D in FIG. 3 according to the motion vector detection range.
- the switching of the motion vector detection range is performed by P picture.
- Comparator 15 operates only when encoding P pictures, but also operates when encoding B pictures if B pictures are also taken into account. Of course.
- the comparator 15 determines whether the motion vector Vij corresponding to the macroblock Cij is in the area U in FIG. 3 and whether or not it is in the area D in FIG. Output to counter 16 as block switching signal.
- the counter 16 When the macroblock switching signal is input, the counter 16 indicates that the motion vector Vij corresponding to the macroblock Cu indicates that the motion vector Vij is in the area U in FIG. If the count value corresponding to U is incremented by 1 and the macroblock switching signal indicates that the motion vector Vij corresponding to the macroblock Cij is in area D in Fig. 3, Increment the corresponding count value by one.
- the counter 16 counts the count value corresponding to the area D and the count value corresponding to the area U for one frame, and the counter 16 converts the count result into a frame-based switching signal (hereinafter referred to as a frame switching signal). )
- the detection range determiner 13 adaptively determines the motion vector detection range in frame units.
- the detection range determiner 13 selects the motion vector detection range that is actually used from the motion vector detection range candidates Al, A2, A3, A4, and A5 shown in FIG. 4 (a). Determined by
- the detection range determiner 13 sets the motion vector detection range A4 as shown in Fig. 5 (b). Select to reduce the motion vector detection range. More specifically, the detection range determiner 13 is input from the counter 16. The value obtained by dividing (the number of motion vectors existing in the motion vector switching area D) by (the number of macro blocks existing in one frame period) based on the input frame switching signal is a predetermined threshold value. At this point, the motion vector detection range is switched to the motion vector switching area A4. At this time, the motion vector detection ranges A 3,, A 3,, are simultaneously switched to A 4,, A 4 ', respectively. Thus, the detection range determiner 13 reduces the detection range of each motion vector.
- the detection range determiner 13 determines the motion vector detection range to be the motion vector detection range A4
- the determined motion vector detection range is transmitted to the switching area determiner 14 and the predictor 12. Will return.
- the switching area determiner 14 determines the motion vector switching areas D and U according to the determination as shown in FIG. 5 (b).
- the detection range determiner 13 detects the motion vector as shown in FIG. 6 (b).
- the motion vector detection range is expanded by selecting the range A2. More specifically, based on the frame switching signal input from the counter 16, the detection range determiner 13 calculates (the number of motion vectors existing in the motion vector switching area U) by (one frame). When the value divided by the number of macroblocks existing during the period of time exceeds a predetermined threshold, the motion vector detection range is switched to the motion vector detection range A2. At this time, the motion vector detection ranges A 3,, A 3,, are simultaneously switched to A 2 ', A 2,, respectively. Thus, the detection range determiner 13 expands the detection range of each motion vector.
- the detection range determiner 13 determines the motion vector detection range as the motion vector detection range A2
- the determined motion vector detection range is fed back to the switching area determiner 14 and the predictor 12 .
- the switching area determiner 14 determines the motion vector switching areas D and U as shown in FIG. 6 (b) according to the determination.
- the detection range determiner 13 calculates a value obtained by dividing (the number of motion vectors existing in the motion vector switching area D) by (the number of macroblocks existing in one frame period) a predetermined threshold value. If it is smaller and the value obtained by dividing (the number of motion vectors existing in the motion vector switching area U) by (the number of macroblocks existing in one frame period) is smaller than a predetermined threshold value, Does not enlarge or shrink the title detection range. That is, the motion vector detection range is not changed.
- the motion vector detection range fed back to the predictor 12 is used as the optimal motion vector detection range for each frame when the motion vector is predicted by the predictor 12 for the next frame. Used as a motion vector detection range.
- the predictor 12 will calculate the motion vector in the next frame unit.
- the motion vector detection range A4 is used in predicting the motion vector.
- the predictor 12 determines the motion vector in the next frame unit.
- the motion vector detection range A2 is used.
- FIG. 7 shows the timing of updating the motion vector detection range.
- the motion vector detected in the P frame 20 is used by the detection range determiner 13 to determine the motion vector detection range of the next P frame 21.
- the moving picture compression encoding apparatus sets the motion vector detection range for each P frame. It is switching.
- the conventional video compression encoding apparatus described with reference to FIG. 11 uses the motion vector on the outermost periphery of the motion vector detection range 320. Since only P was detected, a motion vector that is on the outermost circumference of the motion vector detection range 320 is more appropriate than the motion vector P and exists outside the motion vector detection range 320. However, such motion vectors could not be detected and used. Even in such a case, in the conventional moving image compression encoding apparatus described with reference to FIG. 11, the motion vector P is detected and used instead of detecting the appropriate motion vector.
- the moving picture compression encoding apparatus when expanding the motion vector detection range, the moving picture compression coding apparatus rides on the area U shown in FIGS. 3, 4, 5, and 6, respectively.
- the motion vector is considered. Therefore, even if a proper motion vector exists outside the motion vector detection range in the conventional technology and such a proper motion vector cannot be detected, the area U is not detected as in the present embodiment.
- the motion vector By considering the motion vector as an object of the motion vector, it becomes possible to detect an appropriate motion vector that cannot be detected by the conventional technology.
- an appropriate motion vector can be detected even for an input moving image with a large motion, and an appropriate motion vector detection range can be set.
- the moving image compression encoding apparatus performs the motion vector decoding in parallel with the processing operation of the motion vector detecting means 21 for detecting the motion vector of the moving image signal by performing the compression encoding.
- the motion vector for detecting the vector The configuration is such that the detection range is replaced with the range optimized for the previous frame unit.Therefore, the hardware scale of the circuit etc. provided to the motion vector detection means 21 The effect is that the detection of the motion vector can be optimized without increasing the motion vector. In addition, an appropriate motion vector can be detected even for an image having a large motion, and an appropriate motion vector detection range can be set.
- the detection range determiner 13 has been described as selecting the motion vector detection range to be actually used from among the five motion vector detection range candidates, but the present invention is not limited to this.
- the actual motion vector detection range may be selected from the three motion vector detection range candidates, or the actual motion vector detection range may be selected from the seven motion vector detection range candidates. I do not care.
- the detection range determiner 13 of the present embodiment stores a plurality of motion vector detection range candidates, and determines even by selecting a motion vector detection range to be actually used from among them. do it.
- the detection range determiner 13 may increase the magnification of the motion vector detection range as the number of motion vectors existing in the motion vector switching area U increases.
- the detection range determiner 13 sets a larger motion vector detection range as the number of motion vectors in the motion vector switching area U increases from the motion vector detection range held in advance.
- the detection range determiner 13 does not hold the motion vector detection range in advance.
- a range may be created.
- the detection range determiner 13 may increase the reduction ratio of the motion vector detection range as the number of motion vectors existing in the motion vector switching area D increases. In this case, the detection range determiner 13 sets a smaller motion vector detection range as the number of motion vectors existing in the motion vector switching area D increases from the motion vector detection range held in advance. The detection range determiner 13 does not hold the motion vector detection range in advance, and the smaller the number of motion vectors in the motion vector switching area D, the smaller the motion vector.
- the torque detection range may be generated.
- the moving picture compression encoding apparatus has a pixel-by-pixel basis when the motion vector detection range is narrow.
- the approaching motion vector is detected, and conversely, if it is wide, the motion vector that is detected only for the widened area is thinned out. That is, when the detection range is wide as in the motion vector detection range A1 as shown in Fig. 8 (a), the motion vector related to the thinned pixels is detected as shown by black marks, and conversely.
- the detection range is narrow as in the motion vector detection range A5 as shown in FIG. 8 (c) the motion vector is detected in pixel units as indicated by black marks. Therefore, even if the detection range of the motion vector is wide, pixels for obtaining the motion vector are thinned out according to the size of the detection range, so that the calculation amount for detecting the motion vector does not increase.
- the motion vector detection range is increased. Optimization can be achieved by appropriately enlarging and reducing the size of the motion of the input video, improving the accuracy of motion vector detection and thereby reducing the amount of generated code, resulting in high-quality video after decoding. Can be achieved.
- circuits such as storage means required for motion vector detection can be made to have a scale corresponding to the narrowest range of the motion vector detection range.
- Device that can realize the decoded image of It can be cheaper.
- a switching area determiner 14 for generating a motion vector detection range switching area according to the motion vector detection range, and the motion vector detection range switching area And a comparator 15 for comparing the detected motion vector with the detected motion vector to determine whether the motion vector is in the motion vector switching area. If a configuration is provided to store the judgment signal of the output signal of 15 and determine the motion vector detection range based on the judgment signal stored in the counter 16, the motion vector detected by the motion vector detecting means 21 is provided.
- the vector motion vector detection range can be set to follow the motion of the input video image, and the immediacy of the motion vector detection range in accordance with the motion of the input video image can be improved.
- the motion vector detection range output from the detection range determiner 13 to the predictor 12 has been described as being updated on a frame basis, but is not limited to this. Although the description has been made assuming that the motion vector detection range is determined adaptively in frame units, the present invention is not limited to this.
- the motion vector detection range output from the detection range determiner 13 to the predictor 12 may be updated in n (n is a natural number satisfying ⁇ ⁇ ) periods.
- N is the total number of macroblocks existing in one frame, and the total number of macroblocks in one division unit when one frame is divided into a plurality is n.
- the counter 16 is configured to store the number of motion vectors existing in the motion vector switching area in the n periods, and (the number of motion vectors existing in the motion vector switching area).
- the motion vector detection range is switched, and the switched motion vector detection range is moved to the motion vector detection means. 2 Return to 1 and switching area determiner 14 You.
- the motion vector detection range is set to, for example, as shown in FIG. (a), as shown in FIG. 5 (b), the motion vector detection range A3 is switched to the motion vector detection range A4. In other words, the motion vector detection range is reduced.
- the value obtained by dividing by (the number of motion vectors existing in the area U)) r (the number of macroblocks existing in n periods) is equal to or greater than a predetermined threshold.
- the motion vector detection range is switched from the motion vector detection range A3 to the motion vector detection range A2, for example, as shown in FIGS. 6 (a) and 6 (b). That is, the range of motion vector detection is expanded.
- the input video image input from the input terminal 1 is rearranged by the frame rearranger 2 in decoding order, and subdivided into N (where N is a natural number of 2 or more) per frame in step 31 Macroblock video signal.
- step 32 the switching switch 18 determines whether the macroblock video signal extracted from the frame rearranger 2 in decoding order is an I-picture or a non-I-picture.
- the switch 20 is turned off.
- the macroblock video signal determined as an I picture is transferred to the frame memory 11 via the DCT unit 3, the quantizer 4, the inverse quantizer 9, the inverse DCT unit 10 and the adder 19 in step 33. Restoring macroblock video of pictures Store the encoded signal.
- step 34 it is determined that the compression decoding of the one-frame MAC block block moving image signal has been completed.
- step 32 it is determined whether the macroblock video signal extracted from the rearranger 2 is an I-picture, and if it is not an I-picture, in step 35, whether it is a P-picture or a B-picture is determined by the switching switch 18.
- step 36 the macroblock video signal and the predicted video signal output from the predictor 12 are subtracted by the subtractor 17 to obtain a difference signal. Output and switch 20 ON.
- the difference signal subtracted in step 36 passes through DCT unit 3, quantizer 4, inverse quantizer 9, and inverse DCT unit 10 in step 37, and P-picture inverse DCT signal in adder 19. And the predicted video signal output from the predictor 12 (In this example, the predicted video signal is from the immediately preceding I picture, but if a P picture follows, the predicted video signal is from the immediately preceding P picture) And stores the macro block reference signal in the frame memory 11 until one frame is reached. At the same time, a predictor 12 generates a predicted video signal using a motion vector that minimizes the difference between the frame reference signal and the macroblock video signal from the frame rearranger 2.
- the predicted video signal generated in Step 37 is input to the comparator 15 in Step 38, and the predicted video signal and the motion vector switching area output from the switching area determiner 14 are output from the comparator 15 to the comparator 15.
- the macro block switching signal is output to the counter 16 by comparing.
- the counter 16 stores the macroblock switching signal until one frame is reached.
- step 34 the pressure of the macroblock video signal for one frame is The end of the compression / decoding is determined, and if one frame has not been reached, the process returns to step 32.
- the step of turning on the switch 20 is step 36.
- any step may be used before the addition is performed by the adder 19, and the step may be performed in step 35 or step 37. Of course, it is possible.
- step 32 it is determined whether the macroblock video signal extracted from the rearranger 2 is an I-picture, and if it is not an I-picture, in step 35, whether it is a P-picture or a B-picture is determined by the switching switch 18.
- step 39 the subtractor 17 subtracts the macroblock video signal from the predicted video signal output from the comparator 12 to output a difference signal.
- step 40 the difference signal subtracted in step 39 passes through the DCT unit 3 and the quantizer 4 to generate a quantized signal.
- step 34 the compression decoding of one frame of the macroblock video signal is performed. Judgment of the end, and if it has not reached one frame, return to step 32.
- step 34 If it is determined in step 34 that one frame has been reached, a frame switching signal is output from the counter 16 to the detection range determiner 13 in step 41, and the detection range determiner 13 The motion vector detection range is fed back to the predictor 12 and is also output to the switching area determiner 14, and the switching area determiner 14 generates the motion vector switching area, and the comparator 1 Output to 5.
- step 41 a motion vector detection range for each frame is generated and output to the predictor 12.
- step 42 the video signal ends and it is determined whether or not the next frame exists. If so, the process returns to the frame rearranger 2, and if there is no next frame, the process is terminated.
- the motion vector detection range is updated by a frame.
- the processing may be performed in a predetermined unit of the input moving image signal such as a screen unit, a frame unit, a group of pictures (GOP) unit, or the like.
- a predetermined unit of the input moving image signal such as a screen unit, a frame unit, a group of pictures (GOP) unit, or the like.
- MPEG compression has been described as an example.
- the compression / decoding method is not limited to MPEG, and may be, for example, in the time direction such as H.261 or H.263. Any compression method that performs inter-frame prediction to reduce redundancy can be applied.
- the motion of the input video is reduced. It has the effect of selecting the optimal motion vector detection range according to the speed, and as a result, an excellent effect of achieving high image quality can be obtained.
- an appropriate motion vector can be detected even for an image having a large motion, and an appropriate motion vector detection range can be set.
- the program of the present invention is a program for causing a computer to execute all or some of the steps (or steps, operations, actions, and the like) of the above-described motion vector detection method of the present invention. It is a program that works in cooperation with.
- the recording medium of the present invention is a program for causing a computer to execute all or a part of all or some of the steps (or steps, operations, actions, etc.) of the above-described motion vector detection method of the present invention. And a computer-readable recording medium that executes the above-described operation in cooperation with the computer.
- the “partial means (or device, element, etc.)” of the present invention means Means one or several means of the plurality of means, and the “partial steps (or steps, operations, actions, etc.)” of the present invention means “out of the plurality of steps”. Means one or several steps.
- the “function of the means (or device, element, etc.)” of the present invention means all or a part of the function of the means, and the “step (or process, operation, operation, etc.) The operation of “)” means the operation of all or part of the steps.
- One use form of the program of the present invention may be a form in which the program is recorded on a computer-readable recording medium and operates in cooperation with the computer.
- One use form of the program of the present invention may be a form in which the program is transmitted through a transmission medium, read by a computer, and operates in cooperation with the computer.
- the data structure of the present invention includes a database, a data format, a data table, a data list, a data type, and the like.
- the recording medium includes ROM and the like
- the transmission medium includes transmission media such as the Internet, light, radio waves and sound waves.
- the computer of the present invention described above is not limited to pure hardware such as CPU, but may include firmware, OS, and peripheral devices.
- the configuration of the present invention may be realized by software or hardware. Industrial applicability
- the present invention provides an image with large motion.
- a video compression encoding apparatus, a motion vector detection method, a recording medium, and the like that can detect an appropriate motion vector even for an image and can set an appropriate motion vector detection range. You can offer a program.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020037013911A KR100632072B1 (ko) | 2001-12-25 | 2002-12-24 | 동화상 압축 부호화장치 및 모션벡터 검출방법 |
US10/467,420 US20040105589A1 (en) | 2001-12-25 | 2002-12-24 | Moving picture compression/coding apparatus and motion vector detection method |
EP02793365A EP1460854A4 (en) | 2001-12-25 | 2002-12-24 | COMPRESSION DEVICE / ENCODED IMAGE ENCODING DEVICE AND MOTION VECTOR DETECTION METHOD |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2001-391441 | 2001-12-25 | ||
JP2001391441 | 2001-12-25 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2003056838A1 true WO2003056838A1 (en) | 2003-07-10 |
Family
ID=19188521
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2002/013413 WO2003056838A1 (en) | 2001-12-25 | 2002-12-24 | Moving picture compression/coding apparatus and motion vector detection method |
Country Status (6)
Country | Link |
---|---|
US (1) | US20040105589A1 (ja) |
EP (1) | EP1460854A4 (ja) |
KR (1) | KR100632072B1 (ja) |
CN (1) | CN1266947C (ja) |
TW (1) | TWI225372B (ja) |
WO (1) | WO2003056838A1 (ja) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050169376A1 (en) * | 2004-01-30 | 2005-08-04 | Pai Ramadas L. | Motion vector address computer error detection |
KR100763205B1 (ko) * | 2006-01-12 | 2007-10-04 | 삼성전자주식회사 | 모션 역변환을 사용하여 모션 예측을 수행하는 방법 및장치 |
EP2390840A3 (en) * | 2006-02-13 | 2011-12-14 | Snell Limited | Method and apparatus for extracting a region of interest in a moving image sequence |
US7916141B2 (en) * | 2006-04-10 | 2011-03-29 | Choi Kum-Young | Image processing system using vector pixel |
CN101137065A (zh) * | 2006-09-01 | 2008-03-05 | 华为技术有限公司 | 图像编码方法、解码方法、编码器、解码器、编解码方法及编解码器 |
CN102325257A (zh) * | 2007-07-20 | 2012-01-18 | 富士胶片株式会社 | 图像处理设备和图像处理方法 |
US8428023B2 (en) * | 2010-10-22 | 2013-04-23 | Motorola Solutions, Inc. | Method and apparatus for distributing video packets over multiple bearers for providing unequal packet loss protection |
US8649339B2 (en) * | 2010-10-22 | 2014-02-11 | Motorola Solutions, Inc. | Method and apparatus for distributing video packets over multiple bearers for providing unequal packet loss protection |
KR20120088488A (ko) * | 2011-01-31 | 2012-08-08 | 한국전자통신연구원 | 시간적 움직임 벡터 저장 방법 및 그 장치 |
EP3139611A1 (en) | 2011-03-14 | 2017-03-08 | HFI Innovation Inc. | Method and apparatus for deriving temporal motion vector prediction |
EP2981089B1 (en) | 2013-03-29 | 2019-07-10 | Fujitsu Limited | Encoding device, computer system, encoding method, encoding program, and recording medium |
US11812168B2 (en) * | 2020-01-07 | 2023-11-07 | Semiconductor Components Industries, Llc | Imaging devices with image transform circuitry for improved motion detection |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08307880A (ja) * | 1995-03-03 | 1996-11-22 | Kokusai Denshin Denwa Co Ltd <Kdd> | 動画像符号化装置 |
JPH0955941A (ja) * | 1995-08-16 | 1997-02-25 | Sony Corp | 画像符号化方法、画像符号化装置、及び画像符号化データの記録装置 |
JPH09284776A (ja) * | 1996-04-12 | 1997-10-31 | Sony Corp | 画像符号化装置及び画像符号化方法 |
JPH1023420A (ja) * | 1996-07-02 | 1998-01-23 | Matsushita Electric Ind Co Ltd | 動き検出方法および動き検出装置 |
JPH1155677A (ja) * | 1997-08-08 | 1999-02-26 | Fujitsu Ltd | 動画像符号化装置 |
JPH11127437A (ja) * | 1997-10-21 | 1999-05-11 | Nec Corp | 動画像符号化方法および装置 |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2231225B (en) * | 1989-04-27 | 1993-10-20 | Sony Corp | Motion dependent video signal processing |
TW224553B (en) * | 1993-03-01 | 1994-06-01 | Sony Co Ltd | Method and apparatus for inverse discrete consine transform and coding/decoding of moving picture |
US5537155A (en) * | 1994-04-29 | 1996-07-16 | Motorola, Inc. | Method for estimating motion in a video sequence |
US5841476A (en) * | 1995-03-03 | 1998-11-24 | Kokusai Denshin Denwa Co. Ltd. | Coding apparatus for encoding motion picture |
JP3994445B2 (ja) * | 1995-12-05 | 2007-10-17 | ソニー株式会社 | 動きベクトル検出装置及び動きベクトル検出方法 |
MY118360A (en) * | 1996-04-30 | 2004-10-30 | Nippon Telegraph & Telephone | Scheme for detecting shot boundaries in compressed video data using inter-frame/inter field prediction coding and intra-frame/intra-field coding |
JP3149840B2 (ja) * | 1998-01-20 | 2001-03-26 | 日本電気株式会社 | 動きベクトル検出装置及び方法 |
JP4378824B2 (ja) * | 2000-02-22 | 2009-12-09 | ソニー株式会社 | 画像処理装置及び方法 |
EP1134981A1 (en) * | 2000-03-17 | 2001-09-19 | STMicroelectronics S.r.l. | Automatic setting of optimal search window dimensions for motion estimation |
-
2002
- 2002-12-24 KR KR1020037013911A patent/KR100632072B1/ko not_active IP Right Cessation
- 2002-12-24 US US10/467,420 patent/US20040105589A1/en not_active Abandoned
- 2002-12-24 WO PCT/JP2002/013413 patent/WO2003056838A1/ja active Application Filing
- 2002-12-24 TW TW091137192A patent/TWI225372B/zh not_active IP Right Cessation
- 2002-12-24 EP EP02793365A patent/EP1460854A4/en not_active Withdrawn
- 2002-12-24 CN CNB028091329A patent/CN1266947C/zh not_active Expired - Fee Related
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08307880A (ja) * | 1995-03-03 | 1996-11-22 | Kokusai Denshin Denwa Co Ltd <Kdd> | 動画像符号化装置 |
JPH0955941A (ja) * | 1995-08-16 | 1997-02-25 | Sony Corp | 画像符号化方法、画像符号化装置、及び画像符号化データの記録装置 |
JPH09284776A (ja) * | 1996-04-12 | 1997-10-31 | Sony Corp | 画像符号化装置及び画像符号化方法 |
JPH1023420A (ja) * | 1996-07-02 | 1998-01-23 | Matsushita Electric Ind Co Ltd | 動き検出方法および動き検出装置 |
JPH1155677A (ja) * | 1997-08-08 | 1999-02-26 | Fujitsu Ltd | 動画像符号化装置 |
JPH11127437A (ja) * | 1997-10-21 | 1999-05-11 | Nec Corp | 動画像符号化方法および装置 |
Non-Patent Citations (1)
Title |
---|
See also references of EP1460854A4 * |
Also Published As
Publication number | Publication date |
---|---|
EP1460854A4 (en) | 2008-10-22 |
KR100632072B1 (ko) | 2006-10-04 |
CN1505900A (zh) | 2004-06-16 |
US20040105589A1 (en) | 2004-06-03 |
TW200301655A (en) | 2003-07-01 |
EP1460854A1 (en) | 2004-09-22 |
TWI225372B (en) | 2004-12-11 |
CN1266947C (zh) | 2006-07-26 |
KR20040016856A (ko) | 2004-02-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4373702B2 (ja) | 動画像符号化装置、動画像復号化装置、動画像符号化方法、動画像復号化方法、動画像符号化プログラム及び動画像復号化プログラム | |
US6816617B2 (en) | Motion vector searcher and motion vector search method as well as moving picture coding apparatus | |
JPWO2003003749A1 (ja) | 画像符号化装置、画像復号装置、画像符号化方法及び画像復号方法 | |
JP2004048552A (ja) | 画像符号化装置、画像符号化方法、画像復号装置、画像復号方法、および通信装置 | |
US20120027095A1 (en) | Motion vector detection apparatus, motion vector detection method, and computer-readable storage medium | |
JP4417054B2 (ja) | 離散コサイン変換係数を参照する動き推定方法及び装置 | |
WO2003056838A1 (en) | Moving picture compression/coding apparatus and motion vector detection method | |
WO2006074043A2 (en) | Method and apparatus for providing motion estimation with weight prediction | |
JPH10336672A (ja) | 符号化方式変換装置およびその動きベクトル検出方法 | |
JP2001128179A (ja) | 動画像符号化装置および方法 | |
JP3674535B2 (ja) | 動画像符号化方法および装置 | |
JPH0846969A (ja) | 映像信号符号化方式 | |
JP2507199B2 (ja) | 画像符号化方法及び装置 | |
JPH1023420A (ja) | 動き検出方法および動き検出装置 | |
JP4034180B2 (ja) | 動画像圧縮符号化装置、及び動きベクトル検出方法 | |
JPH0984024A (ja) | 動画像信号の符号化装置 | |
JP2012124851A (ja) | 動き補償符号化装置、動き補償符号化方法、及びプログラム | |
JPH10224779A (ja) | 動画像のシーン変化検出方法及び装置 | |
JP4561701B2 (ja) | 動画像符号化装置 | |
JP4100067B2 (ja) | 画像情報変換方法及び画像情報変換装置 | |
KR100657714B1 (ko) | 3차원 스캐닝을 이용한 영상데이터 부호화 방법 | |
JPH06105299A (ja) | 動画像圧縮装置 | |
JPH11298902A (ja) | 画像符号化装置および方法 | |
JPH11205801A (ja) | 動画像符号化装置およびその符号化選択方法 | |
JPH0799645A (ja) | 動きベクトル検出回路 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): CN KR US |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2002793365 Country of ref document: EP |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 1020037013911 Country of ref document: KR |
|
WWE | Wipo information: entry into national phase |
Ref document number: 028091329 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10467420 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 2002793365 Country of ref document: EP |