CN101056409B - A decoding method for video image to skip the macro block - Google Patents
A decoding method for video image to skip the macro block Download PDFInfo
- Publication number
- CN101056409B CN101056409B CN 200710097499 CN200710097499A CN101056409B CN 101056409 B CN101056409 B CN 101056409B CN 200710097499 CN200710097499 CN 200710097499 CN 200710097499 A CN200710097499 A CN 200710097499A CN 101056409 B CN101056409 B CN 101056409B
- Authority
- CN
- China
- Prior art keywords
- macro block
- coding
- type
- decoding
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention proposes a decoding method for jumping over a macro block during video encoding, comprises: reading encoding sign of a current image jumping over the macro block from a code stream, judging encoding type of the current image jumping over the macro block based on the encoding sign; selecting a macro block type decoding manner according to the encoding type, decoding the macro block type of the current macro block of the current image by using a run decoding manner or a decoding manner of jumping over the macro block number and combining the macro block type, and decording the macro block self-data for the macro block of the current image; judging whether the current macro block is a last encoded macro block of the current image, if it is, decoding is finished, otherwise, decoding is continuously performed. The invention improves image encoding efficiency, reduces cost for transport and storage by adaptively selecting an encoding manner of the video image jumping over the macro block and a corresponding decoding manner, thereby the invention is an easy and available technic scheme, and can be executed in frame encoding or field encoding.
Description
Technical field
The present invention relates to a kind of method to video image decoding, especially a kind of when coded image contains skip macroblock, the skip macroblock of video image is carried out the method that Methods for Coding and corresponding decoding obtain video image, belong to field of video encoding.
Background technology
Digital Television, next-generation mobile communications, broadband network communication, these high-tech industries of household consumption electronics group's common technology concentrates on to look on the multimedia messages treatment technology, particularly data compression technique that audio frequency is main contents.Video coding and decoding technology is to realize high-quality, storage of low-cost multi-medium data and the key of transmitting efficiently.
In existing video standard, all there is a kind of skip macroblock pattern (Skipped Macroblock) in (as MPEG series and H.26x serial).The so-called skip macroblock additional information (for example motion vector or residual error) that do not need to encode when being meant to this type macroblock coding, it only exists in P image and B image, promptly only in the interframe encode video image, exist, do not exist in intra-coded video image such as the I frame.The motion vector of skip macroblock is that the motion vector of the adjacent macroblocks (time-domain or spatial domain) by first pre-treatment is derived, and does not have residual error data (quantizing the back residual error is 0).Because the processing of skip macroblock is different from other macro block, so when video coding, it need be identified out.
Adopt " macroblock address increment " (macroblock_address_increment) to handle in the MPEG2 standard.If macroblock_address_increment greater than 1, then has some skip macroblocks in the middle of the expression.
H.263 identify by special one whether coded data is arranged in the standard, i.e. " coded macroblocks sign " (coded macroblock indication), it is skip macroblocks that 1 expression does not have data, there is the macro block data of coding 0 expression back.
H.264 adopt " Run-Length Coding " (run length) to handle to skip macroblock in the standard, encode skipping number.This processing mode is identical with " macroblock address increment " method thinking of MPEG2, all is the macroblock number that coding is skipped.
In the prior art, only adopt the single mode skip macroblock type of encoding, the efficient of coding is not high.For some level and smooth sequence, when quantizing parameter when big, skip macroblock is a lot, and " macro block identification means " all needs one to each macro block whether identify be skip macroblock at this moment, and efficient is lower; And adopt " macroblock address increment " mode only to need to compile continuous skip macroblock number with variable length code.Equally, the sequence bigger to some motion, when quantizing parameter hour, skip macroblock is less, and continuously the skip macroblock number that occurs is also less, and the frequent fractional value that occurs also is unfavorable for that variable length code encodes, for example may need 3bit to represent during numerical value 3 variable length codings, if such fractional value is a lot, and do not have big numerical value (skip macroblock continues to occur), this moment, fixed length code can reach better coding effect.Simultaneously, for single 0 value that is used for identifying non-skip macroblock, " macroblock address increment " mode is identical with the actual coding figure place of " coded macroblocks sign " mode.This moment, the macroblock address increment mode can not be given full play to the advantage of variable length code, and code efficiency also greatly reduces.
When image encoding, select which kind of mode skip macroblock of encoding, become field of video encoding and further improve one of difficult problem of code efficiency to obtain best code efficiency.
Summary of the invention
Technical problem to be solved by this invention is: propose a kind of coding method of skip macroblock, can be according to the macro block of skipping how much select the different coding mode skip macroblock of encoding, and the coding/decoding method of corresponding skip macroblock further is provided, code efficiency is greatly improved.
A kind of coding/decoding method of video image to skip macro block comprises the steps:
The present invention selects video image to skip macroblock encoding mode and decoding mode corresponding by twice coding or by empirical value, improved the efficient of image encoding, reduced the cost of transmission and storage, when having solved in the past the video image to skip macroblock coding, the problem of inefficiency, and availability is strong, when frame encoding and decoding and field encoding and decoding, all can effectively use, and be a kind of simple, practical technical scheme.
Description of drawings
Fig. 1 is the universal coding schematic flow sheet that the present invention embeds skip macroblock coding;
Fig. 2 is the general decoding schematic flow sheet that the present invention embeds the skip macroblock decoding;
Fig. 3 is a schematic diagram that comprises the image macro example of skip macroblock;
Fig. 4 is the flow chart that the present invention adopts twice coding selection coded system;
Fig. 5 the present invention is based on the flow chart that statistical information is selected coded system.
Embodiment
Video image consists of a plurality of macro blocks, so, video image is encoded, at first want the type of coded macroblocks, and then coded macroblocks itself; All macro blocks of having encoded have just been finished the coding of image.
The present invention relates to the coding to interframe encode video image macro-block type, skip macroblock can be regarded as a kind of special macro block (mb) type, and for the coding of macro block as data such as motion vector, residual errors itself, then can adopt any macroblock coding mode.
The present invention is according to code check and image quality requirements and video sequence characteristics, the more coded image of skip macroblock adopts Run-Length Coding, the less coded image of skip macroblock adopts the coded system of skip macroblock number and macro block (mb) type associating, thereby can adapt to the different application demand better, under different situations, can both select skip macroblock coding mode most effectively for use, improve the efficient of coding.
As shown in Figure 1, the cataloged procedure of technical scheme of the present invention comprises the steps:
Increase a coded system that identifies the present image skip macroblock in step 1, the image head;
Therefore the present invention, need at first change the mode of mark owing to the skip macroblock to video image has adopted different coded systems, and in order to reduce mark, all skip macroblocks of single frames are adopted in a like fashion and encoded.The information that has comprised many images in the image head, by in image head, increasing the coded system that (0 or 1) can identify the present image skip macroblock, such as preestablishing this position is 1 expression Run-Length Coding, is 0 expression skip macroblock number and macro block (mb) type combined coding.
Be an one instantiation below:
Pb_picture_header () // image head
{
…………………
Skip_code_flag // its value has shown the coded system of skip macroblock
…………………
Next_start_code () // find next image head of code stream
}
The increase one digit number certificate of image head among the pb_picture_header (), be used to identify the coded system of present image skip macroblock, be implemented as follows: skip_code_flag length is 1 bit, being that 1 presentation code mode is a Run-Length Coding, is that 0 coded system is skip macroblock number and macro block (mb) type combined coding.
Encoded after the macro block (mb) type, just related to the coding of macro block its data, promptly data such as encoding motion vector and residual error write data in the code stream then, finish the coding of current macro; Successively all macro blocks of present image are encoded, finish the coding of present image; The interframe encode video image that adopts aforesaid way to encode all.
As shown in Figure 2, decoding end is at first read in skip macroblock coding sign skip_code_flag from the image head pb_picture_header of code stream, judges the value of skip_code_flag, if be 1, then is Run-Length Coding, if be 0, then is combined coding; Adopt corresponding mode, finish decoding macro block.
According to above description, step 2 of the present invention can adopt two kinds of methods to the selection of macro block (mb) type coded system in the present image, and a kind of is to adopt twice encoding ratio than coding efficiency, decides according to qualifications; Another kind is what of skip macroblock of estimating image to be encoded by statistical, decides with this and adopts which kind of coded system.
Shown in Figure 3 is a part that comprises the interframe coding/decoding video image of skip macroblock, as the example that describes technical solution of the present invention in detail.
The skip macroblock coding mode that is single-frame images is as shown in Figure 4 selected optimum scheme by twice cataloged procedure, and step is as follows:
Step 200, all macro blocks of current encoded image are adopted Run-Length Coding modes, the back that disposes obtains the corresponding codes performance parameter;
Step 201, current encoded image is carried out secondary coding, its all macro blocks adopt the coded system of skip macroblock numbers and macro block (mb) type associating, the back acquisition corresponding codes that disposes performance parameter;
Step 202, the performance parameter that comprehensively relatively twice coding obtained are chosen the skip macroblock coding mode of present image optimum.
The performance parameter that compares comprises encoding rate and signal to noise ratio, described encoding rate refers to the efficient of encoding, i.e. Ya Suo ratio, distortion situation after described signal to noise ratio finger pressure contracts. select which parameter will to decide according to the requirement of coding as the foundation of judging, if the compression ratio requirement to image is high and less demanding to the distortion situation of image, can select the high coded system of same signal to noise ratio encoding rate; If the distortion situation to image requires high, and compression ratio is not had too high requirement, then select the little coded system of same compression ratio distortion. promptly little to the signal to noise ratio influence because the coding of skip macroblock is less to the quality influence of coded image, this moment, coded system mainly was the code check of influence coding.
Respectively two kinds of coded systems are introduced below:
The Run-Length Coding mode is for continuous skip macroblock, with variable length code (Variable-lengthcoding, VLC) number of encoding and skipping; Identify and must add " 0 " value of volume between the continuous non-skip macroblock, expression does not have skip macroblock.Like this, the non-skip macroblock of each in the code stream is all pressed structured coding shown in the table 1.At each macro block head elder generation coding skip macroblock counter value (skipped macroblockcounter), the macro block (mb) type mb_type (macroblocktype) of the next non-skip macroblock of encoding then.This kind mode is to the not influence of original coding of macro block (mb) type.The skip macroblock number then adopts variable length code (for example Exp-Golomb) coded system.
Table 1, skip macroblock Run-Length Coding mode
skipped macroblock counter | mb_type |
For example, be the macro block (mb) type of image to be encoded as shown in Figure 3, each little lattice is represented a macro block, what color was darker is skip macroblock.Adopt the Run-Length Coding processing mode: (mb
xRepresent x macroblock encoding data), the result is:
(0,mb
0)(1,mb
2)(0,mb
3)(4,mb
8)(0,mb
9)(0,mb
10)(0,mb
11)(1,mb
13)(0,mb
14)(2,mb
17)
Skip macroblock number and macro block (mb) type combined coding mode are handled as follows to the P image: if the P image, then in macro block (mb) type, increase a kind of type (skip mode) of skipping, determine its position in the macro block (mb) type table according to its average probability of occurrence, whole macro block (mb) type table will be adjusted thereupon.The probability that the skip macroblock type occurs can be added up by the image to a certain type in advance according to the difference of image and different, judges the probability that may occur, thus the position of decision skip macroblock type in the macro block (mb) type table.Generally for B image and P image, the probability that the skip macroblock type occurs is higher, and can set its mb_type is 0.
For example, table 2 is depicted as original P image macro type list (is example with AVS 1.0 video standards):
Macro block (mb) type in table 2, the P image:
mb_type | name of mb_type | num_mb_part | mb_part_pred_mode |
0 | |
1 | |
1 | |
2 | |
2 | |
2 | |
3 | |
4 | na |
4 | |
4 | na |
5 | I_8x8 | Intra_8x8 | na |
Table 3 is depicted as the P image macro type list .P_Skip pattern that increases the P_Skip pattern and is inserted into first of table, original other pushers successively. and macro block (mb) type adopts the Exp_Golomb coded system.
Macro block (mb) type in table 3, the adding P_Skip pattern P image
mb_type | name of mb_type | num_mb_part | mb- |
0 | |
1 | na |
1 | |
1 | |
2 | |
2 | |
3 | |
2 | |
4 | |
4 | na |
5 | |
4 | na |
6 | I_8x8 | Intra_8x8 | na |
For continuous skip macroblock, skip counter value according to it and use and to skip the type sign one by one of encoding one by one.For non-skip macroblock, use its corresponding macro block (mb) type coding to identify.Just can know by macro block (mb) type like this and distinguish skip macroblock and non-skip macroblock.
Adopt the combined coding mode that image shown in Figure 3 is encoded, the result is: (mb
xRepresent x macroblock coding data cell, TYPE-mb
xThe type of representing x macro block) (TYPE-mb
0, mb
0) (0) (TYPE-mb
2, mb
2) (TYPE-mb
3, mb
3) (0) (0) (0) (0) (TYPE-mb
8, mb
8) (TYPE-mb
9, mb
9) (TYPE-mb
10, mb
10) (TYPE-mb
11, mb
11) (0) (TYPE-mb1
3, mb
13) (TYPE-mb
14, mb
14) (0) (0) (TYPE-mb
17, mb
17).
The skip macroblock number can adopt dual mode with macro block (mb) type combined coding mode to the B image processing: the one, adopt the processing mode identical with the P image, and join in original macro block (mb) type table, repeat no more here; The 2nd, to original B image directly (Direct) pattern (B_Direct16x16mode) coding adjust and reach effect same.
Consider that B image macro type is more, it is bigger to non-skip macroblock coding influence to change original macro block (mb) type table.Here Direct and Skipped macro block (mb) type are used original B image Direct pattern identification, and further distinguish them by coding CBP.The Direct pattern does not need encoding motion vector information, and its motion vector is derived, and this point is identical with the Skip pattern, but it can have residual error data.The Skip pattern can be regarded the special circumstances of Direct pattern as, and promptly residual error data is 0 Direct pattern entirely.Which 8 * 8 block encoding stencil value (Coded Block Pattern is called for short CBP) identify there is residual error data, if the current macro residual error data all is 0, its CBP also just is 0.
Its coded system of each skip macroblock is that to be right after CBP be that 0 encoded radio was not (because skip macroblock just had residual error data originally to Direct pattern-coding value, CBP should be 0), and its coded system of Direct macro block is the encoded radio that Direct pattern-coding value is right after CBP non-0, and other non-skip macroblocks get final product by its corresponding macro block (mb) type coding.So just can under the assistance of CBP, distinguish Direct and two kinds of coding modes of Skip, not revise original macro block (mb) type table simultaneously, therefore to the not influence of other macro-block coding patterns.Concrete coding is as shown in table 4:
Table 4Direct+CBP mode
Direct pattern-coding value | The encoded radio of CBP |
During decoding processing, by the macro block (mb) type that reads in, if the Direct pattern need be read in CBP numerical value thereafter.If CBP is that 0 current macro is a skip macroblock, data thereafter are next macro block; If be not 0, then current macro is real Direct macro block, and data thereafter are residual error data of current block.
Because twice coding selects best skip macroblock coding mode speed slower, also can adopt a kind of adaptive pattern to select coded system fast.
As shown in Figure 5, each coding is all added up the ratio R of present frame skip macroblock
SkipBefore the coding next frame,,, can predict the skip macroblock ratio of next frame according to the content relevance of video sequence with reference to the statistical information of former frame.If greater than empirical value Threshold, next frame skip macroblock number also can be more, adopts the Run-Length Coding mode this moment; If less than empirical value Threshold, the skip macroblock number is less, adopts the combined coding mode of skip macroblock number and macro block (mb) type.
The selection of threshold value is relevant with quantization parameter (QP), and different QP values adopts different threshold values.Quantization parameter (QP) can roughly be controlled the quality of coded image, and quantization parameter is big more, picture quality variation then, and code check reduces, and compression ratio improves, and the ratio that this moment, skip macroblock occurred increases.
Because the number of macroblocks difference (many as the high-definition image number of macroblocks) that comprises of different images, the altering a great deal of threshold value is generally between 35-55%; In order to obtain best code efficiency, also can adopt mode by statistics, the effect of two kinds of coded systems of contrast, threshold value of the present invention obtains according to the result of statistics.Because in most cases, more for the resource that coding is available, application demand at reality is selected the several representative code stream in advance, according to foregoing twice Methods for Coding, add up the distribution characteristics of typical code stream skip macroblock under this kind application demand, thereby obtain to be fit to the best empirical value of current application.Can also by software when beginning coding earlier by the mode of the twice coding multiframe inter coded images of encoding, add up corresponding skip macroblock distribution characteristics simultaneously, thereby obtain the empirical value of current sequence, after this coding of sequence all carries out according to the mode that quick mode is selected.
For example: when adopting the adaptive fast short-cut counting method, when QP is 37, for high definition sequence (1280 * 720), each image has 3600 macro blocks, if the macro block sum that the former frame image is skipped is greater than 1440, the skip macroblock coding of present frame then adopts the Run-Length Coding mode; Otherwise, adopt the combined coding mode.For CIF sequence (352 * 288), each image has 396 macro blocks, if former frame skip macroblock number greater than 198, adopts the Run-Length Coding mode, otherwise adopts the combined coding mode.
Employing does not increase space complexity based on the self-adaptive encoding method of statistics, the newly-increased amount of calculation of time complexity aspect institute is also very little, and because the relativity of time domain of image makes this estimation under most situation, the effect of can well being encoded.
By to the technical solution of the present invention analysis as can be known, this method is changed very little to traditional coding and decoding video flow process, no matter be that frame encoding and decoding or an encoding and decoding can both effectively be adopted, can embed traditional frame field encoding and decoding flow process easily.
It should be noted that at last: above embodiment is only in order to technical scheme of the present invention to be described but not limit it, although the present invention is had been described in detail with reference to preferred embodiment, those of ordinary skill in the art is to be understood that: it still can make amendment or be equal to replacement technical scheme of the present invention, and these modifications or be equal to replacement and also can not make amended technical scheme break away from the spirit and scope of technical solution of the present invention.
Claims (2)
1. the coding/decoding method of a video image to skip macro block comprises the steps:
Step 1, from the image head of code stream, read in the skip macroblock coding sign, and judge the value of skip macroblock coding sign, if be 1 then be Run-Length Coding, if be 0 then be skip macroblock number and macro block (mb) type combined coding;
Step 2, select the macro block (mb) type decoding process according to type of coding, if be Run-Length Coding, then execution in step 3; If type of coding is skip macroblock number and macro block (mb) type combined coding, then execution in step 4;
Step 3, employing runs decoding mode, the macro block (mb) type of decoding present image current macro, execution in step 5;
Step 4, the decoding process that adopts skip macroblock number and macro block (mb) type to unite, the macro block (mb) type of decoding present image current macro, and execution in step 5;
Step 5, according to the macro block (mb) type of correspondence, the macro block of present image is carried out the decoding of macro block its data;
Step 6, judge that whether current macro is last coded macroblocks of present image, is then to finish, otherwise re-executes step 1.
2. the skip macroblock coding/decoding method of video image according to claim 1, it is characterized in that: described skip macroblock coding/decoding method had both gone for frame decoding, also went for a decoding.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200710097499 CN101056409B (en) | 2003-12-31 | 2003-12-31 | A decoding method for video image to skip the macro block |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200710097499 CN101056409B (en) | 2003-12-31 | 2003-12-31 | A decoding method for video image to skip the macro block |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CNB2003101160885A Division CN1332563C (en) | 2003-12-31 | 2003-12-31 | Coding method of video frequency image jump over macro block |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101056409A CN101056409A (en) | 2007-10-17 |
CN101056409B true CN101056409B (en) | 2010-05-12 |
Family
ID=38795977
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 200710097499 Expired - Fee Related CN101056409B (en) | 2003-12-31 | 2003-12-31 | A decoding method for video image to skip the macro block |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101056409B (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101742284B (en) * | 2008-11-24 | 2011-08-03 | 深圳市融创天下科技发展有限公司 | Method and system for playing and processing H.264 video stream |
CN102447902B (en) * | 2011-09-30 | 2014-04-16 | 广州柯维新数码科技有限公司 | Method for selecting reference field and acquiring time-domain motion vector |
CN107483946B (en) * | 2011-11-08 | 2021-01-12 | 株式会社Kt | Method for decoding video signal by using decoding device |
CN103533325B (en) * | 2012-07-06 | 2017-07-07 | 乐金电子(中国)研究开发中心有限公司 | A kind of depth image frame in decoding method, device and codec |
CN111093079A (en) * | 2019-12-30 | 2020-05-01 | 西安万像电子科技有限公司 | Image processing method and device |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5552832A (en) * | 1994-10-26 | 1996-09-03 | Intel Corporation | Run-length encoding sequence for video signals |
US6031937A (en) * | 1994-05-19 | 2000-02-29 | Next Software, Inc. | Method and apparatus for video compression using block and wavelet techniques |
US6192148B1 (en) * | 1998-11-05 | 2001-02-20 | Winbond Electronics Corp. | Method for determining to skip macroblocks in encoding video |
-
2003
- 2003-12-31 CN CN 200710097499 patent/CN101056409B/en not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6031937A (en) * | 1994-05-19 | 2000-02-29 | Next Software, Inc. | Method and apparatus for video compression using block and wavelet techniques |
US5552832A (en) * | 1994-10-26 | 1996-09-03 | Intel Corporation | Run-length encoding sequence for video signals |
US6192148B1 (en) * | 1998-11-05 | 2001-02-20 | Winbond Electronics Corp. | Method for determining to skip macroblocks in encoding video |
Also Published As
Publication number | Publication date |
---|---|
CN101056409A (en) | 2007-10-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN1332563C (en) | Coding method of video frequency image jump over macro block | |
KR100701810B1 (en) | Signal encoding method, signal decoding method, signal encoding device, signal decoding device, computer-readable recording medium | |
CN100488254C (en) | Entropy coding method and decoding method based on text | |
CN101411196B (en) | Method and system for coding and decoding information associated with video compression | |
RU2502218C2 (en) | Video coding with large macroblocks | |
CN102017615B (en) | Boundary artifact correction within video units | |
CN103891293B (en) | Method and apparatus for the adaptive loop filter of chromatic component | |
CN101267563B (en) | Adaptive variable-length coding | |
CN100581252C (en) | Method for improving entropy coding | |
US20060017592A1 (en) | Method of context adaptive binary arithmetic coding and apparatus using the same | |
CN101198051B (en) | Method and device for implementing entropy decoder based on H.264 | |
CN101584218B (en) | Method and apparatus for encoding and decoding based on intra prediction | |
CN101946516A (en) | The decision of macro block increment quantization parameter fast | |
CN102835107A (en) | Super-block for high performance video coding | |
CN103238322A (en) | Separately coding the position of a last significant coefficient of a video block in video coding | |
CN109964482A (en) | The instruction that two-sided filter in video coding uses | |
CN101946515A (en) | Two pass quantization for cabac coders | |
CN101247522A (en) | Bit rate reduction method by requantization | |
CN101663895B (en) | Video coding mode selection using estimated coding costs | |
JP2003324731A (en) | Encoder, decoder, image processing apparatus, method and program for them | |
CN110291789A (en) | Method and apparatus for selecting the coding mode for encoding/decoding to residual block | |
CN101282480A (en) | Advance macro-block entropy coding for advanced video standards | |
CN103067699A (en) | Intra-frame prediction mode encoder, decoder and method and electronic device thereof | |
JP2004128749A (en) | Moving image coding method and decoding method | |
JP2004527981A (en) | Intra coding of video data block by selecting prediction type |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100512 Termination date: 20201231 |