CN1740891A - Method for changing one high dynamic-range image into a lower dynamic range image and apparatus thereof - Google Patents
Method for changing one high dynamic-range image into a lower dynamic range image and apparatus thereof Download PDFInfo
- Publication number
- CN1740891A CN1740891A CN200410064255.0A CN200410064255A CN1740891A CN 1740891 A CN1740891 A CN 1740891A CN 200410064255 A CN200410064255 A CN 200410064255A CN 1740891 A CN1740891 A CN 1740891A
- Authority
- CN
- China
- Prior art keywords
- image
- brightness
- brightness values
- image processing
- pixels
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Image Processing (AREA)
Abstract
The invented method includes the following steps: a) converting several first brightness values correspondent to several pixels into several second brightness values; and b) using a film conversion function to make these second brightness values correspondent to these pixels be antipodal to several third brightness values so as to produce said low-dynamic range image.
Description
Technical field
The invention provides a kind of image treatment method and relevant apparatus, refer to a kind of method and device thereof that is used for a high dynamic-range image is converted to a lower dynamic range image especially.
Background technology
The dynamic range of a scenery (scene) is defined as the ratio between the highest scenery brightness and the minimum scenery brightness.In general, the dynamic range of a standard display device (as CRT monitor or LCD display) is approximately 250: 1, and this has approximately contained whole visible color scope half.Yet (humanvision system HVS) has one greater than 10,000: 1 dynamic range to human vision system usually, and under a specific brightness, can distinguish about 10,000 kinds of different colors.In addition, (computer-generated image CGI) then has between high and minimum intensity level (intensityvalue) usually and approximates 3000 times proportionate relationship for image that is produced by computer.
Usually, can correspond to 256 different GTG values (graylevel) at the shown image that goes out of standard display device.That is (R, G B) are all determined by 8 bits each color channel.Therefore, minimum GTG value is 0, and maximum GTG value then is 255.From the above, the dynamic range of the scenery dynamic range that display device can show that all is above standard usually in real world.
It is " high dynamic-range image " (being designated hereinafter simply as the HDR image) that a image with high dynamic range can be called usually.In the present science and technology, do not have any simple and direct method and can be used for catching (capture) and depicting (render) high dynamic-range image.And a kind of comparatively complicated technology is arranged, can be used to catch the HDR image, yet, but must carry out multiple-exposure (multipleexposure) to same scenery.The result can draw many different images (different image systems use different conditions of exposures to draw) for identical scenery.Therefore, different exposure draws different images different brightness data can be provided.Next, different images can be by an algorithm of known technology, and combination draws the real radiation levels (radiance level) of scenery that desire is caught, and catches the HDR image that scenery corresponded to so can draw desire.
After correctly noting the HDR image, next procedure will store image exactly.Common now various digitized video forms are mostly all applicable on traditional display device.As mentioned before, generally speaking be to use 8 bits to store each color channel (color channel) of image, correctly to drive the standard display device.Conspicuous, the dynamic range of known image format is not sufficient to use on the HDR image data.Therefore, also there are several File Formats to be developed successively, to solve the above problems.Strengthen the dynamic range of digitized video, a method the simplest is exactly the bit number that increases each color channel, and the LogLuv coding techniques is exactly one of them example, has all used 4 bytes to represent to each pixel.Have 2 bytes to be used for the logarithm value (logarithm) of brightness Y is encoded, other 2 bytes then are used for U passage and V passage on the LUV color space (color space) are encoded.
After correctly producing the HDR image, also must use a tone mapping program (tone mappingprocedure), to utilize the HDR image of gained, the scenery that captures is made again be shown on the standard display device.In other words, tone mapping program can convert the brightness value that is write down in the HDR image to have than low-dynamic range brightness value, has standard display device than low-dynamic range with driving.Therefore, the fundamental purpose of above-mentioned tone mapping program is the dynamic range that bigger dynamic range compression will be become be fit to the standard display device.As everyone knows, a tone again the koji line (tone reproduction curve, TRC) or a tone make operator again (tone reproduction operator TRO) all can be applicable on the image data in the HDR image.With tone again the koji line be example, each pixel all can be transformed into one in the dynamic range of standard display device from its present brightness value and show intensity.The koji line is corresponding to a transfer function that has nothing to do with space distribution again for above-mentioned tone, and each pixel in the HDR image all uses identical transfer function to handle.Make operator again as for tone, the relation (spatialcontext) that then can use the space is adjusted the brightness of each pixel.That is two pixels with same brightness value may correspond to different demonstration intensity in the dynamic range of standard display device, and two pixels with different brightness values also may correspond to identical demonstration intensity in the dynamic range of standard display device.
The technology of tone mapping can also be used for adjusting the display quality of the HDR image that captures.For instance, the reaction that the tone mapping program of known technology can the simulating human eyes.Note that the HDR image is to make up by obtain different images under different exposure to draw, that is the HDR image of transmission does not include the product under any human vision effect (visual artifact) originally.Yet, but all kinds of abrim visual effect in the human vision system, for example effect (blur) of bluring under dazzling effect (glare) under high brightness or the low-light level.Therefore, the tone mapping program of known technology can add the visual effect in the mankind's the vision system among the LDR image after receiving the HDR image.When though last LDR image is shown in the standard display device, can correspond to the situation that the observer sees the scenery that is captured, owing to added visual effect, so the quality of image still can reduce.In addition, this practice must cooperate complicated instant computing, desired visual effect is added among the LDR image, and complex calculation consuming time like this, last then can cause bad image processing efficient.
Summary of the invention
One object of the present invention is to provide a kind of method and a kind of device, is used for converting a high dynamic-range image to a corresponding lower dynamic range image.
According to a following embodiment who proposes, disclosed method is to be used for converting a high dynamic-range image to a lower dynamic range image.This high dynamic-range image has a plurality of pixels, these pixels correspond to a plurality of first brightness values respectively, this method includes following steps: (a) convert these first brightness values that these pixels corresponded to a plurality of second brightness values, second brightness range system of these second brightness values is less than first brightness range of these first brightness values; And (b) use a film transfer function, so that a plurality of the 3rd brightness values are arrived in these second brightness value mappings that these pixels were corresponded to, to produce this lower dynamic range image, wherein this film transfer function does not add visual effect among this lower dynamic range image.
According to following another embodiment that proposes, a disclosed image processing system includes: an image generator, be used for producing a high dynamic-range image, this high dynamic-range image has a plurality of pixels, and these pixels correspond respectively to a plurality of first brightness values; An and image processing logic, these first brightness values that are used for these pixels are corresponded to convert a plurality of second brightness values to, and use a film transfer function, with with these second brightness value mappings that these pixels were corresponded to a plurality of the 3rd brightness values, and under the situation that does not add visual effect, produce a lower dynamic range image; Wherein second brightness range of these second brightness values is less than first brightness range of these first brightness values.
Because the present invention has used film conversion S curve, final LDR image is an image comparatively true to nature, and does not include other visual effect, and the LDR image that finally is shown in the standard display device can be more clear.By using film conversion S curve, have brightness value and can obtain preferable image contrast, and that how trickle variation can become is clearer in the pixel of intermediate luminance scope.And film conversion S curve can pre-define, and need dynamically not calculate in the tone handling procedure.Therefore, on the implementation, tone mapping program proposed by the invention can be simple in the extreme, and image processing usefulness can become better.
Description of drawings
Fig. 1 is an embodiment process flow diagram of tone mapping program of the present invention.
Fig. 2 is the synoptic diagram of overall gradient condensing routine used in the present invention.
Fig. 3 is an example of S curve of the present invention.
Fig. 4 is an embodiment synoptic diagram of image processing system of the present invention.
Embodiment
See also Fig. 1, Fig. 1 is the embodiment process flow diagram of tone mapping program of the present invention (tone mapping process).Each step that below will describe in detail among Fig. 1 to be comprised.At first, prior to being written into a HDR image in the step 100.The HDR image that is written into is generated the dynamic range of the dynamic range overgauge display device that it corresponded to as mentioned before by a plurality of images that draw under different exposure.Therefore, the HDR image of input dynamic range originally must be compressed into the low-dynamic range that is applicable to the standard display device.In addition, human vision system is for absolute brightness (absolute luminance) and insensitive, relatively but changing (local luminance change) for the brightness of part has bigger reaction, and can reduce the effect that bigger overall brightness difference (global illumination difference) is produced.Therefore, in step 102, carried out overall gradient compression (global gradient compression) program, to compress dynamic range originally and to reduce overall brightness difference.In order to reduce computing the time and the complexity on implementing, can use the operator (spatia11y invariant operator) of a space invariance at this, shown in following equation:
L at denominator
w(x, y) be representative in the HDR image pixel (x, original brightness y) (worldluminance or raw luminance) is as for L
d(x, y) then represent pixel (x, brightness behind convergent-divergent y) (scaledluminance).See also Fig. 2, Fig. 2 is the synoptic diagram of overall gradient condensing routine used in the present invention.As shown in Figure 2, L
d(x y) has represented a regular GTG value (normalized graylevel) that is applicable to the standard display device, that is, L
d(x y) can be between 0 and 1.Clearly, L
w(x y) can correspond to a higher brightness value (by L
w(x, y) itself is regular) is as for L
w(x y) then can correspond to a lower brightness value (by ' 1 ' normalization).Denominator in the equation (1) then can allow normalized mode circle between the two above-mentioned, and equation (1) can guarantee that all original brightness values all can be converted within the acceptable dynamic range.For instance, original brightness value can be compressed into the display brightness value that is applicable to a particular display device.
Then, step 104 can be carried out change (histogram equalization) programs such as an exposure analysis chart again, to improve the image contrast of adjusting in the back image normalization brightness value (contrast).Change meetings such as exposure analysis chart herein are transformed into an exposure analysis chart (uniformhistogram) uniformly with the exposure analysis chart of adjusting the back image.Suppose need use cumulative frequency distribution (cumulativefrequency distribution) P (b) when an exposure analysis chart such as grade, it defines shown in following equation:
Equation (2)
Wherein, the sum of field (entry) in the T representative exposure analysis chart.Therefore, P (b
i) be in b in the exposure analysis chart
iThe frequency distribution of map grid (bin), f (bi) then in the exposure analysis chart in b
iThe total number of frequencies (frequency count) of map grid (bin).Change programs such as this exposure analysis chart are applied on the input image, can produce an image output, its brightness value (brightness value) has equal probability distribution (probability).Can be as shown below as for the equation of usefulness such as gradeization:
B
d=log (L
Dmin)+[log (L
Dmax)-log (L
Dmin)] * P (B) equation (3)
Wherein, B
dRepresent adjusted display brightness, the image brilliance that the B representative is original.Log (L
Dmin) be the minimum luminance value of standard display device, log (L
Dmax) then be the maximum brightness value of standard display device.The brightness value of pixel is redistributed (re-distributing) afterwards in to the input image, and image output can have preferable image contrast, so can more clearly show.
Yet, if there is the pixel of half to have the 0.2*L of being lower than
DmaxBrightness value the time, that is a less brightness range [0,0.2*L
Dmax] will use in the standard display device display brightness value half scope.Therefore, the image contrast that might adjust the back image can exceedingly be strengthened (overemphasize).Give an example, suppose that two adjusted pixels have a less luminance difference in the original image.Through after the above-mentioned change programs such as exposure analysis chart, luminance difference can be exaggerated.This can cause an image factitious phenomenon to occur, so that display quality can become is lower.Therefore, in step 106, used an exposure analysis chart to adjust program, prevented that image contrast is amplified singularly in the last image.Aforesaid exposure analysis chart is adjusted program and can be come image contrast is limited by using a maximum limit condition (ceiling condition).With embodiment of next proposition, the maximum limit condition can be shown in following equation:
Equation (4) has represented cannot to surpass use one known linear regular operator by image contrast, and (linearscaling operation, its slope equals L
d/ the image contrast that L) drawn.By aforesaid equation (2), can derive following inequality:
Wherein, Δ b is [log (L
Max)-log (L
Min)]/N, N is the quantity of map grid in the exposure analysis chart, log (L
Max) be the high-high brightness of raw video, log (L
Min) then be the minimum brightness of raw video.Therefore, symbol Δ b can be corresponding to the size of each map grid.Shown in equation (5), certainly, as long as do not have the total number of frequencies of map grid greater than the upper limit (that is L in the exposure analysis chart
d/ L), the exposure analysis chart of then adjusting the back image is magnified image contrast unusually not just.The map grid that just can not include thus, too intensive (overpopulated) exposure analysis chart in the image of being exported.
After the execution of step 106, in step 108 use one a film conversion S curve (film transferS-curve), start a mapping computing (mapping operation), last LDR image then can produce in step 110.See also Fig. 3, Fig. 3 is an example of S curve of the present invention.The transverse axis of Fig. 3 represents to import brightness, and the longitudinal axis then represents to export brightness.Film conversion S curve 10 in this example is a photoresponse (sensitization response) curve corresponding to a photograph film (photographic film).As shown in Figure 3, the input brightness value that is positioned at intermediate range (10-1000) has approximately just accounted for the gamut of output brightness value.In other words, film conversion S curve 10 can strengthen the image contrast of image in the intermediate range brightness region.Therefore, corresponding to the higher brightness district with will constrain significantly than the image contrast in low-light level district.So the vision quality of last LDR image can significantly promote.
Tone mapping program proposed by the invention also can be used in the image processing system, is used for a HDR video conversion is become a LDR image.See also Fig. 4, Fig. 4 is an embodiment synoptic diagram of image processing system of the present invention.Image processing system 20 in the present embodiment includes an image generator 22 and an image processing logic 24.Image generator 22 can produce a high dynamic-range image, can carry out a tone mapping program as for 24 of image processing logics, the HDR image is transformed into corresponding LDR image.For instance, image processing system 20 can be a digital camera, and 22 of image generators include a CCD module, be used for catching incident light, producing corresponding image, and a camera shutter (camerashutter), be used for controlling the exposure status of CCD module.Therefore, image generator 22 can be caught a scenery by the CCD module, and can control camera shutter by suitable, and produces the image of a plurality of different exposure situations.Next, image generator 22 can make in a known manner, the image that draws is combined into corresponds to the HDR image that desire is caught scenery.
Afterwards, restart image processing logic 24 so that the HDR image is handled.Image processing logic 24 in the present embodiment can be carried out above-mentioned step 102,104,106,108, to produce required LDR image.Because image processing logic 24 can be that (digital signalprocessor DSP), uses a simple film transfer function to a Digital System Processor, so relevant calculating can't too complex.Generally speaking, digital camera has a small-sized LCD display screen mostly, is used for the scenery that preview captures.And because image processing logic 24 is used simple film transfer function, Gu Qihui has good image processing usefulness, and the user is preview LDR image on the LCD display screen soon.In addition, the LDR image that is produced also can have preferable image quality (not being added among the LDR image because have any visual effect).
As in a further embodiment, image generator 22 can only be used for catching a scenery to produce a plurality of images down in different conditions of exposures.Then, be responsible for producing the HDR image by image processing logic 24 again.Similar, image processing logic 24 can also be carried out the step 102,104,106,108 that preamble is mentioned, to produce final LDR image.
As mentioned before, image processing system 20 can be a digital camera, so image generator 22 is with among image processing logic 24 all is arranged at identical housing.Yet image processing system 20 can also be made of a plurality of independent device.For instance, image generator 22 itself promptly can be a digital camera, can be a host computer as for 24 of image processing logics.Under this kind framework, the image data that is produced output by image generator 22 can be transferred into outside image processing logic 24, to carry out follow-up image processing program.
As mentioned before, in the practice of known technology, visual effect can be added among the final LDR image, so that emphasize the correctness (visual accuracy) of vision.Yet owing to added visual effect, it is relatively poor that the image quality of LDR image can become.In addition, add human visual system's visual effect, can need to use a large amount of images consuming time and make work again, for example add dazzling effect in the higher brightness part, and add fuzzy effect in the low-light level part, this all can reduce the usefulness of image processing.Compared to known technology, the present invention adopts film conversion S curve.Final LDR image is an image comparatively true to nature, and does not include other visual effect, and finally be shown in the LDR image of standard display device can be more clear.By using film conversion S curve, have brightness value and can obtain preferable image contrast, and that how trickle variation can become is clearer in the pixel of intermediate luminance scope.And film conversion S curve can pre-define, and need dynamically not calculate in the tone handling procedure.Therefore, on the implementation, tone mapping program proposed by the invention can be simple in the extreme, and image processing usefulness can become better.
The above only is preferred embodiment of the present invention, and all equalizations of being done according to the present patent application claim change and modify, and all should belong to the covering scope of patent of the present invention.
Claims (10)
1. a method is used for converting a high dynamic-range image to a lower dynamic range image, and this high dynamic-range image has a plurality of pixels, and these pixels correspond to a plurality of first brightness values respectively, and this method includes following steps:
(a) convert these first brightness values that these pixels corresponded to a plurality of second brightness values, second brightness range system of these second brightness values is less than first brightness range of these first brightness values; And
(b) use a film transfer function, so that a plurality of the 3rd brightness values are arrived in these second brightness value mappings that these pixels were corresponded to, to produce this lower dynamic range image, wherein this film transfer function does not add visual effect among this lower dynamic range image.
2. the method for claim 1 is characterized in that, also includes:
(c) carry out change program such as an exposure analysis chart, to adjust these second brightness values of these pixels.
3. method as claimed in claim 2 is characterized in that, step (c) includes in addition:
A total quantity of presetted pixel that prevents to correspond to second brightness value is greater than a pre-set limit.
4. the method for claim 1 is characterized in that, step (a) is performed by an overall gradient condensing routine.
5. image processing system includes:
One image generator is used for producing a high dynamic-range image, and this high dynamic-range image has a plurality of pixels, and these pixel systems correspond respectively to a plurality of first brightness values; And
One image processing logic, these first brightness values that are used for these pixels are corresponded to convert a plurality of second brightness values to, and use a film transfer function, with with these second brightness value mappings that these pixels were corresponded to a plurality of the 3rd brightness values, and under the situation that does not add visual effect, produce a lower dynamic range image;
Wherein second brightness range of these second brightness values is less than first brightness range of these first brightness values.
6. image processing system as claimed in claim 5 is characterized in that, is a digital camera.
7. image processing system as claimed in claim 5 is characterized in that, this image generator can be caught a plurality of images under different exposure situations, to produce this high dynamic-range image.
8. image processing system as claimed in claim 5 is characterized in that, this image processing logic can be carried out change programs such as an exposure analysis chart, to adjust these second brightness values of these pixels.
9. image processing system as claimed in claim 8 is characterized in that, this image processing logic can prevent to correspond to the total quantity of presetted pixel of second brightness value greater than a pre-set limit.
10. image processing system as claimed in claim 5 is characterized in that, this image processing logic can be carried out an overall gradient condensing routine, to convert these first brightness values to these second brightness value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200410064255.0A CN100492152C (en) | 2004-08-23 | 2004-08-23 | Method for changing one high dynamic-range image into a lower dynamic range image and apparatus thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200410064255.0A CN100492152C (en) | 2004-08-23 | 2004-08-23 | Method for changing one high dynamic-range image into a lower dynamic range image and apparatus thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1740891A true CN1740891A (en) | 2006-03-01 |
| CN100492152C CN100492152C (en) | 2009-05-27 |
Family
ID=36093318
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200410064255.0A Expired - Fee Related CN100492152C (en) | 2004-08-23 | 2004-08-23 | Method for changing one high dynamic-range image into a lower dynamic range image and apparatus thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100492152C (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101707666A (en) * | 2009-11-26 | 2010-05-12 | 北京中星微电子有限公司 | Adjusting method and device with high dynamic range |
| CN102422322A (en) * | 2009-05-11 | 2012-04-18 | 杜比实验室特许公司 | Light detection, color appearance models, and modifying dynamic range for image display |
| CN103597812A (en) * | 2011-06-14 | 2014-02-19 | 皇家飞利浦有限公司 | Graphics processing for high dynamic range video |
| CN104618659A (en) * | 2007-07-25 | 2015-05-13 | 坎德拉微***(S)私人有限公司 | Exposure control for an imaging system |
| CN108141623A (en) * | 2015-10-07 | 2018-06-08 | 松下知识产权经营株式会社 | Image sending method, image method of reseptance, image sending device and video receiver |
-
2004
- 2004-08-23 CN CN200410064255.0A patent/CN100492152C/en not_active Expired - Fee Related
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104618659A (en) * | 2007-07-25 | 2015-05-13 | 坎德拉微***(S)私人有限公司 | Exposure control for an imaging system |
| CN102422322A (en) * | 2009-05-11 | 2012-04-18 | 杜比实验室特许公司 | Light detection, color appearance models, and modifying dynamic range for image display |
| CN102422322B (en) * | 2009-05-11 | 2015-01-21 | 杜比实验室特许公司 | Light detection, color appearance models, and modifying dynamic range for image display |
| CN101707666A (en) * | 2009-11-26 | 2010-05-12 | 北京中星微电子有限公司 | Adjusting method and device with high dynamic range |
| CN103597812A (en) * | 2011-06-14 | 2014-02-19 | 皇家飞利浦有限公司 | Graphics processing for high dynamic range video |
| CN108141623A (en) * | 2015-10-07 | 2018-06-08 | 松下知识产权经营株式会社 | Image sending method, image method of reseptance, image sending device and video receiver |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100492152C (en) | 2009-05-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20050117799A1 (en) | Method and apparatus for transforming a high dynamic range image into a low dynamic range image | |
| DE102016115292B4 (en) | Method and device for automatic exposure value acquisition for high dynamic range imaging | |
| JP4083587B2 (en) | Image quality improving method and apparatus therefor | |
| EP0723364B1 (en) | Real-time image enhancement techniques | |
| CN1093669C (en) | A histogram equalization apparatus for contrast enhancement of moving image and method therefor | |
| US7646931B2 (en) | Automatic analysis and adjustment of digital images with exposure problems | |
| US20090317017A1 (en) | Image characteristic oriented tone mapping for high dynamic range images | |
| CN111491148A (en) | Display method | |
| CN111885312B (en) | HDR image imaging method, system, electronic device and storage medium | |
| CN111612722B (en) | Low-illumination image processing method based on simplified Unet full-convolution neural network | |
| US20060092474A1 (en) | System and method for image processing | |
| CN113191995B (en) | Video image automatic exposure correction method based on deep learning | |
| CN113518185A (en) | Video conversion processing method and device, computer readable medium and electronic equipment | |
| WO2021213336A1 (en) | Image quality enhancement device and related method | |
| US20070086650A1 (en) | Method and Device for Color Saturation and Sharpness Enhancement | |
| CN1249988C (en) | Self adaptive contrast enhancing method of using time varying non linear alteration to video frequency signal | |
| Yu et al. | Adaptive inverse hyperbolic tangent algorithm for dynamic contrast adjustment in displaying scenes | |
| CN100492152C (en) | Method for changing one high dynamic-range image into a lower dynamic range image and apparatus thereof | |
| US10922796B2 (en) | Method of presenting wide dynamic range images and a system employing same | |
| CN105516674B (en) | A kind of supervision equipment with HDR display functions | |
| Zhang et al. | Multi-scale-based joint super-resolution and inverse tone-mapping with data synthesis for UHD HDR video | |
| Johnson | Cares and concerns of CIE TC8-08: spatial appearance modeling and HDR rendering | |
| Dietz et al. | TIK: a time domain continuous imaging testbed using conventional still images and video | |
| CN101248455A (en) | Method of setting contrast in digital image processing, and an arrangement for this purpose | |
| GB2408872A (en) | Converting a high dynamic range image to a low dynamic range image using a film transfer function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090527 Termination date: 20200823 |