EP0680201A2 - Image processing apparatus and method - Google Patents

Image processing apparatus and method Download PDF

Info

Publication number
EP0680201A2
EP0680201A2 EP95106254A EP95106254A EP0680201A2 EP 0680201 A2 EP0680201 A2 EP 0680201A2 EP 95106254 A EP95106254 A EP 95106254A EP 95106254 A EP95106254 A EP 95106254A EP 0680201 A2 EP0680201 A2 EP 0680201A2
Authority
EP
European Patent Office
Prior art keywords
color
data
input
display
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP95106254A
Other languages
German (de)
French (fr)
Other versions
EP0680201A3 (en
EP0680201B1 (en
Inventor
Hideaki C/O Canon K.K. Yui
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of EP0680201A2 publication Critical patent/EP0680201A2/en
Publication of EP0680201A3 publication Critical patent/EP0680201A3/en
Application granted granted Critical
Publication of EP0680201B1 publication Critical patent/EP0680201B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • H04N1/62Retouching, i.e. modification of isolated colours only or in isolated picture areas only
    • H04N1/622Retouching, i.e. modification of isolated colours only or in isolated picture areas only with simulation on a subsidiary picture reproducer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • H04N1/6011Colour correction or control with simulation on a subsidiary picture reproducer

Definitions

  • the present invention relates to an image processing apparatus and, more particularly, to an image processing apparatus for converting a video signal into a signal for a display panel.
  • the hues of CRT video output signals are determined in correspondence with the statistically determined luminous efficiency (the energy distribution amounts of R, G, and B sensed by the human eyes).
  • color digital video signal processing a series of processing operations such as gamma conversion, color management, and the like, which take the characteristics of an input/output display device and matching to the color reproducibility of color peripheral apparatuses represented by a printer and scanner into account are performed in consideration of the statistically determined visual sense characteristics of normal persons.
  • hues are determined in correspondence with the statistically determined luminous efficiency, it is inconvenient for, e.g., red-blind or color-blind persons, or a person who wants to intentionally change hues, resulting in a low degree of freedom. Since it is known that Europeans and Americans tend to be sensitive to red, and Japaneses tend to be sensitive to blue, it is often inconvenient to determine the hues in correspondence with the statistically determined luminous efficiency.
  • an image processing apparatus with a display panel, comprising video signal generation means for generating a video signal, color sense conversion means for color-sense-converting the video signal generated by the video signal generation means on the basis of predetermined color sense data, and signal conversion means for converting the video signal color-sense-converted by the color sense conversion means into a signal for the display panel.
  • an image processing apparatus for converting an input image signal into an output image signal using a color conversion table, comprising switching means for selecting one of first and second modes, and display control means for displaying an image input by input means on display means when the first mode is selected, and displaying information for changing the color conversion table on the display means when the second mode is selected.
  • a video signal is generated by the video signal generation means, the generated video signal is color-sense-converted by the color sense conversion means on the basis of color sense data.
  • the converted video signal is converted into a signal for the display panel by the signal conversion means.
  • Fig. 1 is a block diagram showing the overall image processing apparatus according to the first embodiment of the present invention.
  • digital R, G, and B input data 1 are supplied from a video signal output terminal of an information processing apparatus such as a work station, a personal computer, or the like.
  • a selector 2 switches between custom table address data 8 supplied from a controller 7, and the digital R, G, and B input data 1.
  • a color conversion table 3 comprises a rewritable RAM which stores color conversion table data 14 supplied from the controller 7, and looks up data (address) supplied from the selector 2 to output table data 4 based on the looked-up data.
  • a display controller 5 controls the display operation of a display 6 as an output display device on the basis of the table data 4 supplied from the color conversion table 3.
  • a color conversion table generator 10 changes setting data of table data on the basis of variable information of an RGB control dial 11 when a user of this apparatus wants to generate custom color conversion data.
  • a custom information input device 13 comprises a keyboard used for inputting the personal ID information of a user of this apparatus, a magnetic card, and the like.
  • a custom table memory 9 is a storage device which stores custom table data generated by the color conversion table generator 10, and comprises, e.g., a hard disk device, a floppy disk device, and the like.
  • a comparator 12 compares the personal ID information input from the custom information input device 13 with the registered contents of the custom table memory 9.
  • the digital R, G, and B input data 1 are selected by the selector 2, and are supplied to the color conversion table 3 as addresses. Based on the addresses, data, which are pre-stored in the color conversion table and correspond to the input addresses, are output as the table data 4.
  • the table data 4 are converted into a transfer format compatible with the display by the display controller 5, and the converted data are transferred to the display 6 together with a driving control signal.
  • This processing flow is the same as that of ordinary color conversion processing, and it is a common practice to rewrite and change the contents of the color conversion table upon execution of color conversion processing such as inverse gamma correction in correspondence with the characteristics of the connected display.
  • the flow of the above-mentioned ordinary processing takes only the visual sense characteristics of average persons, the characteristics of the display, and the like.
  • a user generates and registers color conversion table data customized for himself or herself.
  • the processing flow will be explained below with reference to the flow charts shown in Figs. 2A and 2B.
  • Figs. 2A and 2B are flow charts showing color table data generation/registration processing.
  • step S1 the color conversion table generator 10 checks if the user turns on a table control button of the RGB control dial 11 (step S2). If NO in step S2, the ordinary data displaying operation is performed. However, if it is determined in step S2 that the user turns on the table control button, an R-table control image is displayed on the display 6 in step S3. At this time, the color conversion table generator 10 outputs a display request of an R-table control image to the controller 7. Upon reception of this request, the controller 7 switches the selector 2 to the custom table address data 8 side, and reads out an R-scale color bar image as the R-table control image from the custom table memory 9.
  • the R-scale color bar image is displayed on the display 6 via the color conversion table 3 and the display controller 5.
  • the table data stored in the color conversion table are tuned by the controller 7 to have linear input/output characteristics which can serve as standard data for control, as shown in Fig. 3A-1. It is checked in step S4 if a change request of an R-table is input. If NO in step S4, the flow jumps to step S6.
  • the user adjusts the RGB control dial 11 while observing the R-scale color bar image displayed on the display 6, thereby changing the characteristics of table data as the user desired.
  • Fig. 3A-2 shows an example of the input/output characteristics of the R-table which are changed by the adjustment.
  • the characteristics of a G-table are also changed from Fig. 3B-1 to Fig. 3B-2 by the same processing (steps S7 and S8), and the characteristics of a B-table are changed from Fig. 3C-1 to Fig. 3C-2 by the same processing (steps S10 and S11).
  • steps S7 and S8 the characteristics of a B-table
  • step S12 If it is determined in step S12 that the user turns on a custom registration button of the RGB control dial 11, the R, G, and B custom table data adjusted in steps S5, S8, and S11 are stored in the custom table memory 9 in step S13. At this time, the user simultaneously inputs an index ID of the registered data from the custom information input device 13, thus completing registration of custom table data. Subsequently, when the user turns off the table control button of the RGB control dial 11 (step S14), the flow returns to step S1 to resume the ordinary data displaying mode. At this time, the data in the conversion table 3 have already been changed to the latest data (the data adjusted in steps S5, S8, and S11).
  • the user inputs personal ID information from the custom information input device 13, and transfers it to the comparator 12.
  • the comparator 12 transfers a comparison request to the controller 7.
  • the controller 7 loads and scans all index IDs of already registered data from the custom table memory 9, and transfers them to the comparator 12.
  • the comparator 12 performs comparison processing. If the comparator 12 cannot find any coincidence, it informs non-coincidence to the user. If a coincidence is found, the comparator 12 outputs a download request to the controller 7 to download the R, G, and B custom table data corresponding to the index ID from the custom table memory 9 to the color conversion table 3.
  • Fig. 4 is a block diagram showing the overall image processing apparatus according to the second embodiment.
  • the apparatus shown in Fig. 4 is substantially the same as that in Fig. 1, except that host profile information 20 and display profile information 21 are input to the controller 7.
  • the host profile information includes color space information of R, G, and B input data which can be reproduced by the host side.
  • the display profile information includes color space information of R, G, and B output data, which can be reproduced by the display side.
  • Fig. 5A shows a color space in this case.
  • the host color space is the same as the display color space, and the contents of the color conversion table are customized according to a user's request by the processing of the first embodiment while maintaining the host color space.
  • Fig. 5B shows a color space in this case.
  • the display color space is larger than the host color space (the color space reproducing performance of the display color space is higher than that of the host color space), and the contents of the color conversion table are customized according to a user's request by the processing of the first embodiment while maintaining the host color space.
  • Fig. 5C shows a color space in this case.
  • the controller 7 performs the clipping processing, and writes new color conversion data generated after the clipping processing in the color conversion table 3.
  • the input/output characteristics written in the color conversion table 3 are as shown in Figs. 6A-1, 6B-1, and 6C-1.
  • portions other than the clipped portions are adjusted, and color conversion processing which is optimally customized in consideration of the color reproduction performances of both the host and display sides is performed, as shown in Figs. 6A-2, 6B-2, and 6C-2.
  • Fig. 7 is a block diagram showing the overall image processing apparatus according to the third embodiment of the present invention.
  • a host graphic card 71 as video signal generation means outputs graphic data generated by an information processing apparatus such as a work station, a personal computer, or the like.
  • An image converter 74 converts an analog video signal VIDEO and horizontal/vertical synchronization signals (Hsync/Vsync) supplied from the host graphic card 71 into signals for a display panel 75.
  • An external input device 72 as color sense data input means is used for inputting, to the image converter 74, data stored in a storage medium comprising, e.g., a magnetic card, which stores personal color sense (spectral sensitivity) data generated in advance, as described in the first embodiment.
  • a switch 73 is used for selecting one of an ordinary processing mode and a processing mode based on personal color sense data.
  • the image converter 74 comprises an AD converter 76, a selector 79, a color space converter 77 as signal conversion means, a binarizer/buffer 78, a color sense processor 80 as color sense conversion means, and an external input device interface (I/F) 81.
  • the AD converter 76 includes an A/D converter, and other circuits, and performs horizontal/vertical timing detection, data extraction, and the like from the analog video signal VIDEO and the horizontal/vertical synchronization signals (Hsync/Vsync) supplied from the host graphic card 71 using synchronization separation and PLL (phase-locked loop), thereby converting input data into an image data format required in the subsequent processing.
  • VIDEO analog video signal
  • Vsync/Vsync horizontal/vertical synchronization signals supplied from the host graphic card 71 using synchronization separation and PLL (phase-locked loop), thereby converting input data into an image data format required in the subsequent processing.
  • PLL phase-locked loop
  • the selector 79 connects the output from the AD converter 76 to the color space converter 77 when the processing mode based on color sense data is selected by the switch 73, and connects the output from the AD converter 76 to the color sense processor 80 when the ordinary processing mode is selected by the switch 73.
  • the color sense processor 80 color-sense-converts a video signal from the selector 79 on the basis of color sense data input from the external input device 82 via the external input device interface 81.
  • the color space converter 77 performs clipping processing of a video signal from the selector 79 or the color sense processor 80 to a color space optimal to the display panel 75.
  • the binarizer/buffer 78 performs format conversion and buffering of data with respect to the display panel 75.
  • Fig. 8 is a block diagram showing the arrangement of the color sense processor 80 shown in Fig. 7.
  • a spectral sensitivity standardizer 84 converts the spectral sensitivity of data into that of average persons to obtain standardized spectral sensitivity data as pre-processing of conversion since the spectral sensitivity of actually input data may be calibrated in correspondence with a race or personal difference.
  • a controller 85 processes personal spectral sensitivity data read out from the external input device 72 to convert it into control data for spectral sensitivity conversion processing.
  • a spectral sensitivity conversion processor 86 comprises a look-up table memory (LUT ROM) 88 and a decoder 87.
  • LUT ROM look-up table memory
  • a control signal from the controller 85 is decoded by the decoder 87, and the LUT ROM 88 is controlled by the output from the decoder 87, thereby generating personal spectral sensitivity data.
  • the analog video signal VIDEO and the horizontal/vertical synchronization signals (Hsync/Vsync) supplied from the host graphic card 71 are input to the image converter 74, and are subjected to horizontal/vertical timing detection, data extraction, and the like using synchronization separation and PLL in the AD converter 76.
  • the switch 73 selects the processing mode based on color sense data, the output from the AD converter 76 is connected to the color space converter 77 by the selector 79; when the ordinary processing mode is selected, the output from the AD converter 76 is connected to the color sense processor 80.
  • the color space converter 77 performs clipping processing to a color space optimal to the display panel 75
  • the binarizer/buffer 78 performs format conversion and buffering of data with respect to the display panel 75
  • the display panel 75 is driven based on the buffered data.
  • the color sense processor 80 color-sense-converts the video signal on the basis of personal color sense data stored in the storage medium of the external input device 72.
  • the color space converter 77 performs clipping processing of the converted video signal to a color space optimal to the display panel 75
  • the binarizer/buffer 78 performs format conversion of data with respect to the display panel 75
  • the display panel 75 is driven based on buffered data.
  • Fig. 9 is a block diagram showing the overall image processing apparatus according to the fourth embodiment of the present invention.
  • the same reference numerals in Fig. 9 denote the same parts as in Fig. 7.
  • An image converter 94 comprises an AD converter 76, a selector 79, a color space converter 77, a binarizer/buffer 78, a color sense processor 80, an external input device interface 81, a personal code comparator 91 as searching means, and an internal memory 92 as storage means.
  • the image converter 94 is electrically connected to a host graphic card 71, a display panel 75, an external input device 72, and a switch 73 as in the image converter 74 shown in Fig. 7.
  • An external input device 90 as identification data input means comprises, e.g., a ten-key pad, and is used for inputting a user code to the personal code comparator 91.
  • This embodiment is different from the third embodiment in the following points. More specifically, in this embodiment, when a user who initially uses the system inputs personal spectral sensitivity data from the external input device 72 and inputs a user code from the external input device 90, the personal code comparator 91 stores the personal spectral sensitivity data in the internal memory 92 in correspondence with the user code.
  • the personal code comparator 91 searches the internal memory 92. When the comparator 91 finds the input user code, personal spectral sensitivity data corresponding to the input user code is read out, and the readout personal spectral sensitivity data is input to the color sense processor 80 via the external input device interface 81.
  • a system user need not perform calibration using personal color sense data each time he or she uses the system, and the operability of the user environment can be improved for a plurality of users who share a single system.
  • the means for inputting a user code and the means for searching the contents of a registration database are arranged, the color sense data of a user himself or herself are not exposed to a third party, thus improving the confidentiality of personal information.
  • An image processing apparatus of this invention has an ordinary displaying mode and a hue conversion mode to change hues in correspondence with a user.
  • the ordinary displaying mode input image data is displayed on a display, and in the hue conversion mode, an image for hue conversion is displayed on the display. The hues are converted in accordance with an instruction of the user.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Processing Of Color Television Signals (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

An image processing apparatus of this invention has an ordinary displaying mode and a hue conversion mode to change hues in correspondence with a user. In the ordinary displaying mode, input image data is displayed on a display, and in the hue conversion mode, an image for hue conversion is displayed on the display. The hues are converted in accordance with an instruction of the user.

Description

    BACKGROUND OF THE INVENTION Field of the Invention
  • The present invention relates to an image processing apparatus and, more particularly, to an image processing apparatus for converting a video signal into a signal for a display panel.
  • Related Background Art
  • As is conventionally known, the hues of CRT video output signals are determined in correspondence with the statistically determined luminous efficiency (the energy distribution amounts of R, G, and B sensed by the human eyes).
  • In color digital video signal processing, a series of processing operations such as gamma conversion, color management, and the like, which take the characteristics of an input/output display device and matching to the color reproducibility of color peripheral apparatuses represented by a printer and scanner into account are performed in consideration of the statistically determined visual sense characteristics of normal persons.
  • However, when the hues are determined in correspondence with the statistically determined luminous efficiency, it is inconvenient for, e.g., red-blind or color-blind persons, or a person who wants to intentionally change hues, resulting in a low degree of freedom. Since it is known that Europeans and Americans tend to be sensitive to red, and Japaneses tend to be sensitive to blue, it is often inconvenient to determine the hues in correspondence with the statistically determined luminous efficiency.
  • SUMMARY OF THE INVENTION
  • It is an object of the present invention to provide an image processing apparatus which can change hues to solve the above-mentioned problems.
  • According to the present invention, there is provided an image processing apparatus with a display panel, comprising video signal generation means for generating a video signal, color sense conversion means for color-sense-converting the video signal generated by the video signal generation means on the basis of predetermined color sense data, and signal conversion means for converting the video signal color-sense-converted by the color sense conversion means into a signal for the display panel.
  • According to the present invention, there is also provided an image processing apparatus for converting an input image signal into an output image signal using a color conversion table, comprising switching means for selecting one of first and second modes, and display control means for displaying an image input by input means on display means when the first mode is selected, and displaying information for changing the color conversion table on the display means when the second mode is selected.
  • With the above arrangement, a video signal is generated by the video signal generation means, the generated video signal is color-sense-converted by the color sense conversion means on the basis of color sense data. The converted video signal is converted into a signal for the display panel by the signal conversion means.
  • BRIEF DESCRIPTION OF THE DRAWINGS
    • Fig. 1 is a block diagram of the overall image processing apparatus according to the first embodiment of the present invention;
    • Fig. 2 is comprised of Fig. 2A and Fig. 2B showing flow charts of color table data generation/registration processing in the first embodiment;
    • Figs. 3A-1 to 3C-2 are views showing the custom conversion processing of R, G, and B input/output characteristics;
    • Fig. 4 is a block diagram of the overall image processing apparatus according to the second embodiment of the present invention;
    • Figs. 5A to 5C are views showing input and output color spaces in the second embodiment;
    • Figs. 6A-1 to 6C-2 are views showing the custom conversion processing of R, G, and B input/output characteristics;
    • Fig. 7 is a block diagram of the overall image processing apparatus according to the third embodiment of the present invention;
    • Fig. 8 is a block diagram showing the arrangement of a color sense processor; and
    • Fig. 9 is a block diagram of the overall image processing apparatus according to the fourth embodiment of the present invention.
    DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • The preferred embodiments of the present invention will be described hereinafter with reference to the accompanying drawings.
  • (First Embodiment)
  • Fig. 1 is a block diagram showing the overall image processing apparatus according to the first embodiment of the present invention.
  • Referring to Fig. 1, digital R, G, and B input data 1 are supplied from a video signal output terminal of an information processing apparatus such as a work station, a personal computer, or the like. A selector 2 switches between custom table address data 8 supplied from a controller 7, and the digital R, G, and B input data 1. A color conversion table 3 comprises a rewritable RAM which stores color conversion table data 14 supplied from the controller 7, and looks up data (address) supplied from the selector 2 to output table data 4 based on the looked-up data. A display controller 5 controls the display operation of a display 6 as an output display device on the basis of the table data 4 supplied from the color conversion table 3. A color conversion table generator 10 changes setting data of table data on the basis of variable information of an RGB control dial 11 when a user of this apparatus wants to generate custom color conversion data. A custom information input device 13 comprises a keyboard used for inputting the personal ID information of a user of this apparatus, a magnetic card, and the like. A custom table memory 9 is a storage device which stores custom table data generated by the color conversion table generator 10, and comprises, e.g., a hard disk device, a floppy disk device, and the like. A comparator 12 compares the personal ID information input from the custom information input device 13 with the registered contents of the custom table memory 9.
  • The operation of the first embodiment will be described below. In ordinary image processing of this apparatus, the digital R, G, and B input data 1 are selected by the selector 2, and are supplied to the color conversion table 3 as addresses. Based on the addresses, data, which are pre-stored in the color conversion table and correspond to the input addresses, are output as the table data 4. The table data 4 are converted into a transfer format compatible with the display by the display controller 5, and the converted data are transferred to the display 6 together with a driving control signal. This processing flow is the same as that of ordinary color conversion processing, and it is a common practice to rewrite and change the contents of the color conversion table upon execution of color conversion processing such as inverse gamma correction in correspondence with the characteristics of the connected display. The flow of the above-mentioned ordinary processing takes only the visual sense characteristics of average persons, the characteristics of the display, and the like.
  • Processing for customizing color conversion in units of users as the characteristic feature of the present invention will be explained below.
  • First, a user generates and registers color conversion table data customized for himself or herself. The processing flow will be explained below with reference to the flow charts shown in Figs. 2A and 2B.
  • Figs. 2A and 2B are flow charts showing color table data generation/registration processing.
  • When the above-mentioned ordinary data displaying operation is performed (step S1), the color conversion table generator 10 checks if the user turns on a table control button of the RGB control dial 11 (step S2). If NO in step S2, the ordinary data displaying operation is performed. However, if it is determined in step S2 that the user turns on the table control button, an R-table control image is displayed on the display 6 in step S3. At this time, the color conversion table generator 10 outputs a display request of an R-table control image to the controller 7. Upon reception of this request, the controller 7 switches the selector 2 to the custom table address data 8 side, and reads out an R-scale color bar image as the R-table control image from the custom table memory 9. The R-scale color bar image is displayed on the display 6 via the color conversion table 3 and the display controller 5. At this time, the table data stored in the color conversion table are tuned by the controller 7 to have linear input/output characteristics which can serve as standard data for control, as shown in Fig. 3A-1. It is checked in step S4 if a change request of an R-table is input. If NO in step S4, the flow jumps to step S6. Upon adjustment of the R-table, the user adjusts the RGB control dial 11 while observing the R-scale color bar image displayed on the display 6, thereby changing the characteristics of table data as the user desired. During this adjustment, the contents of the color conversion table 3 can be rewritten by the controller 7 as needed, and the user can perform operations while confirming the adjustment result (effect) on the screen of the display 6. Fig. 3A-2 shows an example of the input/output characteristics of the R-table which are changed by the adjustment. The characteristics of a G-table are also changed from Fig. 3B-1 to Fig. 3B-2 by the same processing (steps S7 and S8), and the characteristics of a B-table are changed from Fig. 3C-1 to Fig. 3C-2 by the same processing (steps S10 and S11). With the above-mentioned processing, all the R, G, and B color conversion table data are customized. If it is determined in step S12 that the user turns on a custom registration button of the RGB control dial 11, the R, G, and B custom table data adjusted in steps S5, S8, and S11 are stored in the custom table memory 9 in step S13. At this time, the user simultaneously inputs an index ID of the registered data from the custom information input device 13, thus completing registration of custom table data. Subsequently, when the user turns off the table control button of the RGB control dial 11 (step S14), the flow returns to step S1 to resume the ordinary data displaying mode. At this time, the data in the conversion table 3 have already been changed to the latest data (the data adjusted in steps S5, S8, and S11).
  • Processing for changing the contents of the color conversion table 3 when the user uses this apparatus will be described below.
  • Referring to Fig. 1, the user inputs personal ID information from the custom information input device 13, and transfers it to the comparator 12. The comparator 12 transfers a comparison request to the controller 7. Upon reception of this request, the controller 7 loads and scans all index IDs of already registered data from the custom table memory 9, and transfers them to the comparator 12. Upon reception of these data, the comparator 12 performs comparison processing. If the comparator 12 cannot find any coincidence, it informs non-coincidence to the user. If a coincidence is found, the comparator 12 outputs a download request to the controller 7 to download the R, G, and B custom table data corresponding to the index ID from the custom table memory 9 to the color conversion table 3.
  • With the above-mentioned processing, color conversion processing customized in units of users can be realized.
  • (Second Embodiment)
  • Fig. 4 is a block diagram showing the overall image processing apparatus according to the second embodiment. The apparatus shown in Fig. 4 is substantially the same as that in Fig. 1, except that host profile information 20 and display profile information 21 are input to the controller 7.
  • Referring to Fig. 4, the host profile information includes color space information of R, G, and B input data which can be reproduced by the host side. The display profile information includes color space information of R, G, and B output data, which can be reproduced by the display side. These two pieces of information are transferred to the controller 7, and the controller 7 executes the following processing.
  • (1) When Host Color Space = Display Color Space
  • Fig. 5A shows a color space in this case.
  • In this case, it is determined that the host color space is the same as the display color space, and the contents of the color conversion table are customized according to a user's request by the processing of the first embodiment while maintaining the host color space.
  • (2) When Host Color Space < Display Color Space
  • Fig. 5B shows a color space in this case.
  • In this case, it is determined that the display color space is larger than the host color space (the color space reproducing performance of the display color space is higher than that of the host color space), and the contents of the color conversion table are customized according to a user's request by the processing of the first embodiment while maintaining the host color space.
  • (3) When Host Color Space > Display Color Space
  • Fig. 5C shows a color space in this case.
  • In this case, it is determined that the display color space is smaller than the host color space (the color space reproducing performance of the display color space is lower than that of the host color space), and the following clipping processing is performed prior to the custom processing according to a user's request. More specifically, processing for assigning all color space portions, which cannot be reproduced by the display side, to the closest portions in the host color space (clipping processing) is performed. The controller 7 performs the clipping processing, and writes new color conversion data generated after the clipping processing in the color conversion table 3. The input/output characteristics written in the color conversion table 3 are as shown in Figs. 6A-1, 6B-1, and 6C-1. Upon adjustment of the RGB control dial from this state by the processing of the first embodiment, portions other than the clipped portions are adjusted, and color conversion processing which is optimally customized in consideration of the color reproduction performances of both the host and display sides is performed, as shown in Figs. 6A-2, 6B-2, and 6C-2.
  • (Third Embodiment)
  • Fig. 7 is a block diagram showing the overall image processing apparatus according to the third embodiment of the present invention.
  • Referring to Fig. 7, a host graphic card 71 as video signal generation means outputs graphic data generated by an information processing apparatus such as a work station, a personal computer, or the like. An image converter 74 converts an analog video signal VIDEO and horizontal/vertical synchronization signals (Hsync/Vsync) supplied from the host graphic card 71 into signals for a display panel 75.
  • An external input device 72 as color sense data input means is used for inputting, to the image converter 74, data stored in a storage medium comprising, e.g., a magnetic card, which stores personal color sense (spectral sensitivity) data generated in advance, as described in the first embodiment. A switch 73 is used for selecting one of an ordinary processing mode and a processing mode based on personal color sense data.
  • The image converter 74 comprises an AD converter 76, a selector 79, a color space converter 77 as signal conversion means, a binarizer/buffer 78, a color sense processor 80 as color sense conversion means, and an external input device interface (I/F) 81.
  • The AD converter 76 includes an A/D converter, and other circuits, and performs horizontal/vertical timing detection, data extraction, and the like from the analog video signal VIDEO and the horizontal/vertical synchronization signals (Hsync/Vsync) supplied from the host graphic card 71 using synchronization separation and PLL (phase-locked loop), thereby converting input data into an image data format required in the subsequent processing.
  • The selector 79 connects the output from the AD converter 76 to the color space converter 77 when the processing mode based on color sense data is selected by the switch 73, and connects the output from the AD converter 76 to the color sense processor 80 when the ordinary processing mode is selected by the switch 73.
  • The color sense processor 80 color-sense-converts a video signal from the selector 79 on the basis of color sense data input from the external input device 82 via the external input device interface 81.
  • The color space converter 77 performs clipping processing of a video signal from the selector 79 or the color sense processor 80 to a color space optimal to the display panel 75.
  • The binarizer/buffer 78 performs format conversion and buffering of data with respect to the display panel 75.
  • Fig. 8 is a block diagram showing the arrangement of the color sense processor 80 shown in Fig. 7.
  • Referring to Fig. 8, a spectral sensitivity standardizer 84 converts the spectral sensitivity of data into that of average persons to obtain standardized spectral sensitivity data as pre-processing of conversion since the spectral sensitivity of actually input data may be calibrated in correspondence with a race or personal difference.
  • A controller 85 processes personal spectral sensitivity data read out from the external input device 72 to convert it into control data for spectral sensitivity conversion processing.
  • A spectral sensitivity conversion processor 86 comprises a look-up table memory (LUT ROM) 88 and a decoder 87. In this processor 86, a control signal from the controller 85 is decoded by the decoder 87, and the LUT ROM 88 is controlled by the output from the decoder 87, thereby generating personal spectral sensitivity data.
  • The operation of the image processing apparatus of the third embodiment will be described below.
  • The analog video signal VIDEO and the horizontal/vertical synchronization signals (Hsync/Vsync) supplied from the host graphic card 71 are input to the image converter 74, and are subjected to horizontal/vertical timing detection, data extraction, and the like using synchronization separation and PLL in the AD converter 76. When the switch 73 selects the processing mode based on color sense data, the output from the AD converter 76 is connected to the color space converter 77 by the selector 79; when the ordinary processing mode is selected, the output from the AD converter 76 is connected to the color sense processor 80.
  • In the ordinary processing mode, the color space converter 77 performs clipping processing to a color space optimal to the display panel 75, the binarizer/buffer 78 performs format conversion and buffering of data with respect to the display panel 75, and the display panel 75 is driven based on the buffered data.
  • On the other hand, in the processing mode based or color sense data, the color sense processor 80 color-sense-converts the video signal on the basis of personal color sense data stored in the storage medium of the external input device 72. The color space converter 77 performs clipping processing of the converted video signal to a color space optimal to the display panel 75, the binarizer/buffer 78 performs format conversion of data with respect to the display panel 75, and the display panel 75 is driven based on buffered data.
  • (Fourth Embodiment)
  • Fig. 9 is a block diagram showing the overall image processing apparatus according to the fourth embodiment of the present invention. The same reference numerals in Fig. 9 denote the same parts as in Fig. 7.
  • An image converter 94 comprises an AD converter 76, a selector 79, a color space converter 77, a binarizer/buffer 78, a color sense processor 80, an external input device interface 81, a personal code comparator 91 as searching means, and an internal memory 92 as storage means. The image converter 94 is electrically connected to a host graphic card 71, a display panel 75, an external input device 72, and a switch 73 as in the image converter 74 shown in Fig. 7.
  • An external input device 90 as identification data input means comprises, e.g., a ten-key pad, and is used for inputting a user code to the personal code comparator 91.
  • This embodiment is different from the third embodiment in the following points. More specifically, in this embodiment, when a user who initially uses the system inputs personal spectral sensitivity data from the external input device 72 and inputs a user code from the external input device 90, the personal code comparator 91 stores the personal spectral sensitivity data in the internal memory 92 in correspondence with the user code.
  • Also, in this embodiment, when a user inputs only a user code from the external input device 90, the personal code comparator 91 searches the internal memory 92. When the comparator 91 finds the input user code, personal spectral sensitivity data corresponding to the input user code is read out, and the readout personal spectral sensitivity data is input to the color sense processor 80 via the external input device interface 81.
  • As described above, according to this embodiment, a system user need not perform calibration using personal color sense data each time he or she uses the system, and the operability of the user environment can be improved for a plurality of users who share a single system.
  • Since the means for inputting a user code and the means for searching the contents of a registration database are arranged, the color sense data of a user himself or herself are not exposed to a third party, thus improving the confidentiality of personal information.
  • Even for users having color senses different from the statistically determined color sense data, an output image optimized for each user can be obtained.
  • Since data input/output color spaces are looked up, and matching processing is attained by optimal clipping processing based the looked-up color spaces as pre-processing of custom data calibration, a system user can perform customized color conversion of the connected environment of a color system with optimal color reproducibility.
  • An image processing apparatus of this invention has an ordinary displaying mode and a hue conversion mode to change hues in correspondence with a user. In the ordinary displaying mode, input image data is displayed on a display, and in the hue conversion mode, an image for hue conversion is displayed on the display. The hues are converted in accordance with an instruction of the user.

Claims (5)

  1. An image processing apparatus with a display panel, comprising:
       video signal generation means for generating a video signal;
       color sense conversion means for color-sense-converting the video signal generated by said video signal generation means on the basis of predetermined color sense data; and
       signal conversion means for converting the video signal color-sense-converted by said color sense conversion means into a signal for the display panel.
  2. An apparatus according to claim 1, further comprising color sense data input means for inputting the predetermined color sense data.
  3. An apparatus according to claim 1, further comprising:
       storage means for storing the predetermined color sense data in correspondence with identification data;
       identification data input means for inputting identification data; and
       searching means for searching said storage means to find color sense data corresponding to the identification data input by said identification input means.
  4. An image processing apparatus for converting an input image signal into an output image signal using a color conversion table, comprising:
       switching means for selecting one of first and second modes; and
       display control means for displaying an image input by input means on display means when the first mode is selected, and displaying information for changing the color conversion table on the display means when the second mode is selected.
  5. An image processing method of converting an input image signal into an output image signal using a color conversion table, comprising the steps of:
       selecting one of first and second modes on the basis of an instruction from input means;
       displaying an image input by image input means on display means when the first mode is selected, and displaying information for changing the color conversion table on the display means when the second mode is selected; and
       displaying an image input by the image input means using the changed color conversion table.
EP95106254A 1994-04-27 1995-04-26 Image processing apparatus and method Expired - Lifetime EP0680201B1 (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JP90281/94 1994-04-27
JP9028194 1994-04-27
JP9028194 1994-04-27
JP7095201A JPH0816129A (en) 1994-04-27 1995-04-20 Picture processing device
JP95201/95 1995-04-20
JP9520195 1995-04-20

Publications (3)

Publication Number Publication Date
EP0680201A2 true EP0680201A2 (en) 1995-11-02
EP0680201A3 EP0680201A3 (en) 1996-06-05
EP0680201B1 EP0680201B1 (en) 1999-12-29

Family

ID=26431780

Family Applications (1)

Application Number Title Priority Date Filing Date
EP95106254A Expired - Lifetime EP0680201B1 (en) 1994-04-27 1995-04-26 Image processing apparatus and method

Country Status (4)

Country Link
US (1) US5677741A (en)
EP (1) EP0680201B1 (en)
JP (1) JPH0816129A (en)
DE (1) DE69514143T2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1083658C (en) * 1995-11-28 2002-04-24 三星电子株式会社 Coloring device and method for specific region on screen
WO2004023397A1 (en) * 2002-08-29 2004-03-18 Kistem Co., Ltd Vision aid network server, vision aid network system, vision aid method, vision aid system, color sense function reporting system, program for reporting color sense function, method for reporting color sense function, color sense aid system, color sense aid program, and color sense aid method
EP1453008A1 (en) * 2003-02-28 2004-09-01 Océ-Technologies B.V. Cocverted digital colour image with improved colour distinction for colour-blinds
EP1453006A1 (en) * 2003-02-28 2004-09-01 Océ-Technologies B.V. Converted digital colour image with improved colour distinction for colour-blinds

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08317187A (en) * 1995-05-18 1996-11-29 Canon Inc Image processing unit and method
DE19529367C2 (en) * 1995-08-10 1997-08-21 Wolf Gmbh Richard Device for color correction in color images recorded by a video camera
JPH09179539A (en) * 1995-12-27 1997-07-11 Brother Ind Ltd Color adjustment device
KR100237637B1 (en) * 1996-06-04 2000-01-15 구자홍 Skin color reproduction apparatus and method
KR100225072B1 (en) * 1996-12-18 1999-10-15 윤종용 Format converter
US7148909B2 (en) * 1998-05-27 2006-12-12 Canon Kabushiki Kaisha Image display system capable of displaying and scaling images on plurality of image sources and display control method therefor
US6473088B1 (en) 1998-06-16 2002-10-29 Canon Kabushiki Kaisha System for displaying multiple images and display method therefor
JP2000003152A (en) * 1998-06-16 2000-01-07 Hitachi Ltd Image display device
WO2000010331A1 (en) * 1998-08-14 2000-02-24 Koninklijke Philips Electronics N.V. Color signal matrix adjustment
JP2000115558A (en) * 1998-10-08 2000-04-21 Mitsubishi Electric Corp Color characteristic description device, color management device, image converter and color correction method
JP3702699B2 (en) * 1999-03-26 2005-10-05 三菱電機株式会社 Color image display device
US6581109B1 (en) 1999-06-24 2003-06-17 International Business Machines Corporation System to dynamically adjust image colors in client/server environment to assure accurate color reproduction
US6571009B1 (en) * 1999-07-16 2003-05-27 Hewlett-Packard Development Company Method and apparatus for assigning color management actions within a computing system
US6985524B1 (en) * 1999-09-01 2006-01-10 Sharp Laboratories Of America, Inc. Apparatus and method for adjusting real time video to compensate for color blindness
JP4857429B2 (en) * 2001-03-29 2012-01-18 独立行政法人産業技術総合研究所 Information processing system, method, color correction system, and color correction program
US7046255B2 (en) * 2001-06-28 2006-05-16 Hewlett-Packard Development Company, L.P. Hardware-based accelerated color correction filtering system
KR100923676B1 (en) * 2002-12-31 2009-10-28 엘지디스플레이 주식회사 Liquid crystal display and method for improving color gamut thereof
US7042523B2 (en) * 2003-06-30 2006-05-09 Texas Instruments Incorporated Video correction system and method using logarithmic conversion
JP4394512B2 (en) * 2004-04-30 2010-01-06 富士通株式会社 Liquid crystal display device with improved viewing angle characteristics
JP4154422B2 (en) * 2004-12-15 2008-09-24 キヤノン株式会社 Image display device
JP4154423B2 (en) * 2004-12-17 2008-09-24 キヤノン株式会社 Image display device
JP2008237406A (en) * 2007-03-26 2008-10-09 Samii Kk Image display control device and method, and game machine
US8199184B2 (en) * 2007-11-06 2012-06-12 Cisco Technology, Inc. Visually enhancing a conference
US8411206B2 (en) * 2007-12-27 2013-04-02 Texas Instruments Incorporated Apparatus and method for decoding extended color space data
JP5223492B2 (en) * 2008-06-25 2013-06-26 セイコーエプソン株式会社 Print control apparatus and print control program
JP2010166122A (en) * 2009-01-13 2010-07-29 Olympus Corp Imaging device and image processing method
JP5589544B2 (en) * 2009-06-17 2014-09-17 株式会社リコー Image processing apparatus, image processing method, program, and recording medium
JP5854965B2 (en) * 2012-10-11 2016-02-09 京セラドキュメントソリューションズ株式会社 Information display device
JP6095051B2 (en) * 2012-11-29 2017-03-15 三星電子株式会社Samsung Electronics Co.,Ltd. TV system
US9704416B2 (en) 2012-11-29 2017-07-11 Samsung Electronics Co., Ltd. Television system and image display method thereof
CN107978264B (en) * 2014-12-26 2021-06-08 小米科技有限责任公司 Display brightness adjusting method and device
EP3866155A1 (en) 2015-01-15 2021-08-18 Xiaomi Inc. Method and device for adjusting display brightness

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0310388A1 (en) * 1987-10-02 1989-04-05 Crosfield Electronics Limited Interactive image modification
WO1992020184A1 (en) * 1991-04-26 1992-11-12 Eastman Kodak Company Computer/human interface for performing data transformations by manipulating graphical objects on a video display
EP0546773A2 (en) * 1991-12-11 1993-06-16 Xerox Corporation Graphical user interface for editing a palette of colours
EP0590763A1 (en) * 1992-07-27 1994-04-06 Scitex Corporation Ltd. Electronic separation scanner

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3886817T2 (en) * 1987-05-21 1994-05-11 Sony Corp Color image signal processing method and apparatus.
JPH0440754A (en) * 1990-06-07 1992-02-12 Matsushita Electric Ind Co Ltd Signal converter
JPH05103335A (en) * 1991-10-03 1993-04-23 Jiemuko:Kk Method and device for correcting color
JP2793463B2 (en) * 1992-04-28 1998-09-03 インターナショナル・ビジネス・マシーンズ・コーポレイション Color set selection apparatus and method, and color selection management method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0310388A1 (en) * 1987-10-02 1989-04-05 Crosfield Electronics Limited Interactive image modification
WO1992020184A1 (en) * 1991-04-26 1992-11-12 Eastman Kodak Company Computer/human interface for performing data transformations by manipulating graphical objects on a video display
EP0546773A2 (en) * 1991-12-11 1993-06-16 Xerox Corporation Graphical user interface for editing a palette of colours
EP0590763A1 (en) * 1992-07-27 1994-04-06 Scitex Corporation Ltd. Electronic separation scanner

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1083658C (en) * 1995-11-28 2002-04-24 三星电子株式会社 Coloring device and method for specific region on screen
WO2004023397A1 (en) * 2002-08-29 2004-03-18 Kistem Co., Ltd Vision aid network server, vision aid network system, vision aid method, vision aid system, color sense function reporting system, program for reporting color sense function, method for reporting color sense function, color sense aid system, color sense aid program, and color sense aid method
EP1453008A1 (en) * 2003-02-28 2004-09-01 Océ-Technologies B.V. Cocverted digital colour image with improved colour distinction for colour-blinds
EP1453006A1 (en) * 2003-02-28 2004-09-01 Océ-Technologies B.V. Converted digital colour image with improved colour distinction for colour-blinds
US7394468B2 (en) 2003-02-28 2008-07-01 Océ-Technologies B.V. Converted digital colour image with improved colour distinction for colour-blinds

Also Published As

Publication number Publication date
EP0680201A3 (en) 1996-06-05
EP0680201B1 (en) 1999-12-29
US5677741A (en) 1997-10-14
DE69514143T2 (en) 2000-07-13
DE69514143D1 (en) 2000-02-03
JPH0816129A (en) 1996-01-19

Similar Documents

Publication Publication Date Title
EP0680201B1 (en) Image processing apparatus and method
EP1291822B1 (en) Method and apparatus for image processing
US5398075A (en) Analog chroma keying on color data
US4626892A (en) Television system with menu like function control selection
KR100293153B1 (en) Image data processing apparatus and method, and image data processing program storage medium
EP0800310A2 (en) Image processing method and apparatus
JPH0865701A (en) Device and method for correcting automatically image of image display apparatus
US6211847B1 (en) Apparatus and method for controlling sub monitors in video communication system
US5959686A (en) Apparatus and method for controlling sub monitors in a video communication system
JP3277741B2 (en) Video signal processing device
US6333731B1 (en) Apparatus for simultaneously displaying TV and PC images
JPH06315084A (en) Color reproducing method and device for outputting device
JPH0635659A (en) Information processing system
JP4086580B2 (en) Image processing apparatus, program, and method
JPH07295530A (en) Display monitor device and its adjusting method
US20020080278A1 (en) Displaying apparatus and method for controlling the same
JP2546055Y2 (en) Menu display device
JP3371741B2 (en) Color signal adjustment device and adjustment method
JPH07203230A (en) Color image forming device
KR930007373B1 (en) Auto picture level adjusting method
JP2000221960A (en) Overlay device
JPH05344328A (en) Printing device
JP2003302959A (en) Image output device and its image signal adjusting method
JPH08179729A (en) Liquid crystal projector
JPH04239265A (en) Picture forming system

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): DE ES FR GB IT NL SE

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): DE ES FR GB IT NL SE

17P Request for examination filed

Effective date: 19961022

17Q First examination report despatched

Effective date: 19980807

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE ES FR GB IT NL SE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: THE PATENT HAS BEEN ANNULLED BY A DECISION OF A NATIONAL AUTHORITY

Effective date: 19991229

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 19991229

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRE;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED.SCRIBED TIME-LIMIT

Effective date: 19991229

Ref country code: ES

Free format text: THE PATENT HAS BEEN ANNULLED BY A DECISION OF A NATIONAL AUTHORITY

Effective date: 19991229

REF Corresponds to:

Ref document number: 69514143

Country of ref document: DE

Date of ref document: 20000203

ET Fr: translation filed
NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed
REG Reference to a national code

Ref country code: GB

Ref legal event code: IF02

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20130430

Year of fee payment: 19

Ref country code: GB

Payment date: 20130418

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20130517

Year of fee payment: 19

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 69514143

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20140426

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20141231

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 69514143

Country of ref document: DE

Effective date: 20141101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140426

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140430