WO2024092461A1 - 图像处理方法及装置 - Google Patents
图像处理方法及装置 Download PDFInfo
- Publication number
- WO2024092461A1 WO2024092461A1 PCT/CN2022/128775 CN2022128775W WO2024092461A1 WO 2024092461 A1 WO2024092461 A1 WO 2024092461A1 CN 2022128775 W CN2022128775 W CN 2022128775W WO 2024092461 A1 WO2024092461 A1 WO 2024092461A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- mixed
- image
- color
- original
- pixel
- Prior art date
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 28
- 238000000034 method Methods 0.000 claims abstract description 58
- 239000003086 colorant Substances 0.000 claims abstract description 51
- 230000005540 biological transmission Effects 0.000 claims description 35
- 238000013507 mapping Methods 0.000 claims description 27
- 238000012545 processing Methods 0.000 claims description 26
- 238000004590 computer program Methods 0.000 claims description 3
- 208000003028 Stuttering Diseases 0.000 abstract 1
- 230000008569 process Effects 0.000 description 25
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 15
- 238000004891 communication Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 239000004973 liquid crystal related substance Substances 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 5
- 238000005070 sampling Methods 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000005192 partition Methods 0.000 description 3
- 230000002688 persistence Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 2
- 101000827703 Homo sapiens Polyphosphoinositide phosphatase Proteins 0.000 description 2
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 2
- 102100023591 Polyphosphoinositide phosphatase Human genes 0.000 description 2
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
Definitions
- the present invention relates to the field of image processing technology, and in particular to an image processing method and device.
- a field sequential display device is a new type of liquid crystal display device. Compared with a conventional LCD (Liquid Crystal Display) in which a pixel is composed of multiple partitions, a pixel in a field sequential display device is composed of one partition.
- other devices can process the color image into a monochrome image and send it to the field sequential display device.
- the latter can control the liquid crystal and color film of each pixel to control the pixel to display monochrome images of different colors in sequence, thereby cooperating with the "persistence of vision effect" of the human eye to present a color image display effect.
- the field sequential display device needs to use a higher refresh rate than the conventional LCD to display each monochrome image.
- the field sequential display device needs to display monochrome images at a refresh rate of 270Hz.
- other devices need to render and transmit 270 frames of image data per second to the field sequential display device. Therefore, in scenarios with high image clarity (such as when displaying 4K video images), the data transmission channel between other devices and the field sequential display device will face greater bandwidth pressure.
- an embodiment of the present invention provides an image processing method and apparatus to solve the deficiencies existing in the related art.
- an image processing method is provided, which is applied to an image encoding device, comprising:
- N original sub-pixels contained in any original pixel correspond to different basic colors of the color model respectively, and the color value of any original pixel includes color components of the N original sub-pixels for the corresponding basic colors, where N is a positive integer greater than 1;
- the mixed image When the mixed image corresponding to any basic color is generated, the mixed image is sent to the field sequential display device according to the image transmission rules that conform to the color model, so that the field sequential display device generates and displays a monochrome image corresponding to any basic color based on the mixed image.
- an image processing method is provided, which is applied to a field sequential display device.
- the method includes:
- determining a color value of each mixed pixel in the mixed image wherein the mixed image corresponds to any basic color of the color model, and the color value of any mixed pixel includes color components of N mixed sub-pixels included in the any mixed pixel for the any basic color, where N is a positive integer greater than 1;
- the monochrome image is displayed by controlling a display component of the field sequential display device.
- an image processing apparatus where the apparatus is applied to an image encoding device, and the apparatus includes one or more processors, where the processors are configured to:
- N original sub-pixels contained in any original pixel correspond to different basic colors of the color model respectively, and the color value of any original pixel includes color components of the N original sub-pixels for the corresponding basic colors, where N is a positive integer greater than 1;
- the mixed image When the mixed image corresponding to any basic color is generated, the mixed image is sent to the field sequential display device according to the image transmission rules that conform to the color model, so that the field sequential display device generates and displays a monochrome image corresponding to any basic color based on the mixed image.
- an image processing apparatus is provided, the apparatus being applied to a field sequential display device, the apparatus comprising one or more processors, the processors being configured to:
- determining a color value of each mixed pixel in the mixed image wherein the mixed image corresponds to any basic color of the color model, and the color value of any mixed pixel includes color components of N mixed sub-pixels included in the any mixed pixel for the any basic color, where N is a positive integer greater than 1;
- the monochrome image is displayed by controlling a display component of the field sequential display device.
- an electronic device including:
- a memory for storing processor-executable instructions
- the processor is configured to implement the image processing method described in the first aspect or the second aspect above.
- a non-volatile computer-readable storage medium on which a computer program is stored.
- the program is executed by a processor, the steps of the image processing method described in the first aspect or the second aspect are implemented.
- an image encoding device first determines the color value of each original pixel in an original color image, wherein the N original sub-pixels contained in any original pixel correspond to different basic colors of a color model, and the color value of the original pixel includes the color components of the N original sub-pixels for the corresponding basic colors, where N is a positive integer greater than 1; then, a mixed image corresponding to N basic colors is generated according to the color values of the original pixels, wherein, for any mixed pixel in the mixed image corresponding to any basic color, N original pixels corresponding one-to-one to the N mixed sub-pixels contained in the any mixed pixel are determined in the original color image according to a pixel position mapping relationship, and the color components for the any basic color in the color values of the N original pixels are used as the color components of the corresponding mixed sub-pixels; finally, when the generation of the mixed image corresponding to any basic color is completed, the mixed image is sent to a field sequential display device according to an image transmission rule conforming to
- N original pixel points corresponding to the N mixed sub-pixels contained in the any mixed pixel point will be determined in the original color image according to the pixel position mapping relationship, and the color components for the any basic color in the color values of the N original pixel points will be used as the color components of the corresponding mixed sub-pixels.
- the N mixed sub-pixels in any mixed pixel point in the mixed image are respectively used to record the color components corresponding to the any basic color in different original pixel points, that is, multiple color components corresponding to any basic color in the original color image are concentratedly recorded in one mixed pixel point of the mixed image.
- FIG. 1 is a schematic diagram showing a connection relationship between devices according to an embodiment of the present invention.
- FIG. 2 is a flow chart showing an image processing method according to an embodiment of the present invention.
- FIG. 3 is a schematic diagram showing an image processing process according to an embodiment of the present invention.
- FIG. 4 is a schematic diagram showing a positional relationship between an original sub-pixel and a mixed pixel point according to an embodiment of the present invention.
- FIG. 5 is a schematic diagram showing an original color image and an encoded mixed image according to an embodiment of the present invention.
- FIG. 6 is a flow chart showing another image processing method according to an embodiment of the present invention.
- FIG. 7 is a schematic block diagram of an image processing apparatus according to an embodiment of the present invention.
- FIG1 is a schematic diagram of a connection relationship between devices provided by an exemplary embodiment. As shown in FIG1 , an image encoding device 101 is connected to a field sequential display device 103 via a data transmission channel 102.
- the image encoding device 101 and the field sequential display device 103 may be separate devices, such as the image encoding device 101 may be a terminal device used by a user, exemplarily, the terminal device may be a mobile phone, a tablet device, a laptop computer, a PDA (Personal Digital Assistants), a wearable device (such as smart glasses, smart watches, etc.), a VR (Virtual Reality) device, an AR (Augmented Reality) device, etc.; the field sequential display device 103 may be an independent display device, such as a display, etc. In this case, the data transmission channel 102 between the two may be realized through a cable.
- the terminal device may be a mobile phone, a tablet device, a laptop computer, a PDA (Personal Digital Assistants), a wearable device (such as smart glasses, smart watches, etc.), a VR (Virtual Reality) device, an AR (Augmented Reality) device, etc.
- the field sequential display device 103 may be an independent display device,
- the image encoding device 101 and the field sequential display device 103 may also be different functional components in the same device, such as the image encoding device 101 may be a processing component of a certain display device, and the field sequential display device 103 may be a display component (such as a display screen, etc.) of a certain display device, in which case the data transmission channel 102 between the two may be realized through the bus of the display device or the image data transmission component corresponding to the field sequential display device 103.
- the image encoding device 101 may be a CPU or a GPU of the above-mentioned device
- the field sequential display device 103 may be a display assembled in the device, and the display itself has an independent controller.
- the data transmission channel 102 can have various forms, such as its interface can adopt DP (DisplayPort), HDMI (High Definition Multimedia Interface), DVI (Digital Visual Interface), VGA (Video Graphics Array) and other interface standards, which are not limited in the embodiment of the present invention.
- a buffer can also be included between the image encoding device 101 and the field sequential display device 103, so that the field sequential display device 103 can maintain a relatively stable refresh rate during image playback.
- the image encoding device 101 can encode the original color image by the image processing method to obtain N mixed images, and then send each mixed image to the field sequential display device 103 through the data transmission channel 102.
- the field sequential display device 103 can decode any obtained mixed image by the other processing method to obtain a corresponding monochrome image, and then display the monochrome image locally. It can be understood that for any original color image, after the image encoding device 101 sends the N mixed images obtained by encoding to the field sequential display device 103 in sequence, the field sequential display device 103 can decode and display the corresponding monochrome images in sequence, thereby presenting the color display effect of the original color image to the observer with the help of the visual persistence effect of the human eye.
- the encoding and decoding schemes corresponding to the image processing method of the present invention are described in detail below in conjunction with the accompanying drawings and corresponding embodiments.
- FIG2 is a flow chart of an image processing method shown in an exemplary embodiment of the present invention. As shown in FIG2, the method is applied to an image encoding device. Specifically, the method can be implemented by a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The image processing method may include the following steps 202-206:
- Step 202 determine the color value of each original pixel in the original color image, the N original sub-pixels contained in any original pixel correspond to different basic colors of the color model respectively, and the color value of any original pixel includes the color components of the N original sub-pixels for the corresponding basic colors, and N is a positive integer greater than 1.
- the original color image described in the embodiment of the present invention may be an independent image.
- the field sequential display device may display the multiple monochrome images corresponding to the image repeatedly using the scheme to present the color display effect of the image.
- the original color image may also be a video frame image belonging to any video.
- the field sequential display device may sequentially display the multiple monochrome images corresponding to each video frame image of the video to present the color display effect of the video screen corresponding to the video.
- the color value of the original pixel in the original color image can be represented by a value in a color space
- the color model corresponding to the color space can be in any form, which is not limited in the embodiment of the present invention.
- the color model can be an RGB model, an RGBW model, a CMYK model, etc., wherein the RGB model includes three basic colors of red, green, and blue, the RGBW model includes four basic colors of red, green, blue, and white, and the CMYK model includes cyan, magenta, yellow, and black.
- any original pixel in the original color image contains N (N is a positive integer greater than 1) original sub-pixels, and each original sub-pixel corresponds to a different basic color of the color model, wherein the color value of any original pixel may include the color components of the N original sub-pixels for the corresponding basic colors.
- N is a positive integer greater than 1
- the color model of the original color image is an RGB model
- any original pixel in the image contains original sub-pixels corresponding to the three basic colors of R, G and B, respectively, and the color value of the original pixel includes the color components corresponding to the three original sub-pixels, namely, R value, G value and B value.
- each original pixel in the image can correspond to different pixels in the display screen, and each original sub-pixel in any original pixel can correspond to different partitions in the corresponding pixel that can be independently controlled for display.
- the original color image 301 includes multiple original pixel points such as 1, 2, 3, etc.
- any original pixel point includes three original sub-pixels, such as original pixel point 1 includes three original sub-pixels R1, G1 and B1, original pixel point 2 includes three original sub-pixels R2, G2 and B2, etc., which will not be repeated.
- the original sub-pixels corresponding to different basic colors in FIG3 are filled with gray backgrounds of different depths for the purpose of distinction.
- any original sub-pixel in any of the above original pixels has a color component corresponding to the corresponding basic color.
- the three original sub-pixels R1, G1 and B1 have corresponding color components for red, green and blue respectively.
- the color component of any original sub-pixel does not exceed the value range in the color space corresponding to the RGB model.
- the value range of the color component of any original sub-pixel can be [1,256].
- the color component of R1 for red can be 0, the color component of G1 for green can be 26, the color component of B1 for blue can be 245, etc.
- each original sub-pixel in any original pixel corresponds to the color component of the corresponding basic color, which together constitutes the color value of the original pixel.
- the color value of original pixel 1 includes the color components of original sub-pixels R1, G1 and B1 for red, green and blue respectively; in other words, these three color components together constitute the color value of original pixel 1.
- the color value of any original pixel is actually an array containing N values. It can be seen that the process of the image encoding device determining the color value of each original pixel in the original color image is actually the process of reading the color components of the original sub-pixels contained in each original pixel in the image.
- each original sub-pixel in the original pixel shown in FIG3 is only exemplary. In the use stage of the scheme, each original sub-pixel in the same original pixel can be arranged in any manner, and the embodiment of the present invention does not limit this. It can also be understood that for any image other than the mixed images 3031-3033 in FIG3, the number marked in any pixel (or sub-pixel) is the number of the pixel (or sub-pixel) in the corresponding image, which is only used to distinguish different pixels (or sub-pixels). Any image actually records the color value of any pixel (including the color components of each sub-pixel therein), and the specific value of the color value (or color component) and its number do not have a necessary numerical connection.
- the number of any original pixel or original sub-pixel in the original color image 301 is used to characterize the pixel or sub-pixel.
- the data marked in any mixed pixel in the mixed images 3031-3033 is used to characterize the color component of the mixed pixel and the color component of the original sub-pixel corresponding to which corresponding basic color in the original color image 301 is the same.
- the mixed sub-pixel numbered 7 in the red mixed image 3031 the number is used to represent and characterize the color component of the mixed sub-pixel, which is the color component (corresponding to red) of the red original sub-pixel (numbered 7) in the first original pixel point in the second row of the original color image 301, and will not be repeated here.
- Step 204 generating mixed images corresponding to N basic colors respectively according to the color values of the respective original pixel points, wherein, for any mixed pixel point in the mixed image corresponding to any basic color, N original pixel points corresponding one-to-one to the N mixed sub-pixels contained in the any mixed pixel point are determined in the original color image according to the pixel position mapping relationship, and the color components for the any basic color in the color values of the N original pixel points are respectively used as the color components of the corresponding mixed sub-pixels.
- the image encoding device can generate mixed images corresponding to N basic colors based on the color value.
- the process of generating a mixed image is essentially the process of sequentially determining the color components of the N mixed sub-pixels respectively contained in each mixed pixel in the mixed image. Specifically, for any mixed pixel containing N mixed sub-pixels in a mixed image corresponding to any basic color, the color components of the N original sub-pixels (respectively belonging to different original pixels) in the original color image that correspond one-to-one to the N mixed sub-pixels are used as the color components of the N mixed sub-pixels.
- all original sub-pixels in the original color image 301 can be divided into three categories according to the basic colors, namely, red original sub-pixels 3021, green original sub-pixels 3022, and blue original sub-pixels 3023, wherein the relative position relationship between the original sub-pixels in any category is consistent with the relative position relationship of the original pixels to which they belong in the original color image 301.
- the red original sub-pixel 3021, the green original sub-pixel 3022, and the blue original sub-pixel 3023 can be monochrome images generated according to the original sub-pixels corresponding to the basic colors, or they can be the sub-pixel division results at the logical level, rather than the actually generated monochrome images.
- the image encoding device can determine the N original pixels corresponding to the N mixed sub-pixels in any mixed pixel point according to the pixel position mapping relationship, and then determine the N original sub-pixels corresponding to any basic color in the N original pixels as corresponding to the corresponding mixed sub-pixels.
- the pixel position mapping relationship can be used to record the one-to-one correspondence between the position of the original sub-pixel in the original color image and the position of the corresponding mixed sub-pixel in the mixed image.
- any original pixel point contains N original sub-pixels and each original sub-pixel corresponds to a corresponding basic color
- the position of any original pixel point in the original color image can be used as the position of the N original sub-pixels in the original color image, that is, for other original pixels or other pixels outside the original color image, the original sub-pixels corresponding to each basic color in any original pixel point are in the same position in the original color image.
- the original pixel numbered 1 in the original color image 301 contains three original sub-pixels (i.e., red original sub-pixel 1, green original sub-pixel 1, and blue original sub-pixel 1).
- the positions of these three original sub-pixels in the original color image 301 can be marked with the number "1".
- the other original sub-pixels are similar and will not be repeated here.
- the image encoding device can generate mixed images corresponding to the three basic colors, namely, a red mixed image 3031, a green mixed image 3032, and a blue mixed image 3033, according to the above red original sub-pixel 3021, the green original sub-pixel 3022, and the blue original sub-pixel 3023.
- the red mixed image 3031 as an example, the image records the color components of each mixed sub-pixel contained in each mixed pixel point. It can be seen from the color component determination method in step 204 that the specific value of the color component of any mixed sub-pixel is the same as the specific value of the color component of the original sub-pixel corresponding to the mixed sub-pixel in the original color image 301.
- the specific value of its color component is the same as the specific value of the color component of the first original sub-pixel (i.e., red original sub-pixel 1) contained in the first original pixel point in the original color image 301;
- the specific value of its color component is the same as the specific value of the color component of the second original sub-pixel (i.e., green original sub-pixel 2) contained in the second original pixel point in the original color image 301, and no further details are given.
- the image encoding device can determine the N original pixel points in the original color image that correspond one-to-one to the N mixed sub-pixels contained in any mixed pixel point according to the position correspondence relationship recorded in the aforementioned pixel position mapping relationship. Specifically, the image encoding device can first determine the encoding scaling factor according to the first size of the original color image and the second size of the mixed image, and determine the second position of any mixed pixel point in the mixed image.
- the image encoding device can determine the first position corresponding to the second position in the original color image according to the encoding scaling factor, and then determine the one-to-one correspondence between the N original pixel points at the first position and the N mixed sub-pixels contained in any mixed pixel point.
- the numbers of each mixed pixel point are positive integers and increase in sequence from left to right and from top to bottom; the three mixed sub-pixels in the mixed pixel points with odd numbers correspond to the original sub-pixels in the mixed pixel points with odd numbers in the original color image, and the mixed pixel points adjacent to and located below and to the right of them respectively; the three mixed sub-pixels in the mixed pixel points with even numbers correspond to the original sub-pixels in the mixed pixel points adjacent to and located below, to the right and in the lower right corner of the mixed pixel points in the original color image, respectively.
- the image encoding device can determine that: these three mixed sub-pixels correspond to the red original sub-pixels in the original pixel points numbered 1, 7 and 2 in the original color image 301 respectively; for the three mixed sub-pixels contained in the second (even) pixel point in the first row of the red mixed image 3031, the image encoding device can determine that: these three mixed sub-pixels correspond to the red original sub-pixels in the original pixel points numbered 8, 3 and 9 in the original color image 301 respectively.
- the image encoding device can determine that the three mixed sub-pixels correspond to the red original sub-pixels in the original pixel points numbered 4, 10 and 5 in the original color image 301; for the three mixed sub-pixels contained in the fourth (even) pixel point in the first row of the red mixed image 3031, the image encoding device can determine that the three mixed sub-pixels correspond to the red original sub-pixels in the original pixel points numbered 11, 6 and 12 in the original color image 301.
- the determination method of other mixed pixel points in the red mixed image 3031 and each mixed pixel point in the green mixed pixel point 3032 and the blue mixed pixel point 3033 is similar to this and will not be repeated.
- the image encoding device can determine the corresponding encoding scaling factor. Based on the pixel position mapping relationship corresponding to FIG3, it can be determined that in the process of generating the red mixed image 3031 based on the original color image 301, the three original pixel points numbered 1, 7 and 2 are reduced to a mixed pixel point (i.e., the pixel point composed of the mixed sub-pixels numbered 1, 7 and 2 shown in the red mixed image 3031), and the three original pixel points numbered 8, 3 and 9 are reduced to a mixed pixel point (i.e., the pixel point composed of the mixed sub-pixels numbered 8, 3 and 9 shown in the red mixed image 3031).
- a mixed pixel point i.e., the pixel point composed of the mixed sub-pixels numbered 1, 7 and 2 shown in the red mixed image 3031
- the three original pixel points numbered 8, 3 and 9 are reduced to a mixed pixel point (i.e., the pixel point composed of the mixed sub-pixels numbered 8, 3 and 9 shown
- the mixed pixel points numbered odd are synthesized by the three original sub-pixels at the corresponding positions in the original color image arranged in sequence in a counterclockwise direction
- the mixed pixel points numbered even are synthesized by the three original sub-pixels at the corresponding positions in the original color image arranged in sequence in a clockwise direction.
- the second size of any mixed image generated in the above method is 2560*1920. It can be understood that the above size can be used to characterize the number of pixels in the original color image and the mixed image. Since any original pixel in the original color image contains 3 original sub-pixels and any mixed pixel in the mixed image contains 3 mixed sub-pixels, the data amount of the color component of the original color image corresponding to each original sub-pixel is 3840*3840*3, and the data amount of the color component of any mixed image corresponding to each mixed sub-pixel is 2560*1920*3.
- the embodiment of the present invention does not limit their relative positional relationship.
- the N original pixel points can be continuously adjacent.
- the logic for determining the positions of the N original pixel points is relatively simple, which is convenient for improving the encoding speed. It can be seen from the above embodiments that the original sub-pixels numbered 1, 7 and 2 are continuously adjacent, and the center point connection line of the three forms a right triangle.
- the original sub-pixels corresponding to the three mixed sub-pixels in the same mixed pixel point in the original color image 301 may also have other relative positional relationships.
- the three mixed sub-pixels (i.e. the mixed sub-pixels numbered 1) included in the first mixed pixel point in the first row are still taken as an example.
- the numbers of the three original sub-pixels may be 1, 2 and 3 (the line connecting the center points of the three original sub-pixels is a horizontal straight line) or 1, 7 and 13 (the line connecting the center points of the three original sub-pixels is a vertical straight line), 7, 8 and 9, etc.
- the numbers of the three original sub-pixels may be 1, 8 and 3, 7, 2 and 9, or 1, 7 and 3, 1, 3 and 5, etc., which will not be described in detail.
- the image encoding device can determine the above original sub-pixels according to the position formula. The following is combined with the embodiment shown in FIG3, taking the original color image with a first size of 3840*3840 and the mixed image with a second size of 2560*1920 as an example to illustrate the relevant formula.
- the process of generating a mixed image corresponding to any basic color includes the process of sequentially determining the color components of each mixed sub-pixel in the mixed image for any basic color.
- the image encoding device needs to determine the three original sub-pixels corresponding to the mixed pixel point in the original color image. To this end, it is first necessary to determine the pixel position cur.pos (cur.pos.x, cur.pos.y) corresponding to the mixed pixel point P in the original color image.
- the image coding device supports processing integer data (such as the image coding scheme is implemented by the CPU of the image coding device), in.tex.x ⁇ [0,2560], in.tex.y ⁇ [0,1920]; in this case, cur.pos.x ⁇ [0,2560], cur.pos.y ⁇ [0,1920].
- integer data such as the image coding scheme is implemented by the CPU of the image coding device
- cur.pos.x ⁇ [0,2560] in.pos.y ⁇ [0,1920].
- the image encoding device can calculate the position coordinates raw[0], raw[1] and raw[2] of the three original pixel points corresponding to the mixed pixel point P in the original color image according to the parity of cur.pos.x.
- the mixed pixel point P corresponds to the three original pixel points in the left area, and the coordinate calculation formula of the three original pixel points is shown in the following formula (1); if cur.pos.x is an even number, the mixed pixel point P corresponds to the three original pixel points in the right area, and the coordinate calculation formula of the three original pixel points is shown in the following formula (2).
- the image transmission method corresponding to the encoding scheme can be applied to a GPU (i.e., the image encoding device is a GPU).
- the GPU can also normalize the values of the first size and the second size, and represent the first position and the second position by the normalized coordinate values. In this way, it is possible to ensure that the specific values of the first position and the second position are in the interval [0,1], so that the GPU can accurately and efficiently perform encoding processing on the original color image.
- the aforementioned position coordinates are normalized.
- the above position coordinates can also be normalized.
- the coordinates of the three original pixel points after normalization, raw_rgb[0], raw_rgb[1] and raw_rgb[2], are respectively shown in the following formula (3).
- an offset may be added to the coordinate value of the second position so that the offset second position is inside the original pixel. For example, 0.5 may be added to raw[0], raw[1], and raw[2] as an offset.
- formula (4) may be used to replace formula (3).
- raw_rgb[0], raw_rgb[1], and raw_rgb[2] calculated according to formula (3) or (4) are the position coordinates of the original pixel points corresponding to the mixed pixel point P in the original color image.
- the GPU can sample the color components of the corresponding nine original sub-pixels according to these three position coordinates.
- the GPU can read the red, green, and blue color components corresponding to the position coordinates of raw_rgb[0], raw_rgb[1], and raw_rgb[2], respectively.
- the color components collected and recorded can also be normalized in advance, that is, the value range of any color component can also be [0,1].
- any outColor in formula (5) may also include relevant data such as the transparency value of the corresponding mixed sub-pixel, which is not limited in the embodiment of the present invention.
- the number 1 of the first mixed pixel point (the number of each mixed pixel point is not shown in FIG3) is an odd number, and the position coordinates of the original pixel points numbered 1, 7 and 2 in the left area can be calculated according to formula (1).
- the GPU can determine the color components of each mixed sub-pixel in the first mixed pixel point in the first row of the red mixed image 3031, the green mixed image 3032 and the blue mixed image 3033 by sampling the color components of each original sub-pixel.
- the number 2 of the second mixed pixel point is an even number, and the original pixel points numbered 8, 3 and 9 in the right area can be calculated according to formula (2).
- the GPU can determine the color components of each mixed sub-pixel in the second mixed pixel point in the first row of the red mixed image 3031, the green mixed image 3032 and the blue mixed image 3033 by sampling the color components of each original sub-pixel. In the above manner, the GPU can sequentially determine the color components of each mixed sub-pixel in the above three mixed images, thereby generating the above three mixed images.
- the image encoding device can generate N mixed images corresponding to the image in parallel (such as generating each mixed image at the same time according to the aforementioned formula (5)), or can also generate each mixed image in sequence according to a preset order, such as in the scenario shown in FIG3, generating a red mixed image 3031, a green mixed image 3032 and a blue mixed image 3033 in the order of R, G, and B, and the embodiment of the present invention is not limited to this.
- FIG5 is a schematic diagram of an original color image and a mixed image obtained by encoding according to an embodiment of the present invention.
- FIG5 a is the original color image before encoding
- FIG5 b, c and d are the encoded red mixed image, green mixed image and blue mixed image, respectively. It can be understood that for any mixed pixel point in any of the above mixed images, the color components of the multiple mixed sub-pixels in the mixed pixel point are actually the color components of the corresponding original sub-pixels in the original color image.
- Step 206 when the mixed image corresponding to any basic color is generated, the mixed image is sent to the field sequential display device according to the image transmission rules that conform to the color model, so that the field sequential display device generates and displays a monochrome image corresponding to any basic color based on the mixed image.
- the image encoding device can send the mixed image to the field sequential display device according to the image transmission rule that conforms to the color model. For example, when the original color image conforms to the RGB color model, the image encoding device can use the three channels corresponding to the model to transmit each mixed image.
- the transmission order of each mixed image can be the same as or different from its generation order, which is not limited in the embodiment of the present invention.
- the image encoding device may encode each video frame image in sequence according to the order of each video frame in the video timeline, thereby obtaining N mixed images corresponding to each video frame image, and then transmit each mixed image in sequence according to the order of R, G, and B.
- the three mixed images corresponding to the first video frame image may be transmitted in the order of R, G, and B
- the three mixed images corresponding to the second video frame image may be transmitted in the order of R, G, and B..., which will not be described in detail.
- the field sequential display device can decode the image to generate a monochrome image corresponding to the basic color, and display the monochrome image locally.
- the operations of receiving the mixed image, decoding the mixed image, and displaying the monochrome image can be performed in parallel; and for any mixed image, it can be processed in the order of receiving, decoding, and displaying, which will not be repeated.
- an image encoding device first determines the color value of each original pixel in an original color image, wherein the N original sub-pixels contained in any original pixel correspond to different basic colors of a color model, and the color value of the original pixel includes the color components of the N original sub-pixels for the corresponding basic colors, where N is a positive integer greater than 1; then, a mixed image corresponding to N basic colors is generated according to the color values of the original pixels, wherein, for any mixed pixel in the mixed image corresponding to any basic color, N original pixels corresponding one-to-one to the N mixed sub-pixels contained in the any mixed pixel are determined in the original color image according to a pixel position mapping relationship, and the color components for the any basic color in the color values of the N original pixels are used as the color components of the corresponding mixed sub-pixels; finally, when the generation of the mixed image corresponding to any basic color is completed, the mixed image is sent to a field sequential display device according to an image transmission rule conforming to
- N original pixel points corresponding to the N mixed sub-pixels contained in the any mixed pixel point will be determined in the original color image according to the pixel position mapping relationship, and the color components for the any basic color in the color values of the N original pixel points will be used as the color components of the corresponding mixed sub-pixels.
- the N mixed sub-pixels in any mixed pixel point in the mixed image are respectively used to record the color components corresponding to the any basic color in different original pixels, that is, multiple color components corresponding to any basic color in the original color image are concentratedly recorded in one mixed pixel point of the mixed image.
- the image encoding device needs to use three channels to transmit the three monochrome images corresponding to the original color image 301 respectively.
- the actual amount of data transmitted is 3840*3840*3*3, but 3840*3840*3*2 of the data are invalid data (corresponding to two transmission channels respectively), and the channel utilization rate is 33.3%.
- the image encoding device can use three channels to transmit the three mixed images respectively.
- the actual amount of data transmitted is 2560*1920*3*3, where all the data are the color components of the corresponding original sub-pixels in the original color image, that is, they are all valid data, and the channel utilization rate is 100%. It can be seen that this scheme can realize lossless encoding of the original color image; compared with the scheme in the related art, it can greatly improve the channel utilization rate in the image transmission process, and can effectively avoid frame drops or freezes that may occur during video image transmission.
- an embodiment of the present invention further proposes another image processing scheme for decoding and displaying the received mixed image, which is described in detail below in conjunction with FIG. 6 and related embodiments.
- FIG6 is a flow chart of another image processing method according to an exemplary embodiment of the present invention. As shown in FIG3 , the method is applied to a field sequential display device.
- the image processing method may include the following steps 602-606:
- Step 602 when receiving a mixed image sent according to an image transmission rule that conforms to a color model, determine the color value of each mixed pixel in the mixed image, wherein the mixed image corresponds to any basic color of the color model, and the color value of any mixed pixel includes the color components of N mixed sub-pixels contained in the any mixed pixel for the any basic color, and N is a positive integer greater than 1.
- the process of determining the color value of any mixed pixel in the mixed image is the process of determining the color component of each mixed sub-pixel in the mixed pixel for the corresponding basic color.
- the image encoding device can send the red mixed image 3031, the green mixed image 3032 and the blue mixed image 3033 to the field sequential display device in the order of R, G, and B.
- the field sequential display device can decode each received mixed image in turn to obtain a corresponding monochrome image.
- Step 604 generating a monochrome image corresponding to any one of the basic colors according to the color values of the respective mixed pixel points, wherein, for the N mixed sub-pixels contained in any one of the mixed pixel points, N monochrome pixel points corresponding one to one to the N mixed sub-pixels are determined in the monochrome image according to a pixel position mapping relationship, and the color components of the N mixed sub-pixels for any one of the basic colors are respectively used as the color values of the corresponding monochrome pixel points.
- the process of generating a monochrome image corresponding to any basic color according to a mixed pixel point needs to determine the monochrome pixel points corresponding to each mixed sub-pixel in the mixed image in the corresponding monochrome image.
- N monochrome pixel points corresponding one-to-one to the N mixed sub-pixels can be determined in the monochrome image according to the aforementioned pixel position mapping relationship.
- the field sequential display device can determine a decoding scaling factor based on the third size of the monochrome image and the second size of the mixed image, and determine the second position of any mixed pixel in the mixed image; then, based on the decoding scaling factor, determine a third position corresponding to the second position in the monochrome image, and determine a one-to-one correspondence between the N monochrome pixels at the third position and the N mixed sub-pixels contained in any mixed pixel.
- the number 1 of the first mixed pixel (the numbers of the mixed pixels are not shown in FIG3) is an odd number, and the position coordinates of the original pixels numbered 1, 7 and 2 in the left area can be calculated according to formula (1), so the field sequential display device can use the color components of the mixed sub-pixels recorded in the first mixed pixel as the color values of the monochrome pixels numbered 1, 7 and 2 in the red image 3041.
- the number 2 of the second mixed pixel is an even number, and the position coordinates of the original pixels numbered 8, 3 and 9 in the right area can be calculated according to formula (2), so the field sequential display device can use the color components of the mixed sub-pixels recorded in the second mixed pixel as the color values of the monochrome pixels numbered 8, 3 and 9 in the red image 3041.
- the GPU can sequentially determine the color value of each monochrome pixel in the red image 3041, thereby obtaining the red image 3041. Since each mixed sub-pixel in the red mixed pixel records the color component of the original sub-pixel in the original color image for red, the color value of each monochrome pixel in the red image 3041 generated in the above manner corresponds to red, so the red image is the monochrome image of the red mixed image 3031.
- a green image 3042 corresponding to the green mixed image 3032 and a blue image 3043 corresponding to the blue mixed image 3033 may be generated respectively in the above manner.
- Step 606 Display the monochrome image by controlling a display component of the field sequential display device.
- the field sequential display device may include a control component and a display component, and any of the above components may be implemented by the software and hardware resources in the field sequential display device.
- the field sequential display device may display the monochrome image by controlling the display component. Specifically, the liquid crystal and color film of each pixel in the display component may be controlled, so as to control each pixel to display the corresponding color respectively, so as to display any monochrome image as a whole.
- the field sequential display device may display monochrome images corresponding to different basic colors in sequence according to a preset order and refresh rate, so as to present the color display effect of the original color image in accordance with the "visual persistence effect" of the human eye.
- the field sequential display device may display monochrome images corresponding to different basic colors in sequence according to a preset order and refresh rate, so as to present the color display effect of the original color image in accordance with the "visual persistence effect" of the human eye.
- N original pixel points corresponding to the N mixed sub-pixels contained in the any mixed pixel point will be determined in the original color image according to the pixel position mapping relationship, and the color components for the any basic color in the color values of the N original pixel points will be used as the color components of the corresponding mixed sub-pixels.
- the N mixed sub-pixels in any mixed pixel point in the mixed image are respectively used to record the color components corresponding to the any basic color in different original pixel points, that is, multiple color components corresponding to any basic color in the original color image are concentratedly recorded in one mixed pixel point of the mixed image.
- the present invention also provides an embodiment of an image processing device.
- the device is applied to an image encoding device, and the device includes one or more processors, and the processor is configured to:
- N original sub-pixels contained in any original pixel correspond to different basic colors of the color model respectively, and the color value of any original pixel includes color components of the N original sub-pixels for the corresponding basic colors, where N is a positive integer greater than 1;
- the mixed image When the mixed image corresponding to any basic color is generated, the mixed image is sent to the field sequential display device according to the image transmission rules that conform to the color model, so that the field sequential display device generates and displays a monochrome image corresponding to any basic color based on the mixed image.
- the processor is further configured to:
- a first position corresponding to the second position is determined in the original color image, and a one-to-one correspondence between the N original pixel points at the first position and the N mixed sub-pixels included in any mixed pixel point is determined.
- the image encoding device is a graphics processor GPU, and the processor is further configured to:
- the values of the first size and the second size are normalized, and the first position and the second position are represented by the normalized coordinate values.
- the processor is further configured to:
- An offset is added to the coordinate value of the second position so that the second position after the offset is located inside the original pixel point.
- the N original pixel points in the original color image corresponding one-to-one to the N mixed sub-pixels are continuously adjacent.
- the original color image is a video frame image belonging to any video.
- the present invention also provides another embodiment of an image processing device.
- the device is applied to a field sequential display device, and the device includes one or more processors, and the processor is configured to:
- determining a color value of each mixed pixel in the mixed image wherein the mixed image corresponds to any basic color of the color model, and the color value of any mixed pixel includes color components of N mixed sub-pixels included in the any mixed pixel for the any basic color, where N is a positive integer greater than 1;
- the monochrome image is displayed by controlling a display component of the field sequential display device.
- the processor is further configured to:
- a third position corresponding to the second position is determined in the monochrome image, and a one-to-one correspondence between the N monochrome pixels at the third position and the N mixed sub-pixels included in any mixed pixel is determined.
- An embodiment of the present invention further provides an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to implement the image processing method described in any of the above embodiments.
- An embodiment of the present invention further provides a non-transitory computer-readable storage medium on which a computer program is stored.
- a computer program is stored on which a computer program is stored.
- the apparatus 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
- the device 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input/output (I/O) interface 712 , a sensor component 714 , and a communication component 716 .
- a processing component 702 a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input/output (I/O) interface 712 , a sensor component 714 , and a communication component 716 .
- the processing component 702 generally controls the overall operation of the device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations.
- the processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above-mentioned image processing method.
- the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components.
- the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.
- the memory 704 is configured to store various types of data to support operations on the device 700. Examples of such data include instructions for any application or method operating on the device 700, contact data, phone book data, messages, pictures, videos, etc.
- the memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
- SRAM static random access memory
- EEPROM electrically erasable programmable read-only memory
- EPROM erasable programmable read-only memory
- PROM programmable read-only memory
- ROM read-only memory
- magnetic memory flash memory
- flash memory magnetic disk or optical disk.
- the power supply component 706 provides power to the various components of the device 700.
- the power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 700.
- the multimedia component 708 includes a screen that provides an output interface between the device 700 and the user.
- the screen may include a liquid crystal display (LCD), a field sequential display, and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
- the touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.
- the multimedia component 708 includes a front camera and/or a rear camera. When the device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
- the audio component 710 is configured to output and/or input audio signals.
- the audio component 710 includes a microphone (MIC), and when the device 700 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal.
- the received audio signal can be further stored in the memory 704 or sent via the communication component 716.
- the audio component 710 also includes a speaker for outputting audio signals.
- I/O interface 712 provides an interface between processing component 702 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.
- the sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the device 700.
- the sensor assembly 714 can detect the open/closed state of the device 700, the relative positioning of components, such as the display and keypad of the device 700, and the sensor assembly 714 can also detect the position change of the device 700 or a component of the device 700, the presence or absence of user contact with the device 700, the orientation or acceleration/deceleration of the device 700, and the temperature change of the device 700.
- the sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
- the sensor assembly 714 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
- the sensor assembly 714 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
- the communication component 716 is configured to facilitate wired or wireless communication between the device 700 and other devices.
- the device 700 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G LTE, 6G NR, or a combination thereof.
- the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel.
- the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication.
- the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
- RFID radio frequency identification
- IrDA infrared data association
- UWB ultra-wideband
- Bluetooth Bluetooth
- the apparatus 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned image processing method.
- ASICs application-specific integrated circuits
- DSPs digital signal processors
- DSPDs digital signal processing devices
- PLDs programmable logic devices
- FPGAs field programmable gate arrays
- controllers microcontrollers, microprocessors or other electronic components to perform the above-mentioned image processing method.
- a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by the processor 720 of the device 700 to complete the above-mentioned image processing method.
- the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
一种图像处理方法及装置。该方法包括:确定原始彩色图像中各个原始像素点的颜色值,任一原始像素点包含的N个原始子像素分别对应于色彩模型的不同基础色,其颜色值包括所述N个原始子像素针对相应基础色的颜色分量,N为大于1的正整数;根据各个原始像素点的颜色值生成N种基础色分别对应的混合图像,其中,在原始彩色图像中确定与任一基础色对应的任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将N个原始像素点的颜色值中针对任一基础色的颜色分量分别作为相应混合子像素的颜色分量;将该混合图像发送至场序显示设备,以显示所述任一基础色对应的单色图像。该方法可节省图像编码设备与场序显示设备之间的带宽,避免卡顿。
Description
本发明涉及图像处理技术领域,具体而言,涉及一种图像处理方法及装置。
场序显示设备(或称场序液晶显示屏)是一种新型液晶显示设备,相对于一个像素点由多个分区构成的常规LCD(Liquid Crystal Display,液晶显示器),场序显示设备中的一个像素点由一个分区构成。为了显示彩色图像,可以由其他设备将彩色图像处理为单色图像并发送至场序显示设备,后者可以通过控制各个像素点的液晶和彩膜,控制像素点依次显示不同颜色的单色图像,从而配合人眼的“视觉暂留效应”呈现出彩色图像的显示效果。
然而,基于上述显示原理,场序显示设备需要采用相对于常规LCD更高的刷新率显示各个单色图像。如对于RGB图像而言,要达到常规LCD采用90Hz刷新率时的显示效果,场序显示设备需要按照270Hz的刷新率显示单色图像,相应的,此时其他设备需要每秒渲染并将270帧画面的数据传输至场序显示设备。因此,在图像清晰度较高的场景下(如显示4K视频画面时),其他设备与场序显示设备之间的数据传输通道将面临较大的带宽压力。又由于单色图像往往会遵循相应的多通道规则,如通过RGB三通道分别传输红色、绿色和蓝色图像,此时三个通道分别传输的颜色数据中仅有一个通道是有效数据,所以其他设备和场序显示设备之间的数据传输过程存在严重的带宽浪费,从而在视频播放过程中甚至可能产生掉帧或卡顿。
发明内容
有鉴于此,本发明的实施例提出了一种图像处理方法及装置,以解决相关技术中存在的不足。
根据本发明实施例的第一方面,提出一种图像处理方法,应用于图像编码设备,包括:
确定原始彩色图像中各个原始像素点的颜色值,任一原始像素点包含的N个原始子像素分别对应于色彩模型的不同基础色,所述任一原始像素点的颜色值包括所述 N个原始子像素针对相应基础色的颜色分量,N为大于1的正整数;
根据所述各个原始像素点的颜色值生成N种基础色分别对应的混合图像,其中,针对任一基础色对应的混合图像中的任一混合像素点,根据像素位置映射关系在所述原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将所述N个原始像素点的颜色值中针对所述任一基础色的颜色分量分别作为相应混合子像素的颜色分量;
在生成任一基础色对应的混合图像完成的情况下,按照符合所述色彩模型的图像传输规则将该混合图像发送至场序显示设备,以由所述场序显示设备根据该混合图像生成并显示所述任一基础色对应的单色图像。
根据本发明实施例的第二方面,提出一种图像处理方法,应用于场序显示设备,所述方法包括:
在接收到按照符合色彩模型的图像传输规则发送的混合图像的情况下,确定所述混合图像中各个混合像素点的颜色值,其中,所述混合图像对应于色彩模型的任一基础色,任一混合像素点的颜色值包括所述任一混合像素点所包含N个混合子像素针对所述任一基础色的颜色分量,N为大于1的正整数;
根据所述各个混合像素点的颜色值生成所述任一基础色对应的单色图像,其中,针对所述任一混合像素点包含的N个混合子像素,根据像素位置映射关系在所述单色图像中确定与所述N个混合子像素一一对应的N个单色像素点,并将所述N个混合子像素针对所述任一基础色的颜色分量分别作为相应单色像素点的颜色值;
通过控制所述场序显示设备的显示组件显示所述单色图像。
根据本发明实施例的第三方面,提出一种图像处理装置,所述装置应用于图像编码设备,所述装置包括一个或多个处理器,所述处理器被配置为:
确定原始彩色图像中各个原始像素点的颜色值,任一原始像素点包含的N个原始子像素分别对应于色彩模型的不同基础色,所述任一原始像素点的颜色值包括所述N个原始子像素针对相应基础色的颜色分量,N为大于1的正整数;
根据所述各个原始像素点的颜色值生成N种基础色分别对应的混合图像,其中,针对任一基础色对应的混合图像中的任一混合像素点,根据像素位置映射关系在所述原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将所述N个原始像素点的颜色值中针对所述任一基础色的颜色分量 分别作为相应混合子像素的颜色分量;
在生成任一基础色对应的混合图像完成的情况下,按照符合所述色彩模型的图像传输规则将该混合图像发送至场序显示设备,以由所述场序显示设备根据该混合图像生成并显示所述任一基础色对应的单色图像。
根据本发明实施例的第四方面,提出一种图像处理装置,所述装置应用于场序显示设备,所述装置包括一个或多个处理器,所述处理器被配置为:
在接收到按照符合色彩模型的图像传输规则发送的混合图像的情况下,确定所述混合图像中各个混合像素点的颜色值,其中,所述混合图像对应于色彩模型的任一基础色,任一混合像素点的颜色值包括所述任一混合像素点所包含N个混合子像素针对所述任一基础色的颜色分量,N为大于1的正整数;
根据所述各个混合像素点的颜色值生成所述任一基础色对应的单色图像,其中,针对所述任一混合像素点包含的N个混合子像素,根据像素位置映射关系在所述单色图像中确定与所述N个混合子像素一一对应的N个单色像素点,并将所述N个混合子像素针对所述任一基础色的颜色分量分别作为相应单色像素点的颜色值;
通过控制所述场序显示设备的显示组件显示所述单色图像。
根据本发明实施例的第五方面,提出一种电子设备,包括:
处理器;
用于存储处理器可执行指令的存储器;
其中,所述处理器被配置为实现上述第一方面或第二方面所述的图像处理方法。
根据本发明实施例的第六方面,提出一种非瞬态计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现上述第一方面或第二方面所述的图像处理方法中的步骤。
根据本发明的实施例,图像编码设备先确定原始彩色图像中各个原始像素点的颜色值,任一原始像素点包含的N个原始子像素分别对应于色彩模型的不同基础色,该原始像素点的颜色值包括所述N个原始子像素针对相应基础色的颜色分量,N为大于1的正整数;然后根据所述各个原始像素点的颜色值生成N种基础色分别对应的混合图像,其中,针对任一基础色对应的混合图像中的任一混合像素点,根据像素位置 映射关系在所述原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将所述N个原始像素点的颜色值中针对所述任一基础色的颜色分量分别作为相应混合子像素的颜色分量;最后在生成任一基础色对应的混合图像完成的情况下,按照符合所述色彩模型的图像传输规则将该混合图像发送至场序显示设备,以由所述场序显示设备根据该混合图像生成并显示所述任一基础色对应的单色图像。
如前所述,在生成任一基础色对应的混合图像的过程中,针对任一基础色对应的混合图像中的任一混合像素点,会根据像素位置映射关系在原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将所述N个原始像素点的颜色值中针对所述任一基础色的颜色分量分别作为相应混合子像素的颜色分量。通过该方式,混合图像中任一混合像素点中的N个混合子像素分别用于记录不同的原始像素点中对应于所述任一基础色的颜色分量,即将原始彩色图像中对应于任一基础色的多个颜色分量集中记录于混合图像的一个混合像素点中。
基于此,在后续按照符合所述色彩模型的图像传输规则向场序显示设备传输一张混合图像的过程中,相对于按照该规则传输一张相应的单色图像而言,可以节省(N-1)/N的带宽,从而有效降低了图像编码设备与场序显示设备之间的带宽压力,提升了数据传输通道的利用率。相应的,场序设备接收到任一混合图像之后,只需要解码得到单色图像并显示即可,即便在传输视频画面的场景下,也能够有效避免掉帧或卡顿。
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本发明。
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单的介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1是根据本发明实施例示出的一种设备之间连接关系的示意图。
图2是根据本发明实施例示出的一种图像处理方法的流程图。
图3是根据本发明实施例示出的一种图像处理过程的示意图。
图4是根据本发明实施例示出的一种原始子像素与混合像素点位置关系的示意图。
图5是根据本发明实施例示出的一种原始彩色图像与编码所得混合图像的示意图。
图6是根据本发明实施例示出的另一种图像处理方法的流程图。
图7是根据本发明实施例示出的一种图像处理装置的示意框图。
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
本说明书实施例所述的图像处理方法涉及图像编码设备和场序显示设备两种设备。图1是一示例性实施例提供的一种设备之间连接关系的示意图,如图1所示,图像编码设备101通过数据传输通道102连接至场序显示设备103。
其中,所述图像编码设备101与场序显示设备103可以为分立设备,如图像编码设备101可以为用户使用的终端设备,示例性的,该终端设备可以为手机、平板设备、笔记本电脑、掌上电脑(PDAs,Personal Digital Assistants)、可穿戴设备(如智能眼镜、智能手表等)、VR(Virtual Reality,虚拟现实)设备、AR(Augmented Reality,增强现实)设备等;所述场序显示设备103可以为独立显示设备,如显示器等。此时二者之间的数据传输通道102可以通过线缆实现。或者,所述图像编码设备101和场序显示设备103也可以分别为同一设备中的不同功能组件,如图像编码设备101可以为某一显示设备的处理组件、场序显示设备103可以为某一显示设备的显示组件(如显示屏等),此时二者之间的数据传输通道102可以通过该显示设备的总线或者场序显示设备103对应的图像数据传输组件实现。例如,所述图像编码设备101可以为上述设备的CPU或GPU,而所述场序显示设备103可以为该设备中装配的显示器,该显示器自身具有独立控制器。
另外,所述数据传输通道102可以具有多种形式,如其接口可以采用DP (DisplayPort)、HDMI(High Definition Multimedia Interface,高清多媒体接口)、DVI(Digital Visual Interface,数字视频接口)、VGA(Video Graphics Array,视频图形阵列)等接口标准,本发明实施例并不对此进行限定。以及,所述图像编码设备101和场序显示设备103之间还可以包含缓冲区(Buffer),以便于场序显示设备103在图像播放过程中保持较为稳定的刷新率。
在本说明书实施例中,图像编码设备101可以通过所述图像处理方法对原始彩色图像进行编码处理以得到N张混合图像,然后通过所述数据传输通道102将各张混合图像分别发送至场序显示设备103。相应的,场序显示设备103可以通过所述另一种处理方法对获取到的任一混合图像进行解码处理以得到相应的单色图像,然后在本地显示所述单色图像。可以理解的是,对于任一原始彩色图像而言,图像编码设备101将编码得到的N张混合图像依次发送至场序显示设备103后,场序显示设备103可以依次解码并展示相应的单色图像,从而借助人眼的视觉暂留效应,向观察者呈现出所述原始彩色图像的彩色显示效果。下面结合附图及相应实施例对本发明所述图像处理方法对应的编码和解码方案进行详细描述。
图2是本发明示例性实施例示出的一种图像处理方法的流程图。如图2所示,该方法应用于图像编码设备,具体而言,该方法可以由CPU(Central Processing Unit,中央处理器)或GPU(Graphics Processing Unit,图形处理器)实现。所述图像处理方法可以包括以下步骤202-206:
步骤202,确定原始彩色图像中各个原始像素点的颜色值,任一原始像素点包含的N个原始子像素分别对应于色彩模型的不同基础色,所述任一原始像素点的颜色值包括所述N个原始子像素针对相应基础色的颜色分量,N为大于1的正整数。
本发明实施例所述的原始彩色图像可以为独立图像,此时,利用该方案场序显示设备可以通过重复显示该图像对应的多张单色图像,以呈现出该图像的彩色显示效果。或者,所述原始彩色图像也可以为归属于任一视频的视频帧图像,此时利用该方案,场序显示设备可以顺序显示该视频的各个视频帧图像分别对应的多张单色图像,以呈现出该视频所对应视频画面的彩色显示效果。
另外,所述原始彩色图像中原始像素点的颜色值可以采用色彩空间中的取值加以表示,所述色彩空间对应的色彩模型可以为任意形式,本发明实施例并不对此进行限定。示例性的,所述色彩模型可以为RGB模型、RGBW模型、CMYK模型等,其中,RGB模型包括红色(Red)、绿色(Green)和蓝色(Blue)这三个基础色,RGBW 模型包括红色(Red)、绿色(Green)、蓝色(Blue)和白色(White)这四个基础色,CMYK模型包括青色(Cyan)、品红色(Magenta)、黄色(Yellow)和黑色(Black)。
无论采用何种色彩模型,所述原始彩色图像中任一原始像素点包含N(N为大于1的正整数)个原始子像素,而各个原始子像素分别对应于该色彩模型的不同基础色,其中任一原始像素点的颜色值可以包括其中N个原始子像素针对相应基础色的颜色分量。如在原始彩色图像的色彩模型为RGB模型的情况下,N=3,即此时该图像中任一原始像素点包含R、G和B三种基础色分别对应的原始子像素,而该原始像素点的颜色值即包含这三个原始子像素分别对应的颜色分量,即R值、G值和B值。实际上,在采用常规LCD显示所述原始彩色图像时,该图像中的各个原始像素点可以分别对应于显示屏中的不同像素,任一原始像素点中的各个原始子像素,可以分别对应于相应像素中可以独立控制显示的不同分区。
下面结合图3,以RGB模型为例进行说明。如图3所示,原始彩色图像301包含1、2、3……等多个原始像素点。其中,任一原始像素点包含三个原始子像素,如原始像素点1包含R1、G1和B1这三个原始子像素、原始像素点2包含R2、G2和B2这三个原始子像素等,不再赘述。图3中不同基础色对应的原始子像素分别采用不同深度的灰色背景进行填充,以便区分。
上述任一原始像素点中的任一原始子像素具有对应于相应基础色的颜色分量,以原始像素点1为例,R1、G1和B1这三个原始子像素分别针对红色、绿色和蓝色具有相应的颜色分量。任一原始子像素的颜色分量不超出所述RGB模型所对应颜色空间中的取值范围,如所述RGB模型中各个基础色对应的颜色分量采用位长为8bit的数值表示的情况下,任一原始子像素的颜色分量的取值范围可以为[1,256],如R1针对红色的颜色分量可以为0、G1针对绿色的颜色分量可以为26、B1针对蓝色的颜色分量可以为245等。
另外,任一原始像素点中各个原始子像素对应于相应基础色的颜色分量,共同构成该原始像素点的颜色值,如原始像素点1的颜色值,即包含原始子像素R1、G1和B1分别针对红色、绿色和蓝色的颜色分量;换言之,这三个颜色分量共同构成原始像素点1的颜色值,可见,任一原始像素点的颜色值实际上是包含N个数值的数组。由此可见,图像编码设备确定原始彩色图像中各个原始像素点的颜色值的过程,实际上就是读取该图像中各个原始像素点分别包含的原始子像素的颜色分量的过程。
另外需要说明的是,图3所示原始像素点中各个原始子像素的排列方式仅是示 例性的,在方案使用阶段,同一原始像素点中各个原始子像素可以采用任意方式进行排列,本发明实施例并不对此进行限定。而且可以理解的是,对于图3中除混合图像3031-3033之外的任一图像,其中任一像素点(或子像素)中所标记的数字,是该像素点(或子像素)在相应图像中的编号,仅用于区分不同的像素点(或子像素)。任一图像实际上记录有任一像素点的颜色值(包含其中各个子像素的颜色分量),该颜色值(或颜色分量)的具体值与其编号并不存在数值上的必然联系。如原始彩色图像301中的任一原始像素点或原始子像素的编号用于表征该像素点或子像素。而混合图像3031-3033中任一混合像素点中标记的数据,用于表征该混合像素点的颜色分量与原始彩色图像301中哪个相应基础色对应的原始子像素的颜色分量相同。如红色混合图像3031中编号为7的混合子像素,该编号用于和表征该混合子像素的颜色分量为原始彩色图像301第二行第一个原始像素点中的红色原始子像素(编号为7)的(对应于红色的)颜色分量,不再赘述。
步骤204,根据所述各个原始像素点的颜色值生成N种基础色分别对应的混合图像,其中,针对任一基础色对应的混合图像中的任一混合像素点,根据像素位置映射关系在所述原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将所述N个原始像素点的颜色值中针对所述任一基础色的颜色分量分别作为相应混合子像素的颜色分量。
在确定出原始彩色图像中各个原始像素点的颜色值的情况下,图像编码设备可以基于该颜色值生成N种基础色分别对应的混合图像。其中,生成混合图像的过程,本质上就是依次确定混合图像中各个混合像素点分别包含的N个混合子像素的颜色分量的过程。具体到任一基础色对应的混合图像中的包含N个混合子像素的任一混合像素点而言,就是将原始彩色图像中与所述N个混合子像素一一对应的N个原始子像素(分别属于不同的原始像素点)的颜色分量作为所述N个混合子像素的颜色分量。
如图3所示,针对原始彩色图像301中的全部原始子像素,可以按照基础色将其划分为三类,即红色原始子像素3021、绿色原始子像素3022和蓝色原始子像素3023,其中,任一类中的各个原始子像素之间的相对位置关系与各自所属原始像素点在原始彩色图像301中的相对位置关系保持一致。但需要说明的是,对于上述红色原始子像素3021、绿色原始子像素3022和蓝色原始子像素3023,既可以是根据各个基础色对应的原始子像素生成的单色图像,也可以分别是逻辑层面的子像素划分结果,而并非实际生成的单色图像。
图像编码设备可以根据像素位置映射关系确定与任一混合像素点中的N个混合子像素一一对应的N个原始像素点,然后将所述N个原始像素点中对应于所述任一基础色的N个原始子像素确定为与相应的混合子像素一一对应。所述像素位置映射关系可以用于记录原始子像素在原始彩色图像中的位置与相应的混合子像素在混合图像中的位置之间的一一对应关系。其中,由于任一原始像素点中包含N个原始子像素且各个原始子像素分别对应于相应的基础色,所以可以将所述任一原始像素点在原始彩色图像中的位置作为其中N个原始子像素在原始彩色图像中的位置,即针对其他原始像素点或者原始彩色图像之外的其他像素点而言,所述任一原始像素点中分别对应于各个基础色的原始子像素在原始彩色图像中处于相同的位置。如图3所示,原始彩色图像301中编号为1的原始像素点中包含三个原始子像素(即红色原始子像素1、绿色原始子像素1和蓝色原始子像素1),则这三个原始子像素在原始彩色图像301中所处的位置均可以用编号“1”标记,其他原始子像素与此类似,不再赘述。
基于上述像素位置映射关系,图像编码设备可以根据上述红色原始子像素3021、绿色原始子像素3022和蓝色原始子像素3023生成三种基础色分别对应的混合图像,即红色混合图像3031、绿色混合图像3032和蓝色混合图像3033。以红色混合图像3031为例,该图像中记录有各个混合像素点所包含各个混合子像素的颜色分量,由步骤204中的颜色分量确定方式可知,任一混合子像素的颜色分量的具体值即与该混合子像素在原始彩色图像301中对应的原始子像素的颜色分量的具体值相同。如对于第一个混合像素点中的第一个混合子像素(即红色混合子像素1),其颜色分量的具体值与原始彩色图像301中第一个原始像素点所包含的第一个原始子像素(即红色原始子像素1)的颜色分量的具体值相同;再如对于第二个混合像素点中的第二个混合子像素(即绿色混合子像素2),其颜色分量的具体值与原始彩色图像301中第二个原始像素点所包含的第二个原始子像素(即绿色原始子像素2)的颜色分量的具体值相同,不再赘述。
为确保所生成的任一基础色对应的混合图像具有上述效果,图像编码设备可以根据前述像素位置映射关系中记录的位置对应关系,在所述原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点。具体的,图像编码设备可以先根据原始彩色图像的第一尺寸和混合图像的第二尺寸确定编码缩放系数,并确定所述任一混合像素点在所述混合图像中所处的第二位置。然后,图像编码设备可以根据所述编码缩放系数在原始彩色图像中确定对应于所述第二位置的第一位置,然后确定处于第一位置处的N个原始像素点与所述任一混合像素点包含的N个混 合子像素之间的一一对应关系。
如图3所示,若前述像素位置映射关系中记录有:各个混合像素点编号均为正整数且按照从左到右、从上到下的顺序依次递增;编号为奇数的混合像素点中的三个混合子像素分别对应于原始彩色图像中编号为奇数列的混合像素点、与其相邻且分别位于其下方和右侧的混合像素点中的原始子像素;编号为偶数的混合像素点中的三个混合子像素分别对应于原始彩色图像中与编号为偶数列的混合像素点相邻的、且分别位于其下方、右侧和右下角的混合像素点中的原始子像素。基于此,对于红色混合图像3031首行的第一个(奇数)像素点所包含的三个混合子像素,图像编码设备可以确定:这三个混合子像素分别对应于原始彩色图像301中编号为1、7和2的原始像素点中的红色原始子像素;对于红色混合图像3031首行的第二个(偶数)像素点所包含的三个混合子像素,图像编码设备可以确定:这三个混合子像素分别对应于原始彩色图像301中编号为8、3和9的原始像素点中的红色原始子像素。类似的,对于红色混合图像3031首行的第三个(奇数)像素点所包含的三个混合子像素,图像编码设备可以确定:这三个混合子像素分别对应于原始彩色图像301中编号为4、10和5的原始像素点中的红色原始子像素;对于红色混合图像3031首行的第四个(偶数)像素点所包含的三个混合子像素,图像编码设备可以确定:这三个混合子像素分别对应于原始彩色图像301中编号为11、6和12的原始像素点中的红色原始子像素。红色混合图像3031中的其他混合像素点以及绿色混合像素点3032和蓝色混合像素点3033中各个混合像素点的确定方式与此类似,不再赘述。
基于上述像素位置映射关系以及第一尺寸和第二尺寸,图像编码设备可以确定相应的编码缩放系数。基于图3对应的像素位置映射关系可以确定,在基于原始彩色图像301生成红色混合图像3031的过程中,编号为1、7和2的三个原始像素点被缩减为一个混合像素点(即红色混合图像3031所示编号为1、7和2的混合子像素构成的像素点),编号为8、3和9的三个原始像素点被缩减为一个混合像素点(即红色混合图像3031所示编号为8、3和9的混合子像素构成的像素点)。可见,在任一基础色对应的混合图像中,编号为奇数的混合像素点由原始彩色图像中相应位置的三个原始子像素按照逆时针方向依次排列合成、编号为偶数的混合像素点由原始彩色图像中相应位置的三个原始子像素按照顺时针方向依次排列合成。
显然,对于任意三个原始像素点及其对应的一个混合像素点而言,横向上,原始彩色图像中的三个原始像素点对应于混合图像中的两个混合像素点;纵向上,原始 彩色图像中的两个原始像素点对应于混合图像中的一个混合像素点。可见,通过上述编码方式可以将原始彩色图像中的三列列合成为混合图像中的两列——纵向的列数变为原来的2/3;同时,原始彩色图像中的两行合成为混合图像中的一行——纵向的行数变为原来的1/2。综合来看,编码后的任一混合图像的数据量减少为编码前的原始彩色图像的数据量的1/2*2/3=1/3。如图3所示,若原始彩色图像为4K视频中的视频帧图像,其第一尺寸为3840*3840,则按照上述方式生成的任一混合图像的第二尺寸为2560*1920。可以理解的是,上述尺寸可以用于表征原始彩色图像和混合图像中像素点的个数,由于原始彩色图像中的任一原始像素点包含3个原始子像素、混合图像中的任一混合像素点包含3个混合子像素,所以原始彩色图像对应于各个原始子像素的颜色分量的数据量为3840*3840*3,任一混合图像对应于各个混合子像素的颜色分量的数据量为2560*1920*3。考虑到图像编码设备共生成三张混合图像(即红色混合图像3031、绿色混合图像3032和蓝色混合图像3033),所以根据原始彩色图像生成的混合图像的总数据量与原始彩色图像数据量并无差别(3*2560*1920*3=3840*3840*3),即编码后的混合图像中记录了原始彩色图像中全部的颜色分量,因此该方案能够实现对原始彩色图像的无损编码。
对于与任一混合像素点中的N个混合子像素一一对应的N个原始像素点,本发明实施例对其相对位置关系并不进行限定。例如,所述N个原始像素点可以连续相邻,此时N个原始像素点的位置确定逻辑较为简单,便于提升编码速度。由前述实施例可知,编号为1、7和2的原始子像素连续相邻,且三者的中心点连线构成直角三角形。实际上,同一混合像素点中的三个混合子像素在原始彩色图像301中分别对应的原始子像素也可以具有其他的相对位置关系。对于红色混合图像3031、绿色混合图像3032和蓝色混合图像3033中的任一混合图像,仍以其首行中的第一个混合像素点包含的三个混合子像素(即编号为1的混合子像素)为例,在这三个混合子像素一一对应的原始子像素相邻的情况下,这三个原始子像素的编号除了分别为1、7和2之外,也可以分别为1、2和3(此时这三个原始子像素的中心点连线为横向直线),或者分别为1、7和13(此时这三个原始子像素的中心点连线为纵向直线),分别为7、8和9等。而在上述三个混合子像素一一对应的原始子像素不相邻的情况下,这三个原始子像素的编号可以分别为1、8和3,分别为7、2和9,或者也可以分别为1、7和3,分别为1、3和5等,不再赘述。
由前述实施例可见,在根据原始彩色图像中各个原始像素点的颜色值生成混合图像的过程中,确定各个混合子像素分别对应的原始子像素至关重要。具体的,图像 编码设备可以按照位置公式确定上述原始子像素,下面结合图3所示实施例,以原始彩色图像第一尺寸为3840*3840、混合图像的第二尺寸为2560*1920为例对相关公式进行说明。
如前所述,生成任一基础色对应的混合图像的过程,即包括依次确定该混合图像中各个混合子像素针对所述任一基础色的颜色分量的过程。针对混合图像中坐标为in.text(in.tex.x,in.tex.y)的任一混合像素点P,图像编码设备需要确定该混合像素点在原始彩色图像中对应的三个原始子像素。对此,首先需要确定混合像素点P在原始彩色图像中对应的像素位置cur.pos(cur.pos.x,cur.pos.y)。
在图像编码设备支持处理整数类型的数据(如图像编码方案由图像编码设备的CPU实现)的情况下,所述in.tex.x∈[0,2560],in.tex.y∈[0,1920];此时,cur.pos.x∈[0,2560],cur.pos.y∈[0,1920]。而在图像编码设备支持处理[0,1]区间内的小数类型的数据(如图像编码设备为GPU)的情况下,所述in.tex.x∈[0,1],in.tex.y∈[0,1],此时cur.pos.x=int(in.tex.x*2560)∈[0,2560),cur.pos.y=int(in.tex.y*1920)∈[0,1920)。
此时,图像编码设备可以根据cur.pos.x的奇偶性计算原始彩色图像中与混合像素点P对应的三个原始像素点的位置坐标raw[0],raw[1]和raw[2]。如图4所示,若cur.pos.x是奇数,则混合像素点P对应于左侧区域中的三个原始像素点,此时这三个原始像素点的坐标计算公式参见下式(1);若cur.pos.x是偶数,则混合像素点P对应于右侧区域中的三个原始像素点,此时这三个原始像素点的坐标计算公式参见下式(2)。
如前所述,所述编码方案对应的图像传输方法可以应用于GPU(即所述图像编码设备为GPU),在该场景下,考虑到现阶段的GPU通常可以处理[0,1]区间内的数 值,因此GPU还可以对前述第一尺寸和第二尺寸的数值进行归一化处理,并通过归一化处理后的坐标值表示所述第一位置和第二位置。通过该方式,能够确保第一位置和第二位置的具体值处于[0,1]区间中,从而便于GPU准确、高效地进行针对原始彩色图像的编码处理。对前述位置坐标进行归一化处理。
对应于上述归一化处理,还可以对前述位置坐标进行归一化处理。其中,归一化处理后的三个原始像素点的坐标raw_rgb[0]、raw_rgb[1]和raw_rgb[2]分别参见下式(3)。
其中,为了确保针对各个原始子像素的颜色分量采样准确,还可以对第二位置的坐标值增加偏移量,以使偏移后的所述第二位置处于原始像素点内部。例如,可以在raw[0],raw[1]和raw[2]中加入0.5作为偏移量,具体的,可以采用式(4)替换所述式(3)。
至此,根据式(3)或(4)计算得到的raw_rgb[0]、raw_rgb[1]和raw_rgb[2]即为混合像素点P在原始彩色图像中对应的各个原始像素点的位置坐标。此时,GPU即可按照这三个位置坐标对相应的九个原始子像素的颜色分量进行sampler采样。具体的,GPU可以根据raw_rgb[0]、raw_rgb[1]和raw_rgb[2]的位置坐标,分别读取该位置坐标对应的红色、绿色和蓝色的颜色分量。当然,被采集并记录的所述颜色分量也可以预先进行归一化处理,即任一颜色分量的取值范围也可以为[0,1]。
采样得到三个原始像素点的颜色分量texColor0、texColor1、texColor2后,根据R、G或B分别合成相应颜色的混合像素点,参见式(5)。
至此,采样得到的所述outColorR即为红色混合图像中的混合像素点P中各个 混合子像素的颜色分量、outColorG即为绿色混合图像中的混合像素点P中各个混合子像素的颜色分量、outColorB即为蓝色混合图像中的混合像素点P中各个混合子像素的颜色分量。另外,式(5)中任一outColor中除了包含相应的三个颜色分量之外,还可以包含相应混合子像素的透明度值等相关数据,本发明实施例并不对此进行限定。
以图3所示各个混合像素点中首行的第一个和第二个混合像素点为例,如图4所示,第一个混合像素点的编号1(各个混合像素点的编号图3中并未示出)是奇数,根据式(1)可以计算出左侧区域中编号分别为1、7和2的原始像素点的位置坐标,GPU通过采样各个原始子像素的颜色分量,可以分别确定红色混合图像3031、绿色混合图像3032和蓝色混合图像3033中首行的第一个混合像素点中各个混合子像素的颜色分量。类似的,第二个混合像素点的编号2是偶数,根据式(2)可以计算出右侧区域中编号分别为8、3和9的原始像素点,GPU通过采样各个原始子像素的颜色分量,可以分别确定红色混合图像3031、绿色混合图像3032和蓝色混合图像3033中首行的第二个混合像素点中各个混合子像素的颜色分量。通过上述方式,GPU可以依次确定上述三张混合图像中各个混合子像素的颜色分量,从而生成上述三张混合图像。
至此,对原始彩色图像所对应N张混合图像的生成过程介绍完毕。需要说明的是,对于任一原始彩色图像而言,图像编码设备可以并行生成该图像对应的N张混合图像(如按照前述式(5)同时生成各个混合图像),或者也可以按照预设顺序依次生成各张混合图像,如在图3所示场景下,按照R、G、B的顺序先后生成红色混合图像3031、绿色混合图像3032和蓝色混合图像3033,本发明实施例并不对此进行限定。
图5是根据本发明实施例示出的一种原始彩色图像与编码所得混合图像的示意图。如图5所示,图5的a为编码前的原始彩色图像,图5的b、c和d分别为编码得到的红色混合图像、绿色混合图像和蓝色混合图像。可以理解的是,对于上述任一混合图像中的任一混合像素点而言,该混合像素点中的多个混合子像素的颜色分量实际是原始彩色图像中相应原始子像素的颜色分量。
步骤206,在生成任一基础色对应的混合图像完成的情况下,按照符合所述色彩模型的图像传输规则将该混合图像发送至场序显示设备,以由所述场序显示设备根据该混合图像生成并显示所述任一基础色对应的单色图像。
在生成原始彩色图像对应的N张混合图像之后,图像编码设备可以按照符合所述色彩模型的图像传输规则将该混合图像发送至场序显示设备,如在原始彩色图像符合RGB色彩模型的情况下,图像编码设备可以采用该模型对应的三通道传输各张混合 图像。另外,各张混合图像的传输顺序与其生成顺序可以相同或不同,本发明实施例并不对此进行限定。
在一实施例中,在所述原始彩色图像为归属于任一视频的视频帧图像的情况下,图像编码设备可以按照各张视频帧在视频时间轴中的顺序依次编码各张视频帧图像,从而得到各张视频帧图像分别对应的N张混合图像,然后按照R、G、B的顺序依次传输各张混合图像。如可以按照R、G、B的顺序先传输第一张视频帧图像对应的三张混合图像、在按照R、G、B的顺序传输第二章视频帧图像对应的三张混合图像……,不再赘述。
相应的,场序显示设备在接收到任一基础色对应的任一混合图像后,可以解码该图像以生成该基础色对应的单色图像,并在本地显示该单色图像。对场序显示设备所处理的不同图像而言,其接收混合图像、解码混合图像和显示单色图像的操作可以并行进行;而对于任一混合图像而言,其可以按照上述接收、解码和显示的顺序依次进行处理,不再赘述。
根据本发明的实施例,图像编码设备先确定原始彩色图像中各个原始像素点的颜色值,任一原始像素点包含的N个原始子像素分别对应于色彩模型的不同基础色,该原始像素点的颜色值包括所述N个原始子像素针对相应基础色的颜色分量,N为大于1的正整数;然后根据所述各个原始像素点的颜色值生成N种基础色分别对应的混合图像,其中,针对任一基础色对应的混合图像中的任一混合像素点,根据像素位置映射关系在所述原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将所述N个原始像素点的颜色值中针对所述任一基础色的颜色分量分别作为相应混合子像素的颜色分量;最后在生成任一基础色对应的混合图像完成的情况下,按照符合所述色彩模型的图像传输规则将该混合图像发送至场序显示设备,以由所述场序显示设备根据该混合图像生成并显示所述任一基础色对应的单色图像。
如前所述,在生成任一基础色对应的混合图像的过程中,针对任一基础色对应的混合图像中的任一混合像素点,会根据像素位置映射关系在原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将所述N个原始像素点的颜色值中针对所述任一基础色的颜色分量分别作为相应混合子像素的颜色分量。通过该方式,混合图像中任一混合像素点中的N个混合子像素分别用于记录不同的原始像素点中对应于所述任一基础色的颜色分量,即将原始彩色图像中对应 于任一基础色的多个颜色分量集中记录于混合图像的一个混合像素点中。
基于此,在后续按照符合所述色彩模型的图像传输规则向场序显示设备传输一张混合图像的过程中,相对于按照该规则传输一张相应的单色图像而言,可以节省(N-1)/N的带宽,从而有效降低了图像编码设备与场序显示设备之间的带宽压力,提升了数据传输通道的利用率。相应的,场序设备接收到任一混合图像之后,只需要解码得到单色图像并显示即可,即便在传输视频画面的场景下,也能够有效避免掉帧或卡顿。
对于图3所示的原始彩色图像,若采用相关技术中的单色图像传输方式,图像编码设备需要采用三通道分别传输原始彩色图像301对应的三张单色图像,此时实际传输的数据量为3840*3840*3*3,但其中有3840*3840*3*2的数据为无效数据(分别对应于两个传输通道),此时通道利用率为33.3%。而采用前述编码方案生成原始彩色图像301对应的三张混合图像之后,图像编码设备可以采用三通道分别传输这三张混合图像,此时实际传输的数据量为2560*1920*3*3,其中所有数据均为原始彩色图像中相应原始子像素的颜色分量,即均为有效数据,此时通道利用率为100%。可见,本方案能够实现对原始彩色图像的无损编码;相对于相关技术中的方案,能够大幅提升图像传输过程中的通道利用率,能够有效避免视频画面传输过程中可能出现的掉帧或卡顿。
对应于用于对原始彩色图像进行解码以生成混合图像的前述图像处理方法,本发明实施例还提出了另一种图像处理方案,用于对接收到的混合图像进行解码并显示,下面结合附图6和相关实施例进行详细描述。
图6是本发明示例性实施例示出的另一种图像处理方法的流程图。如图3所示,该方法应用于场序显示设备。所述图像处理方法可以包括以下步骤602-606:
步骤602,在接收到按照符合色彩模型的图像传输规则发送的混合图像的情况下,确定所述混合图像中各个混合像素点的颜色值,其中,所述混合图像对应于色彩模型的任一基础色,任一混合像素点的颜色值包括所述任一混合像素点所包含N个混合子像素针对所述任一基础色的颜色分量,N为大于1的正整数。
与前述实施例类似的,确定所述混合图像中任一混合像素点的颜色值的过程,即为确定该混合像素点中各个混合子像素针对相应基础色的颜色分量的过程。承接于前述实施例,图像编码设备可以按照R、G、B的顺序,依次向场序显示设备发送所述 红色混合图像3031、绿色混合图像3032和蓝色混合图像3033。相应的,场序显示设备可以依次对接收到的各个混合图像进行解码处理,以得到相应的单色图像。
步骤604,根据所述各个混合像素点的颜色值生成所述任一基础色对应的单色图像,其中,针对所述任一混合像素点包含的N个混合子像素,根据像素位置映射关系在所述单色图像中确定与所述N个混合子像素一一对应的N个单色像素点,并将所述N个混合子像素针对所述任一基础色的颜色分量分别作为相应单色像素点的颜色值。
与前述编码过程对应的,根据混合像素点生成任一基础色对应的单色图像的过程,需要确定该混合图像中各个混合子像素在相应的单色图像中对应的单色像素点。如针对任一混合像素点包含的N个混合子像素,可以根据前述像素位置映射关系在所述单色图像中确定与所述N个混合子像素一一对应的N个单色像素点。
在一实施例中,场序显示设备可以根据所述单色图像的第三尺寸和所述混合图像的第二尺寸确定解码缩放系数,并确定所述任一混合像素点在所述混合图像中所处的第二位置;然后根据所述解码缩放系数,在所述单色图像中确定对应于所述第二位置的第三位置,并确定处于第三位置处的N个单色像素点与所述任一混合像素点包含的N个混合子像素之间的一一对应关系。
以图3所示的红色混合图像3031为例,对于该混合像素点中首行的第一个和第二个混合像素点,如图4所示,第一个混合像素点的编号1(各个混合像素点的编号图3中并未示出)是奇数,根据式(1)可以计算出左侧区域中编号分别为1、7和2的原始像素点的位置坐标,所以场序显示设备可以将第一个混合像素点中记录的各个混合子像素的颜色分量分别作为红色图像3041中编号分别为1、7和2的单色像素点的颜色值。类似的,第二个混合像素点的编号2是偶数,根据式(2)可以计算出右侧区域中编号分别为8、3和9的原始像素点的位置坐标,所以场序显示设备可以将第二个混合像素点中记录的各个混合子像素的颜色分量分别作为红色图像3041中编号分别为8、3和9的单色像素点的颜色值。
通过上述方式,GPU可以依次确定红色图像3041中各个单色像素点的颜色值,从而得到红色图像3041。由于红色混合像素中的各个混合子像素记录的是原始彩色图像中原始子像素针对红色的颜色分量,所以通过上述方式生成的红色图像3041中各个单色像素点的颜色值均对应于红色,所以该红色图像即为红色混合图像3031的单色图像。
类似的,通过上述方式可以分别生成对应于绿色混合图像3032的绿色图像3042和对应于蓝色混合图像3033的蓝色图像3043。
步骤606,通过控制所述场序显示设备的显示组件显示所述单色图像。
所述场序显示设备可以包含控制组件和显示组件,上述任一组件可以通过场序显示设备中的软硬件资源实现。在生成任一单色图像后,场序显示设备可以通过控制所述显示组件显示所述单色图像。具体的,可以控制所述显示组件中各个像素点的液晶和彩膜,从而控制各个像素点分别显示相应的颜色,以整体显示出所述任一单色图像。可以理解的是,场序显示设备可以按照预设顺序和刷新率依次显示不同基础色分别对应的单色图像,从而配合人眼的“视觉暂留效应”呈现出所述原始彩色图像的彩色显示效果。具体可参见相关技术中针对场序显示设备工作原理的记载,此处不再赘述。
如前所述,在生成任一基础色对应的混合图像的过程中,针对任一基础色对应的混合图像中的任一混合像素点,会根据像素位置映射关系在原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将所述N个原始像素点的颜色值中针对所述任一基础色的颜色分量分别作为相应混合子像素的颜色分量。通过该方式,混合图像中任一混合像素点中的N个混合子像素分别用于记录不同的原始像素点中对应于所述任一基础色的颜色分量,即将原始彩色图像中对应于任一基础色的多个颜色分量集中记录于混合图像的一个混合像素点中。
基于此,在后续按照符合所述色彩模型的图像传输规则向场序显示设备传输一张混合图像的过程中,相对于按照该规则传输一张相应的单色图像而言,可以节省(N-1)/N的带宽,从而有效降低了图像编码设备与场序显示设备之间的带宽压力,提升了数据传输通道的利用率。相应的,场序设备接收到任一混合图像之后,只需要解码得到单色图像并显示即可,即便在传输视频画面的场景下,也能够有效避免掉帧或卡顿。
与前述的图像处理方法的实施例相对应,本发明还提供了一种图像处理装置的实施例。所述装置应用于图像编码设备,所述装置包括一个或多个处理器,所述处理器被配置为:
确定原始彩色图像中各个原始像素点的颜色值,任一原始像素点包含的N个原始子像素分别对应于色彩模型的不同基础色,所述任一原始像素点的颜色值包括所述 N个原始子像素针对相应基础色的颜色分量,N为大于1的正整数;
根据所述各个原始像素点的颜色值生成N种基础色分别对应的混合图像,其中,针对任一基础色对应的混合图像中的任一混合像素点,根据像素位置映射关系在所述原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将所述N个原始像素点的颜色值中针对所述任一基础色的颜色分量分别作为相应混合子像素的颜色分量;
在生成任一基础色对应的混合图像完成的情况下,按照符合所述色彩模型的图像传输规则将该混合图像发送至场序显示设备,以由所述场序显示设备根据该混合图像生成并显示所述任一基础色对应的单色图像。
在一个实施例中,所述处理器还被配置为:
根据所述原始彩色图像的第一尺寸和所述混合图像的第二尺寸确定编码缩放系数,并确定所述任一混合像素点在所述混合图像中所处的第二位置;
根据所述编码缩放系数,在所述原始彩色图像中确定对应于所述第二位置的第一位置,并确定处于第一位置处的N个原始像素点与所述任一混合像素点包含的N个混合子像素之间的一一对应关系。
在一个实施例中,所述图像编码设备为图形处理器GPU,所述处理器还被配置为:
对所述第一尺寸和所述第二尺寸的数值进行归一化处理,所述第一位置和所述第二位置通过归一化处理后的坐标值表示。
在一个实施例中,所述处理器还被配置为:
对所述第二位置的坐标值增加偏移量,以使偏移后的所述第二位置处于原始像素点内部。
在一个实施例中,所述原始彩色图像中与所述N个混合子像素一一对应的N个原始像素点之间连续相邻。
在一个实施例中,所述色彩模型为RGB模型,所述N=3。
在一个实施例中,所述原始彩色图像为归属于任一视频的视频帧图像。
与前述的图像处理方法的实施例相对应,本发明还提供了另一种图像处理装置的实施例。所述装置应用于场序显示设备,所述装置包括一个或多个处理器,所述处 理器被配置为:
在接收到按照符合色彩模型的图像传输规则发送的混合图像的情况下,确定所述混合图像中各个混合像素点的颜色值,其中,所述混合图像对应于色彩模型的任一基础色,任一混合像素点的颜色值包括所述任一混合像素点所包含N个混合子像素针对所述任一基础色的颜色分量,N为大于1的正整数;
根据所述各个混合像素点的颜色值生成所述任一基础色对应的单色图像,其中,针对所述任一混合像素点包含的N个混合子像素,根据像素位置映射关系在所述单色图像中确定与所述N个混合子像素一一对应的N个单色像素点,并将所述N个混合子像素针对所述任一基础色的颜色分量分别作为相应单色像素点的颜色值;
通过控制所述场序显示设备的显示组件显示所述单色图像。
在一个实施例中,所述处理器还被配置为:
根据所述单色图像的第三尺寸和所述混合图像的第二尺寸确定解码缩放系数,并确定所述任一混合像素点在所述混合图像中所处的第二位置;
根据所述解码缩放系数,在所述单色图像中确定对应于所述第二位置的第三位置,并确定处于第三位置处的N个单色像素点与所述任一混合像素点包含的N个混合子像素之间的一一对应关系。
本发明的实施例还提出一种电子设备,包括:处理器;用于存储处理器可执行指令的存储器;其中,所述处理器被配置为实现上述任一实施例所述的图像处理方法。
本发明的实施例还提出一种非瞬态计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现上述任一实施例所述的图像处理方法中的步骤。
关于上述实施例中的装置,其中各个模块执行操作的具体方式已经在相关方法的实施例中进行了详细描述,此处将不做详细阐述说明。
图7是根据本发明的实施例示出的一种用于数据存证或者驾驶模式的确定的装置700的示意框图。例如,装置700可以是移动电话,计算机,数字广播终端,消息收发设备,游戏控制台,平板设备,医疗设备,健身设备,个人数字助理等。
参照图7,装置700可以包括以下一个或多个组件:处理组件702,存储器704,电源组件706,多媒体组件708,音频组件710,输入/输出(I/O)的接口712,传感器组件714,以及通信组件716。
处理组件702通常控制装置700的整体操作,诸如与显示,电话呼叫,数据通信,相机操作和记录操作相关联的操作。处理组件702可以包括一个或多个处理器720来执行指令,以完成上述图像处理方法的全部或部分步骤。此外,处理组件702可以包括一个或多个模块,便于处理组件702和其他组件之间的交互。例如,处理组件702可以包括多媒体模块,以方便多媒体组件708和处理组件702之间的交互。
存储器704被配置为存储各种类型的数据以支持在装置700的操作。这些数据的示例包括用于在装置700上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。存储器704可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。
电源组件706为装置700的各种组件提供电力。电源组件706可以包括电源管理***,一个或多个电源,及其他与为装置700生成、管理和分配电力相关联的组件。
多媒体组件708包括在所述装置700和用户之间的提供一个输出接口的屏幕。在一些实施例中,屏幕可以包括液晶显示器(LCD)、场序显示器和触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中,多媒体组件708包括一个前置摄像头和/或后置摄像头。当装置700处于操作模式,如拍摄模式或视频模式时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜***或具有焦距和光学变焦能力。
音频组件710被配置为输出和/或输入音频信号。例如,音频组件710包括一个麦克风(MIC),当装置700处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器704或经由通信组件716发送。在一些实施例中,音频组件710还包括一个扬声器,用于输出音频信号。
I/O接口712为处理组件702和***接口模块之间提供接口,上述***接口模块可以是键盘,点击轮,按钮等。这些按钮可包括但不限于:主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件714包括一个或多个传感器,用于为装置700提供各个方面的状态评估。例如,传感器组件714可以检测到装置700的打开/关闭状态,组件的相对定位,例如所述组件为装置700的显示器和小键盘,传感器组件714还可以检测装置700或装置700一个组件的位置改变,用户与装置700接触的存在或不存在,装置700方位或加速/减速和装置700的温度变化。传感器组件714可以包括接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件714还可以包括光传感器,如CMOS或CCD图像传感器,用于在成像应用中使用。在一些实施例中,该传感器组件714还可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器或温度传感器。
通信组件716被配置为便于装置700和其他设备之间有线或无线方式的通信。装置700可以接入基于通信标准的无线网络,如WiFi,2G或3G,4G LTE、6G NR或它们的组合。在一个示例性实施例中,通信组件716经由广播信道接收来自外部广播管理***的广播信号或广播相关信息。在一个示例性实施例中,所述通信组件716还包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB)技术,蓝牙(BT)技术和其他技术来实现。
在示例性实施例中,装置700可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现,用于执行上述图像处理方法。
在示例性实施例中,还提供了一种包括指令的非瞬态计算机可读存储介质,例如包括指令的存储器704,上述指令可由装置700的处理器720执行以完成上述图像处理方法。例如,所述非瞬态计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
本领域技术人员在考虑说明书及实践这里公开的实施例后,将容易想到本发明的其它实施方案。本发明旨在涵盖本发明的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本发明的一般性原理并包括本发明未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本发明的真正范围和精神由下面的权利要求指出。
应当理解的是,本发明并不局限于上面已经描述并在附图中示出的精确结构, 并且可以在不脱离其范围进行各种修改和改变。本发明的范围仅由所附的权利要求来限制。
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
以上对本发明实施例所提供的方法和装置进行了详细介绍,本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。
Claims (13)
- 一种图像处理方法,应用于图像编码设备,包括:确定原始彩色图像中各个原始像素点的颜色值,任一原始像素点包含的N个原始子像素分别对应于色彩模型的不同基础色,所述任一原始像素点的颜色值包括所述N个原始子像素针对相应基础色的颜色分量,N为大于1的正整数;根据所述各个原始像素点的颜色值生成N种基础色分别对应的混合图像,其中,针对任一基础色对应的混合图像中的任一混合像素点,根据像素位置映射关系在所述原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将所述N个原始像素点的颜色值中针对所述任一基础色的颜色分量分别作为相应混合子像素的颜色分量;在生成任一基础色对应的混合图像完成的情况下,按照符合所述色彩模型的图像传输规则将该混合图像发送至场序显示设备,以由所述场序显示设备根据该混合图像生成并显示所述任一基础色对应的单色图像。
- 根据权利要求1所述的方法,所述根据像素位置映射关系在所述原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,包括:根据所述原始彩色图像的第一尺寸和所述混合图像的第二尺寸确定编码缩放系数,并确定所述任一混合像素点在所述混合图像中所处的第二位置;根据所述编码缩放系数,在所述原始彩色图像中确定对应于所述第二位置的第一位置,并确定处于第一位置处的N个原始像素点与所述任一混合像素点包含的N个混合子像素之间的一一对应关系。
- 根据权利要求2所述的方法,所述图像编码设备为图形处理器GPU,所述方法还包括:对所述第一尺寸和所述第二尺寸的数值进行归一化处理,所述第一位置和所述第二位置通过归一化处理后的坐标值表示。
- 根据权利要求2所述的方法,还包括:对所述第二位置的坐标值增加偏移量,以使偏移后的所述第二位置处于原始像素点内部。
- 根据权利要求1所述的方法,所述原始彩色图像中与所述N个混合子像素一一对应的N个原始像素点之间连续相邻。
- 根据权利要求1所述的方法,所述色彩模型为RGB模型,所述N=3。
- 根据权利要求1所述的方法,所述原始彩色图像为归属于任一视频的视频帧图像。
- 一种图像处理方法,应用于场序显示设备,所述方法包括:在接收到按照符合色彩模型的图像传输规则发送的混合图像的情况下,确定所述混合图像中各个混合像素点的颜色值,其中,所述混合图像对应于色彩模型的任一基础色,任一混合像素点的颜色值包括所述任一混合像素点所包含N个混合子像素针对所述任一基础色的颜色分量,N为大于1的正整数;根据所述各个混合像素点的颜色值生成所述任一基础色对应的单色图像,其中,针对所述任一混合像素点包含的N个混合子像素,根据像素位置映射关系在所述单色图像中确定与所述N个混合子像素一一对应的N个单色像素点,并将所述N个混合子像素针对所述任一基础色的颜色分量分别作为相应单色像素点的颜色值;通过控制所述场序显示设备的显示组件显示所述单色图像。
- 根据权利要求8所述的方法,所述根据像素位置映射关系在所述单色图像中确定与所述N个混合子像素一一对应的N个单色像素点,包括:根据所述单色图像的第三尺寸和所述混合图像的第二尺寸确定解码缩放系数,并确定所述任一混合像素点在所述混合图像中所处的第二位置;根据所述解码缩放系数,在所述单色图像中确定对应于所述第二位置的第三位置,并确定处于第三位置处的N个单色像素点与所述任一混合像素点包含的N个混合子像素之间的一一对应关系。
- 一种图像处理装置,所述装置应用于图像编码设备,所述装置包括一个或多个处理器,所述处理器被配置为:确定原始彩色图像中各个原始像素点的颜色值,任一原始像素点包含的N个原始子像素分别对应于色彩模型的不同基础色,所述任一原始像素点的颜色值包括所述N个原始子像素针对相应基础色的颜色分量,N为大于1的正整数;根据所述各个原始像素点的颜色值生成N种基础色分别对应的混合图像,其中,针对任一基础色对应的混合图像中的任一混合像素点,根据像素位置映射关系在所述原始彩色图像中确定与所述任一混合像素点包含的N个混合子像素一一对应的N个原始像素点,并将所述N个原始像素点的颜色值中针对所述任一基础色的颜色分量分别作为相应混合子像素的颜色分量;在生成任一基础色对应的混合图像完成的情况下,按照符合所述色彩模型的图像传输规则将该混合图像发送至场序显示设备,以由所述场序显示设备根据该混合图像 生成并显示所述任一基础色对应的单色图像。
- 一种图像处理装置,所述装置应用于场序显示设备,所述装置包括一个或多个处理器,所述处理器被配置为:在接收到按照符合色彩模型的图像传输规则发送的混合图像的情况下,确定所述混合图像中各个混合像素点的颜色值,其中,所述混合图像对应于色彩模型的任一基础色,任一混合像素点的颜色值包括所述任一混合像素点所包含N个混合子像素针对所述任一基础色的颜色分量,N为大于1的正整数;根据所述各个混合像素点的颜色值生成所述任一基础色对应的单色图像,其中,针对所述任一混合像素点包含的N个混合子像素,根据像素位置映射关系在所述单色图像中确定与所述N个混合子像素一一对应的N个单色像素点,并将所述N个混合子像素针对所述任一基础色的颜色分量分别作为相应单色像素点的颜色值;通过控制所述场序显示设备的显示组件显示所述单色图像。
- 一种电子设备,其特征在于,包括:处理器;用于存储处理器可执行指令的存储器;其中,所述处理器被配置为实现权利要求1-7或8-9中任一项所述的方法。
- 一种非瞬态计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现权利要求1-7或8-9中任一项所述的方法中的步骤。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202280003925.4A CN118284901A (zh) | 2022-10-31 | 2022-10-31 | 图像处理方法及装置 |
PCT/CN2022/128775 WO2024092461A1 (zh) | 2022-10-31 | 2022-10-31 | 图像处理方法及装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2022/128775 WO2024092461A1 (zh) | 2022-10-31 | 2022-10-31 | 图像处理方法及装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2024092461A1 true WO2024092461A1 (zh) | 2024-05-10 |
Family
ID=90929361
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/128775 WO2024092461A1 (zh) | 2022-10-31 | 2022-10-31 | 图像处理方法及装置 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN118284901A (zh) |
WO (1) | WO2024092461A1 (zh) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100259552A1 (en) * | 2009-04-10 | 2010-10-14 | Faraday Technology Corporation | Field color sequential imaging method and related technology |
CN104112436A (zh) * | 2014-07-07 | 2014-10-22 | 复旦大学 | 一种采用彩色滤光片与场序的彩色液晶图像显示方法 |
US20160307482A1 (en) * | 2015-04-17 | 2016-10-20 | Nvidia Corporation | Mixed primary display with spatially modulated backlight |
CN109934795A (zh) * | 2019-03-04 | 2019-06-25 | 京东方科技集团股份有限公司 | 一种显示方法、装置、电子设备及计算机可读存储介质 |
CN109960082A (zh) * | 2019-05-05 | 2019-07-02 | 京东方科技集团股份有限公司 | 场序显示模组、显示装置及场序显示控制方法 |
-
2022
- 2022-10-31 WO PCT/CN2022/128775 patent/WO2024092461A1/zh unknown
- 2022-10-31 CN CN202280003925.4A patent/CN118284901A/zh active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100259552A1 (en) * | 2009-04-10 | 2010-10-14 | Faraday Technology Corporation | Field color sequential imaging method and related technology |
CN104112436A (zh) * | 2014-07-07 | 2014-10-22 | 复旦大学 | 一种采用彩色滤光片与场序的彩色液晶图像显示方法 |
US20160307482A1 (en) * | 2015-04-17 | 2016-10-20 | Nvidia Corporation | Mixed primary display with spatially modulated backlight |
CN109934795A (zh) * | 2019-03-04 | 2019-06-25 | 京东方科技集团股份有限公司 | 一种显示方法、装置、电子设备及计算机可读存储介质 |
CN109960082A (zh) * | 2019-05-05 | 2019-07-02 | 京东方科技集团股份有限公司 | 场序显示模组、显示装置及场序显示控制方法 |
Also Published As
Publication number | Publication date |
---|---|
CN118284901A (zh) | 2024-07-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6401785B2 (ja) | 液晶表示方法および装置 | |
RU2654135C2 (ru) | Способ и устройство для отображения контента | |
CN106710539B (zh) | 液晶显示方法及装置 | |
CN109196865B (zh) | 一种数据处理方法、终端以及存储介质 | |
US9892524B2 (en) | Image displaying methods, devices, and storage media | |
US10943566B1 (en) | Screen-off display method and apparatus | |
US11404027B2 (en) | Image processing method and device, electronic device, and storage medium | |
RU2667381C2 (ru) | Устройство и способ обработки изображений, электронное устройство | |
CN107624194A (zh) | 用于操作显示器的定时控制器的设备和方法 | |
KR101859305B1 (ko) | 콘텐츠를 디스플레이 하는 장치 및 방법 | |
US10204403B2 (en) | Method, device and medium for enhancing saturation | |
EP4109914A1 (en) | Display control method, display control device and storage medium | |
JP2017156365A (ja) | 液晶表示装置 | |
WO2024092461A1 (zh) | 图像处理方法及装置 | |
CN107534763A (zh) | 自适应色彩等级插值方法和设备 | |
US11778139B2 (en) | Electronic apparatus and control method thereof | |
CN113570992A (zh) | 显示装置及其控制方法 | |
US20230222993A1 (en) | Display device and control method thereof | |
RU2616163C1 (ru) | Способ и устройство для отображения содержания | |
US11202028B2 (en) | Display device configuring multi display system and control method thereof | |
CN114756189A (zh) | 显示数据处理方法、装置、显示驱动芯片和显示设备 | |
US9317891B2 (en) | Systems and methods for hardware-accelerated key color extraction | |
WO2023236148A1 (zh) | 显示控制方法及装置、显示设备及存储介质 | |
CN111381407A (zh) | 显示面板、显示设备、扫描方法及装置 | |
US20240248663A1 (en) | Image processing system, cloud serving end, and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22963780 Country of ref document: EP Kind code of ref document: A1 |