CN105578063A - Image processing method and terminal - Google Patents

Image processing method and terminal Download PDF

Info

Publication number
CN105578063A
CN105578063A CN201510413773.7A CN201510413773A CN105578063A CN 105578063 A CN105578063 A CN 105578063A CN 201510413773 A CN201510413773 A CN 201510413773A CN 105578063 A CN105578063 A CN 105578063A
Authority
CN
China
Prior art keywords
image
black
parameter
white
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510413773.7A
Other languages
Chinese (zh)
Other versions
CN105578063B (en
Inventor
朱先鹏
王显林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yulong Computer Telecommunication Scientific Shenzhen Co Ltd
Original Assignee
Yulong Computer Telecommunication Scientific Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yulong Computer Telecommunication Scientific Shenzhen Co Ltd filed Critical Yulong Computer Telecommunication Scientific Shenzhen Co Ltd
Priority to CN201510413773.7A priority Critical patent/CN105578063B/en
Publication of CN105578063A publication Critical patent/CN105578063A/en
Application granted granted Critical
Publication of CN105578063B publication Critical patent/CN105578063B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Processing (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

The invention discloses an image processing method. The method comprises the steps that a color image photographed by a first camera and a black-and-white image photographed by a second camera at the same time are acquired, and the first camera and the second camera are arranged at the same side of a terminal; the color information parameters of all the pixel points in the color image are extracted; the gray scale information parameters of all the pixel points in the black-and-white image are extracted; and the color information parameters of corresponding pixel points in an output image are determined according to the color information parameters of the pixel points in the color image and the gray scale information parameters of the corresponding pixel points in the black-and-white image. The invention also discloses an image processing terminal. With application of the image processing method and terminal, the photographing effect of the image under the condition of low brightness can be improved.

Description

A kind of image processing method and terminal
Technical field
The present invention relates to electronic technology field, particularly relate to a kind of image processing method and terminal.
Background technology
Along with the development of electronic product and image processing techniques is more and more quicker, people require also more and more higher to the shooting effect of the image that electronic product is taken.At present, electronic product is generally realize by an integrated colour imagery shot function taken color photographs, colour imagery shot realizes the perception of environment to external world by focusing on white light, and extraneous light is except white light (visible ray), also there is infrared ray, when being in the environment of low-light level, white light is little and infrared ray account for leading, the color pixel that when this just causes taking under low-light level environment, infrared ray is formed on a sensor can interfere with the coloured image that white light is formed on a sensor, thus make the photo taken there is color error ratio, shooting effect is poor.
Summary of the invention
Embodiment of the present invention technical problem to be solved is, provides a kind of image processing method and terminal, can improve the shooting effect of low illumination conditions hypograph and present effect.
In order to solve the problems of the technologies described above, embodiments provide a kind of image processing method, described method comprises:
Obtain the coloured image of the first camera shooting and the black and white image of same time second camera shooting, described first camera and described second camera are positioned at the same side of terminal;
Extract the color information parameter of each pixel in described coloured image;
Extract the half-tone information parameter of each pixel in described black and white image;
According to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image.
Correspondingly, the embodiment of the present invention additionally provides a kind of image processing terminal, comprising:
Image collection module, the black and white image that coloured image and same time second camera for obtaining the first camera shooting are taken, described first camera and described second camera are positioned at the same side of terminal;
Colouring information extraction module, for extracting the color information parameter of each pixel in described coloured image;
Half-tone information extraction module, for extracting the half-tone information parameter of each pixel in described black and white image;
Output image module, for the half-tone information parameter according to corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determines the color information parameter of corresponding pixel points in output image.
The coloured image of the embodiment of the present invention by the shooting of acquisition first camera and the black and white image of same time second camera shooting, extract the color information parameter of each pixel in described coloured image, extract the half-tone information parameter of each pixel in described black and white image, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image, improve the shooting effect of low illumination conditions hypograph.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the schematic flow sheet of a kind of image processing method in the embodiment of the present invention;
Fig. 2 is the schematic flow sheet of image processing method in another embodiment of the present invention;
Fig. 3 is the composition structural representation of a kind of image processing terminal in the embodiment of the present invention;
Fig. 4 is the output image module composition structure chart of Fig. 3 in the embodiment of the present invention;
Fig. 5 is the registration module composition structure chart of Fig. 3 in the embodiment of the present invention;
Fig. 6 is the schematic diagram of virtual borderlines in the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Fig. 1 is the schematic flow sheet of a kind of image processing method in the embodiment of the present invention, and this method flow process can be implemented by image processing terminal, and described image processing terminal can comprise mobile phone, notebook computer, panel computer, digital camera etc.Method flow as shown in the figure in the present embodiment can comprise:
Step S101, obtain the coloured image of the first camera shooting and the black and white image of same time second camera shooting, described first camera and described second camera are positioned at the same side of terminal.
Concrete, after the photographing instruction receiving user, described be positioned at the same side the first camera and second camera will carry out finding a view taking pictures, the relative position of described first camera and described second camera can be one on the other or a first from left right, and both relative distance is wanted ensure in shooting process, the acquisition parameters such as viewfinder range, angle of described first camera and described second camera is consistent all substantially.Described first camera is provided with the ultrared colorized optical filtering mirror of filtering, and when taking pictures under such low-light level, white light a small amount of in environment can arrive transducer through described first camera, makes described first camera photograph coloured image by focusing on white light; Described second camera is provided with the infrared filter of filtering white light, because infrared ray does not reduce during low-light level, infrared ray arrives transducer through described second camera, makes described second camera photograph the black and white image being filtered white light.Afterwards, terminal obtains the described coloured image of the first camera shooting and the black and white image of described second camera shooting, for extracting the parameter of pixel further.
Further alternative, when terminal induction to environment brightness value lower than preset luminance threshold time, open photoflash lamp when can take described coloured image and described black and white image respectively by described first camera and described second camera and irradiate fill-in light to shooting direction, described fill-in light comprises white light and infrared ray.Due to the existence of optical filtering, two kinds of light can not produce interference to the described coloured image of shooting and described black and white image mutually, and therefore white light is only to give the first camera light filling, infrared ray only to give second camera light filling, to improve the brightness of shooting environmental.
Step S102, extracts the color information parameter of each pixel in described coloured image.
Concrete, described coloured image is made up of the pixel of some, and described each pixel all comprises color information parameter, and described coloured image is preserved and reduced to terminal by the color information parameter extracting described each pixel.It should be noted that, the color information parameter of coloured image described here is the RGB parameter of RGB color space, wherein R, G and B are the color space component of described coloured image at RGB color space, represent the numerical value that Red Green Blue light is shared in each pixel respectively.Different R, G and B numerical value can represent different colourity, therefore by extracting described RGB parameter, can obtain the colouring information of each pixel in described coloured image.
Step S103, extracts the half-tone information parameter of each pixel in described black and white image.
Concrete, described black and white image is made up of the pixel of some, and described each pixel all comprises half-tone information parameter, and described black and white image is preserved and reduced to terminal by the half-tone information parameter extracting described each pixel.It should be noted that, the half-tone information parameter of black and white image described here is the YUV parameter of YUV color space, wherein Y, U and V are the color space component of described black and white image at YUV color space, represent luminance component Y and chromatic component U, V of each pixel respectively, wherein chromatic component can describe tone and saturation.If only have Y-signal component and do not have U, V component, the image represented so is like this exactly black and white gray level image.Therefore by extracting described YUV parameter, the half-tone information of each pixel in described black and white image can be obtained.
Step S104, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determines the color information parameter of corresponding pixel points in output image.
Concrete, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in the described coloured image that step S102 and step S103 extract and described black and white image, can synthesize the color information parameter of the corresponding pixel points obtaining described output image, thus described output image can be preserved, reduces and be presented to described terminal just according to the color information parameter of the corresponding pixel points of described output image.The half-tone information parameter (luminance component Y) of each pixel that described black and white image comprises than described coloured image is more accurate, and the color information parameter (rgb space component) of each pixel that described coloured image comprises than described black and white image is more accurate, after synthesis, described output image quality just can improve.In concrete enforcement, first can carry out image registration to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.Afterwards, described black and white image is become the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space, again the RGB parametric compensation of described black and white image is given the RGB parameter of described coloured image, determine the RGB parameter of described output image, finally preserve according to the RGB parameter of described output image or show described output image.
The coloured image of the embodiment of the present invention by the shooting of acquisition first camera and the black and white image of same time second camera shooting, extract the color information parameter of each pixel in described coloured image, extract the half-tone information parameter of each pixel in described black and white image, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image, improve the shooting effect of low illumination conditions hypograph.
Fig. 2 is the schematic flow sheet of image processing method in another embodiment of the present invention.Method flow as shown in the figure in the present embodiment can comprise:
Step S201, obtain the coloured image of the first camera shooting and the black and white image of same time second camera shooting, described first camera and described second camera are positioned at the same side of terminal.
Concrete grammar refer step S101.
Step S202, determines the displacement difference vector between described coloured image and described black and white image.
Concrete, owing to there is certain distance between the first camera and second camera, certain skew will be there is in the described coloured image of the first camera shooting and the described black and white image of second camera shooting, therefore need to carry out image registration to described coloured image and described black and white image, first just need the displacement difference vector determined between described coloured image and described black and white image.In concrete enforcement, described terminal, by the similar features point of detection two images, extracts at least one group of fixed reference feature point pair of described coloured image and described black and white image; According to described fixed reference feature point to the reference coordinate respectively on described coloured image and described black and white image, determine the virtual borderlines relation of described coloured image and described black and white image; Then described mapping relations are converted into corresponding displacement difference vector.Described displacement difference vector have recorded the distance size and correspondence direction that described coloured image and described black and white image spatially differ, important parameter when being translation compensation.For the simplest example, as shown in Figure 6, in plane X-Y-coordinate system, one group of fixed reference feature point of described coloured image and described black and white image is (1,1) and (2,2) to coordinate, and so obtaining its mapping relations is X 2=X 1+ 1, Y 2=Y 1+ 1, then obtaining displacement difference vector as shown in the figure according to these mapping relations.
Step S203, according to described displacement difference vector, carries out translation compensation to described coloured image and described black and white image.
Concrete, after determining described displacement difference vector, described terminal just can according to the direction of this displacement difference vectors directed and distance size, translation compensation is carried out to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.To the image registration of described coloured image and described black and white image, can be with described black and white image for reference to carrying out image registration to described coloured image, also can be for reference to carrying out image registration to described black and white image with described coloured image.In concrete enforcement, can with described black and white image for reference carry out translation compensation to described coloured image, namely described black and white image keeps motionless, coloured image described in a translation; Or conversely, can with described coloured image for reference carry out translation compensation to described black and white image, namely described coloured image keeps motionless, black and white image described in a translation; On the other hand, also can set a reference coordinate, by described black and white image and described coloured image with described reference coordinate for reference to carrying out translation compensation, namely described black and white image and described coloured image are all to the position translation of reference coordinate.Because the above two can reduce time and the difficulty of image procossing, therefore select a method as translation compensation in the above two here.
Step S204, extracts the RGB parameter of each pixel in described coloured image at RGB color space.
Concrete, described coloured image is made up of the pixel of some, and described each pixel all comprises the RGB parameter of RGB color space, and described coloured image is preserved and reduced to terminal by the RGB parameter extracting described each pixel.It should be noted that, R, G and B are the color space component of described coloured image at RGB color space here, represent the numerical value that Red Green Blue light is shared in each pixel respectively.Different R, G and B numerical value can represent different colourity, therefore by extracting described RGB parameter, can obtain the colouring information of each pixel in described coloured image.
Step S205, extracts the YUV parameter of each pixel in described black and white image at YUV color space.
Concrete, described black and white image is made up of the pixel of some, and described each pixel all comprises the YUV parameter of YUV color space, and described black and white image is preserved and reduced to terminal by the YUV parameter extracting described each pixel.It should be noted that, Y, U and V are the color space component of described black and white image at YUV color space here, and represent luminance component Y and chromatic component U, V of each pixel respectively, wherein chromatic component can describe tone and saturation.If only have Y-signal component and do not have U, V component, the image represented so is like this exactly black and white gray level image.Therefore by extracting described YUV parameter, the half-tone information of each pixel in described black and white image can be obtained.Further, step S202 and step S203 has carried out registration to described coloured image and described black and white image, and the pixel collected in the pixel therefore collected in described coloured image for same photographic subjects position and described black and white image exists relation one to one.
Step S206, becomes the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space by described black and white image.
Concrete, the conversion formula of described YUV parameter and described RGB parameter is as follows:
R=1.164(Y-16)+1.596(V-128)
G=1.164(Y-16)-0.813(V-128)-0.391(U-128)
B=1.164(Y-16)+2.018(U-128)
After step S205 extracts the YUV parameter of each pixel in described black and white image at YUV color space, just can utilize this group conversion formula, described black and white image is become the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space, the color space of each pixel of described like this black and white image and described coloured image just can be consistent.
Step S207, according to the RGB parameter of described black and white image and the RGB parameter of described coloured image, determines the RGB parameter of described output image.
Concrete, after described terminal obtains the RGB parameter of described black and white image and the RGB parameter of described coloured image respectively, the RGB parametric compensation of described black and white image can be given the RGB parameter of described coloured image, to determine the RGB parameter of described output image.Here compensation can be partial-compensation also can be whole compensation, concrete compensation way can by the quality settings threshold value of described coloured image of taking out to described first camera, the many indexs such as definition, brightness, contrast are judged, such as, when the many index of described coloured image exceedes described threshold value, represent the quality hit the target of described coloured image, only need the partial-compensation of the RGB parameter of the described black and white image of 50%; When the many index of described coloured image does not exceed described threshold value, represent the non-hit the target of the quality of described coloured image, the RGB parameter of described black and white image all can be compensated to the RGB parameter of described coloured image.Concrete example, the RGB parameter supposing the target pixel points of described black and white image is [66, 20, 57], described coloured image be [91 with the RGB parameter of described target pixel points corresponding pixel points, 52, 43], and the many index of described coloured image does not exceed described threshold value, at this moment just by the RGB parameter [66 of the described target pixel points of described black and white image, 20, 57] all compensate to the RGB parameter [91 of the pixel of the described coloured image corresponding with described target pixel points, 52, 43], then the RGB parameter of the described target pixel points of described output image is just described R, G, value [157 after the superposition of B component correspondence, 72, 100].Just can be obtained the RGB parameter of each pixel of described output image by described method, final described terminal can be preserved according to the RGB parameter of each pixel of described output image and show described output image.
The coloured image of the embodiment of the present invention by the shooting of acquisition first camera and the black and white image of same time second camera shooting, extract the color information parameter of each pixel in described coloured image, extract the half-tone information parameter of each pixel in described black and white image, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image, improve the shooting effect of low illumination conditions hypograph.
Fig. 3 is the composition structural representation of a kind of image processing terminal in the embodiment of the present invention, and described image processing terminal can comprise mobile phone, notebook computer, panel computer, digital camera etc.Terminal as shown in the figure in the present embodiment can comprise:
Image collection module 310, the black and white image that coloured image and same time second camera for obtaining the first camera shooting are taken, described first camera and described second camera are positioned at the same side of terminal.
Concrete, after the photographing instruction receiving user, described be positioned at the same side the first camera and second camera will carry out finding a view taking pictures, the relative position of described first camera and described second camera can be one on the other or a first from left right, and both relative distance is wanted ensure in shooting process, the acquisition parameters such as viewfinder range, angle of described first camera and described second camera is consistent all substantially.Described first camera is provided with the ultrared colorized optical filtering mirror of filtering, and when taking pictures under such low-light level, white light a small amount of in environment can arrive transducer through described first camera, makes described first camera photograph coloured image by focusing on white light; Described second camera is provided with the infrared filter of filtering white light, because infrared ray does not reduce during low-light level, infrared ray arrives transducer through described second camera, makes described second camera photograph the black and white image being filtered white light.Afterwards, described image collection module 310 obtains the described coloured image of the first camera shooting and the black and white image of described second camera shooting, for extracting the parameter of pixel further.
Colouring information extraction module 320, for extracting the color information parameter of each pixel in described coloured image.
Concrete, described coloured image is made up of the pixel of some, described each pixel all comprises color information parameter, and described coloured image is preserved and reduced to described colouring information extraction module 320 by the color information parameter extracting described each pixel.It should be noted that, the color information parameter of coloured image described here is the RGB parameter of RGB color space, wherein R, G and B are the color space component of described coloured image at RGB color space, represent the numerical value that Red Green Blue light is shared in each pixel respectively.Different R, G and B numerical value can represent different colourity, therefore by extracting described RGB parameter, can obtain the colouring information of each pixel in described coloured image.
Half-tone information extraction module 330, for extracting the half-tone information parameter of each pixel in described black and white image.
Concrete, described black and white image is made up of the pixel of some, described each pixel all comprises half-tone information parameter, and described black and white image is preserved and reduced to described half-tone information extraction module 330 by the half-tone information parameter extracting described each pixel.It should be noted that, the half-tone information parameter of black and white image described here is the YUV parameter of YUV color space, wherein Y, U and V are the color space component of described black and white image at YUV color space, represent luminance component Y and chromatic component U, V of each pixel respectively, wherein chromatic component can describe tone and saturation.If only have Y-signal component and do not have U, V component, the image represented so is like this exactly black and white gray level image.Therefore by extracting described YUV parameter, the half-tone information of each pixel in described black and white image can be obtained.Further, registration module 360 can carry out registration to described coloured image and described black and white image, there is one to one relation when the pixel collected gathers in the pixel therefore collected in described coloured image for same photographic subjects position and described black and white image.
Output image module 340, for the half-tone information parameter according to corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determines the color information parameter of corresponding pixel points in output image.
Concrete, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in the described coloured image that colouring information extraction module 320 and half-tone information extraction module 330 extract and described black and white image, can synthesize the color information parameter of the corresponding pixel points obtaining described output image, thus described output image can be preserved, reduces and be presented to described output image module 340 just according to the color information parameter of the corresponding pixel points of described output image.The half-tone information parameter (luminance component Y) of each pixel that described black and white image comprises than described coloured image is more accurate, and the color information parameter (rgb space component) of each pixel that described coloured image comprises than described black and white image is more accurate, after synthesis, described output image quality just can improve.
Further, described output image module 340 also comprises: parameter conversion unit 341 and parameter conversion unit 341, as described in Figure 4.
Parameter conversion unit 341, for becoming the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space by described black and white image.
Concrete, the conversion formula of described YUV parameter and described RGB parameter is as follows:
R=1.164(Y-16)+1.596(V-128)
G=1.164(Y-16)-0.813(V-128)-0.391(U-128)
B=1.164(Y-16)+2.018(U-128)
After half-tone information extraction module 330 extracts the YUV parameter of each pixel in described black and white image at YUV color space, parameter conversion unit 341 just can utilize this group conversion formula, described black and white image is become the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space, described like this black and white image just can be consistent with the color space of each pixel of described coloured image.
Parameter determination unit 342, for according to the RGB parameter of described black and white image and the RGB parameter of described coloured image, determines the RGB parameter of described output image.
Concrete, after described colouring information extraction module 320 and described half-tone information extraction module 330 obtain the RGB parameter of described black and white image and the RGB parameter of described coloured image respectively, the RGB parametric compensation of described black and white image can be given the RGB parameter of described coloured image by described parameter determination unit 342, to determine the RGB parameter of described output image.Here compensation can be partial-compensation also can be whole compensation, concrete compensation way can by the quality settings threshold value of described coloured image of taking out to described first camera, the many indexs such as definition, brightness, contrast are judged, such as, when the many index of described coloured image exceedes described threshold value, represent the quality hit the target of described coloured image, only need the partial-compensation of the RGB parameter of the described black and white image of 50%; When the many index of described coloured image does not exceed described threshold value, represent the non-hit the target of the quality of described coloured image, the RGB parameter of described black and white image all can be compensated to the RGB parameter of described coloured image.Concrete example, the RGB parameter supposing the target pixel points of described black and white image is [66, 20, 57], described coloured image be [91 with the RGB parameter of described target pixel points corresponding pixel points, 52, 43], and the many index of described coloured image does not exceed described threshold value, at this moment just by the RGB parameter [66 of the described target pixel points of described black and white image, 20, 57] all compensate to described coloured image with the RGB parameter [91 of described target pixel points corresponding pixel points, 52, 43], then the RGB parameter of the described target pixel points of described output image is just described R, G, value [157 after the superposition of B component correspondence, 72, 100].Just can be obtained the RGB parameter of each pixel of described output image by described method, final described output image module 340 can be preserved according to the RGB parameter of each pixel of described output image and show described output image.
Flash module 350, open photoflash lamp during for taking described coloured image and described black and white image respectively by described first camera and described second camera and irradiate fill-in light to shooting direction, described fill-in light comprises white light and infrared light.
Concrete optional, when terminal induction to environment brightness value lower than preset luminance threshold time, open photoflash lamp when can take described coloured image and described black and white image respectively by flash module 350 to described first camera and described second camera and irradiate fill-in light to shooting direction, described fill-in light comprises white light and infrared ray.Due to the existence of optical filtering, two kinds of light can not produce interference to the described coloured image of shooting and described black and white image mutually, and therefore white light is only to give the first camera light filling, infrared ray only to give second camera light filling, to improve the brightness of shooting environmental.
Registration module 360, for carrying out image registration to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.
Described registration module 360 comprises: displacement difference determining unit 361 and compensating unit 362, as described in Figure 5.
Displacement difference determining unit 361, for determining the displacement difference vector between described coloured image and described black and white image.
Concrete, owing to there is certain distance between the first camera and second camera, will be there is certain skew in the described coloured image of the first camera shooting and the described black and white image of second camera shooting, therefore need to carry out image registration to described coloured image and described black and white image.In concrete enforcement, described displacement difference determining unit 361, by the similar features point of detection two images, extracts at least one group of fixed reference feature point pair of described coloured image and described black and white image; According to described fixed reference feature point to the reference coordinate respectively on described coloured image and described black and white image, determine the virtual borderlines relation of described coloured image and described black and white image; Then described mapping relations are converted into corresponding displacement difference vector.Described displacement difference vector have recorded the distance size and correspondence direction that described coloured image and described black and white image spatially differ, important parameter when being translation compensation.For the simplest example, as shown in Figure 6, in plane X-Y-coordinate system, one group of fixed reference feature point of described coloured image and described black and white image is (1,1) and (2,2) to coordinate, and so obtaining its mapping relations is X 2=X 1+ 1, Y 2=Y 1+ 1, then obtaining displacement difference vector as shown in the figure according to these mapping relations.
Compensating unit 362, for according to described displacement difference vector, carries out translation compensation to institute's coloured image and described black and white image.
Concrete, after determining described displacement difference vector, described compensating unit 362 just can according to the direction of this displacement difference vectors directed and distance size, translation compensation is carried out to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.To the image registration of described coloured image and described black and white image, can be with described black and white image for reference to carrying out image registration to described coloured image, also can be for reference to carrying out image registration to described black and white image with described coloured image.In concrete enforcement, can with described black and white image for reference carry out translation compensation to described coloured image, namely described black and white image keeps motionless, coloured image described in a translation; Or conversely, can with described coloured image for reference carry out translation compensation to described black and white image, namely described coloured image keeps motionless, black and white image described in a translation; On the other hand, also can set a reference coordinate, by described black and white image and described coloured image with described reference coordinate for reference to carrying out translation compensation, namely described black and white image and described coloured image are all to the position translation of reference coordinate.Because the above two can reduce time and the difficulty of image procossing, therefore select a method as translation compensation in the above two here.
The coloured image of the embodiment of the present invention by the shooting of acquisition first camera and the black and white image of same time second camera shooting, extract the color information parameter of each pixel in described coloured image, extract the half-tone information parameter of each pixel in described black and white image, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image, improve the shooting effect of low illumination conditions hypograph.
One of ordinary skill in the art will appreciate that all or part of flow process realized in above-described embodiment method, that the hardware that can carry out instruction relevant by computer program has come, described program can be stored in a computer read/write memory medium, this program, when performing, can comprise the flow process of the embodiment as above-mentioned each side method.Wherein, described storage medium can be magnetic disc, CD, read-only store-memory body (Read-OnlyMemory, ROM) or random store-memory body (RandomAccessMemory, RAM) etc.
Above disclosedly be only present pre-ferred embodiments, certainly can not limit the interest field of the present invention with this, therefore according to the equivalent variations that the claims in the present invention are done, still belong to the scope that the present invention is contained.

Claims (14)

1. an image processing method, is characterized in that, described method comprises:
Obtain the coloured image of the first camera shooting and the black and white image of same time second camera shooting, described first camera and described second camera are positioned at the same side of terminal;
Extract the color information parameter of each pixel in described coloured image;
Extract the half-tone information parameter of each pixel in described black and white image;
According to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image.
2. image processing method as claimed in claim 1, it is characterized in that, the color information parameter of described coloured image is the RGB parameter of RGB color space, and the half-tone information parameter of described black and white image is the YUV parameter of YUV color space;
The half-tone information parameter of corresponding pixel points in the described color information parameter according to pixel in described coloured image and described black and white image, determine that in output image, the color information parameter of corresponding pixel points comprises:
Described black and white image is become the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space;
According to the RGB parameter of described black and white image and the RGB parameter of described coloured image, determine the RGB parameter of described output image.
3. image processing method as claimed in claim 1, it is characterized in that, described first camera is provided with the ultrared colorized optical filtering mirror of filtering, and described second camera is provided with the infrared filter of filtering white light.
4. image processing method as claimed in claim 1, it is characterized in that, described method also comprises:
Open photoflash lamp when taking described coloured image and described black and white image respectively by described first camera and described second camera and irradiate fill-in light to shooting direction, described fill-in light comprises white light and infrared ray.
5. image processing method as claimed in claim 1, is characterized in that, also comprise before the color information parameter of each pixel in the described coloured image of described extraction:
Image registration is carried out to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.
6. image processing method as claimed in claim 5, is characterized in that, describedly carries out image registration to described coloured image and described black and white image and comprises:
Determine the displacement difference vector between described coloured image and described black and white image;
According to described displacement difference vector, translation compensation is carried out to described coloured image and described black and white image.
7. image processing method as claimed in claim 5, it is characterized in that, describedly image registration is carried out to described coloured image and described black and white image comprise: with described black and white image for reference to carrying out image registration to described coloured image, or with described coloured image for reference to carrying out image registration to described black and white image.
8. an image processing terminal, is characterized in that, described terminal comprises:
Image collection module, the black and white image that coloured image and same time second camera for obtaining the first camera shooting are taken, described first camera and described second camera are positioned at the same side of terminal;
Colouring information extraction module, for extracting the color information parameter of each pixel in described coloured image;
Half-tone information extraction module, for extracting the half-tone information parameter of each pixel in described black and white image;
Output image module, for the half-tone information parameter according to corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determines the color information parameter of corresponding pixel points in output image.
9. image processing terminal as claimed in claim 8, it is characterized in that, the color information parameter of described coloured image is the RGB parameter of RGB color space, and the half-tone information parameter of described black and white image is the YUV parameter of YUV color space;
Described output image module comprises:
Parameter conversion unit, for becoming the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space by described black and white image;
Parameter determination unit, for according to the RGB parameter of described black and white image and the RGB parameter of described coloured image, determines the RGB parameter of described output image.
10. image processing terminal as claimed in claim 8, it is characterized in that, described first camera is provided with the ultrared colorized optical filtering mirror of filtering, and described second camera is provided with the infrared filter of filtering white light.
11. image processing terminals as claimed in claim 8, it is characterized in that, described terminal also comprises:
Flash module, open photoflash lamp during for taking described coloured image and described black and white image respectively by described first camera and described second camera and irradiate fill-in light to shooting direction, described fill-in light comprises white light and infrared light.
12. image processing terminals as claimed in claim 8, it is characterized in that, described terminal also comprises:
Registration module, for carrying out image registration to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.
13. image processing terminals as claimed in claim 12, it is characterized in that, described registration module comprises:
Displacement difference determining unit, for determining the displacement difference vector between described coloured image and described black and white image;
Compensating unit, for according to described displacement difference vector, carries out translation compensation to institute's coloured image and described black and white image.
14. image processing terminals as claimed in claim 12, it is characterized in that, describedly image registration is carried out to described coloured image and described black and white image comprise: with described black and white image for reference to carrying out image registration to described coloured image, or with described coloured image for reference to carrying out image registration to described black and white image.
CN201510413773.7A 2015-07-14 2015-07-14 A kind of image processing method and terminal Active CN105578063B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510413773.7A CN105578063B (en) 2015-07-14 2015-07-14 A kind of image processing method and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510413773.7A CN105578063B (en) 2015-07-14 2015-07-14 A kind of image processing method and terminal

Publications (2)

Publication Number Publication Date
CN105578063A true CN105578063A (en) 2016-05-11
CN105578063B CN105578063B (en) 2018-04-10

Family

ID=55887670

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510413773.7A Active CN105578063B (en) 2015-07-14 2015-07-14 A kind of image processing method and terminal

Country Status (1)

Country Link
CN (1) CN105578063B (en)

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106060419A (en) * 2016-06-30 2016-10-26 维沃移动通信有限公司 Photographing method and mobile terminal
CN106101666A (en) * 2016-06-30 2016-11-09 维沃移动通信有限公司 The method of a kind of image color reservation and mobile terminal
CN106412534A (en) * 2016-10-27 2017-02-15 成都西纬科技有限公司 Method and device for adjusting image brightness
CN106454077A (en) * 2016-09-26 2017-02-22 宇龙计算机通信科技(深圳)有限公司 Photographing method, photographing apparatus and terminal
CN106454290A (en) * 2016-10-12 2017-02-22 成都西纬科技有限公司 Dual-camera image processing system and method thereof
CN106550227A (en) * 2016-10-27 2017-03-29 成都西纬科技有限公司 A kind of image saturation method of adjustment and device
CN107087108A (en) * 2017-05-18 2017-08-22 努比亚技术有限公司 A kind of image processing method and device based on dual camera
CN107493431A (en) * 2017-08-31 2017-12-19 努比亚技术有限公司 A kind of image taking synthetic method, terminal and computer-readable recording medium
CN107566730A (en) * 2017-09-27 2018-01-09 维沃移动通信有限公司 A kind of panoramic picture image pickup method and mobile terminal
WO2018082165A1 (en) * 2016-11-03 2018-05-11 华为技术有限公司 Optical imaging method and apparatus
CN108022227A (en) * 2017-12-29 2018-05-11 努比亚技术有限公司 A kind of black and white background photo acquisition methods, device and computer-readable recording medium
WO2018119787A1 (en) * 2016-12-28 2018-07-05 华为技术有限公司 Demosaicing method and device
CN108445010A (en) * 2018-03-12 2018-08-24 昆山国显光电有限公司 Automatic optical detection method and device
CN108540736A (en) * 2018-04-03 2018-09-14 深圳新亮智能技术有限公司 Infrared laser illuminates the camera chain of Color License Plate
CN108737728A (en) * 2018-05-03 2018-11-02 Oppo广东移动通信有限公司 A kind of image capturing method, terminal and computer storage media
CN109120911A (en) * 2018-07-09 2019-01-01 武汉斗鱼网络科技有限公司 A kind of video method for transformation, device, equipment and medium
CN109785251A (en) * 2018-12-25 2019-05-21 北京中科慧眼科技有限公司 A kind of picture quality method for improving, device and automated driving system
US10341543B2 (en) 2016-04-28 2019-07-02 Qualcomm Incorporated Parallax mask fusion of color and mono images for macrophotography
CN110326288A (en) * 2017-03-02 2019-10-11 索尼公司 Image processing equipment and imaging device
CN110476056A (en) * 2017-04-26 2019-11-19 深圳配天智能技术研究院有限公司 A kind of visible detection method, detection device and robot
CN111479075A (en) * 2020-04-02 2020-07-31 青岛海信移动通信技术股份有限公司 Photographing terminal and image processing method thereof
CN111970432A (en) * 2019-05-20 2020-11-20 华为技术有限公司 Image processing method and image processing device
CN112133101A (en) * 2020-09-22 2020-12-25 杭州海康威视数字技术股份有限公司 Method and device for enhancing license plate area, camera device, computing equipment and storage medium
CN112822465A (en) * 2019-11-15 2021-05-18 北京小米移动软件有限公司 Terminal device and image processing method
CN113038017A (en) * 2021-03-24 2021-06-25 重庆中科云从科技有限公司 Image acquisition method, image acquisition device and computer-readable storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110336907A (en) * 2019-08-21 2019-10-15 惠州Tcl移动通信有限公司 Terminal, image pickup method and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103986875A (en) * 2014-05-29 2014-08-13 宇龙计算机通信科技(深圳)有限公司 Image acquiring device, method and terminal and video acquiring method
CN104463112A (en) * 2014-11-27 2015-03-25 深圳市科葩信息技术有限公司 Method and system for carrying out biological recognition through RGB+IR image sensor
CN105049718A (en) * 2015-07-06 2015-11-11 深圳市金立通信设备有限公司 Image processing method and terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103986875A (en) * 2014-05-29 2014-08-13 宇龙计算机通信科技(深圳)有限公司 Image acquiring device, method and terminal and video acquiring method
CN104463112A (en) * 2014-11-27 2015-03-25 深圳市科葩信息技术有限公司 Method and system for carrying out biological recognition through RGB+IR image sensor
CN105049718A (en) * 2015-07-06 2015-11-11 深圳市金立通信设备有限公司 Image processing method and terminal

Cited By (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10362205B2 (en) 2016-04-28 2019-07-23 Qualcomm Incorporated Performing intensity equalization with respect to mono and color images
US10341543B2 (en) 2016-04-28 2019-07-02 Qualcomm Incorporated Parallax mask fusion of color and mono images for macrophotography
CN106101666A (en) * 2016-06-30 2016-11-09 维沃移动通信有限公司 The method of a kind of image color reservation and mobile terminal
CN106060419A (en) * 2016-06-30 2016-10-26 维沃移动通信有限公司 Photographing method and mobile terminal
CN106060419B (en) * 2016-06-30 2019-05-17 维沃移动通信有限公司 A kind of photographic method and mobile terminal
CN106454077A (en) * 2016-09-26 2017-02-22 宇龙计算机通信科技(深圳)有限公司 Photographing method, photographing apparatus and terminal
CN106454077B (en) * 2016-09-26 2021-02-23 宇龙计算机通信科技(深圳)有限公司 Shooting method, shooting device and terminal
CN106454290A (en) * 2016-10-12 2017-02-22 成都西纬科技有限公司 Dual-camera image processing system and method thereof
CN106412534B (en) * 2016-10-27 2018-09-11 成都西纬科技有限公司 A kind of brightness of image adjusting method and device
CN106412534A (en) * 2016-10-27 2017-02-15 成都西纬科技有限公司 Method and device for adjusting image brightness
CN106550227A (en) * 2016-10-27 2017-03-29 成都西纬科技有限公司 A kind of image saturation method of adjustment and device
WO2018082165A1 (en) * 2016-11-03 2018-05-11 华为技术有限公司 Optical imaging method and apparatus
CN108605097A (en) * 2016-11-03 2018-09-28 华为技术有限公司 Optical imaging method and its device
US10810720B2 (en) 2016-11-03 2020-10-20 Huawei Technologies Co., Ltd. Optical imaging method and apparatus
CN108605097B (en) * 2016-11-03 2020-09-08 华为技术有限公司 Optical imaging method and device
WO2018119787A1 (en) * 2016-12-28 2018-07-05 华为技术有限公司 Demosaicing method and device
US11017501B2 (en) 2016-12-28 2021-05-25 Huawei Technologies Co., Ltd. Demosaicing method and apparatus
CN110326288A (en) * 2017-03-02 2019-10-11 索尼公司 Image processing equipment and imaging device
CN110326288B (en) * 2017-03-02 2021-07-06 索尼公司 Image processing apparatus and imaging apparatus
CN110476056B (en) * 2017-04-26 2022-02-18 深圳配天智能技术研究院有限公司 Visual detection method, detection equipment and robot
CN110476056A (en) * 2017-04-26 2019-11-19 深圳配天智能技术研究院有限公司 A kind of visible detection method, detection device and robot
CN107087108A (en) * 2017-05-18 2017-08-22 努比亚技术有限公司 A kind of image processing method and device based on dual camera
CN107493431A (en) * 2017-08-31 2017-12-19 努比亚技术有限公司 A kind of image taking synthetic method, terminal and computer-readable recording medium
CN107566730B (en) * 2017-09-27 2019-10-15 维沃移动通信有限公司 A kind of panoramic picture image pickup method and mobile terminal
CN107566730A (en) * 2017-09-27 2018-01-09 维沃移动通信有限公司 A kind of panoramic picture image pickup method and mobile terminal
CN108022227A (en) * 2017-12-29 2018-05-11 努比亚技术有限公司 A kind of black and white background photo acquisition methods, device and computer-readable recording medium
CN108445010A (en) * 2018-03-12 2018-08-24 昆山国显光电有限公司 Automatic optical detection method and device
CN108540736A (en) * 2018-04-03 2018-09-14 深圳新亮智能技术有限公司 Infrared laser illuminates the camera chain of Color License Plate
CN108737728A (en) * 2018-05-03 2018-11-02 Oppo广东移动通信有限公司 A kind of image capturing method, terminal and computer storage media
CN108737728B (en) * 2018-05-03 2021-06-11 Oppo广东移动通信有限公司 Image shooting method, terminal and computer storage medium
CN109120911A (en) * 2018-07-09 2019-01-01 武汉斗鱼网络科技有限公司 A kind of video method for transformation, device, equipment and medium
CN109785251A (en) * 2018-12-25 2019-05-21 北京中科慧眼科技有限公司 A kind of picture quality method for improving, device and automated driving system
CN111970432A (en) * 2019-05-20 2020-11-20 华为技术有限公司 Image processing method and image processing device
CN112822465A (en) * 2019-11-15 2021-05-18 北京小米移动软件有限公司 Terminal device and image processing method
CN111479075A (en) * 2020-04-02 2020-07-31 青岛海信移动通信技术股份有限公司 Photographing terminal and image processing method thereof
CN112133101A (en) * 2020-09-22 2020-12-25 杭州海康威视数字技术股份有限公司 Method and device for enhancing license plate area, camera device, computing equipment and storage medium
CN112133101B (en) * 2020-09-22 2021-11-26 杭州海康威视数字技术股份有限公司 Method and device for enhancing license plate area, camera device, computing equipment and storage medium
CN113038017A (en) * 2021-03-24 2021-06-25 重庆中科云从科技有限公司 Image acquisition method, image acquisition device and computer-readable storage medium

Also Published As

Publication number Publication date
CN105578063B (en) 2018-04-10

Similar Documents

Publication Publication Date Title
CN105578063A (en) Image processing method and terminal
CN105554483B (en) A kind of image processing method and terminal
CN107977940B (en) Background blurring processing method, device and equipment
KR102279436B1 (en) Image processing methods, devices and devices
EP3542347B1 (en) Fast fourier color constancy
US10645268B2 (en) Image processing method and apparatus of terminal, and terminal
CN103366352B (en) Apparatus and method for producing the image that background is blurred
CN105049718A (en) Image processing method and terminal
CN108712608A (en) Terminal device image pickup method and device
US9460497B2 (en) Image enhancement methods and systems using the same
CN111738970A (en) Image fusion method and device and computer readable storage medium
CN108012078A (en) Brightness of image processing method, device, storage medium and electronic equipment
CN111837155A (en) Image processing method and apparatus
CN108717691B (en) Image fusion method and device, electronic equipment and medium
CN105245863A (en) Image processing device that performs white balance control, method of controlling the same, and image pickup apparatus
CN107682611B (en) Focusing method and device, computer readable storage medium and electronic equipment
CN112991245A (en) Double-shot blurring processing method and device, electronic equipment and readable storage medium
CN115550570A (en) Image processing method and electronic equipment
CN114866754A (en) Automatic white balance method and device, computer readable storage medium and electronic equipment
CN106550227A (en) A kind of image saturation method of adjustment and device
CN107948511A (en) Brightness of image processing method, device, storage medium and electronic equipment
CN111866369B (en) Image processing method and device
CN109300186B (en) Image processing method and device, storage medium and electronic equipment
WO2023124201A1 (en) Image processing method and electronic device
WO2021145913A1 (en) Estimating depth based on iris size

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant