WO2021000592A1 - Dispositif et procédé de capture d'image - Google Patents

Dispositif et procédé de capture d'image Download PDF

Info

Publication number
WO2021000592A1
WO2021000592A1 PCT/CN2020/078327 CN2020078327W WO2021000592A1 WO 2021000592 A1 WO2021000592 A1 WO 2021000592A1 CN 2020078327 W CN2020078327 W CN 2020078327W WO 2021000592 A1 WO2021000592 A1 WO 2021000592A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
image
target
infrared light
visible light
Prior art date
Application number
PCT/CN2020/078327
Other languages
English (en)
Chinese (zh)
Inventor
刘军
汪鹏程
陈勇
李�灿
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2021000592A1 publication Critical patent/WO2021000592A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means

Definitions

  • This application relates to the field of imaging technology, and in particular to a camera device and method.
  • a camera is a device that converts optical image signals into electrical signals. Since the invention of camera technology, researchers have been improving the structure of the camera, aiming to allow the camera to capture images under different conditions and the captured images are clearer and more realistic, whether effective, clear and true images and lenses can be obtained , Image sensors, and image processing modules are closely related.
  • a polarizer on the lens can filter out the light reflected by the transparent medium when the camera shoots the object through the transparent medium with strong reflection ability, so that The light reflected by the transparent medium has a weaker effect on the image of the object, but the polarizer will also filter the reflected light of the target, which affects the image of the object, and because the filter of the reflected light by the polarizer is relative to the camera, the light direction and the target
  • the locations are all related and performance is unstable. Therefore, how to design a camera with more stable performance and adaptable to complex scenes is a problem that needs to be solved urgently.
  • the present application provides a camera device, which is used to solve the problem of poor shooting effect of a camera in a complex scene (for example, when shooting an object through a transparent medium with strong reflection ability).
  • the present application provides a camera device that includes a lens, a light processing module, a first image sensor, a second image sensor, and an image processing module; wherein the lens is used to capture light reflected by a target , And inject the acquired light into the light processing module; the light processing module is arranged on the exit surface of the lens, and is used to separate the light acquired by the lens into visible light and near-infrared light, wherein the Visible light is emitted from the first exit surface of the light processing module, and the near-infrared light is emitted from the second exit surface of the light processing module; the first image sensor is arranged on the first exit surface for The visible light is received, and a visible light image is generated according to the received visible light; the second image sensor is arranged on the second exit surface and is used to receive the near-infrared light, and according to the received near-infrared light The infrared light generates a near-infrared light image; the image processing module is connected to the first
  • the camera device provided by the first aspect separates the light reflected by the photographed target into visible light and near-infrared light, and then obtains two images.
  • the final output image is obtained based on the two images, which makes the obtained output image signal-to-noise ratio better High (that is, the quality of the output image is high), which also enables this camera device to adapt to more shooting scenes, and can also shoot high-quality images in complex shooting scenes.
  • the light processing module is further configured to determine the wavelength range of the near-infrared light according to the environment where the target is located. This allows the camera device to adaptively adjust the near-infrared light according to the environment where the target is photographed, ensuring that the obtained near-infrared light image has a good signal-to-noise ratio, which also ensures the output obtained from the near-infrared light image and the visible light image The quality of the image makes the application scene of the camera device wider.
  • the determined near-infrared light has a wavelength range of 930 nm-950 nm. Determining the wavelength of the near-infrared light within the wavelength range of 930nm-940nm enables the imaging device to obtain a higher-quality output image when shooting a target through a medium with strong reflection ability in a strong light environment.
  • the determined wavelength range of the near-infrared light is 740 nm-760 nm. Determining the wavelength of the near-infrared light within the wavelength range of 740nm-760nm enables the imaging device to obtain a higher quality output image when shooting a target through a medium with strong reflection ability in a weakly illuminated environment.
  • the visible light image is a color image
  • the near-infrared light image is a black and white image
  • the output image is a color image.
  • the output image obtained by the camera device is of high quality and color image, which is applicable to a wider range of scenes.
  • the image processing module is specifically configured to extract the area corresponding to the target in the visible light image and the near-infrared light image; to combine the area corresponding to the target in the visible light image with The region corresponding to the target in the near-infrared light image is fused to obtain the region corresponding to the fused target; an output image is obtained according to the region corresponding to the fused target and the visible light image.
  • the camera device can also obtain high-quality output images of only the target being photographed. This camera device is suitable for application scenarios that pay special attention to the target (for example: vehicle overload judgment by outputting images, etc.) ).
  • the camera device further includes a light supplement module configured to determine the wavelength range of the light to be directed to the target according to the environment where the target is located, The target emits light with a wavelength within the determined wavelength range.
  • the camera device is equipped with a supplementary light module that determines the wavelength range of the light to be directed to the target according to the environment where the target is located, so that the visible light image and the near-infrared light image obtained by the camera device have higher energy, and further makes the output image obtained Higher energy.
  • the present application provides an imaging method, the method includes: acquiring light reflected by a target; separating the acquired light into visible light and near-infrared light, wherein the near-infrared light is filtered by a filter unit The obtained near-infrared light with a wavelength in a specific wavelength range is obtained later; a visible light image is generated according to the visible light, and a near-infrared light image is generated according to the near-infrared light; an output image is obtained according to the visible light image and the near-infrared light image.
  • the method further includes: adjusting the wavelength range of the light filtered by the filter unit according to the environment where the target is located.
  • the adjusting the wavelength range of the light filtering of the light filter unit according to the environment where the target is located specifically includes: adjusting the light filtering of the light filter unit according to the environment where the target is located.
  • the wavelength range of light is 930nm-950nm.
  • the adjusting the wavelength range of the light filtering of the light filter unit according to the environment where the target is located specifically includes: adjusting the light filtering of the light filter unit according to the environment where the target is located.
  • the wavelength range of light is 740nm-760nm.
  • the visible light image is a color image
  • the near-infrared light image is a black and white image
  • the output image is a color image
  • the obtaining an output image based on the visible light image and the near-infrared light image specifically includes: extracting an area corresponding to a target in the visible light image and the near-infrared light image; The area corresponding to the target in the visible light image and the area corresponding to the target in the near-infrared light image are fused to obtain the area corresponding to the fused target; according to the area corresponding to the fused target and the visible light The image gets the output image.
  • the method further includes: determining a wavelength range of light to be emitted to the target according to the environment in which the target is located, and the wavelength emitted to the target is within the determined wavelength range Of light.
  • FIG. 1 is a schematic diagram of the structure of a camera device 100
  • FIG. 2 is a schematic structural diagram of a camera device 200 provided by this application.
  • FIG. 3 is a working schematic diagram of an optical working sub-device 300 according to an embodiment of the application.
  • FIG. 4 is a schematic structural diagram of a switchable filter unit 3022 provided by an embodiment of the application.
  • FIG. 5 is a working schematic diagram of an electrical working sub-device 400 provided by an embodiment of the application.
  • FIG. 6 is a schematic flowchart of a camera method provided by an embodiment of the application.
  • FIG. 7 is a working schematic diagram of an optical processing module 600 provided by an embodiment of the application.
  • Visible light is an electromagnetic wave that the human eye can perceive. Generally, the human eye can perceive an electromagnetic wave with a wavelength between about 390 and 700 nm.
  • Near-infrared light is an electromagnetic wave between visible light and mid-infrared light. According to the definition of the American Society for Testing and Materials Inspection, near-infrared light refers to electromagnetic waves with a wavelength in the range of 700 to 2500 nm.
  • the half-height width of the filter film system In a graph formed by taking the wavelength of light as the abscissa and the transmittance of the filter to light of different wavelengths on the ordinate, the light wave wavelength and the light peak corresponding to the light peak transmittance The absolute value of the difference between the wavelengths of light corresponding to half of the transmittance is called the half-width of the filter film.
  • the peak light transmittance refers to the size of the highest light transmittance of the filter.
  • Spectroscopic film a combination of multilayer optical films that separate one light into two or more lights of different wavelengths.
  • Filter film a combination of multilayer optical films that filter the passing light according to certain requirements.
  • the spectroscopic film system and the filter film system can respectively realize different functions of spectroscopy and filtering.
  • the spectroscopic film used in this application can realize the separation of light into visible light and near-infrared light
  • the filter film used in this application includes a filter film that can transmit light with a wavelength of 940nm and a filter film that can transmit light with a wavelength of 750nm Light filter film system.
  • Exit surface The plane formed by the propagation direction of light from one medium to another.
  • FIG. 1 is a schematic diagram of the structure of a camera device 100.
  • the imaging device 100 includes a lens 101, an image sensor 102, an analog signal/digital signal (A/D) conversion module 103, and an image processing module 104.
  • A/D analog signal/digital signal
  • the lens 101 is a lens group including one or more pieces of optical glass (for example, a convex lens, a concave lens). In the imaging process, the lens 101 is used to gather light reflected by a photographed object and map the light reflected by the photographing target to the image sensor 102 . In order to adapt to different applications, there are many types of lenses, such as: zoom lens, fixed focus lens, fisheye lens, wide-angle lens, telephoto lens, macro lens, etc.
  • the image sensor 102 is a component or device that converts optical images into electronic signals.
  • the subject is mapped from the lens 101 to the light-receiving surface of the image sensor 102, and an optical image of the object is formed on the light-receiving surface.
  • the image sensor 102 further converts the optical image formed by the object into an analog electronic signal.
  • the image sensor 102 has many types. For example: camera tube, charge coupled device (CCD), complementary metal oxide semiconductor (complementary metal oxide semiconductor, CMOS) sensor).
  • the A/D conversion module 103 is used to convert the analog electronic signal obtained by the image sensor 102 into a digital signal. It is worth noting that the A/D conversion module 103 can be combined with the image sensor 102 or the image processing module 104 in some camera devices.
  • the image processing module 104 is configured to receive the digital signal obtained by the A/D conversion module 103, and process the digital signal to form a digital image.
  • the image processing module 104 can perform multiple processing on the digital signal, such as: deducting dark current (removing the bottom current noise), linearization (solving data nonlinear problems), shading (solving brightness attenuation and color changes caused by the lens), and removing damage Point (remove the bad point data in the sensor), convert the original data to RGB data, auto white balance, auto focus, auto exposure, optimize local and overall contrast, angle change, sharpening, color space conversion (convert to a different color space for Processing), color enhancement, etc.
  • the functions included in the image processing modules of different types of camera devices are also different.
  • the image sensor 102 is disposed on the exit surface of the lens 101 so that the light emitted by the lens 101 is incident on the light receiving surface of the image sensor 102.
  • the image sensor 102 and the A/D conversion module 103 are connected through a communication path, so that the image sensor 102 sends analog electronic signals to the A/D conversion module 103.
  • the A/D conversion module 103 and the image processing module 104 are connected through a communication path, so that the A/D conversion module 103 sends digital signals to the image processing module 104.
  • the camera device 100 photographs an object
  • the light reflected by each reflective point on the object is collected by the lens 101.
  • Each reflective point is mapped to the light-receiving surface of the image sensor 102, and the photoelectric conversion is completed by the image sensor 102.
  • the A/D conversion module 103 then converts the obtained analog electrical signal into a digital signal
  • the image processing module 104 processes the digital signal to form Digital image, which is the image formed by the photographed target.
  • the digital image can be displayed by a display module, which can be a display screen in a camera, a computer display screen, a mobile phone display screen, etc.
  • the present application provides a camera device 200, as shown in FIG. 2, the device includes: a lens 201, a light processing module 202, an image sensor 203a and an image sensor 203b, an A/D conversion module 204, an image processing module 205, a supplement Optical module 206.
  • the lens 201 is used to obtain the light reflected by the object in the shooting area, and send the obtained light to the light processing module 202.
  • the light processing module 202 is used to separate the light emitted from the lens 201 into visible light and near-infrared light.
  • the light processing module 202 is also used to filter the separated visible light and/or near-infrared light, so as to obtain monochromaticity. Better visible light and/or near infrared light.
  • the image sensor 203a and the image sensor 203b are respectively used for photoelectric conversion of visible light and near-infrared light to obtain analog electronic signals corresponding to the two lights.
  • the A/D conversion module 204 is configured to convert the analog electronic signals corresponding to the two lights obtained by the image sensor 203a and the image sensor 203b into digital signals respectively, and send the two obtained digital signals to the image processing module 205 respectively.
  • the image processing module 205 is used for receiving two digital signals sent by the A/D conversion module 204, processing the two digital signals to form a digital image, and for fusing the two digital images to obtain the fusion The resulting digital image is used as the output image.
  • the camera device 200 further includes a supplementary light module 206, which is used as a supplementary light source when shooting a target, emitting near-infrared light and/or visible light to the target, so that the photographed target reflects near-infrared light and/ Or visible light to the lens 201.
  • a supplementary light module 206 which is used as a supplementary light source when shooting a target, emitting near-infrared light and/or visible light to the target, so that the photographed target reflects near-infrared light and/ Or visible light to the lens 201.
  • the above-mentioned image sensors 203a and 203b and the A/D conversion module 204 are connected through a communication path, so that the analog electrical signals of the visible light path and the analog electrical signals of the near-infrared light path generated by the image sensors 203a and 203b are transmitted through the communication path to
  • the A/D conversion module 204; the A/D conversion module 204 and the image processing module 205 are also connected through a communication path.
  • the above-mentioned positional relationship between the lens 201 and the light processing module 202 allows the light emitted by the lens 201 to be incident on the light processing module 202, and the positional relationship between the light processing module 202 and the image sensor 203a makes the visible light separated from the light processing module 202 be emitted
  • the positional relationship between the light processing module 202 and the image sensor 203b is such that the near-infrared light separated by the light processing module 202 is emitted to the light receiving surface of the image sensor 203b.
  • the camera device 200 may also include other components, such as a shutter button, a housing, a switch, a display screen, etc. These components may be any type of components in existing or future technologies, and this application does not specifically limit it.
  • the imaging device 200 includes an optical working sub-device 300 and an electrical working sub-device 400.
  • the imaging device 200 is divided into an optical working sub-device 300 and an electrical working sub-device 400 according to the difference of the signals processed in the working process.
  • the optical working sub-device 300 is used to process optical signals during operation.
  • 400 is used to process electrical signals during work.
  • the optical working sub-device 300 includes a lens 301 (corresponding to a specific realization of the lens 201 in the camera device 200), and a light processing module 302 (corresponding to It is a specific realization of the light processing module 202 in the camera 200), the image sensor 303a (corresponding to a specific realization of the image sensor 203a in the camera 200), and the image sensor 303b (corresponds to the image in the camera 200) A specific implementation of the sensor 203b).
  • the lens 301 is used to capture the light (including visible light and near-infrared light) reflected by the object being photographed.
  • the lens 301 includes a variety of lenses, for example, according to functions, it can be divided into dust-proof lenses, filter lenses, and condenser lenses.
  • the light processing module 302 is arranged on the exit surface of the light emitted from the lens 301, and the light processing module 302 is arranged adjacent to the lens 301.
  • the light acquired by the lens 301 is injected into the light processing module 302.
  • the processing module 302 separates and filters the light acquired by the lens 301 into a visible light and a near-infrared light.
  • the light processing module 302 includes a spectroscopic film system 3021 and a switchable filter unit 3022.
  • the switchable filter unit 3022 is disposed on the exit surface of the near-infrared light separated by the spectroscopic film system 3021, so that the switchable filter unit 3022 is The light is filtered.
  • the spectroscopic film system 3021 is composed of multiple layers of dichroic optical films, referred to as the spectroscopic film.
  • the transmittance and reflectance of each layer of the spectroscopic film can be different.
  • the multilayer spectroscopic film in the spectroscopic film system 3021 in this application is designed to reflect Visible light transmits near-infrared light. Therefore, the reflected light of the photographed target captured by the lens 301 is separated into two rays of visible light and near-infrared light by the multilayer spectroscopic film.
  • the switchable filter unit 3022 is used to filter the near-infrared light separated by the spectroscopic film system 3021, so that the obtained near-infrared light retains the near-infrared light in a specific wavelength range after being filtered.
  • the switchable filter unit 3022 includes two filter film systems (respectively a 940nm filter film system with a light transmission wavelength centered at 940nm and a light transmission wavelength 750nm filter film system centered on 750nm), switch, photosensitive element.
  • the photosensitive element in the switchable filter unit 3022 can perceive the surrounding light environment of the photographed target.
  • the photosensitive element When the surrounding environment of the photographed target is bright (for example, in a strong daylight environment), the photosensitive element is connected to the switch, The filter film system is switched according to the light information of the photosensitive element by the switch, so that in an environment with strong light, the switchable filter unit 3022 uses the 940nm filter film system to filter, so that it passes through the switchable filter unit 3022.
  • the wavelength of infrared light is between 940nm ⁇ 10nm.
  • the photosensitive element When the surrounding environment of the subject is dark (for example, in an environment with weak night light), the photosensitive element is connected to the switch, and the switch is used to switch the filter film system according to the light information of the photosensitive element, so that the light In a weak environment, the switchable filter unit 3022 is filtered by a 750nm filter film system, so that the wavelength of the near-infrared light passing through the switchable filter unit 3022 is between 750nm ⁇ 10nm.
  • the photosensitive element can be a photoresistor
  • the switch can be a DC motor switch.
  • the photoresistor When the light is strong, the photoresistor has a large resistance value, and the switch is in the off state, and the 940nm filter The optical film system is located on the exit surface of the light emitted from the lens 301. Therefore, the near-infrared light separated by the spectroscopic film system is filtered by the 940 nm filter film system.
  • the resistance of the photoresistor becomes lower, and the DC motor switch is powered on, and the 750nm filter film is switched to the light exit surface of the lens 301. Therefore, the 750nm filter film is used for The near-infrared light separated by the spectroscopic film is filtered.
  • the switchable filter unit 3022 can complete the switching of the filter film in time, so that the switchable filter unit 3022 filters light
  • the latter near-infrared light is near-infrared light in a specific wavelength range.
  • the imaging device 200 can shoot a target on a transparent medium with strong reflection ability during the day and night, and obtain a clear image.
  • the design of the 940nm filter film in the switchable filter unit 3022 in this application is used for the imaging device to shoot objects through a transparent medium with strong reflective ability in a strong light environment.
  • the experiment concluded that there are more components of near-infrared light with a wavelength near 940nm in natural light during the day, and the transparent medium (such as glass) with strong reflection ability of 940nm near-infrared light has higher transmittance and lower reflectance. Therefore, in an environment with strong light, using 940nm near-infrared light as the light to be photographed on the image sensor can make the image sensor obtain an optical image with a high signal-to-noise ratio.
  • the design of the 750nm filter film is used in the case where the camera device shoots objects through a transparent medium with strong reflection ability in a weak light environment. It is mainly based on experimental findings that under a weak light environment (for example: night), it is The ratio of the near-infrared light with a wavelength of 750nm reflected by the shooting target to the near-infrared light with a wavelength of 750nm reflected by a transparent medium (for example: glass) with strong reflection ability is higher, which also makes the target photographed under the light with a wavelength of 750nm The signal-to-noise ratio of imaging is higher.
  • the film system design parameters include: filter film system half-height width, film The number of layers of the optical film in the system, the thickness of the film, the film material, etc., among which the half-height width of the filter film is one of the most important film design parameters.
  • the half-height width of the filter film is an important indicator used to limit the wavelength of the light that passes through the filter film. The larger the half-height of the filter film, the greater the range of the wavelength of the light that passes through the filter film, and vice versa. small.
  • the half-height width of the filter film can be calculated according to the energy distribution of the light source and the image signal-to-noise ratio required to identify the target. It can also be adjusted in combination with factors such as the technological level, the main purpose of the camera device, and the manufacturing cost. Generally speaking, the smaller the half-height width of the filter film, the higher the design cost and the higher the required process level.
  • This application does not limit the specific value of the half-height width of the filter film system.
  • the half-height width of the filter film system of the 940nm filter film system and the half-height width of the filter film system of the 750nm filter film system are not limited in this application. Both can be designed to be 20nm.
  • the wavelength of light that can be transmitted by the 940nm filter film is within the range of [930nm, 950nm], and the wavelength of the light that can be transmitted by the 750nm filter film is [740nm, 760nm]. Within the interval.
  • the image sensor 303a is provided on the exit surface of the visible light reflected by the light processing module 302 for To receive the visible light reflected by the light processing module 302, a layer of sensor smear is designed on the image sensor 303a.
  • the sensor smear is the light-receiving surface.
  • the visible light emitted by the light processing module 302 is incident on the sensor smear to form a reflection of the target
  • the image sensor 303a converts the optical image of visible light into an analog electrical signal corresponding to the visible light.
  • the visible light reflected by the photographed target in the optical working sub-device 300 forms an analog electrical signal corresponding to the target through the lens 301, the light processing module 302, and the image sensor 303a, wherein, through the lens 301, the light processing module 302 and the image sensor
  • the path through which the visible light of 303a passes is called the visible light path.
  • the image sensor 303b is arranged on the exit surface of the light processing module 302, so that the near-infrared light of a specific wavelength emitted by the switchable filter unit 3022 in the light processing module 302 enters the surface of the image sensor 303b.
  • Sensitive smear the sensor smear of the image sensor 303b forms an optical image of the near-infrared light emitted by the target, and the image sensor 303b converts the optical image of the near-infrared light into an analog electrical signal.
  • the near-infrared light reflected by the photographic target in the optical working sub-device 300 forms an analog electric signal corresponding to the target through the lens 301, the light processing module 302, and the image sensor 303b.
  • the path through which the near-infrared light of the image sensor 303b passes is called the near-infrared light path.
  • the optical working sub-device 300 forms two analog electrical signals on the captured image (including the target and the background), which are called the analog electrical signal of the visible light path formed by the visible light path and the analog electrical signal of the near-infrared light path formed by the near-infrared light path. .
  • the optical working sub-device 300 further includes a light supplement module 304, which serves as a near-infrared light source for emitting near-infrared light (and/or visible light) to the photographed target, so that the photographed target not only reflects the natural light source and emits The natural light is also reflected by the light emitted by the light supplement module 304.
  • the light supplemented by the light supplement module 304 makes the near-infrared light path have sufficient near-infrared light, so that the image sensor 303b can form a strong near-infrared light path analog electrical signal.
  • the light emitted by the supplementary light module 304 may be a combination of visible light and near-infrared light.
  • the supplementary light module 304 may also only have one or several specific wavelength ranges of near-infrared light.
  • the supplementary light module 304 may include a photosensitive element and a switch, so that in a strong light environment, the supplementary light module 304 emits at a wavelength of 940 nm
  • the light supplement module 304 emits near-infrared light and visible light with a specific wavelength range centered at 750 nm in a weak light environment.
  • the supplementary light function provided by the supplementary light module 304 can also be implemented by other equipment or modules other than the camera.
  • a specific supplementary light is set on a hanging pole at a traffic intersection to provide a camera for a camera set at a traffic intersection.
  • the device provides supplementary light function.
  • the optical working sub-device 300 is connected to the electrical working sub-device 400.
  • the image sensor 303a and the image sensor 303b in the optical working sub-device 300 and the A/D in the electrical working sub-device 400 The conversion module 401 is connected.
  • the two analog electrical signals (the analog electrical signal of the visible light path and the analog electrical signal of the near-infrared light path) obtained by the optical working sub-device 300 are transmitted to the A/D conversion module 401 in the electrical working sub-device 400.
  • the electrical work sub-device 400 includes an A/D conversion module 401 (corresponding to a specific implementation of the A/D conversion module 204 in the camera device 200) and an image processing module 402 (corresponding to the image processing module 205 in the camera device 200). A concrete realization).
  • the working content of the electric working sub-device 400 is specifically introduced below:
  • the A/D conversion module 401 is used to receive the analog signal of the visible light path and the analog signal of the near-infrared light path, and respectively convert the two analog electrical signals into two digital signals to form the digital signal of the visible light path and the digital signal of the near-infrared light path. It should be understood that both the visible light path digital signal and the near infrared light path digital signal are two-dimensional digital signals.
  • the image processing module 402 is used to receive the visible light path digital signal and the near-infrared light path digital signal, respectively perform color correction and white balance processing on the two digital signals, and further encode the two digital signals, so that the two digital signals form two digital signals.
  • a digital image digital image of visible light path and digital image of near-infrared light path
  • each digital image is composed of multiple pixels.
  • the image processing module 402 also includes an extraction unit 4021 and a fusion unit 4022.
  • the extraction unit 4021 is used to receive the digital image of the visible light path and the digital image of the near-infrared light path, and extract the digital image of the near-infrared light path.
  • the photographed target in the digital image of the target and visible light path.
  • the present application does not limit the specific method for the extraction unit 4021 to extract the photographed target.
  • the edge of the photographed target may be detected by an edge detection algorithm, and the photographed target may be extracted according to the detected edge.
  • the fusion unit 4022 receives the photographed target in the digital image of the near-infrared light path extracted by the extraction unit 4021 and the photographed target in the digital image of the visible light path, and merges the data corresponding to the two photographed objects to form a fused photographed object
  • the target is to replace the fused photographed target with the corresponding position of the photographed target in the digital image of the visible light path to obtain the fused digital image
  • the fused digital image is a color image with high signal-to-noise ratio.
  • the fused digital image is stored or displayed by the camera device, that is, the image of the photographed target captured by the camera device.
  • the image processing module 402 may perform further processing on the fused digital image, such as optimizing local and overall contrast, angle change, sharpening, color enhancement, etc., and the processed fused digital image is stored or stored by the camera device. display.
  • this application does not limit the specific fusion method of the fusion unit 4022 on the target in the digital image of the near-infrared light path and the target in the digital image of the visible light path.
  • the digital image of the near-infrared light path can be used.
  • the gray value of each pixel in the target is weighted and averaged with the gray value of each pixel in the target in the digital image of the visible light path to obtain the gray value of each pixel of the target.
  • the fused image of the photographed target is obtained according to the gray value of each pixel after fusion.
  • the image processing module 402 may not include the extraction unit 4021.
  • the extraction unit 4021 For example, for the case where the target is all the pictures captured by the camera, and for the background of the target, it is also necessary to obtain signal-to-noise.
  • the fusion unit 4022 directly fuses the two digital images to obtain the fused digital image.
  • the fusion unit 4022 in the image processing module 402 can also fuse the visible light path digital signal and the near-infrared light path digital signal directly received from the aforementioned A/D conversion module 401 to obtain the fusion
  • the image processing module 402 further performs color correction, white balance processing, encoding processing, color enhancement, optimization of local and overall contrast, angle change, sharpening and other operations on the fused digital signal. Item to obtain the fused digital image.
  • the digital image obtained from the visible light path usually has a low signal-to-noise ratio (because in a strong light environment, the visible light reflected by a transparent medium with strong reflective ability is The ratio of the energy of the visible light reflected by the shooting target is small; in a weakly illuminated environment, the energy of the visible light reflected by the shooting target is small), and for the digital image of the near-infrared light path obtained in this application, the light is strong and the light is weak.
  • Digital images with high signal-to-noise ratio can be captured in any environment, but because the digital image of the near-infrared optical path is obtained by only one kind of light reflection, the digital image formed by the near-infrared optical path is a black and white image.
  • the fused digital image obtained by fusing the digital image of the visible light path and the digital image of the near-infrared light path by the extraction unit 4021 and the fusion unit 4022 in the image processing module 402 in this application has a high signal-to-noise ratio and is a color image.
  • the imaging device composed of the optical working sub-device 300 and the electrical working sub-device 400 has stable performance when shooting targets, and can overcome the difficulties of various environments. For example, it can be used in strong and weak light.
  • the target is shot through the reflective transparent medium in the environment, and the digital image with high signal-to-noise ratio is obtained, which avoids the light reflected by the reflective transparent medium from affecting the imaging of the target, and also avoids the environment with weak light Under the situation where the digital image signal-to-noise ratio of the subject is low.
  • this application also provides an imaging method executed by the imaging device.
  • the following describes the method flow of the camera device provided in the embodiment of the present application when shooting a target in a weak light environment in conjunction with FIG. 6.
  • the camera device determines that the object to be shot is in an environment with weak light according to the shooting environment, and adjusts the configuration of the camera device.
  • the photosensitive element in the imaging device feels that the environment where the target is photographed is dark, and the supplementary light module switches the supplementary light source to a supplementary light source capable of emitting near-infrared light in the wavelength range of 750nm ⁇ 10nm, and the light processing module
  • the switchable filter unit in the switch switches the filter film system to a 750nm filter film system that can filter near-infrared light in the wavelength range of 750nm ⁇ 10nm.
  • S502 The camera device photographs the target.
  • the camera device is activated, the light supplement module of the camera device emits near-infrared light (and/or visible light) to the photographed target, and the camera device acquires the light reflected by the target and the background in the photographed area through the lens.
  • the light supplement module of the camera device emits near-infrared light (and/or visible light) to the photographed target, and the camera device acquires the light reflected by the target and the background in the photographed area through the lens.
  • the camera device generates a near-infrared light path image and a visible light path image.
  • the light processing module in the camera device receives the light acquired by the lens, separates one light into visible light and near-infrared light, and the near-infrared light also passes through the 750nm filter film system to obtain a wavelength between 740nm-760nm Near infrared light.
  • Visible light enters the first image sensor, and the first image sensor generates a visible light image; the near-infrared light enters the second image sensor, and the second image sensor generates a near-infrared light image.
  • the visible light image and the near-infrared light image are two-dimensional analog signals generated by the first image sensor and the second image sensor.
  • visible light can also pass through a specific filter film system to obtain visible light in a specific wavelength range.
  • the camera device obtains an output image according to the near-infrared light image and the visible light image.
  • the visible light image obtained by the first image sensor and the near-infrared light image obtained by the second image sensor are input to the A/D conversion module, and the A/D conversion module is converted into a visible light digital image and a near-infrared light digital image.
  • the image processing module fuses the visible light digital image and the near infrared light digital image to obtain the output image.
  • step S501 the light-receiving element in the imaging device feels that the environment where the target is photographed is brighter, and the supplemental light module switches the supplemental light source to a supplementary light that emits near-infrared light in the wavelength range of 940nm ⁇ 10nm
  • the light source, the switchable filter unit in the light processing module switches the filter film system to a 940nm filter film system that can filter near-infrared light in the wavelength range of 940nm ⁇ 10nm.
  • step S503 the light processing module in the camera device receives the light obtained by the lens, and separates one light into visible light and near-infrared light, and the near-infrared light also passes through the 940nm filter film system to obtain a wavelength of 930nm -Near infrared light between 950nm.
  • the internal structure of the light processing module 202 in the camera device 200 may have multiple types, for example, the internal structure of the light processing module 302 described in the foregoing embodiment is one of them.
  • FIG. 7 Another embodiment of the present application also provides another optical processing module 600.
  • the internal structure of the optical processing module 600 is shown in FIG. 7.
  • the optical processing module 600 in FIG. 7 includes a switchable filter unit 601 and a spectroscopic film system. 602.
  • the switchable filter unit 601 in the light processing module 600 is placed on the exit surface of the light acquired by the lens.
  • the light emitted by the lens is first injected into the switchable filter unit 601.
  • the switchable filter unit 601 includes a photosensitive element and a switch , Two kinds of filter film systems (respectively, a double-pass filter film system that transmits visible light and near-infrared light with a wavelength of 940nm ⁇ 10nm and a double-pass filter film system that transmits visible light and near-infrared light with a wavelength of 750nm ⁇ 10nm) .
  • the photosensitive element in the switchable filter unit 601 can perceive the surrounding light environment of the photographed target.
  • the photosensitive element When the surrounding environment of the photographed target is bright (for example, in a strong daylight environment), the photosensitive element is connected to the switch, The filter film system is switched according to the light information of the photosensitive element by the switch, so that in a strong light environment, the switchable filter unit 601 uses a double-pass filter film system that transmits visible light and 940nm ⁇ 10nm near infrared light. Filtering, so that the switchable filter unit 601 emits near-infrared light and visible light with a wavelength between 940nm ⁇ 10nm.
  • the photosensitive element When the surrounding environment of the subject is dark (for example, in an environment with weak night light), the photosensitive element is connected to the switch, and the switch is used to switch the filter film system according to the light information of the photosensitive element, so that the light
  • the switchable filter unit 601 uses a double-pass filter film that transmits visible light and 750nm ⁇ 10nm near-infrared light to filter, so that the switchable filter unit 601 emits near-infrared wavelengths between 750nm ⁇ 10nm Light and visible light.
  • the spectroscopic film 602 of the light processing module 600 is placed on the exit surface of the switchable filter unit 601, so that the visible light emitted by the switchable filter unit 601 and the near-infrared light of a specific wavelength range (under strong light environment: 940nm ⁇ 10nm near infrared) Light; in a dark environment: 750nm ⁇ 10nm near infrared light) enters the spectroscopic film 602, the spectroscopic film 602 reflects visible light, transmits near-infrared light in a specific wavelength range, and separates the incident light into visible light and specific wavelength range In the near-infrared light, the two rays of light are emitted through different exit surfaces.
  • the optical processing module 600 can be used to replace the optical processing module 302 in the optical working sub-device 300 described in the foregoing embodiment, and the optical working sub-device 300 after module replacement can implement the aforementioned All the functions described in the embodiments will not be repeated here.
  • the light processing module 600 and the light processing module 302 are only two specific implementations of the light processing module 200 in the camera 200 provided in the present application, and do not limit the camera 200 and the camera method provided in the present application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Blocking Light For Cameras (AREA)

Abstract

La présente invention concerne un dispositif de capture d'image. Le dispositif de capture d'image comprend une lentille, un module de traitement optique, un premier capteur d'image, un second capteur d'image et un module de traitement d'image. La lentille est utilisée pour acquérir une lumière réfléchie par une cible, et diriger la lumière acquise dans le module de traitement optique. Le module de traitement optique est utilisé pour diviser la lumière acquise par la lentille en lumière visible et en lumière proche infrarouge. Le premier capteur d'image est utilisé pour recevoir la lumière visible, et pour générer une image de lumière visible en fonction de la lumière visible reçue. Le second capteur d'image est utilisé pour recevoir la lumière proche infrarouge, et pour générer une image de lumière proche infrarouge en fonction de la lumière infrarouge proche reçue. Le module de traitement d'image est utilisé pour obtenir une image de sortie en fonction de l'image de lumière visible et de l'image de lumière proche infrarouge. Le dispositif de capture d'image décrit selon la présente invention est susceptible de capturer une cible dans un scénario complexe, et fournit une performance de capture d'image stable.
PCT/CN2020/078327 2019-07-04 2020-03-07 Dispositif et procédé de capture d'image WO2021000592A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910600695.X 2019-07-04
CN201910600695.XA CN110365878B (zh) 2019-07-04 2019-07-04 一种摄像装置和方法

Publications (1)

Publication Number Publication Date
WO2021000592A1 true WO2021000592A1 (fr) 2021-01-07

Family

ID=68218116

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/078327 WO2021000592A1 (fr) 2019-07-04 2020-03-07 Dispositif et procédé de capture d'image

Country Status (2)

Country Link
CN (1) CN110365878B (fr)
WO (1) WO2021000592A1 (fr)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110365878B (zh) * 2019-07-04 2022-05-17 华为技术有限公司 一种摄像装置和方法
CN111726493A (zh) * 2020-06-17 2020-09-29 Oppo广东移动通信有限公司 摄像头模组及终端设备
CN112383688B (zh) * 2020-11-10 2023-03-24 珠海格力电器股份有限公司 摄像补光方法、装置、电子设备和智能终端
CN113303905B (zh) * 2021-05-26 2022-07-01 中南大学湘雅二医院 一种基于视频影像反馈的介入手术操作模拟方法
CN114650359A (zh) * 2022-03-22 2022-06-21 维沃移动通信有限公司 摄像模组以及电子设备
CN115273184B (zh) * 2022-07-15 2023-05-05 北京百度网讯科技有限公司 人脸活体检测模型训练方法及装置
CN116261042B (zh) * 2022-12-20 2024-02-27 哈尔滨海鸿基业科技发展有限公司 一种用于多摄像单元图像融合后影像自动聚焦机构
CN116647737B (zh) * 2023-07-21 2023-10-31 立臻科技(昆山)有限公司 一种彩色成像组件及其图像处理方法
CN117768793B (zh) * 2024-02-22 2024-05-17 长春市榣顺科技有限公司 一种大视场、长焦距、高分辨率的探测仪器及探测方法

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201464775U (zh) * 2009-06-11 2010-05-12 哈尔滨市科佳通用机电有限公司 高速工业数字摄像装置
CN101795397A (zh) * 2010-01-27 2010-08-04 北京交通大学 一种检测车辆内部乘客的红外成像方法
US20140168444A1 (en) * 2012-12-14 2014-06-19 Korea University Research And Business Foundation Apparatus and method for fusing images
CN107845083A (zh) * 2016-09-19 2018-03-27 杭州海康威视数字技术股份有限公司 分光融合的图像采集设备
US20180278857A1 (en) * 2017-03-23 2018-09-27 JVC Kenwood Corporation Imaging device and imaging method
CN109151287A (zh) * 2018-10-30 2019-01-04 泰州市华润纺织品有限公司 一种军用车载辅助夜视仪***
CN208576482U (zh) * 2018-06-19 2019-03-05 大连天天安全***有限公司 一种汽车防爆隔热膜透视***
CN110365878A (zh) * 2019-07-04 2019-10-22 华为技术有限公司 一种摄像装置和方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8531562B2 (en) * 2004-12-03 2013-09-10 Fluke Corporation Visible light and IR combined image camera with a laser pointer
JP2010258636A (ja) * 2009-04-23 2010-11-11 Alps Electric Co Ltd 撮像素子ユニット
CN101610355B (zh) * 2009-05-05 2011-03-16 张日和 日夜两用摄像装置
CN109474770B (zh) * 2017-09-07 2021-09-14 华为技术有限公司 一种成像装置及成像方法
CN207251777U (zh) * 2017-09-20 2018-04-17 信利光电股份有限公司 一种三维摄像模组
CN208820888U (zh) * 2018-11-02 2019-05-03 国网浙江省电力有限公司舟山供电公司 夜间增强图像色彩监控摄像机

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201464775U (zh) * 2009-06-11 2010-05-12 哈尔滨市科佳通用机电有限公司 高速工业数字摄像装置
CN101795397A (zh) * 2010-01-27 2010-08-04 北京交通大学 一种检测车辆内部乘客的红外成像方法
US20140168444A1 (en) * 2012-12-14 2014-06-19 Korea University Research And Business Foundation Apparatus and method for fusing images
CN107845083A (zh) * 2016-09-19 2018-03-27 杭州海康威视数字技术股份有限公司 分光融合的图像采集设备
US20180278857A1 (en) * 2017-03-23 2018-09-27 JVC Kenwood Corporation Imaging device and imaging method
CN208576482U (zh) * 2018-06-19 2019-03-05 大连天天安全***有限公司 一种汽车防爆隔热膜透视***
CN109151287A (zh) * 2018-10-30 2019-01-04 泰州市华润纺织品有限公司 一种军用车载辅助夜视仪***
CN110365878A (zh) * 2019-07-04 2019-10-22 华为技术有限公司 一种摄像装置和方法

Also Published As

Publication number Publication date
CN110365878B (zh) 2022-05-17
CN110365878A (zh) 2019-10-22

Similar Documents

Publication Publication Date Title
WO2021000592A1 (fr) Dispositif et procédé de capture d'image
CN102783135B (zh) 利用低分辨率图像提供高分辨率图像的方法和装置
KR101265358B1 (ko) 컬러 디지털 이미지를 사용하여 선명도 변경과 같은 액션을제어하는 방법
TWI526068B (zh) 圖像擷取裝置及影像處理方法
CN108712608B (zh) 终端设备拍摄方法和装置
US8792019B2 (en) Video creation device, video creation method and non-transitory computer-readable storage medium
CN101502098A (zh) 从场景到成像传感器的动态范围压缩的可调中灰过滤***
EP3481060B1 (fr) Caméra de surveillance utilisant un procédé de filtrage composite robuste contre un changement d'état de visibilité et système de surveillance vidéo utilisant celle-ci
CN114928688B (zh) 阵列摄像模组及具有阵列摄像模组的电子设备和图像处理方法
US11756221B2 (en) Image fusion for scenes with objects at multiple depths
WO2021083082A1 (fr) Procédé de commutation de trajet de lumière et module de surveillance
JP2009290694A (ja) 撮像装置
CN110326291B (zh) 具有自动聚焦功能的监控相机和采用其的视频监控***
US11347978B2 (en) Image processing apparatus, image processing method, and image processing system
JP2018023077A (ja) ビデオカメラ撮像装置
JP4751638B2 (ja) 色変換装置および撮影装置
CN109644258B (zh) 用于变焦摄影的多相机***
CN112104796B (zh) 图像处理方法和装置、电子设备、计算机可读存储介质
JP2008278538A (ja) 電子カメラ
CN206514949U (zh) 一种多光谱成像装置
JP2004222232A (ja) 画像処理装置および画像処理プログラム
KR200445847Y1 (ko) 카메라
JP2016200742A (ja) 撮像装置
KR200449278Y1 (ko) 케이스 및 이것을 구비한 감시카메라
KR100915406B1 (ko) 카메라

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20834970

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20834970

Country of ref document: EP

Kind code of ref document: A1