CN113160574A - Image processing method for traffic monitoring and dual-mode bayonet camera system - Google Patents

Image processing method for traffic monitoring and dual-mode bayonet camera system Download PDF

Info

Publication number
CN113160574A
CN113160574A CN202110111637.8A CN202110111637A CN113160574A CN 113160574 A CN113160574 A CN 113160574A CN 202110111637 A CN202110111637 A CN 202110111637A CN 113160574 A CN113160574 A CN 113160574A
Authority
CN
China
Prior art keywords
camera
image
traffic monitoring
image processing
dual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110111637.8A
Other languages
Chinese (zh)
Inventor
王鹏飞
陈雷
龚志广
何东昌
张景岩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Casic Wisdom Industrial Development Co ltd
Original Assignee
Casic Wisdom Industrial Development Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Casic Wisdom Industrial Development Co ltd filed Critical Casic Wisdom Industrial Development Co ltd
Priority to CN202110111637.8A priority Critical patent/CN113160574A/en
Publication of CN113160574A publication Critical patent/CN113160574A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/017Detecting movement of traffic to be counted or controlled identifying vehicles
    • G08G1/0175Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00Special procedures for taking photographs; Apparatus therefor
    • G03B15/02Illuminating scene
    • G03B15/03Combinations of cameras with lighting apparatus; Flash units
    • G03B15/05Combinations of cameras with electronic flash apparatus; Electronic flash units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0125Traffic data processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/08Detecting or categorising vehicles

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Traffic Control Systems (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention relates to the technical field of video processing, in particular to an image processing method for traffic monitoring and a dual-mode bayonet camera system, wherein the system comprises the following steps: a first camera, a second camera, and an image processing subsystem, wherein: an infrared filter is arranged in front of an image sensor of the first camera; the second camera is a low-illumination camera; the image processing subsystem is configured to: acquiring images captured by a first camera and a second camera; processing the acquired image and outputting a composite image superposed with vehicle information, personnel information and judgment result information; the first camera and the second camera have the same resolution, focal length and field angle lenses; the first camera and the second camera are both electrically connected to the image processing subsystem. The invention provides an image processing method for traffic monitoring and a dual-mode bayonet camera system, which solve the problem that the existing bayonet camera is difficult to provide color license plates and vehicle information.

Description

Image processing method for traffic monitoring and dual-mode bayonet camera system
Technical Field
The invention relates to the technical field of video processing, in particular to an image processing method for traffic monitoring and a dual-mode bayonet camera system.
Background
Currently, most bayonet cameras are visible light-based, because infrared light, although having the ability to suppress glare, does not provide clear license plate information and color vehicle information. The bayonet camera mainly using visible light wave band has two kinds of common LED light supplement lamp and low light camera. The ordinary LED fill light bayonet camera has strong light pollution and strong interference of strong light at noon, and can not see through the vehicle for 24 hours; the low-light-level camera solves the problem of light pollution, but cannot realize the 24-hour perspective of the vehicle.
Disclosure of Invention
The invention provides an image processing method for traffic monitoring and a dual-mode checkpoint camera system, which are used for solving the problem that the existing checkpoint camera is difficult to provide color license plates and vehicle information.
The technical scheme for solving the problems is as follows: a dual-mode bayonet camera system for traffic monitoring comprises a first camera, a second camera and an image processing subsystem, wherein:
an infrared filter is arranged in front of the image sensor of the first camera;
the second camera is a low-illumination camera, and a visible filter is arranged in front of an image sensor of the second camera;
the image processing subsystem is configured to: acquiring images captured by a first camera and a second camera; processing the acquired image and outputting a composite image superposed with vehicle information, personnel information and judgment result information;
the first camera and the second camera have the same resolution, focal length and field angle lenses; the first camera and the second camera are both electrically connected with the image processing subsystem.
Preferably, an infrared fill-in light is mounted on the first camera.
Preferably, an LED fill-in light is mounted on the second camera;
preferably, the infrared filter is a 940nm filter.
Preferably, the infrared light supplement lamp has a flashing mode.
Preferably, the pixels of the first camera and the second camera are each 900 ten thousand pixels.
In another aspect, the present invention further provides an image processing method for traffic monitoring, including the following steps:
receiving images captured by a first camera and a second camera; wherein: the image shot by the first camera is a black-and-white image, and the image shot by the second camera is a color image;
fusing the black-and-white image and the color image to obtain a composite image;
recognizing face information in the black-and-white image and vehicle information in the color image, wherein the vehicle information comprises information of a license plate and a vehicle type;
judging whether the behavior characteristics of the personnel in the black-and-white image are matched with preset behavior characteristics or not;
and overlapping the recognized vehicle information, the recognized face information and the recognized judgment result information to the synthetic image and outputting the synthetic image.
Preferably, the recognizing the face information in the black-and-white image specifically includes:
extracting a face area and coordinates from a black-and-white image;
and transmitting the coordinates and the black-and-white image to an identification library for identification and outputting an identification result.
Preferably, the preset behavior is a driving violation behavior.
Compared with the prior art, the invention has the beneficial effects that: the invention utilizes the dual-mode bayonet camera of the infrared camera and the low-light-level camera to realize the capability of providing clear face information and vehicle information of the driver and the co-driver for 24 hours all day. The dual-mode bayonet camera system comprises a high-speed low-light and infrared camera, an infrared light supplement lamp irradiation device and an LED light supplement lamp, can realize the perspective of a front windshield vehicle film by utilizing the optical characteristics of laser and video fusion processing, has the detection and identification capability on vehicles and drivers in all weather for 24 hours, and can be applied to the traffic fields of real-time snapshot of highways, important traffic frontier defense bayonet vehicle investigation, one-helmet one-band investigation and the like. The system can be deployed at a traffic intersection, when a vehicle runs to a snapshot area, the system is triggered to snapshot, a snapshot picture is processed and analyzed, a face area and coordinates are extracted, the coordinates and the picture are transmitted to a background recognition library, and face recognition is carried out on a driver and a copilot.
Drawings
Fig. 1 is an image output by the image processing method of the present invention.
Fig. 2 is a theoretical diagram of the atmospheric absorption spectrum model.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings of the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention.
Example 1: the dual-mode bayonet camera system comprises an image processing subsystem, a low-light-level camera, an infrared light supplement lamp with an explosion flashing mode and an LED light supplement lamp.
The infrared camera is used for capturing black and white images when the vehicle runs to the capturing area, and an infrared filter installed in the infrared camera is a 940nm filter;
the low-light-level camera is used for capturing a color image when the vehicle runs to the capturing area;
the image processing subsystem is configured to: acquiring images captured by an infrared camera and a low-light-level camera; processing the acquired image and outputting a composite image superposed with vehicle information, personnel information and judgment result information;
the infrared camera and the low-light camera have the same resolution, focal length and field angle lens. The infrared camera and the low-light camera are both electrically connected with the image processing subsystem.
The pixels of the infrared camera and the low-light camera are 900 ten thousand pixels. An appropriate waveband is selected, so that the filmed front windshield can be seen through under strong light interference, the influence of white light can be reduced as much as possible, according to the atmospheric absorption spectrum model theory shown in fig. 2, it can be seen that an absorption band can be seen in a 940nm waveband, 940nm light intensity in the daytime is selected in the waveband, infrared light supplementary lighting is performed in the 940nm waveband, the transparent front windshield under the strong light interference in the daytime can be restrained, and 940nm is an infrared waveband and cannot be seen.
Example 2: an image processing method for traffic monitoring comprises the following steps
Step 1: selecting two cameras with the same 900 ten thousand pixels and arranging lenses with the same focal length and field angle;
step 2: two optical filters are arranged for the two cameras, wherein the wavelength of 940nm is the wavelength of visible light;
step 3: an infrared light supplement lamp capable of supporting an explosion flash mode is installed on one camera provided with a 940nm infrared filter;
step 4: carrying out image fusion processing on the snap-shot images of the low-light camera and the infrared camera to obtain a synthetic image;
step 5: processing the color image of the low-light-level camera, and analyzing information such as the license plate and the model of the vehicle;
step 6: processing a black-and-white image of the infrared camera, identifying face information in the black-and-white image and judging whether behavior characteristics of personnel in the black-and-white image are matched with preset behavior characteristics or not;
step 7: superposing the processing results of the low-light-level camera and the infrared camera to the synthesized image;
step 8: the output image is spliced by two color and black-and-white images, and vehicle information, driver information, co-driver information and traffic violation information are superposed.
As a preferred embodiment of the present invention: the preset behavior characteristics comprise behaviors of driving a car to make a call, playing a mobile phone, not fastening a safety belt and the like.
As a preferred embodiment of the present invention: analyzing the face information in the black-and-white image specifically includes:
extracting a face area and coordinates from a black-and-white image;
and transmitting the coordinates and the black-and-white image to an identification library for identification and outputting an identification result.
As a preferred embodiment of the present invention: the specific implementation mode of performing image fusion processing on the captured images of the low-light-level camera and the infrared camera in the step4 to obtain a synthetic image is as follows: the deviation value is measured and calculated by a software algorithm, fitting is carried out, a composite image of the micro light and the infrared light is output, and vehicle information, personnel information, traffic violation information and the like can be displayed.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent structures or equivalent flow transformations made by using the contents of the specification and the drawings, or applied directly or indirectly to other related systems, are included in the scope of the present invention.

Claims (9)

1. A dual-mode bayonet camera system for traffic monitoring is characterized by comprising a first camera, a second camera and an image processing subsystem, wherein:
an infrared filter is arranged in front of the image sensor of the first camera;
the second camera is a low-illumination camera, and a visible filter is arranged in front of an image sensor of the second camera;
the image processing subsystem is configured to: acquiring images captured by a first camera and a second camera; processing the acquired image and outputting a composite image superposed with vehicle information, personnel information and judgment result information;
the first camera and the second camera have the same resolution, focal length and field angle lenses; the first camera and the second camera are both electrically connected with the image processing subsystem.
2. The dual-mode bayonet camera system for traffic monitoring as claimed in claim 1, wherein an infrared fill-in light is installed on the first camera.
3. The dual-mode bayonet camera system for traffic monitoring as claimed in claim 2, wherein the second camera is provided with an LED fill-in light.
4. The dual-mode bayonet camera system for traffic monitoring as claimed in claim 3, wherein the infrared filter is a 940nm filter.
5. The dual-mode bayonet camera system for traffic monitoring as claimed in claim 4, wherein the infrared fill light has a flashing mode.
6. The dual-mode bayonet camera system for traffic monitoring as claimed in claim 5, wherein the pixels of the first camera and the second camera are 900 ten thousand pixels each.
7. An image processing method for traffic monitoring, characterized by comprising the steps of:
receiving images captured by a first camera and a second camera; wherein: the image shot by the first camera is a black-and-white image, and the image shot by the second camera is a color image;
fusing the black-and-white image and the color image to obtain a composite image;
recognizing face information in the black-and-white image and vehicle information in the color image, wherein the vehicle information comprises information of a license plate and a vehicle type;
judging whether the behavior characteristics of the personnel in the black-and-white image are matched with preset behavior characteristics or not;
and overlapping the recognized vehicle information, the recognized face information and the recognized judgment result information to the synthetic image and outputting the synthetic image.
8. The image processing method for traffic monitoring according to claim 7, wherein recognizing the face information in the black-and-white image specifically comprises:
extracting a face area and coordinates from a black-and-white image;
and transmitting the coordinates and the black-and-white image to an identification library for identification and outputting an identification result.
9. The image processing method for traffic monitoring according to claim 8, wherein the preset behavior is a driving violation behavior.
CN202110111637.8A 2021-01-27 2021-01-27 Image processing method for traffic monitoring and dual-mode bayonet camera system Pending CN113160574A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110111637.8A CN113160574A (en) 2021-01-27 2021-01-27 Image processing method for traffic monitoring and dual-mode bayonet camera system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110111637.8A CN113160574A (en) 2021-01-27 2021-01-27 Image processing method for traffic monitoring and dual-mode bayonet camera system

Publications (1)

Publication Number Publication Date
CN113160574A true CN113160574A (en) 2021-07-23

Family

ID=76878825

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110111637.8A Pending CN113160574A (en) 2021-01-27 2021-01-27 Image processing method for traffic monitoring and dual-mode bayonet camera system

Country Status (1)

Country Link
CN (1) CN113160574A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114299724A (en) * 2021-12-28 2022-04-08 航天科工智慧产业发展有限公司 Dual-mode perspective bayonet laser all-in-one machine

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012008924A (en) * 2010-06-28 2012-01-12 Mitsubishi Electric Corp Number reader
CN203193791U (en) * 2013-03-26 2013-09-11 深圳市中控生物识别技术有限公司 Network camera with face identification function
CN103646545A (en) * 2013-11-15 2014-03-19 天津天地伟业数码科技有限公司 Infrared bayonet camera snapshot realization method
CN107403554A (en) * 2017-09-01 2017-11-28 北京壹卡行科技有限公司 Binocular integrated driving person's behavioural analysis apparatus and method for
CN109743494A (en) * 2018-09-30 2019-05-10 天津天地伟业信息***集成有限公司 A kind of infrared light filling bayonet camera
CN110428637A (en) * 2019-07-24 2019-11-08 华为技术有限公司 A kind of road gate grasp shoot method and road gate capturing system
CN111435972A (en) * 2019-01-15 2020-07-21 杭州海康威视数字技术股份有限公司 Image processing method and device
CN111783563A (en) * 2020-06-15 2020-10-16 深圳英飞拓科技股份有限公司 Double-spectrum-based face snapshot and monitoring method, system and equipment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012008924A (en) * 2010-06-28 2012-01-12 Mitsubishi Electric Corp Number reader
CN203193791U (en) * 2013-03-26 2013-09-11 深圳市中控生物识别技术有限公司 Network camera with face identification function
CN103646545A (en) * 2013-11-15 2014-03-19 天津天地伟业数码科技有限公司 Infrared bayonet camera snapshot realization method
CN107403554A (en) * 2017-09-01 2017-11-28 北京壹卡行科技有限公司 Binocular integrated driving person's behavioural analysis apparatus and method for
CN109743494A (en) * 2018-09-30 2019-05-10 天津天地伟业信息***集成有限公司 A kind of infrared light filling bayonet camera
CN111435972A (en) * 2019-01-15 2020-07-21 杭州海康威视数字技术股份有限公司 Image processing method and device
CN110428637A (en) * 2019-07-24 2019-11-08 华为技术有限公司 A kind of road gate grasp shoot method and road gate capturing system
CN111783563A (en) * 2020-06-15 2020-10-16 深圳英飞拓科技股份有限公司 Double-spectrum-based face snapshot and monitoring method, system and equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114299724A (en) * 2021-12-28 2022-04-08 航天科工智慧产业发展有限公司 Dual-mode perspective bayonet laser all-in-one machine

Similar Documents

Publication Publication Date Title
US10377322B2 (en) In-vehicle camera and vehicle control system
CA3004029C (en) Apparatus, systems and methods for improved facial detection and recognition in vehicle inspection security systems
DE102016215618B4 (en) VEHICLE CAMERA DEVICE FOR IMAGE CAPTURE IN FRONT OF VEHICLE AND FOR VEHICLE CONTROL
US7016518B2 (en) Vehicle license plate imaging and reading system for day and night
US9317754B2 (en) Object identifying apparatus, moving body control apparatus, and information providing apparatus
CN102447911B (en) Image acquisition unit, its method and associated control element
CN1867954B (en) Method and device for visualising the surroundings of a vehicle
CA3087048A1 (en) Multiple operating modes to expand dynamic range
US20060269105A1 (en) Methods, Apparatus and Products for Image Capture
WO2010077316A1 (en) Multiple object speed tracking system
EP2463806A1 (en) Vehicle detection device and vehicle detection method
CN203134149U (en) Vehicle auxiliary driving system based on different wave band imaging fusion image processing
CN101919246A (en) Non-retro-reflective license plate imaging system
EP2026313A1 (en) A method and a system for the recognition of traffic signs with supplementary panels
JP2006190198A (en) Portable vehicle number recognizing device and vehicle number recognizing method using the same
US20170083775A1 (en) Method and system for pattern detection, classification and tracking
CN104407488A (en) Laser-assisted vehicle information shooting device and shooting method
DE102009014437B4 (en) Object Recognition System and Method
CN101795397A (en) Infrared imaging method for detecting passengers in vehicle
CN111653101A (en) Vehicle snapshot method and vehicle snapshot system
CN113160574A (en) Image processing method for traffic monitoring and dual-mode bayonet camera system
CN210777141U (en) Violation high beam snapshot system
WO2014171897A1 (en) Apparatus, system and method for remote detection of vehicle exhaust
Hao et al. A near-infrared imaging method for capturing the interior of a vehicle through windshield
CN113538926B (en) Face snapshot method, face snapshot system and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210723

RJ01 Rejection of invention patent application after publication