CN107134145B - Road side parking management device, system and method based on multi-type image acquisition - Google Patents

Road side parking management device, system and method based on multi-type image acquisition Download PDF

Info

Publication number
CN107134145B
CN107134145B CN201710434897.2A CN201710434897A CN107134145B CN 107134145 B CN107134145 B CN 107134145B CN 201710434897 A CN201710434897 A CN 201710434897A CN 107134145 B CN107134145 B CN 107134145B
Authority
CN
China
Prior art keywords
parking
information
license plate
vehicle
image acquisition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710434897.2A
Other languages
Chinese (zh)
Other versions
CN107134145A (en
Inventor
闫军
项炎平
刘武杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Smart Intercommunication Technology Co ltd
Original Assignee
Smart Intercommunication Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Smart Intercommunication Technology Co ltd filed Critical Smart Intercommunication Technology Co ltd
Priority to CN201710434897.2A priority Critical patent/CN107134145B/en
Publication of CN107134145A publication Critical patent/CN107134145A/en
Application granted granted Critical
Publication of CN107134145B publication Critical patent/CN107134145B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/017Detecting movement of traffic to be counted or controlled identifying vehicles
    • G08G1/0175Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07BTICKET-ISSUING APPARATUS; FARE-REGISTERING APPARATUS; FRANKING APPARATUS
    • G07B15/00Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points
    • G07B15/02Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points taking into account a variable factor such as distance or time, e.g. for passenger transport, parking systems or car rental systems
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/10Internal combustion engine [ICE] based vehicles
    • Y02T10/40Engine management systems

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Finance (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention relates to the field of parking management, in particular to a road side parking management method based on multi-type image acquisition, which comprises the steps of acquiring first parking event information of a near-end vehicle position and a nearby area and/or a far-end vehicle position and a nearby area, acquiring second parking event information based on the first parking event information, generating third parking event information based on the first parking event information, the second parking event information and the occurrence time period of the first parking event information and the second parking event information, and sending the third parking event information to a background for background parking management. The advantages are that: the invention can cover the parking spaces at the far and near ends with high quality, expands the detection visual angle and improves the accuracy of vehicle detection and tracking; the advantages of different types of image acquisition devices are fully utilized, and the effective area occupation ratio of the images is improved; the best license plate detection area is utilized, so that the license plate recognition accuracy is improved; based on the functions of the control modules, the parking event judgment is more accurate, and the charging evidence collection is more sufficient.

Description

Road side parking management device, system and method based on multi-type image acquisition
Technical Field
The invention relates to the field of parking management, is used for roadside parking management, in particular to a device, a system and a method for roadside parking management based on multi-type image acquisition.
Background
Urban roadside parking (also called roadside occupied road parking or road internal parking) is always a difficult problem of urban management, a roadside parking lot in a city is generally a full-open parking space, vehicles are free from the constraint of a road gate and the like, and currently are generally managed manually, so that the problems of irregular parking charging, low timing precision, missed charging, messy charging, insufficient evidence obtaining, difficult tracing, incapability of all-weather management and the like exist. The actual parking spaces which can be managed by each toll collector are extremely limited, and the standard parking spaces with the length of 6 meters for one road side parallel parking (the parking direction is parallel to the road direction, the vehicle head and vehicle tail mode is also called as in-line parking) are used for calculation, and the lengths of 20 parking spaces are more than 120 meters, so that the labor management has high working strength, low working efficiency and high potential safety hazard.
In recent years, part of urban trial use is based on road side parking management of geomagnetic sensors, and a geomagnetic sensor buried in a parking space is used for providing a trigger signal to remind a manager to carry out charge management and supervise charge, so that part of management efficiency is improved. However, the proposal still needs a great deal of manual participation, and the geomagnetic sensor is only an auxiliary means and cannot complete the evidence collection of license plates and vehicle photos; some cities use video pile equipment to carry out parking management, a low video pile equipment is deployed in each parking space, and the vehicles are subjected to snapshot evidence obtaining, so that the problems of small visual field range, easiness in shielding, serious light interference, large construction quantity, high cost, difficulty in coping with irregular parking and the like exist.
The technical scheme of parking management on the road side based on the linkage of the gun-ball camera is adopted recently, the scheme adopts a common master-slave gun-ball linkage camera and comprises a gun-shaped camera (a camera with a fixed rear view angle and a fixed focal length is installed, hereinafter referred to as a gun-shaped camera for short) and a billiard-shaped camera (a camera with an automatic shooting angle and a focal length can be automatically adjusted, hereinafter referred to as a billiard-shaped camera for short), when the device is used, the device is deployed on an L-shaped monitoring rod on the road side, the gun-shaped camera detects a parking event by adjusting the fixed focal length and the shooting angle, and the billiard-shaped camera adjusts the focal length and the angle according to the detection result of the gun-shaped camera, so that the capturing target is finished to obtain evidence. Because the camera is designed for security protection and illegal parking purposes, the camera is not specially designed by fully considering the characteristics of road side parking scenes, and the problems of large visual angle constraint, limited detection and snapshot effects, insufficient performance and the like exist. Parallel parking lots on the road side, and the parking spaces on the vehicle head are connected, and a plurality of parking space areas are characterized in that the up-down scale is large and the left-right scale is small in the gun-type camera image; if a single common gun-type camera needs to cover more parking spaces, the focal length needs to be adjusted to be small during installation, but the focal length can influence the detection of vehicles at far-end parking spaces, especially the condition that near-end and far-end parking spaces are required to be covered simultaneously, the situation that the camera can not be covered completely or the image quality is poor, and the quantity and the quality of single-pole management roadside parking spaces are seriously restricted; the road side parallel parking scene also has the characteristics of capturing evidence in the process of entering and exiting the vehicle, coping with various light and shadow interferences and coping with pedestrian shielding.
Aiming at various problems of a road side parallel parking scene, how to design a set of special road side parking management snapshot equipment to achieve better snapshot detection effect, realize high-accuracy detection and evidence obtaining, realize unattended front field and be a very significant subject.
In view of the above-mentioned drawbacks, the present inventors have actively studied and innovated to create a device, system and method for road side parking management based on multi-type image acquisition, so as to make the device, system and method have more industrial utility value.
Disclosure of Invention
In order to solve the technical problems, the invention aims to provide a road side parking management device system and method based on multi-type image acquisition; the system uses a mode that the first image acquisition device, the second image acquisition device and the third image acquisition device are subjected to regional detection and then are subjected to linkage snapshot with the fourth image acquisition device, the characteristics of various image acquisition devices are fully utilized, and high-quality parking event detection and evidence collection of a far parking space and a near parking space are realized through the combination of far and near snapshot regions of the first image acquisition device, the second image acquisition device and the third image acquisition device and the task joint scheduling of the first image acquisition device, the second image acquisition device and the third image acquisition device and the fourth image acquisition device.
The technical scheme of the invention is as follows: a road side parking management method based on multi-type image acquisition comprises the following steps:
acquiring first parking event information of a near-end parking place and a nearby area and/or a far-end parking place and a nearby area, wherein the first parking event information comprises image information of a near-end parking place and a nearby area and/or a far-end parking place and a nearby area, and the near-end parking place and the nearby area are overlapped with the far-end parking place and the nearby area;
acquiring second parking event information based on the first parking event information, wherein the second parking event information comprises a picture, a license plate picture and a license plate recognition result of key points of vehicle entering and exiting through snapshot;
based on the first parking event information, the second parking event information, and the period of time in which both occur, third parking event information is generated,
and sending the third parking event information to the background for the background parking management.
Further, the method further comprises the following steps: obtaining license plate information, vehicle image information and snapshot time of an optimal license plate detection area passing through a near-end vehicle position and a near-end area, and generating an entrance license plate information reference table according to the license plate information, the vehicle image information and the snapshot time; and matching the entering license plate information reference table with the third parking event information based on the time period, the license plate characters and the vehicle image, if the matching is successful, generating an optimal license plate recognition result according to the entering license plate information reference table, and merging the information of the entering license plate information reference table into the third parking event information.
Further, the method further comprises the following steps: obtaining license plate information, vehicle image information and snapshot time of a vehicle off-site passing region, generating a reference table of the exiting license plate information according to the license plate information, the vehicle image information and the snapshot time,
matching the exiting license plate information reference table with license plate information of the vehicle which is judged to enter, and judging that the vehicle leaves the scene if the matching is successful; and incorporating the vehicle departure information into the third parking event information.
Further, if the vehicle is not judged to leave the field before, a departure record is generated according to a departure license plate information reference table, and the departure record is integrated into third parking event information, so that complete parking event information is generated.
Further, scheduling calculation is performed based on the short-time occurrence of a plurality of first parking events, and second parking event information is sequentially obtained by combining calculation results.
Further, the overlapping areas of the image information of the near-end parking space and the image information of the near-end parking space are spliced to generate complete image information.
The road side parking management device based on multi-type image acquisition comprises a main control device, wherein the main control device comprises a first control module, a second control module, a parking event management module and a network communication module,
the first control module is used for controlling the image acquisition device to detect and track the image information of the vehicle passing through the near-end vehicle position and the nearby area and the far-end vehicle position and the nearby area, and splicing the overlapping area of the image information of the near-end vehicle position and the nearby area and the image information of the far-end vehicle position and the nearby area to generate complete image information;
the second control module is used for controlling the image acquisition device to acquire pictures of key points of the vehicle entering and exiting the scene, license plate pictures and license plate recognition results,
the parking event management module is used for acquiring first parking event information, acquiring second parking event information based on the first parking event information, and generating third parking event information based on the first parking event information, the second parking event information and the occurrence time period of the first parking event information and the second parking event information;
the network management module is used for sending the third parking event information to the background.
Further, the parking event management module is further configured to obtain license plate information, vehicle image information and snapshot time of an optimal license plate detection area passing through a near-end parking space and a nearby area, and generate an entering license plate information reference table according to the license plate information, the vehicle image information and the snapshot time; and matching the entering license plate information reference table with the third parking event information based on the time period, the license plate characters and the vehicle image, if the matching is successful, generating an optimal license plate recognition result according to the entering license plate information reference table, and merging the information of the entering license plate information reference table into the third parking event information.
Further, the parking event management module is also used for obtaining license plate information, vehicle image information and snapshot time of the vehicle leaving the field passing region, generating a field license plate information reference table according to the license plate information, the vehicle image information and the snapshot time,
matching the exiting license plate information reference table with license plate information of the vehicle which is judged to enter, and judging that the vehicle leaves the scene if the matching is successful; and incorporating the vehicle departure information into the third parking event information.
Furthermore, if the vehicle is not judged to leave the field before, the parking event management module is further used for generating a departure record from the departure license plate information reference table, and merging the departure record into third parking event information so as to generate complete parking event information.
Further, the system also comprises a task scheduling module, wherein the task scheduling module performs scheduling calculation based on a plurality of first parking events occurring in a short time, and generates second parking event information by combining calculation results.
The system comprises a first image acquisition device, a second image acquisition device, a fourth image acquisition device, a storage module and a road side parking management device based on multi-type image acquisition, wherein the first image acquisition device, the second image acquisition device and the fourth image acquisition device are deployed on a cross arm of an L-shaped monitoring rod on the road side; the first image acquisition device is used for detecting and tracking vehicle image information of a near-end vehicle position and a nearby area, the second image acquisition device is used for detecting and tracking vehicle image information of a far-end vehicle position and a nearby area, the near-end vehicle position and the nearby area are provided with overlapping areas, and the fourth image acquisition device is used for capturing pictures, license plate pictures and license plate recognition results of key points of entering and exiting a vehicle;
the first image acquisition device, the second image acquisition device and the fourth image acquisition device are communicated with a road side parking management device based on multi-type image acquisition;
the storage module is used for storing the image information acquired by the first image acquisition device, the second image acquisition device and the fourth image acquisition device.
Further, the system also comprises a fourth image acquisition module, wherein the fourth image acquisition module is used for acquiring image information of a vehicle departure passing region, and the storage module stores the image information.
Further, the main control device is integrated in the first image acquisition device, the second image acquisition device, the fourth image acquisition device and/or the third image acquisition device, and the first image acquisition device, the second image acquisition device, the third image acquisition device and/or the fourth image acquisition device are/is installed in a device box.
In the invention, the gun-type camera has the characteristics of fixed visual angle and wide monitoring range, and the focal length of the gun-type camera can be adjusted according to the use scene.
In the invention, the spherical camera has the characteristics and functions of quick tracking, 360-degree horizontal rotation, no monitoring blind area, no shielding of privacy area and the like, and the focal length and the turnover angle of the spherical camera can be automatically adjusted.
In the invention, the optimal license plate detection area refers to an area where the first image acquisition device is easiest to track and detect and identify vehicles and license plate information.
In the invention, the vehicle departure passing area refers to an area where the vehicle departure can pass with a high probability.
By means of the scheme, the invention has at least the following advantages: the vehicle parking space can be covered with high quality based on multi-type image acquisition, so that the detection visual angle is enlarged, and the accuracy of vehicle detection and tracking is improved; the advantages of the image acquisition device are fully utilized, and the effective area occupation ratio of the image is improved; the best license plate detection area is utilized, so that the license plate recognition accuracy is improved; based on the functions of the control modules, the parking event judgment is more accurate, the evidence collection is more sufficient, and the charging evidence is more sufficient.
The foregoing description is only an overview of the present invention, and is intended to provide a more thorough understanding of the present invention, and is to be accorded the full scope of the present invention.
Drawings
FIG. 1 is a schematic illustration of a multi-type image acquisition based roadside parking management system of the present invention;
FIG. 2 is a flow chart of a road side parking management method based on multi-type image acquisition of the present invention;
FIG. 3 is a schematic diagram of a multi-type image acquisition based roadside parking management system of the present invention;
FIG. 4 is a schematic flow chart of a road side parking management device based on multi-type image acquisition of the present invention;
FIG. 5 is a schematic view of a practical perspective of the multi-type image acquisition based roadside parking management system of the present invention;
FIG. 6 is a perspective view of a multi-type image acquisition based roadside parking management system of the present invention;
FIG. 7 is a top view of a conventional entrance of the roadside parking management system based on multi-type image acquisition of the present invention;
FIG. 8 is a top view of a conventional entrance of the roadside parking management system based on multi-type image acquisition of the present invention;
FIG. 9 is a top view of an irregular entry of the roadside parking management system based on multi-type image acquisition of the present invention;
FIG. 10 is a top view of an irregular entry of the roadside parking management system based on multi-type image acquisition of the present invention;
FIG. 11 is a top view of an abnormal entrance of the roadside parking management system based on multi-type image acquisition of the present invention;
fig. 12 is a top view of an abnormal entrance of the roadside parking management system based on multi-type image acquisition of the present invention.
Description of the embodiments
The following describes in further detail the embodiments of the present invention with reference to the drawings and examples. The following examples are illustrative of the invention and are not intended to limit the scope of the invention.
Examples
As shown in fig. 1 and 2, the multi-type image acquisition-based road side parking management system is used for road side parking management and comprises a first image acquisition device 1, a second image acquisition device 2, a fourth image acquisition device 4, a storage module 5 and a main control device 6, wherein the first image acquisition device 1 and the second image acquisition device 2 are provided with gun-type cameras, the fourth image acquisition device 4 is provided with spherical cameras, the main control device 6 comprises a first control module 601, a second control module 602, a parking event management module 603 and a network communication module 605, the network communication module 605 is responsible for communication with a background 7, the first control module 601 is provided with a gun-type camera control module, the second control module 602 is provided with a spherical camera control module, the first image acquisition device 1, the second image acquisition device 2 and the fourth image acquisition device 4 are deployed on a cross arm of an L-type monitoring rod of a road side, and the storage module 5 stores vehicle image information acquired from the first image acquisition device 1, the second image acquisition device 2 and the fourth image acquisition device 4.
Specifically, when a vehicle enters/exits a parking monitoring area, it is classified into a normal case, an abnormal case, and an abnormal case.
Conventional case: (1) When a vehicle enters the parking space in a conventional mode, high-quality license plate information (first parking event information) is acquired through a detection area (a near-end parking space and a nearby area) of the first image acquisition device, license plate information, vehicle image information and snapshot time are acquired through the optimal license plate detection area 101, an entering license plate information reference table is generated, if the first image acquisition device tracks that the vehicle enters the parking space, the vehicle is judged to enter the parking space, and then the fourth image acquisition device controls the fourth image acquisition device according to instructions of the second control module
And adjusting the angle and the focal length to capture the image information of the vehicle, and acquiring parking evidence (second parking event information), wherein: the parking evidence comprises pictures of key points of vehicle entering and exiting, license plate pictures and license plate recognition results;
and generating third parking event information based on the entry license plate information reference table information, the acquired parking evidence information and the occurrence time period of the corresponding event, and sending the third parking event information to the background.
If the vehicle has left the detection area of the first image acquisition device, the first image acquisition device stops tracking and detecting the vehicle.
(2) If the vehicle enters the detection area (the far-end parking space and the nearby area) of the second image acquisition device, the second image acquisition device detects and tracks the vehicle, if the vehicle is tracked to enter the parking space, the second image acquisition device judges that the vehicle enters the parking space and sends the entering information of the vehicle to the main control device, and the second control module controls the fourth image acquisition device to take a candid photograph according to the information provided by the second image acquisition device, so that parking evidence (second parking event information) is obtained.
Based on the images of the overlapped area 102 acquired by the first image acquisition device and the second image acquisition device, the images are spliced into complete panoramic image information;
the parking event management module combines the acquired complete panoramic image information, the entry license plate information reference table information and the acquired parking evidence information into third parking event information, and sends the third parking event information to the background.
If a plurality of parking events occur in a short time, the first image acquisition device and the second image acquisition device detect that the parking events occur, the task scheduling module 604 performs scheduling calculation and controls the fourth image acquisition device to sequentially capture according to a calculation result, and complete parking event information is synthesized according to the given parking event information, captured parking event information and image information recorded by the storage module in a corresponding period;
when the complete parking event information is synthesized, the parking event management module matches an entering license plate information reference table, carries out fuzzy matching on the parking information according to time periods, license plate characters and vehicle images, if the matching can be achieved, gives out an optimal license plate recognition result according to the license plate information reference table, and merges the corresponding information of the license plate information reference table into the parking event information; the network communication module in the main control device sends the complete parking event information to the background;
therefore, when a vehicle enters the ground conventionally, most of the situations can snap the license plate at the optimal visual angle, and the accuracy of license plate recognition is improved.
When the vehicle is normally out of the field, vehicle departure information of the first image acquisition device or the second image acquisition device is acquired, and the main control device controls the fourth image acquisition device to adjust the angle and the focal length to snap according to the information acquired by the first image acquisition device or the second image acquisition device, so that parking evidence (wherein the parking evidence comprises pictures, license plate recognition results and the like of key points of vehicle out of the field) is acquired.
And the parking event management module combines the acquired vehicle departure information and parking evidence into third parking event information and sends the third parking event information to the background.
If the first image acquisition device and the second image acquisition device acquire vehicle departure information, the first image control module splices a complete panoramic image according to the overlapping area image and incorporates the complete panoramic image into third parking time information.
Similarly, if a plurality of parking events occur during departure, the first image acquisition device and the second image acquisition device detect that the parking events occur, the task scheduling module performs scheduling calculation, controls the second control module to control the fourth image acquisition device to sequentially capture according to the calculation result, and synthesizes third parking event information according to the given parking event information, the captured parking event information and the image information recorded by the storage module of the corresponding time period.
Examples
As shown in fig. 3 to 8, it is different from embodiment 1 in that: the system also comprises a third image acquisition device 3, wherein the third image acquisition device 3 is also arranged on the L-shaped monitoring rod, and if the vehicle leaves the field but the vehicle leaves the field after being identified by the third image acquisition device, the vehicle leaves the field according to the vehicle;
and the third image acquisition device acquires license plate information, vehicle image information and snapshot time of the vehicle off-site passing region through high-speed snapshot recognition, and generates an off-site license plate information reference table according to the license plate information, the vehicle image information and the snapshot time.
The parking event management module can match the outgoing license plate information reference table with license plate information of the vehicle which is judged to enter the parking event at regular time, if the outgoing license plate information reference table can be matched with the license plate information of the vehicle which is judged to enter the parking event, the outgoing parking event is judged, and the outgoing parking event information of the vehicle is incorporated into third parking event information; if the first image acquisition device and the second image acquisition device do not judge the departure of the vehicle, generating a departure record based on the snapshot result of the third image acquisition device, and merging the departure record into third parking event information to generate complete parking event information; if the vehicle is judged to leave the field before, the confidence of the departure judgment is further improved.
If the exiting license plate information reference table is not successfully matched with the license plate information of the vehicle judged to enter, the vehicle is possibly a passing vehicle, and the parking event information is not recorded.
Therefore, conventionally, when a vehicle that has detected an entrance exits, only when it is missed by the first image capturing device (or the second image capturing device) and not detected by the third image capturing device at the same time, a situation of missed recognition is likely to occur, which greatly reduces the situation of missed detection.
As shown in fig. 5, a plurality of groups of L-shaped monitoring rods are arranged on the road side, and the first image acquisition device in the front L-shaped monitoring rod can acquire the vehicle image information of the optimal license plate detection area, and can acquire the vehicle image information of the vehicle departure passing area covered by the third image acquisition device of the rear L-shaped monitoring rod at the same time, so that the vehicle image information acquired by the two groups of acquisition devices is compared and information complemented at any time, and the condition that the vehicle passing through the vehicle departure passing area covered by the third image acquisition device in the rear L-shaped monitoring rod is missed can be reduced or even avoided.
When the device is specifically arranged, under the condition that a plurality of groups of L-shaped monitoring rods are arranged on the road side, the third image acquisition device is not required to be installed on the L-shaped monitoring rods at the rear, and only the first image acquisition device on the L-shaped monitoring rods at the front is required to acquire the vehicle image information of the vehicle passing region after leaving the road.
Thus, the design reduces the installation cost of the equipment without affecting the overall parking management.
Examples
Unconventional conditions of vehicle entry: as shown in fig. 9, when a vehicle enters the parking space, the first image acquisition device acquires high-quality license plate information (first parking event information) when the vehicle does not directly cross the line to enter the detection area (near-end parking space and nearby area) of the first image acquisition device through the optimal license plate detection area of the first image acquisition device, if the first image acquisition device tracks that the vehicle enters the parking space, the vehicle is judged to enter the parking space, then the fourth image acquisition device controls the fourth image acquisition device to adjust the angle and focal length according to the instruction of the second control module to capture the image information of the vehicle, and parking evidence (second parking event information) is acquired, wherein: the parking evidence comprises pictures of key points of vehicle entering and exiting, license plate pictures and license plate recognition results;
and generating third parking event information based on the first parking event information, the second parking event information and the time period of occurrence of the corresponding event, and sending the third parking event information to the background.
If the vehicle has left the detection area of the first image acquisition device, the first image acquisition device stops tracking and detecting the vehicle.
When the vehicle leaves the first image acquisition device and enters the detection area (the far-end parking space and the nearby area) of the second image acquisition device, the second image acquisition device detects and tracks the vehicle, if the vehicle is tracked to enter the parking space, the second image acquisition device judges the entrance of the vehicle and sends the entrance information of the vehicle to the main control device, the second control module controls the fourth image acquisition device to take a candid photograph according to the information provided by the second image acquisition device to acquire parking evidence (second parking event information),
based on the vehicle images of the overlapping area acquired by the first image acquisition device and the second image acquisition device, the vehicle images are spliced into complete panoramic image information;
the parking event management module combines the acquired complete panoramic image information and the acquired parking evidence information into third parking event information, and sends the third parking event information to the background.
If a plurality of parking events occur in a short time, the first image acquisition device and the second image acquisition device detect that the parking events occur, the task scheduling module 604 performs scheduling calculation and controls the fourth image acquisition device to sequentially capture according to a calculation result, and complete parking event information is synthesized according to the given parking event information, captured parking event information and image information recorded by the storage module in a corresponding period; and transmits the complete parking event information to the background.
In the abnormal case of the departure of the vehicle, as shown in fig. 10, if the vehicle passes through the area without passing through the departure of the vehicle of the third image pickup device, the judgment result of the first image pickup device or the second image pickup device is used as the parking event information.
Examples
As shown in fig. 11, in a short time, the vehicle passes through the detection area of the third image acquisition device, enters the parking space after being detected by the license plate, and is judged to be retrograde to enter the parking space; classifying the parking in a illegal way;
or the vehicle enters the parking space after passing through the detection area of the second image acquisition device and then entering the detection area of the first image acquisition device, and is classified as illegal parking.
As shown in fig. 12, in a short time of the departure of the vehicle, the vehicle in the far-end parking space is firstly judged to leave the departure and then appears in the best license plate detection area of the first image acquisition device or the detection area of the second image acquisition device, and then the vehicle is judged to be in a retrograde departure; and is classified as out-of-limits.
As a variant embodiment, the main control device is integrated in one or more of the first, second, fourth and/or third image acquisition devices, which are installed in one or more equipment boxes.
In the present invention, the first image capturing device, the second image capturing device, the third image capturing device and the fourth image capturing device are not limited to a gun-type camera or a spherical camera, and devices capable of acquiring vehicle image information are all within the scope of protection of the present invention.
In the invention, the same L-shaped monitoring rod is not limited to be provided with one set of road side parking management system, and more than two sets of road side parking management systems can be arranged when the system is particularly used; or one or more of one or more groups of first image acquisition devices, second image acquisition devices, third image acquisition devices and fourth image acquisition devices are not limited to be added on the basis of a set of road side parking management systems.
The image acquisition devices in the drawings of the embodiment of the invention acquire the image information of the tail of the vehicle at first, and can set the installation directions of all the image acquisition devices according to the requirements of different road conditions so as to acquire the image information of the head direction of the vehicle.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, and it should be noted that it is possible for those skilled in the art to make several improvements and modifications without departing from the technical principle of the present invention, and these improvements and modifications should also be regarded as the protection scope of the present invention.

Claims (11)

1. The road side parking management method based on multi-type image acquisition is characterized by comprising the following steps of:
acquiring first parking event information of a near-end parking place and a nearby area and/or a far-end parking place and a nearby area, wherein the first parking event information comprises image information of a near-end parking place and a nearby area and/or a far-end parking place and a nearby area, and the near-end parking place and the nearby area are overlapped with the far-end parking place and the nearby area;
acquiring second parking event information based on the first parking event information, wherein the second parking event information comprises a picture, a license plate picture and a license plate recognition result of key points of vehicle entering and exiting through snapshot;
generating third parking event information based on the first parking event information, the second parking event information, and a period of time in which both occur;
obtaining license plate information, vehicle image information and snapshot time of an optimal license plate detection area passing through a near-end vehicle position and a near-end area, and generating an entering license plate information reference table according to the license plate information, the vehicle image information and the snapshot time;
matching the entering license plate information reference table with the third parking event information based on the time period, the license plate characters and the vehicle image, if the matching is successful, generating an optimal license plate recognition result according to the entering license plate information reference table, and merging the information of the entering license plate information reference table into the third parking event information;
acquiring license plate information, vehicle image information and snapshot time of a vehicle off-site passing region, and generating a field license plate information reference table according to the license plate information, the vehicle image information and the snapshot time;
matching the exiting license plate information reference table with license plate information of the vehicle which is judged to enter, and judging that the vehicle leaves the scene if the matching is successful; and incorporating the vehicle departure information into third parking event information;
and sending the third parking event information to the background for the background parking management.
2. The road side parking management method based on multi-type image acquisition according to claim 1, wherein if the vehicle is not judged to leave the field before, a departure record is generated according to a departure license plate information reference table, and the departure record is incorporated into third parking event information, so that complete parking event information is generated.
3. The road side parking management method based on multi-type image acquisition according to claim 1, wherein the scheduling calculation is performed based on a plurality of first parking events occurring in a short time, and the second parking event information is sequentially acquired in combination with the calculation result.
4. The road side parking management method based on multi-type image acquisition according to claim 1, wherein the overlapping areas of the image information of the near-end parking space and the nearby area and the image information of the far-end parking space and the nearby area are spliced to generate complete image information.
5. The road side parking management device based on the multi-type image acquisition is characterized by comprising a main control device, wherein the main control device comprises a first control module, a second control module, a parking event management module and a network communication module;
the first control module is used for controlling the image acquisition device to detect and track the image information of the vehicle passing through the near-end vehicle position and the nearby area and the far-end vehicle position and the nearby area, and splicing the overlapping area of the image information of the near-end vehicle position and the nearby area and the image information of the far-end vehicle position and the nearby area to generate complete image information;
the second control module is used for controlling the image acquisition device to acquire pictures of key points of the vehicle entering and exiting the scene, license plate pictures and license plate recognition results,
the parking event management module is used for acquiring first parking event information, acquiring second parking event information based on the first parking event information and generating third parking event information based on the first parking event information, the second parking event information and the occurrence time period of the first parking event information and the second parking event information; obtaining license plate information, vehicle image information and snapshot time of an optimal license plate detection area passing through a near-end parking space and a nearby area, and generating an entrance license plate information reference table according to the license plate information, the vehicle image information and the snapshot time; matching the entering license plate information reference table with the third parking event information based on the time period, the license plate characters and the vehicle image, if the matching is successful, generating an optimal license plate recognition result according to the entering license plate information reference table, and merging the information of the entering license plate information reference table into the third parking event information; acquiring license plate information, vehicle image information and snapshot time of a vehicle leaving field passing region, generating a leaving field license plate information reference table according to the license plate information, the vehicle image information and the snapshot time, matching the leaving field license plate information reference table with the license plate information of the vehicle which is judged to enter the field, and judging that the vehicle leaves the field if the matching is successful; and incorporating the vehicle departure information into third parking event information;
the network communication module is used for sending the third parking event information to the background.
6. The apparatus for road side parking management based on multi-type image acquisition according to claim 5, wherein if the vehicle is not determined to be off-road, the parking event management module is further configured to generate a departure record from the departure license plate information reference table, and incorporate the departure record into third parking event information, thereby generating complete parking event information.
7. The apparatus for road side parking management based on multi-type image acquisition according to claim 5, further comprising a task scheduling module, wherein the task scheduling module performs scheduling calculation based on a plurality of first parking events occurring in a short time, and sequentially acquires second parking event information in combination with a calculation result.
8. The system for road side parking management based on multi-type image acquisition is characterized by comprising a first image acquisition device, a second image acquisition device, a fourth image acquisition device, a storage module and the road side parking management device based on multi-type image acquisition, wherein the first image acquisition device, the second image acquisition device and the fourth image acquisition device are deployed on a cross arm of an L-shaped monitoring rod on a road side; the first image acquisition device is used for detecting and tracking vehicle image information of a near-end vehicle position and a nearby area, the second image acquisition device is used for detecting and tracking vehicle image information of a far-end vehicle position and a nearby area, the near-end vehicle position and the nearby area are provided with overlapping areas, and the fourth image acquisition device is used for capturing pictures, license plate pictures and license plate recognition results of key points of entering and exiting a vehicle;
the first, second, fourth image acquisition devices communicating with the multi-type image acquisition-based roadside parking management device of any one of claims 5 to 7;
the storage module is used for storing the vehicle image information acquired by the first image acquisition device, the second image acquisition device and the fourth image acquisition device.
9. The system for roadside parking management based on multi-type image acquisition as claimed in claim 8, further comprising a third image acquisition module for acquiring image information of a passing region where the vehicle leaves the field, the storage module storing the image information thereof.
10. The system for roadside parking management based on multi-type image collection according to claim 9 wherein the master control device is integrated in a first image collection device, a second image collection device, a fourth image collection device and/or a third image collection device, wherein the first image collection device, the second image collection device, the third image collection device and/or the fourth image collection device are mounted in one equipment box.
11. The system for roadside parking management based on multi-type image collection according to any one of claims 8 to 10 wherein the first image collection device, the second image collection device and the third image collection device are set as gun type cameras and the fourth image collection device is set as spherical type cameras.
CN201710434897.2A 2017-06-10 2017-06-10 Road side parking management device, system and method based on multi-type image acquisition Active CN107134145B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710434897.2A CN107134145B (en) 2017-06-10 2017-06-10 Road side parking management device, system and method based on multi-type image acquisition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710434897.2A CN107134145B (en) 2017-06-10 2017-06-10 Road side parking management device, system and method based on multi-type image acquisition

Publications (2)

Publication Number Publication Date
CN107134145A CN107134145A (en) 2017-09-05
CN107134145B true CN107134145B (en) 2023-07-07

Family

ID=59734987

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710434897.2A Active CN107134145B (en) 2017-06-10 2017-06-10 Road side parking management device, system and method based on multi-type image acquisition

Country Status (1)

Country Link
CN (1) CN107134145B (en)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109544707B (en) * 2017-09-18 2021-06-01 武汉万德智新科技股份有限公司 Intelligent control system and method for access of parking lot
CN107730908B (en) * 2017-09-22 2023-11-07 智慧互通科技股份有限公司 Roadside concurrent parking event management device, system and method
CN107767673B (en) 2017-11-16 2019-09-27 智慧互通科技有限公司 A kind of Roadside Parking management method based on multiple-camera, apparatus and system
CN107945521A (en) * 2017-11-20 2018-04-20 青岛比特信息技术有限公司 A kind of rifle ball linkage trackside is parked detecting system and method
CN107845289A (en) * 2017-12-19 2018-03-27 智慧互通科技有限公司 A kind of Roadside Parking management and charging system based on height digital video array
CN108288387B (en) * 2018-01-29 2020-05-08 深圳信路通智能技术有限公司 Intelligent linkage in-road parking tracking method
CN108460990A (en) * 2018-04-19 2018-08-28 智慧互通科技有限公司 System is managed based on gunlock and the united Roadside Parking of ball machine
CN108364480A (en) * 2018-04-19 2018-08-03 智慧互通科技有限公司 System is managed based on the united Roadside Parking of more ball machines
CN108765973B (en) * 2018-06-01 2022-04-19 智慧互通科技股份有限公司 Roadside parking management system based on opposite side visual angle complementation
CN109377768B (en) * 2018-10-24 2021-10-12 成都臻识科技发展有限公司 Parking detection method and system for roadside parking
CN109327684A (en) * 2018-11-23 2019-02-12 智慧互通科技有限公司 A kind of management system of the Roadside Parking based on camera matrix
CN111462502B (en) * 2019-01-22 2021-06-08 杭州海康威视数字技术股份有限公司 Method, device and computer readable storage medium for vehicle management
CN109917417A (en) * 2019-03-14 2019-06-21 珠海丽亭智能科技有限公司 A kind of vehicle appearance measurement method and device and equipment based on photographic device
CN111835998B (en) * 2019-04-13 2023-06-13 长沙智能驾驶研究院有限公司 Beyond-the-horizon panoramic image acquisition method, device, medium, equipment and system
TWI708696B (en) 2019-05-08 2020-11-01 神達數位股份有限公司 Method and system for parking behavior evaluating
CN112446268B (en) * 2019-09-04 2024-04-05 浙江宇视科技有限公司 Lifting rod control method, lifting rod control device, monitoring equipment and monitoring system
CN110930723B (en) * 2019-12-06 2022-07-05 沈阳聚德视频技术有限公司 Illegal parking detection implementation method
CN111739175B (en) * 2020-08-11 2022-07-05 上海高德威智能交通***有限公司 Vehicle parking monitoring method and device
CN112509364B (en) * 2020-11-17 2021-11-09 北京精英路通科技有限公司 Method and device for determining parking state of vehicle, computer equipment and storage medium
CN114040104A (en) * 2021-11-16 2022-02-11 北京筑梦园科技有限公司 Equipment debugging method and device and parking management system
CN116504071B (en) * 2023-05-12 2024-01-30 广东科陆智泊信息科技有限公司 Evidence obtaining system and evidence obtaining method for lengthened evidence obtaining photo for parking

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002015347A (en) * 2000-06-28 2002-01-18 Matsushita Electric Ind Co Ltd Road side machine, on-vehicle machine and toll collection system
CN103413460A (en) * 2013-07-17 2013-11-27 北京航空航天大学 Bend driving early warning method based on vehicular access synergy
CN103680201A (en) * 2013-12-10 2014-03-26 中国石油大学(华东) Intelligent city parking system
JP2015197780A (en) * 2014-04-01 2015-11-09 三菱プレシジョン株式会社 vehicle detection and vehicle number recognition device
CN205091927U (en) * 2015-11-09 2016-03-16 乐山师范学院 Intelligent parking lot management system
CN105957395A (en) * 2016-05-26 2016-09-21 智慧互通科技有限公司 Road side parking management system based on camera array and method thereof
CN106683207A (en) * 2017-03-17 2017-05-17 深圳市迅朗科技有限公司 Parking electronic toll collection system component

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102004012604B4 (en) * 2004-03-12 2006-10-12 Donnelly Hohe Gmbh & Co. Kg Method for operating a display system in a vehicle for starting a parking space
CN101894482A (en) * 2010-07-15 2010-11-24 东南大学 Video technology-based roadside vacant parking position wireless network detection system and method
CN102110376B (en) * 2011-02-18 2012-11-21 汤一平 Roadside parking space detection device based on computer vision
MX352839B (en) * 2012-11-27 2017-12-11 Cloudparc Inc Controlling use of a single multi-vehicle parking space using multiple cameras.
US11004337B2 (en) * 2012-12-28 2021-05-11 Balu Subramanya Advanced parking management system
CN205751245U (en) * 2016-03-08 2016-11-30 智慧互通科技有限公司 A kind of Roadside Parking field based on multi-machine interaction vehicle identifier
CN106373405B (en) * 2016-09-29 2019-04-12 浙江宇视科技有限公司 Parking position monitoring system and method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002015347A (en) * 2000-06-28 2002-01-18 Matsushita Electric Ind Co Ltd Road side machine, on-vehicle machine and toll collection system
CN103413460A (en) * 2013-07-17 2013-11-27 北京航空航天大学 Bend driving early warning method based on vehicular access synergy
CN103680201A (en) * 2013-12-10 2014-03-26 中国石油大学(华东) Intelligent city parking system
JP2015197780A (en) * 2014-04-01 2015-11-09 三菱プレシジョン株式会社 vehicle detection and vehicle number recognition device
CN205091927U (en) * 2015-11-09 2016-03-16 乐山师范学院 Intelligent parking lot management system
CN105957395A (en) * 2016-05-26 2016-09-21 智慧互通科技有限公司 Road side parking management system based on camera array and method thereof
CN106683207A (en) * 2017-03-17 2017-05-17 深圳市迅朗科技有限公司 Parking electronic toll collection system component

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于ROI的智能交通***摄像机控制算法;潘薇;周欣;卢晓春;蒋欣荣;;测控技术(第02期);全文 *

Also Published As

Publication number Publication date
CN107134145A (en) 2017-09-05

Similar Documents

Publication Publication Date Title
CN107134145B (en) Road side parking management device, system and method based on multi-type image acquisition
CN108765973B (en) Roadside parking management system based on opposite side visual angle complementation
KR101698026B1 (en) Police enfoforcement system of illegal stopping and parking vehicle by moving vehicle tracking
CN108242152A (en) Roadside Parking manages system
CN208014185U (en) A kind of Roadside Parking monitoring system based on high-order image recognition and ETC equipment
CN108470381A (en) Roadside Parking management method
CN102542806B (en) Real-time monitoring system for license plate shielding of vehicles running on speedway and control method thereof
CN111325858B (en) Method for realizing automatic charging management aiming at roadside temporary parking space
CN108765975B (en) Roadside vertical parking lot management system and method
KR20200025247A (en) Managemnet system of parking by moving vehicle tracking
CN105118301B (en) The illegal monitoring system of vehicular
CN112382104B (en) Roadside parking management method based on vehicle track analysis
CN103730009A (en) Method and system for detecting vehicle with one number plate missing
CN104036640A (en) Panoramic image acquisition device and panoramic image acquisition method
CN111192462A (en) Overrun information acquisition method, device and system and overrun detection equipment
CN105303826A (en) Violating side parking evidence obtaining device and method
EP3026652A1 (en) Double stereoscopic sensor
CN202018736U (en) Vehicle-mounted monitoring system for illegal bus lane occupation
CN105070065A (en) Mobile intelligent traffic gate system and method adopting same to monitor vehicles
CN204833705U (en) Illegal automatic snapshot system that parks of yellow gridlines
CN110580809B (en) Expressway rescue lane occupation snapshot method
CN105303827A (en) Traffic violation image obtaining device and method
CN112601049B (en) Video monitoring method and device, computer equipment and storage medium
CN207676481U (en) Roadside Parking managing device and system based on polymorphic type Image Acquisition
CN110490117B (en) Parking event determination method and system based on image depth information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 075000 ten building, phase 1, airport economic and Technological Development Zone, Zhangjiakou, Hebei

Applicant after: Smart intercommunication Technology Co.,Ltd.

Address before: 075000 ten building, phase 1, airport economic and Technological Development Zone, Zhangjiakou, Hebei

Applicant before: INTELLIGENT INTER CONNECTION TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant