CN113313051B - Detection and identification method and system for illegal use of ETC behaviors of other people - Google Patents
Detection and identification method and system for illegal use of ETC behaviors of other people Download PDFInfo
- Publication number
- CN113313051B CN113313051B CN202110659683.1A CN202110659683A CN113313051B CN 113313051 B CN113313051 B CN 113313051B CN 202110659683 A CN202110659683 A CN 202110659683A CN 113313051 B CN113313051 B CN 113313051B
- Authority
- CN
- China
- Prior art keywords
- vehicle
- data
- behavior
- detection
- violation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/54—Surveillance or monitoring of activities, e.g. for recognising suspicious objects of traffic, e.g. cars on the road, trains or boats
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Evolutionary Computation (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention provides a detection and identification method and a system for illegal use of other people ETC behaviors, which relate to the field of intelligent traffic management and comprise the steps of collecting real-time data of lane entrances, carrying out target detection on the real-time data, and enabling a vehicle to pass through an ETC system if only one vehicle is available; if the number of the vehicles exceeds one, performing track analysis on each vehicle, and when the violation behavior is judged to be overtaking and ETC rubbing behavior, recognizing a license plate and confirming the vehicle to be passed, so that the vehicle to be passed passes through an ETC system; when the violation behavior type is judged to be the following ETC behavior, identifying a license plate and confirming a vehicle to be passed, sending warning information to a vehicle which is not to be passed, and when the vehicle which is not to be passed moves to a preset area, enabling the vehicle to be passed to pass through an ETC system; carry out the people's face to the non-vehicle of treating in step and gather, generate the behavior data set violating rules and regulations to the storage is in predetermineeing the database, solves current lack and to rubbing the effective monitoring of the action of ETC, leads to being rubbed the vehicle of ETC to be forced to park simultaneously and can cause the condition that the lane blocks up.
Description
Technical Field
The invention relates to the field of intelligent traffic management, in particular to a method and a system for detecting and identifying ETC behaviors of other people in violation of using.
Background
The expressway is a life line of national economic development, is an indispensable important component of the working and living of the masses of people, and how to efficiently and scientifically manage the expressway is an important issue in front of expressway management departments. The toll station in the expressway is firstly in a fixed bayonet structure, and under the condition that vehicles are more and more in the current society, the toll station cannot meet the requirement of the development of the times, so that an Electronic Toll Collection (ETC) system appears, the passing efficiency of the toll station is greatly improved, and the passing convenience brought by the expressway is further promoted.
However, because some defects of ETC itself appear, some illegal behaviors of rubbing ETC appear, the legal rights and interests of being rubbed ETC users are violated, moreover, if when the traffic flow is more on holidays, because the vehicle that leads to being rubbed ETC due to rubbing ETC passes through is forced to park to select the artificial passage or seek staff's help, very easily lead to blocking up, in addition, the vehicle that rubs ETC is difficult to find the vehicle in succession unless being intercepted on the spot, consequently, can't give the owner of the rubbing ETC punishment, can't effectively reduce the behavior of rubbing ETC.
Disclosure of Invention
In order to overcome the technical defects, the invention aims to provide a method and a system for detecting and identifying ETC behaviors of other people in violation of use, which are used for solving the problem that the conventional ETC-smearing behavior is lack of effective monitoring, and the condition that a vehicle which is smeared with ETC is forced to stop and lane congestion is caused.
The invention discloses a detection and identification method for illegal use of other people ETC behaviors, which is associated with an ETC system and comprises the following steps:
the method comprises the steps of collecting real-time data of a lane entrance, carrying out target detection on the real-time data, and obtaining at least one vehicle and vehicle information related to the vehicle, wherein the vehicle information comprises vehicle basic parameters and vehicle position data;
if only one vehicle exists, monitoring the work of an ETC system, and enabling the vehicle to pass through the ETC system;
if the number of the vehicles exceeds one, performing track analysis on each vehicle to judge the type of the violation;
when the violation behavior type is judged to be overtaking and ETC rubbing behavior, license plates of all vehicles are identified, the vehicles to be passed are confirmed according to the read card data read by the ECT system, the work of the ETC system is monitored, and the vehicles to be passed pass through the ETC system;
when the violation behavior type is judged to be a following ETC behavior, license plates of all vehicles are recognized, the vehicles to be passed are confirmed according to the read card data read by the ECT system, warning information is sent to the vehicles which are not to be passed, and when the vehicles which are not to be passed move to a preset area according to the warning information, the work of the ETC system is monitored, so that the vehicles to be passed pass through the ETC system;
and synchronously carrying out face acquisition on the non-passing vehicles, generating violation data sets according to the acquired face data and the real-time data, and storing the violation data sets in a preset database.
Preferably, the track analysis of the vehicle corresponding to each piece of vehicle information to determine the violation type includes the following steps:
adopting a multi-target tracking algorithm to track vehicles corresponding to each piece of vehicle information to obtain tracking data;
correcting the tracking data according to the vehicle information to generate track data corresponding to each vehicle;
judging whether overtaking behaviors exist in each vehicle or not according to the track data;
if yes, judging that the type of the violation behaviors is the overtaking ETC behaviors;
if not, calculating whether the distance between each adjacent vehicle is within a preset range, and if so, judging that the violation behaviors are follow-up ETC behaviors.
Preferably, the determining whether there is a passing behavior according to the trajectory data includes the following:
for each vehicle, collecting driving data of two side edges of a lane in real time, and judging whether the vehicle passes through the side edges of the lane or not according to the driving data and the track data;
if yes, the overtaking behavior exists;
if not, no overtaking behavior exists.
Preferably, the identifying the license plate of each vehicle includes:
acquiring vehicle information related to each vehicle;
processing the information of each vehicle by adopting a pre-trained YOLOV3 detection network so as to position the license plate area of the vehicle corresponding to each piece of vehicle information;
and adopting a bidirectional long-short term memory network to combine a convolutional neural network and CTC loss to identify the license plate region from end to end so as to identify the license plate of each vehicle.
Preferably, the target detection is performed on the real-time data, and the at least one vehicle and its associated vehicle information are acquired, including the following:
and carrying out target detection on the real-time data by adopting a pre-trained SSD target detection network to obtain at least one vehicle and associated vehicle information thereof.
Preferably, the monitoring of the operation of the ETC system, passing the vehicle to be passed through the ETC system, comprises:
monitoring an activated state of a transit bar of the ETC system;
and if the vehicle to be passed passes through the ETC system, recovering the non-activated state of the passing rod of the ETC system.
Preferably, when the face of the vehicle is collected, a violation data set is generated according to the collected face data and the real-time data, and is stored in a preset database, where the violation data set includes the following steps:
judging whether the current vehicle is a vehicle to be passed or not according to the real-time data;
if not, acquiring a face, and triggering a video recording program to acquire video data;
and associating the video data with the real-time data, combining a face recognition result obtained based on the collected face data to generate a violation data set, and storing the violation data set in a preset database.
The invention also discloses a detection and identification system for illegal use of other people ETC behaviors, which comprises:
the acquisition module is used for acquiring real-time data of a lane entrance;
the detection module is used for carrying out target detection on the real-time data and acquiring at least one vehicle and vehicle information related to the vehicle, wherein the vehicle information comprises vehicle basic parameters and vehicle position data;
a communication module for information interaction with the ETC system,
the control module is used for controlling a traffic pole of the ETC system to enable the vehicle to pass through the ETC system and sending out warning information;
the license plate recognition module is used for recognizing the license plate of the vehicle information;
the behavior recognition module is used for analyzing the track of each vehicle to judge the type of the illegal behavior;
the face recognition module is used for carrying out face acquisition on the non-passing vehicle;
the storage module is used for generating a violation data set according to the collected face data and the real-time data and storing the violation data set in a preset database;
if only one vehicle is available, monitoring the work of an ETC system by adopting a communication module so that the vehicle passes through the ETC system;
if the number of the vehicles exceeds one, adopting a behavior recognition module to perform track analysis on each vehicle so as to judge the type of the illegal behavior;
when the behavior recognition module judges that the type of the illegal behavior is overtaking and ETC rubbing behavior, the license plate recognition module is adopted to recognize the license plate of each vehicle and confirm the vehicle to be passed according to the read card data read by the ECT system, and the communication module is adopted to monitor the work of the ETC system so that the vehicle to be passed passes through the ETC system;
when the behavior recognition module judges that the violation behavior type is the following ETC behavior, the license plate recognition module is adopted to recognize the license plate of each vehicle and confirms to pass through the vehicle according to the card reading data read by the ECT system, the communication module is adopted to send the warning information to the non-passing vehicle, and when the non-passing vehicle moves to a preset area, the ETC system is monitored to work, so that the passing vehicle passes through the ETC system.
Preferably, the detection and identification system comprises at least two acquisition devices which are respectively arranged on two sides of a passing pole of the ETC system.
Preferably, the detection and recognition system is provided with driving data recording devices on both sides of the lane, and is configured to collect driving data on both sides of the lane, and determine whether the vehicle passes through the side of the lane according to the driving data and the trajectory data, so as to determine whether there is a passing behavior.
After the technical scheme is adopted, compared with the prior art, the method has the following beneficial effects:
according to the scheme, real-time data of a lane entrance are collected, target detection is carried out on the basis of the real-time data, if only one vehicle exists in a current lane, the vehicle passes through an ETC system in a conventional mode, if a plurality of vehicles exist in the current lane, the violation behaviors are judged to exist, track analysis is carried out on each vehicle, when the fact that the ETC behaviors are rubbed along with the vehicle is judged to exist, a license plate is identified, and the vehicle which is not to pass through is prompted to pass through in a one-pole one-vehicle mode after moving to a preset area; if judge to have the overtaking to rub the ETC action, make the trafficability characteristic pole keep lifting the state, close again after the vehicle that is rubbed the ETC passes through, reduce to rub the ETC vehicle and put down the problem that leads to this passageway to take place to block up through passing through the pole after the passageway, and wait to carry out people's face to the non-and gather through the vehicle, acquire driver's personal information, the process of rubbing the ETC action simultaneously can be intercepted alone and preserve to corresponding the storage.
Drawings
FIG. 1 is a flowchart of a first embodiment of a method and system for detecting and identifying ETC behaviors of others in violation of using according to the present invention;
fig. 2 is a flowchart illustrating a trajectory analysis of a vehicle corresponding to information of each vehicle to determine a type of an illegal act in a first embodiment of a method and a system for detecting and identifying an ETC act of another person in violation;
fig. 3 is a flowchart illustrating a first method and system for detecting and identifying an ETC behavior of another person in violation according to the track data to determine whether there is an overtaking behavior;
fig. 4 is a flowchart of identifying license plates of vehicles in a first embodiment of the detection and identification method and system for illegal use of other people's ETC behaviors according to the present invention;
fig. 5 is a flowchart of a method and a system for detecting and identifying an ETC behavior of another person in violation, according to a first embodiment of the present invention, for monitoring the operation of an ETC system, so that the vehicle to be passed passes through the ETC system;
fig. 6 is a flowchart illustrating a method and a system for detecting and identifying an etc. behavior of another person in violation according to an embodiment of the present invention, where in the first embodiment of the method and the system, when the face of the non-passing vehicle is collected, a violation data set is generated according to the collected face data and the real-time data, and is stored in a preset database;
fig. 7 is a schematic block diagram of a second embodiment of the method and system for detecting and identifying an ETC behavior of another person in violation.
Reference numerals are as follows:
7-detecting the recognition system; 71-an acquisition module; 72-a detection module; 73-a communication module; 74-a control module; 75-license plate recognition module; 76-a behavior recognition module; 77-face recognition module; 78-memory module.
Detailed Description
The advantages of the invention are further illustrated in the following description of specific embodiments in conjunction with the accompanying drawings.
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at" ... "or" when ...or" in response to a determination ", depending on the context.
In the description of the present invention, it is to be understood that the terms "longitudinal", "lateral", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate orientations or positional relationships based on those shown in the drawings, and are merely for convenience of description and simplicity of description, but do not indicate or imply that the device or element referred to must have a particular orientation, be constructed in a particular orientation, and be operated, and thus, are not to be construed as limiting the present invention.
In the description of the present invention, unless otherwise specified and limited, it is to be noted that the terms "mounted," "connected," and "connected" are to be interpreted broadly, and may be, for example, a mechanical connection or an electrical connection, a communication between two elements, a direct connection, or an indirect connection via an intermediate medium, and specific meanings of the terms may be understood by those skilled in the art according to specific situations.
In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.
The first embodiment is as follows: the embodiment discloses a detection and identification method for illegal use of other people ETC behaviors, which is used for overcoming partial defects existing in the existing ETC system, effectively detecting and identifying a vehicle rubbing ETC, acquiring information storage related to the vehicle, facilitating subsequent work of law enforcement officers, reducing behavior events rubbing ETC, and is specific, the monitoring and identification method is used for a server end, the server end is associated with the ETC system and controls the ETC system, and the method refers to figure 1 and comprises the following steps:
s100: the method comprises the steps of collecting real-time data of a lane entrance, carrying out target detection on the real-time data, and obtaining at least one vehicle and vehicle information related to the vehicle, wherein the vehicle information comprises vehicle basic parameters and vehicle position data;
in the above step, the lane is a lane equipped with an ETC device, when any vehicle travels to a lane entrance, the ETC device reads the card to obtain the card reading data, and excites the passing rod of the ETC device according to the card reading data, so that the vehicle passes through the ETC system, in the scheme, the real-time data of the lane entrance is collected, and the target detection is performed on the real-time data to confirm the number of vehicles at the current lane entrance, in the step, the vehicle can be positioned by adopting the large target detection, specifically, the target detection is performed on the real-time data to obtain at least one vehicle and the associated vehicle information thereof, which includes the following steps:
and carrying out target detection on the real-time data by adopting a pre-trained SSD target detection network to obtain at least one vehicle and associated vehicle information thereof. In the embodiment, the SSD detection algorithm is used for customizing and modifying (namely parameter adjustment or training sample adjustment, and can be specifically improved according to the use scene) based on a lane entrance scene to detect the vehicle, and the SSD algorithm has enough precision for large target detection and high detection speed, so that the module uses the improved SSD algorithm for vehicle detection.
S200: if only one vehicle exists, monitoring the work of an ETC system, and enabling the vehicle to pass through the ETC system;
in the above steps, when it is determined through the target detection that there is only one vehicle at the current lane entrance, the vehicle is a normally-passing vehicle, and there is no case of illegally using other people's ETC.
S300: if the number of the vehicles exceeds one, performing track analysis on each vehicle to judge the type of the violation;
in the above steps, when it is confirmed through the target detection that the current lane entrance exceeds one vehicle, since the card reading of the ETC device can only allow one vehicle to pass through at a time, it indicates that there may be a behavior of illegally using other people ETC, and at this time, the vehicle trajectory needs to be analyzed to determine the behavior of illegally using other people ETC and the vehicle implementing the behavior.
The method comprises the following steps that two common ETC rubbing behaviors exist at present, one mode is that a rubbing ETC vehicle and a rubbed ETC vehicle run on different lanes, and when the rubbed ETC vehicle is successfully communicated with ETC equipment, the rubbing ETC vehicle suddenly overtakes from a nearby position and runs into the lane where the ETC equipment is located; the other type is that the vehicle that rubs ETC and the vehicle that is rubbed ETC are in same lane, rub ETC vehicle and slow down and drive into the ETC passageway, travel to passing the pole before, when the vehicle that is rubbed ETC drives into this ETC passageway and succeeds with ETC equipment communication under the obscure condition, rub ETC vehicle and drive out the passageway when the machine, based on this, divide into two types with the behavior type of violating the rule in this scheme, one type is as above the former rub ETC action for overtaking, another type is as above the latter follow and rub ETC action.
More specifically, the above-mentioned performing trajectory analysis on the vehicle corresponding to each piece of vehicle information to determine the violation type includes, referring to fig. 2, the following:
s310: adopting a multi-target tracking algorithm to track vehicles corresponding to each piece of vehicle information to obtain tracking data;
in the steps, the multi-target tracking algorithm is a Deepsort algorithm, the extracted features are required to be utilized for target tracking, more specifically, a Kalman filtering algorithm is combined with a Hungarian algorithm to serve as a tracking part, the target tracking algorithm is high in precision and good in real-time performance, has a good continuous tracking effect on a shielded target, and is suitable for the scene of the implementation mode.
S320: correcting the tracking data according to the vehicle information to generate track data corresponding to each vehicle;
in the above steps, the detection result of the detection algorithm (i.e. the vehicle position data in the vehicle information) is used to correct the result of the tracker, so that the tracking precision can be greatly improved, and the accuracy of the subsequently obtained track data is effectively improved.
S330: judging whether overtaking behaviors exist in each vehicle or not according to the track data;
the behaviors of each vehicle can be obtained according to the trajectory data generated in the step S320, and therefore, if the vehicle has a passing behavior, the first type of violation behavior, that is, a passing ETC behavior, is optionally determined, the determination that the passing behavior exists can be manually determined according to the visual trajectory data, as another option, a pre-trained neural network model can be further used, when the vehicle running trajectory deviates beyond a preset range, it is determined that passing news exists, and as an option, whether the passing behavior exists is determined according to the trajectory data, referring to fig. 3, the method includes the following steps:
s331: for each vehicle, collecting driving data of two side edges of a lane in real time, and judging whether the vehicle passes through the side edge of the lane according to the driving data and the track data;
in above-mentioned step, as the example, gather the driving data on lane both sides limit in real time and can realize through setting up induction equipment on lane both sides limit, because when overtaking and rubbing the ETC action, then rub the ETC vehicle and be rubbed the ETC vehicle and travel at different lanes before, after being rubbed ETC vehicle and ETC equipment communication success, rub the ETC vehicle and drive into the lane that current ETC equipment belonged to from the lane side, can accurately gather driving data through induction equipment, the action of overtaking must exist this moment in combination of orbit data.
S332: if yes, overtaking behavior exists;
s333: if not, no overtaking behavior exists.
S340: if so, judging that the type of the violation behavior is overtaking ETC behavior;
in the steps, the vehicle is judged to have the behavior of illegally using other people ETC when the overtaking behavior exists, and the behavior is specifically judged to be the overtaking ETC behavior.
S350: if not, calculating whether the distance between each adjacent vehicle is within a preset range (S350-1), and if so, judging that the violation behaviors are follow-up ETC behaviors (S350-2).
In the above steps, when there is no overtaking behavior, a non-overtaking ETC behavior is judged, at this time, in order to accurately judge that the violation behavior belongs to a following ETC behavior, whether the distance between each adjacent vehicle in the lane is within a preset range is calculated, when the distance between the two vehicles is within the preset range, it is judged that the vehicle has a tendency that the violated vehicle drives into the ETC channel under an unknown condition and successfully communicates with the ETC device, the violation vehicle drives out of the channel while the vehicle is, that is, the following ETC behavior can exist, if the distance between the two vehicles exceeds the preset range, the ETC behavior is probably caused by the fact that other vehicles drive into the lane by misoperation, at this time, it is judged that the behavior of illegally using other vehicles is less, and the ETC behavior cannot be judged to be following and rubbing.
S400: when the type of the violation behaviors is judged to be overtaking and overtaking ETC behaviors, license plates of all vehicles are identified, the vehicles to be passed are confirmed according to the read card data read by the ECT system, the work of the ETC system is monitored, and the vehicles to be passed pass through the ETC system;
judging to have the overtaking and rubbing ETC action, because when the overtaking and rubbing ETC action appears, after being rubbed ETC vehicle and ETC equipment communication success, rub ETC vehicle and drive in the lane that current ETC equipment is located from the lane side, the current pole of ETC system has been in the excited state this moment, rub ETC vehicle in the front, can directly drive out the lane and pass through ETC system, but because the current mode of the one-pole car of ETC system itself, before being rubbed ETC vehicle reaches the pole of passing, the pole of passing can resume to the state that has not been activated, the ETC vehicle that is rubbed this moment can only be forced to stop, cause the condition of blocking up easily, from this moment according to implementing data discernment license plate in this scheme, confirm the vehicle of waiting to pass through that is correlated with ETC equipment, after the above-mentioned condition appears, make the trafficability pole excited once more, make the ETC vehicle of being rubbed pass through smoothly, in order to overcome the condition that the ETC vehicle that causes follow-up vehicle and block up.
Specifically, in the above embodiment, the identifying the license plate of each vehicle, referring to fig. 4, includes the following:
s410: acquiring vehicle information related to each vehicle;
the vehicle information is data obtained after the large target detection is performed through the target detection network in step S100, specifically, the vehicle information includes vehicle basic parameters and vehicle position data, and the vehicle basic parameters include, but are not limited to, a vehicle body position, a color, a vehicle type, and the like.
S420: processing the information of each vehicle by adopting a pre-trained YOLOV3 detection network so as to position the license plate area of the vehicle corresponding to each piece of vehicle information;
in the above steps, vehicle information is processed, that is, license plate region positioning is performed based on the vehicle basic parameters, and detection of the license plate in the scene is small target detection, which requires as high precision as possible and high speed. The YOLO3 is a network with improved V1 and V2 in the existing YOLO series target detection algorithm, the main improvements comprise that the network structure is adjusted, multi-scale features are utilized for object detection, object classification is achieved by replacing softmax with Logistic, and in an actual use scene, license plate detection is achieved after YOLOv3 improvement, and the specific improvement comprises but is not limited to data preprocessing and is used for being suitable for each actual use scene.
S430: and performing end-to-end identification on the license plate area by adopting a bidirectional long-short term memory network in combination with a convolutional neural network and CTC loss so as to identify the license plate of each vehicle.
In the above steps, the specific license plate recognition uses a bidirectional long and short term memory network in combination with a convolutional neural network and a CTC loss to perform end-to-end recognition, and through the algorithm, the character segmentation process in the existing common license plate recognition can be omitted, and the license plate length is not limited, and an indefinite long license plate can be recognized, it is particularly noted that, in the above steps S420-S430, for the license plate recognition, certain GPU equipment and a high-speed camera need to be configured for hardware support, so that even two acquisition equipment (or license plate recognition equipment) can be taken in, one of which is arranged in front of a transit pole, and at the entrance of an ETC channel, is responsible for activating ETC equipment, so that a vehicle can be recognized under normal conditions; and the other is arranged behind the passing pole and is responsible for acquiring license plate information of the vehicle actually passing through the ETC channel so as to compare the license plate information with the vehicle information reserved in the ETC system. The license plate recognition method of steps S410-S430 may also be used for license plate recognition in step S500 below.
S500: when the violation behavior type is judged to be a following ETC behavior, license plates of all vehicles are recognized, the vehicles to be passed are confirmed according to the read card data read by the ECT system, warning information is sent to the vehicles which are not to be passed, and when the vehicles which are not to be passed move to a preset area according to the warning information, the work of the ETC system is monitored, so that the vehicles to be passed pass through the ETC system;
in the above steps, when it is determined that the ETC act is to be followed (i.e., the violation act of the ETC act is not overtaking), the license plate recognition method in the above steps S410-S430 is adopted to recognize the license plate of each vehicle, and then it is confirmed that the vehicle to be passed is in front and back, and warning information is sent to the subsequent vehicle, so that the vehicle with the possibility of the ETC act is driven out of the induction range of the ETC device.
In the above steps S400 and S500, the monitoring of the operation of the ETC system, and the passing of the vehicle through the ETC system, referring to fig. 5, includes the following steps:
s510: monitoring an activated state of a transit bar of the ETC system;
in the above steps, the transit bar of the ETC system takes a one-bar-one-car transit mode, so that when the vehicle passes under the ETC system, the ETC system reads the card and matches the vehicle information so that the transit bar passes through the vehicle after being activated.
S520: and if the vehicle to be passed passes through the ETC system, recovering the non-activated state of the passing rod of the ETC system.
Specifically, in step S400, it is required to monitor that the traffic lever is in an activated state so that the following passing vehicle exits the lane, and in step S500, it is required to monitor that the traffic lever is in an inactivated state so that the following non-passing vehicle exits to the preset area and is activated, even if the inactivated state is restored, thereby ensuring that the passing vehicle passes and the non-passing vehicle is blocked.
S600: and synchronously carrying out face acquisition on the vehicles which are not to pass through, generating a violation data set according to the acquired face data and the real-time data, and storing the violation data set in a preset database.
In above-mentioned step S400 and step S500, carry out respectively and use the different processing mode of other people ' S ETC action based on two kinds of violations, a vehicle jam for reducing the violation use other people ' S ETC action and cause, punish in order to further use other people ' S ETC action to the violation, and then be used for reducing the violation action of using other people ' S ETC, record the vehicle of using other people ' S ETC in violation, record the owner of this type of vehicle simultaneously, the process of rubbing ETC action can be preserved alone, combine the face identification result to be filed, leave the punishment foundation of post processing ETC action. As a supplement, the camera for face recognition is installed at the exit of the ETC channel at a position substantially equal to the cab and on the left of the driver, so that a clear picture of the driver can be captured conveniently.
When the face of the non-passing vehicle is collected, a violation data set is generated according to the collected face data and the real-time data and is stored in a preset database, referring to fig. 6, which includes the following steps:
s610: judging whether the current vehicle is a vehicle to be passed or not according to the real-time data;
in the above steps, it is determined whether the current vehicle is a vehicle to be passed through by referring to the vehicle license plate recognition process described in the above steps S100 to S430, or when the overtaking ETC act is recognized, it is determined that the following vehicle is a vehicle to be passed through, and when the overtaking ETC act is recognized, it is determined that the preceding vehicle is a vehicle to be passed through.
S620: if not, acquiring the human face, and triggering a video recording program to acquire video data;
in this embodiment, if there is a rub-ETC behavior, the system will synchronously execute three processes to process: intercepting the ETC rubbing behavior process, storing a video, activating a face recognition module, and performing face recognition on a driver rubbing an ETC vehicle; check ETC equipment state, if the ETC is activated, then lift the pole of passing until being rubbed the ETC vehicle and pass through, avoid because rubbing the ETC action and lead to the process that the record rubbed the ETC action when traffic jams.
S630: and associating the video data with the real-time data, combining a face recognition result obtained based on the collected face data to generate a violation data set, and storing the violation data set in a preset database.
In the embodiment, the face recognition result, the video data and the real-time data are collected, and the behavior of using ETC of other people in violation can be stored so as to be used as a penalty basis in the following process and be called from the database in the following process.
In the scheme, real-time data of a lane entrance are collected, when a plurality of vehicles are detected to pass through simultaneously, track analysis is carried out on each vehicle, when the fact that a vehicle-mounted ETC behavior exists is judged, vehicle information of the ETC equipment which is activated currently in an ETC system is obtained, license plates are identified, license plate comparison is carried out on the vehicle information and the prior vehicle entering a channel, if the information is the same, the vehicle which is not to pass through is prompted to move to a preset area, and then the vehicle passes through in a one-pole one-car mode; if the information is different then the affirmation has the overtaking ETC action, then the current pole is the vehicle of just rubbing the ETC vehicle earlier, the vehicle still keeps lifting up the state through back trafficability pole here, close again after passing through until the vehicle of rubbing the ETC, avoid the front truck to rub ETC through the passageway after the current pole puts down and leads to this passageway to take place the problem that blocks up through this mode, and carry out face acquisition to the non-vehicle of treating through the vehicle, acquire driver's personal information, the process of rubbing the ETC action simultaneously can be intercepted alone and preserved, adopt face identification to combine the method of license plate discernment to acquire illegal vehicle's true information, prevent that the fake plate action makes can't pursue the responsibility to illegal vehicle or personnel.
The second embodiment: the embodiment discloses a detection and recognition system 7 for illegal use of other people's ETC behaviors, referring to fig. 7, including:
the acquisition module 71 is used for acquiring real-time data of a lane entrance;
the detection module 72 is configured to perform target detection on the real-time data, and acquire at least one vehicle and vehicle information related to the vehicle, where the vehicle information includes vehicle basic parameters and vehicle position data;
specifically, the detection module 720 performs customized modification based on the toll gate scene by using an SSD detection algorithm to perform vehicle detection.
A communication module 73 for information interaction with the ETC system,
a control module 74 for controlling a traffic pole of the ETC system to pass the vehicle to be passed through the ETC system and for issuing warning information;
the license plate recognition module 75 is used for recognizing the license plate of the vehicle information;
specifically, the license plate recognition module 750 performs license plate region location by using a method combining a detection algorithm and a recognition algorithm and using a coordinate position obtained by the detection algorithm, and then cuts out a license plate region and sends the license plate region to a recognition part for license plate recognition.
A behavior recognition module 76, configured to perform trajectory analysis on each vehicle to determine a type of violation;
specifically, the behavior recognition module 76 performs vehicle tracking on the vehicle corresponding to each piece of vehicle information by using a multi-target tracking algorithm to obtain tracking data; correcting the tracking data according to the vehicle information to generate track data corresponding to each vehicle; judging whether overtaking behaviors exist in each vehicle or not according to the track data; if so, judging that the type of the violation behavior is overtaking ETC behavior; if not, calculating whether the distance between each two adjacent vehicles is within a preset range, and if so, judging that the type of the violation behaviors is the follow-up ETC behaviors.
A face recognition module 77, configured to perform face acquisition on the non-passing vehicle;
the storage module 78 is configured to generate an illegal action data set according to the acquired face data and the real-time data, and store the illegal action data set in a preset database;
if only one vehicle is available, monitoring the work of an ETC system by adopting a communication module so that the vehicle passes through the ETC system;
if the number of the vehicles exceeds one, the track of each vehicle is analyzed by adopting a behavior recognition module 76 to judge the type of the illegal behavior; when the behavior recognition module 76 judges that the violation behavior type is overtaking and ETC-taking behavior, the license plate recognition module 75 is adopted to recognize the license plate of each vehicle and confirm the vehicle to be passed according to the read card data read by the ECT system, and the communication module 73 is adopted to monitor the work of the ETC system so that the vehicle to be passed passes through the ETC system; when behavior recognition module 76 judges that the violation type is for following the ETC action of rubbing, then adopt license plate recognition module 75 discernment each vehicle's license plate and according to the card data of reading that the ECT system read confirms that to wait to pass through the vehicle, adopt communication module 73 to send warning information to the non-vehicle of waiting to pass through, when the non-vehicle of waiting to pass through according to warning information removes when predetermineeing the region, monitors ETC system work, makes it passes through to wait to pass through the vehicle the ETC system.
In the above embodiment, the detection and identification system 7 includes at least two acquisition devices respectively disposed on two sides of a transit bar of the ETC system, one of which is disposed in front of the transit bar and at the entrance of the ETC passageway, and is responsible for participating in activating the ETC device; and the other one is arranged behind the passing rod and is responsible for acquiring license plate information of a vehicle actually passing through the ETC channel so as to compare the license plate information with card reading data acquired by card reading in the ETC system.
In the above embodiment, the detection and recognition system is provided with driving data recording devices on both sides of the lane, and is configured to collect driving data on both sides of the lane, and determine whether the vehicle passes through the side of the lane according to the driving data and the trajectory data, so as to determine whether there is a passing behavior.
In the embodiment, the two behaviors of illegally using other people ETC (including overtaking ETC behaviors and following ETC behaviors) are identified, different strategies are adopted according to different types of illegal behaviors, the problem that the toll collection channel passing efficiency is influenced due to blockage caused by forced stop of the overtaked ETC vehicle is solved, meanwhile, the real information of the illegal vehicle is obtained by adopting a method of combining face recognition with license plate recognition, and the information is stored to be used as a subsequent punishment evidence; in the process, an improved license plate recognition algorithm is used, so that the recognition accuracy and the recognition speed are improved, and various license plate numbers with different lengths can be recognized.
It should be noted that the embodiments of the present invention have been described in terms of preferred embodiments, and not by way of limitation, and that those skilled in the art can make modifications and variations of the embodiments described above without departing from the spirit of the invention.
Claims (10)
1. A detection and identification method for illegal use of other people ETC behaviors is associated with an ETC system and is characterized by comprising the following steps:
the method comprises the steps of collecting real-time data of a lane entrance, carrying out target detection on the real-time data, and obtaining at least one vehicle and vehicle information related to the vehicle, wherein the vehicle information comprises vehicle basic parameters and vehicle position data;
if only one vehicle exists, monitoring the work of an ETC system, and enabling the vehicle to pass through the ETC system;
if the number of the vehicles exceeds one, performing track analysis on each vehicle to judge the type of the violation;
when the violation behavior type is judged to be overtaking and ETC rubbing behavior, license plates of all vehicles are identified, the vehicles to be passed are confirmed according to the read card data read by the ECT system, the work of the ETC system is monitored, and the vehicles to be passed pass through the ETC system; when the violation behavior type is judged to be a following ETC behavior, license plates of all vehicles are recognized, the vehicles to be passed are confirmed according to the read card data read by the ECT system, warning information is sent to the vehicles which are not to be passed, and when the vehicles which are not to be passed move to a preset area according to the warning information, the work of the ETC system is monitored, so that the vehicles to be passed pass through the ETC system;
and synchronously carrying out face acquisition on the non-passing vehicles, generating violation data sets according to the acquired face data and the real-time data, and storing the violation data sets in a preset database.
2. The detection and identification method according to claim 1, wherein the trajectory analysis of each vehicle to determine the violation type includes the following steps:
vehicle tracking is carried out on vehicles corresponding to all vehicle information by adopting a multi-target tracking algorithm, and tracking data are obtained;
correcting the tracking data according to the vehicle information to generate track data corresponding to each vehicle;
judging whether overtaking behaviors exist in each vehicle or not according to the track data;
if so, judging that the type of the violation behavior is overtaking ETC behavior;
if not, calculating whether the distance between each adjacent vehicle is within a preset range, and if so, judging that the violation behaviors are follow-up ETC behaviors.
3. The detection and identification method according to claim 2, wherein the determining whether the overtaking behavior exists in each vehicle according to the trajectory data comprises the following steps:
for each vehicle, collecting driving data of two side edges of a lane in real time, and judging whether the vehicle passes through the side edges of the lane or not according to the driving data and the track data;
if yes, the overtaking behavior exists;
if not, no overtaking behavior exists.
4. The detection and identification method according to claim 1, wherein the identifying of the license plate of each vehicle comprises the following steps:
acquiring vehicle information related to each vehicle;
processing the information of each vehicle by adopting a pre-trained YOLOV3 detection network so as to position the license plate area of the vehicle corresponding to each piece of vehicle information;
and performing end-to-end identification on the license plate area by adopting a bidirectional long-short term memory network in combination with a convolutional neural network and CTC loss so as to identify the license plate of each vehicle.
5. The detection and identification method according to claim 1, wherein the step of performing target detection on the real-time data to obtain at least one vehicle and associated vehicle information comprises the following steps:
and carrying out target detection on the real-time data by adopting a pre-trained SSD target detection network to obtain at least one vehicle and associated vehicle information thereof.
6. The detection and identification method according to claim 1, wherein the monitoring of the operation of the ETC system for the vehicle to pass through the ETC system comprises the following steps:
monitoring an activated state of a transit bar of the ETC system;
and if the vehicle to be passed passes through the ETC system, recovering the non-activated state of the passing rod of the ETC system.
7. The detection and identification method according to claim 1, wherein when the face of the non-passing vehicle is collected, a violation data set is generated according to the collected face data and the real-time data, and is stored in a preset database, and the method comprises the following steps:
judging whether the current vehicle is a vehicle to be passed or not according to the real-time data;
if not, acquiring a face, and triggering a video recording program to acquire video data;
and associating the video data with the real-time data, generating a violation data set based on a face recognition result obtained by the collected face data, and storing the violation data set in a preset database.
8. A detection and recognition system for illegal use of ETC behaviors of other people is characterized by comprising:
the acquisition module is used for acquiring real-time data of a lane entrance;
the detection module is used for carrying out target detection on the real-time data and acquiring at least one vehicle and vehicle information related to the vehicle, wherein the vehicle information comprises vehicle basic parameters and vehicle position data;
a communication module for information interaction with the ETC system,
the control module is used for controlling a passing pole of the ETC system to enable a vehicle to pass through the ETC system and sending out warning information;
the license plate recognition module is used for recognizing the license plate of the vehicle information;
the behavior recognition module is used for analyzing the track of each vehicle so as to judge the type of the illegal behavior;
the face recognition module is used for carrying out face acquisition on the vehicles which are not to pass through;
the storage module is used for generating a violation data set according to the collected face data and the real-time data and storing the violation data set in a preset database;
if only one vehicle is available, monitoring the work of an ETC system by adopting a communication module so that the vehicle passes through the ETC system;
if the number of the vehicles exceeds one, adopting a behavior recognition module to perform track analysis on each vehicle so as to judge the type of the illegal behavior;
when the behavior recognition module judges that the type of the illegal behavior is overtaking and ETC rubbing behavior, the license plate recognition module is adopted to recognize the license plate of each vehicle and confirm the vehicle to be passed according to the read card data read by the ECT system, and the communication module is adopted to monitor the work of the ETC system so that the vehicle to be passed passes through the ETC system;
when behavior recognition module judges that the violation type is for following the ETC action of rubbing, then adopt license plate recognition module discernment each vehicle's license plate and according to the card data of reading that the ECT system reads is confirmed and is waited to pass through the vehicle, adopts communication module to send warning information extremely the non-vehicle of waiting to pass through works as the non-vehicle of waiting to pass through according to warning information removes when predetermineeing the region, monitors ETC system work, makes it passes through to wait to pass through the vehicle the ETC system.
9. The detection and identification system according to claim 8, wherein:
the detection and recognition system is provided with driving data recording equipment on two sides of the lane and is used for collecting driving data on two side edges of the lane and judging whether the vehicle passes through the side edges of the lane according to the driving data and the track data so as to judge whether overtaking behaviors exist.
10. The detection and identification system according to claim 8, wherein:
the detection and identification system comprises at least two acquisition devices which are respectively arranged on two sides of a passing pole of the ETC system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110659683.1A CN113313051B (en) | 2021-06-11 | 2021-06-11 | Detection and identification method and system for illegal use of ETC behaviors of other people |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110659683.1A CN113313051B (en) | 2021-06-11 | 2021-06-11 | Detection and identification method and system for illegal use of ETC behaviors of other people |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113313051A CN113313051A (en) | 2021-08-27 |
| CN113313051B true CN113313051B (en) | 2023-04-18 |
Family
ID=77378885
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110659683.1A Active CN113313051B (en) | 2021-06-11 | 2021-06-11 | Detection and identification method and system for illegal use of ETC behaviors of other people |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113313051B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116305735B (en) * | 2022-12-02 | 2023-10-10 | 湖北华中电力科技开发有限责任公司 | Computer data remote management system and method based on Internet of things |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110717433A (en) * | 2019-09-30 | 2020-01-21 | 华中科技大学 | Deep learning-based traffic violation analysis method and device |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU5603596A (en) * | 1995-06-13 | 1997-01-02 | Pacrim Corporation Pty Ltd | Vehicle identification and/or positioning system |
| CN105488855A (en) * | 2015-11-24 | 2016-04-13 | 东南大学 | Vehicle type identification method in ETC system and ETC system |
| CN107944329B (en) * | 2016-10-12 | 2021-12-07 | 航天信息股份有限公司 | Vehicle detection method, lane controller and system for ETC lane |
| CN110178167B (en) * | 2018-06-27 | 2022-06-21 | 潍坊学院 | Intersection violation video identification method based on cooperative relay of cameras |
| CN109615868A (en) * | 2018-12-20 | 2019-04-12 | 北京以萨技术股份有限公司 | A kind of video frequency vehicle based on deep learning is separated to stop detection method |
| CN110264734A (en) * | 2019-06-26 | 2019-09-20 | 北京梦陀螺科技有限公司 | A kind of vehicle on highway auditing system and its working method |
| CN111127897A (en) * | 2019-12-27 | 2020-05-08 | 泰斗微电子科技有限公司 | Vehicle state detection method and device, server and inspection system |
| CN111784859A (en) * | 2020-07-28 | 2020-10-16 | 哈尔滨智路科技开发有限公司 | Special embedded lane control system for expressway |
| CN112064539B (en) * | 2020-08-06 | 2021-07-30 | 苏州固特斯电子科技有限公司 | Anti-rubbing card running road isolating device for high-speed toll station |
| CN112766054A (en) * | 2020-12-29 | 2021-05-07 | 安徽中科新萝智慧城市信息科技有限公司 | Intelligent toll station fee evasion prevention method and system based on image recognition |
-
2021
- 2021-06-11 CN CN202110659683.1A patent/CN113313051B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110717433A (en) * | 2019-09-30 | 2020-01-21 | 华中科技大学 | Deep learning-based traffic violation analysis method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113313051A (en) | 2021-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110136447A (en) | Lane change of driving a vehicle detects and method for distinguishing is known in illegal lane change | |
| CN107067730B (en) | Network appointment vehicle-man-vehicle inconsistency monitoring method based on bayonet equipment | |
| CN104809887B (en) | A kind of retrograde detection method of vehicle on expressway and autoalarm | |
| CN111353369B (en) | Application method and system of urban road side parking high-level video in auxiliary criminal investigation | |
| CN103914886A (en) | Parking lot management method and system | |
| CN109189019A (en) | A kind of engine drivers in locomotive depot value multiplies standardization monitoring system | |
| CN108932849B (en) | Method and device for recording low-speed running illegal behaviors of multiple motor vehicles | |
| CN112381014A (en) | Illegal parking vehicle detection and management method and system based on urban road | |
| CN113313051B (en) | Detection and identification method and system for illegal use of ETC behaviors of other people | |
| CN111243185A (en) | Charging parking space occupation determination method, device and medium | |
| CN111460985A (en) | On-site worker track statistical method and system based on cross-camera human body matching | |
| CN113990101B (en) | Method, system and processing device for detecting vehicles in no-parking area | |
| CN114694197A (en) | Driving early warning method, electronic device and computer readable storage medium | |
| CN108921962B (en) | Parking lot entrance and exit management method and parking lot management server | |
| CN108389276A (en) | Highway operating system and method | |
| CN117115801A (en) | License plate authenticity identification method, device, equipment and storage medium | |
| CN115731707A (en) | Highway vehicle traffic control method and system | |
| CN116778742A (en) | Information acquisition-based parking big data dynamic visual analysis operation and maintenance management system | |
| CN108122414A (en) | The detection method and device of car on-board and off-board on highway | |
| CN114360279B (en) | Method, device and storage medium for controlling vehicle access in parking lot | |
| CN115440071A (en) | Automatic driving illegal parking detection method | |
| CN114627652A (en) | Intelligent detection method and system for highway ETC | |
| CN110718071B (en) | Verification method and device for image acquisition equipment, computer equipment and storage medium | |
| CN111881758B (en) | Parking management method and system | |
| CN117315601B (en) | Vehicle dangerous behavior AI identification alarm system based on remote sensing technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |