CN115273266A - Patrol system - Google Patents

Patrol system Download PDF

Info

Publication number
CN115273266A
CN115273266A CN202210701272.9A CN202210701272A CN115273266A CN 115273266 A CN115273266 A CN 115273266A CN 202210701272 A CN202210701272 A CN 202210701272A CN 115273266 A CN115273266 A CN 115273266A
Authority
CN
China
Prior art keywords
module
vehicle
patrol
target image
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210701272.9A
Other languages
Chinese (zh)
Other versions
CN115273266B (en
Inventor
李天彪
郭祖龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Uisee Shanghai Automotive Technologies Ltd
Original Assignee
Uisee Shanghai Automotive Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Uisee Shanghai Automotive Technologies Ltd filed Critical Uisee Shanghai Automotive Technologies Ltd
Priority to CN202210701272.9A priority Critical patent/CN115273266B/en
Publication of CN115273266A publication Critical patent/CN115273266A/en
Application granted granted Critical
Publication of CN115273266B publication Critical patent/CN115273266B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/20Checking timed patrols, e.g. of watchman
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)

Abstract

The embodiment of the disclosure discloses a patrol system, which comprises: the system comprises a business module, a stream pulling module and an algorithm module which are respectively arranged at the cloud end; the service module is used for acquiring vehicle data and sending the vehicle data to the pull flow module; the stream pulling module is used for determining patrol operation according to the vehicle data, acquiring a video stream of a vehicle-mounted camera of a preset vehicle according to the vehicle data when the patrol operation is started or patrol is resumed, processing the video stream to obtain a target image, and sending the target image to the algorithm module so as to execute a patrol task through the preset vehicle; the algorithm module is used for detecting the target image to determine whether a target event occurs in the surrounding environment of the preset vehicle. The patrol system disclosed by the invention reduces patrol cost and is suitable for various patrol scenes.

Description

Patrol system
Technical Field
The disclosure relates to the technical field of automatic driving, in particular to a patrol system.
Background
With the accelerated development of modern construction, the intelligent networked automobile has increasingly come to the ground in various large factories, logistics parks, airports and other scenes. The trend of increasing nobody puts new demands on security patrols for such parks.
At present, two security patrol modes are commonly used, one is as follows: the method mainly comprises the steps of monitoring by a camera and assisting in manual patrol; the other is to patrol by using an unmanned patrol car. The first security patrol mode needs a large number of cameras to cover a large patrol area, so that the cost is high; the unmanned patrol car in the second security patrol mode also costs high, and the patrol route of the patrol car may conflict with the driving route of the logistics car or ferry car in the garden.
Therefore, there is a need for continued improvement over existing security patrol approaches.
Disclosure of Invention
In order to solve the technical problem or at least partially solve the technical problem, the embodiments of the present disclosure provide a patrol system, which reduces patrol cost and is suitable for various patrol scenarios.
The disclosed embodiment provides a patrol system, which comprises: the system comprises a business module, a stream pulling module and an algorithm module which are respectively arranged at the cloud end; the service module is used for acquiring vehicle data and sending the vehicle data to the pull flow module; the stream pulling module is used for determining patrol operation according to the vehicle data, acquiring a video stream of a vehicle-mounted camera of a preset vehicle according to the vehicle data when the patrol operation is started or is recovered, processing the video stream to obtain a target image, and sending the target image to the algorithm module so as to execute a patrol task through the preset vehicle; the algorithm module is used for detecting the target image so as to determine whether a target event occurs in the surrounding environment of the preset vehicle.
The patrol system provided by the embodiment of the disclosure is characterized in that the service module, the pull flow module and the algorithm module which are respectively arranged at the cloud end are matched with the camera at the vehicle end, so that automatic patrol is realized, typically, an intelligent internet vehicle is reused to shoot an original working scene, and a video stream is sent to the pull flow module and the algorithm module at the cloud end, so that automatic patrol is realized, and the patrol vehicle is not additionally specially configured, so that the cost can be greatly reduced.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.
Fig. 1 is a schematic structural diagram of a patrol system in an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a patrol system according to an embodiment of the present disclosure;
fig. 3 is a schematic diagram of a patrol system according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a patrol system in an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a patrol system in an embodiment of the present disclosure;
fig. 6 is a schematic diagram of a service architecture in an embodiment of the disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the drawings, it is to be understood that the disclosure may be embodied in various forms, and should not be construed as limited to the embodiments set forth herein but are to be provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
The embodiment of the disclosure provides a patrol system, aiming at reducing patrol cost and improving patrol efficiency. The intelligent network connection system is particularly suitable for working scenes of intelligent network connection automobiles, such as logistics parks, large visiting parks and the like. Generally, in a logistics park, an intelligent networked automobile transports goods to and fro on the basis of a pre-planned route; in a large visiting park, the intelligent networked automobile is used for carrying passengers. In the scheme of the embodiment of the disclosure, frequent mobility of the intelligent networked automobile is fully considered, the intelligent networked automobile is reused to patrol the original working scene of the intelligent networked automobile, and the patrol car is not specially configured additionally, so that the cost can be greatly reduced. Specifically, in order to not influence the intelligent networked automobile to execute the original work task, a camera for patrol and a plug-flow module matched with the camera are specially configured on the intelligent networked automobile, and the existing camera of the intelligent networked automobile is not reused. Furthermore, the plug-flow module can be set to use an independent SIM card and computing equipment so as to achieve the purpose of not occupying the network bandwidth and the computing power of the intelligent networked automobile, and meanwhile, one of the purposes of laying the algorithm module to the cloud is also to achieve the purpose of not occupying the computing power of the intelligent networked automobile. .
Referring to fig. 1, a schematic diagram of a patrol system is shown, which includes: the business module 110, the stream pulling module 120 and the algorithm module 130 are respectively arranged at the cloud end.
The service module 110 is configured to obtain vehicle data and send the vehicle data to the stream pulling module 120; the stream pulling module 120 is configured to determine a patrol operation according to the vehicle data, acquire a video stream of a vehicle-mounted camera of a preset vehicle according to the vehicle data when the patrol operation is to start patrol or to resume patrol, process the video stream to obtain a target image, and send the target image to the algorithm module 130 so as to execute a patrol task by the preset vehicle; the algorithm module 130 is configured to detect the target image to determine whether a target event occurs in the surroundings of the preset vehicle. Typically, the target event may be the presence or absence of a pedestrian entering the campus or the presence or absence of a broken wire tie, etc.
Specifically, the vehicle data may include vehicle resource data and vehicle real-time data. The vehicle resource data comprises a vehicle list supporting a patrol function and pull addresses of vehicle-mounted cameras used for patrol tasks on vehicles. The vehicle real-time data refers to data reported by each vehicle supporting the patrol function in real time, and specifically may include a real-time position, a course angle, whether the vehicle is in a driving state, a parking state, and the like.
Optionally, the current pulling module 120 determines a patrol operation according to the vehicle data, including: and determining whether the position of a preset vehicle is a set patrol position or not according to the vehicle position information in the vehicle data, and if the position of the preset vehicle is the set patrol position, determining patrol operation based on operation configured corresponding to the set patrol position. It can be understood that the preset vehicle is one of the vehicles supporting the patrol function, and each vehicle supporting the patrol function is traversed according to the related method provided by the embodiment of the disclosure, so that each vehicle is fully utilized to perform patrol tasks, patrol efficiency is improved, and patrol cost is reduced.
Further, if the preset vehicle is located at the set patrol position, the pull-stream module 120 is further configured to determine whether the course angle of the preset vehicle at the set patrol position is the set course angle according to the vehicle data, and if so, determine the operation configured corresponding to the set patrol position and the set course angle as the patrol operation.
In summary, the stream pulling module 120 supports configuring trigger points including position (coordinates), heading (heading direction), patrol operations performed (start patrol, stop patrol, suspend patrol, or resume patrol), and a label for a camera (e.g., camera number 1 or 2 installed on the same car). The master process of the pull-stream module 120 regularly polls the service module 110 to obtain the vehicle resource data and the vehicle real-time data from the service module 110, compares the position data in the vehicle real-time data with the positions included in all the trigger points, and starts to perform corresponding patrol operations, such as starting patrol, stopping patrol, suspending patrol, or resuming patrol, when it is determined that the vehicle has traveled to the positions included in the trigger points. Starting patrol or restoring patrol, namely starting to execute a stream pulling operation (namely acquiring a video stream of a vehicle-mounted camera), and processing the video stream; the essence of stopping patrol or pausing patrol is not to perform a pull operation.
It can be understood that the stream pulling operation performed on the video stream of each vehicle-mounted camera corresponds to one thread, and since the cost of processing resources is high by starting and closing the stream pulling operation, and the time consumption is long, in the stream pulling process, if a vehicle passes through a first specified position (for example, a position area which is short in path time and does not need to be detected, such as a gate), the stream pulling operation is still maintained, but the pulled video stream is not processed, and when the vehicle reaches a second specified position, the operation of processing the video stream is resumed, so that the purpose of reducing the frequency of starting and closing the stream pulling operation is achieved, and the purpose of saving the resource cost is achieved.
For example, referring to a schematic structural diagram of a patrol system shown in fig. 2, on the basis of the patrol system provided in the foregoing embodiment, the patrol system provided in this embodiment further includes: the video transit service module 210 is in communication connection with a stream pushing module installed on the preset vehicle, and is configured to receive a video stream of the vehicle-mounted camera pushed by the stream pushing module; correspondingly, the stream pulling module 120 is configured to obtain the video stream of the vehicle-mounted camera of the preset vehicle from the video transit service module 210 according to the vehicle data.
Further, the stream pulling module 120 processes the video stream to obtain a target image, including: the stream pulling module 120 cuts out image frames from the video stream as the target image according to a set frequency, for example, cuts out one image frame from the video stream every 1s as the target image.
In order to improve the patrol accuracy, the pull-stream module 120 transmits the pull time from the video relay service module 210 to the image frame to the algorithm module 130 while transmitting the target image to the algorithm module 130. When it is determined that a target event occurs in the surrounding environment of the preset vehicle, the algorithm module 130 is further configured to obtain a timestamp of the target image based on an optical character recognition technology, determine the timestamp as the occurrence time of the target event if a difference between the timestamp and the pull time is smaller than a set threshold, and send the timestamp and the target event to the service module 110. This is because there is a network delay in pulling the video stream, the target image obtained by the algorithm module 130 may be a period of time ahead (the time may be determined by the pull time), and the timestamp in the form of a watermark in the target image is the real time when the target event occurs, so if the difference between the timestamp and the pull time is smaller than the set threshold, the timestamp is determined as the occurrence time of the target event.
For example, referring to a schematic structural diagram of a patrol system shown in fig. 3, on the basis of the patrol system provided in the foregoing embodiment, the patrol system provided in this embodiment further includes: correspondingly, the service module 110 is further configured to determine vehicle real-time data of the preset vehicle corresponding to the timestamp, generate an event packet based on the vehicle real-time data corresponding to the timestamp and the target event, and push the event packet to the first message queue 310, so that a plurality of service parties can obtain the event packet from the first message queue 310. The first message queue 310 is further configured to receive vehicle real-time data reported by the preset vehicle, and send the vehicle real-time data to the service module 110.
Wherein the vehicle data comprises the vehicle real-time data. Optionally, the vehicle real-time data is reported to an MQTT-Broker (i.e., the first Message queue 310) in the cloud by using an MQTT (Message queue Telemetry Transport) protocol. The service module 110 subscribes vehicle real-time data and planning messages from the MQTT-Broker, and when receiving vehicle real-time data reported by the vehicle, the MQTT-Broker immediately pushes the vehicle real-time data to the service module 110, and a latest piece of vehicle real-time data is cached in the service module 110.
By setting the first message queue 310, the expandability of the patrol system can be improved, and other business parties can conveniently acquire relevant data from the first message queue 310.
For example, referring to a schematic structural diagram of a patrol system shown in fig. 4, on the basis of the patrol system provided in the foregoing embodiment, the patrol system provided in this embodiment further includes: a static resource service module 410, a front end 420, and an event management service module 430. The static resource service module 410 is configured to receive the target image sent by the business module 110, where when it is determined that the target event occurs, the business module 110 sends the target image to the static resource service module 410 according to a specified rule.
The front end 420 is communicatively connected to the first message queue 310, and configured to receive and display the event information packet pushed by the first message queue 310, and obtain a corresponding target image from the static resource service module 410 for display based on the event information packet, for example, obtain the corresponding target image from the static resource service module 410 according to a timestamp in the event information packet. Furthermore, the coordinates of the occurrence position of the target event can be displayed, and the coordinates can be determined based on current vehicle real-time data, or when the algorithm module detects and identifies the target image, if the target event is identified, the coordinates of the occurrence position of the target event and simple description (for example, detailed information such as human intrusion, broken wire, and the area of the broken hole is about what) for the target event are synchronously recorded, so that the front end can display conveniently, and the early warning efficiency is improved.
The event management service module 430 is configured to receive the event information packet pushed by the first message queue 310, and store the event information packet. Correspondingly, the stream pulling module 120 is further configured to obtain the event information packet from the event management service module 430, and analyze information in the event information packet to obtain an analysis result; if it is determined that the occurrence time of the target event is within a first time period (for example, a time period corresponding to daytime) based on the analysis result, performing cluster analysis on the target event detected by different vehicles in the same trip to obtain the occurrence position of the target event in the same trip, and sending a prompt message related to the occurrence position of the target event to the algorithm module 130 in a second time period (for example, a time period corresponding to nighttime) to prompt the algorithm module 130 to perform key point detection and identification on the position, so as to achieve the purpose of improving night patrol accuracy.
In summary, the patrol scheme of the embodiments of the present disclosure develops a night mode to assist the algorithm module 130 in image detection, since the night image quality is worse than the day. The pull stream module 120 supports configuring the start-stop time of the night. After the time period corresponding to night is reached, clustering is carried out on the target events determined by analyzing the video streams collected in the same trip based on different vehicles, and the positions of the target events in each trip are counted. When the vehicle is driving at night and arrives at the counted position, the reminding algorithm module 130 is abnormal in the daytime and needs to monitor intensively.
Optionally, in addition to clustering target events determined by analyzing video streams acquired by different vehicles in the same trip and counting the positions of the target events occurring in each trip, clustering analysis may be performed on the target events determined when the same vehicle passes through the same position at different times, so as to determine the positions of the target events more accurately.
For example, referring to a schematic structural diagram of a patrol system shown in fig. 5, on the basis of the patrol system provided in the foregoing embodiment, the patrol system provided in this embodiment further includes: further comprising: a vehicle resource service module 510, a second message queue 520, and a third message queue 530. The vehicle resource service module 510 is configured to send vehicle resource data to the second message queue 520, where the vehicle resource data includes the vehicle resource data, and specifically, the vehicle resource service module 510 is responsible for managing the vehicle resource data (including a pull address corresponding to a camera mounted on a vehicle). The second message queue 520 is used to push the vehicle resource data to the traffic module 110. The third message queue 530 is respectively connected to the pull flow module 120 and the algorithm module 130 in a communication manner, and is configured to push the target image sent by the pull flow module 120 to the algorithm module 130.
By setting the second message queue 520 and the third message queue 530, the scalability of the system can be improved, and other business parties can obtain related data from the second message queue 520 and the third message queue 530 conveniently.
It should be noted that the preset vehicle is a vehicle for performing a first task (e.g., a logistics task), the patrol task is an expansion task of the preset vehicle, and a vehicle-mounted camera for performing the patrol task is specially configured on the preset vehicle, that is, the patrol task is implemented by using the preset vehicle. Optionally, the vehicle resource service module 510, the static resource service module 410, the event management service module 430, the second message queue 520, and the first message queue 310 shown in fig. 5 are service modules configured for a first task of a preset vehicle, and the embodiment of the present disclosure implements intelligent patrol by multiplexing each service module, and has an advantage of low implementation cost.
Further, referring to a service architecture diagram shown in fig. 6, the service module and the pull module respectively include a plurality of service nodes 610, each service node 610 is configured to execute processing logic of the service module or the pull module, and when there is an online or offline service node, send a notification message to the vehicle resource service module 510; when the vehicle resource service module 510 receives the notification message, pushing vehicle resource data to the second message queue 520; the vehicle resource data is equally distributed to the service nodes 610 through the second message queue 520. When the vehicle resource data is updated, the vehicle resource service module pushes the updated vehicle resource data to the second message queue 520, so as to averagely allocate the updated vehicle resource data to the service nodes 610 through the second message queue 520.
If the algorithm module includes a plurality of algorithm nodes 620, the third message queue 530 is further configured to send a target image obtained based on a video stream captured by the same vehicle-mounted camera to the same algorithm node 620, so as to ensure detection accuracy of a target event. When the algorithm nodes 620 are increased or decreased, the third message queue 530 can perform rebalancing by itself, so as to ensure that each algorithm node 620 can be assigned to a task as much as possible.
In order to realize high availability of the service, the service module, the pull flow module and the algorithm module can adopt distributed deployment, and the service nodes can be dynamically and horizontally expanded. Data (such as vehicle data) generated when the service module and the stream pulling module operate can be stored in a database redis in a centralized manner, and when the algorithm module reports the target event, corresponding latest vehicle data is acquired from the redis. When the algorithm module reports the target event, the request is subjected to load balancing, no matter which service node is sent to, the current real-time data of the vehicle can be obtained, and then event splicing is completed.
The patrol system provided by the embodiment can conveniently expand the patrol function as long as the vehicle can report real-time data of the vehicle and provide the pull address of the camera, so that intelligent patrol is realized, and the patrol system has the advantage of low realization cost. Specifically, a special camera and a video stream pushing module are installed on the intelligent networked automobile, a stream pulling module is deployed at the cloud end and is responsible for pulling the video stream reported by the automobile end, the video stream is stored into an image according to a specified time interval, and an algorithm module is deployed at the cloud end and is responsible for carrying out image recognition, determining a target event and reporting the target event.
The scheme 1 discloses a patrol system which comprises a business module, a stream pulling module and an algorithm module which are respectively distributed at a cloud end;
the service module is used for acquiring vehicle data and sending the vehicle data to the pull flow module;
the stream pulling module is used for determining patrol operation according to the vehicle data, acquiring a video stream of a vehicle-mounted camera of a preset vehicle according to the vehicle data when the patrol operation is started or is recovered, processing the video stream to obtain a target image, and sending the target image to the algorithm module so as to execute a patrol task through the preset vehicle;
the algorithm module is used for detecting the target image so as to determine whether a target event occurs in the surrounding environment of the preset vehicle.
Scheme 2, the system of scheme 1, the pull module is according to vehicle data confirms patrol and operates, including:
and determining whether the position of the preset vehicle is a set patrol position or not according to the vehicle data, and if the position of the preset vehicle is the set patrol position, determining the patrol operation based on the operation configured corresponding to the set patrol position.
And in a scheme 3, according to the system in the scheme 2, if the position of the preset vehicle is the set patrol position, the stream pulling module is further configured to determine whether a course angle of the preset vehicle at the set patrol position is the set course angle according to the vehicle data, and if so, determine an operation configured corresponding to the set patrol position and the set course angle as the patrol operation.
Scheme 4, the system of scheme 1, further comprising: the video transfer service module is in communication connection with a stream pushing module installed on the preset vehicle and is used for receiving the video stream of the vehicle-mounted camera pushed by the stream pushing module;
correspondingly, the stream pulling module is used for acquiring the video stream of the vehicle-mounted camera of the preset vehicle from the video transit service module according to the vehicle data.
In the system according to claim 5 and 4, the stream pulling module processes the video stream to obtain a target image, including:
the stream pulling module intercepts image frames from the video stream as the target image according to a set frequency;
and the stream pulling module sends the target image to the algorithm module and sends the pulling time of the image frame pulled from the video transfer service module to the algorithm module at the same time.
According to the system in the scheme 6 and the scheme 5, when it is determined that a target event occurs in the surrounding environment of the preset vehicle, the algorithm module is further configured to obtain a timestamp of the target image based on an optical character recognition technology, determine the timestamp as the occurrence time of the target event if a difference between the timestamp and the pull time is smaller than a set threshold, and send the timestamp and the target event to the service module.
Scheme 7, the system of scheme 6, further comprising: correspondingly, the business module is further configured to determine vehicle real-time data of the preset vehicle, which corresponds to the timestamp, generate an event information packet based on the vehicle real-time data corresponding to the timestamp and the target event, and push the event information packet to the first message queue;
the first message queue is further configured to receive vehicle real-time data reported by the preset vehicle and send the vehicle real-time data to the service module, where the vehicle data includes the vehicle real-time data.
Scheme 8, the system of claim 7, further comprising: and the static resource service module is used for receiving the target image sent by the business module, wherein when the target event is determined to occur, the business module sends the target image to the static resource service module according to a specified rule.
Scheme 9, the system of scheme 8, further comprising: and the front end is in communication connection with the first message queue and is used for receiving and displaying the event information packet pushed by the first message queue and acquiring a corresponding target image from the static resource service module for displaying based on the event information packet.
Scheme 10, the system of claim 7, further comprising: and the event management service module is used for receiving the event information packet pushed by the first message queue and storing the event information packet.
In the system according to claim 11 or 10, the pull module is further configured to obtain the event information packet from the event management service module, and analyze information in the event information packet to obtain an analysis result;
if the occurrence time of the target event is determined to be within the first time period based on the analysis result, performing cluster analysis on the target event detected by different vehicles in the same trip to obtain the occurrence position of the target event in the same trip, and sending prompt information related to the occurrence position of the target event to the algorithm module in the second time period.
Scheme 12, the system of any of schemes 1-11, further comprising: the vehicle resource service module is used for sending vehicle resource data to the second message queue, and the vehicle data comprises the vehicle resource data;
the second message queue is used for pushing the vehicle resource data to the business module;
the service module and the stream pulling module respectively comprise a plurality of service nodes, each service node is used for executing the processing logic of the service module or the stream pulling module, and when a service node is on line or off line, a notification message is sent to the vehicle resource service module;
when the vehicle resource service module receives the notification message, pushing vehicle resource data to the second message queue;
and when the vehicle resource data are updated, the vehicle resource service module pushes the updated vehicle resource data to the second message queue so as to averagely distribute the updated vehicle resource data to the service nodes through the second message queue.
Scheme 13, the system of any of schemes 1-11, further comprising: the third message queue is respectively in communication connection with the stream pulling module and the algorithm module and is used for pushing the target image sent by the stream pulling module to the algorithm module;
if the algorithm module comprises a plurality of algorithm nodes, the third message queue is also used for sending target images obtained based on video streams shot by the same vehicle-mounted camera to the same algorithm node.
Scheme 14, the system according to any one of schemes 1 to 11, wherein the preset vehicle is a vehicle for performing a first task, the patrol task is an expansion task of the preset vehicle, and a vehicle-mounted camera for performing the patrol task is specially configured on the preset vehicle.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Claims (10)

1. A patrol system, comprising: the system comprises a business module, a stream pulling module and an algorithm module which are respectively arranged at the cloud end;
the service module is used for acquiring vehicle data and sending the vehicle data to the pull flow module;
the stream pulling module is used for determining patrol operation according to the vehicle data, acquiring a video stream of a vehicle-mounted camera of a preset vehicle according to the vehicle data when the patrol operation is started or is recovered, processing the video stream to obtain a target image, and sending the target image to the algorithm module so as to execute a patrol task through the preset vehicle;
the algorithm module is used for detecting the target image to determine whether a target event occurs in the surrounding environment of the preset vehicle.
2. The system of claim 1, wherein the pull module determines patrol operations from the vehicle data, comprising:
and determining whether the position of the preset vehicle is a set patrol position or not according to the vehicle data, and if the position of the preset vehicle is the set patrol position, determining the patrol operation based on the operation configured corresponding to the set patrol position.
3. The system of claim 2, wherein if the preset vehicle is located at a set patrol position, the wake module is further configured to determine whether a heading angle of the preset vehicle at the set patrol position is a set heading angle according to the vehicle data, and if so, determine an operation configured corresponding to the set patrol position and the set heading angle as the patrol operation.
4. The system of claim 1, further comprising: the video transfer service module is in communication connection with a stream pushing module installed on the preset vehicle and is used for receiving the video stream of the vehicle-mounted camera pushed by the stream pushing module;
correspondingly, the stream pulling module is used for acquiring the video stream of the vehicle-mounted camera of the preset vehicle from the video transit service module according to the vehicle data.
5. The system of claim 4, wherein the pull stream module processes the video stream to obtain a target image, comprising:
the stream pulling module intercepts image frames from the video stream as the target image according to a set frequency;
and the pull streaming module sends the target image to the algorithm module and sends the pull time from the video transfer service module to the image frame to the algorithm module.
6. The system of claim 5, wherein when it is determined that a target event occurs in the surrounding environment of the preset vehicle, the algorithm module is further configured to obtain a timestamp of the target image based on an optical character recognition technology, determine the timestamp as an occurrence time of the target event if a difference between the timestamp and the pull time is smaller than a set threshold, and send the timestamp and the target event to the service module.
7. The system of claim 6, further comprising: correspondingly, the business module is further configured to determine vehicle real-time data of the preset vehicle, which corresponds to the timestamp, generate an event information packet based on the vehicle real-time data corresponding to the timestamp and the target event, and push the event information packet to the first message queue;
the first message queue is further configured to receive vehicle real-time data reported by the preset vehicle and send the vehicle real-time data to the service module, where the vehicle real-time data includes the vehicle real-time data.
8. The system of claim 7, further comprising: and the static resource service module is used for receiving the target image sent by the business module, wherein when the target event is determined to occur, the business module sends the target image to the static resource service module according to a specified rule.
9. The system of claim 8, further comprising: and the front end is in communication connection with the first message queue and is used for receiving and displaying the event information packet pushed by the first message queue and acquiring a corresponding target image from the static resource service module for displaying based on the event information packet.
10. The system of claim 7, further comprising: and the event management service module is used for receiving the event information packet pushed by the first message queue and storing the event information packet.
CN202210701272.9A 2022-06-20 2022-06-20 Patrol system Active CN115273266B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210701272.9A CN115273266B (en) 2022-06-20 2022-06-20 Patrol system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210701272.9A CN115273266B (en) 2022-06-20 2022-06-20 Patrol system

Publications (2)

Publication Number Publication Date
CN115273266A true CN115273266A (en) 2022-11-01
CN115273266B CN115273266B (en) 2024-06-14

Family

ID=83760429

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210701272.9A Active CN115273266B (en) 2022-06-20 2022-06-20 Patrol system

Country Status (1)

Country Link
CN (1) CN115273266B (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105957347A (en) * 2016-06-16 2016-09-21 大连海事大学 Navigation-automobile-data-recorder-based detection method for illegal turning around of vehicle
WO2017219780A1 (en) * 2016-06-21 2017-12-28 中兴通讯股份有限公司 Tour inspection method and device for unmanned aerial vehicle, unmanned aerial vehicle, and computer storage medium
CN108417046A (en) * 2018-04-28 2018-08-17 上海与德科技有限公司 Driving behavior monitoring method, traffic monitoring method, apparatus, terminal and medium
CN108961768A (en) * 2018-07-30 2018-12-07 鄂尔多斯市普渡科技有限公司 The unmanned police cruiser of one kind and patrol method
CN109333504A (en) * 2018-12-05 2019-02-15 博众精工科技股份有限公司 A kind of patrol robot and patrol robot management system
CN109922068A (en) * 2019-03-13 2019-06-21 特斯联(北京)科技有限公司 Security protection patrol robot, security system and its secret communication method
CN110188717A (en) * 2019-06-03 2019-08-30 中国通信建设第四工程局有限公司 Image acquiring method and device
CN113467447A (en) * 2021-06-24 2021-10-01 武汉虹信技术服务有限责任公司 Illegal person intrusion monitoring system and method based on patrol robot
CN113469105A (en) * 2021-07-15 2021-10-01 恒大恒驰新能源汽车研究院(上海)有限公司 Method and device for monitoring surrounding vehicle and computer readable storage medium
US20210337250A1 (en) * 2018-05-25 2021-10-28 Wangsu Science & Technology Co., Ltd. A method and device for combining audio and video data streams
CN114067200A (en) * 2021-11-19 2022-02-18 上海微电机研究所(中国电子科技集团公司第二十一研究所) Intelligent inspection method of quadruped robot based on visual target detection

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105957347A (en) * 2016-06-16 2016-09-21 大连海事大学 Navigation-automobile-data-recorder-based detection method for illegal turning around of vehicle
WO2017219780A1 (en) * 2016-06-21 2017-12-28 中兴通讯股份有限公司 Tour inspection method and device for unmanned aerial vehicle, unmanned aerial vehicle, and computer storage medium
CN108417046A (en) * 2018-04-28 2018-08-17 上海与德科技有限公司 Driving behavior monitoring method, traffic monitoring method, apparatus, terminal and medium
US20210337250A1 (en) * 2018-05-25 2021-10-28 Wangsu Science & Technology Co., Ltd. A method and device for combining audio and video data streams
CN108961768A (en) * 2018-07-30 2018-12-07 鄂尔多斯市普渡科技有限公司 The unmanned police cruiser of one kind and patrol method
CN109333504A (en) * 2018-12-05 2019-02-15 博众精工科技股份有限公司 A kind of patrol robot and patrol robot management system
CN109922068A (en) * 2019-03-13 2019-06-21 特斯联(北京)科技有限公司 Security protection patrol robot, security system and its secret communication method
CN110188717A (en) * 2019-06-03 2019-08-30 中国通信建设第四工程局有限公司 Image acquiring method and device
CN113467447A (en) * 2021-06-24 2021-10-01 武汉虹信技术服务有限责任公司 Illegal person intrusion monitoring system and method based on patrol robot
CN113469105A (en) * 2021-07-15 2021-10-01 恒大恒驰新能源汽车研究院(上海)有限公司 Method and device for monitoring surrounding vehicle and computer readable storage medium
CN114067200A (en) * 2021-11-19 2022-02-18 上海微电机研究所(中国电子科技集团公司第二十一研究所) Intelligent inspection method of quadruped robot based on visual target detection

Also Published As

Publication number Publication date
CN115273266B (en) 2024-06-14

Similar Documents

Publication Publication Date Title
US11657718B2 (en) Method for controlling vehicle platoon, device, and internet of vehicles system
CN109993969B (en) Road condition judgment information acquisition method, device and equipment
CN113706737B (en) Road surface inspection system and method based on automatic driving vehicle
US8031084B2 (en) Method and system for infraction detection based on vehicle traffic flow data
GB2455837A (en) Co-operative camera surveillance method
US20220214684A1 (en) Monitoring center, monitoring system and method
EP4198944A1 (en) Roadside sensing system and traffic control method
CN110648533A (en) Traffic control method, equipment, system and storage medium
CN105187790B (en) Method, device and system for monitoring working state of vehicle-mounted terminal
CN107862883A (en) The fault detect and alarm of traffic lights and operation management system and implementation method
CN104243900A (en) Vehicle arrival time prediction system and method
CN111862593B (en) Method and device for reporting traffic events, electronic equipment and storage medium
CN112562407B (en) ODD state prejudging method and device and autonomous passenger-riding parking system
JP2022542641A (en) Methods and systems for dynamic event identification and dissemination
JP2019185366A (en) Information processing device, system, method, and computer program
CN112560546B (en) Method and device for detecting throwing behavior and storage medium
CN115273266B (en) Patrol system
CN103646563A (en) Method for sensing buses passing by fixed station
Pyykönen et al. Traffic monitoring and modeling for intersection safety
CN111368626B (en) Vehicle identification method, device, electronic equipment and storage medium
CN108470451A (en) A kind of intelligent transportation system based on big data
CN113012458A (en) Multi-point road side perception target state monitoring management method and system
JPWO2020213512A1 (en) Congestion information providing device, congestion information processing method and program
CN105448114A (en) Intelligent traffic intersection information system
CN113470213A (en) Data processing method and device, vehicle-mounted terminal equipment and server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant