CN110379126B - Passenger carrying operation vehicle monitoring system, device and medium - Google Patents
Passenger carrying operation vehicle monitoring system, device and medium Download PDFInfo
- Publication number
- CN110379126B CN110379126B CN201910698215.8A CN201910698215A CN110379126B CN 110379126 B CN110379126 B CN 110379126B CN 201910698215 A CN201910698215 A CN 201910698215A CN 110379126 B CN110379126 B CN 110379126B
- Authority
- CN
- China
- Prior art keywords
- vehicle
- monitoring
- module
- passenger
- driver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/012—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using recorded signals, e.g. speech
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/016—Personal emergency signalling and security systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Alarm Systems (AREA)
Abstract
The application discloses a passenger-carrying operation vehicle supervision system, a device and a medium. The system comprises a vehicle-mounted monitoring module, a vehicle-mounted monitoring module and a vehicle-mounted monitoring module, wherein the vehicle-mounted monitoring module is used for carrying out video monitoring and voice monitoring on an operating vehicle; the terminal control platform determines whether an abnormal condition occurs according to at least one type of information in the information provided by the passenger end, the information provided by the driver end and the monitoring data of the vehicle-mounted monitoring module; and the authority control module limits at least part of authority of the driver end if the terminal control platform determines that an abnormal condition occurs, and hands over the audiovisual interface authority of the vehicle-mounted monitoring module to a remote monitoring headquarter platform so as to control the risk of the monitoring headquarter platform. This application is through monitoring the operation vehicle, and when having abnormal conditions to take place, supplementary distal end's control headquarters platform intervenes and obtains the audio-visual interface authority of monitoring the operation vehicle, and then can know the scene directly perceivedly in time to take measures help the solution problem, this kind of supervision scheme can protect passenger and driver's interests more reliably.
Description
Technical Field
The application relates to the technical field of internet, in particular to a passenger carrying operation vehicle supervision system, a device and a medium.
Background
The popularization of taxis in cities brings great convenience to daily trips of people, in recent years, people similar to taxis are shown, but more flexible passenger carrying operation vehicles are operated, such as network car reservation, windward driving and the like, and the vehicles can cover sections and time periods where taxis are not easy to take, so that more requirements of people can be met.
In practical application, vehicles such as online taxi appointment and the like are not strongly supervised like taxis, a common driver only needs to register on a corresponding online platform and can operate through some relatively simple information auditing processes, and the online platform has less interference to the operation process of the online platform compared with a taxi company, and usually only has simple order information record for tracing.
The above-mentioned features of vehicles such as net appointment vehicles give the passengers and drivers greater flexibility, but at the same time involve risks, especially the drivers become mixed and the possibility of the safety of the passengers becomes greater, and of course there may be some illegal passengers who threaten the safety of the drivers.
Based on this, a more reliable supervision scheme is needed for vehicles such as net appointments.
Disclosure of Invention
The embodiment of the application provides a passenger carrying operation vehicle supervisory systems and equipment, medium for solve the following technical problem among the prior art: for vehicles such as net appointment vehicles, a more reliable supervision scheme is needed.
The embodiment of the application adopts the following technical scheme:
a passenger carrying operation vehicle supervision system comprises a vehicle-mounted monitoring module, a terminal control platform and a permission management and control module;
the vehicle-mounted monitoring module is used for carrying out video monitoring and voice monitoring on an operating vehicle;
the terminal control platform determines whether an abnormal condition occurs according to at least one type of information in information provided by a passenger end, information provided by a driver end and monitoring data of the vehicle-mounted monitoring module;
and the authority control module limits at least part of authority of the terminal if the terminal control platform determines that an abnormal condition occurs, and transfers the audio-visual interface authority of the vehicle-mounted monitoring module to a remote monitoring headquarter platform so as to facilitate the monitoring headquarter platform to carry out risk control.
Optionally, the vehicle-mounted monitoring module includes an in-vehicle monitoring shooting video module, an out-vehicle monitoring shooting video module, and an Artificial Intelligence (AI) face recognition module;
the in-vehicle monitoring shooting video module is used for carrying out video monitoring on the in-vehicle of an operating vehicle;
the vehicle exterior monitoring shooting video module is used for carrying out video monitoring on the exterior of the operating vehicle;
the artificial intelligence AI face recognition module at least recognizes the face in the video shot by the in-vehicle monitoring shooting video module so as to try to determine the corresponding identity information.
Optionally, the vehicle-mounted monitoring module includes a recording function module and an AI voice intercom module;
the recording function module is used for recording the operation vehicle;
the AI voice talkback module supports voice talkback with a communicated remote end in an operating vehicle.
Optionally, the method further comprises:
and the starting and closing triggering module is carried on the passenger end and/or the driver end and is used for starting and closing the vehicle-mounted monitoring module.
Optionally, the start-stop triggering module is mounted at the driver end, and starts or closes the vehicle-mounted monitoring module according to operation information of a meter-making timer of a driver for an operating vehicle; alternatively, the first and second electrodes may be,
the starting and closing triggering module is carried at the passenger end, and starts or closes the vehicle-mounted monitoring module according to the confirmation information aiming at the passengers for getting on or off the vehicle.
Optionally, if it is determined that an abnormal condition occurs and the terminal control platform decides that the abnormal condition needs to be alarmed, the terminal control platform automatically alarms the public security alarm system.
Optionally, the information provided by the passenger side for indicating that an abnormal condition occurs or the information provided by the driver side includes at least one of: telephone alarm record, one-key distress signal, abnormal operation information of a driver, positioning information and moving path information.
Optionally, the driver abnormal operation information includes at least one of: the driver of the vehicle-mounted monitoring module does not normally start information, and the driver of the vehicle-mounted monitoring module does not normally close information;
and if the terminal control platform determines that an abnormal condition occurs according to the abnormal operation information of the driver, the terminal control platform informs the monitoring headquarters platform to carry out risk control.
Optionally, the terminal control platform performs matching in a predetermined risk personnel database according to the video monitoring data of the vehicle-mounted monitoring module, and if a risk personnel is matched, it is determined that an abnormal condition occurs.
Optionally, the terminal control platform determines that an abnormal condition occurs if the duration of the monitored volume exceeding the standard exceeds a set threshold and/or monitors a predetermined sensitive word or phrase according to the voice monitoring data of the vehicle-mounted monitoring module.
A passenger operated vehicle surveillance device, comprising:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
carrying out video monitoring and voice monitoring on an operating vehicle;
determining whether an abnormal condition occurs according to at least one type of information in the information provided by the passenger side, the information provided by the driver side and the monitoring data;
and if the abnormal condition is determined, limiting at least part of authority of the computer end, and transferring the monitored audio-visual interface authority to a remote monitoring headquarter platform so as to facilitate the monitoring headquarter platform to carry out risk control.
A passenger operated vehicle surveillance non-volatile computer storage medium storing computer-executable instructions configured to:
carrying out video monitoring and voice monitoring on an operating vehicle;
determining whether an abnormal condition occurs according to at least one type of information in the information provided by the passenger side, the information provided by the driver side and the monitoring data;
and if the abnormal condition is determined, limiting at least part of authority of the computer end, and transferring the monitored audio-visual interface authority to a remote monitoring headquarter platform so as to facilitate the monitoring headquarter platform to carry out risk control.
The embodiment of the application adopts at least one technical scheme which can achieve the following beneficial effects: through monitoring the operation vehicle, when an abnormal condition occurs, the monitoring headquarters platform at the auxiliary remote end intervenes to obtain the audiovisual interface authority for monitoring the operation vehicle, so that the site can be visually and timely known, the problem can be solved by taking measures, and the monitoring scheme can more reliably protect the benefits of passengers and drivers.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 is a schematic block diagram of a supervisory system for a passenger operated vehicle provided by some embodiments of the present application;
fig. 2 is a detailed structural diagram of the supervisory system for passenger-carrying operation vehicles in fig. 1 in an application scenario provided by some embodiments of the present application;
fig. 3 is a schematic structural diagram of a passenger operating vehicle supervision device corresponding to fig. 1 according to some embodiments of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
To the problem in the background art, this application has provided a passenger carrying operation vehicle supervisory systems, the condition that can real time monitoring operation vehicle to can be mutual with the control headquarters platform of distal end, when having abnormal conditions to take place, in time inform and supplementary control headquarters platform and intervene the solution, thereby make the operation environment safer, help striking utilize the lawless persons who utilizes passenger carrying operation vehicles such as net car appointment to infringe on the interests of the law-keeping people, protect the law-keeping people, standardize the operation order. The passenger carrying operation vehicle can be a vehicle such as a net appointment vehicle, a shun feng vehicle and a taxi mentioned in the background technology, and can also be other vehicles such as a manned bus.
Fig. 1 is a schematic structural diagram of a supervisory system for a passenger-carrying operation vehicle according to some embodiments of the present application. The supervision system of the passenger carrying operation vehicle in fig. 1 comprises a vehicle-mounted monitoring module 100, a terminal control platform 102 and a permission management and control module 104; the vehicle-mounted monitoring module 100 is used for carrying out video monitoring and voice monitoring on an operating vehicle; the terminal control platform 102 determines whether an abnormal condition occurs according to at least one type of information in the information provided by the passenger side, the information provided by the driver side and the monitoring data of the vehicle-mounted monitoring module 100; and the authority control module 104, if the terminal control platform 102 determines that an abnormal condition occurs, limits at least part of authority of the driver end, and hands over the audiovisual interface authority of the vehicle-mounted monitoring module 100 to a remote monitoring headquarter platform so as to facilitate the monitoring headquarter platform to perform risk control. For simplicity, the module numbers are omitted in some embodiments below, and are referred to by module names only.
The scheme of the application mainly relates to a passenger end, a driver end and a remote monitoring headquarters platform. The passenger operating vehicle regulatory system may be on one or more of these three terminals, or may also be at least partially on other associated equipment. In an application scenario, a passenger end and a driver end respectively refer to taxi taking application clients used by a passenger and a driver, the passenger end can be mounted on a mobile phone of the passenger, the driver end can be mounted on the mobile phone of the driver or a vehicle machine for operating the vehicle, and a remote monitoring headquarters platform at least comprises a service end of the taxi taking application client and can also comprise other related service modules.
The vehicle-mounted monitoring module can be operated by a driver through a driver end or a remote monitoring headquarters platform, and the authority of each party to the vehicle-mounted monitoring module can be determined according to a preset safety strategy, wherein the authority can not be fixed or unchanged, for example, the authority can be intelligently adjusted according to a specific scene to adapt to the supervision requirement.
In practice, passengers are often more vulnerable parties than drivers, and thus, in order to improve the passenger's sense of safety, the passenger's end may be given the ability to gain access to the on-board monitoring module. For example, when a passenger gets into the vehicle and confirms to get on the vehicle (the passenger can be confirmed by the passenger end or the driver end), the passenger end automatically obtains the authority of the vehicle-mounted monitoring module, based on the authority, the audio-visual interface of the vehicle-mounted monitoring module can be automatically synchronized to the passenger end, and the passenger can share the audio-visual interface with family and friends to watch the audio-visual interface, so that the family and friends can timely know the current riding state of the passenger, and can intervene in help once an abnormal condition occurs. The passenger end can automatically detect whether the vehicle-mounted monitoring module works normally, and if not, the passenger end can warn the passenger to further confirm the reason due to the fact that the passenger possibly intervenes maliciously by an illegal driver, and can also inform a remote monitoring headquarters platform to perceive and cope with the abnormal behaviors of the illegal driver in time, so that risk control can be carried out.
The vehicle-mounted monitoring module can continuously shoot monitoring videos for operating vehicles and continuously record monitoring voice. More intelligently, under the support of a corresponding machine learning algorithm, the vehicle-mounted monitoring module can also analyze the shot video and the recorded voice, extract the required characteristics and further make intelligent decisions. For example, characters in a video, interactive actions between the characters, events near an operating vehicle, and the like are recognized, conversation contents, sounds, and the like in voice are recognized, and then whether the normal situation or the abnormal situation is determined intelligently according to the recognition result. Of course, these analysis decision-making operations can also be performed by the terminal control platform, which can be located at any of the above three terminals.
Besides the monitoring data of the vehicle-mounted monitoring module, the information provided by the passenger side and the information provided by the driver side can also be used as the judgment basis for judging whether the abnormal condition exists. These provided information may be, for example: telephone alarm record, one-key distress signal, abnormal operation information of a driver, positioning information, moving path information and the like.
Taking a telephone alarm record as an example, a public alarm telephone number in China is "110", after a passenger gets on a car, whether the current telephone of "110" is dialed is monitored in real time through a call record provided by a passenger end and a driver end, if so, the passenger or the driver is known to try to alarm, the abnormal situation can be determined, and it needs to be explained that, in order to protect the privacy of the user, the access authority to the call record can be limited, for example, only a terminal control platform is allowed to obtain the access authority for the call record of specific public numbers such as "110" and "120".
Taking the driver abnormal operation information as an example, the driver abnormal operation information may be, for example, driver abnormal start information of the vehicle-mounted monitoring module, driver abnormal close information of the vehicle-mounted monitoring module, and vehicle-taking order early-end information, which may be provided by the driver side, and according to the information, it may be detected that the driver does not start the vehicle-mounted monitoring module, or closes the vehicle-mounted monitoring module in advance, or ends the vehicle-taking order if the driver does not reach the destination, and it may be determined that the driver abnormal operation information belongs to the abnormal condition.
Further, taking the moving route information as an example, if it is detected that the moving route deviates unreasonably from the predetermined route to the destination based on the moving route information provided from the passenger side or the driver side, it is determined that this is an abnormal situation, where unreasonable conditions include, for example, the need to significantly detour to reach the destination, unnecessary travel to a remote place, and the like.
After the abnormal condition is determined to occur, at least part of authority of a driver end can be limited (the reason is that in practical application, an operation vehicle is directly controlled by a driver, and cases of the driver invading the benefits of passengers are most), for example, the authority of operating a current taxi taking order, the authority of operating an audio-visual interface of an on-board monitoring module and the like are beneficial to preventing the field condition from further developing towards a direction which is difficult to control. The remote monitoring headquarters platform acquires the audiovisual interface permission of the vehicle-mounted monitoring module, at the moment, the audiovisual interface can be displayed on the monitoring headquarters platform, and the staff of the monitoring headquarters platform decides the countermeasures according to the real-time content of the audiovisual interface, wherein the countermeasures can be: and an alarm and help seeking traffic management department assists in intercepting operating vehicles, directly calls passengers or drivers to communicate and the like.
In the system of fig. 1, by monitoring the operating vehicle, when an abnormal condition occurs, the monitoring headquarters platform at the auxiliary remote end intervenes to obtain the audiovisual interface authority of the monitoring operating vehicle, so that the site can be known visually and timely to take measures to help solve the problem, and the monitoring scheme can more reliably protect the benefits of passengers and drivers.
Based on the system of fig. 1, some embodiments of the present application also provide some specific schemes that the system can perform, and related extension schemes, which are described below.
The vehicle-mounted monitoring module is mounted on an operating vehicle and can be started and closed through the starting and closing triggering module. If the starting and closing triggering module is carried at the driver end, the vehicle-mounted monitoring module can be started or closed according to the operation information of the meter-making timer of the driver aiming at the operating vehicle; or the starting and closing triggering module is carried at the passenger end, and the vehicle-mounted monitoring module is started or closed according to the confirmation information aiming at the passengers for getting on or off the vehicle. For example, it is assumed that both the passenger side and the driver side are equipped with a start-stop triggering module, after a passenger gets on the vehicle, the passenger or the driver clicks a key indicating that the passenger confirms getting on the vehicle to trigger the start-stop triggering module to start the vehicle-mounted monitoring module, and if a meter-striking timer is provided on the operating vehicle and is previously associated with the driver side, the driver can start striking the meter to trigger the start-stop triggering module to start the vehicle-mounted monitoring module.
If the terminal control platform determines that no abnormal condition occurs, the related information can be stored in the cloud platform and used as historical data of the platform for use when needed. When the terminal control platform determines that an abnormal condition exists, the terminal control platform can also intelligently contact third-party organizations such as a public security bureau, a traffic management department and the like to request help. For example, the terminal control platform can communicate with a public security alarm system, and if the abnormal decision condition reaches the alarm requirement degree, the terminal control platform can automatically alarm the public security alarm system in time.
The abnormal conditions are mentioned in many places, and the specific conditions can be defined in advance, and can be adapted to the capability of the supervision system of the passenger operation vehicle to define the abnormal conditions so that the supervision system of the passenger operation vehicle can identify and process the abnormal conditions.
In practical applications, the more common abnormal situations include three main categories: firstly, clear disputes occur between the driver and the passenger, including quarrel or even fighting; secondly, the driver and the passenger do not have an open dispute, but one party has an unscrupulous attempt or potential danger; and thirdly, driving accidents.
Most of the three types of abnormal conditions can be determined by performing video monitoring and voice monitoring on an operating vehicle, and for the second type of abnormal conditions, some auxiliary information may be needed to more accurately determine the abnormal conditions. The following is a specific analysis.
For video monitoring, videos can be shot inside and outside an operating vehicle, and whether abnormal conditions occur or not can be determined by intelligently recognizing the shot videos. For example, a human face, human body actions, an external environment of the vehicle and the like can be recognized based on a machine learning algorithm, under a normal condition, a driver drives the vehicle stably, passengers sit stably, most of video images are relatively static, in a riding process, if the passengers compete with the driver, some body actions exist, and whether abnormal conditions occur or not is determined by detecting the body actions in the video. Similarly, if a driving accident occurs, the state in the vehicle may change suddenly, for example, the picture shakes sharply, the goods are misplaced, the vehicle cabin is deformed, the passengers and the driver are even thrown out of the seat, etc., and the abnormal situation is determined by detecting the driving environment change in the video.
For voice monitoring, whether disputed or driving accidents occur, corresponding human voice and environmental sound can be generated, and whether abnormal conditions occur can be determined by recognizing voice content and environmental sound and detecting sound intensity in a vehicle. For example, in a dispute, the sound in the car may become loud, the volume may increase significantly, and the parties may abuse the opponent or ask for help with certain words, or ask for help directly with a call. Based on the above, it can be determined that an abnormal condition occurs if the duration of the volume exceeding the standard is monitored to exceed a set threshold and/or a predetermined sensitive word (a word for abusive persons) is monitored according to the voice monitoring data of the vehicle-mounted monitoring module.
For the second type of abnormal situation, if the driver or the passenger is a risk person (e.g., wanted person, driver blacked out by platform, driver without corresponding driving qualification, driver complained by multiple passengers, passenger complained by multiple drivers, etc.) who is already recorded on the case, face recognition matching can be performed according to the corresponding risk person database to determine whether there is a risk person who is considered to be potentially dangerous.
For persons with derailment attempts, it is possible to find the terminal through video monitoring, which mainly includes some abnormal actions of passengers or drivers, such as passengers drinking wine in the vehicle, fiddling with instruments, drivers moving off the normal path, small actions disturbing passengers, etc. By using the monitoring data, the possibility of timely detecting the derailed attempted person can be improved in cooperation with other relevant information (such as the historical taxi taking record of the passenger, the driving operation record of the driver and the like) which can be provided by the passenger side and the driver side.
According to the above description, some embodiments of the present application provide a detailed structural diagram of the supervisory system of the passenger carrying operation vehicle in fig. 1 in an application scenario, as shown in fig. 2.
In fig. 2, the vehicle-mounted monitoring module 100 includes an in-vehicle monitoring shooting video module 1000, an out-vehicle monitoring shooting video module 1002, an AI face recognition module 1004, and the like, which are related to video monitoring; the in-vehicle monitoring shooting video module 1000 is used for carrying out video monitoring on the in-vehicle of an operating vehicle; the vehicle exterior monitoring shooting video module 1002 is used for carrying out video monitoring on the exterior of the operating vehicle; and the AI face recognition module is used for recognizing the face at least in the video shot by the in-vehicle monitoring shooting video module so as to try to determine corresponding identity information (such as whether the person is a risk person, whether the person is the user for placing an order, whether the driver of the operating vehicle is driving, and the like).
The vehicle-mounted monitoring module 100 further comprises a recording function module 1006, an AI voice intercom module 1008 and the like related to voice monitoring; the recording function module 1006 records the operation vehicle; the AI voice intercom module 1008 supports voice intercom with a communicated remote end in an operating vehicle. After the monitoring headquarters platform at the far end obtains the audiovisual interface authority of the vehicle-mounted monitoring module, on one hand, the field situation can be visually seen and heard, and on the other hand, the AI voice intercom module 1008 can be used for communicating with a driver and passengers in real time, so that the monitoring effects of further understanding problems, adjusting contradictions, negotiating conditions, deterring illegal behaviors and the like can be realized.
In some embodiments of the present application, if it is determined that an abnormal condition occurs, the terminal control platform generates a help task, and may broadcast the help task to other operating vehicles near the operating vehicle in which the abnormal condition occurs, and request the other operating vehicles to participate in executing the help task, where the execution measure may be, for example: the system can directly go to the site to help, assist nearby police dispatch, remotely connect the operating vehicle with abnormal conditions to talk back, transport the personnel on the operating vehicle with abnormal conditions, and the like. In order to improve the safety of the drivers participating in the help task, for example, a plurality of other operating vehicles may be aggregated to go to the site together based on the help task, considering that the abnormal situation may be dangerous. Also, drivers participating in the performance of help tasks may be given attractive rewards, such as financial rewards, honor title rewards, etc., in order to increase the motivation of other drivers.
In some embodiments of the present application, the authority management and control module may be further associated with a driving control system of an operating vehicle, and even the authority management and control module may be allowed to intervene to forcibly obtain driving control authority of the operating vehicle in case of a specific abnormal condition. For example, when an abnormal situation that the driver is determined to coerce the passenger and bring the passenger to a remote direction occurs, the operating vehicle can be automatically forced to be controlled, the passenger can be helped to get out of the trouble or the intention of the driver can be prevented, and specific measures for forcing the operating vehicle to be controlled can include: the vehicle speed is reduced, even the vehicle is forcibly stopped, double flashing and whistling are started, the vehicle door is unlocked, and the like. These specific measures may be adapted to the field environment and may be selectively performed, for example, if the operating vehicle is currently at a high speed, it is dangerous to forcibly stop the vehicle, and the vehicle speed may be gradually reduced to give the following vehicle reaction time.
Fig. 3 is a schematic structural diagram of a passenger operating vehicle supervision device corresponding to fig. 1 provided in some embodiments of the present application, the device including:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
carrying out video monitoring and voice monitoring on an operating vehicle;
determining whether an abnormal condition occurs according to at least one type of information in the information provided by the passenger side, the information provided by the driver side and the monitoring data;
and if the abnormal condition is determined, limiting at least part of authority of the computer end, and transferring the monitored audio-visual interface authority to a remote monitoring headquarter platform so as to facilitate the monitoring headquarter platform to carry out risk control.
Some embodiments of the present application provide a passenger operated vehicle surveillance non-volatile computer storage medium corresponding to fig. 1 having stored thereon computer-executable instructions configured to:
carrying out video monitoring and voice monitoring on an operating vehicle;
determining whether an abnormal condition occurs according to at least one type of information in the information provided by the passenger side, the information provided by the driver side and the monitoring data;
and if the abnormal condition is determined, limiting at least part of authority of the computer end, and transferring the monitored audio-visual interface authority to a remote monitoring headquarter platform so as to facilitate the monitoring headquarter platform to carry out risk control.
The embodiments in the present application are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the device and media embodiments are substantially similar to the system embodiments and therefore are described in a relatively simple manner, where relevant, reference may be made to some of the descriptions of the system embodiments.
The device and the medium provided by the embodiment of the application correspond to the system, and therefore, the device and the medium also have beneficial technical effects similar to the corresponding system.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (6)
1. A passenger carrying operation vehicle supervision system is characterized by comprising a vehicle-mounted monitoring module, a terminal control platform and an authority management and control module;
the vehicle-mounted monitoring module is used for carrying out video monitoring and voice monitoring on an operating vehicle; the control authority of the vehicle-mounted monitoring module is determined according to a preset safety strategy, and the preset safety strategy at least comprises the following steps: after the passengers are confirmed to get on the bus, the passenger side automatically obtains the authority of the vehicle-mounted monitoring module, based on the authority of the passenger side and the vehicle-mounted monitoring module, an audio-visual interface of the vehicle-mounted monitoring module is automatically synchronized to the passenger side, the passenger side has the function of sharing the audio-visual interface to other terminal equipment, and the passenger side has the function of automatically detecting whether the vehicle-mounted monitoring module is normal or not; the passenger end and the driver end are both provided with a start-stop triggering module, and after a passenger gets on the vehicle, the passenger or the driver clicks a key for confirming getting on the vehicle so as to trigger the start-stop triggering module to start the vehicle-mounted monitoring module;
the terminal control platform determines whether an abnormal condition occurs according to information provided by a passenger end, information provided by a driver end and monitoring data of the vehicle-mounted monitoring module; the authority control module limits at least part of authority of the terminal if the terminal control platform determines that an abnormal condition occurs, and transfers the audio-visual interface authority of the vehicle-mounted monitoring module to a remote monitoring headquarter platform so that the monitoring headquarter platform can carry out risk control; at least part of the authority of the driver end comprises: the authority of operating the current taxi taking order and the authority of operating the audio-visual interface of the vehicle-mounted monitoring module; after the far-end monitoring headquarter platform obtains the audiovisual interface authority of the vehicle-mounted monitoring module, on one hand, the field situation is visually seen and heard, on the other hand, the AI voice intercom module in the vehicle-mounted monitoring module is communicated with a driver and passengers in real time, the AI voice intercom module does not depend on far-end personnel, but intelligently and automatically adapts to a scene, and the dialogue is carried out with the personnel in the vehicle or the far-end personnel;
the video monitoring is to shoot videos inside and outside the operating vehicle, identify human faces, limb actions of people and environment outside the operating vehicle based on a machine learning algorithm, and determine whether abnormal conditions occur or not by detecting the limb actions in the videos when passengers and drivers compete for each other; when a driving accident occurs, the state in the vehicle can be changed instantly and violently, and whether an abnormal condition occurs or not is determined by detecting the driving environment change in the video; the video monitoring can provide the historical taxi taking record of the passenger or the driving operation record of the driver by monitoring some abnormal actions of the passenger or the driver in cooperation with the passenger end and the driver end, so that the possibility of timely detecting the derailed attempted person is improved;
the voice monitoring is that according to the voice monitoring data of the vehicle-mounted monitoring module, if the duration time that the volume exceeds the standard is monitored to exceed a set threshold value and/or a preset sensitive word or sentence is monitored, an abnormal condition is determined to occur;
if the terminal control platform determines that the abnormal condition occurs, a help task is generated, the help task is broadcasted to other operation vehicles nearby the operation vehicle with the abnormal condition, the other operation vehicles are requested to participate in executing the help task, and the execution measures comprise at least one of the following measures: directly go to the site to help, assist nearby operation vehicles to send out police, remotely connect operation vehicles with abnormal conditions to talk and transport the personnel on the operation vehicles with abnormal conditions; aggregating a plurality of other operating vehicles to go to the scene together based on the help task, and giving attractive rewards to drivers participating in the help task;
the information provided by the passenger side or the information provided by the driver side for indicating the occurrence of the abnormal condition comprises: driver abnormal operation information; the driver abnormal operation information includes at least one of: the driver of the vehicle-mounted monitoring module does not normally start information, and the driver of the vehicle-mounted monitoring module does not normally close information;
the information provided by the passenger end used for indicating the occurrence of abnormal conditions or the information provided by the driver end also comprises a telephone alarm record, after a passenger gets on the bus, whether the current telephone of the public alarm telephone number is dialed out is monitored in real time through the call records provided by the passenger end and the driver end, if yes, the passenger or the driver is known to try to alarm, the abnormal conditions are determined, and only the terminal control platform is allowed to acquire the access authority for the call record of the public alarm telephone number.
2. The system of claim 1, wherein the on-board monitoring module comprises an in-vehicle monitoring shooting video module, an out-vehicle monitoring shooting video module, an artificial intelligence AI face recognition module;
the in-vehicle monitoring shooting video module is used for carrying out video monitoring on the in-vehicle of an operating vehicle;
the vehicle exterior monitoring shooting video module is used for carrying out video monitoring on the exterior of the operating vehicle;
the AI face recognition module recognizes a face at least in the video shot by the in-vehicle monitoring shooting video module to try to determine corresponding identity information.
3. The system of claim 1, wherein the in-vehicle monitoring module comprises a recording function module;
the recording function module records the sound in the operating vehicle.
4. The system of claim 1, wherein the terminal control platform automatically alarms to a public security alarm system if it is determined that an abnormal situation occurs and the decision is the abnormal situation requiring alarm.
5. The system of claim 1, wherein the information provided by the passenger side or the information provided by the driver side for indicating the occurrence of an abnormal condition further comprises at least one of: one-key distress signal, positioning information and moving path information.
6. The system of claim 1, wherein the terminal control platform performs matching in a predetermined risk personnel database according to the video monitoring data of the vehicle-mounted monitoring module, and determines that an abnormal situation occurs if risk personnel are matched.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910698215.8A CN110379126B (en) | 2019-07-31 | 2019-07-31 | Passenger carrying operation vehicle monitoring system, device and medium |
| PCT/CN2019/102120 WO2021017057A1 (en) | 2019-07-31 | 2019-09-02 | Passenger-carrying operating vehicle supervision system and device, and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910698215.8A CN110379126B (en) | 2019-07-31 | 2019-07-31 | Passenger carrying operation vehicle monitoring system, device and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110379126A CN110379126A (en) | 2019-10-25 |
| CN110379126B true CN110379126B (en) | 2020-11-06 |
Family
ID=68257199
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910698215.8A Active CN110379126B (en) | 2019-07-31 | 2019-07-31 | Passenger carrying operation vehicle monitoring system, device and medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110379126B (en) |
| WO (1) | WO2021017057A1 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111008586A (en) * | 2019-11-29 | 2020-04-14 | 上海能塔智能科技有限公司 | Data processing method, device, equipment and storage medium for passenger car conflict detection |
| CN111862580A (en) * | 2020-06-14 | 2020-10-30 | 李建华 | Network car booking safety protection system based on intelligent identification and big data |
| CN111669397A (en) * | 2020-06-15 | 2020-09-15 | 北京趣拿信息技术有限公司 | Target event processing method and device, storage medium and electronic device |
| CN111913486B (en) * | 2020-08-05 | 2022-01-25 | 三一专用汽车有限责任公司 | Operation system, engineering vehicle, remote operation subsystem and control method |
| CN112286482A (en) * | 2020-10-28 | 2021-01-29 | 广州小鹏汽车科技有限公司 | Riding atmosphere rendering method and device, electronic equipment and storage medium |
| CN112462745A (en) * | 2020-12-01 | 2021-03-09 | 南京领行科技股份有限公司 | Vehicle machine equipment and information processing method |
| CN112992372A (en) * | 2021-03-09 | 2021-06-18 | 深圳前海微众银行股份有限公司 | Epidemic situation risk monitoring method, device, equipment, storage medium and program product |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105185100A (en) * | 2015-09-24 | 2015-12-23 | 天津诗辰科技有限公司 | Vehicle monitoring and managing system |
| CN105243838B (en) * | 2015-11-09 | 2018-05-04 | 北京奇虎科技有限公司 | Vehicle driving safety monitoring method and device, system |
| JP6402787B2 (en) * | 2017-01-27 | 2018-10-10 | 日本電気株式会社 | Monitoring system, monitoring center device, mounted device, monitoring method, processing method, program |
| CN107332875A (en) * | 2017-05-27 | 2017-11-07 | 上海与德科技有限公司 | A kind of net about car monitoring method and system, cloud server |
| CN207425102U (en) * | 2017-08-15 | 2018-05-29 | 陕西导航科技有限公司 | Intelligent vehicle mounted terminal device |
| CN208569839U (en) * | 2018-07-06 | 2019-03-01 | 深圳卡安兴科技有限公司 | A kind of abnormal behavior alarm system based on vehicle-mounted camera |
| CN109398230A (en) * | 2018-08-30 | 2019-03-01 | 杨子午 | Passenger personal security means of defence and system |
| CN108986400A (en) * | 2018-09-03 | 2018-12-11 | 深圳市尼欧科技有限公司 | A kind of third party based on image procossing, which multiplies, drives safety automatic-alarming method |
| CN108877146A (en) * | 2018-09-03 | 2018-11-23 | 深圳市尼欧科技有限公司 | It is a kind of that safety automatic-alarming devices and methods therefor is driven based on multiplying for intelligent sound identification |
| CN109711920A (en) * | 2018-11-05 | 2019-05-03 | 界首市菁华科技信息咨询服务有限公司 | A kind of net about vehicle safety monitoring system |
-
2019
- 2019-07-31 CN CN201910698215.8A patent/CN110379126B/en active Active
- 2019-09-02 WO PCT/CN2019/102120 patent/WO2021017057A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| CN110379126A (en) | 2019-10-25 |
| WO2021017057A1 (en) | 2021-02-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110379126B (en) | Passenger carrying operation vehicle monitoring system, device and medium | |
| CN108810101B (en) | Network vehicle service supervision method and platform for guaranteeing passenger safety | |
| US9679210B2 (en) | Using passive driver identification and other input for providing real-time alerts or actions | |
| CN109711920A (en) | A kind of net about vehicle safety monitoring system | |
| US20160112461A1 (en) | Collection and use of captured vehicle data | |
| US20140343785A1 (en) | Automobile monitoring for operation analysis | |
| CN105049785A (en) | Vehicle driving safety monitoring terminal, system and method | |
| CN108423003A (en) | A kind of driving safety monitoring method and system | |
| CN111598368B (en) | Risk identification method, system and device based on stop abnormality after stroke end | |
| CN110751530B (en) | Identity information security verification method, server, passenger end and driver end | |
| CN109712379B (en) | Riding safety alarm method and device | |
| CN208314982U (en) | A kind of intelligent alarm system of taxi and net about vehicle | |
| CN110217187B (en) | Vehicle collision processing method and device, HUD device and storage medium | |
| DE102020122757A1 (en) | SYSTEMS AND PROCEDURES FOR RIDE OPPORTUNITIES USING BLOCKCHAIN | |
| US20070282519A1 (en) | System and method for analyzing traffic disturbances reported by vehicles | |
| JP7160454B2 (en) | Method, apparatus and system, electronic device, computer readable storage medium and computer program for outputting information | |
| CN110379107A (en) | A kind of public transport travel safety ensuring system and method | |
| CN111210620A (en) | Method, device and equipment for generating driver portrait and storage medium | |
| CN112381677A (en) | Community management method, community management device and Internet of things intelligent box | |
| CN113240920A (en) | Vehicle passing method and device, authentication server and emergency rescue system | |
| CN108674352B (en) | Communication apparatus and communication system | |
| WO2019126408A1 (en) | Rideshare safety system | |
| CN113763189A (en) | Intelligent vehicle-mounted behavior detection and reporting system based on AI technology | |
| CN111225033A (en) | Vehicle management method, device, equipment and storage medium | |
| CN112365627A (en) | Driving recording method and device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |