CN113043982A - Vehicle and control method and device thereof - Google Patents
Vehicle and control method and device thereof Download PDFInfo
- Publication number
- CN113043982A CN113043982A CN201911368937.3A CN201911368937A CN113043982A CN 113043982 A CN113043982 A CN 113043982A CN 201911368937 A CN201911368937 A CN 201911368937A CN 113043982 A CN113043982 A CN 113043982A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- passenger
- getting
- children
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
- B60R21/015—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
- B60R21/01512—Passenger detection systems
- B60R21/0153—Passenger detection systems using field detection presence sensors
- B60R21/01538—Passenger detection systems using field detection presence sensors for image processing, e.g. cameras or sensor arrays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R2021/003—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks characterised by occupant or pedestian
- B60R2021/006—Type of passenger
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Emergency Alarm Devices (AREA)
Abstract
The application provides a vehicle and a control method and a control device thereof, wherein the method comprises the following steps: monitoring images at the door of the passenger compartment to obtain a monitoring image; the vehicle door comprises a space between the vehicle door and the vehicle body when the vehicle door is in an open state; respectively carrying out boarding and disembarking state identification and passenger type identification on the monitoring image so as to acquire a first image of boarding of a passenger and a second image of disembarking of the passenger through the boarding and disembarking state identification, and acquiring children in the passenger through the passenger type identification; acquiring a first number of getting-on children and a second number of getting-off children in passengers through a target deep learning model; detecting the car locking control instructions, and determining that children are left in the car according to the first quantity and the second quantity when the car locking control instructions are detected; the control vehicle does not execute the locking control instruction and sends the reminding information to realize that whether children are left in the vehicle or not is judged through the number of the children getting on the vehicle and the number of the children getting off the vehicle, and the children are effectively prevented from being left in the closed vehicle.
Description
Technical Field
The invention relates to the technical field of vehicles, in particular to a vehicle and a control method and device thereof.
Background
In recent years, tragedies have occurred in which many children are locked in the car. Research shows that when the temperature is 30 ℃ outdoors, the temperature in the vehicle can be rapidly increased to 41 ℃ within 10 minutes. Even at an outdoor temperature of 20 ℃, the temperature in the vehicle can reach 46 ℃ when the vehicle stays outdoors for one hour. The children are not fully developed, the body temperature rises and the water loss speed in the body is higher than that of adults, the respiratory system and the heat resistance are not as good as that of adults, and the children are more prone to lesion and even death in a compartment without ventilation. Therefore, detection of a child left behind in a car is particularly important.
Disclosure of Invention
The present invention is directed to solving, at least to some extent, one of the technical problems in the related art.
Therefore, a first object of the present invention is to provide a control method for a vehicle, so as to determine whether a child remains in the vehicle according to the number of children getting on the vehicle and the number of children getting off the vehicle, thereby effectively preventing the child from being left in the closed vehicle.
A second object of the present invention is to provide a control device for a vehicle.
A third object of the invention is to propose a vehicle.
A fourth object of the invention is to propose a computer-readable storage medium.
To achieve the above object, an embodiment of a first aspect of the present invention provides a control method for a vehicle, including: the method comprises the following steps: monitoring images at the door of the passenger compartment to obtain a monitoring image; the vehicle door comprises a space between the vehicle door and a vehicle body when the vehicle door is in an open state; respectively carrying out boarding and disembarking state identification and passenger type identification on the monitoring images so as to acquire a first image for passengers to board and a second image for passengers to board through the boarding and disembarking state identification, and acquiring children in the passengers through the passenger type identification; counting a first number of children getting on and a second number of children getting off of the passengers; detecting a vehicle locking control command, and determining that children are left in the vehicle according to the first quantity and the second quantity when the vehicle locking control command is detected; and controlling the vehicle not to execute the vehicle locking control instruction and sending reminding information.
According to an embodiment of the present invention, the identifying the getting-on/off state of the monitoring image includes: identifying the position of the passenger in the monitoring image, and determining that the passenger is in an getting-on state or a getting-off state; and taking the monitoring image of the passenger in the boarding state as the first image, and taking the monitoring image of the passenger in the alighting state as the second image.
According to an embodiment of the present invention, the identifying the position of the passenger in the monitoring image and determining whether the passenger is in the boarding state or the alighting state includes: respectively extracting the passenger positions in the monitoring images adjacent in time sequence; and determining that the passenger is in an getting-on state or a getting-off state according to the moving direction of the position.
According to an embodiment of the present invention, the passenger type identification of the monitoring image includes: and identifying the passenger type in the monitoring image through a target deep learning model, and determining the child in the monitoring image.
According to an embodiment of the present invention, the determining that a child is left in the vehicle according to the first number and the second number includes: identifying that the first number is greater than the second number.
According to an embodiment of the present invention, after the controlling vehicle does not execute the vehicle locking control command and sends a reminding message, the method further includes: judging whether a control releasing instruction is received within preset time or not; and if so, executing the vehicle locking control command.
According to an embodiment of the present invention, the control method of a vehicle further includes: and when the control releasing instruction is not received within the preset time, starting the remote communication system, and sending emergency reminding information to the emergency contact through the remote communication system.
According to the vehicle control method provided by the embodiment of the invention, the number of the children getting on the vehicle and the number of the children getting off the vehicle in the passenger compartment can be obtained and judged by identifying the passenger compartment monitoring image, whether the children are left in the vehicle is identified, the accuracy of child detection is effectively improved, and the danger that the children are left in the vehicle is reduced.
To achieve the above object, an embodiment of a second aspect of the present invention provides a control apparatus for a vehicle, including: the monitoring module is used for carrying out image monitoring on the door of the passenger compartment to obtain a monitoring image; the vehicle door comprises a space between the vehicle door and a vehicle body when the vehicle door is in an open state; the identification module is used for respectively carrying out getting-on and getting-off state identification and passenger type identification on the monitoring image, so that a first image for getting on a passenger and a second image for getting off the passenger are obtained through the getting-on and getting-off state identification, and children in the passenger are obtained through the passenger type identification; the counting module is used for acquiring a first number of children getting on the bus and a second number of children getting off the bus; the judging module is used for detecting the vehicle locking control command, and determining that children are left in the vehicle according to the first quantity and the second quantity when the vehicle locking control command is detected; and the control module is used for controlling the vehicle not to execute the vehicle locking control instruction and sending reminding information.
In order to achieve the above object, a third aspect of the present invention provides a vehicle including the control apparatus of the vehicle.
In order to achieve the above object, a fourth aspect of the present invention proposes a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the control method of the vehicle.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a flowchart of a control method of a vehicle of an embodiment of the invention;
FIG. 2 is a flowchart of a control method of a vehicle according to one embodiment of the invention;
fig. 3 is a flowchart of a control method of a vehicle according to another embodiment of the invention;
FIG. 4 is a flowchart of a control method of a vehicle according to an embodiment of the invention;
fig. 5 is a block diagram of a control apparatus of a vehicle according to an embodiment of the invention;
fig. 6 is a block schematic diagram of a vehicle according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
It should be noted that tragedy problems caused by children leaving behind cars have been of great concern. In the related art, the child remaining detection is usually performed by means of infrared recognition, detection of crying of children, and the like. However, the infrared detection technology has low accuracy and high false alarm rate, and the detection of crying of children can be disabled when the children are in a sleeping state or have unconscious consciousness and lose consciousness.
Based on this, this application has proposed a vehicle and control method and device thereof.
A vehicle and a control method and apparatus thereof according to an embodiment of the invention are described below with reference to the drawings.
Fig. 1 is a flowchart of a control method of a vehicle according to an embodiment of the present invention. As shown in fig. 1, a control method of a vehicle according to an embodiment of the present invention includes the steps of:
s101: and monitoring images of the door of the passenger compartment to obtain a monitoring image.
The vehicle door comprises a space between the vehicle door and the vehicle body when the vehicle door is in an open state. It should be understood that the passengers need to get on and off the vehicle in the open state of the vehicle door, and the passengers cannot get on and off the vehicle when the vehicle door is closed. Therefore, monitoring at the door of the passenger compartment also needs to be performed during the vehicle passenger compartment opening of the door, i.e., the monitoring at the door of the passenger compartment is started after recognizing that the door opening signal is acquired, and is stopped when recognizing that the door has been closed. Moreover, the space between the vehicle door and the vehicle body is limited when the vehicle door is opened, and noise data of pedestrians far away from the vehicle and noise data generated by seat replacement of passengers in the vehicle are avoided.
Preferably, the wide-angle camera is disposed on the inner wall of the door frame of the vehicle body so as to cover an area of about 1m inside and outside the door sill, and only the position of the occupant in the area is detected.
Further, since a child does not have the ability to drive a car, and a child seat is recommended in our country for the safety of the child in the car, and the recommended installation position of the child seat is the rear passenger compartment, in order to reduce the amount of computation of image processing, only the image of getting on or off the passenger in the passenger compartment can be recognized, that is, the driving behavior of the driver does not need to be recognized, and preferably, only the image of getting on or off the passenger in the rear passenger compartment can be detected.
S102: and respectively carrying out boarding and disembarking state identification and passenger type identification on the monitoring image so as to acquire a first image for passengers to board and a second image for passengers to board through the boarding and disembarking state identification, and acquiring children in the passengers through the passenger type identification.
S103: a first number of children getting on and a second number of children getting off are counted.
S104: and detecting the vehicle locking control command, and determining that children are left in the vehicle according to the first quantity and the second quantity when the vehicle locking control command is detected.
Preferably, it is determined that the first number is greater than the second number, i.e., the number of children getting on the vehicle is greater than the number of children getting off the vehicle, indicating that there are children who have got on the vehicle that have not got off the vehicle, i.e., that there are children left in the vehicle. It should be understood that when the first number is equal to the second number, the number of children entering the vehicle is equal to the number of children getting off the vehicle, and the normal state is achieved, and if the first number is smaller than the second number, the number of children entering the vehicle is smaller than the number of children getting off the vehicle, and the children cannot be present in the carriage through empty space, so that an abnormal alarm needs to be given.
S105: and controlling the vehicle not to execute the vehicle locking control instruction and sending reminding information.
From this, this application can be through discerning passenger cabin monitoring image, acquires the children's of getting on the bus quantity and the children's quantity of getting off in passenger cabin and judges, discerns whether leave children in the car, effectively improves the accuracy that children detected, reduces children and is left over the danger in the car.
Further, as shown in fig. 2, before the first image of getting on the passenger in the passenger compartment and the second image of getting off the passenger compartment are respectively acquired, the method further comprises:
s201: and identifying the position of the passenger in the monitoring image, and determining that the passenger is in the getting-on state or the getting-off state.
S202: and taking the monitoring image of the passenger in the boarding state as a first image and taking the monitoring image of the passenger in the alighting state as a second image.
That is, in order to obtain the first image of getting on the passenger compartment and the second image of getting off the passenger compartment, the identification of the getting on state and the getting off state can be realized by identifying the position of the passenger in the monitoring image, and the monitoring image of the getting on state of the passenger is used as the first image and the image of the passenger in the getting off state is used as the second image.
As a possible embodiment, as shown in fig. 3, step S202 may further include:
s301: the passenger positions in the chronologically adjacent monitoring images are respectively extracted.
S302: and determining that the passenger is in the getting-on state or the getting-off state according to the moving direction of the position.
It should be noted that, since the monitoring is a time-continuous image acquisition, and the passenger presents a position change with time in the process of getting on or off the vehicle, the passenger state can be determined by identifying the passenger position in the monitoring images adjacent in time sequence.
Specifically, two adjacent frames of monitoring images containing passengers can be acquired, the two frames of monitoring images are subjected to image analysis respectively, the relative positions of the passengers and the doors or the carriages in the images are acquired, then the moving direction of the passengers is determined according to the positions, and further the state of the passengers is determined to be the getting-on state or the getting-off state.
For example, taking the relative position of the passenger and the car as an example, if the relative position of the passenger and the car in the first frame image is smaller than the relative position of the passenger and the car in the second frame image, it indicates that the passenger is in the getting-off state, and conversely, if the relative position of the passenger and the car in the first frame image is larger than the relative position of the passenger and the car in the second frame image, it indicates that the passenger is in the getting-on state. It should be noted that, since the door is in the open state during the boarding and disembarking of the passenger, when the distance between the passenger and the door is decreased, it indicates that the passenger is in the alighting state, and when the distance between the passenger and the door is increased, it indicates that the passenger is in the boarding state, and it should be noted that, when the reference object is the door, it is determined that the distance between the passenger and the door is the distance of the door in the vehicle compartment direction, and if the distance of the door in the vehicle exterior direction is opposite, of course, the monitoring of the door in the vehicle exterior direction is likely to be mixed with the information of the non-passenger, and therefore, the present invention is not a preferred embodiment.
Further, passenger type identification is performed on the monitoring image, and the passenger type identification comprises the following steps: and identifying the passenger type in the monitored image through the target deep learning model, and determining the child in the monitored image.
It should be noted that, in the embodiment of the application, the target deep learning model capable of accurately identifying the child through the image is obtained by training the deep learning model. It should be understood that the deep learning model can be trained before the vehicle leaves the factory, the latest training result can be downloaded by the server in the using process of the user, the identification result of the child can be confirmed and adjusted in the daily using process to carry out targeted training on the learning model, and preferably, the three training modes can be combined for use.
It should be further noted that the monitoring image in the embodiment of the present application may be in a whole process, that is, passengers can get on or off the vehicle during the driving process, and therefore, the first number of children getting on the vehicle and the second number of children getting off the vehicle can be updated in real time during the monitoring process, so as to realize statistics of the first number and the second number.
It should be understood that, in order to save the time for data processing, it is preferable to perform the on-off state recognition and the passenger type recognition on the monitoring image at the same time, and then classify and sum the two results to obtain the first number and the second number.
Further, after controlling the vehicle not to execute the vehicle locking control instruction and sending the reminding information, the method further comprises the following steps: and judging whether the control releasing instruction is received within the preset time, and if so, executing the vehicle locking control instruction.
It should be noted that, in a normal state, the vehicle locking operation occurs after the driver leaves the cockpit, and the driver does not leave too far (the vehicle locking function has a distance limitation), so the reminding information may include various reminding manners capable of reminding the driver of attention in time, such as voice reminding, buzzer reminding, light reminding, and the like. Wherein, the buzzing reminding can be used for whistling according to the frequency of 5 Hz.
It should be understood that after the vehicle locking control command is not executed and the reminding information is sent, the driver usually returns to check or rescues the child according to the reminding information, and sends the control releasing command after checking that no child is left or rescues the child, so that the vehicle can continue to execute the vehicle locking operation according to the control releasing command.
It should be further understood that before the vehicle locking control command is not executed, it is also necessary to determine whether other vehicle locking control commands can be executed, for example, whether the vehicle is in an ignition state, whether a vehicle door is closed, and the like. In other words, only when the vehicle has no other abnormality which affects the execution of the vehicle locking control command, the reminding operation of the application can be performed according to the vehicle left children.
Furthermore, when the control releasing instruction is not received within the preset time, the remote communication system is started, and the emergency reminding information is sent to the emergency contact through the remote communication system.
It should be understood that if the control releasing instruction is not received within the preset time, it may be that the driver and the passenger return to check or rescue the child due to the aforementioned reminding information, because the reminding operation may have a smaller reminding range, and the driver and the passenger may have exceeded the reminding range and cannot obtain the reminding information.
According to an embodiment of the present invention, as shown in fig. 4, a control method of a vehicle includes the steps of:
s401: the method comprises the steps of sensing the vehicle, including monitoring and sensing the passenger compartment, sensing the ignition state of the vehicle, sensing the in-place state of a driver, sensing the state of a vehicle door and the like.
S402: according to the monitoring perception image of the passenger compartment, passenger state recognition and passenger type recognition are carried out, so that a first number of children getting on the vehicle and a second number of children getting off the vehicle in the passengers are obtained.
S403: and acquiring a vehicle locking control instruction.
S404: whether the vehicle is flamed out or not, whether the driver leaves the driving position or not, whether all doors are closed or not and whether the first number of the children getting on the vehicle is equal to the second number of the children getting off the vehicle or not are judged.
If all the judgment results are yes, controlling the vehicle to lock;
if any of the determinations is no, step S505 is executed.
S405: and controlling the vehicle not to execute the vehicle locking control instruction and sending reminding information.
S406: and judging whether a control releasing instruction is acquired or not.
If yes, executing a vehicle locking control instruction; and if not, sending emergency reminding information to the emergency contact.
In summary, according to the control method of the vehicle in the embodiment of the invention, the number of the children getting on the vehicle and the number of the children getting off the vehicle in the passenger compartment can be obtained and judged by identifying the passenger compartment monitoring image, and whether the children are left in the vehicle is identified, so that the accuracy of the detection of the children is effectively improved, and the danger that the children are left in the vehicle is reduced.
In order to realize the above embodiment, the invention also provides a control device of the vehicle.
Fig. 5 is a block diagram of a control device of a vehicle according to an embodiment of the present invention. As shown in fig. 5, the control device 100 for a vehicle includes: a monitoring module 10, an identification module 20, a statistics module 30, a judgment module 40 and a control module 50.
The monitoring module 10 is used for monitoring images of a door of a passenger compartment to obtain a monitoring image; the vehicle door comprises a space between the vehicle door and the vehicle body when the vehicle door is in an open state; the identification module 20 is used for respectively performing getting-on and getting-off state identification and passenger type identification on the monitoring image, so as to acquire a first image for getting on a passenger and a second image for getting off the passenger through the getting-on and getting-off state identification, and acquire a child in the passenger through the passenger type identification; the counting module 30 is used for counting a first number of children getting on the bus and a second number of children getting off the bus; (ii) a The judging module 40 is used for detecting the car locking control instruction, and when the car locking control instruction is detected, determining that children are left in the car according to the first quantity and the second quantity; the control module 50 is used for controlling the vehicle not to execute the vehicle locking control instruction and sending the reminding information.
Further, the identification module 20 is further configured to: identifying the position of the passenger in the monitoring image, and determining that the passenger is in an getting-on state or a getting-off state; and taking the monitoring image of the passenger in the boarding state as a first image and taking the monitoring image of the passenger in the alighting state as a second image.
Further, the identification module 20 is further configured to: respectively extracting passenger positions in the monitoring images adjacent in time sequence; and determining that the passenger is in the getting-on state or the getting-off state according to the moving direction of the position.
Further, the statistical module 30 is further configured to: and identifying the passenger type in the monitored image through the target deep learning model, and determining the child in the monitored image.
Further, the determining module 40 is further configured to: it is identified that the first number is greater than the second number.
Further, the control module 50 is further configured to: judging whether a control releasing instruction is received within preset time or not; and if so, executing a vehicle locking control command.
Further, the control module 50 is further configured to: and when the control releasing instruction is not received within the preset time, starting the remote communication system, and sending emergency reminding information to the emergency contact through the remote communication system.
It should be noted that the foregoing explanation of the embodiment of the control method for the vehicle is also applicable to the control device for the vehicle in this embodiment, and the details are not repeated here.
In order to implement the above embodiment, the present invention also proposes a vehicle, as shown in fig. 6, a vehicle 200 includes a control device 100 of the vehicle.
In order to achieve the above-described embodiments, the present invention also proposes a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the aforementioned control method of a vehicle.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (10)
1. A control method of a vehicle, characterized by comprising the steps of:
monitoring images at the door of the passenger compartment to obtain a monitoring image; the vehicle door comprises a space between the vehicle door and a vehicle body when the vehicle door is in an open state;
respectively carrying out boarding and disembarking state identification and passenger type identification on the monitoring images so as to acquire a first image for passengers to board and a second image for passengers to board through the boarding and disembarking state identification, and acquiring children in the passengers through the passenger type identification;
counting a first number of children getting on and a second number of children getting off of the passengers;
detecting a vehicle locking control command, and determining that children are left in the vehicle according to the first quantity and the second quantity when the vehicle locking control command is detected;
and controlling the vehicle not to execute the vehicle locking control instruction and sending reminding information.
2. The method according to claim 1, wherein the identifying of the on-off state of the monitoring image includes:
identifying the position of the passenger in the monitoring image, and determining that the passenger is in an getting-on state or a getting-off state;
and taking the monitoring image of the passenger in the boarding state as the first image, and taking the monitoring image of the passenger in the alighting state as the second image.
3. The method of controlling a vehicle according to claim 2, wherein said identifying a position of the passenger in the monitoring image and determining that the passenger is in an entering state or a leaving state includes:
respectively extracting the passenger positions in the monitoring images adjacent in time sequence;
and determining that the passenger is in an getting-on state or a getting-off state according to the moving direction of the position.
4. The control method of a vehicle according to claim 1, wherein said performing passenger type identification on said monitor image includes:
and identifying the passenger type in the monitoring image through a target deep learning model, and determining the child in the monitoring image.
5. The method of controlling a vehicle according to claim 1, wherein the determining that a child is left in the vehicle based on the first number and the second number comprises:
identifying that the first number is greater than the second number.
6. The method for controlling a vehicle according to claim 1, further comprising, after the controlling the vehicle does not execute the vehicle locking control instruction and sends a warning message:
judging whether a control releasing instruction is received within preset time or not;
and if so, executing the vehicle locking control command.
7. The control method of a vehicle according to claim 6, characterized by further comprising:
and when the control releasing instruction is not received within the preset time, starting the remote communication system, and sending emergency reminding information to the emergency contact through the remote communication system.
8. A control apparatus of a vehicle, characterized by comprising:
the monitoring module is used for carrying out image monitoring on the door of the passenger compartment to obtain a monitoring image; the vehicle door comprises a space between the vehicle door and a vehicle body when the vehicle door is in an open state;
the identification module is used for respectively carrying out getting-on and getting-off state identification and passenger type identification on the monitoring image, so that a first image for getting on a passenger and a second image for getting off the passenger are obtained through the getting-on and getting-off state identification, and children in the passenger are obtained through the passenger type identification;
the counting module is used for counting a first number of children getting on the bus and a second number of children getting off the bus;
the judging module is used for detecting the vehicle locking control command, and determining that children are left in the vehicle according to the first quantity and the second quantity when the vehicle locking control command is detected;
and the control module is used for controlling the vehicle not to execute the vehicle locking control instruction and sending reminding information.
9. A vehicle characterized by comprising the control apparatus of the vehicle according to claim 8.
10. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when executed by a processor, implements a control method of a vehicle according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911368937.3A CN113043982A (en) | 2019-12-26 | 2019-12-26 | Vehicle and control method and device thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911368937.3A CN113043982A (en) | 2019-12-26 | 2019-12-26 | Vehicle and control method and device thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113043982A true CN113043982A (en) | 2021-06-29 |
Family
ID=76505550
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911368937.3A Pending CN113043982A (en) | 2019-12-26 | 2019-12-26 | Vehicle and control method and device thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113043982A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113570871A (en) * | 2021-07-09 | 2021-10-29 | 超级视线科技有限公司 | Multidimensional vehicle personnel getting-on and getting-off judgment method and system |
| CN114407822A (en) * | 2021-12-09 | 2022-04-29 | 北京罗克维尔斯科技有限公司 | Information pushing method and device, electronic equipment, storage medium and vehicle |
| CN114789705A (en) * | 2021-07-15 | 2022-07-26 | 长城汽车股份有限公司 | In-vehicle life remaining detection control method and device and vehicle |
| WO2024007815A1 (en) * | 2022-07-04 | 2024-01-11 | 东风汽车集团股份有限公司 | Method and system for determining whether there are passengers left in vehicle by means of electronic rearview mirror |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108189753A (en) * | 2017-12-15 | 2018-06-22 | 信利光电股份有限公司 | A kind of vehicle carried method and system |
| CN109345770A (en) * | 2018-11-14 | 2019-02-15 | 深圳市尼欧科技有限公司 | A kind of child leaves in-vehicle alarm system and child leaves interior alarm method |
| CN109784296A (en) * | 2019-01-27 | 2019-05-21 | 武汉星巡智能科技有限公司 | Bus occupant quantity statistics method, device and computer readable storage medium |
| KR20190094546A (en) * | 2018-02-05 | 2019-08-14 | 정찬세 | Vehicular safety system for children school bus |
-
2019
- 2019-12-26 CN CN201911368937.3A patent/CN113043982A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108189753A (en) * | 2017-12-15 | 2018-06-22 | 信利光电股份有限公司 | A kind of vehicle carried method and system |
| KR20190094546A (en) * | 2018-02-05 | 2019-08-14 | 정찬세 | Vehicular safety system for children school bus |
| CN109345770A (en) * | 2018-11-14 | 2019-02-15 | 深圳市尼欧科技有限公司 | A kind of child leaves in-vehicle alarm system and child leaves interior alarm method |
| CN109784296A (en) * | 2019-01-27 | 2019-05-21 | 武汉星巡智能科技有限公司 | Bus occupant quantity statistics method, device and computer readable storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113570871A (en) * | 2021-07-09 | 2021-10-29 | 超级视线科技有限公司 | Multidimensional vehicle personnel getting-on and getting-off judgment method and system |
| CN114789705A (en) * | 2021-07-15 | 2022-07-26 | 长城汽车股份有限公司 | In-vehicle life remaining detection control method and device and vehicle |
| CN114407822A (en) * | 2021-12-09 | 2022-04-29 | 北京罗克维尔斯科技有限公司 | Information pushing method and device, electronic equipment, storage medium and vehicle |
| WO2024007815A1 (en) * | 2022-07-04 | 2024-01-11 | 东风汽车集团股份有限公司 | Method and system for determining whether there are passengers left in vehicle by means of electronic rearview mirror |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113043982A (en) | Vehicle and control method and device thereof | |
| CN110619733B (en) | Protection method and device for forgotten life body, computer equipment and storage medium | |
| CN104859651B (en) | A kind of danger souding for improving parking enabling security and prevention method | |
| CN111907453A (en) | Vehicle and method for protecting a person remaining in a vehicle | |
| US10217344B2 (en) | Noxious gas alert and remediation system | |
| US9847004B1 (en) | Vehicle child detection and response system | |
| US20180065504A1 (en) | Vehicle Child Detection and Response System | |
| CN113246895A (en) | Vehicle cabin safety system and method | |
| CN110549976A (en) | In-vehicle high-temperature protection system and method thereof | |
| CN108263325A (en) | A kind of interior omission life entity detecting system based on image processing techniques | |
| WO2015060868A1 (en) | Responding to in-vehicle environmental conditions | |
| KR101768847B1 (en) | Black box equipped with gas sensitive function | |
| CN209928582U (en) | Automobile alarm device and automobile | |
| CN112509279A (en) | Method and system for detecting and protecting life and article left in vehicle | |
| CN114572141A (en) | Occupant monitoring system, occupant leaving reminding method and related equipment | |
| CN112319367A (en) | Monitoring and protecting system and equipment for people staying in vehicle | |
| JP7478592B2 (en) | Vehicle control system and vehicle control method | |
| US11951997B2 (en) | Artificial intelligence-enabled alarm for detecting passengers locked in vehicle | |
| JP2020093684A (en) | In-car accident prevention device and in-car accident prevention system | |
| CN112918485A (en) | System and method for detecting and mitigating unsafe conditions in a vehicle | |
| CN214084149U (en) | Passenger monitoring system and vehicle | |
| CN115071623A (en) | Vehicle control method and device, storage medium and equipment | |
| CN115027401A (en) | Safety risk monitoring method and system for stationary vehicle passengers | |
| CN113859171A (en) | Vehicle control method, device, equipment and storage medium | |
| CN114274872A (en) | Early warning method and system for vital signs in vehicle, readable storage medium and vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210629 |
|
| WD01 | Invention patent application deemed withdrawn after publication |