CN115146830A - Method and system for intelligently identifying taxi taking intention of passerby and vehicle thereof - Google Patents
Method and system for intelligently identifying taxi taking intention of passerby and vehicle thereof Download PDFInfo
- Publication number
- CN115146830A CN115146830A CN202210647142.1A CN202210647142A CN115146830A CN 115146830 A CN115146830 A CN 115146830A CN 202210647142 A CN202210647142 A CN 202210647142A CN 115146830 A CN115146830 A CN 115146830A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- passerby
- taxi
- intention
- pedestrian
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 230000006870 function Effects 0.000 claims description 27
- 230000009471 action Effects 0.000 claims description 19
- 238000004891 communication Methods 0.000 claims description 17
- 230000036544 posture Effects 0.000 claims description 17
- 230000001427 coherent effect Effects 0.000 claims description 16
- 238000003709 image segmentation Methods 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 8
- 230000003993 interaction Effects 0.000 claims description 7
- 230000001815 facial effect Effects 0.000 claims description 3
- 230000033001 locomotion Effects 0.000 claims description 3
- 238000001514 detection method Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 241000287107 Passer Species 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000004297 night vision Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000029305 taxis Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/04—Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
- G06Q10/047—Optimisation of routes or paths, e.g. travelling salesman problem
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/40—Business processes related to the transportation industry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Resources & Organizations (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- Marketing (AREA)
- Human Computer Interaction (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Game Theory and Decision Science (AREA)
- Psychiatry (AREA)
- Entrepreneurship & Innovation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Social Psychology (AREA)
- Development Economics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Primary Health Care (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a method, a system and a vehicle for intelligently identifying the taxi-taking intention of passers-by, wherein the method specifically comprises the following steps: acquiring pedestrian attitude images outside the vehicle in real time, and detecting the azimuth distance of a target by using a vehicle-mounted radar; and comparing the pedestrian posture image with the database, and judging whether the pedestrian has the vehicle-calling intention and the temporary parking condition, wherein the system, the vehicle and the method correspond to each other. After the technical scheme of the invention is adopted, a driver only needs to pay attention to vehicle driving and does not need to pay attention to whether a passerby wants to take a taxi or not, so that the attention load of the driver is reduced, the safety is improved, the service habit that the taxi is stopped along with calling is kept to the maximum extent, the taxi does not need to be arranged at a specific fixed certain position for waiting, the positions of a plurality of passerbies needing to take the taxi are evaluated and managed, and the driver is helped to find the most appropriate passerby positions and answering routes.
Description
Technical Field
The invention relates to a method and a system for intelligently identifying a taxi-taking intention of a passerby and a vehicle thereof, belonging to the technical field of intelligent identification and intelligent vehicles.
Background
In recent years, the rate of traffic accidents is rising, and safe driving has become the focus of attention of every driver and passerby. Safe driving not only complies with traffic regulations and qualified driving techniques, but also has strict requirements on driver attention. The so-called concentration is to require the driver not to be interfered by the surroundings inside and outside the vehicle, accurately sense the change of the conditions inside and outside the vehicle and quickly react, which is a key link for safe driving.
However, as a taxi driver, people cannot drive without a side wu in most cases, and the taxi driver usually pays attention to the conditions on both sides of the road during driving and pays attention to whether passersby call for cars so as to ensure that passengers with riding intentions do not miss. Therefore, the attention of taxi drivers is not concentrated, and traffic accidents are easy to happen.
In the related field of the existing taxies, a vehicle-mounted system for automatically identifying surrounding pedestrians to request to take a taxi does not exist, although technical data show that a scheme that a sensor is placed under a fixed license plate and people request to take a taxi is provided, the scheme belongs to a similar fixed stop mode with the existing bus and does not have the technical effect of 'calling and stopping along with stopping' belonging to the field of taxies.
The prior art lacks a scheme belonging to the field of taxis, is not limited by stations, and automatically and accurately identifies whether passers-by need to take a taxi, so that the attention burden of taxi drivers for finding passengers while driving is relieved, and the safety and the working efficiency are improved.
Disclosure of Invention
The invention aims to provide a method, a system and a vehicle for intelligently identifying a passerby taxi-taking intention, which solve the problems that a taxi driver drives the taxi and searches passengers at the same time, reduce the attention burden of the driver and solve the defects in the prior art.
The invention provides the following scheme:
a method for intelligently identifying a taxi-taking intention of a passerby specifically comprises the following steps:
acquiring pedestrian attitude images outside the vehicle in real time, and detecting the azimuth distance of a target by using a vehicle-mounted radar;
comparing the pedestrian posture image with a database, and judging whether the pedestrian has the intention of calling the vehicle;
if the pedestrian is judged not to have the intention of receiving the vehicle, the vehicle keeps a normal driving state, or:
if the pedestrian has the intention of calling the vehicle, performing order receiving service and judging whether the pedestrian has a temporary parking condition;
if the temporary parking condition is met, parking the vehicle near the pedestrian;
and if the temporary parking condition is not met, displaying information to the outside of the vehicle for prompting the parking place of the passenger.
Further, the real-time collection of the pedestrian posture image outside the vehicle specifically includes:
classifying images, namely judging whether the acquired image information of the passerby contains the passerby, if so, entering an image segmentation step, and if not, directly stopping analyzing the picture and analyzing the next picture;
and image segmentation, namely judging whether the acquired image information of the passerby contains a plurality of passerbies, and segmenting the image information if the acquired image information of the passerby contains a plurality of passerbies until each image information contains only one passerby.
Further, the image segmentation specifically includes: firstly, dividing the video information into image information frame by frame, and then processing the image information.
Further, the gesture or/and coherent action in the step of target recognition comprises: physical, gestural, facial, eye gestures or/and coherent motions; and selecting one or more postures or/and coherent actions to judge according to the image information quality and the shooting angle.
Further, it is judged whether the pedestrian has the intention of calling the vehicle, and the method specifically comprises the following steps: carrying out target identification to obtain database image information; according to a preset rule, marking characteristic key points for image information of passers-by and image information of a database, comparing the characteristic key points of the two groups of image information, calculating the correlation factors of the characteristic key points, and analyzing whether the action of the passers-by accords with the gesture or/and the coherent action of requesting to taxi.
Further, if the temporary parking condition is not met, displaying information to the outside of the vehicle for prompting the parking place of the passenger, specifically: and prompting the parking place for the passengers through the ceiling lamp screen.
The utility model provides a system for intelligent recognition passerby's intention of hiring a car, specifically includes:
the image acquisition module is used for acquiring pedestrian posture images outside the vehicle in real time;
the radar ranging module is used for detecting the azimuth distance of a target by utilizing a vehicle-mounted radar;
the image processing module is used for comparing the pedestrian posture image with the database;
the intelligent image decision-making module is used for making decision-making output based on the judgment of whether the pedestrian has the vehicle-calling intention, and if the pedestrian does not have the vehicle-calling intention, the vehicle keeps a normal driving state, or: if the pedestrian has the intention of calling the car, performing order receiving service;
the intelligent parking decision module is used for carrying out decision output based on whether the temporary parking condition is met or not, and if the temporary parking condition is met, the vehicle is parked near the pedestrian, or: if the temporary parking condition is not met, displaying information to the outside of the vehicle to prompt passengers of the parking place;
and the intelligent cockpit interaction module is used for interacting with a driver in a click or voice mode.
An electronic device, comprising: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory has stored therein a computer program which, when executed by the processor, causes the processor to carry out the steps of the method.
A computer-readable storage medium storing a computer program executable by an electronic device, the computer program, when run on the electronic device, causing the electronic device to perform the steps of the method.
A vehicle with intelligent recognition passerby taxi taking intention function specifically comprises:
an electronic device for implementing the steps of the method;
a processor running a program, the steps of the method being performed from data output by the electronic device when the program is running;
a storage medium for storing a program which, when executed, performs the steps of the method on data output from an electronic device.
Compared with the prior art, the invention has the following advantages:
the driver only needs to pay attention to the driving of the vehicle, and does not need to pay attention to observe whether passers-by want to take the vehicle or not, so that the attention load of the driver is reduced, and the safety is improved.
The service habit that the taxi stops along with calling is reserved to the maximum extent, and the taxi does not need to be arranged at a specific fixed certain position for waiting.
And evaluating and managing the positions of a plurality of passers-by to take the car, and helping a driver to find the most suitable passer-by position and a receiving route.
When the condition that the traffic laws are violated possibly or the condition that the driving has safety risks is met, the vehicle-mounted taxi taking system is communicated with passers, so that the passers are slightly matched, and the connection place is modified, so that the taxi taking process is safer for drivers, passengers and third parties.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flow chart of a method for intelligently identifying a passerby's intention to taxi.
Fig. 2 is an architecture diagram of a system for intelligently identifying a passerby's intention to take a car.
Fig. 3 is a flow chart of the taxi intelligent passenger identification and reminding function system in one embodiment.
Fig. 4 is a flow chart of the taxi intelligent passenger identification and reminding function system in one embodiment.
Fig. 5 is a flow chart of a taxi intelligent passenger identification and reminding function system in yet another embodiment.
Fig. 6 is a block diagram of a taxi intelligent passenger identification and reminder system in yet another embodiment.
Fig. 7 is a system architecture diagram of an electronic device.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it is to be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The method for intelligently identifying the taxi-taking intention of the passerby as shown in fig. 1 specifically comprises the following steps:
acquiring pedestrian attitude images outside the vehicle in real time, and detecting the azimuth distance of a target by using a vehicle-mounted radar;
comparing the pedestrian posture image with a database, and judging whether the pedestrian has the intention of calling the vehicle;
if the pedestrian is judged not to have the intention of receiving the vehicle, the vehicle keeps a normal driving state, or:
if the pedestrian has the intention of calling the vehicle, performing order receiving service and judging whether the pedestrian has a temporary parking condition;
if the temporary parking condition is met, parking the vehicle near the pedestrian;
and if the temporary parking condition is not met, displaying information to the outside of the vehicle for prompting the parking place of the passenger.
Preferably, the acquiring the pedestrian posture image outside the vehicle in real time specifically includes:
classifying images, namely judging whether the acquired image information of the passerby contains the passerby, if so, entering an image segmentation step, and if not, directly stopping analyzing the picture and analyzing the next picture;
and image segmentation, namely judging whether the acquired image information of the passerby contains a plurality of passerbies, and segmenting the image information if the acquired image information of the passerby contains a plurality of passerbies until each image information contains only one passerby.
Preferably, the image segmentation specifically includes: firstly, dividing the video information into image information frame by frame, and then processing the image information.
Preferably, the gesture or/and coherent action in the step of object recognition comprises: physical, gestural, facial, eye gestures or/and coherent motions; and selecting one or more postures or/and coherent actions to judge according to the image information quality and the shooting angle.
Preferably, the determining whether the pedestrian has the intention of calling the vehicle specifically includes: carrying out target identification to obtain database image information; according to a preset rule, marking characteristic key points for image information of passers-by and image information of a database, comparing the characteristic key points of the two groups of image information, calculating the correlation factors of the characteristic key points, and analyzing whether the action of the passers-by accords with the gesture or/and the coherent action of requesting to taxi.
Preferably, if the temporary parking condition is not met, displaying information to the outside of the vehicle for prompting the parking place of the passenger, specifically: and prompting the parking place for the passengers through the ceiling lamp screen.
For the purposes of simplicity of description, the method steps disclosed in the present embodiment are described as a series of acts, but those skilled in the art will appreciate that the present embodiment is not limited by the order of acts described, as some steps may occur in other orders or concurrently in accordance with the present embodiment. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
The system for intelligently identifying the taxi-taking intention of the passerby as shown in fig. 2 specifically comprises:
the image acquisition module is used for acquiring pedestrian posture images outside the vehicle in real time;
the radar ranging module is used for detecting the azimuth distance of a target by utilizing a vehicle-mounted radar;
the attitude image processing module is used for comparing the pedestrian attitude image with the database;
the intelligent image decision-making module is used for making decision-making output based on the judgment of whether the pedestrian has the vehicle-calling intention, and if the pedestrian does not have the vehicle-calling intention, the vehicle keeps a normal driving state, or: if the pedestrian has the intention of calling the vehicle, the order receiving service is carried out;
the intelligent parking decision module is used for carrying out decision output based on whether the temporary parking condition is met or not, and if the temporary parking condition is met, the vehicle is parked near the pedestrian, or: if the temporary parking condition is not met, information is displayed to the outside of the vehicle to prompt passengers of the parking place.
And the intelligent cockpit interaction module is used for interacting with a driver in a clicking or voice mode.
It should be noted that, although only the image acquisition module, the radar ranging module, the attitude image comparison module, the intelligent image decision module and the intelligent parking decision module are disclosed in the present system, the composition of the present system is not limited to the above basic function modules, but rather, the present invention is to be expressed as: on the basis of the basic functional modules, a person skilled in the art can combine the prior art to add one or more functional modules arbitrarily to form an infinite number of embodiments or technical solutions, that is, the present system is open rather than closed, and the protection scope of the present invention claims should not be considered to be limited to the disclosed basic functional modules because the present embodiment discloses only individual basic functional modules. Meanwhile, for convenience of description, the above devices are described as being divided into various units and modules by functions, respectively. Of course, the functions of the units and modules may be implemented in one or more software and/or hardware when the present application is implemented.
As shown in fig. 3, a flowchart of a method for intelligently identifying a passerby requesting to taxi specifically includes:
step S1, acquiring image information of passers-by: shooting pictures or videos of passers-by through a camera; if the video is the video, the video is decomposed into pictures frame by frame, and then the pictures are used in step S3.
S2, acquiring database image information: a large number of pictures of passers-by determined to be driving are recorded in the database in advance as reference objects for comparison.
Step S3, judging that the passerby requests to take a taxi: comparing the shot passerby photos with the existing passerby photos to be taxi taken in the database, and selecting the passerby photos with the same characteristics as the photos in the database; the method comprises the following specific steps of finding out passers-by needing to take a car by aiming at pictures or images:
step S3a, image classification: judging whether the acquired passerby image information contains passerby, if so, entering an image segmentation step, and if not, directly stopping analyzing the picture and analyzing the next picture;
step S3b, image segmentation: judging whether the acquired image information of the passerby contains a plurality of passerbies or not, and if the image information contains a plurality of passerbies, segmenting the image information until each image information contains only one passerby;
step S3c, target identification: according to a preset rule, marking characteristic key points for image information of passers-by, marking characteristic key points for image information of a database, comparing the characteristic key points of the two groups of image information, calculating relevant factors of the characteristic key points, and judging whether the actions of the passers-by accord with the postures or/and the coherent actions of requesting to taxi according to the calculation and analysis results of the relevant factors;
step S4, locking the passerby requesting to taxi: and if the judgment analysis result meets the preset threshold value, judging that the passerby requests to take the car, and locking the passerby.
The person skilled in the art can understand the basic concepts of image classification, image segmentation and target recognition, can understand the feature key points marked on the image, can also understand the technical knowledge of calculating the correlation factors of the feature key points and judging whether the passerby accords with the gesture or/and the coherent action of requesting to taxi according to the correlation factor calculation.
Preferably, the method further comprises the following steps: acquiring video information of passers-by; in the image segmentation step, the video information is segmented into image information frame by frame, and then the image information is processed.
Preferably, in the step of target identification, whether the passerby meets the gesture or/and coherent action of requesting to take the car or not is judged according to the correlation factor, and the method further comprises the following steps: distinguishing a body, a gesture, a face and eyes; and selecting one or more discrimination modes according to the image quality and the shooting angle.
Preferably, the method further comprises the following steps: acquiring position information of passers-by; fusing image information and position information of the same target passerby to enable the image information to contain the position information; and extracting and sending the position information of the road passenger requesting to make the car.
As shown in fig. 4, the present invention discloses a method for intelligently identifying a passerby request to taxi, and also discloses a system for intelligently identifying a passerby request to taxi, which specifically comprises:
the image module is used for acquiring image information of passers-by;
the data module acquires database image information;
the calculation module is used for judging the similarity between the image information of the passerby and the image information of the database;
and according to the steps from S1 to S4, judging that the passerby requests to take the car, and locking the passerby.
Preferably, the judging whether the passerby accords with the gesture or the coherent action of requesting to take the car comprises body judgment, gesture judgment, face judgment and eye judgment; selecting one or more discrimination modes according to the image quality; and if the judgment analysis result meets the preset threshold value, judging that the passerby requests to take the car.
Preferably, the method further comprises the following steps: the video module is used for acquiring video information of passers-by; in the image segmentation step, the video information is segmented into image information frame by frame, and then the image information is processed.
Preferably, the method further comprises the following steps: the distance measurement module is used for acquiring the position information of passers-by; fusing image information and position information of the same target passerby to enable the image information to contain the position information; and extracting the position information of the vehicle-calling passerby and sending the position information to the man-machine interaction system.
It should be noted that, although the present system only discloses basic function modules such as an image module, a data module, a calculation module, a video module, a distance measurement module, etc., the present system is not limited to the above basic function modules, but rather, the present invention is to be construed as meaning that, on the basis of the above basic function modules, one skilled in the art can arbitrarily add one or more function modules in combination with the prior art to form an infinite number of embodiments or technical solutions, that is, the present system is open rather than closed, and the protection scope of the present invention claims is considered to be limited to the above disclosed basic function modules because the present embodiment only discloses individual basic function modules.
As shown in fig. 5, the present invention discloses a specific embodiment, a taxi intelligent passenger identification and reminding function system control method:
a taxi driver can select whether to start the taxi intelligent passenger identification and reminding functions in the intelligent cockpit system; if the vehicle is started, whether the current vehicle is in an empty state or not is further judged.
Under the condition of an empty vehicle state, the 360-degree panoramic camera is used under the condition that the light outside the vehicle is sufficient; use infrared night vision camera under the dark condition, cooperation radar real time monitoring and advance to transmit the image processing module with the image of gathering, carry out gesture detection and gesture detection function, the radar will monitor target personage position and current distance detected simultaneously. The gesture of the target person is compared with the gesture of the taxi calling in the database, when the detection result is that the gesture of the passenger calling or/and the action of the taxi calling are met, the image processing module transmits the result to the intelligent cabin system, the cabin system and a taxi driver perform voice interaction, for example, the driver is reminded of the direction of the passenger calling by voice, and the cabin screen displays and inquires whether the driver needs to take an order or not. The driver can choose to voice reply "pick/not pick" or click "yes/no" on the screen to interact with the cabin system. If the driver selects the order, the image processing module further analyzes whether the passenger position is a bus stop, a crossroad, a railway crossing or a place where temporary stop is forbidden, such as Huang Shixian and the like, and informs the driver through voice or a screen; if the vehicle can be temporarily parked, the vehicle can be parked and taken; if the temporary parking is impossible, the driver is informed, the driver asks the parking space in the front for receiving the passenger in a voice manner, the driver replies the information of '50 meters forwards/backwards, 100 meters and the like' of the cabin system, the information is displayed on a roof lamp board screen by the cabin system, the passenger at a distance is informed, and finally the passenger is converged with the passenger to complete the receiving.
In yet another embodiment shown in fig. 6, a block diagram of a taxi intelligent passenger identification and reminder system is shown; the method comprises the following steps:
and the function starting decision module judges whether to start the intelligent passenger identification and reminding function according to whether the driver starts the intelligent passenger identification and reminding function of the taxi and the current passenger carrying state of the taxi. If the driver does not start the intelligent passenger identification and reminding functions in the intelligent cabin system, the subsequent data acquisition module and the data processing module are not started; if the driver starts the intelligent passenger identification and reminding function, the state of a passenger carrying lamp board at the front end of the taxi is further collected, and if the passenger carrying state is the passenger carrying state, the function is not started; and if the vehicle is in an empty state, reading the data of the sunlight and rainfall sensor, and judging the vehicle to be in the daytime or at night according to the current light state.
The data acquisition module acquires images/videos in front of the running vehicle and radar data in real time. The data acquisition module reads the day/night judgment information transmitted by the sunlight and rainfall sensor data processing module, and if the information is day, the 360-degree panoramic camera acquires an environmental picture/video in real time; and if the environment is at night, acquiring an environment picture/video in real time by using an infrared night vision camera. And the three-dimensional laser radar collects the information of the direction, the distance and the like of the front dynamic object in real time.
And the data processing module intelligently identifies whether the acquired pedestrian gesture is the car-calling gesture and the position information of the car-calling personnel.
The module can collect the surrounding environment information of the vehicle in real time after the function of the 360-degree panoramic camera is started. The first step of image recognition is image classification, i.e., two classifications. Firstly, identifying whether the acquired image/video information contains a person, further analyzing downwards if the image information contains the person, and directly stopping analyzing the image and analyzing the next image if the image information does not contain the person; the video is similar to the video, whether picture frames of people exist is analyzed, further processing exists, and the picture frames are discarded if the picture frames do not exist; after the image containing the person is screened, the second step is to perform target identification and image segmentation on the image, for example, the number of people in the image can be identified by utilizing pixel segmentation, the image segmentation is performed on the areas where different people are located, and the number of people in the image is identified. And thirdly, target recognition and posture detection based on model matching. And detecting key points of human bodies of the segmented pictures of different people, comparing the detection result with the key points of the actions of the person calling the car in the database, calculating relevant factors of the detection result, and judging whether the target accords with the driving posture or not according to the relevant factors. If the person is the person with the intention of calling the car, further intercepting the gesture key points to analyze the key points, comparing the analysis result with the gesture key points in the database, and determining that the target is the person calling the car. If the passenger does not intend, no output is given; if the person who waves hands to call the car is judged, the position and distance data of the person are further identified from the multi-person radar data and transmitted to the intelligent cockpit system, the camera further tracks the image information of the person around the person, whether the person is a parking prohibition place or not is analyzed, and the parking information is sent to the intelligent cockpit system.
And the intelligent cockpit system carries out human-computer interaction on the identified taxi calling personnel and the driver in real time. After the intelligent cabin system receives the position and distance data of the taxi calling personnel and whether the parking information can be carried out around, the intelligent cabin voice interaction system inquires a driver: if the driver replies 'order receiving', if the passenger can temporarily stop at the passenger place; if the passenger can not temporarily stop at the place, the system further inquires that the driver can return to 50 meters and the like after judging the situation according to the 'temporary stop before temporary stop and the number of preceding meters', and after the intelligent cabin system receives the instruction, the intelligent cabin system further displays the 'temporary stop can not be stopped at the place and the 50 meters ahead' word, and the service is ended. The voice service system can synchronously inquire in the screen system of the intelligent cabin and can click a reply on the screen.
As shown in fig. 7, the invention discloses an electronic device and a storage medium corresponding to the method and the system for intelligently identifying the taxi driver to request to take the taxi based on the method and the system for intelligently identifying the taxi driver:
an electronic device, comprising: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus; the memory has stored therein a computer program that, when executed by the processor, causes the processor to perform the steps of the method for taxi intelligent identification passerby requested taxi taking.
A computer readable storage medium storing a computer program executable by an electronic device to cause the taxi to intelligently identify steps of a method by which a passerby requests to take a taxi, when the computer program is run on the electronic device.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The electronic device includes a hardware layer, an operating system layer running on top of the hardware layer, and an application layer running on top of the operating system. The hardware layer includes hardware such as a Central Processing Unit (CPU), a Memory Management Unit (MMU), and a Memory. The operating system may be any one or more computer operating systems that implement control of the electronic device through a Process (Process), such as a Linux operating system, a Unix operating system, an Android operating system, an iOS operating system, or a windows operating system. In the embodiment of the present invention, the electronic device may be a handheld device such as a smart phone and a tablet computer, or an electronic device such as a desktop computer and a portable computer, which is not particularly limited in the embodiment of the present invention.
The execution main body of the electronic device control in the embodiment of the present invention may be the electronic device, or a functional module capable of calling a program and executing the program in the electronic device. The electronic device may obtain the firmware corresponding to the storage medium, the firmware corresponding to the storage medium is provided by a vendor, and the firmware corresponding to different storage media may be the same or different, which is not limited herein. After the electronic device acquires the firmware corresponding to the storage medium, the firmware corresponding to the storage medium may be written into the storage medium, specifically, the firmware corresponding to the storage medium is burned into the storage medium. The process of burning the firmware into the storage medium can be implemented by adopting the prior art, and is not described in the embodiment of the present invention.
The electronic device may further acquire a reset command corresponding to the storage medium, where the reset command corresponding to the storage medium is provided by a vendor, and the reset commands corresponding to different storage media may be the same or different, and are not limited herein.
At this time, the storage medium of the electronic device is a storage medium in which the corresponding firmware is written, and the electronic device may respond to the reset command corresponding to the storage medium in which the corresponding firmware is written, so that the electronic device resets the storage medium in which the corresponding firmware is written according to the reset command corresponding to the storage medium. The process of resetting the storage medium according to the reset command may be implemented in the prior art, and is not described in detail in the embodiment of the present invention.
The invention also discloses a vehicle with the function of intelligently identifying the taxi-taking intention of passers-by, which specifically comprises the following steps:
the electronic equipment is used for realizing the steps of the method for intelligently identifying the taxi-taking intention of the passerby;
a processor that runs a program, and executes a step of intelligently recognizing a passerby taxi-taking intention method from data output from the electronic device when the program runs;
a storage medium for storing a program which, when executed, performs the steps of the intelligent passerby taxi hiring intention method on data output from an electronic device.
For convenience of description, the above devices are described as being functionally divided into various units and modules. Of course, the functions of the units and modules may be implemented in one or more software and/or hardware when the present application is implemented.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
It should be noted that certain terms are used throughout the description and following claims to refer to particular components. As one skilled in the art will appreciate, vehicle manufacturers may refer to a component by different names. The description and claims do not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms "include" and "comprise" are used in an open-ended fashion, and thus should be interpreted to mean "include, but not limited to. The following description is of the preferred embodiment for carrying out the invention, but the description is made for the purpose of general principles of the specification and is not intended to limit the scope of the invention. The scope of the present invention is defined by the appended claims.
From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the embodiments or some parts of the embodiments of the present application.
The above-described embodiments of the apparatus are merely schematic, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
The application is operational with numerous general purpose or special purpose computing system environments or configurations, such as: personal computers, server computers, hand-held or portable devices, tablet-type devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
In the description herein, references to the description of "one embodiment," "an example," "a specific example" or the like are intended to mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A method for intelligently identifying a taxi-taking intention of a passerby is characterized by specifically comprising the following steps:
acquiring pedestrian attitude images outside the vehicle in real time, and detecting the azimuth distance of a target by using a vehicle-mounted radar;
comparing the pedestrian posture image with a database, and judging whether the pedestrian has the intention of calling the vehicle;
if the pedestrian is judged not to have the intention of receiving the vehicle, the vehicle keeps a normal driving state, or:
if the pedestrian has the intention of calling the vehicle, performing order receiving service and judging whether the pedestrian has a temporary parking condition;
if the temporary parking condition is met, parking the vehicle near the pedestrian;
and if the temporary parking condition is not met, displaying information to the outside of the vehicle for prompting the parking place of the passenger.
2. The method for intelligently identifying the taxi-taking intention of the passerby according to claim 1, wherein the acquiring of the pedestrian posture image outside the vehicle in real time specifically comprises:
classifying images, namely judging whether the acquired image information of the passerby contains the passerby, if so, entering an image segmentation step, and if not, directly stopping analyzing the picture and analyzing the next picture;
and image segmentation, namely judging whether the acquired image information of the passerby contains a plurality of passerbies, and segmenting the image information if the acquired image information of the passerby contains a plurality of passerbies until each image information contains only one passerby.
3. The method for intelligently identifying the taxi-taking intention of the passerby according to claim 2, wherein the image segmentation specifically comprises: firstly, dividing the video information into image information frame by frame, and then processing the image information.
4. The method for intelligently identifying the taxi-taking intention of the passerby according to claim 3, wherein the gesture or/and the coherent action in the step of target identification comprises the following steps: physical, gestural, facial, eye gestures or/and coherent motions; and selecting one or more postures or/and coherent actions to judge according to the image information quality and the shooting angle.
5. The method for intelligently identifying the taxi-taking intention of the passerby according to claim 1, wherein the step of judging whether the passerby has the taxi-taking intention is specifically as follows: carrying out target identification to obtain database image information; according to a preset rule, marking characteristic key points for image information of passers-by and image information of a database, comparing the characteristic key points of the two groups of image information, calculating relevant factors of the characteristic key points, and analyzing whether the action of the passers-by accords with the gesture or/and the coherent action of the requested taxi taking.
6. The method for intelligently identifying the taxi-taking intention of the passerby according to claim 1, wherein if the temporary parking condition is not met, information is displayed to the outside of the vehicle for prompting the passenger to park, and specifically comprises the following steps: and the parking place is prompted to the passengers through the top lamp screen.
7. The utility model provides a system for intelligent recognition passerby's intention of taking a car which characterized in that specifically includes:
the image acquisition module is used for acquiring pedestrian posture images outside the vehicle in real time;
the radar ranging module is used for detecting the azimuth distance of a target by using a vehicle-mounted radar;
the image processing module is used for comparing the pedestrian posture image with the database;
the intelligent image decision-making module is used for making decision-making output based on the judgment of whether the pedestrian has the vehicle-calling intention, and if the pedestrian does not have the vehicle-calling intention, the vehicle keeps a normal driving state, or: if the pedestrian has the intention of calling the vehicle, the order receiving service is carried out;
the intelligent parking decision module is used for carrying out decision output based on whether the temporary parking condition is met or not, and if the temporary parking condition is met, the vehicle is parked near the pedestrian, or: if the temporary parking condition is not met, displaying information to the outside of the vehicle to prompt the parking place of the passenger;
and the intelligent cockpit interaction module is used for interacting with a driver in a click or voice mode.
8. An electronic device, comprising: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory has stored therein a computer program which, when executed by the processor, causes the processor to perform the steps of the method of any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that it stores a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the method of any one of claims 1 to 6.
10. The utility model provides a vehicle with intelligent recognition passerby intention function of taking a car which characterized in that specifically includes:
an electronic device for implementing the steps of the method of any one of claims 1 to 6;
a processor running a program, data output from the electronic device when the program is running performing the steps of the method of any of claims 1 to 6;
storage medium for storing a program which, when executed, performs the steps of the method of any one of claims 1 to 6 on data output from an electronic device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210647142.1A CN115146830A (en) | 2022-06-08 | 2022-06-08 | Method and system for intelligently identifying taxi taking intention of passerby and vehicle thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210647142.1A CN115146830A (en) | 2022-06-08 | 2022-06-08 | Method and system for intelligently identifying taxi taking intention of passerby and vehicle thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115146830A true CN115146830A (en) | 2022-10-04 |
Family
ID=83408333
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210647142.1A Pending CN115146830A (en) | 2022-06-08 | 2022-06-08 | Method and system for intelligently identifying taxi taking intention of passerby and vehicle thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115146830A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117831122A (en) * | 2023-12-20 | 2024-04-05 | 慧之安信息技术股份有限公司 | Underground vehicle-booking method and system based on gesture recognition |
-
2022
- 2022-06-08 CN CN202210647142.1A patent/CN115146830A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117831122A (en) * | 2023-12-20 | 2024-04-05 | 慧之安信息技术股份有限公司 | Underground vehicle-booking method and system based on gesture recognition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113284366B (en) | Vehicle blind area early warning method, early warning device, MEC platform and storage medium | |
| AU2017383463B2 (en) | On-demand roadway stewardship system | |
| CN109345829B (en) | Unmanned vehicle monitoring method, device, equipment and storage medium | |
| EP4283575A2 (en) | Detection of driving actions that mitigate risk | |
| CN112041908A (en) | System and method for monitoring traffic sign violations | |
| CN111368612B (en) | Overguard detection system, personnel detection method and electronic equipment | |
| CN111382735B (en) | Night vehicle detection method, device, equipment and storage medium | |
| CN112085953B (en) | Traffic command method, device and equipment | |
| CN113569698B (en) | Vehicle monitoring method, vehicle and computer readable storage medium | |
| CN112381014A (en) | Illegal parking vehicle detection and management method and system based on urban road | |
| CN114758297A (en) | Traffic incident detection method and system based on fusion of radar and video | |
| CN115146830A (en) | Method and system for intelligently identifying taxi taking intention of passerby and vehicle thereof | |
| CN115416651A (en) | Method and device for monitoring obstacles in driving process and electronic equipment | |
| CN112906486B (en) | Passenger condition detection method, control method and system for unmanned taxi | |
| CN110087026A (en) | A kind of vehicle double screen multi-cam monitoring system | |
| CN110706115A (en) | Traffic accident fast claims settlement method, system and server | |
| CN111523368B (en) | Information processing device, server, and traffic management system | |
| JP2023130394A (en) | System, program, and the like | |
| CN114693722B (en) | Vehicle driving behavior detection method, detection device and detection equipment | |
| CN110996053B (en) | Environment safety detection method and device, terminal and storage medium | |
| CN114399671A (en) | Target identification method and device | |
| JP7364365B2 (en) | Onboard equipment and driving evaluation system | |
| CN108664695B (en) | System for simulating vehicle accident and application thereof | |
| JP7207912B2 (en) | Driving evaluation system | |
| CN113378972B (en) | License plate recognition method and system under complex scene |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |