CN116409239A - Risk prompting method, risk prompting device, risk prompting equipment, risk prompting medium and risk prompting product - Google Patents

Risk prompting method, risk prompting device, risk prompting equipment, risk prompting medium and risk prompting product Download PDF

Info

Publication number
CN116409239A
CN116409239A CN202211552531.2A CN202211552531A CN116409239A CN 116409239 A CN116409239 A CN 116409239A CN 202211552531 A CN202211552531 A CN 202211552531A CN 116409239 A CN116409239 A CN 116409239A
Authority
CN
China
Prior art keywords
risk
door
area
risk level
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211552531.2A
Other languages
Chinese (zh)
Inventor
罗晓薇
阮春彬
徐哲
易小江
刘书奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Voyager Technology Co Ltd
Original Assignee
Beijing Voyager Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Voyager Technology Co Ltd filed Critical Beijing Voyager Technology Co Ltd
Priority to CN202211552531.2A priority Critical patent/CN116409239A/en
Publication of CN116409239A publication Critical patent/CN116409239A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B60Q9/008Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)

Abstract

According to embodiments of the present disclosure, a risk prompting method, apparatus, electronic device, computer storage medium, and computer program product are provided. The method described herein comprises: sensing a target area associated with a door of the vehicle in response to the vehicle reaching a predetermined location; responsive to sensing a risk object associated with the target area, determining a risk level related to movement of the vehicle door based at least on a movement relationship of the risk object relative to the target area; and enabling the terminal equipment to present prompt information corresponding to the risk level. In this way, the intelligent degree of the vehicle is improved, the identification accuracy of potential safety hazards in the vehicle operation process is enhanced, and potential risks are timely prompted to users. Therefore, the travel efficiency can be improved, and meanwhile, the safety of traffic participants can be guaranteed.

Description

Risk prompting method, risk prompting device, risk prompting equipment, risk prompting medium and risk prompting product
Technical Field
Example embodiments of the present disclosure relate generally to the field of computers, and more particularly, relate to a method, apparatus, electronic device, computer storage medium, and computer program product for risk prompting.
Background
With the rapid development of technologies such as automatic control, assisted driving, environment sensing, information fusion and the like, vehicles with autonomous planning and decision making capabilities are currently emerging. Such vehicles can be partially or completely out of the driver's control, even enabling unmanned operation. On the other hand, such scenes sometimes rely on direct interaction of the passenger with the vehicle. Thus, automation and intellectualization of vehicles face challenges in terms of traffic safety, user experience, etc.
Disclosure of Invention
In a first aspect of the present disclosure, a risk prompting method is provided. The method comprises the following steps: sensing a target area associated with a door of the vehicle in response to the vehicle reaching a predetermined location; responsive to sensing a risk object associated with the target area, determining a risk level related to movement of the vehicle door based at least on a movement relationship of the risk object relative to the target area; and enabling the terminal equipment to present prompt information corresponding to the risk level.
In a second aspect of the present disclosure, a risk prompting method is provided. The method comprises the following steps: acquiring, via the terminal device, a risk level relating to movement of a door of the vehicle in response to the vehicle reaching a predetermined position; and presenting prompt information corresponding to the risk level.
In a third aspect of the present disclosure, an apparatus for suggesting risk is provided. The device comprises: a sensing module configured to sense a target area associated with a door of a vehicle in response to the vehicle reaching a predetermined location; a risk level determination module configured to determine a risk level related to movement of the vehicle door based at least on a movement relationship of the risk object relative to the target area in response to sensing the risk object associated with the target area; and the sending module is configured to enable the terminal equipment to present prompt information corresponding to the risk level.
In a fourth aspect of the present disclosure, an apparatus for suggesting risk is provided. The device comprises: an acquisition module configured to acquire, via the terminal device, a risk level related to movement of a door of the vehicle in response to the vehicle reaching a predetermined position; and a presentation module configured to present the prompt information corresponding to the risk level.
In a fifth aspect of the present disclosure, there is provided an electronic device comprising: at least one processing unit; and at least one memory coupled to the at least one processing unit and storing computer-executable instructions that, when executed by the at least one processing unit, cause the electronic device to perform the method according to the first or second aspect of the present disclosure.
In a sixth aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon computer executable instructions, wherein the computer executable instructions are executed by a processor to implement a method according to the first or second aspect of the present disclosure.
In a seventh aspect of the present disclosure, a computer program product is provided. The computer program product is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions that, when executed, cause a processor to perform a method according to the first or second aspect of the present disclosure.
According to various embodiments of the present disclosure, a risk prompting scheme is provided. According to the scheme, in a scene of getting on or off a user, the area near the vehicle can be monitored, and corresponding prompts are provided for the user according to whether potential safety hazards exist in the area. The door may also be automatically locked when necessary. Therefore, the vehicle door is prevented from colliding with pedestrians or other vehicles around the vehicle when being opened or closed, and damage is avoided. In addition, the size of the monitored area may vary based on the type of traffic participant that may pose a safety hazard, which may more accurately predict the movement trajectories of the traffic participants and determine the risk level. In this way, the driving safety is enhanced, the intelligent degree of the vehicle is promoted, and the user experience is improved.
Drawings
The above and other features, advantages and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, wherein like or similar reference numerals designate like or similar elements, and wherein:
FIG. 1 illustrates a block diagram of an example environment in which some embodiments of the disclosure can be implemented;
FIG. 2 illustrates a schematic view of a target area associated with a vehicle in accordance with some embodiments of the present disclosure;
FIG. 3 illustrates a schematic diagram of an exemplary process for suggesting risk according to some embodiments of the present disclosure;
fig. 4A-4C illustrate schematic diagrams of exemplary target areas according to some embodiments of the present disclosure;
5A-5C illustrate schematic diagrams of example User Interfaces (UIs) according to some embodiments of the present disclosure;
FIG. 6 illustrates a schematic diagram of an exemplary process for risk prompting in accordance with some embodiments of the present disclosure;
FIG. 7 illustrates a schematic diagram of an exemplary process for risk prompting in accordance with some embodiments of the present disclosure;
fig. 8 illustrates a schematic block diagram of an apparatus for risk prompting in accordance with some embodiments of the present disclosure;
fig. 9 shows a schematic block diagram of an apparatus for risk prompting in accordance with some embodiments of the present disclosure; and
Fig. 10 illustrates a block diagram of an electronic device capable of implementing various embodiments of the present disclosure.
Detailed Description
Preferred implementations of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the preferred implementations of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the implementations set forth herein. Rather, these implementations are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The term "comprising" and variations thereof as used herein means open ended, i.e., "including but not limited to. The term "or" means "and/or" unless specifically stated otherwise. The term "based on" means "based at least in part on". The terms "one example implementation" and "one implementation" mean "at least one example implementation". The term "another implementation" means "at least one additional implementation". The terms "first," "second," and the like, may refer to different or the same object. Other explicit and implicit definitions are also possible below.
In the technical scheme of the disclosure, the acquisition, storage, application and the like of the related user data all conform to the regulations of related laws and regulations and do not violate the popular regulations.
It will be appreciated that prior to using the technical solutions disclosed in the embodiments of the present disclosure, the user should be informed and authorized of the type, usage range, usage scenario, etc. of the personal information related to the present disclosure in an appropriate manner according to relevant legal regulations.
For example, in response to receiving an active request from a user, prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed will require obtaining and using personal information to the user, so that the user may autonomously select whether to provide personal information to software or hardware such as an electronic device, an application, a server, or a storage medium that performs the operation of the technical solution of the present disclosure according to the prompt information.
As an alternative but non-limiting implementation, in response to receiving an active request from a user, the prompt information may be sent to the user, for example, in a pop-up window, where the prompt information may be presented in text. In addition, a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device may also be carried in the pop-up window.
It will be appreciated that the above-described notification and user authorization process is merely illustrative and not limiting of the implementations of the present disclosure, and that other ways of satisfying relevant legal regulations may be applied to the implementations of the present disclosure.
In a riding scene, passengers may get on or off the vehicle in an incorrect manner, which may cause potential safety hazards. For example, a passenger may get off the vehicle by opening the door without taking care of the traffic conditions around the vehicle, and may collide with other traffic participants (e.g., pedestrians, bicycles, etc.) that suddenly appear behind the vehicle. Often, drivers are predictive of these safety hazards, and may alert passengers to get on and off the right side door, keep track of the surroundings of the door before opening and closing the door, and so forth. In addition, the driver may signal or lock the door in the event of an emergency to avoid dangerous situations.
As previously mentioned, with the increasing degree of automation and intellectualization of vehicles, unmanned operation of vehicles has been possible. In particular, in an unmanned scenario, there may be no driver, only passengers and vehicles, such vehicles also being referred to as autonomous vehicles. The autonomous vehicle may provide travel services to the user as a shared car or taxi. For example, an autonomous vehicle travels to a departure point of travel for a ride and carries passengers to an end of travel. After the passenger gets off the vehicle, the autonomous vehicle may end the current order and receive a new order for the travel service delegate.
In the above scenario, since no driver takes precautions against the potential safety hazard, passengers are likely to physically contact or collide with other traffic participants on the side of the door during the door opening or closing process, even causing casualties and vehicle damage. Even with the assistance of a driver or a safety officer, dangerous conditions around the vehicle may not be noticed due to visual blind areas or negligence.
In view of this, embodiments of the present disclosure propose a risk prompting scheme. The area around the vehicle can be sensed to this scheme to the potential safety hazard in the discernment area. Different potential safety hazards can correspond to different risk levels, and corresponding prompt information can be provided for a user. The prompt information may take one or more forms to ensure that the user perceives the safety hazard in time. In addition, in order to effectively avoid the occurrence of dangers, measures such as automatic falling locking and the like can be adopted aiming at risks of higher grades. In this way, the degree of intellectualization of the vehicle can be further improved, while ensuring travel safety of the user.
Some example embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.
FIG. 1 illustrates a block diagram of an example environment 100 in which some embodiments of the disclosure can be implemented. The example environment 100 includes a vehicle 10 having a vehicle control unit 110 and sensors 112 and 114 mounted throughout the vehicle 10. In addition, the example environment 100 also includes a terminal device 120 associated with the user 102.
With the aid of the vehicle control unit 110 and the sensors 112 and 114, the vehicle 10 may have environmental awareness and analytical decision-making capabilities. Thus, the vehicle 10 may perform its respective task autonomously, with little or no human handling required. Such tasks may include, but are not limited to, automatically opening and closing doors, automatically stopping, route planning, speed limit adjustment, obstacle avoidance, unmanned, and the like. By way of example, the vehicle 10 may be any conventional or non-conventional vehicle for carrying passengers or cargo, including but not limited to a car, sedan, van, truck, bus, electric vehicle, and the like. It should be appreciated that the vehicle 10 may have other elements, hardware mechanisms, or actuators in addition to the components shown in FIG. 1. Accordingly, the scope of the present disclosure is not limited in this respect.
The vehicle control unit 110 may be, for example, an automated driving control unit (ACU). In some embodiments, the vehicle control unit 110 may perform analysis and decision making based on data collected by the sensors 112 and 114, as will be described in detail below. Additionally or alternatively, the vehicle control unit 110 may also communicate with a remote server (not shown) via a network.
In some embodiments of the present disclosure, sensor 112 and sensor 114 may be the same type of sensor or may be different types of sensors. As an example implementation, the sensors 112 and 114 may include, but are not limited to, ranging and/or speed radars, vision sensors, infrared sensors, etc. installed throughout the vehicle 10 for purposes of monitoring, obstacle avoidance, collision prediction, etc. It should be understood that the number and location of the sensors shown in fig. 1 are exemplary only and not limiting.
The terminal device 120 may be installed with an application for interacting with the vehicle 10, such as a vehicle control application, an application providing travel services or call services, and the like. In addition, the user 102 may operate the application through a User Interface (UI) presented by the terminal device 120 to interact with the vehicle 10.
The vehicle control unit 110 may communicate with the terminal device 120. In some embodiments, the terminal device 120 may communicate with the vehicle control unit 110 through a remote server (not shown). In other embodiments, the terminal device 20 may communicate with the vehicle control unit 110 by means of a short-range communication channel. This may depend on the distance between the vehicle 10 and the terminal device 120. For example, the near field communication channel may be a channel based on bluetooth, near field communication, wireless local area network, infrared data transmission, ultraviolet communication, or the like.
In some embodiments, terminal device 120 may be any device having wired or wireless communication capabilities and possibly also computing capabilities, including, but not limited to, a communication device, a cell phone, a computer, a personal digital assistant, a gaming device, a wearable device, an in-vehicle communication device, a control panel, and the like. The terminal device 120 may provide input means such as a mouse, keyboard, etc. for the user 102 to operate. Furthermore, the terminal device 120 may be further equipped with positioning means to determine its position, which positioning means may for example be based on any of the following techniques: global Positioning System (GPS), global navigation satellite system (GLONASS), beidou navigation system, galileo positioning system (Galileo), quasi zenith satellite system (QAZZ), base station positioning technology, wi-Fi positioning technology, and so forth.
The remote server may be a server or computing system of a service provider that may provide data storage, analysis, processing, etc. functions. In some embodiments, a remote server may access a data store to store information thereto or to retrieve desired information therefrom. The remote server may be separate from the data store or may be implemented as a single device, e.g., the data store is implemented in the remote server. In some embodiments, the remote server may be located at the cloud.
As an example scenario, the user 102 may send a call request to a remote server (not shown) through an application on the terminal device 120 to obtain travel services. In some embodiments, the remote server may select a vehicle, such as vehicle 10, suitable for servicing user 102 based on the current location of user 102, departure point, destination point, etc. information associated with the call request. The remote server may then send a dispatch indication to the vehicle 10 to take the vehicle 10 to the departure point. After receiving the user 102, the vehicle 10 carries the user 102 to the destination.
The vehicle 10 may be sensed by the sensors 112 and 114 for areas of potential safety hazard near the vehicle before reaching the end point and opening the door. In the context of the disclosed embodiments, the area where there is a safety hazard is also referred to as a target area.
Fig. 2 illustrates a schematic diagram of a target area associated with a vehicle according to some embodiments of the present disclosure. In the scenario 200 shown in fig. 2, the vehicle is a left-rudder vehicle, in which case the doors on the right side of the vehicle may be used to get on and off the vehicle. During the opening or closing of the door, a collision may occur with a traffic participant present on the right side of the vehicle. Thus, traffic participants are also referred to as risk objects.
Traffic participants may include, but are not limited to, pedestrians 32, non-motorized vehicles 34 (e.g., bicycles, motorcycles, etc.). In addition, where the lane in which the vehicle 10 is located is not the rightmost lane, the traffic participant may also include a motor vehicle 36. In some embodiments, the risk subject may also include animals, obstructions, and the like.
In some embodiments, the target area may include a door movement area and/or a risk area adjacent to the door movement area. As shown in fig. 2, the door movement area is an area 202, i.e., an area through which the door passes during opening or closing of the door. The risk areas adjacent to the door motion area 202 may include areas adjacent to the door motion area in the front, rear, lateral directions, for example, areas 212 and 214. Other traffic participants may enter the door movement area via the risk area.
In some embodiments, the vehicle control unit 110 may determine whether a risk object exists within or near the target area through the sensing results of the sensors 112 and 114. If a risk object is present, the vehicle control unit 110 may determine a movement relationship of the risk object with respect to the target area based on the sensed data. For example, the motion relationship may include a predicted motion trajectory 301, 302, or 303 of the risk object.
The vehicle control unit 110 may determine a risk level related to movement of the door based on the movement relationship. In some embodiments, the type of risk object, the lane in which the vehicle 10 is located, etc. may also be considered in determining the risk level. Further, the vehicle control unit 110 may cause the terminal device 120 to present the prompt information corresponding to the risk level. For example, the vehicle control unit 110 may transmit the risk level to the terminal device 120, so that the terminal device 120 presents the prompt information corresponding to the risk level to the user. Additionally or alternatively, the vehicle control unit 110 may send the risk level to a server and to the terminal device 120 via the server for presenting the user with prompt information corresponding to the risk level. This will be discussed in more detail below.
It should be appreciated that embodiments of the present disclosure are not limited to the application scenario of left-rudder vehicles, but are applicable to any type of vehicle. In addition, the use for getting on and off is not limited to a fixed-side door. In some embodiments, the door may include a cab door, a passenger side door, a user compartment door, a trunk door, and the like.
It should be appreciated that the layout, functionality, and number of elements in environment 100 are described for illustrative purposes only, and that various designs may actually exist. Embodiments of the present disclosure may also be applied in environments having different structures and/or functions. The scope of the present disclosure is not limited in this respect.
Specific procedures and details for unlocking the vehicle door will be described in detail with continued reference to the accompanying drawings. Further, embodiments will be described hereinafter with reference to example states of several UIs. It should be understood that these UIs and interactions are merely illustrative and that various interface designs and interactions may exist in practice. In addition, the controls included in these UIs can be implemented with any presently known or future developed UI elements and techniques. Further, the type, form, manner of operation, layout, arrangement, etc. of these controls in the UI are illustrative and are not intended to limit the scope of the present disclosure in any way.
Fig. 3 illustrates a schematic diagram of an exemplary process 300 for risk prompting in accordance with some embodiments of the present disclosure. For ease of discussion, an example embodiment of door unlocking will be described with reference to fig. 1. The process 300 may involve the control unit 110, the sensors 112 and 114, and the terminal device 120 of the vehicle 10 in the environment 100. It should be appreciated that process 300 may be applicable to various types of vehicles as well as various travel scenarios, including, but not limited to, passenger loading, logistics, delivery courier, takeaway, cargo, and the like.
In one example scenario of process 300, user 102 travels on vehicle 10. In the event that the vehicle 10 reaches a predetermined position, the vehicle control unit 110 senses 305 a target area associated with a door of the vehicle 10. For example, the vehicle control unit 110 may sense the target area with the sensors 112 and 114 to determine whether a risk object is present within or near the target area.
The predetermined location may include, but is not limited to, a start point, an end point, a middle point, etc. of the trip. In some embodiments, after reaching the predetermined location, the terminal device 120 may send 310 an unlock indication for the vehicle door to the vehicle 10 to trigger the vehicle control unit 110 to sense for the target area. Of course, it should be understood that an unlock indication is not necessary for execution of process 300. In other embodiments, the vehicle control unit 110 may automatically perform subsequent actions of the process 300 based on the vehicle reaching a predetermined location.
In some embodiments, the target area may include a door movement area and a risk area adjacent to the door movement area. For example, the length of the door movement region may be determined based on the door length and an optional safety factor (e.g., 1.2). Since the region of door movement is fan-shaped, the width of the door movement region can also be determined on the basis of the door length and optionally the safety factor.
Taking a passenger compartment door as an example, the length of the rear door may be determined based on the distance between the B-pillar and the C-pillar of the vehicle. Assuming that the distance between the B pillar and the C pillar is 0.82m and the safety factor is 1.2, the length l1=0.82×1.2=0.984 m of the door movement region and the length w1=0.82×1.2=0.984 m of the door movement region can be obtained.
The movement speed, acceleration of different types of risk objects are different, the required braking distance is also different, and thus the size of the sensed risk area may also be different. In some embodiments, the target area associated with the risk object may be determined based on the type, overall size, braking distance corresponding to the road surface condition (e.g., wet and dry state), and size of the vehicle 10.
Fig. 4A-4C illustrate schematic diagrams of exemplary target areas according to some embodiments of the present disclosure. In the example scenario 400 of fig. 4A, the type of risk object is a pedestrian 32. The movement speed of the pedestrian is low, the braking distance is short, the movement track is flexible, and the pedestrian can possibly enter the target area from all directions. Thus, the length of the risk areas 402 and 404 may be determined based on the braking distance of the pedestrian 32 and, optionally, the safety factor. Further, the stopping distance of the pedestrian 32 may be determined based on the reaction time and running speed of the pedestrian. As an example, assuming that the reaction time of the pedestrian is 0.3s, the running speed is 3.3m per second, and the safety factor is 1.2, it is possible to obtain a length l2=0.3×3.3×1.2×1.2m of the risk area corresponding to the pedestrian, and a width W2 of the risk area may be the same as or similar to a length W1 of the door movement area.
In the example scenario 410 illustrated in fig. 4B, the type of risk object is a non-motor vehicle 34. The speed of movement of a non-motor vehicle is generally higher than that of a pedestrian, and thus the braking distance is also longer than that of a pedestrian. In addition, the motion trail of the non-motor vehicle is also relatively flexible, and the non-motor vehicle can enter the target area from all directions. For example, in the event that the non-motor vehicle is traveling in reverse approaching the vehicle, the non-motor vehicle may enter the target area from a risk area 414 in front of the door movement area 202. The length of the risk zones 412 and 414 may be determined based on the maximum braking distance of the non-motor vehicle 34, and optionally a safety factor. As an example, assuming a maximum braking distance of 13.86m for the non-motor vehicle 34 and a safety factor of 1.2, it is possible to obtain a length l3=13.86×1.2=16.63 m of the risk zone corresponding to the non-motor vehicle, and a width W3 of the risk zone may be the same as or similar to a length W1 of the door movement zone.
In the example scenario 420 illustrated in fig. 4C, the type of risk object is a motor vehicle 36. Motor vehicles typically move at a higher speed than non-motor vehicles and pedestrians, and thus require longer braking distances. In addition, the motion trail of the motor vehicle is limited. For example, when the lane in which the vehicle 10 is located is the outermost lane, there is a low possibility that other vehicles are sensed in the target area on the right side of the vehicle. The length of the risk zone 424 may be determined based on the maximum braking distance of the motor vehicle 36 and an optional safety factor. As an example, assuming a maximum braking distance of 30.75m for the motor vehicle 36 and a safety factor of 1.2, a length l4=30.75×1.2=36.9 m of the risk zone corresponding to the non-motor vehicle can be obtained, and the width W4 of the risk zone can be the same as or similar to the length W1 of the door movement zone. Additionally or alternatively, in the event that the vehicle is traveling in reverse approaching the vehicle, the vehicle may enter the target area from a risk area 424 forward of the door movement area 202. In this case, the length of the risk area 424 may be set to any suitable value.
As is clear from fig. 4A to 4C, the range of the target area corresponding to the pedestrian is small, in the range of the target area corresponding to the non-motor vehicle, or the like, while the range of the target area corresponding to the motor vehicle is large.
In some embodiments, the vehicle control unit 110 may determine the risk area based on the type of the risk object. Further, as previously described, the vehicle control unit 110 may determine the type of risk object to be focused on based on the lane in which the vehicle 10 is located. If the vehicle 10 is in the outermost lane, the risk object type is less likely to be a motor vehicle. In this case, only the type of risk object other than the motor vehicle (e.g., non-motor vehicle, pedestrian) may be focused on. If the vehicle 10 is not in the outermost lane, the types of risk objects may include motor vehicles, non-motor vehicles, pedestrians, and the like. Further, the vehicle control unit 110 senses the door movement region and the corresponding risk region.
If a risk object associated with the target area is sensed, at 315, the vehicle control unit 110 determines a risk level related to movement of the vehicle door based at least on a movement relationship of the risk object relative to the target area.
In some embodiments, the motion relationship of the risk object relative to the target area may include a predicted motion profile of the risk area within the door motion area and/or the risk area. As an example, if the risk object is already located or will enter the door movement area within a first predetermined time (e.g., 3 s), such as trajectory 406 shown in fig. 4A, trajectory 416 shown in fig. 4B, trajectory 426 shown in fig. 4C, in which case the likelihood of the door transmitting a collision with the risk object during opening is high. Thus, the risk level may be determined as a high risk level, for example, the first risk level P0.
Additionally, if the risk object is already in the risk area but does not enter the door movement area within a first predetermined time (e.g., 3 s), for example, the risk object moves slowly or stays within the risk area, in which case the door is less likely to send a collision with the risk object during opening. Thus, the risk level may be determined as a risk level, e.g., a second risk level P1.
Additionally, if the risk object is located in or about to enter the risk area, but does not enter the door movement area for a first predetermined time (e.g., 3 s), and will leave the risk area for the first predetermined time, such as track 407 shown in fig. 4A, track 417 shown in fig. 4B, track 427 shown in fig. 4C, in which case the likelihood of the door transmitting a collision with the risk object during opening is low. Thus, the risk level may be determined as a low risk level, e.g., a third risk level P2.
Additionally, if the risk object is outside the target area and does not enter the target area for a second predetermined time, such as trajectory 408 shown in FIG. 4A, trajectory 418 shown in FIG. 4B, trajectory 428 shown in FIG. 4C, in which case the likelihood of the door transmitting a collision with the risk object during opening is low. The risk level may thus be determined as a low risk level, e.g. a third risk level P2.
At 320, the vehicle control unit 110 transmits a prompt message corresponding to the risk level to the terminal device 120. For example, the prompt information may include an image prompt for the movement relationship of the risk object relative to the target area, a voice prompt for the risk level, and a text prompt for the risk level. Table 1 below shows hints for different risk levels.
TABLE 1 prompt for different risk classes
Figure BDA0003981906800000121
Figure BDA0003981906800000131
After receiving the alert message, the terminal device 120 presents the alert message at 325. Thus, the user 102 can be reminded to pay attention to the traffic conditions around the vehicle before opening the door, avoiding collision.
In some embodiments, the risk level may indicate that door movement will cause the door to collide with a risk object. In this case, the vehicle control unit 110 may control the door to be locked at 330.
Additionally or alternatively, in some embodiments, the terminal device 120 may present a prompt to the user 102 for door locking. Accordingly, at 335, the terminal device 120 may send an unlock request to the vehicle control unit 110.
At 340, the vehicle control unit 110 may begin timing after the door is locked, or alternatively after receiving an unlock request. If no risk object is sensed within the target area after the timing is over (e.g., after a predetermined period of time), the vehicle control unit 110 may control the door to be unlocked at 345. In this way, after the potential safety hazard is eliminated, the door is automatically unlocked for the user.
Fig. 5A-5C illustrate schematic diagrams of example User Interfaces (UIs) according to some embodiments of the present disclosure. In the example of fig. 5A, the vehicle 10 arrives at the predetermined location 501, the vehicle control unit 110 senses for the target area 502 and determines that the risk object 511 will enter the door movement area within a predetermined time, and thus the risk level is a first risk level (e.g., P0).
In the example interface 500, the presented prompt may include, for example, "end-point reached, please note that the coming car behind-! "or the like. In addition, the terminal device 120 may also report the prompt information to the user 102 in a voice prompt manner. Additionally or alternatively, the presented hints information also includes image hints of the motion relationship of the risk object 511 relative to the target region 512. For example, the image cues may be animated cues of the predicted motion trajectory 513 of the risk object.
Additionally or alternatively, to ensure that the door is not opened, the vehicle control unit 110 may control the door to be locked. Accordingly, the prompt indicates that the door is locked. In this case, the terminal device 120 may present the user 102 with an unlock option for the vehicle door. As shown in fig. 5A, the user interface 500 includes a control 530 for controlling the unlock option.
In the example of fig. 5B, the vehicle 10 arrives at the predetermined location 501, the vehicle control unit 110 senses for the target area 502 and determines that the risk object 511 is located in the risk area 512 and does not enter the door movement area for a predetermined time, and thus, the risk level is a second risk level (e.g., P1).
In the example interface 510, the presented prompt may include, for example, "end-point has been reached, please note the next car when getting off-! "or the like. In addition, the terminal device 120 may also report the prompt information to the user 102 in a voice prompt manner. Additionally or alternatively, the presented hints information also includes image hints 513 of the motion relationship of the risk object 511 relative to the target region 512. In addition, the example interface 510 may also include a control 531 for ending an order.
In the example of fig. 5C, the vehicle 10 arrives at the predetermined location 501, the vehicle control unit 110 senses for the target area 502 and determines that the risk object 511 is about to enter the risk area 512, and thus the risk level is a third risk level (e.g., P2).
Because of the low likelihood of a collision at the third risk level, the prompt presented at the example interface 520 may include, for example, "have reached the end point, thank you for your ride-! "or the like. Additionally or alternatively, the presented hints information also includes image hints 513 of the motion relationship of the risk object 511 relative to the target region 512. In addition, the example interface 510 may also include a control 531 for ending an order.
As one example implementation, the image of the predicted motion trajectory may take the form of an animation and display the vehicle location and the location and trajectory of the traffic participant within the risk area in real-time. For example, traffic participants corresponding to different risk levels may be indicated with different models and colors. The render layer model may be color-changed according to the read field. If the output prediction field is not stable, the color may continue to flash or even be unrecognizable. If the output color can be stabilized, prediction stabilization is indicated.
Conversely, if the risk level determined in 315 indicates that door movement will not result in a collision of the door with a risk object, the vehicle control unit 110 may control the door to be unlocked. In such embodiments, the vehicle control unit 110 may determine whether the user 102 is getting off after the door is unlocked. For example, conditions inside the vehicle may be sensed by means of sensors of the vehicle 10. The sensors may include, but are not limited to, visual sensors, weight sensors, temperature sensors, and the like. The vehicle control unit 110 may in turn determine whether the user 102 is getting off based on the data collected by the sensors.
In some embodiments, the vehicle control unit 110 may send a reminder to the terminal device 120 if the user 102 has not been getting off after a predetermined period of time. Additionally or alternatively, the vehicle control unit 110 may report the abnormal situation to a remote server.
Embodiments of the present disclosure provide a scheme for risk prompting. According to the scheme, the risk objects can be distinguished according to different dangerous scenes, and corresponding sensing areas are defined for different risk objects. Thus, the movement track of the traffic participant in the corresponding sensing area can be predicted and the risk level can be determined. In this way, the vehicle can accurately identify potential safety hazards and timely prompt the user of potential risks. Therefore, travel safety can be guaranteed, and the intelligent degree of the vehicle is improved.
Fig. 6 illustrates a schematic diagram of an exemplary process 600 for risk prompting in accordance with some embodiments of the present disclosure. Process 600 may be implemented by a vehicle control unit 110 as shown in fig. 1. Of course, in other embodiments, process 600 may be implemented by any suitable other electronic device. It should be appreciated that process 600 is applicable to a variety of vehicle travel scenarios including, but not limited to, passenger loading, logistics, delivery courier, takeaway, cargo, and the like.
As shown in fig. 6, at block 610, the vehicle control unit 110 determines whether the vehicle 10 has reached a predetermined location. For example, the predetermined location may include, but is not limited to, a start point, an end point, a middle point, and the like of the trip.
If the predetermined location is reached, at block 620, the vehicle control unit 110 senses for a target area associated with a door of the vehicle. For example, the target area may include at least a door movement area and a risk area adjacent to the door movement area. Specifically, the door movement region may include a region through which the door passes during a door opening or closing process. The risk area adjacent to the door motion area may include an area adjacent to the door motion area in the front, rear, lateral direction.
In some embodiments, if the type of the risk object is a pedestrian, a first region adjacent to the door movement region may be determined as a risk region. If the type of the risk object is a non-motor vehicle, a second region adjacent to the door movement region may be determined as a risk region. Since the moving speed of the non-motor vehicle is generally greater than the moving speed of the pedestrian, the area of the second region may be greater than the area of the first region. If the type of risk object is a motor vehicle, a third region adjacent to the door movement region may be determined as a risk region. Since the moving speed of the motor vehicle is generally greater than that of the non-motor vehicle or the pedestrian, the area of the third region is greater than that of the second region. Further, the vehicle control unit 110 may determine the risk level based on the movement relationship of the risk object with respect to the door movement region and the risk region.
In some embodiments the door may include, but is not limited to, a cockpit door, a passenger side door, a passenger cabin door, a trunk door, and the like.
For example, risk objects may include, but are not limited to, motor vehicles, non-motor vehicles, pedestrians, animals, obstacles, and the like.
If a risk object associated with the target area is sensed, at block 630, the vehicle control unit 110 determines a risk level related to movement of the vehicle door based at least on a movement relationship of the risk object relative to the target area.
In some embodiments, determining the risk level includes: determining a risk area based on the type of the risk object; and determining a risk level based at least on the movement relationship of the risk object relative to the door movement region and the risk region.
In some embodiments, determining the risk level related to movement of the vehicle door may include: determining a risk level as a first risk level in response to the risk object being located or being about to enter the door movement area within a first predetermined time; determining the risk level as a second risk level in response to the risk object being in the risk area and not entering the door movement area for a first predetermined time, wherein the second risk level is lower than the first risk level; in response to the risk object being at or about to enter the risk area and being about to leave the risk area within the first predetermined time, determining the risk level as a third risk level, wherein the third risk level is lower than the second risk level; and determining the risk level as a third risk level in response to the risk object being outside the target area and not entering the target area for a second predetermined time.
In some embodiments, determining the risk level related to movement of the vehicle door may include: determining the type of a risk object to be focused on based on a lane in which the vehicle is located; determining a risk area based on the type of the risk object; and determining a risk level based at least on the movement relationship of the risk object relative to the door movement region and the risk region.
At block 640, the vehicle control unit 110 causes the terminal device 120 to present a prompt corresponding to the risk level. In some embodiments, the vehicle control unit 110 may directly send the risk level to the terminal device 120, so that the terminal device 120 presents the prompt information corresponding to the risk level to the user. Additionally or alternatively, the vehicle control unit 110 may send the risk level to a remote server and to the terminal device 120 via the remote server for presenting a prompt corresponding to the risk level to the user.
In some embodiments, the hint information includes at least one of: image prompt of the motion relation of the risk object relative to the target area, voice prompt aiming at the risk level and text prompt aiming at the risk level.
By way of example, the prompt may include a text or voice prompt such as "please note rear traffic participant when getting off" and/or an animated prompt of the predicted motion profile of the risk object. Thus, the user 102 can be alerted to traffic conditions around the vehicle before the door is opened.
As one example implementation, the image of the predicted motion trajectory may take the form of an animation and display the vehicle location and the location and trajectory of the traffic participant within the risk area in real-time. For example, traffic participants corresponding to different risk levels may be indicated with different models and colors. The render layer model may be color-changed according to the read field. If the output prediction field is not stable, the color may continue to flash or even be unrecognizable. If the output color can be stabilized, prediction stabilization is indicated.
In one example implementation, where the risk level is a third risk level (e.g., P2), the likelihood of a collision caused by opening the door is low, and the hint information may include only an image of the predicted motion profile of the risk object. In the case where the risk level is the first risk level (e.g., P0) or the second risk level (e.g., P1), the possibility of collision caused by opening the door increases, and the prompt information may further include a voice prompt and/or a text prompt for the risk level in addition to the image of the predicted motion trajectory of the risk object. Additionally or alternatively, in the event that the risk level is the first risk level, the vehicle control unit 110 may control the door to be locked, whether or not the door was previously unlocked.
In some embodiments, the method 600 further comprises: controlling the door to be locked in response to the risk level indicating that door movement will cause the door to collide with the risk object; and controlling the door to be unlocked in response to the risk level indicating that the door movement will not result in the door colliding with the risk object. For example, in the case where the risk level is the first risk level, if the moving speed of the risk object is faster or closer to the door, the door opening action is likely to cause a collision. Thus, in this case, the vehicle control unit 110 can ensure that the door is not opened, thereby avoiding danger and loss.
In some embodiments, the method 600 further comprises: sensing for the target area after a predetermined period of time in response to the door being locked; and controlling the door to be unlocked in response to sensing the risk object within the target area. For example, in the event that the first risk level is detected and the door lock is controlled, the vehicle control unit 110 may start timing after the door is locked. If no risk object is sensed within the target area after the timing is over (e.g., after a predetermined period of time), the door may be unlocked. Thus, after the potential safety hazard is eliminated, the vehicle door can be automatically unlocked for the user.
Additionally or alternatively, in case a first risk level is detected and the door lock is controlled, the vehicle control unit 110 detects an unlock request from the terminal device 120. The vehicle control unit 110 may sense for the target area if an unlock request is detected. If a risk object is not sensed, the door may be unlocked. In this way, the user input can be responded in time, the interaction with the user is enhanced, and the user experience is improved.
Additionally or alternatively, in some embodiments, the vehicle control unit 110 may cease sensing the target area based on one or more of receiving an end-of-travel indication, cancelling a sensing indication, or a new travel order. For example, the new travel order may be received from a remote server. The end of travel indication and the cancel sensing indication may be received from the terminal device 110 or a remote server.
Fig. 7 illustrates a schematic diagram of an exemplary process 700 for risk prompting in accordance with some embodiments of the present disclosure. Process 700 may be implemented by terminal device 120 as shown in fig. 1. Of course, in other embodiments, process 700 may be implemented by any suitable other electronic device. It should be appreciated that process 700 is applicable to a variety of vehicle travel scenarios including, but not limited to, passenger loading, logistics, delivery courier, takeaway, cargo, and the like.
At block 710, the terminal device 120 determines whether a predetermined location is reached. For example, the predetermined location may include, but is not limited to, a start point, an end point, a middle point, and the like of the trip.
If the predetermined location is reached, the terminal device 120 obtains a risk level associated with movement of the door of the vehicle 10 at block 720. In some embodiments, the terminal device 120 may receive the risk level directly from the vehicle control unit 110, or alternatively, from a remote server, the risk level determined by the vehicle control unit 110.
In some embodiments the door may include, but is not limited to, a cockpit door, a passenger side door, a passenger cabin door, a trunk door, and the like.
At block 730, the terminal device 120 presents a hint information corresponding to the risk level.
In some embodiments, the hint information includes at least one of: image prompt of the motion relation of the risk object relative to the target area, voice prompt aiming at the risk level and text prompt aiming at the risk level. Risk objects may include, but are not limited to, pedestrians, vehicles, non-vehicles, animals, obstacles, and the like.
As examples, the prompt may include a text or voice prompt such as "please note rear traffic participant when getting off," and/or an image of the predicted motion profile of the risk object. Thus, the user 102 can be alerted to traffic conditions around the vehicle before the door is opened.
As one example implementation, the image of the predicted motion trajectory may take the form of an animation and display the vehicle location and the location and trajectory of the traffic participant within the risk area in real-time. For example, traffic participants corresponding to different risk levels may be indicated with different models and colors. The render layer model may be color-changed according to the read field. If the output prediction field is not stable, the color may continue to flash or even be unrecognizable. If the output color can be stabilized, prediction stabilization is indicated.
In some embodiments, the target area may include at least a door movement area and a risk area adjacent to the door movement area. Specifically, the door movement region may include a region through which the door passes during a door opening or closing process. The risk area adjacent to the door motion area may include an area adjacent to the door motion area in the front, rear, lateral direction.
Additionally or alternatively, in some embodiments, the risk level may include at least one of: a first risk level indicating that a risk object is located or will enter a door movement area within a predetermined time; a second risk level indicating that the risk object is located in the risk area and does not enter the door movement area for a predetermined time, wherein the second risk level is lower than the first risk level; a third risk level indicating that the risk object is at or about to enter the risk area and will leave the risk area within a predetermined time, wherein the third risk level is lower than the second risk level.
In one example implementation, where the risk level is a third risk level (e.g., P2), the likelihood of a collision caused by opening the door is low, and the hint information may include only an image of the predicted motion profile of the risk object. In the case where the risk level is the first risk level (e.g., P0) or the second risk level (e.g., P1), the possibility of collision caused by opening the door increases, and the prompt information may further include a voice prompt and/or a text prompt for the risk level in addition to the image of the predicted motion trajectory of the risk object. Additionally or alternatively, in the event that the risk level is a first risk level, the door may be locked, whether or not the door was previously unlocked.
In some embodiments, the method 700 further comprises: in response to the prompt indicating that the door is locked, an unlock option for the door is presented to the user. In this case, the user 102 may trigger an unlock option via the terminal device 120 to request unlocking of the vehicle door. In this way, the interaction between the user and the vehicle is enhanced, thereby improving the user experience.
Embodiments of the present disclosure also provide corresponding apparatus for implementing the above-described methods or processes. Fig. 8 illustrates a schematic block diagram of an apparatus 800 for risk prompting according to some embodiments of the present disclosure. The apparatus 800 may be implemented as a vehicle control unit 110 of the vehicle 10, or any other electronic device included in the vehicle 10 or integrated within the vehicle 10.
As shown in fig. 8, the apparatus 800 includes a sensing module 810 configured to sense a target area associated with a door of a vehicle in response to the vehicle reaching a predetermined location. The apparatus 800 further includes a risk level determination module 820 configured to determine a risk level related to movement of the vehicle door based at least on a movement relationship of the risk object relative to the target area in response to sensing the risk object associated with the target area. The apparatus 800 further comprises a sending module 830 configured to cause the terminal device to present a prompt corresponding to the risk level.
In some embodiments, the target area includes at least a door movement area and a risk area adjacent to the door movement area, and the risk level determination module is configured to: determining a risk area based on the type of the risk object; and determining a risk level based at least on the movement relationship of the risk object relative to the door movement region and the risk region.
In some embodiments, the risk level determination module is configured to: determining a first region adjacent to the door movement region as a risk region in response to the type of the risk object being a pedestrian; determining a second region adjacent to the door movement region as a risk region in response to the type of the risk object being a non-motor vehicle, the second region having an area greater than an area of the first region; and determining a third region adjacent to the door movement region as a risk region in response to the type of the risk object being a motor vehicle, the third region having an area greater than an area of the second region.
In some embodiments, the target area includes at least a door movement area and a risk area adjacent to the door movement area, and the risk level determination module is configured to: determining a risk level as a first risk level in response to the risk object being located or being about to enter the door movement area within a first predetermined time; determining the risk level as a second risk level in response to the risk object being in the risk area and not entering the door movement area for a first predetermined time, wherein the second risk level is lower than the first risk level; in response to the risk object being at or about to enter the risk area and being about to leave the risk area within the first predetermined time, determining the risk level as a third risk level, wherein the third risk level is lower than the second risk level; and determining the risk level as a third risk level in response to the risk object being outside the target area and not entering the target area for a second predetermined time. The first predetermined time and the second predetermined time may be the same or different.
In some embodiments, the risk level determination module is configured to: determining the type of a risk object to be focused on based on a lane in which the vehicle is located; determining a risk area based on the type of the risk object; and determining a risk level based at least on the movement relationship of the risk object relative to the door movement region and the risk region.
In some embodiments, the hint information includes at least one of: image prompt of the motion relation of the risk object relative to the target area, voice prompt aiming at the risk level and text prompt aiming at the risk level.
In some embodiments, the apparatus 800 further comprises: a first door control module configured to control the door to be locked in response to the risk level indicating that door movement will cause the door to collide with a risk object; and a second door control module configured to control the door to be unlocked in response to the risk level indicating that door movement will not result in the door colliding with the risk object.
In some embodiments, the sensing module 810 is further configured to: sensing for the target area after a predetermined period of time in response to the door being locked; and the second door control module is further configured to control the door to be unlocked in response to the risk object not being sensed in the target area.
Fig. 9 shows a schematic block diagram of an apparatus 900 for risk prompting according to some embodiments of the present disclosure. The apparatus 900 may be implemented as the terminal device 120, or as any other electronic device.
As shown in fig. 9, the apparatus 900 includes a receiving module 910 configured to obtain a risk level related to movement of a door of a vehicle in response to the vehicle reaching a predetermined location. The apparatus 900 further comprises a presentation module 920 configured to present a hint information corresponding to the risk level.
In some embodiments, the hint information includes at least one of: image cues of a movement relationship of a risk object relative to a target area associated with a vehicle door, wherein the risk object comprises at least one of a pedestrian, a motor vehicle, a non-motor vehicle, an animal, an obstacle; voice prompts for risk classes; text prompts for risk classes.
In some embodiments, the target area includes at least a door movement area and a risk area adjacent to the door movement area, and the risk level includes at least one of: a first risk level indicating that the risk object is in or will enter the door movement area within a predetermined time, a second risk level indicating that the risk object is in the risk area and does not enter the door movement area within a predetermined time, wherein the second risk level is lower than the first risk level, a third risk level indicating that the risk object is in or will enter the risk area and will leave the risk area within a predetermined time, wherein the third risk level is lower than the second risk level.
In some embodiments, the presentation module 920 is further configured to: in response to the prompt indicating that the door is locked, an unlock option for the door is presented to the user.
The elements included in apparatus 800 and apparatus 900 may be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units may be implemented using software and/or firmware, such as machine executable instructions stored on a storage medium. In addition to or in lieu of machine-executable instructions, some or all of the elements of apparatus 800 and apparatus 900 may be at least partially implemented by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include Field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standards (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), and the like.
Fig. 10 illustrates a block diagram of an electronic device/server 1000 in which one or more embodiments of the disclosure may be implemented. It should be understood that the electronic device/server 1000 illustrated in fig. 10 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein.
As shown in fig. 10, the electronic device/server 1000 is in the form of a general-purpose electronic device. The components of the electronic device/server 1000 may include, but are not limited to, one or more processors or processing units 1010, memory 1020, storage 1030, one or more communication units 1040, one or more input devices 1050, and one or more output devices 1060. The processing unit 1010 may be an actual or virtual processor and is capable of executing various processes according to programs stored in the memory 1020. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capabilities of the electronic device/server 1000.
The electronic device/server 1000 typically includes a number of computer storage media. Such media can be any available media that is accessible by the electronic device/server 1000 and includes, but is not limited to, volatile and non-volatile media, removable and non-removable media. The memory 1020 may be volatile memory (e.g., registers, cache, random Access Memory (RAM)), non-volatile memory (e.g., read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory), or some combination thereof. Storage 1030 may be a removable or non-removable medium and may include machine-readable media such as flash drives, magnetic disks, or any other medium that may be capable of storing information and/or data (e.g., training data for training) and may be accessed within electronic device/server 1000.
The electronic device/server 1000 may further include additional removable/non-removable, volatile/nonvolatile storage media. Although not shown in fig. 10, a magnetic disk drive for reading from or writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data medium interfaces. Memory 1020 may include a computer program product 1025 having one or more program modules configured to perform the various methods or acts of the various embodiments of the disclosure.
The communication unit 1040 enables communication with other electronic devices through a communication medium. Additionally, the functionality of the components of the electronic device/server 1000 may be implemented in a single computing cluster or in multiple computing machines capable of communicating over a communication connection. Thus, the electronic device/server 1000 may operate in a networked environment using logical connections to one or more other servers, a network Personal Computer (PC), or another network node.
The input device 1050 may be one or more input devices such as a mouse, keyboard, trackball, etc. The output device 1070 may be one or more output devices such as a display, speakers, printer, etc. The electronic device/server 1000 may also communicate with one or more external devices (not shown), such as storage devices, display devices, etc., as needed through the communication unit 1040, with one or more devices that enable a user to interact with the electronic device/server 1000, or with any device (e.g., network card, modem, etc.) that enables the electronic device/server 1000 to communicate with one or more other electronic devices. Such communication may be performed via an input/output (I/O) interface (not shown).
According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which one or more computer instructions are stored, wherein the one or more computer instructions are executed by a processor to implement the method described above.
Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer readable program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable medium having the instructions stored therein includes an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various implementations of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The foregoing description of implementations of the present disclosure has been provided for illustrative purposes, is not exhaustive, and is not limited to the implementations disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the various implementations described. The terminology used herein was chosen in order to best explain the principles of each implementation, the practical application, or the improvement of technology in the marketplace, or to enable others of ordinary skill in the art to understand each implementation disclosed herein.

Claims (17)

1. A risk prompting method, comprising:
sensing a target area associated with a door of a vehicle in response to the vehicle reaching a predetermined location;
responsive to sensing a risk object associated with the target area, determining a risk level related to movement of the vehicle door based at least on a movement relationship of the risk object relative to the target area; and
and enabling the terminal equipment to present prompt information corresponding to the risk level.
2. The method of claim 1, wherein the target area includes at least a door movement area and a risk area adjacent to the door movement area, and wherein determining the risk level includes:
Determining the risk area based on the type of the risk object; and
the risk level is determined based at least on a kinematic relationship of the risk object with respect to the door kinematic region and the risk region.
3. The method of claim 2, wherein determining the risk area based on the type of the risk object comprises:
determining a first region adjacent to the door movement region as the risk region in response to the type of the risk object being a pedestrian;
determining a second region adjacent to the door movement region as the risk region in response to the type of the risk object being a non-motor vehicle, the second region having an area greater than an area of the first region; and
in response to the type of the risk object being a motor vehicle, a third region adjacent to the door movement region is determined as the risk region, the third region having an area greater than an area of the second region.
4. The method of claim 1, wherein the target area includes at least a door movement area and a risk area adjacent to the door movement area, and wherein determining the risk level includes:
In response to the risk object being located or being about to enter the door movement region within a first predetermined time, determining the risk level as a first risk level;
determining the risk level as a second risk level in response to the risk object being located in the risk area and not entering the door movement area for the first predetermined time, wherein the second risk level is lower than the first risk level;
determining the risk level as a third risk level in response to the risk object being at or about to enter the risk area and being about to leave the risk area within the first predetermined time, wherein the third risk level is lower than the second risk level; and
and determining the risk level as the third risk level in response to the risk object being outside the target area and not entering the target area for a second predetermined time.
5. The method of claim 1, wherein the target area includes at least a door movement area and a risk area adjacent to the door movement area, and wherein determining a risk level related to movement of the door comprises:
Determining the type of a risk object to be focused on based on the lane in which the vehicle is located;
determining the risk area based on the type of the risk object; and
the risk level is determined based at least on a kinematic relationship of the risk object with respect to the door kinematic region and the risk region.
6. The method of claim 1, wherein the hint information includes at least one of:
an image cue of the motion relationship of the risk object relative to the target area,
a voice prompt for the risk level,
and prompting words aiming at the risk level.
7. The method of claim 1, further comprising:
controlling the door to be locked in response to the risk level indicating that the door movement will cause the door to collide with the risk object; and
controlling the door to be unlocked in response to the risk level indicating that the door movement will not result in the door colliding with the risk object.
8. The method of claim 7, further comprising:
sensing for the target area after a predetermined period of time in response to the door being locked; and
Controlling the door to be unlocked in response to the risk object not being sensed in the target area.
9. A risk prompting method, comprising:
acquiring, via a terminal device, a risk level relating to movement of a door of a vehicle in response to the vehicle reaching a predetermined position; and
presenting prompt information corresponding to the risk level.
10. The method of claim 9, wherein the hint information includes at least one of:
an image cue of a movement relationship of a risk object relative to a target area associated with the vehicle door, wherein the risk object comprises at least one of a pedestrian, a motor vehicle, a non-motor vehicle, an animal, an obstacle;
a voice prompt for the risk level;
and prompting words aiming at the risk level.
11. The method of claim 10, wherein the target area includes at least a door movement area and a risk area adjacent to the door movement area, and the risk level includes at least one of:
a first risk level indicating that the risk object is located or will enter a door movement zone within a first predetermined time,
a second risk level indicating that the risk object is located in the risk area and does not enter the door movement area for the first predetermined time, wherein the second risk level is lower than the first risk level,
A third risk level indicating at least one of:
the risk object is located in or about to enter the risk area, and will leave the risk area within the predetermined time,
the risk object is located outside the target area and does not enter the target area for a second predetermined time,
wherein the third risk level is lower than the second risk level.
12. The method of claim 9, further comprising:
and responding to the prompt information to indicate that the vehicle door is locked, and presenting an unlocking option for the vehicle door to a user.
13. A risk prompting device, comprising:
a sensing module configured to sense a target area associated with a door of a vehicle in response to the vehicle reaching a predetermined location;
a risk level determination module configured to determine a risk level related to movement of the vehicle door based at least on a movement relationship of a risk object associated with the target area in response to sensing the risk object relative to the target area; and
and the sending module is configured to enable the terminal equipment to present prompt information corresponding to the risk level.
14. A risk prompting device, comprising:
An acquisition module configured to acquire, via a terminal device, a risk level related to movement of a door of a vehicle in response to the vehicle reaching a predetermined position; and
and the presentation module is configured to present prompt information corresponding to the risk level.
15. An electronic device, comprising:
at least one processing unit; and
at least one memory coupled to the at least one processing unit and storing machine-executable instructions that, when executed by the at least one processing unit, cause the electronic device to perform the method of any one of claims 1-8 or 9-13.
16. A computer readable storage medium having stored thereon a computer program executable by a processor to implement the method of any one of claims 1 to 8 or 9 to 13.
17. A computer program product tangibly stored on a non-transitory computer-readable medium and comprising computer-executable instructions that, when executed, cause a processor to perform the steps of the method of any one of claims 1 to 8 or 9 to 13.
CN202211552531.2A 2022-12-05 2022-12-05 Risk prompting method, risk prompting device, risk prompting equipment, risk prompting medium and risk prompting product Pending CN116409239A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211552531.2A CN116409239A (en) 2022-12-05 2022-12-05 Risk prompting method, risk prompting device, risk prompting equipment, risk prompting medium and risk prompting product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211552531.2A CN116409239A (en) 2022-12-05 2022-12-05 Risk prompting method, risk prompting device, risk prompting equipment, risk prompting medium and risk prompting product

Publications (1)

Publication Number Publication Date
CN116409239A true CN116409239A (en) 2023-07-11

Family

ID=87053804

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211552531.2A Pending CN116409239A (en) 2022-12-05 2022-12-05 Risk prompting method, risk prompting device, risk prompting equipment, risk prompting medium and risk prompting product

Country Status (1)

Country Link
CN (1) CN116409239A (en)

Similar Documents

Publication Publication Date Title
US10074280B2 (en) Vehicle pedestrian safety system and methods of use and manufacture thereof
US11269325B2 (en) System and methods to enable user control of an autonomous vehicle
EP3600936B1 (en) Method and system for safe passenger exit from autonomous vehicle
CN111942369B (en) Vehicle control device, vehicle control method, and storage medium
US20200307589A1 (en) Automatic lane merge with tunable merge behaviors
US10858014B2 (en) Vehicle control system, vehicle control method, and storage medium
US10490007B2 (en) System and method for automatically controlling movement of a barrier
CN113853640B (en) electronic control device
US20210039638A1 (en) Driving support apparatus, control method of vehicle, and non-transitory computer-readable storage medium
CN112849129B (en) Method for parking an automatically driven vehicle
JP2020107212A (en) Vehicle control system, vehicle control method, and program
CN111731295B (en) Travel control device, travel control method, and storage medium storing program
CN109466433B (en) Method, device, equipment, computer readable storage medium and vehicle for providing out-of-vehicle reminder
EP3555866B1 (en) Vehicle management system
US20200018100A1 (en) Occupant assisting apparatus, method, and program
US20230138112A1 (en) Artificial intelligence methods and systems for remote monitoring and control of autonomous vehicles
US11565717B2 (en) Method and system for remote assistance of an autonomous agent
CN114787888A (en) Information processing method, information processing terminal, and information processing system
US20230249700A1 (en) Vehicle management system and vehicle management method
CN116409239A (en) Risk prompting method, risk prompting device, risk prompting equipment, risk prompting medium and risk prompting product
US11908200B2 (en) System and method in the prediction of target vehicle behavior based on image frame and normalization
CN115035707B (en) Automatic parking system and control method thereof
US20230117967A1 (en) Vehicle, automated valet parking system, and automated valet parking method
US20240046778A1 (en) Information providing method, vehicle system and management device
CN118049115A (en) Method, device, apparatus, medium and product for controlling a vehicle door

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination