CN116631309A

CN116631309A - Vehicle VR head display control method, electronic device and storage medium

Info

Publication number: CN116631309A
Application number: CN202310640036.5A
Authority: CN
Inventors: 陈思瑶; 陈小彬
Original assignee: Dongfeng Nissan Passenger Vehicle Co
Current assignee: Dongfeng Nissan Passenger Vehicle Co
Priority date: 2023-05-31
Filing date: 2023-05-31
Publication date: 2023-08-22

Abstract

The invention discloses a vehicle VR head display control method, electronic equipment and a storage medium. The method comprises the following steps: responding to the VR head display use request to acquire the vehicle state; if the vehicle state meets the head display use condition, controlling the VR head display to switch from a perspective state to a non-perspective state; the vehicle state, the environment state and/or the user state are monitored, and if the vehicle state, the environment state or the user state meets the head display exit condition, the VR head display is controlled to be switched from the non-perspective state to the perspective state. When the VR head display is required to be used, the VR head display is controlled to be switched from the perspective state to the non-perspective state according to the vehicle state, so that the VR head display is ensured to be used by passengers under proper conditions. Meanwhile, when an abnormal condition is judged in the process that the passenger uses the VR head display, the VR head display is automatically controlled to be switched from a non-perspective state to a perspective state, so that the passenger can observe the conditions inside and outside the vehicle in time when the abnormal condition occurs, and accidents are avoided.

Description

Vehicle VR head display control method, electronic device and storage medium

Technical Field

The invention relates to the technical field of vehicles, in particular to a vehicle VR head display control method, electronic equipment and a storage medium.

Background

Virtual Reality (VR) is a computer simulation system that can create and experience a Virtual world by using a computer to create a simulated environment into which a user is immersed. And VR headset is a head mounted display device that provides VR display.

The existing vehicle provides a VR head display, so that passengers can obtain VR experience in the passenger cabin. The passenger can play games, watch movies or work through wearing the VR head display. The VR game is played on the vehicle, so that the driver at the driving position can play the driving game.

However, VR heads are in use, and in order for the occupant to obtain a virtual immersion environment, the display screen is required to project various pictures, and therefore, the display screen is not see-through when in use. In this case, the occupant cannot know the external environment. The use of VR head displays in vehicles is distinguished from the use of VR head displays in indoor environments. Since the vehicle is used outdoors, and the vehicle itself is operable and movable.

In the prior art, when the VR head is used by an occupant, the occupant is in a non-perspective state, the occupant cannot observe the environment inside and outside the vehicle, and the occupant can observe the environment inside and outside the vehicle only by taking off the VR head, so that certain risks can exist under the abnormal condition of the vehicle. For example, an occupant may inadvertently touch an operating device of the vehicle, causing an abnormality in the vehicle, or a suspicious person outside the vehicle. Under these circumstances, if the occupant is still blocked from view by the VR head display, there is a greater risk that the vehicle interior and exterior environment cannot be observed.

Disclosure of Invention

Based on the above, it is necessary to provide a vehicle VR head display control method, an electronic device and a storage medium for solving the technical problem that passengers cannot observe the environment inside and outside the vehicle in time due to the fact that the VR head display is in a non-perspective state when in use in the prior art, and a large risk exists.

The invention provides a vehicle VR head display control method, which comprises the following steps:

responding to the VR head display use request to acquire the vehicle state;

if the vehicle state meets the head display use condition, controlling the VR head display to switch from a perspective state to a non-perspective state;

and monitoring a vehicle state, an environment state and/or a user state, and controlling the VR head display to switch from a non-perspective state to a perspective state if the vehicle state, the environment state or the user state meets the head display exit condition.

Further, after the obtaining the vehicle state in response to the VR head display usage request, the method further includes: obtaining a user of the VR head display, wherein the user comprises a driver and a passenger;

if the vehicle state meets the head display use condition, controlling the VR head display to be switched from the perspective state to the non-perspective state, specifically comprising: if the vehicle state meets the head display use condition corresponding to the user of the head display, controlling the VR head display to switch from a perspective state to a non-perspective state;

And if the vehicle state, the environment state or the user state meets the head display exit condition, controlling the VR head display to be switched from the non-perspective state to the perspective state, wherein the method specifically comprises the following steps of: and if the vehicle state, the environment state or the user state meets the head display exit condition corresponding to the user, controlling the VR head display to be switched from the non-perspective state to the perspective state.

Further, if the vehicle state meets the head display use condition corresponding to the user, the VR head display is controlled to switch from the perspective state to the non-perspective state, which specifically includes:

and when the user is a driver, if the vehicle safety condition is judged to be met, controlling the VR head display to switch from the perspective state to the non-perspective state.

Still further, when the user is a driver, if it is determined that the vehicle safety condition is satisfied, the VR head display is controlled to switch from the perspective state to the non-perspective state, which specifically includes:

when the user is a driver and the head display use request is a driving game head display use request, if the vehicle state is a parking state, and the handle in communication connection with the VR head display is judged to be put down, and the vehicle safety condition is judged to be met, the VR head display is controlled to be switched from a perspective state to a non-perspective state.

and when the user is a passenger, if all the doors are detected to be closed, controlling the VR head display to switch from the perspective state to the non-perspective state.

Further, if the vehicle state, the environment state or the user state satisfies the head display exit condition corresponding to the user, the VR head display is controlled to switch from the non-perspective state to the perspective state, which specifically includes:

when the user is a driver, if any driver head display exit condition is met, the VR head display is controlled to be switched from a non-perspective state to a perspective state, and the driver head display exit condition comprises:

detecting that vehicle hardware is triggered by mistake; or alternatively

Detecting that the person outside the vehicle meets the preset suspicious condition; or alternatively

Detecting that the driver satisfies a fatigue condition; or alternatively

Detecting that the weather of the environment where the vehicle is located meets a preset abnormal weather condition; or alternatively

Detecting that the behavior of children in the vehicle meets the preset abnormal behavior condition; or alternatively

Detecting an impact event; or alternatively

Detecting that the vehicle electric quantity is smaller than an electric quantity safety threshold value; or alternatively

Detecting that the vehicle is being charged, wherein the electric quantity of the vehicle is greater than or equal to the set electric quantity; or alternatively

Detecting that the using time reaches a preset time threshold; or alternatively

Detecting that a preset type of vehicle passes outside the vehicle.

when the user is a driver and the head display use request is a driving game head display use request, if any driver head display exit condition is met, the VR head display is controlled to be switched from a non-perspective state to a perspective state, and the driver head display exit condition comprises:

detecting that the driver seat belt is pulled out; or alternatively

It is detected that the degree of wear of the vehicle tires exceeds a preset wear threshold.

When the user is a passenger, if any passenger head display exit condition is met, the VR head display is controlled to be switched from a non-perspective state to a perspective state, and the passenger head display exit condition comprises:

detecting a driver change from a manned state to an unmanned state; or alternatively

Detecting that the driver is occupied, and the vehicle stopping time exceeds a preset time threshold; or alternatively

The vehicle speed is detected to be greater than 0, and the safety belt of the passenger is pulled out; or alternatively

Detecting that the passenger meets the fatigue condition; or alternatively

Detecting an impact event; or alternatively

Detecting that the using time reaches a preset time threshold; or alternatively

Detecting that a preset type of vehicle passes outside the vehicle.

Still further, the switching from the perspective state to the non-perspective state specifically includes:

displaying a countdown prompt;

if the in-cancel instruction is received before the countdown is finished, the method is finished, otherwise, after the countdown is finished, the method is switched from the perspective state to the non-perspective state.

The present invention provides an electronic device including:

at least one processor; the method comprises the steps of,

a memory communicatively coupled to at least one of the processors; wherein,,

the memory stores instructions executable by at least one of the processors to enable the at least one processor to perform the vehicle VR head display control method as previously described.

The present invention provides a storage medium storing computer instructions that, when executed by a computer, are operable to perform all the steps of a vehicle VR head display control method as described above.

When the VR head display is required to be used, the VR head display is controlled to be switched from the perspective state to the non-perspective state according to the vehicle state, so that the VR head display is ensured to be used by passengers under proper conditions. Meanwhile, in the process that the passenger uses the VR head display, the vehicle state, the environment state and/or the user state are monitored, when the abnormal situation is judged, the VR head display is automatically controlled to be switched from the non-perspective state to the perspective state, so that the passenger can observe the conditions inside and outside the vehicle in time when the abnormal situation occurs, and accidents are avoided.

Drawings

FIG. 1 is a flowchart illustrating a vehicle VR head display control method according to one embodiment of the present invention;

FIG. 2 is a flowchart illustrating a vehicle VR head display control method in accordance with another embodiment of the present invention;

fig. 3 is a schematic hardware structure of an electronic device according to the present invention.

Detailed Description

Specific embodiments of the present invention will be further described below with reference to the accompanying drawings. Wherein like parts are designated by like reference numerals. It should be noted that the words "front", "rear", "left", "right", "upper" and "lower" used in the following description refer to directions in the drawings, and the words "inner" and "outer" refer to directions toward or away from, respectively, the geometric center of a particular component.

Fig. 1 is a flowchart of a VR head display control method of a vehicle according to an embodiment of the present invention, including:

step S101, responding to a VR head display use request, and acquiring a vehicle state;

step S102, if the vehicle state meets the head display use condition, controlling the VR head display to be switched from a perspective state to a non-perspective state;

step S103, monitoring a vehicle state, an environment state and/or a user state, and if the vehicle state, the environment state or the user state meets a head display exit condition, controlling the VR head display to switch from a non-perspective state to a perspective state.

In particular, the invention may be applied to an electronic device, such as an electronic controller unit (Electronic Control Unit, ECU), of a vehicle having processing capabilities.

Specifically, when the occupant wishes to use the VR head set, the electronic device is triggered to execute step S101, and the vehicle state is acquired in response to the VR head set use request. The occupant may be a driver or an in-vehicle occupant.

Then, the vehicle state is waited for to meet the head-up use condition. The head display use condition is preset, when the vehicle state meets the head display use condition, the vehicle is in a safe state, step S102 is executed at the moment, and the VR head display is controlled to be switched from the perspective state to the non-perspective state.

Wherein, the perspective state of VR head display is: the display device of the VR head display is in a perspective state, and passengers can observe the environment inside and outside the vehicle through the display device of the VR head display. The non-perspective state of the VR head display is: the display device of the VR head display is in a non-perspective state, and the display device plays the VR image, so that an occupant can obtain immersive experience.

During the use of the VR headset by the occupant, step S103 is continuously performed to monitor the vehicle status, the environment status, and/or the user status. Once the vehicle state, the environment state or the user state is found to meet the head display exit condition, namely, the vehicle state, the environment state and/or the user state are abnormal, the VR head display is controlled to be switched from the non-perspective state to the perspective state, so that passengers can observe the environment inside and outside the vehicle in time, and accidents are avoided.

Fig. 2 is a flowchart of a VR head display control method of a vehicle according to another embodiment of the present invention, including:

step S201, responding to a VR head display use request, acquiring a vehicle state, and acquiring a user of the VR head display, wherein the user comprises a driver and a passenger.

Step S202, if the vehicle state meets the head display use condition corresponding to the user, controlling the VR head display to switch from the perspective state to the non-perspective state.

In one embodiment, if the vehicle state meets the head display usage condition corresponding to the user of the head display, the VR head display is controlled to switch from the perspective state to the non-perspective state, which specifically includes:

In one embodiment, when the user is a driver, if it is determined that the vehicle safety condition is met, the VR head display is controlled to switch from the perspective state to the non-perspective state, which specifically includes:

In one embodiment, the switching from the perspective state to the non-perspective state specifically includes:

Displaying a countdown prompt;

In step S203, a vehicle state, an environmental state and/or a user state are monitored, and if the vehicle state, the environmental state or the user state satisfies the head display exit condition corresponding to the user, the VR head display is controlled to switch from the non-perspective state to the perspective state.

In one embodiment, if the vehicle state, the environment state or the user state meets the head display exit condition corresponding to the user, the VR head display is controlled to switch from the non-perspective state to the perspective state, which specifically includes:

detecting that vehicle hardware is triggered by mistake; or alternatively

Detecting that the driver satisfies a fatigue condition; or alternatively

Detecting an impact event; or alternatively

Detecting that the using time reaches a preset time threshold; or alternatively

Detecting that a preset type of vehicle passes outside the vehicle.

detecting that the driver seat belt is pulled out; or alternatively

Detecting that the passenger meets the fatigue condition; or alternatively

Detecting an impact event; or alternatively

Detecting that the using time reaches a preset time threshold; or alternatively

Detecting that a preset type of vehicle passes outside the vehicle.

Specifically, when the occupant wishes to use the VR head set, the electronic device is triggered to execute step S201, and the vehicle state is acquired in response to the VR head set use request. And simultaneously, acquiring the VR head display user. Wherein the user includes a driver and a passenger. The driver is an occupant seated in the driving position, and the passenger is an occupant seated in a passenger position other than the driving position.

Then, waiting for the vehicle state to meet the head display use condition, and controlling the VR head display to switch from the perspective state to the non-perspective state.

The head display use conditions correspond to the user, namely the head display use conditions comprise the head display use conditions when the user is a driver and the head display use conditions when the user is a passenger.

The user determines whether the person wearing the head-mounted display is a driver or a passenger through a passenger monitoring system (Occupancy Monitoring System, OMS) and then sends a signal to the VR head-mounted display. When it is determined that the passenger, the driving game is not usable.

Specifically, the vehicle is parked, the current gear is the P gear, the vehicle speed is smaller than or equal to a preset vehicle speed threshold value, and the vehicle safety condition is judged to be met.

In some embodiments, when the vehicle is in a power-on (IGN on) state, electronic parking (Electrical Park Brake, EPB) is on, the current gear is P gear, the vehicle speed is less than or equal to 5km/h, and the system shielding is in a ready (ready) state, it is determined that the vehicle safety condition has been met.

When the vehicle safety conditions are met, vehicle hardware such as gears, handbrakes and the like do not need to be continuously operated; if the safety condition is not met, the forced exit is changed into a perspective interface to operate gears, handbrakes and the like. The vehicle hardware mainly means that the gear is required to be kept at the P gear, and the electronic hand brake EPB is started.

Whether the vehicle safety condition is satisfied is detected by the system. The vehicle safety condition refers to a condition that the vehicle reaches when the vehicle is already in a safe state and no further operation of the vehicle hardware is required.

The embodiment allows a driver to play games or view office movies through the VR head display when parking.

Specifically, the driver may play the driving game through the VR head. Therefore, the present embodiment determines whether the driver is already in a ready state by determining whether the handle communicatively connected to the VR head display has been put down. And when the vehicle state is a parking state, judging that the handle in communication connection with the VR head display is put down and judging that the vehicle safety condition is met, controlling the VR head display to switch from the perspective state to the non-perspective state.

Specifically, for the passenger, because there is no driving requirement, only the vehicle door is required to be judged to be closed, and the VR head display is controlled to be switched from the perspective state to the non-perspective state.

displaying a countdown prompt;

In the embodiment, when the perspective state is switched to the non-perspective state, the confirmation of the passengers is facilitated by increasing the countdown time. The non-perspective state is switched to the perspective state, which belongs to emergency, so that the non-perspective state is directly switched to the perspective state without countdown.

In some embodiments, the countdown is 3 seconds.

During the use of the VR headset by the occupant, step S203 is continuously performed to monitor the vehicle status, the environment status, and/or the user status. Once the vehicle state, the environment state or the user state is found to meet the head display exit condition, namely, the vehicle state, the environment state and/or the user state are abnormal, the VR head display is controlled to be switched from the non-perspective state to the perspective state, so that passengers can observe the environment inside and outside the vehicle in time, and accidents are avoided.

Detecting that vehicle hardware is triggered by mistake; or alternatively

Detecting that the driver satisfies a fatigue condition; or alternatively

Detecting an impact event; or alternatively

Detecting that the using time reaches a preset time threshold; or alternatively

Detecting that a preset type of vehicle passes outside the vehicle.

Specifically, for the case that the user is a driver, when any driver head display exit condition is satisfied, the VR head display is controlled to switch from the non-perspective state to the perspective state, and the driver head display exit condition includes:

1. it is detected that the vehicle hardware is false triggered. For example, when it is detected that there is a false touch of hardware other than the throttle brake steering wheel, such as: gear false touch (P- > D/R), wiper false touch and the like affect safety actions.

2. Detecting that the person outside the vehicle meets the preset suspicious condition. For example, the identification manner may be: within a preset range around the vehicle, someone stops exceeding a preset time threshold. For example, in the range of 0.3m around the vehicle, others stop for more than 5s.

3. It is detected that the driver satisfies the fatigue condition. Specifically, the fatigue condition of the user is judged through the in-vehicle sensor. For example:

detecting that the heart rate exceeds a heart rate threshold, judging as tired, for example: the heart rate during waking is 80-100 times/min, so when the heart rate is detected to be 65-80 times/min, fatigue can be judged; or alternatively

The pulse dominant frequency is detected to exceed the dominant frequency threshold and the pulse amplitude peak-to-average exceeds the peak-to-average threshold, e.g., the pulse dominant frequency is detected: about 1.5Hz and pulse amplitude peak-to-average: about 200 mV; or alternatively

The occupant sleep time is less than a sleep time threshold, for example: and acquiring the health data of the mobile phone, acquiring the sleeping time of the passenger through the passenger ID, and judging fatigue if the sleeping time of the passenger is less than 6 hours.

4. And detecting that the weather of the environment where the vehicle is located meets the preset abnormal weather condition. For example, the car weather APP predicts abnormal weather within 1-2 hours in the future, such as: extreme conditions such as storms, thunderstorms, lightning, etc.

5. And detecting that the behavior of the child in the vehicle meets the preset abnormal behavior condition. Specifically, the child waking up or the child (attempting) leaving the seat may be detected by a gravity sensor of the child seat or a passenger camera OMS.

6. An impact event is detected. For example, when a vehicle inertial measurement unit (Inertial measurement unit, IMU), such as a six-axis gyroscope, detects that the vehicle is abnormally impacted.

7. It is detected that the vehicle charge is less than a charge safety threshold. For example, the State of Charge (SOC) of the battery is below a preset Charge safety threshold, for example below 20%.

8. It is detected that the vehicle is being charged, and the vehicle electric quantity is equal to or greater than the set electric quantity. Specifically, if the vehicle is charging, the immediate charge reaches the user-set SOC.

9. The use time is detected to reach a preset time threshold. For example: if the using time reaches the set using time of the user; or, the continuous use time is preset, for example, 1h, if the continuous use exceeds the preset continuous use time.

10. Detecting that a preset type of vehicle passes outside the vehicle. For example, if an emergency vehicle such as an police car, an ambulance or a fire truck passes nearby, the vehicle-mounted camera detects the emergency vehicle.

The embodiment determines various emergency situations so as to inform passengers in time when the emergency situations occur, and avoid accidents.

detecting that the driver seat belt is pulled out; or alternatively

Specifically, the case where the driver plays the driving game is addressed. This embodiment increases the detection of belt and wheel wear.

And whether the safety belt is pulled out or not is detected, so that the safety of passengers is ensured. Meanwhile, the tire is worn by the driving game, so that the wear degree of the tire is detected, and the excessive use of the tire is avoided. The tire wear may be determined using existing tire wear calculation methods. For example, a vehicle tire wear level value is determined based on the total vehicle range, the number of vehicle turns, and the number of sudden braking, and then the vehicle tire wear level value is compared with a preset wear threshold.

Detecting that the passenger meets the fatigue condition; or alternatively

Detecting an impact event; or alternatively

Detecting that the using time reaches a preset time threshold; or alternatively

Detecting that a preset type of vehicle passes outside the vehicle.

In the case of a passenger of a vehicle,

specifically, for the case that the user is a passenger, when any passenger head display exit condition is satisfied, the VR head display is controlled to switch from the non-perspective state to the perspective state, and the passenger head display exit condition includes:

1. it is detected that the driver has changed from the manned state to the unmanned state. For example, a weight change is detected as sensed by the seat and the door is opened.

2. A driver presence is detected and the vehicle stop time exceeds a preset time threshold. For example: the main drive detects a person, but the vehicle stop time exceeds 120s (it is determined to be stopped).

3. Detecting that the person outside the vehicle meets the preset suspicious condition. For example: and after the main driving detection is finished, selecting to continue the game, and if suspicious personnel appear outside the vehicle.

4. The vehicle speed is detected to be greater than 0, and the seat belt of the passenger is pulled out. Namely: if the speed of the game is detected to be more than 0km/h, the safety belt is pulled out accidentally.

5. It is detected that the passenger satisfies the fatigue condition. For example, the user is judged to have fatigue through an in-vehicle sensor.

6. And detecting that the weather of the environment where the vehicle is located meets the preset abnormal weather condition. For example, if the vehicle weather APP predicts abnormal weather within 1-2 hours in the future, such as: extreme conditions such as storms, thunderstorms, lightning, etc.

7. And detecting that the behavior of the child in the vehicle meets the preset abnormal behavior condition. For example: the gravity sensor or passenger camera OMS of the child seat detects that the child is awake or that the child is (attempting to) leave the seat.

8. An impact event is detected. For example, when a vehicle inertial measurement unit (Inertial measurement unit, IMU), such as a six-axis gyroscope, detects that the vehicle is abnormally impacted.

When the VR head display is used for games, and the user is a driver, the VR head display switching conditions are as follows:

starting state: all scenes directly enter the perspective interface, so that a user can conveniently take the handle to select, and the VR head is displayed as the perspective interface.

Judgment 1, whether to enter the game normally (security condition judgment): when the vehicle is in an IGN on state, EPB is started, P gear is carried out, the speed is less than or equal to 5km/h, and the system shielding ready state, the VR head is displayed as a perspective interface (without change).

And 2, continuously judging in the whole game process, and judging whether the vehicle hardware needs to be operated in the next step. Specifically:

under the driving game, the system judges the position of the user and the positions of the steering wheel, the accelerator and the brake; and a handle storage position, the VR head display remains perspective;

When the detection handle is put down; or the system judges that the vehicle hardware does not need to be operated, the VR head display displays a countdown, perspective- > non-perspective (the countdown is convenient for a user to put a handle to confirm a good state);

and 3, continuously judging in the whole game process, and converting the non-perspective interface into a perspective interface for convenience in operation and safety guarantee in the next step. Specifically, when any of the following conditions is satisfied, the VR head display is viewed from a non-perspective- > perspective:

1. there is a false touch of hardware other than the throttle brake steering wheel, such as: gear false touch (P- > D/R), windshield wiper false touch and the like affect safe actions, and then the VR head displays a popup window: "touch the vehicle safety hardware by mistake, please check the vehicle settings", while the VR head display is from non-perspective- > perspective.

2. Suspicious personnel appear outside the vehicle, then VR head shows bullet window: "suspicious personnel appear outside the vehicle, please see the external situation", while the VR head display is from non-perspective- > perspective. Wherein suspicious persons are defined as: within 0.3m of the periphery of the vehicle, others stopped for more than 5s.

3. If a driving game is selected, the user is detected to pull out the safety belt accidentally (game must signal) (only suitable for non-driving games of main driving, such as watching video and office, passenger still needs to restrict the safety belt in use), then the window is flicked: "the seat belt is accidentally opened, please re-ensure the normal insertion of the seat belt into the recess". Meanwhile, the VR head display is from non-perspective- > perspective.

4. The in-vehicle sensor judges that the user has fatigue conditions:

heart rate: 65-80 times/min (fatigue time) (wakefulness: 80-100); or alternatively

Pulse: the main frequency: about 1.5 Hz; pulse amplitude peak-to-average: about 200 mV; or alternatively

And the vehicle body and mobile phone health data are communicated, and the sleeping time of the user is judged to be less than 6 hours through the user ID.

When the sensor in the vehicle judges that the fatigue condition exists in the user, the VR head displays a popup window: "do you detect you have tired driving, do you end the game? "simultaneously, the VR head display is from non-perspective- > perspective.

5. Abnormal weather: if the weather APP of the automobile is predicted to be abnormal weather in the future 1-2 hours, the weather APP of the automobile can be predicted to be abnormal weather, for example: extreme cases such as heavy rain, thunder rain, lightning, etc., then the VR head shows the bullet window: "predict that there is abnormality in the weather next, please decide whether to continue the game after judging the external environment. Meanwhile, the VR head display is from non-perspective- > perspective.

6. Children behaving abnormally in the vehicle:

if the child seat's gravity sensor or passenger camera OMS detects that the child is awake or that the child is (attempting to leave the seat), the VR head shows a popup window: "detect rear-row child behavior abnormality, please care for child. Meanwhile, the VR head display is from non-perspective- > perspective.

7. And detecting the wear degree f (x, y, z) of the vehicle tyre according to the big data of the Internet of vehicles, and reminding a user if the wear degree of the tyre reaches a value of a certain degree f not less than H. If f is greater than or equal to H, the popup window reminds: "detect your tire wear seriously, please go to the store in time to detect and repair". Meanwhile, the VR head display is from non-perspective- > perspective. Wherein; the H value is a preset wear threshold, which may also be referred to as a tire wear threshold, x is the total vehicle range, y is the number of vehicle turns, and z is the number of sudden braking. f is the degree of tire wear.

8. And (3) crashing: when the IMU (six-axis gyroscope) of the vehicle senses that the vehicle is abnormally impacted, the VR head displays a popup window: "detect that the vehicle receives abnormal collision, please look over the external situation in time, pay attention to safety". Meanwhile, the VR head display is from non-perspective- > perspective.

9. Vehicle electric quantity

1) SOC is lower than 20%, VR popup window: "detect that the vehicle electric quantity is insufficient, please charge in time to guarantee the normal running function to use". Meanwhile, the VR head display is from non-perspective- > perspective.

2) If the vehicle is being charged, when the on-the-spot electric quantity reaches the SOC set by the user, the VR head displays a popup window: "detect that the vehicle charge has been charged to the desired charge, please take care of unplugging the charging plug". Meanwhile, the VR head display is from non-perspective- > perspective.

10. Time of game

1) If the game duration reaches the user-set game duration, the VR head displays a popup window: "detect you have played long-time game, please take a rest, do you end game? ". Meanwhile, the VR head display is from non-perspective- > perspective.

2) Presetting a fatigue value of a game duration, such as 1h, and displaying a popup window by the VR head if the continuous use exceeds the preset duration: "detect you have played long-time game, please take a rest, do you end game? ". Meanwhile, the VR head display is from non-perspective- > perspective.

11. Emergency vehicle road crossing: if the vehicle-mounted camera detects that an emergency vehicle such as a police car, an ambulance and a fire truck passes nearby, the VR head displays a popup window: when the emergency vehicle passing is detected nearby, the external situation is checked in time, and avoidance is noted. Meanwhile, the VR head display is from non-perspective- > perspective.

In the preferred embodiment of the invention, when the VR head display is used for a game and the user is a passenger, the VR head display switching conditions are as follows:

Judgment 1, whether to normally enter the application (security condition judgment): all doors are closed, the VR head appears as a see-through interface (unchanged).

And 2, continuously judging in the whole application process, and judging whether the vehicle hardware needs to be operated in the next step. Specifically:

the passenger does not need to operate the vehicle hardware, and the VR head display shows countdown, perspective- > non-perspective.

And 3, continuously judging in the whole application process, and converting the non-perspective interface into a perspective interface in the next step so as to facilitate operation and ensure safety. Specifically, when any of the following conditions is satisfied, the VR head display is viewed from a non-perspective- > perspective:

1. if the auxiliary passenger has false touch with the vehicle hardware: such as: gear and the like affect the safe action, then the VR head displays a popup window: "touch the vehicle driving safety hardware by mistake, please check the vehicle setup", while VR head display is from non-perspective- > perspective.

2. The main driver monitors that the main driver is changed from someone to no person, namely: the seat senses weight change and the door is opened, then VR head shows the bullet window: the main driver is unmanned, please pay attention to the surrounding environment, and the VR head display is from non-perspective- > perspective.

3. If the main drive detects someone but the vehicle stop time exceeds 120s (the vehicle is judged to be stopped), the VR head displays a popup window: "park, do play continue? ", while VR head display is from non-perspective- > perspective.

4. After the main driving detection unmanned judgment is finished, selecting to continue the game, and if suspicious personnel appear outside the vehicle, displaying a popup window by the VR head: "suspicious personnel appear outside the vehicle please see the external situation". And simultaneously, the VR head display is from non-perspective- > perspective.

5. If the vehicle speed is detected to be more than 0km/h in the application, the safety belt is accidentally pulled out, and then the VR head displays a popup window: "the seat belt is accidentally opened, please re-ensure the normal insertion of the seat belt into the recess". And simultaneously, the VR head display is from non-perspective- > perspective.

6. The in-vehicle sensor judges that the user has fatigue conditions:

When the sensor in the vehicle judges that the fatigue condition exists in the user, the VR head displays a popup window: is you detected to have tired driving, is you finished playing? Meanwhile, the VR head display is from non-perspective- > perspective.

7. Abnormal weather: if the weather APP of the automobile is predicted to be abnormal weather in the future 1-2 hours, the weather APP of the automobile can be predicted to be abnormal weather, for example: extreme cases such as heavy rain, thunder rain, lightning, etc., then the VR head shows the bullet window: if the following weather is predicted to be abnormal, please judge the external environment and then decide whether to continue the game. Meanwhile, the VR head display is from non-perspective- > perspective.

8. Children behaving abnormally in the vehicle:

if the child seat's gravity sensor or passenger camera OMS detects that the child is awake or that the child is (attempting to leave the seat), the VR head shows a popup window: the abnormal behavior of the rear-row children is detected, and the child is attended to. Meanwhile, the VR head display is from non-perspective- > perspective.

9. Time of game

1) If the game duration reaches the user-set game duration, the VR head displays a popup window: "detect you have played long-time game, please take a rest, do you end game? ". Meanwhile, the VR head display is from non-perspective- > perspective. .

2) Presetting a fatigue value of a game duration, such as 1h, and displaying a popup window by the VR head if the continuous use exceeds the preset duration: detect you have done VR for a long time, please take a rest, do you end the game? Meanwhile, the VR head display is from non-perspective- > perspective.

10. Emergency vehicle road crossing: if the vehicle-mounted camera detects that an emergency vehicle such as a police car, an ambulance and a fire truck passes nearby, the VR head displays a popup window: when the emergency vehicle passing is detected nearby, the external situation is checked in time, and avoidance is noted. Meanwhile, the VR head display is from non-perspective- > perspective.

When the VR head display is used for office work or film watching, and the user is a driver, the VR head display switching conditions are as follows:

Judgment 1, whether to normally enter the application (security condition judgment): when the vehicle is in an IGN on state, EPB is started, P gear is carried out, the speed is less than or equal to 5km/h, and the system shielding ready state, the VR head is displayed as a perspective interface (without change).

when the system judges that the user needs to operate the vehicle hardware, the VR head display keeps perspective;

when the system judges that the user operation hardware is finished, detecting that the handle is put down; or when the system judges that the user does not need to operate the vehicle hardware, the VR head display displays a countdown, perspective- > non-perspective (the countdown is convenient for the user to put a handle to confirm a good state);

3. The in-vehicle sensor judges that the user has fatigue conditions:

When the sensor in the vehicle judges that the fatigue condition exists in the user, the VR head displays a popup window: "do you detect you have tired driving, do you end the application? "simultaneously, the VR head display is from non-perspective- > perspective.

4. Abnormal weather: if the weather APP of the automobile is predicted to be abnormal weather in the future 1-2 hours, the weather APP of the automobile can be predicted to be abnormal weather, for example: extreme cases such as heavy rain, thunder rain, lightning, etc., then the VR head shows the bullet window: "predict that there is abnormality in the following weather, please decide whether to continue application after judging the external environment. Meanwhile, the VR head display is from non-perspective- > perspective.

5. Children behaving abnormally in the vehicle:

6. And (3) crashing: when the IMU (six-axis gyroscope) of the vehicle senses that the vehicle is abnormally impacted, the VR head displays a popup window: "detect that the vehicle receives abnormal collision, please look over the external situation in time, pay attention to safety". Meanwhile, the VR head display is from non-perspective- > perspective.

7. Vehicle electric quantity

8. Office/film viewing time

1) If the office/movie watching time reaches the user set time, the VR head displays a popup window: detect you have done using VR for a long time, please note rest, do you end application? Meanwhile, the VR head display is from non-perspective- > perspective.

2) Presetting an office/film watching duration fatigue value, for example, 1h, and displaying a popup window by the VR head if the continuous use exceeds the preset duration: detect you have done using VR for a long time, please note rest, do you end application? Meanwhile, the VR head display is from non-perspective- > perspective.

9. Emergency vehicle road crossing: if the vehicle-mounted camera detects that an emergency vehicle such as a police car, an ambulance and a fire truck passes nearby, the VR head displays a popup window: when the emergency vehicle passing is detected nearby, the external situation is checked in time, and avoidance is noted. Meanwhile, the VR head display is from non-perspective- > perspective.

When the VR head display is used for office work or video watching, and the user is a passenger, the VR head display switching conditions are as follows:

Judgment 1, whether to normally enter the application (security condition judgment): when all doors are closed, the VR head appears as a see-through interface (unchanged).

when the system judges that the user operation hardware is finished, detecting that the handle is put down; or when the system judges that the user does not need to use the handle, the VR head display counts down, and the perspective- > non-perspective.

1. if the auxiliary passenger has false touch with the vehicle hardware: such as: gear and the like affect the safe action, then the VR head displays a popup window: "touch the vehicle safety hardware by mistake, please check the vehicle settings", while the VR head display is from non-perspective- > perspective.

3. If the main drive detects someone but the vehicle stop time exceeds 120s (the vehicle is judged to be stopped), the VR head displays a popup window: "parked, not continue application? ", while VR head display is from non-perspective- > perspective.

4. After the main driving detection unmanned judgment is finished, the main driving detection unmanned judgment is selected to continue to be applied, and if suspicious personnel appear outside the vehicle, the VR head displays a popup window: "suspicious personnel appear outside the vehicle please see the external situation". And simultaneously, the VR head display is from non-perspective- > perspective.

6. The in-vehicle sensor judges that the user has fatigue conditions:

When the sensor in the vehicle judges that the fatigue condition exists in the user, the VR head displays a popup window: is you detected to have tired driving, is you finished applying? Meanwhile, the VR head display is from non-perspective- > perspective.

7. Abnormal weather: if the weather APP of the automobile is predicted to be abnormal weather in the future 1-2 hours, the weather APP of the automobile can be predicted to be abnormal weather, for example: extreme cases such as heavy rain, thunder rain, lightning, etc., then the VR head shows the bullet window: if the following weather is predicted to be abnormal, please judge the external environment and then decide whether to continue the application. Meanwhile, the VR head display is from non-perspective- > perspective.

8. Children behaving abnormally in the vehicle:

9. Office/film viewing time

Fig. 3 is a schematic diagram of a hardware structure of an electronic device according to the present invention, including:

At least one processor 301; the method comprises the steps of,

a memory 302 communicatively coupled to at least one of the processors 301; wherein,,

the memory 302 stores instructions executable by at least one of the processors to enable the at least one processor to perform the vehicle VR head display control method as previously described.

One processor 301 is illustrated in fig. 3.

The electronic device may further include: an input device 303 and a display device 304.

The processor 301, memory 302, input device 303, and display device 304 may be connected by a bus or other means, for example.

The memory 302 is used as a non-volatile computer readable storage medium, and may be used to store a non-volatile software program, a non-volatile computer executable program, and modules, such as program instructions/modules corresponding to the VR head display control method of the vehicle in the embodiment of the present application, for example, the method flows shown in fig. 1 and 2. The processor 301 executes various functional applications and data processing by running nonvolatile software programs, instructions, and modules stored in the memory 302, that is, implements the vehicle VR head display control method in the above-described embodiment.

Memory 302 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data created according to the use of the vehicle VR head display control method, or the like. In addition, memory 302 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 302 optionally includes memory remotely located relative to processor 301, which may be connected via a network to a device that performs the vehicle VR headset control method. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input device 303 may receive input user clicks and generate signal inputs related to user settings and function controls of the vehicle VR headset control method. The display 304 may include a display device such as a display screen.

The vehicle VR head control method of any of the method embodiments described above is performed when executed by the one or more processors 301 in the one or more modules stored in the memory 302.

An embodiment of the invention provides a storage medium storing computer instructions that, when executed by a computer, perform all the steps of a vehicle VR head display control method as described above.

The foregoing examples illustrate only a few embodiments of the invention and are described in detail herein without thereby limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.

Claims

1. The vehicle VR head display control method is characterized by comprising the following steps:

responding to the VR head display use request to acquire the vehicle state;

2. The VR head display control method of claim 1, wherein after said obtaining a vehicle state in response to a VR head display use request, the method further comprises: obtaining a user of the VR head display, wherein the user comprises a driver and a passenger;

3. The method for controlling a VR head display of a vehicle according to claim 2, wherein if the vehicle state satisfies a head display usage condition corresponding to a head display of the user, controlling the VR head display to switch from a perspective state to a non-perspective state specifically includes:

4. The VR head display control method of claim 3, wherein when the user is a driver, if it is determined that the vehicle safety condition is satisfied, controlling the VR head display to switch from the see-through state to the non-see-through state comprises:

5. The method for controlling a VR head display of a vehicle according to claim 2, wherein if the vehicle state satisfies a head display usage condition corresponding to a head display of the user, controlling the VR head display to switch from a perspective state to a non-perspective state specifically includes:

6. The method for controlling a VR head-up display of a vehicle according to claim 2, wherein if the vehicle state, the environment state, or the user state satisfies a head-up display exit condition corresponding to the user, controlling the VR head-up display to switch from a non-perspective state to a perspective state specifically includes:

detecting that vehicle hardware is triggered by mistake; or alternatively

Detecting that the driver satisfies a fatigue condition; or alternatively

Detecting an impact event; or alternatively

Detecting that the using time reaches a preset time threshold; or alternatively

Detecting that a preset type of vehicle passes outside the vehicle.

7. The method for controlling a VR head-up display of a vehicle according to claim 2, wherein if the vehicle state, the environment state, or the user state satisfies a head-up display exit condition corresponding to the user, controlling the VR head-up display to switch from a non-perspective state to a perspective state specifically includes:

detecting that the driver seat belt is pulled out; or alternatively

8. The method for controlling a VR head-up display of a vehicle according to claim 2, wherein if the vehicle state, the environment state, or the user state satisfies a head-up display exit condition corresponding to the user, controlling the VR head-up display to switch from a non-perspective state to a perspective state specifically includes:

Detecting that the passenger meets the fatigue condition; or alternatively

Detecting an impact event; or alternatively

Detecting that the using time reaches a preset time threshold; or alternatively

Detecting that a preset type of vehicle passes outside the vehicle.

9. The vehicle VR head display control method of any one of claims 1 to 8, wherein the switching from the see-through state to the non-see-through state specifically comprises:

displaying a countdown prompt;

10. An electronic device, comprising:

at least one processor; the method comprises the steps of,

A memory communicatively coupled to at least one of the processors; wherein,,

the memory stores instructions executable by at least one of the processors to enable the at least one of the processors to perform the vehicle VR head display control method of any one of claims 1 to 9.

11. A storage medium storing computer instructions which, when executed by a computer, are adapted to carry out all the steps of the vehicle VR head display control method of any one of claims 1 to 9.