WO2023284382A1 - 显示方法、装置、头戴式增强现实设备以及存储介质 - Google Patents

显示方法、装置、头戴式增强现实设备以及存储介质 Download PDF

Info

Publication number
WO2023284382A1
WO2023284382A1 PCT/CN2022/091719 CN2022091719W WO2023284382A1 WO 2023284382 A1 WO2023284382 A1 WO 2023284382A1 CN 2022091719 W CN2022091719 W CN 2022091719W WO 2023284382 A1 WO2023284382 A1 WO 2023284382A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
head
augmented reality
reality device
mounted augmented
Prior art date
Application number
PCT/CN2022/091719
Other languages
English (en)
French (fr)
Inventor
李炳耀
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2023284382A1 publication Critical patent/WO2023284382A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0132Head-up displays characterised by optical features comprising binocular systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0141Head-up displays characterised by optical features characterised by the informative content of the display

Definitions

  • the present application relates to the field of augmented reality technology, and more specifically, to a display method, device, head-mounted augmented reality device, and storage medium.
  • the present application proposes a display method, device, head-mounted augmented reality device and storage medium to solve the above problems.
  • the embodiment of the present application provides a display method, which is applied to a head-mounted augmented reality device, and the head-mounted augmented reality device includes a display screen.
  • the method includes: when the head-mounted augmented reality device in the vehicle When the augmented reality device detects that the vehicle starts to drive, it acquires the driving state of the vehicle; acquires a virtual road condition image corresponding to the driving state; displays the target content image in the first display area of the display screen, and The second display area of the display screen displays the virtual road condition image.
  • the embodiment of the present application provides a display device, which is applied to a head-mounted augmented reality device, the head-mounted augmented reality device includes a display screen, and the device includes: a driving state acquisition module, configured to When the head-mounted augmented reality device in the vehicle detects that the vehicle starts to drive, it acquires the driving state of the vehicle; the virtual road condition image acquisition module is used to acquire a virtual road condition image corresponding to the driving state; a display module , for displaying the target content image in the first display area of the display screen, and displaying the virtual road condition image in the second display area of the display screen.
  • a driving state acquisition module configured to When the head-mounted augmented reality device in the vehicle detects that the vehicle starts to drive, it acquires the driving state of the vehicle; the virtual road condition image acquisition module is used to acquire a virtual road condition image corresponding to the driving state; a display module , for displaying the target content image in the first display area of the display screen, and displaying the virtual road condition image in the second display area of the display
  • an embodiment of the present application provides a head-mounted augmented reality device, including a display screen, a memory, and a processor, the display screen and the memory are coupled to the processor, and the memory stores instructions, The processor performs the method described above when the instructions are executed by the processor.
  • the embodiment of the present application provides a computer-readable storage medium, where program code is stored in the computer-readable storage medium, and the program code can be invoked by a processor to execute the above method.
  • FIG. 1 shows a schematic diagram of an application scenario of a display method provided by an embodiment of the present application
  • Fig. 2 shows a schematic diagram of another application scenario of the display method provided by the embodiment of the present application
  • FIG. 3 shows a schematic flowchart of a display method provided by an embodiment of the present application
  • FIG. 4 shows a schematic diagram of a display screen of a head-mounted augmented reality device provided by an embodiment of the present application
  • Fig. 5 shows a schematic flowchart of a display method provided by another embodiment of the present application.
  • FIG. 6 shows a schematic flowchart of step S220 of the display method shown in FIG. 5 of the present application
  • FIG. 7 shows a schematic flowchart of a display method provided by another embodiment of the present application.
  • FIG. 8 shows a schematic flowchart of a display method provided by another embodiment of the present application.
  • FIG. 9 shows a schematic flow chart of a display method provided by still another embodiment of the present application.
  • Fig. 10 shows a schematic flow chart of a display method provided by yet another embodiment of the present application.
  • FIG. 11 shows a block diagram of a display device provided by an embodiment of the present application.
  • FIG. 12 shows a block diagram of an electronic device for performing a display method according to an embodiment of the present application in an embodiment of the present application
  • FIG. 13 shows a storage unit used to store or carry program codes for implementing the display method according to the embodiment of the present application according to the embodiment of the present application.
  • VR virtual reality
  • Virtual Reality Virtual Reality
  • the head-mounted virtual reality device needs to access all vehicle information, such as brake information, accelerator information, suspension information, etc., and the head-mounted virtual reality device , calculate the driving state of the vehicle, and display a matching screen according to the driving state of the vehicle, so that the user's visual information and the information received by the body match each other, so as to achieve the effect of preventing motion sickness.
  • vehicle information such as brake information, accelerator information, suspension information, etc.
  • the head-mounted virtual reality device needs to obtain the vehicle to provide an interface for obtaining vehicle information. This requires the establishment of a cooperative relationship with the vehicle manufacturer. The cost of cooperation is high, and it needs to take into account different vehicle manufacturers and different models. The universality of the technology and less promotional. In addition, users cannot see the real world when wearing a head-mounted virtual reality device, and users cannot quickly perceive and respond to emergencies in a driving vehicle, and the safety is not high.
  • the inventor found after long-term research, and proposed the display method, device, head-mounted augmented reality (AR, Augmented Reality) device and storage medium provided by the embodiment of the present application.
  • the display screen of the head-mounted augmented reality device is divided into two areas to display the target content image and the virtual road condition image corresponding to the vehicle's driving state, so that the user can watch the target content image while viewing the vehicle's driving state.
  • Virtual road condition images to synchronize eye-sight information and inner ear information to achieve the effect of preventing motion sickness.
  • FIG. 1 shows a schematic diagram of an application scenario of the display method provided by the embodiment of the present application.
  • the application scenario includes a head-mounted augmented reality device 100 and a vehicle 200. As shown in FIG. 1, wearing the headset A user of the augmented reality device 100 may sit in the passenger seat of the vehicle 200.
  • FIG. 2 shows a schematic diagram of another application scenario of the display method provided by the embodiment of the present application.
  • the application scenario includes a head-mounted augmented reality device 100 and a vehicle 200. As shown in FIG. The user of the wearable augmented reality device 100 can sit in the rear seat of the vehicle 200 .
  • the user wearing the head-mounted augmented reality device 100 can also sit in other positions in the vehicle 200 , which will not be repeated here.
  • the head-mounted augmented reality device 100 may be an integrated head-mounted display device, and the head-mounted augmented reality device 100 may also be an intelligent terminal such as a mobile phone connected to an external head-mounted display device, that is, a head-mounted augmented reality device.
  • the augmented reality device 100 can be used as a processing and storage device of a head-mounted display device, plugged into or connected to an external head-mounted display device, and can display virtual objects in the head-mounted display device.
  • FIG. 3 shows a schematic flowchart of a display method provided by an embodiment of the present application.
  • the display method is used to divide the display screen of the head-mounted augmented reality device into two areas to display the target content image and the virtual road condition image corresponding to the driving state of the vehicle in a driving vehicle, so that the user can watch the target content.
  • the display method is applied to a display device 300 as shown in FIG. 10 and a head-mounted augmented reality device 100 ( FIG. 11 ) configured with the display device 300 .
  • FIG. 11 the head-mounted augmented reality device
  • Step S110 When the head-mounted augmented reality device in the vehicle detects that the vehicle starts to drive, acquire the driving state of the vehicle.
  • the user can wear a head-mounted augmented reality device when riding in a vehicle.
  • the user can sit in the front row of the vehicle or in the rear row of the vehicle, which is not limited here.
  • the head-mounted augmented reality device is located in the vehicle.
  • the head-mounted augmented reality device can detect the state of the vehicle, and when it is detected that the state of the vehicle indicates that the vehicle starts to drive, the driving state of the vehicle can be obtained.
  • the head-mounted augmented reality device can detect whether it is in the vehicle, and when it is detected that it is in the vehicle, it can detect the state of the vehicle it is in.
  • the head-mounted augmented reality device may include a camera, and the head-mounted augmented reality device may detect whether it is in the vehicle through the camera;
  • the augmented reality device can obtain information input from the outside through the information input device, and determine whether it is in the vehicle based on the information input from the outside.
  • the head-mounted augmented reality device can detect whether it is in the wearing state. When it is detected that it is in the wearing state, it can detect whether the user wearing the head-mounted augmented reality device is in the vehicle. When it is in the vehicle, it can detect the state of the vehicle it is in.
  • the head-mounted augmented reality device may include a pressure sensor, and the head-mounted augmented reality device may detect whether it is in a wearing state through the pressure sensor; A type of augmented reality device can detect whether it is in a wearing state through a contact sensor.
  • the head-mounted augmented reality device detecting the state of the vehicle may include: detecting the advancing distance of the vehicle within a preset time period, wherein, when it is detected that the vehicle is When the forward distance within the preset time period is less than the preset forward distance, it can be determined that the vehicle is in a parked state; When the distance is less than the preset distance, it can be determined that the vehicle starts to drive.
  • the head-mounted augmented reality device detecting the state of the vehicle may include: detecting whether the vehicle is turned off, and when it is detected that the vehicle is turned off, it may be determined that the vehicle is in a parked state , when it is detected that the vehicle changes from being turned off to not being turned off, it can be determined that the vehicle starts to drive.
  • the head-mounted augmented reality device detecting the state of the vehicle may include: the head-mounted augmented reality device may include a motion sensor, and the head-mounted augmented reality device may monitor the state of the vehicle through its motion sensor. The state of the vehicle is detected, and when the target motion parameter is detected by the motion sensor, it can be determined that the vehicle is detected to start driving.
  • the head-mounted augmented reality device and the vehicle can be connected, and then the head-mounted augmented reality device can obtain the driving status sent by the vehicle based on the connection with the vehicle.
  • the head-mounted augmented reality device may be connected to the vehicle-mounted terminal of the vehicle, and the head-mounted augmented reality device may obtain the driving status sent by the vehicle-mounted terminal based on the connection to the vehicle-mounted terminal.
  • the head-mounted augmented reality device may include a motion sensor, and the head-mounted augmented reality device may detect and obtain the driving state of the vehicle through its motion sensor.
  • the driving state of the vehicle may include, but is not limited to: a speed change of the vehicle and a driving direction of the vehicle.
  • Step S120 Obtain a virtual road condition image corresponding to the driving state.
  • a virtual road condition image corresponding to the driving state of the vehicle may be acquired. For example, when it is acquired that the driving state of the vehicle is accelerating forward, its corresponding virtual road condition image can be acquired as the road accelerating backward; Forward; when the driving state of the vehicle is obtained as turning left, the corresponding virtual road condition image can be obtained as the road winds to the left, and the virtual road condition image will switch to the content seen from the right perspective at the same time; when the vehicle is obtained When the driving state of the user is turning right, the corresponding virtual road condition image can be obtained, which shows that the road is winding to the right, and the virtual road condition image will be switched to the content seen from the left perspective at the same time.
  • a mapping relationship table can be established in advance as a preset mapping relationship table, and the preset mapping relationship table includes multiple driving states, multiple virtual road condition images, and multiple driving states and multiple virtual road conditions Correspondence between images, wherein multiple driving states and multiple virtual road condition images can be in one-to-one correspondence.
  • the preset mapping relationship table may include driving state A1, driving state A2, driving state A3, virtual road condition image B1, virtual road condition image B2, virtual road condition image B3, wherein, driving state A1 and virtual road condition There is a corresponding relationship between the image B1, the corresponding relationship between the driving state A2 and the virtual road condition image B2, and the corresponding relationship between the driving state A3 and the virtual road condition image B3.
  • a virtual road condition image corresponding to the driving state of the vehicle may be acquired based on a preset mapping relationship table. For example, when it is acquired that the driving state of the vehicle matches the driving state A1, the virtual road condition image corresponding to the vehicle's driving state may be determined as the virtual road condition image B1 based on the preset mapping relationship table.
  • Step S130 Displaying the target content image in the first display area of the display screen, and displaying the virtual road condition image in the second display area of the display screen.
  • the target content image represents the actual content image desired by the user, for example, it may be a video image, a game image, etc.; the virtual road condition image is a virtual road image matching the vehicle's motion state.
  • the target content image may be stored locally on the head-mounted augmented reality device, and the target content image may also be projected by an electronic device (such as a smart phone) connected to the head-mounted augmented reality device, so as to realize the content is displayed in an augmented reality headset, preventing motion sickness from using a smartphone in a moving vehicle.
  • the display area of the display screen of the head-mounted augmented reality device includes a first display area and a second display area.
  • the size relationship between the first display area and the second display area can be manually set by the user, or can be automatically set by the head-mounted augmented reality device.
  • the first display area can be larger than the second display area, or smaller than the second display area.
  • the second display area, etc.; the positional relationship between the first display area and the second display area can be manually set by the user, or can be automatically set by the head-mounted augmented reality device, for example, the first display area can be located in the second display area , may also be surrounded by the second display area, etc., which is not limited here.
  • the second display area is located around the first display area.
  • the second display area can be located on the left and right sides of the first display area; the second display area can be located on the left and right sides and the lower side of the first display area; side; the second display area may be located on the right side, lower side, etc. of the first display area.
  • the target content image is displayed in the first display area, and the virtual road image is displayed around the target content image, while the user is watching the target content image, the remaining light can see the surrounding virtual road image, which can make the brain perceive Real motion status to prevent motion sickness.
  • the second display area when the head-mounted augmented reality device is in the wearing state, the second display area is located at the two sides and the bottom side of the first display area. Based on this, the target content image is displayed in the first display area, and the virtual road image is displayed on the left, right and bottom sides of the target content image, so the user can see the left, right and left sides while viewing the target content image.
  • the virtual road images on the side and bottom can make the brain perceive the real state of motion, thereby preventing motion sickness.
  • the first display area can correspond to the large upper middle area
  • the second display area can correspond to the left narrow area, right narrow area, and bottom narrow area.
  • the force is mainly concentrated on the target content image displayed in the large middle and upper area, and the virtual road condition image displayed in the left narrow area, right narrow area and bottom narrow area can be seen in the peripheral vision of the eyes, so that the brain perceives the real state of motion , thereby preventing motion sickness.
  • FIG. 4 shows a schematic diagram of a display screen of a head-mounted augmented reality device provided by an embodiment of the present application.
  • the display area of the display screen 130 is divided into a first display area 131 and a second display area 132, wherein the first display area 131 can be used to display target content images, and the second display area 132 can be Used to display virtual road images.
  • the display screen of the head-mounted augmented reality device can be divided into the first display area and the second display area by default, then after obtaining the virtual road condition image corresponding to the driving state, the A display area displays the target content image, and a virtual road condition image is displayed in the second display area of the display screen.
  • the display screen of the head-mounted augmented reality device may be divided into a first display area while acquiring the driving state of the vehicle and the second display area, after acquiring the virtual road condition image corresponding to the driving state, the target content image can be displayed in the first display area of the display screen, and the virtual road condition image can be displayed in the second display area of the display screen.
  • the head-mounted augmented reality device in the vehicle detects that the vehicle starts to drive, it obtains the driving state of the vehicle, obtains a virtual road condition image corresponding to the driving state, and displays it on the first screen of the display screen.
  • the target content image is displayed in the display area
  • the virtual road condition image is displayed in the second display area of the display screen, so that in the moving vehicle, the display screen of the head-mounted augmented reality device is divided into two areas to display the target content image and
  • the virtual road condition image enables the user to watch the virtual road condition image corresponding to the driving state of the vehicle while watching the target content image, so that the eye-sight information and the inner ear information are synchronized to achieve the effect of preventing motion sickness.
  • FIG. 5 shows a schematic flowchart of a display method provided by another embodiment of the present application. This method is applied to the above-mentioned head-mounted augmented reality device, and the following will elaborate on the process shown in Figure 5 in detail.
  • the head-mounted augmented reality device includes a display screen, and the display method may specifically include The following steps:
  • Step S210 When the head-mounted augmented reality device in the vehicle detects that the vehicle starts to drive, acquire motion parameters of the head-mounted augmented reality device.
  • the motion parameters of the head-mounted augmented reality device may be detected and acquired.
  • the head-mounted augmented reality device may include a motion sensor, and then the head-mounted augmented reality device may detect the motion state of the head-mounted augmented reality device in real time through its motion sensor.
  • the motion sensor may detect and acquire motion parameters of the head-mounted augmented reality device.
  • Step S220 Obtain the driving state of the vehicle based on the motion parameters of the head-mounted augmented reality device.
  • the motion parameters of the head-mounted augmented reality device may include two components, one is the motion parameters of the vehicle, and the other is the motion parameters of the user's head. Therefore, in this embodiment, after the motion parameters of the head-mounted augmented reality device are obtained, the motion parameters of the vehicle can be separated from the motion parameters of the head-mounted augmented reality device, and the vehicle's driving motion can be obtained based on the motion parameters of the vehicle. state.
  • FIG. 6 shows a schematic flowchart of step S220 of the display method shown in FIG. 5 of the present application.
  • the process shown in Figure 6 will be described in detail below, and the method may specifically include the following steps:
  • Step S221 Perform filtering processing on the motion parameters of the head-mounted augmented reality device, and separate the motion parameters of the vehicle from the motion parameters of the head-mounted augmented reality device.
  • the motion parameters of the head-mounted augmented reality device may include two components, one is the motion parameters of the vehicle, and the other is the motion parameters of the user's head. Therefore, in some implementation manners, after acquiring the motion parameters of the head-mounted augmented reality device, the motion parameters of the head-mounted augmented reality device may be filtered to separate the The motion parameters of the vehicle. That is to say, since the motion parameters of the head-mounted augmented reality device include the motion parameters of the vehicle and the motion parameters of the user's head, the motion parameters of the head-mounted augmented reality device can be filtered to filter out the head-mounted augmented reality device. Among the motion parameters of the augmented reality device, the motion parameters of the user's head are retained and the motion parameters of the vehicle are retained.
  • the natural frequency of the vehicle is different from the natural frequency of the user's head.
  • Each object has its own natural frequency, such as the vehicle
  • the vibration of the whole vehicle caused by the vibration of the engine when starting is the natural frequency of the vehicle, and this vibration frequency will always exist as long as the vehicle is started.
  • the natural frequency of mechanical equipment is generally high, while the natural frequency of human head movement is low, and there is no intersection between the two;
  • the motion parameters of the vehicle can be described by corresponding mathematical models, such as the acceleration of the vehicle , deceleration, left turn, right turn, etc. all correspond to different motion parameters, while the motion parameters of the user's head have no general rules to describe.
  • the motion parameters of the head-mounted augmented reality device can be filtered according to the difference between the motion parameters of the vehicle and the motion parameters of the user's head, and the motion parameters of the vehicle can be separated from the motion parameters of the head-mounted augmented reality device.
  • the motion parameters of the head-mounted augmented reality device may be filtered based on the natural frequency of the vehicle, and the head-mounted augmented reality device The motion parameters of the vehicle are separated from the motion parameters of the augmented reality device.
  • Step S222 Perform fitting processing on the motion parameters of the vehicle to obtain the driving state of the vehicle.
  • fitting processing may be performed on the acquired motion parameters of the vehicle to obtain the driving state of the vehicle.
  • the motion parameters of the vehicle can be fitted to restore the motion information of the vehicle, so as to obtain the driving state of the vehicle.
  • the method of obtaining the driving state of the vehicle in this embodiment is active acquisition, relying on the motion sensor on the head-mounted augmented reality device to detect the motion parameters of the head-mounted augmented reality device, and restore the result by filtering algorithm and data fitting
  • the real driving status of the vehicle does not require the vehicle manufacturer to provide a data interface, which can improve universality and promotion.
  • Step S230 Obtain a virtual road condition image corresponding to the driving state.
  • Step S240 displaying the target content image in the first display area of the display screen, and displaying the virtual road condition image in the second display area of the display screen.
  • step S230-step S240 please refer to step S120-step S130, which will not be repeated here.
  • the motion parameters of the head-mounted augmented reality device are acquired, based on the motion of the head-mounted augmented reality device parameter, acquire the driving state of the vehicle, obtain the virtual road image corresponding to the driving state, display the target content image in the first display area of the display screen, and display the virtual road image in the second display area of the display screen.
  • this embodiment also acquires the motion parameters of the head-mounted augmented reality device, and determines the driving state of the vehicle according to the motion parameters, thereby relying on the head-mounted augmented reality device to actively detect its motion parameters
  • the dependence on the data interface of the vehicle manufacturer can be avoided, and the universality and popularization can be improved.
  • FIG. 7 shows a schematic flowchart of a display method provided by another embodiment of the present application. This method is applied to the above-mentioned head-mounted augmented reality device. The following will elaborate on the process shown in FIG. 7 in detail.
  • the head-mounted augmented reality device includes a display screen, and the display method may specifically include The following steps:
  • Step S310 Displaying the target content image in a display area of the display screen, wherein the target content image completely covers the display area, and the display area includes the first display area and the second display area .
  • the head-mounted augmented reality device when it is turned on, if it is not in the vehicle in the driving state, it can display the target content image in full screen in the display area of the display screen, that is, it can display the target content image in the display area including the first The display areas of the first display area and the second display area display the target content image, and the target content image completely covers the display area.
  • the head-mounted augmented reality device when it is turned on, it can detect whether it is in the vehicle. Among them, when it is detected that it is not in the vehicle, the target content image can be displayed in full screen in the display area of the display screen; when it is detected that it is in the vehicle, the state of the vehicle can be detected; When the vehicle starts to drive, the target content image originally displayed in full screen in the display area can be switched to be displayed in the first display area of the display area, and a virtual road condition image can be displayed in the second display area of the display area.
  • prompt information can be output, wherein the The prompt information is used to prompt the user to select whether to switch the target content image from full-screen display to display in the first display area.
  • the target content image originally displayed in the display area in full screen may be switched to be displayed in the first display area in the display area, and displayed in the display area
  • the virtual road condition image is displayed in the second display area; when receiving the instruction information of rejecting switching output by the user based on the prompt information, the target content image can be displayed in full screen in the display area.
  • Step S320 When the head-mounted augmented reality device in the vehicle detects that the vehicle starts to drive, acquire the driving state of the vehicle.
  • Step S330 Obtain a virtual road condition image corresponding to the driving state.
  • Step S340 displaying the target content image in the first display area of the display screen, and displaying the virtual road condition image in the second display area of the display screen.
  • step S320-step S340 please refer to step S110-step S130, which will not be repeated here.
  • the target content image is displayed in the display area of the display screen, wherein the target content image completely covers the display area, and the display area includes the first display area and the second display area.
  • the wearable augmented reality device detects that the vehicle starts to drive, it obtains the driving state of the vehicle, obtains the virtual road condition image corresponding to the driving state, displays the target content image in the first display area of the display screen, and displays the target content image in the second display area of the display screen.
  • Virtual traffic image Compared with the display method shown in FIG. 3, this embodiment can also display the target content image in full screen in advance, and then switch to the first display area to display the target content image, and display the virtual road condition image in the second display area to suit Match different usage scenarios.
  • FIG. 8 shows a schematic flowchart of a display method provided by another embodiment of the present application. This method is applied to the above-mentioned head-mounted augmented reality device. The process shown in FIG. 8 will be described in detail below.
  • the head-mounted augmented reality device includes a display screen, and the display method may specifically include The following steps:
  • Step S410 When the head-mounted augmented reality device is in the first mode, display the target content image in the display area of the display screen, wherein the target content image completely covers the display area, and the display The regions include the first display region and the second display region.
  • the head-mounted augmented reality device when the head-mounted augmented reality device is turned on, it can detect the mode it is in, and when it is detected that the mode it is in is the first mode (normal mode), it can display
  • the target content image can be displayed in full screen in the display area of the screen, that is, the target content image can be displayed in the display area including the first display area and the second display area, and the target content image completely covers the display area.
  • the head-mounted augmented reality device when the head-mounted augmented reality device is turned on, if it is not in a vehicle in a driving state, its mode can be automatically set to the first mode, or a prompt message can be output to prompt the user to set the Its mode is set to the first mode, and when it is determined that the head-mounted augmented reality device is in the first mode, the target content image can be displayed in full screen in the display area of the display screen.
  • the head-mounted augmented reality device when the head-mounted augmented reality device is turned on, it can detect whether it is in the vehicle. Wherein, when it is detected that it is not in the vehicle, its mode can be automatically set to the first mode, or prompt information can be output to prompt the user to set its mode to the first mode. In the first mode, the target content image can be displayed in full screen in the display area of the display screen.
  • the state of the vehicle When it is detected that it is in the vehicle, the state of the vehicle can be detected, and when it is detected that the state of the vehicle is a parking state, its mode can be automatically set to the first mode, or a prompt message can be output
  • the target content image may be displayed in full screen in the display area of the display screen.
  • Step S420 When it is detected that the vehicle starts to drive and the head-mounted augmented reality device is switched from the first mode to the second mode, acquire the driving state of the vehicle.
  • the mode in which the head-mounted augmented reality device is located can be automatically set to the second mode (vehicle mode).
  • vehicle mode vehicle mode
  • the augmented reality device can acquire the driving state of the vehicle, display the target content image in the first display area of the display area, and display the virtual road conditions corresponding to the driving state in the second display area of the display area image.
  • a prompt message may be output to prompt the user to set the mode of the head-mounted augmented reality device as the second mode, and after determining When the head-mounted augmented reality device is in the second mode, it can acquire the driving state of the vehicle, display the target content image in the first display area of the display area, and display the corresponding information corresponding to the driving state in the second display area of the display area.
  • Virtual traffic image when it is detected that the vehicle in which the head-mounted augmented reality device is located starts to drive, a prompt message may be output to prompt the user to set the mode of the head-mounted augmented reality device as the second mode, and after determining When the head-mounted augmented reality device is in the second mode, it can acquire the driving state of the vehicle, display the target content image in the first display area of the display area, and display the corresponding information corresponding to the driving state in the second display area of the display area. Virtual traffic image.
  • the The mode is switched from the first mode (normal mode) to the second mode (vehicle mode).
  • the driving state of the vehicle can be obtained, and the target that was originally displayed in the display area in full screen
  • the content image is switched to be displayed in the first display area of the display area, and the virtual road condition image corresponding to the driving state is displayed in the second display area of the display area.
  • Step S430 Obtain a virtual road condition image corresponding to the driving state.
  • Step S440 displaying the target content image in the first display area of the display screen, and displaying the virtual road condition image in the second display area of the display screen.
  • step S430-step S440 please refer to step S120-step S130, which will not be repeated here.
  • the target content image is displayed in the display area of the display screen, wherein the target content image completely covers the display area, and the display area includes the first In the display area and the second display area
  • the driving state of the vehicle is obtained, and the virtual road condition image corresponding to the driving state is obtained.
  • the target content image is displayed in the first display area of the display screen, and the virtual road condition image is displayed in the second display area of the display screen.
  • FIG. 9 shows a schematic flowchart of a display method provided by still another embodiment of the present application. This method is applied to the above-mentioned head-mounted augmented reality device. The flow shown in FIG. 9 will be described in detail below.
  • the head-mounted augmented reality device includes a display screen, and the display method may specifically include The following steps:
  • Step S510 When the head-mounted augmented reality device in the vehicle detects that the vehicle starts to drive, acquire the driving state of the vehicle.
  • step S510 for the specific description of step S510, please refer to step S110, which will not be repeated here.
  • Step S520 Select a virtual road from multiple virtual roads as the target virtual road in response to the virtual road selection instruction.
  • the plurality of virtual roads may include, but is not limited to: highways, country lanes, mountain roads, and urban roads.
  • the head-mounted augmented reality device can be preset and stored with multiple virtual roads, and when the head-mounted augmented reality device detects that the vehicle it is in starts to drive, it can display a virtual road selection control, which The virtual road selection control is used for the user to select one virtual road from multiple virtual roads as the target virtual road, so as to increase the user's selection diversity of virtual roads.
  • a virtual road selection control when a virtual road selection instruction is received, a virtual road may be selected from a plurality of virtual roads as the target virtual road in response to the virtual road selection instruction.
  • the head-mounted augmented reality device can be preset and stored with multiple virtual roads, and when the head-mounted augmented reality device detects that the vehicle it is on starts to drive, Detecting, determining a virtual road matching the detected road as a target virtual road from a plurality of virtual roads according to the detected road. For example, when it is detected that the road on which the vehicle is driving is a highway, then "highway" can be determined from multiple virtual roads as the target virtual road; Among the virtual roads, "country lane” is determined as the target virtual road.
  • Step S530 Obtain the virtual road condition image based on the driving state and the target virtual road.
  • a virtual road condition image may be acquired based on the driving state of the vehicle and the target virtual road. For example, when the target virtual road is a highway and the driving state of the vehicle is accelerating forward, then the corresponding virtual road condition image can be acquired as expressway accelerating backward; when the target virtual road is a country lane and the driving state of the vehicle is backward, Then the corresponding virtual road condition image can be obtained as a country road; when the target virtual road is a winding road and the driving state of the vehicle is turning left, the corresponding virtual road condition image can be obtained as a winding road winding to the left, and the virtual At the same time, the road condition image will be switched to the content seen from the right perspective; when the target virtual road is a winding road and the driving state of the vehicle is turning right, the corresponding virtual road condition image can be obtained as the winding road winding to the right, and the virtual The traffic image will also switch to the content seen from the left perspective.
  • Step S540 displaying the target content image in the first display area of the display screen, and displaying the virtual road condition image in the second display area of the display screen.
  • step S540 please refer to step S130, which will not be repeated here.
  • the head-mounted augmented reality device in the vehicle detects that the vehicle starts to drive, it acquires the driving state of the vehicle, and selects from multiple virtual roads in response to a virtual road selection instruction.
  • a virtual road is used as the target virtual road, based on the driving state and the target virtual road, a virtual road condition image is obtained, the target content image is displayed in the first display area of the display screen, and the virtual road condition image is displayed in the second display area of the display screen.
  • this embodiment also selects a target virtual road from a plurality of virtual roads according to a virtual road selection instruction, so as to improve the user's autonomous choice.
  • FIG. 10 shows a schematic flowchart of a display method provided in yet another embodiment of the present application. This method is applied to the above-mentioned head-mounted augmented reality device. The following will elaborate on the flow shown in FIG. 10 in detail.
  • the head-mounted augmented reality device includes a display screen, and the display method may specifically include The following steps:
  • Step S610 When the head-mounted augmented reality device in the vehicle detects that the vehicle starts to drive, acquire the driving state of the vehicle.
  • Step S620 Obtain a virtual road condition image corresponding to the driving state.
  • step S610-step S620 please refer to step S110-step S130, which will not be repeated here.
  • Step S630 Select a content image from multiple content images as a target content image in response to the content image selection instruction.
  • the plurality of content images may include, but is not limited to: game content images, video content images, news content images, and chat content images.
  • the head-mounted augmented reality device or the electronic device connected to the head-mounted augmented reality device can be preset and stored with multiple content images, then when the head-mounted augmented reality device is turned on, the content images can be displayed
  • a selection control the content image selection control is used for the user to select a content image from multiple content images as a target content image, so as to increase the diversity of selection of content images by the user.
  • a content image may be selected from multiple content images as the target content image in response to the content image selection instruction.
  • the head-mounted augmented reality device or the electronic device connected to the head-mounted augmented reality device can be preset and stored with a plurality of content images, then when the head-mounted augmented reality device is turned on, the head-mounted augmented reality device can The content image displayed last time by the augmented reality device is detected, and the content image matching the content image displayed last time is selected from the plurality of content images as the target content image.
  • the head-mounted augmented reality device or the electronic device connected to the head-mounted augmented reality device can be preset and stored with a plurality of content images, then when the head-mounted augmented reality device is turned on, the head-mounted augmented reality device can The augmented reality device detects the content image that is displayed the most times, and selects the content image that matches the content image that is displayed the most times from the plurality of content images as the target content image.
  • Step S640 Displaying the target content image in the first display area of the display screen.
  • Step S650 Displaying the virtual road condition image in the second display area of the display screen.
  • step S640-step S650 please refer to step S130, which will not be repeated here.
  • the head-mounted augmented reality device in the vehicle detects that the vehicle starts to drive, it acquires the driving state of the vehicle, acquires a virtual road condition image corresponding to the driving state, and responds to the content selection
  • An instruction is to select a content image from multiple content images as a target content image, display the target content image in the first display area of the display screen, and display a virtual road condition image in the second display area of the display screen.
  • this embodiment also selects a target content image from a plurality of content images according to a content image selection instruction, so as to improve the user's autonomous selectivity.
  • FIG. 11 shows a block diagram of modules of a display device provided by an embodiment of the present application.
  • the display device 300 is applied to the above-mentioned head-mounted augmented reality device.
  • the block diagram shown in FIG. 11 will be described below.
  • the head-mounted augmented reality device includes a display screen
  • the displayed display device 300 includes: Driving state acquisition module 310, virtual road condition image acquisition module 320 and display module 330, wherein:
  • the driving state acquisition module 310 is configured to acquire the driving state of the vehicle when the head-mounted augmented reality device in the vehicle detects that the vehicle starts to drive.
  • the driving state acquisition module 310 includes: a motion parameter acquisition submodule and a first driving state acquisition submodule, wherein:
  • the motion parameter acquisition sub-module is used to acquire the motion parameters of the head-mounted augmented reality device.
  • the first driving state acquiring submodule is configured to acquire the driving state of the vehicle based on the motion parameters of the head-mounted augmented reality device.
  • the driving state acquisition sub-module includes: a motion parameter acquisition unit and a driving state acquisition unit, wherein:
  • the motion parameter acquisition unit is configured to filter the motion parameters of the head-mounted augmented reality device, and separate the motion parameters of the vehicle from the motion parameters of the head-mounted augmented reality device.
  • the motion parameter acquisition unit includes: a motion parameter acquisition unit, wherein:
  • a motion parameter acquisition unit configured to filter the motion parameters of the head-mounted augmented reality device based on the natural frequency of the vehicle, and separate the motion of the vehicle from the motion parameters of the head-mounted augmented reality device parameter.
  • the driving state acquisition unit is configured to perform fitting processing on the motion parameters of the vehicle to obtain the driving state of the vehicle.
  • the driving state obtaining module 310 includes: a second driving state obtaining sub-module, wherein:
  • the second driving state acquisition sub-module is configured to acquire the driving state of the vehicle when it is detected that the vehicle starts to drive and the head-mounted augmented reality device is switched from the first mode to the second mode.
  • the virtual road condition image acquisition module 320 is configured to acquire a virtual road condition image corresponding to the driving state.
  • the virtual road condition image acquisition module 320 includes: a target virtual road selection submodule and a virtual road condition image acquisition submodule, wherein:
  • the target virtual road selection submodule is configured to select a virtual road from a plurality of virtual roads as the target virtual road in response to a virtual road selection instruction.
  • the virtual road condition image acquisition submodule is configured to obtain the virtual road condition image based on the driving state and the target virtual road.
  • the display module 330 is configured to display the target content image in the first display area of the display screen, and display the virtual road condition image in the second display area of the display screen.
  • the display module 330 includes: a target content image selection submodule and a display submodule, wherein:
  • the target content image selection submodule is configured to select a content image from multiple content images as the target content image in response to the content image selection instruction.
  • a display submodule configured to display the target content image in the first display area of the display screen.
  • the display device 300 also includes: a target content image display module, wherein:
  • a target content image display module configured to display the target content image in a display area of the display screen, wherein the target content image completely covers the display area, and the display area includes the first display area and the the second display area.
  • the target content image display module includes: a target content image display submodule, wherein:
  • the target content image display submodule is configured to display the target content image in the display area of the display screen when the head-mounted augmented reality device is in the first mode.
  • the coupling between the modules may be electrical, mechanical or other forms of coupling.
  • each functional module in each embodiment of the present application may be integrated into one processing module, each module may exist separately physically, or two or more modules may be integrated into one module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules.
  • FIG. 12 shows a structural block diagram of a head-mounted augmented reality device 100 provided by an embodiment of the present application.
  • the head-mounted augmented reality device 100 may be an electronic device capable of running application programs, such as a smart phone, a tablet computer, and an e-book.
  • the head-mounted augmented reality device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, a display screen 130, and one or more application programs, wherein one or more application programs may be stored in the memory 120 and is configured to be executed by one or more processors 110, and one or more programs are configured to execute the methods described in the foregoing method embodiments.
  • the processor 110 may include one or more processing cores.
  • the processor 110 uses various interfaces and lines to connect various parts in the whole head-mounted augmented reality device 100, and runs or executes instructions, programs, code sets or instruction sets stored in the memory 120, and calls stored in the memory 120. Execute various functions of the head-mounted augmented reality device 100 and process data.
  • the processor 110 may adopt at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware.
  • DSP Digital Signal Processing
  • FPGA Field-Programmable Gate Array
  • PLA Programmable Logic Array
  • the processor 110 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a modem, and the like.
  • CPU Central Processing Unit
  • GPU Graphics Processing Unit
  • the CPU mainly handles the operating system, user interface and application programs, etc.
  • the GPU is used to render and draw the content to be displayed
  • the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 110, but may be realized by a communication chip alone.
  • the memory 120 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory).
  • the memory 120 may be used to store instructions, programs, codes, sets of codes, or sets of instructions.
  • the memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system and instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.) , instructions for implementing the following method embodiments, and the like.
  • the storage data area can also store data created by the head-mounted augmented reality device 100 during use (such as phonebook, audio and video data, chat record data) and the like.
  • the display screen 130 is used to display information input by the user, information provided to the user, and various graphical user interfaces of the head-mounted augmented reality device 100. These graphical user interfaces can be composed of graphics, text, icons, numbers, videos, and In one example, the display screen 130 can be a liquid crystal display (Liquid Crystal Display, LCD) or an organic light-emitting diode (Organic Light-Emitting Diode, OLED), which is not limited here.
  • LCD Liquid Crystal Display
  • OLED Organic Light-Emitting Diode
  • FIG. 13 shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application.
  • Program codes are stored in the computer-readable medium 400, and the program codes can be invoked by a processor to execute the methods described in the foregoing method embodiments.
  • the computer readable storage medium 400 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM.
  • the computer-readable storage medium 400 includes a non-transitory computer-readable storage medium (non-transitory computer-readable storage medium).
  • the computer-readable storage medium 400 has a storage space for program code 410 for executing any method steps in the above methods. These program codes can be read from or written into one or more computer program products.
  • Program code 410 may, for example, be compressed in a suitable form.
  • the display method, device, head-mounted augmented reality device, and storage medium provided by the embodiments of the present application divide the display screen of the head-mounted augmented reality device into two areas to display The target content image and the virtual road condition image corresponding to the driving state of the vehicle, so that the user can watch the virtual road condition image corresponding to the driving state of the vehicle while viewing the target content image, so that the visual information and the inner ear information are synchronized to prevent motion sickness Effect.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Instrument Panels (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种显示方法、装置(300)、头戴式增强现实设备(100)以及存储介质(400),涉及增强现实技术领域。显示方法应用于包括显示屏(130)的头戴式增强现实设备(100),包括:当处于车辆(200)内的头戴式增强现实设备(100)检测到车辆(200)开始行驶时,获取车辆(200)的行驶状态(S110),获取与行驶状态对应的虚拟路况图像(S120),在显示屏(130)的第一显示区域(131)显示目标内容图像,并在显示屏(130)的第二显示区域(132)显示虚拟路况图像(S130)。通过在行驶的车辆(200)中,将头戴式增强现实设备(100)的显示屏(130)分为两个区域分别显示目标内容图像和虚拟路况图像,使得用户在观看目标内容图像的同时可以观看到与车辆(200)的行驶状态对应的虚拟路况图像,以使眼见信息和内耳信息同步,达到防止晕车的效果。

Description

显示方法、装置、头戴式增强现实设备以及存储介质
相关申请的交叉引用
本申请要求于2021年07月16日提交的申请号为CN202110806323.X的中国申请的优先权,其在此出于所有目的通过引用将其全部内容并入本文。
技术领域
本申请涉及增强现实技术领域,更具体地,涉及一种显示方法、装置、头戴式增强现实设备以及存储介质。
背景技术
近年来,随着车辆技术的发展,越来越多的用户依靠车辆作为出行工具。但是,用户在乘坐车辆时,容易出现晕车的情况,特别地,当用户在乘坐车辆的同时观看电子设备的内容时,由于眼见信息和内耳信息的不同步,会提升晕车的概率。
发明内容
鉴于上述问题,本申请提出了一种显示方法、装置、头戴式增强现实设备以及存储介质,以解决上述问题。
第一方面,本申请实施例提供了一种显示方法,应用于头戴式增强现实设备,所述头戴式增强现实设备包括显示屏,所述方法包括:当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述车辆的行驶状态;获取与所述行驶状态对应的虚拟路况图像;在所述显示屏的第一显示区域显示目标内容图像,并在所述显示屏的第二显示区域显示所述虚拟路况图像。
第二方面,本申请实施例提供了一种显示装置,应用于头戴式增强现实设备,所述头戴式增强现实设备包括显示屏,所述装置包括:行驶状态获取模块,用于当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述车辆的行驶状态;虚拟路况图像获取模块,用于获取与所述行驶状态对应的虚拟路况图像;显示模块,用于在所述显示屏的第一显示区域显示目标内容图像,并在所述显示屏的第二显示区域显示所述虚拟路况图像。
第三方面,本申请实施例提供了一种头戴式增强现实设备,包括显示屏、存储器和处理器,所述显示屏和所述存储器耦接到所述处理器,所述存储器存储指令,当所述指令由所述处理器执行时所述处理器执行上述方法。
第四方面,本申请实施例提供了一种计算机可读取存储介质,所述计算机可读取存储介质中存储有程序代码,所述程序代码可被处理器调用执行上述方法。
附图说明
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它的附图。
图1示出了本申请实施例提供的显示方法的一个应用场景的示意图;
图2示出了本申请实施例提供的显示方法的另一个应用场景的示意图;
图3示出了本申请实施例提供的显示方法的流程示意图;
图4示出了本申请实施例提供的头戴式增强现实设备的显示屏的示意图;
图5示出了本申请又一个实施例提供的显示方法的流程示意图;
图6示出了本申请的图5所示的显示方法的步骤S220的流程示意图;
图7示出了本申请再一个实施例提供的显示方法的流程示意图;
图8示出了本申请另一个实施例提供的显示方法的流程示意图;
图9示出了本申请又再一个实施例提供的显示方法的流程示意图;
图10示出了本申请又另一个实施例提供的显示方法的流程示意图;
图11示出了本申请实施例提供的显示装置的模块框图;
图12示出了本申请实施例用于执行根据本申请实施例的显示方法的电子设备的框图;
图13示出了本申请实施例的用于保存或者携带实现根据本申请实施例的显示方法的程序代码的存储单元。
具体实施方式
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。
发明人经过研究发现,为了防止用户在乘坐车辆时出现晕车的问题,可以让用户佩戴头戴式虚拟现实(VR,Virtual Reality)设备,其中,其防晕车原理是在头戴式虚拟现实设备中播放跟车辆的行驶状态相匹配的画面,使人脸能够感知到与人身体的运动状态一致的信息,以此来达到防晕车的效果。其中,在头戴式虚拟现实设备的应用中,头戴式虚拟现实设备需要访问所有的车辆信息,如刹车信息、油门信息、悬架信息等,头戴式虚拟现实设备根据获取到的车辆信息,推算出车辆的行驶状态,根据车辆的行驶状态显示相匹配的画面,使用户的视觉信息与身体接受的信息互相匹配,从而达到防晕车的效果。
但是,头戴式虚拟现实设备需要获取车辆提供获取车辆信息的接口,此举需要和车辆厂商建立合作关系,合作成本较高,且需要兼顾不同的车辆厂商、不同的车型,技术的普适性和推广性较差。另外,用户在佩戴头戴式虚拟现实设备时无法看到现实世界,在行驶的车辆中用户无法快速感知和应对突发状况,安全性不高。
针对上述问题,发明人经过长期的研究发现,并提出了本申请实施例提供的显示方法、装置、头戴式增强现实(AR,Augmented Reality)设备以及存储介质,通过在行驶的车辆中,将头戴式增强现实设备的显示屏分为两个区域分别显示目标内容图像和与车辆的行驶状态对应的虚拟路况图像,使得用户在观看目标内容图像的同时可以观看到与车辆的行驶状态对应的虚拟路况图像,以使眼见信息和内耳信息同步,达到防止晕车的效果。其中,具体的显示方法在后续的实施例中进行详细的说明。
下面将针对可用于本申请实施例提供的显示方法的应用场景进行介绍。
请参见图1,图1示出了本申请实施例提供的显示方法的一个应用场景的示意图,该应用场景包括头戴式增强现实设备100和车辆200,如图1所示,佩戴该头戴式增强现实设备100的用户可以坐在车辆200里的副驾驶位置。
请参见图2,图2示出了本申请实施例提供的显示方法的另一个应用场景的示意图,该应用场景包括头戴式增强现实设备100和车辆200,如图2所示,佩戴该头戴式增强现实设备100的用户可以坐在车辆200里的后排位置。
当然,佩戴该头戴式增强现实设备100的用户还可以坐在车辆200里的其他位置,在此不再赘述。
在本申请实施例中,头戴式增强现实设备100可以为一体式头戴显示装置,头戴式增强现实设备100也可以是与外接式头戴显示装置连接的手机等智能终端,即头戴式增强现实设备100可作为头戴显示装置的处理和存储设备,***或者接入外接式头戴显示装置,在头戴显示装置中对虚拟对象进行显示功能。
请参阅图3,图3示出了本申请实施例提供的显示方法的流程示意图。该显示方法用于通过在行驶的车辆中,将头戴式增强现实设备的显示屏分为两个区域分别显示目标内容图像和与车辆的行驶状态对应的虚拟路况图像,使得用户在观看目标内容图像的同时可以观看到与车辆的行驶状态对应的虚拟路况图像,以使眼见信息和内耳信息同步,达到防止晕车的效果。在具体的实施例中,该显示方法应用于如图10所示的显示装置300以及配置有显示装置300的头戴式增强现实设备100(图11)。下面将针对图3所示的流程进行详细的阐述,在本实施例中,该头戴式增强现实设备包括显示屏,所述显 示方法具体可以包括以下步骤:
步骤S110:当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述车辆的行驶状态。
在本实施例中,用户在乘坐车辆时可以佩戴头戴式增强现实设备,其中,用户可以乘坐于车辆的前排位置,也可以乘坐于车辆的后排位置,在此不做限定。相应地,该头戴式增强现实设备则处于车辆内。
在本实施例中,头戴式增强现实设备可以对所处的车辆所处的状态进行检测,当检测到该车辆所处的状态表征该车辆开始行驶时,则可以获取车辆的行驶状态。
在一些实施方式中,头戴式增强现实设备可以检测其是否处于车辆内,当检测到其处于车辆内时,则可以对其所处的车辆所处的状态进行检测。例如,该头戴式增强现实设备可以包括摄像头,则头戴式增强现实设备可以通过摄像头检测其是否处于车辆内;又例如,该头戴式增强现实设备可以包括信息输入装置,则头戴式增强现实设备可以通过信息输入装置获取外界输入的信息,并基于外界输入的信息确定其是否处于车辆内。
在一些实施方式中,头戴式增强现实设备可以检测其是否处于佩戴状态,当检测到其处于佩戴状态时,可以检测佩戴该头戴式增强现实设备的用户是否处于车辆内,当检测到其处于车辆内时,则可以对其所处车辆所处的状态进行检测。例如,该头戴式增强现实设备可以包括压力传感器,则头戴式增强现实设备可以通过压力传感器检测其是否处于佩戴状态;又例如,该头戴式增强现实设备可以包括接触传感器,则头戴式增强现实设备可以通过接触传感器检测其是否处于佩戴状态。
作为一种方式,头戴式增强现实设备对所处的车辆所处的状态进行检测可以包括:对该车辆在预设时长内的前进距离进行检测,其中,当检测到该车辆在预设时长内的前进距离小于预设前进距离时,则可以确定该车辆处于停车状态;当检测到该车辆从在预设时长内的前进距离小于预设前进距离变化为在预设时长内的前进距离不小于预设前进距离时,则可以确定该车辆开始行驶。
作为又一种方式,头戴式增强现实设备对所处的车辆所处的状态进行检测可以包括:对该车辆是否熄火进行检测,当检测到该车辆熄火时,则可以确定该车辆处于停车状态,当检测到该车辆从熄火变化为未熄火时,则可以确定该车辆开始行驶。
作为再一种方式,头戴式增强现实设备对所处的车辆所处的状态进行检测可以包括:头戴式增强现实设备可以包括运动传感器,则头戴式增强现实设备可以通过其运动传感器对车辆所处的状态进行检测,当通过运动传感器检测到目标运动参数时,则可以确定检测到车辆开始行驶。
在一些实施方式中,头戴式增强现实设备和车辆可以连接,则头戴式增强现实设备可以基于与车辆的连接,获取车辆发送的其行驶状态。例如,头戴式增强现实设备可以和车辆的车载终端连接,则头戴式增强现实设备可以基于该车载终端的连接,获取车载终端发送的其行驶状态。
在一些实施方式中,头戴式增强现实设备可以包括运动传感器,则头戴式增强现实设备可以通过其运动传感器,检测获得车辆的行驶状态。
作为一种可实施的方式,车辆的行驶状态可以但不限于包括:车辆的速度变化和车辆的行驶方向。
步骤S120:获取与所述行驶状态对应的虚拟路况图像。
在一些实施方式中,在获取车辆的行驶状态后,则可以获取与该车辆的行驶状态对应的虚拟路况图像。例如,当获取到车辆的行驶状态为加速前进时,则可以获取其对应的虚拟路况图像为道路加速后退;当获取到车辆的行驶状态为倒退时,则可以获取其对应的虚拟路况图像为道路前进;当获取到车辆的行驶状态为左转时,则可以获取其对应的虚拟路况图像为道路向左蜿蜒,且虚拟路况图像同时会切换为右方视角看到的内容;当获取到车辆的行驶状态为右转时,则可以获取其对应的虚拟路况图像为道路向右蜿蜒,且虚拟路况图像同时会切 换为左方视角看到的内容。
作为一种可实施的方式,可以预先建立映射关系表作为预设映射关系表,该预设映射关系表中包括多个行驶状态、多个虚拟路况图像、以及多个行驶状态和多个虚拟路况图像之间的对应关系,其中,多个行驶状态和多个虚拟路况图像可以一一对应。如表1所示,该预设映射关系表中可以包括行驶状态A1、行驶状态A2、行驶状态A3、虚拟路况图像B1、虚拟路况图像B2、虚拟路况图像B3,其中,行驶状态A1和虚拟路况图像B1存在对应关系,行驶状态A2和虚拟路况图像B2存在对应关系,行驶状态A3和虚拟路况图像B3存在对应关系。
表1
行驶状态A 虚拟路况图像B
A1 B1
A2 B2
A3 B3
…… ……
因此,在本实施例中,在获取车辆的行驶状态后,可以基于预设映射关系表,获取与该车辆的行驶状态对应的虚拟路况图像。例如,当获取到车辆的行驶状态与行驶状态A1匹配时,则可以基于预设映射关系表,确定与该车辆的行驶状态对应的虚拟路况图像为虚拟路况图像B1。
步骤S130:在所述显示屏的第一显示区域显示目标内容图像,并在所述显示屏的第二显示区域显示所述虚拟路况图像。
在本实施例中,目标内容图像表征用户期望现实的内容图像,例如,可以为视频图像、可以为游戏图像等;虚拟路况图像为与车辆的运动状态相匹配的虚拟道路图像。在一些实施方式中,目标内容图像可以为头戴式增强现实设备本地存储的,目标内容图像也可以为与头戴式增强现实设备连接的电子设备(如智能手机)投影的,以实现智能手机的内容在头戴式增强现实设备中显示,防止在行驶的车辆中使用智能手机而晕车。
在本实施例中,头戴式增强现实设备的显示屏的显示区域包括第一显示区域和第二显示区域。其中,第一显示区域和第二显示区域的大小关系可以由用户手动设定、也可以由头戴式增强现实设备自动设定,例如,第一显示区域可以大于第二显示区域,也可以小于第二显示区域等;第一显示区域和第二显示区域的位置关系可以由用户手动设定、也可以由头戴式增强现实设备自动设定,例如,第一显示区域可以位于第二显示区域的上方,也可以被第二显示区域包围等,在此不做限定。
作为一种可实施的方式,第二显示区域位于第一显示区域的周边。例如,第二显示区域可以位于第一显示区域的左右两侧;第二显示区域可以位于第一显示区域的左右两侧以及下侧;第二显示区域可以位于第一显示区域的左侧和下侧;第二显示区域可以位于第一显示区域的右侧和下侧等。基于此,目标内容图像显示于第一显示区域,虚拟道路图像显示于目标内容图像的周边,则用户在观看目标内容图像的同时,其余光可以看到周边的虚拟道路图像,可以使得大脑感知到真实的运动状态,从而防止晕车。
在一些实施方式中,当头戴式增强现实设备处于佩戴状态时,则该第二显示区域位于第一显示区域的两侧和底侧。基于此,目标内容图像显示于第一显示区域,虚拟道路图像显示于目标内容图像的左侧、右侧以及底侧,则用户在观看目标内容图像的同时,其余光可以看到左侧、右侧以及底侧的虚拟道路图像,可以使得大脑感知到真实的运动状态,从而防止晕车。作为一种方式,第一显示区域可以对应中上部大区域,第二显示区域可以对应左侧窄区域、右侧窄区域以及底侧窄区域,用户在佩戴使用头戴式增强现实设备时的注意力主要集中在中上部大区域显示的目标内容图像上,眼睛余光可看到左侧窄区域、右侧窄区域以及底侧窄区域中显示的虚拟路况图像,使大脑感知到真实的运动状态,从而防止晕车。
请参阅图4,图4示出了本申请实施例提供的头戴式增强现实设备的显示屏的示意图。如图4所示,该显示屏130的显示区域划分为第一显示区域131和第二显示区域132,其中,该第一显示区域131可以用于显示目标内容图像,该第二显示区域132可以用于显示虚拟道路图像。
在一些实施方式中,头戴式增强现实设备的显示屏可以默认且预先划分第一显示区域和第二显示区域,则在获取与行驶状态对应的虚拟路况图像后,可以直接在显示屏的第一显示区域显示目标内容图像,以及在显示屏的第二显示区域显示虚拟路况图像。
在一些实施方式中,当处于车辆内的头戴式增强现实设备检测到车辆开始行驶时,在获取车辆的行驶状态的同时,可以将头戴式增强现实设备的显示屏划分为第一显示区域和第二显示区域,则在获取与行驶状态对应的虚拟路况图像后,可以在显示屏的第一显示区域显示目标内容图像,以及在显示屏的第二显示区域显示虚拟路况图像。
本申请一个实施例提供的显示方法,当处于车辆内的头戴式增强现实设备检测到车辆开始行驶时,获取车辆的行驶状态,获取与行驶状态对应的虚拟路况图像,在显示屏的第一显示区域显示目标内容图像,并在显示屏的第二显示区域显示虚拟路况图像,从而通过在行驶的车辆中,将头戴式增强现实设备的显示屏分为两个区域分别显示目标内容图像和虚拟路况图像,使得用户在观看目标内容图像的同时可以观看到与车辆的行驶状态对应的虚拟路况图像,以使眼见信息和内耳信息同步,达到防止晕车的效果。
请参阅图5,图5示出了本申请又一个实施例提供的显示方法的流程示意图。该方法应用于上述头戴式增强现实设备,下面将针对图5所示的流程进行详细的阐述,在本实施例中,该头戴式增强现实设备包括显示屏,所述显示方法具体可以包括以下步骤:
步骤S210:当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述头戴式增强现实设备的运动参数。
在本实施例中,当处于车辆内的头戴式增强现实设备检测到车辆开始行驶时,则可以检测并获取该头戴式增强现实设备的运动参数。
作为一种方式,头戴式增强现实设备可以包括运动传感器,则头戴式增强现实设备可以通过其运动传感器实时检测头戴式增强现实设备的运动状态,当基于头戴式增强现实设备的运动传感器确定该头戴式增强现实设备在行驶的车辆中处于佩戴状态时,则可以通过该运动传感器检测并获取该头戴式增强现实设备的运动参数。
步骤S220:基于所述头戴式增强现实设备的运动参数,获取所述车辆的行驶状态。
其中,头戴式增强现实设备的运动参数可以包含两种成分,其一是车辆的运动参数,其二是用户头部的运动参数。因此,在本实施例中,在获取头戴式增强现实设备的运动参数后,可以从头戴式增强现实设备的运动参数中分离出车辆的运动参数,并基于车辆的运动参数获取车辆的行驶状态。
请参阅图6,图6示出了本申请的图5所示的显示方法的步骤S220的流程示意图。下面将针对图6所示的流程进行详细的阐述,所述方法具体可以包括以下步骤:
步骤S221:对所述头戴式增强现实设备的运动参数进行滤波处理,从所述头戴式增强现实设备的运动参数中分离出所述车辆的运动参数。
其中,头戴式增强现实设备的运动参数可以包含两种成分,其一是车辆的运动参数,其二是用户头部的运动参数。因此,在一些实施方式中,在获取头戴式增强现实设备的运动参数后,则可以对头戴式增强现实设备的运动参数进行滤波处理,从头戴式增强现实设备的运动参数中分离出车辆的运动参数。也就是说,由于头戴式增强现实设备的运动参数包括车辆的运动参数和用户头部的运动参数,因此,可以对头戴式增强现实设备的运动参数进行滤波处理,以过滤掉头戴式增强现实设备的运动参数中的用户头部的运动参数并保留车辆的运动参数。
其中,车辆的运动参数和用户头部的运动参数存在以下两个主要区别:第一,是车辆固有频率和用户头部的固有频率不同,其中,每种物体都有自己的固有频率,比如车辆 启动时由于发动机震动造成的整车震动就是车辆的固有频率,这种震动频率只要车辆一启动就一直存在。机械设备的固有频率一般较高,而人体头部运动的固有频率则较低,两者不存在交集;第二,是车辆的运动参数可以找到对应的相应的数学模型进行描述,如车辆的加速、减速、左转弯、右转弯等都对应了不同的运动参数,而用户头部的运动参数则无一般规律可描述。因此,可以根据车辆的运动参数和用户头部的运动参数的区别,对头戴式增强现实设备的运动参数进行滤波处理,从头戴式增强现实设备的运动参数中分离出车辆的运动参数。
在一些实施方式中,由于车辆的固有频率和用户头部的固有频率不存在交集,因此,可以基于车辆的固有频率对所述头戴式增强现实设备的运动参数进行滤波处理,从头戴式增强现实设备的运动参数中分离出车辆的运动参数。
步骤S222:对所述车辆的运动参数进行拟合处理,获得所述车辆的行驶状态。
在一些实施方式中,在从头戴式增强现实设备的运动参数中获取车辆的运动参数之后,可以对所获取的车辆的运动参数进行拟合处理,获得车辆的行驶状态。作为一种方式,在从头戴式增强现实设备的运动参数中获取车辆的运动参数后,可以对车辆的运动参数进行拟合以还原车辆的运动信息,从而获得车辆的行驶状态。
可以理解的,本实施例获取车辆行驶状态的方式为主动获取,依靠头戴式增强现实设备上自带的运动传感器检测头戴式增强现实设备的运动参数,通过滤波算法和数据拟合还原出车辆的真实行驶状态,无需车辆厂商提供数据接口,可以提升普适性和推广性。
步骤S230:获取与所述行驶状态对应的虚拟路况图像。
步骤S240:在所述显示屏的第一显示区域显示目标内容图像,并在所述显示屏的第二显示区域显示所述虚拟路况图像。
其中,步骤S230-步骤S240的具体描述请参阅步骤S120-步骤S130,在此不再赘述。
本申请又一个实施例提供的显示方法,当处于车辆内的头戴式增强现实设备检测到车辆开始行驶时,获取头戴式增强现实设备的运动参数,基于该头戴式增强现实设备的运动参数,获取车辆的行驶状态,获取与行驶状态对应的虚拟道路图像,在显示屏的第一显示区域显示目标内容图像,并在显示屏的第二显示区域显示虚拟道路图像。相较于图3所示的显示方法,本实施例还获取头戴式增强现实设备的运动参数,并根据该运动参数确定车辆的行驶状态,从而依靠头戴式增强现实设备主动检测其运动参数以获取车辆的行驶状态的方式,可以避免对车辆厂商的数据接口的依赖,提升普适性和推广性。
请参阅图7,图7示出了本申请再一个实施例提供的显示方法的流程示意图。该方法应用于上述头戴式增强现实设备,下面将针对图7所示的流程进行详细的阐述,在本实施例中,该头戴式增强现实设备包括显示屏,所述显示方法具体可以包括以下步骤:
步骤S310:在所述显示屏的显示区域显示所述目标内容图像,其中,所述目标内容图像完全覆盖所述显示区域,所述显示区域包括所述第一显示区域和所述第二显示区域。
在本实施例中,头戴式增强现实设备在处于开启状态时,如果没有在处于行驶状态中的车辆内,则可以在显示屏的显示区域内全屏显示目标内容图像,即,可以在包括第一显示区域和第二显示区域的显示区域显示目标内容图像,且该目标内容图像完全覆盖该显示区域。
在一些实施方式中,头戴式增强现实设备在处于开启状态时,可以检测其是否处于车辆内。其中,当检测到其没有处于车辆内时,则可以在显示屏的显示区域全屏显示目标内容图像,当检测到其处于车辆内时,可以对该车辆所处的状态进行检测,当检测到该车辆开始行驶时,则可以将原本全屏显示于显示区域的目标内容图像切换为显示于显示区域中的第一显示区域,并在显示区域中的第二显示区域显示虚拟路况图像。
作为一种可实施的方式,在头戴式增强现实设备全屏显示目标内容图像的过程中,若检测到头戴式增强现实设备所处的车辆开始运行时,则可以输出提示信息,其中,该提示信息用于提示用户选择是否将目标内容图像从全屏显示切换为在第一显示区域显示。其中,当接收到用户基于该提示信息输出的确认切换的指令信息时,则可以将原本全屏显示于显示区域 的目标内容图像切换为显示于显示区域中的第一显示区域,并在显示区域中的第二显示区域显示虚拟路况图像;当接收到用户基于该提示信息输出的拒绝切换的指令信息时,则可以保持在显示区域全屏显示目标内容图像。
步骤S320:当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述车辆的行驶状态。
步骤S330:获取与所述行驶状态对应的虚拟路况图像。
步骤S340:在所述显示屏的第一显示区域显示目标内容图像,并在所述显示屏的第二显示区域显示所述虚拟路况图像。
其中,步骤S320-步骤S340的具体描述请参阅步骤S110-步骤S130,在此不再赘述。
本申请再一个实施例提供的显示方法,在显示屏的显示区域显示目标内容图像,其中,目标内容图像完全覆盖显示区域,显示区域包括第一显示区域和第二显示区域,当车辆内的头戴式增强现实设备检测车辆开始行驶时,获取车辆的行驶状态,获取与行驶状态对应的虚拟路况图像,在显示屏的第一显示区域显示目标内容图像,并在显示屏的第二显示区域显示虚拟路况图像。相较于图3所示的显示方法,本实施例还可以预先全屏显示目标内容图像,并在后续切换至第一显示区域显示目标内容图像,并在第二显示区域显示虚拟路况图像,以适配不同的使用场景。
请参阅图8,图8示出了本申请另一个实施例提供的显示方法的流程示意图。该方法应用于上述头戴式增强现实设备,下面将针对图8所示的流程进行详细的阐述,在本实施例中,该头戴式增强现实设备包括显示屏,所述显示方法具体可以包括以下步骤:
步骤S410:当所述头戴式增强现实设备处于第一模式时,在所述显示屏的显示区域显示所述目标内容图像,其中,所述目标内容图像完全覆盖所述显示区域,所述显示区域包括所述第一显示区域和所述第二显示区域。
在本实施例中,头戴式增强现实设备在处于开启状态时,可以检测其所处的模式,其中,当检测到其所处的模式为第一模式(普通模式)时,则可以在显示屏的显示区域内全屏显示目标内容图像,即,可以在包括第一显示区域和第二显示区域的显示区域显示目标内容图像,且该目标内容图像完全覆盖该显示区域。
在一些实施方式中,头戴式增强现实设备在处于开启状态时,如果没有在处于行驶状态中的车辆内,则可以自动将其模式设置为第一模式,或者可以输出提示信息以提示用户将其模式设置为第一模式,在确定头戴式增强现实设备处于第一模式时,则可以在显示屏的显示区域内全屏显示目标内容图像。
在一些实施方式中,头戴式增强现实设备在处于开启状态时,可以检测其是否处于车辆内。其中,当检测到其没有处于车辆内时,则可以自动将其模式设置为第一模式,或者可以输出提示信息以提示用户将其模式设置为第一模式,在确定头戴式增强现实设备处于第一模式时,则可以在显示屏的显示区域全屏显示目标内容图像。当检测到其处于车辆内时,可以对该车辆所处的状态进行检测,当检测到车辆所处的状态为停车状态时,则可以自动将其模式设置为第一模式,或者可以输出提示信息以提示用户将其模式设置为第一模式,在确定头戴式增强现实设备处于第一模式时,则可以在显示屏的显示区域全屏显示目标内容图像。
步骤S420:当检测到所述车辆开始行驶且所述头戴式增强现实设备从处于所述第一模式切换为第二模式时,获取所述车辆的行驶状态。
作为一种方式,当检测到头戴式增强现实设备所处的车辆开始行驶时,则可以自动将头戴式增强现实设备所处的模式设置为第二模式(车载模式),在确定头戴式增强现实设备处于第二模式时,则可以获取车辆的行驶状态,在显示区域中的第一显示区域显示目标内容图像,并在显示区域中的第二显示区域显示与行驶状态对应的虚拟路况图像。
作为又一种方式,当检测到头戴式增强现实设备所处的车辆开始行驶时,则可以输出提示信息以提示用户将头戴式增强现实设备所处的模式设置为第二模式,在确定头戴式增强现实设备处于第二模式时,则可以获取车辆的行驶状态,在显示区域中的第一显示区域显示目 标内容图像,并在显示区域中的第二显示区域显示与行驶状态对应的虚拟路况图像。
作为再一种方式,当检测到头戴式增强现实设备所处的车辆开始行驶且头戴式增强现实设备所处的模式为第一模式时,则可以将头戴式增强现实设备所处的模式从第一模式(普通模式)切换为第二模式(车载模式),在确定头戴式增强现实设备处于第二模式时,则可以获取车辆的行驶状态,将原本全屏显示于显示区域的目标内容图像切换为显示于显示区域中的第一显示区域,并在显示区域中的第二显示区域显示与行驶状态对应的虚拟路况图像。
步骤S430:获取与所述行驶状态对应的虚拟路况图像。
步骤S440:在所述显示屏的第一显示区域显示目标内容图像,并在所述显示屏的第二显示区域显示所述虚拟路况图像。
其中,步骤S430-步骤S440的具体描述请参阅步骤S120-步骤S130,在此不再赘述。
本申请另一个实施例提供的显示方法,当头戴式增强现实设备处于第一模式时,在显示屏的显示区域显示目标内容图像,其中,目标内容图像完全覆盖显示区域,显示区域包括第一显示区域和第二显示区域,当检测到车辆开始行驶且头戴式增强现实设备从处于第一模式切换为第二模式时,获取车辆的行驶状态,获取与行驶状态对应的虚拟路况图像,在显示屏的第一显示区域显示目标内容图像,并在显示屏的第二显示区域显示虚拟路况图像。相较于图3所示的显示方法,本实施例还在不同的模式下采用不同的显示策略,使用户在不同的使用场景下均能获得良好的使用体验。
请参阅图9,图9示出了本申请又再一个实施例提供的显示方法的流程示意图。该方法应用于上述头戴式增强现实设备,下面将针对图9所示的流程进行详细的阐述,在本实施例中,该头戴式增强现实设备包括显示屏,所述显示方法具体可以包括以下步骤:
步骤S510:当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述车辆的行驶状态。
其中,步骤S510的具体描述请参阅步骤S110,在此不再赘述。
步骤S520:响应于虚拟道路选择指令,从多个虚拟道路中选择一个虚拟道路作为目标虚拟道路。
作为一种可实施的方式,多个虚拟道路可以但不限于包括:高速公路、乡间小道、盘山公路、城市道路。
在一些实施方式中,头戴式增强现实设备可以预先设置并存储有多个虚拟道路,则当头戴式增强现实设备检测到其所处的车辆开始行驶时,可以显示虚拟道路选择控件,该虚拟道路选择控件用于供用户从多个虚拟道路中选择一个虚拟道路作为目标虚拟道路,以提升用户对于虚拟道路的选择多样性。其中,在显示虚拟道路选择控件的过程中,当接收到虚拟道路选择指令时,则可以响应该虚拟道路选择指令,从多个虚拟道路中选择一个虚拟道路作为目标虚拟道路。
在一些实施方式中,头戴式增强现实设备可以预先设置并存储有多个虚拟道路,则当头戴式增强现实设备检测到其所处的车辆开始行驶时,可以对车辆所行驶的道路进行检测,根据检测到的道路从多个虚拟道路中确定一个与该检测到的道路匹配的虚拟道路作为目标虚拟道路。例如,当检测到车辆所行驶的道路为高速公路时,则可以从多个虚拟道路中确定“高速公路”作为目标虚拟道路;当检测到车辆所行驶的道路为乡间小道时,则可以从多个虚拟道路中确定“乡间小道”作为目标虚拟道路。
步骤S530:基于所述行驶状态和所述目标虚拟道路,获得所述虚拟路况图像。
在一些实施方式中,在获取目标虚拟道路后,可以基于该车辆的行驶状态和目标虚拟道路,获取虚拟路况图像。例如,当目标虚拟道路为高速公路且车辆的行驶状态为加速前进时,则可以获取其对应的虚拟路况图像为高速公路加速后退;当目标虚拟道路为乡间小道且车辆的行驶状态为倒退时,则可以获取其对应的虚拟路况图像为乡间小道前进;当目标虚拟道路为盘山公路且车辆的行驶状态为左转时,则可以获取其对应的虚拟路况图像为盘山公路向左蜿蜒,且虚拟路况图像同时会切换为右方视角看到的内容;当目标虚拟道路为盘山公路且车 辆的行驶状态为右转时,则可以获取其对应的虚拟路况图像为盘山公路向右蜿蜒,且虚拟路况图像同时会切换为左方视角看到的内容。
步骤S540:在所述显示屏的第一显示区域显示目标内容图像,并在所述显示屏的第二显示区域显示所述虚拟路况图像。
其中,步骤S540的具体描述请参阅步骤S130,在此不再赘述。
本申请又再一个实施例提供的显示方法,当处于车辆内的头戴式增强现实设备检测到车辆开始行驶时,获取车辆的行驶状态,响应于虚拟道路选择指令,从多个虚拟道路中选择一个虚拟道路作为目标虚拟道路,基于行驶状态和目标虚拟道路,获得虚拟路况图像,在显示屏的第一显示区域显示目标内容图像,并在显示屏的第二显示区域显示虚拟路况图像。相较于图3所示的显示方法,本实施例还根据虚拟道路选择指令从多个虚拟道路中选择目标虚拟道路,提高用户的自主选择性。
请参阅图10,图10示出了本申请又另一个实施例提供的显示方法的流程示意图。该方法应用于上述头戴式增强现实设备,下面将针对图10所示的流程进行详细的阐述,在本实施例中,该头戴式增强现实设备包括显示屏,所述显示方法具体可以包括以下步骤:
步骤S610:当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述车辆的行驶状态。
步骤S620:获取与所述行驶状态对应的虚拟路况图像。
其中,步骤S610-步骤S620的具体描述请参阅步骤S110-步骤S130,在此不再赘述。
步骤S630:响应于内容图像选择指令,从多个内容图像中选择一个内容图像作为目标内容图像。
作为一种可实施的方式,多个内容图像可以但不限于包括:游戏内容图像、视频内容图像、新闻内容图像、聊天内容图像。
在一些实施方式中,头戴式增强现实设备或者与头戴式增强现实设备连接的电子设备可以预先设置并存储有多个内容图像,则当头戴式增强现实设备开启时,可以显示内容图像选择控件,该内容图像选择控件用于供用户从多个内容图像中选择一个内容图像作为目标内容图像,以提升用户对于内容图像的选择多样性。其中,在显示内容图像选择控件的过程中,当接收到内容图像选择指令时,则可以响应该内容图像选择指令,从多个内容图像中选择一个内容图像作为目标内容图像。
在一些实施方式中,头戴式增强现实设备或者与头戴式增强现实设备连接的电子设备可以预先设置并存储有多个内容图像,则当头戴式增强现实设备开启时,可以对头戴式增强现实设备最近一次显示的内容图像进行检测,并从多个内容图像中选择与最近一次显示的内容图像匹配的内容图像作为目标内容图像。
在一些实施方式中,头戴式增强现实设备或者与头戴式增强现实设备连接的电子设备可以预先设置并存储有多个内容图像,则当头戴式增强现实设备开启时,可以对头戴式增强现实设备显示次数最多的内容图像进行检测,并从多个内容图像中选择与显示次数最多的内容图像匹配的内容图像作为目标内容图像。
步骤S640:在所述显示屏的所述第一显示区域显示所述目标内容图像。
步骤S650:在所述显示屏的第二显示区域显示所述虚拟路况图像。
其中,步骤S640-步骤S650的具体描述请参阅步骤S130,在此不再赘述。
本申请又另一个实施例提供的显示方法,当处于车辆内的头戴式增强现实设备检测到车辆开始行驶时,获取车辆的行驶状态,获取与行驶状态对应的虚拟路况图像,响应于内容选择指令,从多个内容图像中选择一个内容图像作为目标内容图像,在显示屏的第一显示区域显示目标内容图像,在显示屏的第二显示区域显示虚拟路况图像。相较于图3所示的显示方法,本实施例还根据内容图像选择指令从多个内容图像中选择目标内容图像,提高用户的自主选择性。
请参阅图11,图11示出了本申请实施例提供的显示装置的模块框图。该显示装置300应用于上述头戴式增强现实设备,下面将针对图11所示的框图进行阐述,在本实施例中,该头戴式增强现实设备包括显示屏,所示显示装置300包括:行驶状态获取模块310、虚拟路况图像获取模块320以及显示模块330,其中:
行驶状态获取模块310,用于当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述车辆的行驶状态。
进一步地,所示行驶状态获取模块310包括:运动参数获取子模块和第一行驶状态获取子模块,其中:
运动参数获取子模块,用于获取所述头戴式增强现实设备的运动参数。
第一行驶状态获取子模块,用于基于所述头戴式增强现实设备的运动参数,获取所述车辆的行驶状态。
进一步地,所示行驶状态获取子模块包括:运动参数获取单元和行驶状态获取单元,其中:
运动参数获取单元,用于对所述头戴式增强现实设备的运动参数进行滤波处理,从所述头戴式增强现实设备的运动参数中分离出所述车辆的运动参数。
进一步地,所示运动参数获取单元包括:运动参数获取单元,其中:
运动参数获取单元,用于基于所述车辆的固有频率对所述头戴式增强现实设备的运动参数进行滤波处理,从所述头戴式增强现实设备的运动参数中分离出所述车辆的运动参数。
行驶状态获取单元,用于对所述车辆的运动参数进行拟合处理,获得所述车辆的行驶状态。
进一步地,所示行驶状态获取模块310包括:第二行驶状态获取子模块,其中:
第二行驶状态获取子模块,用于当检测到所述车辆开始行驶且所述头戴式增强现实设备从处于所述第一模式切换为第二模式时,获取所述车辆的行驶状态。
虚拟路况图像获取模块320,用于获取与所述行驶状态对应的虚拟路况图像。
进一步地,所述虚拟路况图像获取模块320包括:目标虚拟道路选择子模块和虚拟路况图像获取子模块,其中:
目标虚拟道路选择子模块,用于响应于虚拟道路选择指令,从多个虚拟道路中选择一个虚拟道路作为目标虚拟道路。
虚拟路况图像获取子模块,用于基于所述行驶状态和所述目标虚拟道路,获得所述虚拟路况图像。
显示模块330,用于在所述显示屏的第一显示区域显示目标内容图像,并在所述显示屏的第二显示区域显示所述虚拟路况图像。
进一步地,所述显示模块330包括:目标内容图像选择子模块和显示子模块,其中:
目标内容图像选择子模块,用于响应于内容图像选择指令,从多个内容图像中选择一个内容图像作为目标内容图像。
显示子模块,用于在所述显示屏的所述第一显示区域显示所述目标内容图像。
进一步地,所示显示装置300还包括:目标内容图像显示模块,其中:
目标内容图像显示模块,用于在所述显示屏的显示区域显示所述目标内容图像,其中,所述目标内容图像完全覆盖所述显示区域,所述显示区域包括所述第一显示区域和所述第二显示区域。
进一步地,所示目标内容图像显示模块包括:目标内容图像显示子模块,其中:
目标内容图像显示子模块,用于当所述头戴式增强现实设备处于第一模式时,在所述显示屏的显示区域显示所述目标内容图像。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述装置和模块的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,模块相互之间的耦合可以是电性,机械或其它形 式的耦合。
另外,在本申请各个实施例中的各功能模块可以集成在一个处理模块中,也可以是各个模块单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。
请参阅图12,其示出了本申请实施例提供的一种头戴式增强现实设备100的结构框图。该头戴式增强现实设备100可以是智能手机、平板电脑、电子书等能够运行应用程序的电子设备。本申请中的头戴式增强现实设备100可以包括一个或多个如下部件:处理器110、存储器120、显示屏130以及一个或多个应用程序,其中一个或多个应用程序可以被存储在存储器120中并被配置为由一个或多个处理器110执行,一个或多个程序配置用于执行如前述方法实施例所描述的方法。
其中,处理器110可以包括一个或者多个处理核。处理器110利用各种接口和线路连接整个头戴式增强现实设备100内的各个部分,通过运行或执行存储在存储器120内的指令、程序、代码集或指令集,以及调用存储在存储器120内的数据,执行头戴式增强现实设备100的各种功能和处理数据。可选地,处理器110可以采用数字信号处理(Digital Signal Processing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable Logic Array,PLA)中的至少一种硬件形式来实现。处理器110可集成中央处理器(Central Processing Unit,CPU)、图形处理器(Graphics Processing Unit,GPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作***、用户界面和应用程序等;GPU用于负责待显示内容的渲染和绘制;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器110中,单独通过一块通信芯片进行实现。
存储器120可以包括随机存储器(Random Access Memory,RAM),也可以包括只读存储器(Read-Only Memory)。存储器120可用于存储指令、程序、代码、代码集或指令集。存储器120可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作***的指令、用于实现至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现下述各个方法实施例的指令等。存储数据区还可以存储头戴式增强现实设备100在使用中所创建的数据(比如电话本、音视频数据、聊天记录数据)等。
显示屏130用于显示由用户输入的信息、提供给用户的信息以及所述头戴式增强现实设备100的各种图形用户接口,这些图形用户接口可以由图形、文本、图标、数字、视频和其任意组合来构成,在一个实例中,该显示屏130可以为液晶显示器(Liquid Crystal Display,LCD),也可以为有机发光二极管(Organic Light-Emitting Diode,OLED),在此不做限定。
请参阅图13,其示出了本申请实施例提供的一种计算机可读存储介质的结构框图。该计算机可读介质400中存储有程序代码,所述程序代码可被处理器调用执行上述方法实施例中所描述的方法。
计算机可读存储介质400可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。可选地,计算机可读存储介质400包括非易失性计算机可读介质(non-transitory computer-readable storage medium)。计算机可读存储介质400具有执行上述方法中的任何方法步骤的程序代码410的存储空间。这些程序代码可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。程序代码410可以例如以适当形式进行压缩。
综上所述,本申请实施例提供的显示方法、装置、头戴式增强现实设备以及存储介质,通过在行驶的车辆中,将头戴式增强现实设备的显示屏分为两个区域分别显示目标内容图像和与车辆的行驶状态对应的虚拟路况图像,使得用户在观看目标内容图像的同时可以观看到与车辆的行驶状态对应的虚拟路况图像,以使眼见信息和内耳信息同步, 达到防止晕车的效果。
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不驱使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。

Claims (20)

  1. 一种显示方法,其特征在于,应用于头戴式增强现实设备,所述头戴式增强现实设备包括显示屏,所述方法包括:
    当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述车辆的行驶状态;
    获取与所述行驶状态对应的虚拟路况图像;
    在所述显示屏的第一显示区域显示目标内容图像,并在所述显示屏的第二显示区域显示所述虚拟路况图像。
  2. 根据权利要求1所述的方法,其特征在于,所述获取所述车辆的行驶状态,包括:
    获取所述头戴式增强现实设备的运动参数;
    基于所述头戴式增强现实设备的运动参数,获取所述车辆的行驶状态。
  3. 根据权利要求2所述的方法,其特征在于,所述基于所述头戴式增强现实设备的运动参数,获取所述车辆的行驶状态,包括:
    对所述头戴式增强现实设备的运动参数进行滤波处理,从所述头戴式增强现实设备的运动参数中分离出所述车辆的运动参数;
    对所述车辆的运动参数进行拟合处理,获得所述车辆的行驶状态。
  4. 根据权利要求3所述的方法,其特征在于,所述对所述头戴式增强现实设备的运动参数进行滤波处理,从所述头戴式增强现实设备的运动参数中分离出所述车辆的运动参数,包括:
    基于所述车辆的固有频率对所述头戴式增强现实设备的运动参数进行滤波处理,从所述头戴式增强现实设备的运动参数中分离出所述车辆的运动参数。
  5. 根据权利要求2所述的方法,其特征在于,所述头戴式增强现实设备包括运动传感器,所述获取所述头戴式增强现实设备的运动参数,包括:
    通过所述运动传感器获取所述头戴式增强现实设备的运动参数。
  6. 根据权利要求1所述的方法,其特征在于,所述获取所述车辆的行驶状态,包括:
    对所述头戴式增强现实设备所处的位置进行检测;
    在检测到所述头戴式增强现实设备处于所述车辆内时,获取所述车辆的行驶状态。
  7. 根据权利要求6所述的方法,其特征在于,所述对所述头戴式增强现实设备所处的位置进行检测,包括:
    对所述头戴式增强现实设备所处的状态进行检测;
    在检测到所述头戴式增强现实设备处于佩戴状态时,对所述头戴式增强现实设备所处的位置进行检测。
  8. 根据权利要求1-7任一项所述的方法,其特征在于,在当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述车辆的行驶状态之前,还包括:
    在所述显示屏的显示区域显示所述目标内容图像,其中,所述目标内容图像完全覆盖所述显示区域,所述显示区域包括所述第一显示区域和所述第二显示区域。
  9. 根据权利要求8所述的方法,其特征在于,所述在所述显示屏的显示区域显示所述目标内容图像,包括:
    当所述头戴式增强现实设备处于第一模式时,在所述显示屏的显示区域显示所述目标内容图像;
    所述当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述车辆的行驶状态,包括:
    当检测到所述车辆开始行驶且所述头戴式增强现实设备从处于所述第一模式切换为第二模式时,获取所述车辆的行驶状态。
  10. 根据权利要求1-7任一项所述的方法,其特征在于,所述获取与所述行驶状态对应 的虚拟路况图像,包括:
    响应于虚拟道路选择指令,从多个虚拟道路中选择一个虚拟道路作为目标虚拟道路;
    基于所述行驶状态和所述目标虚拟道路,获得所述虚拟路况图像。
  11. 根据权利要求1-7任一项所述的方法,其特征在于,所述在所述显示屏的第一显示区域显示目标内容图像,包括:
    响应于内容图像选择指令,从多个内容图像中选择一个内容图像作为目标内容图像;
    在所述显示屏的所述第一显示区域显示所述目标内容图像。
  12. 根据权利要求11所述的方法,其特征在于,所述响应于内容图像选择指令,从多个内容图像中选择一个内容图像作为目标内容图像,包括:
    显示内容图像选择控件;
    响应基于所述内容图像选择控件触发的内容图像选择指令,从所述多个内容图像中选择一个内容图像作为所述目标内容图像。
  13. 根据权利要求11所述的方法,其特征在于,所述多个内容图像包括游戏内容图像、视频内容图像、新闻内容图像以及聊天内容图像中的至少一种。
  14. 根据权利要求1-7任一项所述的方法,其特征在于,所述第二显示区域位于所述第一显示区域的周边。
  15. 根据权利要求14所述的方法,其特征在于,当所述头戴式增强现实设备处于佩戴状态时,所述第二显示区域位于所述第一显示区域的两侧和底侧。
  16. 根据权利要求1-7任一项所述的方法,其特征在于,所述获取所述车辆的行驶状态,包括:
    获取所述车辆在预设时长内的前进距离;
    基于所述车辆在预设时长内的前进距离,获取所述车辆的行驶状态。
  17. 根据权利要求1-7任一项所述的方法,其特征在于,所述车辆的行驶状态包括所述车辆的速度变化和所述车辆的行驶方向中的至少一种。
  18. 一种显示装置,其特征在于,应用于头戴式增强现实设备,所述头戴式增强现实设备包括显示屏,所述装置包括:
    行驶状态获取模块,用于当处于车辆内的所述头戴式增强现实设备检测到所述车辆开始行驶时,获取所述车辆的行驶状态;
    虚拟路况图像获取模块,用于获取与所述行驶状态对应的虚拟路况图像;
    显示模块,用于在所述显示屏的第一显示区域显示目标内容图像,并在所述显示屏的第二显示区域显示所述虚拟路况图像。
  19. 一种头戴式增强现实设备,其特征在于,包括显示屏、存储器和处理器,所述显示屏和所述存储器耦接到所述处理器,所述存储器存储指令,当所述指令由所述处理器执行时所述处理器执行如权利要求1-17任一项所述的方法。
  20. 一种计算机可读取存储介质,其特征在于,所述计算机可读取存储介质中存储有程序代码,所述程序代码可被处理器调用执行如权利要求1-17任一项所述的方法。
PCT/CN2022/091719 2021-07-16 2022-05-09 显示方法、装置、头戴式增强现实设备以及存储介质 WO2023284382A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110806323.XA CN113534466B (zh) 2021-07-16 2021-07-16 显示方法、装置、头戴式增强现实设备以及存储介质
CN202110806323.X 2021-07-16

Publications (1)

Publication Number Publication Date
WO2023284382A1 true WO2023284382A1 (zh) 2023-01-19

Family

ID=78099712

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/091719 WO2023284382A1 (zh) 2021-07-16 2022-05-09 显示方法、装置、头戴式增强现实设备以及存储介质

Country Status (2)

Country Link
CN (1) CN113534466B (zh)
WO (1) WO2023284382A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113534466B (zh) * 2021-07-16 2023-06-23 Oppo广东移动通信有限公司 显示方法、装置、头戴式增强现实设备以及存储介质
CN114460749A (zh) * 2022-01-29 2022-05-10 杭州灵伴科技有限公司 头戴式显示装置和载人装置
CN116804918A (zh) * 2022-03-16 2023-09-26 华为技术有限公司 基于视觉补偿图像的防晕车方法、装置和***

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108885343A (zh) * 2016-03-24 2018-11-23 三星电子株式会社 校正车辆引起的方向改变的***和方法
EP3476673A1 (en) * 2017-10-30 2019-05-01 Alpine Electronics, Inc. Vehicle image displaying apparatus and method of displaying image data on a head-mounted display device disposed in a vehicle
CN109716266A (zh) * 2016-09-23 2019-05-03 苹果公司 沉浸式虚拟显示
CN110603167A (zh) * 2017-05-05 2019-12-20 奥迪股份公司 用于可用在车辆中的头戴式视觉输出装置的移动式传感器设备和运行显示***的方法
GB2592397A (en) * 2020-02-27 2021-09-01 Daimler Ag Method and system for mitigating motion sickness of users in a moving vehicle
CN113534466A (zh) * 2021-07-16 2021-10-22 Oppo广东移动通信有限公司 显示方法、装置、头戴式增强现实设备以及存储介质

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006035980A (ja) * 2004-07-26 2006-02-09 Matsushita Electric Ind Co Ltd 乗り心地向上装置
US10455165B2 (en) * 2016-12-28 2019-10-22 Microsoft Technology Licensing, Llc Systems, methods, and computer-readable media for using a video capture device to alleviate motion sickness via an augmented display for a passenger

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108885343A (zh) * 2016-03-24 2018-11-23 三星电子株式会社 校正车辆引起的方向改变的***和方法
CN109716266A (zh) * 2016-09-23 2019-05-03 苹果公司 沉浸式虚拟显示
CN110603167A (zh) * 2017-05-05 2019-12-20 奥迪股份公司 用于可用在车辆中的头戴式视觉输出装置的移动式传感器设备和运行显示***的方法
EP3476673A1 (en) * 2017-10-30 2019-05-01 Alpine Electronics, Inc. Vehicle image displaying apparatus and method of displaying image data on a head-mounted display device disposed in a vehicle
GB2592397A (en) * 2020-02-27 2021-09-01 Daimler Ag Method and system for mitigating motion sickness of users in a moving vehicle
CN113534466A (zh) * 2021-07-16 2021-10-22 Oppo广东移动通信有限公司 显示方法、装置、头戴式增强现实设备以及存储介质

Also Published As

Publication number Publication date
CN113534466A (zh) 2021-10-22
CN113534466B (zh) 2023-06-23

Similar Documents

Publication Publication Date Title
WO2023284382A1 (zh) 显示方法、装置、头戴式增强现实设备以及存储介质
US10534428B2 (en) Image processing device and image processing method, display device and display method, and image display system
KR102055967B1 (ko) 헤드 탑재형 디스플레이 자원 관리
US11024083B2 (en) Server, user terminal device, and control method therefor
WO2021037251A1 (zh) 一种显示用户界面的方法及车载终端
US11410634B2 (en) Information processing apparatus, information processing method, display system, and mobile object
WO2017118270A1 (zh) 车载hmi调节方法、车载终端、存储介质
JP2016525917A (ja) ヘッドマウンテッドディスプレイ上でのゲームプレイの移行
US11626028B2 (en) System and method for providing vehicle function guidance and virtual test-driving experience based on augmented reality content
CN111596830A (zh) 消息提醒方法及装置
CN112116716A (zh) 基于检测到的对象来定位的虚拟内容
CN113055742A (zh) 视频显示方法、装置、终端及存储介质
CN109774601B (zh) 一种全息投影方法、***及汽车
CN106020459B (zh) 一种智能眼镜、智能眼镜的操控方法及操控***
JP2017219827A (ja) 画像安定化方法及び電子デバイス
JP2015210580A (ja) 表示システム及びウェアラブル機器
US20230091348A1 (en) Method and device for transmitting image content using edge computing service
CN109427220B (zh) 一种基于虚拟现实的展示方法和***
WO2023001113A1 (zh) 一种显示方法与电子设备
JP2020050326A (ja) 車両用インフォテインメントシステムの画面設定方法及びその方法が適用された車両用インフォテインメントシステム
CN114398120A (zh) 界面显示方法、装置、存储介质及电子设备
CN108055401B (zh) 弹框处理方法、装置、存储介质及电子设备
KR102431493B1 (ko) 증강현실 콘텐츠 기반 차량기능 안내 및 가상 시험주행 경험 제공 시스템 및 방법
CN117184115A (zh) 一种驾驶状态的显示方法、相关装置、设备以及存储介质
JP2014007465A (ja) 車載表示装置およびプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22841022

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22841022

Country of ref document: EP

Kind code of ref document: A1