CN113986165A - Display control method, electronic device and readable storage medium - Google Patents
Display control method, electronic device and readable storage medium Download PDFInfo
- Publication number
- CN113986165A CN113986165A CN202111177747.0A CN202111177747A CN113986165A CN 113986165 A CN113986165 A CN 113986165A CN 202111177747 A CN202111177747 A CN 202111177747A CN 113986165 A CN113986165 A CN 113986165A
- Authority
- CN
- China
- Prior art keywords
- electronic device
- dimensional environment
- environment video
- display
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000000007 visual effect Effects 0.000 claims abstract description 24
- 238000004590 computer program Methods 0.000 claims description 5
- 208000012886 Vertigo Diseases 0.000 abstract description 4
- 231100000889 vertigo Toxicity 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 23
- 238000004891 communication Methods 0.000 description 14
- 201000003152 motion sickness Diseases 0.000 description 14
- 238000012545 processing Methods 0.000 description 11
- 230000002265 prevention Effects 0.000 description 10
- 230000008569 process Effects 0.000 description 8
- 230000008859 change Effects 0.000 description 6
- 230000003068 static effect Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 208000002173 dizziness Diseases 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 239000003814 drug Substances 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 235000013361 beverage Nutrition 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/04—Context-preserving transformations, e.g. by using an importance map
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/06—Topological mapping of higher dimensional structures onto lower dimensional surfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a display control method, an electronic device and a readable storage medium. The method is applied to an electronic device, the electronic device is in a riding environment under the running of vehicle equipment, and the method comprises the following steps: acquiring a three-dimensional environment video outside the vehicle equipment; acquiring relative attitude information between the electronic device and the vehicle equipment; generating a two-dimensional environment video corresponding to the visual angle of the electronic device according to the relative attitude information and the three-dimensional environment video; and controlling a display picture of the electronic device according to the two-dimensional environment video. Through the mode, the display picture of the electronic device can be controlled according to the two-dimensional environment video, so that a user can know information of the two-dimensional environment video through a display screen of the electronic device, and the vertigo of the user can be reduced through the two-dimensional environment video which is changed synchronously even if the electronic device moves.
Description
Technical Field
The present disclosure relates to the field of display of electronic devices, and more particularly, to a display control method, an electronic device, and a readable storage medium.
Background
Through long-term research, carsickness is easily caused when a user plays a mobile phone or a tablet personal computer or operates other electronic equipment while riding a vehicle. At present, 3 common carsickness prevention modes exist, namely a medicine carsickness prevention mode comprising carsickness medicines, carsickness prevention beverages and the like, and a wearable equipment carsickness prevention mode comprising carsickness prevention earphones, carsickness prevention bracelets, carsickness prevention glasses and the like; and thirdly, an environmental carsickness prevention mode comprises a carsickness prevention seat, a carsickness prevention window and the like, and no scheme for dealing with carsickness caused by playing of electronic equipment is provided.
Disclosure of Invention
The application mainly provides a display control method, an electronic device and a readable storage medium, which can solve the problem that the electronic device in the prior art cannot display an environmental video consistent with a user visual angle.
In order to solve the above technical problem, a first aspect of the present application provides a display control method, which is applied to an electronic device in a riding environment in which vehicle equipment is operated, and includes: acquiring a three-dimensional environment video outside the vehicle equipment; acquiring relative attitude information between the electronic device and the vehicle equipment; generating a two-dimensional environment video corresponding to the visual angle of the electronic device according to the relative attitude information and the three-dimensional environment video; and controlling a display picture of the electronic device according to the two-dimensional environment video.
In order to solve the above technical problem, a second aspect of the present application provides an electronic device, the electronic device being in a riding environment in which vehicle equipment is running, the electronic device including: the acquisition module is used for acquiring a three-dimensional environment video outside the vehicle equipment and acquiring relative attitude information between the electronic device and the vehicle equipment; the video generation module is used for generating a two-dimensional environment video corresponding to the user visual angle according to the relative posture information; and the display module is used for controlling a display picture of the electronic device according to the two-dimensional environment video.
In order to solve the above technical problem, a third aspect of the present application provides an electronic device, including a processor and a memory coupled to each other, where the memory stores a computer program, and the processor is configured to execute the computer program to implement the display control method of the electronic device provided by the first aspect.
In order to solve the above technical problem, a fourth aspect of the present application provides a computer-readable storage medium, in which program data are stored, and when the program data are executed by a processor, the display control method of an electronic device provided by the first aspect is implemented.
The beneficial effect of this application is: different from the prior art, the method is applied to an electronic device, the electronic device is in a riding environment in which vehicle equipment runs, the method comprises the steps of obtaining a three-dimensional environment video outside the vehicle equipment and obtaining relative posture information between the electronic device and the vehicle equipment, then generating a two-dimensional environment video corresponding to a user visual angle according to the relative posture information and the three-dimensional environment video, and controlling a display picture of the electronic device according to the two-dimensional environment video. The angle change of the two-dimensional environment video generated in the mode is highly adaptive to the self posture of the electronic device, and meanwhile, the display picture of the electronic device is controlled according to the two-dimensional environment video, so that a user can know the information of the two-dimensional environment video through watching the display screen of the electronic device, and the vertigo of the user can be reduced through the two-dimensional environment video which is changed synchronously even if the electronic device moves.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic block diagram of a flow chart of an embodiment of a display control method of the present application;
FIG. 2 is a schematic diagram of an embodiment of vehicle equipment attitude information according to the present application;
FIG. 3 is a schematic diagram of an embodiment of a relative attitude of a vehicle device and an electronic device according to the present application;
FIG. 4 is a block diagram illustrating the flowchart of an embodiment of step S20 of the present application;
FIG. 5 is a schematic diagram of an embodiment of displaying a two-dimensional environment video and a current display frame in an overlay manner according to the present application;
FIG. 6 is a schematic diagram illustrating an embodiment of a display of a reduced current display screen and a superimposed background screen;
FIG. 7 is a schematic diagram of another embodiment of displaying a reduced currently displayed image and a background image in an overlapping manner according to the present application;
FIG. 8 is a schematic diagram illustrating another embodiment of a current display screen being reduced and then displayed in superposition with a background screen;
FIG. 9 is a schematic diagram illustrating another embodiment of a reduced currently displayed image and a superimposed background image;
FIG. 10 is a diagram illustrating an embodiment of replacing background display content in a current display with two-dimensional environment video according to the present application;
FIG. 11 is a schematic block diagram of a circuit configuration of an embodiment of the subject vehicle apparatus;
FIG. 12 is a block diagram of an embodiment of an electronic device;
FIG. 13 is a schematic block diagram of a circuit configuration of another embodiment of a vehicular apparatus of the present application;
FIG. 14 is a schematic block diagram of a circuit configuration of an embodiment of a computer-readable storage medium of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those skilled in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.
Referring to fig. 1, fig. 1 is a schematic flow chart diagram illustrating a display control method of an electronic device according to an embodiment of the present disclosure. The embodiment comprises the following steps:
s10: the method includes acquiring a three-dimensional environment video outside the vehicle equipment, and acquiring relative posture information between the electronic device and the vehicle equipment.
It should be understood that the electronic device proposed in the present application is a device that can be a mobile phone, a tablet computer, a notebook computer, etc. for displaying graphics information or video information and can establish a communication connection with a vehicle device. The vehicle device may be an automobile, a rail vehicle, or the like, as long as it is capable of carrying a person.
The electronic device can be located in a cabin of the vehicle equipment, which is in a riding environment in which the vehicle equipment is operated. Specifically, for the user, when the user obtains information through the electronic device in the process of traveling of the vehicle equipment, the vehicle equipment slightly vibrates or even jolts due to the operation of an engine inside the vehicle equipment or the influence of other external factors, so that the human body and the electronic device are driven to shake, the user can feel dizzy, and the experience feeling is poor.
Referring to fig. 2 and 3, fig. 2 is a schematic diagram of an embodiment of vehicle device attitude information according to the present application; FIG. 3 is a schematic diagram of an embodiment of relative positions of a vehicle device and an electronic device according to the present application.
The attitude referred to in the present embodiment refers to an attitude angle of the electronic device and the vehicular apparatus in a three-dimensional space. As shown in fig. 2, taking an airplane as an example, in a general three-dimensional space, an object can rotate along three relatively vertical axes (Pitch Axis, Roll Axis, and Yaw Axis shown in the figure), and the angles of rotation along these axes are referred to as attitude angles, and by defining the attitude angles, we can know the three-dimensional space attitude of the object.
As shown in fig. 3, the vehicle device 700 is an automobile, the electronic apparatus 600 is a mobile phone, and the relative posture information indicates a difference in posture angle between the vehicle device 700 and the electronic apparatus 600. As the pitch Axis attitude direction of the vehicle equipment 700 and the electronic device 600 is illustrated, the relative attitude of the electronic device 600 and the vehicle equipment 700 is X degrees, and thus the relative attitude is an angle X. The relative attitude of the three-dimensional space can be described by the relative attitude angles of the Pitch Axis, Roll Axis and Yaw Axis in three directions.
Specifically, the step first obtains respective attitude information of the electronic device and the vehicle equipment, and the attitude information of the electronic device and the vehicle equipment can be obtained by using a sensing Unit provided in the electronic device and the vehicle equipment, for example, an Inertial Measurement Unit (IMU) for Measurement.
The Inertial Measurement Unit (IMU) comprises three single-axis accelerometers and three single-axis gyroscopes, wherein the accelerometers detect acceleration signals of an object on three independent axes of a carrier coordinate system, and the gyroscopes detect angular velocity signals of the carrier relative to a navigation coordinate system, measure the angular velocity and acceleration of the object in a three-dimensional space, and calculate the attitude of the object according to the angular velocity and acceleration signals.
The three-dimensional environment video outside the vehicle device may be a three-dimensional environment video of an environment where the vehicle device is located, or may be a virtual environment created according to a motion state of the vehicle device, and then the three-dimensional environment video corresponding to the virtual environment is generated according to speed and angle information of the vehicle device, and the three-dimensional environment video corresponding to the virtual environment may show a motion state relative to the vehicle device.
The three-dimensional environment video can be acquired through three implementation modes 1) to 3):
1) the method comprises the steps of shooting external scenes of the vehicle equipment from different visual angles, and generating a three-dimensional environment video through three-dimensional reconstruction.
In the method, the camera device can be arranged at each visual angle of the vehicle equipment, the image information of each angle of the external scene of the vehicle equipment is acquired by using the camera device, and then the three-dimensional reconstruction is carried out by using the image information so as to obtain the three-dimensional environment video.
2) And shooting an external scene of the vehicle equipment in a surround view mode to directly acquire a three-dimensional environment video.
In this way, the three-dimensional environment video of the external scene of the vehicle equipment can be directly acquired by using the 360-degree all-around camera device installed on the vehicle equipment.
In both of the two modes, the vehicle equipment is used for acquiring the three-dimensional environment video, the electronic device and the vehicle equipment establish communication connection through wireless communication modes such as WIFI (wireless fidelity)/bluetooth, the vehicle equipment sends the three-dimensional environment video to the electronic device, and the electronic device performs processing and display of subsequent steps.
3) And virtually constructing a three-dimensional environment video according to the movement speed and the posture of the vehicle equipment.
The embodiment can construct the three-dimensional environment video by using the virtual three-dimensional environment based on the movement speed and the posture information of the vehicle equipment. Specifically, the virtual three-dimensional environment may be, for example, an animation scene or a game scene, and may further be combined with satellite navigation map data to construct a three-dimensional environment video with a high degree of structural similarity to an actual external scene of the vehicle device.
In one case, the computing processing center of the vehicle device virtually constructs a three-dimensional environment video by using the motion speed and the posture of the vehicle device, and then sends the three-dimensional environment video to the electronic device in a wireless communication mode, and the electronic device performs subsequent processing and finally displays the three-dimensional environment video. In another case, the vehicle device transmits its movement speed and posture information to the electronic device, and the electronic device constructs a three-dimensional environment video.
Among the three methods for acquiring a three-dimensional environment video:
1) and 2) the three-dimensional environment video is obtained by reconstructing or directly shooting the actual external scene of the vehicle equipment, and the obtained three-dimensional environment video is completely the same as the actual external scene, for example, for the vehicle equipment of a vehicle type, the obtained three-dimensional environment video is the information of the road and the surrounding environment where the vehicle equipment currently passes, and for the vehicle equipment of a ship type, the obtained three-dimensional environment video is the information of the water area and the surrounding environment where the vehicle equipment currently passes, and the reduction degree is high. In the implementation mode, the camera device can be used for shooting according to the set shooting frequency and the high frequency to obtain the external environment image information, in the advancing process of the vehicle equipment, the camera device can continuously shoot to obtain the three-dimensional environment video in real time, and in the visual sense, the moving speed and the steering angle shown by the three-dimensional environment video are consistent with the moving speed and the posture of the vehicle equipment relative to the external environment.
3) The virtual scene is constructed, and the user can set the type or the style of the virtual scene in a personalized way, so that the presented scene is more in line with the preference of the user. In an implementation, a static three-dimensional scene of a corresponding type may be generated according to a selection, and then the motion speed and posture information of the vehicle device may be applied to the static three-dimensional scene to generate a three-dimensional environment video as described above, which also exhibits a moving speed and a steering angle consistent with the vehicle device.
It is understood that the three ways of constructing the three-dimensional environment video may be constructing a Digital Twin (Digital Twin), which is also called Digital mapping, Digital mirroring. The digital twin is a full life cycle process of reflecting corresponding entity equipment by integrating multidisciplinary, multi-physical quantity, multi-scale and multi-probability simulation processes by fully utilizing data such as physical models, sensor updating, operation histories and the like and completing mapping in a virtual space. For example, in the method 1), the digital twin is generated by performing three-dimensional reconstruction by using images of each visual angle of the external scene of the vehicle device, the external scene of the vehicle device is continuously changed during the traveling process of the vehicle device, and the speed, the steering angle and the like expressed by the digital twin constructed in real time are consistent with those of the vehicle device; the above-described mode 2) is similar thereto; the mode 3) applies the motion speed and the posture of the vehicle equipment to the static digital twin body to enable the static digital twin body to be dynamic, and the expressed motion speed and the expressed motion angle are consistent with the external environment change condition of the vehicle equipment visual angle.
S20: and generating a two-dimensional environment video corresponding to the user visual angle according to the relative attitude information and the three-dimensional environment video.
Referring to fig. 4, fig. 4 is a schematic block diagram illustrating a flow of step S20 according to an embodiment of the present application. The method specifically comprises the following steps:
s21: and determining image information of the three-dimensional environment video corresponding to the visual angle of the electronic device according to the relative attitude information and the visual angle of the three-dimensional environment video.
Since the three-dimensional environment video represents a motion state of the vehicular apparatus with respect to the environment, the view angle thereof is the view angle of the vehicular apparatus.
In the step, according to the relative posture information of the vehicle equipment and the electronic device, the two-dimensional environment video corresponding to the visual angle of the brain-equipped device is obtained, so that the two-dimensional environment video displayed by the electronic device is consistent with the visual angle of the user. For example, when the electronic device is a mobile phone, and a user holds the mobile phone to enable the back of the mobile phone to face a downward angle in front, the two-dimensional environment video displayed on the display screen of the mobile phone is a scene of the downward angle in front in the three-dimensional environment video; if the back of the mobile phone faces to the side, the two-dimensional environment video displayed on the display screen of the mobile phone is a scene of the side in the three-dimensional environment video; when the mobile phone shakes, the two-dimensional environment video displayed on the display screen of the mobile phone can follow the pose of the mobile phone and synchronously change into the corresponding angle in the three-dimensional environment video, so that the consistency of the angle of the two-dimensional environment video and the visual angle of a user is improved, and the change of the background video is continuous in the process that the user changes the angle of the mobile phone.
Specifically, the image information corresponding to the user view angle in the three-dimensional environment video is captured according to the set time interval, and the captured image information is displayed through a display screen of the electronic device, so that each frame in the two-dimensional environment video is formed.
The visual angle of the electronic device can be reflected by the posture of the electronic device, and the posture information of the electronic device can be acquired by an IMU sensing unit of the electronic device.
S22: and outputting the continuous multi-frame image information as a two-dimensional environment video.
Outputting multiple frames of image information determined according to the visual angle of the electronic device, and splicing the multiple frames of image information according to the output time to obtain the two-dimensional environment video.
Therefore, the electronic device realizes two-dimensional AR display, the displayed environment angle change is highly consistent with the visual angle of a user, the user experiences the real-time image of the external environment of the vehicle equipment when holding a movable window, and the vertigo of the user can be reduced when the mobile phone shakes.
S30: and controlling a display picture of the electronic device according to the two-dimensional environment video.
In one embodiment, the display mode is: and displaying the current display picture of the electronic device and the two-dimensional environment video in an overlapping manner, so that a user can simultaneously acquire information of the operation page and the two-dimensional environment video information through the electronic device. The current display picture is a user operation page, for example, when a user browses news, the front display picture is a news webpage, the contents of the news webpage and the contents of the two-dimensional environment video can be displayed simultaneously in a superposition display mode, and the user can simultaneously acquire the information of the news webpage and the two-dimensional environment video information through a display screen of the electronic device. The specific manner of the overlay display will be described in detail later.
In other embodiments, the display mode may be to display the current display screen of the electronic device and the two-dimensional environment video in different regions. For example, a display page of the electronic device is divided into 2 or more than 2 display areas, which at least include a first display area and a second display area, the first display area is used for displaying a current display picture, and the second display area is used for displaying a two-dimensional environment video.
Further, the manner of the overlay display is as follows: and taking the two-dimensional environment video as a background picture, and carrying out superposition display on the two-dimensional environment video and a current display picture of the electronic device.
Referring to fig. 5, fig. 5 is a schematic diagram illustrating an embodiment of displaying a two-dimensional environment video and a current display frame in an overlay manner. The display interface of the electronic device 100 includes a foreground image display window 102 and a background image display window 101, the background display image is displayed through the background image display window 101, the foreground image is displayed through the foreground image display window 102, and the foreground image display window 102 is superimposed on the background image display window 101 for displaying.
It will be appreciated that the current display may be image information, video information or text information. For example, when the electronic device is a handheld electronic device, a user may operate the handheld electronic device to browse news, read short messages, or watch videos, and the display interface of the news, short messages, or video information that the user needs to acquire is the current display screen.
In the step, the current display picture is used as the foreground picture, the two-dimensional environment video is used as the background picture and is superposed with the current display picture for display, information to be browsed and the two-dimensional environment video can be provided for a user at the same time, for the user, the user can acquire concerned news, images or video information through the current display picture, and meanwhile, the position change condition of the electronic device relative to the environment can be sensed in real time through the two-dimensional environment video, so that the dizzy feeling caused by the shaking of the display equipment can be effectively reduced, and the carsickness symptom is relieved.
In an embodiment, the displaying of the two-dimensional environment video as a background picture and the current display picture of the electronic device in an overlay manner specifically includes: and reducing and displaying the current display picture in a centered mode, and taking the two-dimensional environment video as a background picture. The situation described in this embodiment is the same as the display situation in fig. 3.
Specifically, the current display screen may be reduced by a preset size, where the preset size is smaller than the size of the full-screen display interface, and a ratio of the preset size to the size of the full-screen display interface is between 1/2 and 5/6, where the ratio may be a ratio between one side of the preset size and a corresponding side of the full-screen display interface. Therefore, the central position of the display screen of the electronic device displays the current display picture, the background picture is tiled at the next layer of the current display picture in a full-screen display mode, and the background picture can provide partial image information of the two-dimensional environment video for a user through a display area reserved at the periphery of the current display picture.
According to the mode, the current display picture is reduced and centered, and is displayed in a superposition mode with the two-dimensional environment video displayed in a full screen mode, on one hand, the integrity of the current display page can be guaranteed, and on the other hand, the image information of the two-dimensional environment video can be completely displayed as far as possible.
As can be understood, please refer to fig. 6 and fig. 7 in combination, the background frame display window 101 is displayed in a full screen manner, and after the current display frame is reduced, the foreground frame display window 102 may be located at the center of the full screen display interface, that is, the center point O of the background frame display window 101 coincides with the center point O' of the foreground frame display window 102; the center point O' of the foreground display window 102 may not coincide with the center point O of the background display window 101.
Referring to fig. 8 and fig. 9 in combination, in addition to the above, one or two adjacent sides of the foreground display window 102 displayed in a reduced manner may coincide with the corresponding side of the background display window 101, that is, the foreground display window 102 is displayed at an edge position. For example, the first edge 1021 of the foreground display window 102 shown in fig. 6 coincides with the first edge 1011 of the background picture display window 101; the first edge 1021 of the foreground display window 102 shown in fig. 7 coincides with the first edge 1011 of the background picture display window 101, and the second edge 1022 of the foreground display window 102 coincides with the second edge 1012 of the background picture display window 101, which facilitates one-handed operation.
In other overlay display modes, the reduced foreground display window 102 is a window that can be moved, and the user can set the position of the foreground display window on the display screen according to the viewing habit.
In another embodiment, the displaying of the two-dimensional environment video as a background picture and the current display picture of the electronic device in an overlay manner specifically includes: and determining foreground display content and background display content in the current display picture, and replacing the background display content with a two-dimensional environment video.
Referring to fig. 10, fig. 10 is a schematic view illustrating an embodiment of the present application replacing background display content in a current display screen with a two-dimensional environment video, a foreground display content 103 and a background display content 104 in the current display screen are displayed in an overlapping manner on a display interface of an electronic device 100, where the foreground display content is text information.
Specifically, when the content of the foreground image is text or desktop icon, for example, when the user reads news information, reads an electronic book, and reads a short message, the content of the foreground image is mainly text, and when the foreground image returns to the desktop, the content of the foreground image is mainly desktop icon, and at this time, the text and icon are the contents mainly concerned by the user, background color, patterns, desktop wallpaper and the like in the background display content are not information needing attention, the display content is replaced by the two-dimensional environment video, so that the two-dimensional environment video and the characters or the desktop icons are displayed in an overlapping manner, in vision, the desktop icons or characters float above the two-dimensional environment video, the environment video data can still be displayed through the gaps between the icons or the characters, the display range of the two-dimensional environment video reaches the maximum limit, the perception of a user to environment factors can be enhanced, and the vertigo caused by operating the electronic device when the user is riding the car is further reduced.
In other embodiments, transparency adjustments may also be made to the two-dimensional environmental video. Specifically, when the color parameters such as the chromaticity and the saturation of the two-dimensional environment video exceed the set values, the two-dimensional environment video can interfere with the user in obtaining the foreground picture information due to the fact that the display screen simultaneously displays the foreground picture and the background picture with the content of the two-dimensional environment video, the user experience is poor, after the transparency of the two-dimensional environment video is adjusted, the two-dimensional environment video can provide the environment information for the user, and excessive visual interference to the user is avoided.
The transparency of the two-dimensional environment video can be adjusted according to the preset transparency, and the preset transparency is 20% -80%. The operation of adjusting the transparency can be finished by a computing processing module of the electronic device, and a UI operation module can be provided on the display interface for the user to manually operate and adjust.
In addition, brightness or transparency adjustment can be performed on the two-dimensional environment video according to the external environment brightness detected by the vehicle equipment and the internal environment brightness detected by the vehicle equipment or the electronic device in the vehicle equipment cabin. In particular, most vehicle equipment is filmed on its windows, resulting in the user experiencing an external environment in the cabin that is significantly darker than the actual external environment. Because, in order to better simulate the real situation, the two-dimensional environment video may be adjusted in brightness or transparency by the difference between the external environment brightness and the internal environment brightness, the greater the difference, the lower the brightness or the higher the transparency of the two-dimensional environment video.
Different from the prior art, the scheme of the application can simultaneously display the page information and the two-dimensional environment video information to be operated by the user, can furthest ensure that the displayed two-dimensional environment video is consistent with the posture of the electronic device, realizes AR display and superposition display of the two-dimensional environment video and images, videos or characters, and reduces dizziness caused by the fact that the user operates the electronic device in the advancing process of the vehicle equipment.
Referring to fig. 11, fig. 11 is a schematic block diagram of a circuit structure of an embodiment of a vehicle device according to the present application. The vehicle device 200 is provided with a camera module 201, a processing module 202 and a communication module 203, as described above, the camera module 201 may include a plurality of cameras to acquire environment images at various angles, or may include only one 360-degree panoramic camera for acquiring a three-dimensional environment video of an external scene of the vehicle device 200; the processing module 202 is connected with the camera module 201, and receives the image information sent by the camera module 201 when the image information is needed to be used for three-dimensional reconstruction, so as to obtain a three-dimensional environment video by using the image information for reconstruction; the communication module 203 is connected with the processing module 202 and the camera module 201, and is in communication connection with the electronic device, and is used for sending the three-dimensional environment video to the electronic device.
The processing module 202 may also be configured to virtually construct a three-dimensional environment video according to the motion speed and the posture of the vehicle apparatus 200 itself, and the communication module 203 transmits the three-dimensional environment video to the electronic device.
The communication module 203 is, for example, a wireless communication module such as WIFI or bluetooth.
Referring to fig. 12, fig. 12 is a schematic block diagram of a circuit structure of an electronic device according to an embodiment of the present application. The electronic device 300 is located in a riding environment in which the vehicle equipment runs, and the electronic device 300 comprises an acquisition module 301, a video generation module 302 and a display module 303, wherein the acquisition module 301 is used for acquiring a three-dimensional environment video outside the vehicle equipment and acquiring relative attitude information between the electronic device 300 and the vehicle equipment; the video generating module 302 is configured to generate a two-dimensional environment video corresponding to the viewing angle of the electronic device 300 according to the relative pose information and the three-dimensional environment video; the display module 303 is configured to control a display screen of the electronic device 300 according to the two-dimensional environment video.
Optionally, the display module 303 is further configured to perform an overlay display on a current display screen of the electronic device with the two-dimensional environment video as a background screen.
Optionally, the display module 303 is further configured to reduce and display the current display picture in a centered manner, and display the two-dimensional environment video as the background picture in an overlapping manner.
Optionally, the display module 303 is further configured to determine foreground display content and background display content in the current display screen, and replace the background display content with the two-dimensional environment video.
Optionally, the electronic device 300 further includes an adjusting module for performing transparency and/or brightness adjustment on the two-dimensional environment video.
Optionally, the electronic apparatus 300 may further include a communication module, configured to receive a three-dimensional environment video sent by the vehicle device, and the video generation module 302 generates a two-dimensional environment video according to the three-dimensional environment video; alternatively, the electronic device 300 may further include a building module, where the communication module is configured to receive the motion speed and the posture information of the vehicle device sent by the vehicle device and send the motion speed and the posture information to the building module, and the building module generates the three-dimensional environment video according to the motion speed and the posture information of the vehicle device.
For the description of the steps executed by the modules of the electronic device 300, please refer to the description of the steps in the embodiment of the display control method of the electronic device of the present application, which is not repeated herein.
Referring to fig. 13, fig. 13 is a schematic block diagram of a circuit structure of an electronic device according to another embodiment of the present application. The electronic device 400 includes a processor 401 and a memory 402 coupled to each other, the memory 402 stores a computer program, and the processor 401 is configured to execute the computer program to implement the display control method of the electronic device according to the above embodiments.
For the description of the steps executed in the processing, please refer to the description of the steps in the embodiment of the display control method of the electronic device of the present application, which is not repeated herein.
The memory 402 may be used to store program data and modules, and the processor 401 executes various functional applications and data processing by operating the program data and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the electronic apparatus 400, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 access to the memory 402.
In some embodiments, the electronic device 400 is not limited to include televisions, desktop computers, laptop computers, handheld computers, wearable devices, head-mounted displays, reader devices, portable music players, portable game consoles, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, and cicada-style phones, Personal Digital Assistants (PDAs), Augmented Reality (AR).
In the embodiments of the present application, the display control method of the electronic device and the electronic device can be implemented in other manners. For example, the various embodiments of the vehicle device and electronic apparatus described above are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium, or in a part of or all of the technical solutions that contribute to the prior art.
Referring to fig. 14, fig. 14 is a schematic block diagram of a circuit structure of an embodiment of a computer-readable storage medium 500 of the present application, where the computer-readable storage medium 500 stores program data 510, and the program data 510 implements the steps of the embodiments of the display control method described above when executed.
For the description of the steps executed in the processing, please refer to the description of the steps in the embodiment of the display control method of the electronic device of the present application, which is not repeated herein.
The computer-readable storage medium 500 may be various media that can store program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings, or which are directly or indirectly applied to other related technical fields, are intended to be included within the scope of the present application.
Claims (11)
1. A display control method applied to an electronic device in a riding environment in which vehicle equipment is running, the method comprising:
acquiring a three-dimensional environment video outside the vehicle equipment;
acquiring relative attitude information between the electronic device and the vehicle equipment;
generating a two-dimensional environment video corresponding to the visual angle of the electronic device according to the relative attitude information and the three-dimensional environment video;
and controlling a display picture of the electronic device according to the two-dimensional environment video.
2. The method of claim 1, wherein the step of generating a two-dimensional environment video corresponding to the electronic device perspective from the relative pose information and the three-dimensional environment video comprises:
determining image information of the three-dimensional environment video corresponding to the visual angle of the electronic device according to the relative posture information and the visual angle of the three-dimensional environment video;
and outputting continuous multiframe image information into a two-dimensional environment video.
3. The method of claim 1, wherein the three-dimensional environment video is obtained by:
shooting external scenes of the vehicle equipment from different perspectives, and generating the three-dimensional environment video through three-dimensional reconstruction.
4. The method of claim 1, wherein the three-dimensional environment video is obtained by:
and shooting an external scene of the vehicle equipment in a surrounding view mode to directly acquire the three-dimensional environment video.
5. The method of claim 1, wherein the three-dimensional environment video is obtained by:
and virtually constructing the three-dimensional environment video according to the movement speed and the posture of the vehicle equipment.
6. The method of claim 1, wherein the step of controlling the display of the electronic device according to the two-dimensional environment video comprises:
and reducing and centering the current display picture of the electronic device, and performing superposition display on the two-dimensional environment video serving as a background picture.
7. The method of claim 1, wherein the step of controlling the display of the electronic device according to the two-dimensional environment video comprises:
determining foreground display content and background display content in a current display picture of the electronic device, and replacing the background display content with the two-dimensional environment video.
8. The method of claim 1, wherein the step of controlling the display of the electronic device according to the two-dimensional environment video further comprises:
and adjusting the transparency and/or brightness of the two-dimensional environment video.
9. An electronic device in a riding environment in which vehicle equipment is operated, the electronic device comprising:
the acquisition module is used for acquiring a three-dimensional environment video outside the vehicle equipment and acquiring relative attitude information between the electronic device and the vehicle equipment;
the video generation module is used for generating a two-dimensional environment video corresponding to the visual angle of the electronic device according to the relative attitude information and the three-dimensional environment video;
and the display module is used for controlling a display picture of the electronic device according to the two-dimensional environment video.
10. An electronic device, comprising a processor and a memory coupled to each other; the memory has stored therein a computer program for execution by the processor to implement the steps of the method according to any one of claims 1-8.
11. A computer-readable storage medium, characterized in that the computer-readable storage medium stores program data which, when executed by a processor, implements the steps of the method according to any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111177747.0A CN113986165B (en) | 2021-10-09 | 2021-10-09 | Display control method, electronic device and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111177747.0A CN113986165B (en) | 2021-10-09 | 2021-10-09 | Display control method, electronic device and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113986165A true CN113986165A (en) | 2022-01-28 |
| CN113986165B CN113986165B (en) | 2024-04-26 |
Family
ID=79737960
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111177747.0A Active CN113986165B (en) | 2021-10-09 | 2021-10-09 | Display control method, electronic device and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113986165B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107089191A (en) * | 2016-02-18 | 2017-08-25 | 索尼公司 | Active window for information of vehicles He virtual reality |
| CN109416842A (en) * | 2016-05-02 | 2019-03-01 | 华纳兄弟娱乐公司 | Geometric match in virtual reality and augmented reality |
| CN109823173A (en) * | 2019-03-08 | 2019-05-31 | 浙江吉利汽车研究院有限公司 | A kind of dynamic display method and system of carsickness-proof |
| CN110036635A (en) * | 2016-12-28 | 2019-07-19 | 微软技术许可有限责任公司 | Alleviate the system, method and computer-readable medium of motion sickness via the display of the enhancing for passenger for using video capture device |
| US20190317600A1 (en) * | 2017-02-13 | 2019-10-17 | Jaguar Land Rover Limited | Apparatus and a method for controlling a head-up display of a vehicle |
| CN110769905A (en) * | 2017-06-16 | 2020-02-07 | 本田技研工业株式会社 | In-vehicle performance device, in-vehicle performance system, in-vehicle performance method, program, and instruction measurement device |
| CN111103688A (en) * | 2019-12-11 | 2020-05-05 | 塔普翊海（上海）智能科技有限公司 | Anti-dizzy device, system and method |
| CN111103584A (en) * | 2018-10-10 | 2020-05-05 | Zf 腓德烈斯哈芬股份公司 | Device and method for determining height information of objects in the surroundings of a vehicle |
| CN111182940A (en) * | 2017-10-04 | 2020-05-19 | 奥迪股份公司 | Viewing digital content in a vehicle without motion sickness |
| CN111491584A (en) * | 2017-12-15 | 2020-08-04 | 美敦力公司 | Augmented reality solution for optimizing targeted access and therapy delivery for interventional cardiology tools |
| CN111824177A (en) * | 2019-04-10 | 2020-10-27 | 重庆金康新能源汽车有限公司 | Vehicle instrument system, reminding method, automobile and storage medium |
| CN112369051A (en) * | 2018-05-18 | 2021-02-12 | 法雷奥舒适驾驶助手公司 | Shared environment for vehicle occupants and remote users |
| CN112839190A (en) * | 2021-01-22 | 2021-05-25 | 九天华纳(北京)科技有限公司 | Method for synchronously recording or live broadcasting video of virtual image and real scene |
| CN113377482A (en) * | 2021-07-06 | 2021-09-10 | 浙江商汤科技开发有限公司 | Display method, display device, electronic equipment and computer-readable storage medium |
-
2021
- 2021-10-09 CN CN202111177747.0A patent/CN113986165B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107089191A (en) * | 2016-02-18 | 2017-08-25 | 索尼公司 | Active window for information of vehicles He virtual reality |
| CN109416842A (en) * | 2016-05-02 | 2019-03-01 | 华纳兄弟娱乐公司 | Geometric match in virtual reality and augmented reality |
| CN110036635A (en) * | 2016-12-28 | 2019-07-19 | 微软技术许可有限责任公司 | Alleviate the system, method and computer-readable medium of motion sickness via the display of the enhancing for passenger for using video capture device |
| US20190317600A1 (en) * | 2017-02-13 | 2019-10-17 | Jaguar Land Rover Limited | Apparatus and a method for controlling a head-up display of a vehicle |
| CN110769905A (en) * | 2017-06-16 | 2020-02-07 | 本田技研工业株式会社 | In-vehicle performance device, in-vehicle performance system, in-vehicle performance method, program, and instruction measurement device |
| CN111182940A (en) * | 2017-10-04 | 2020-05-19 | 奥迪股份公司 | Viewing digital content in a vehicle without motion sickness |
| CN111491584A (en) * | 2017-12-15 | 2020-08-04 | 美敦力公司 | Augmented reality solution for optimizing targeted access and therapy delivery for interventional cardiology tools |
| CN112369051A (en) * | 2018-05-18 | 2021-02-12 | 法雷奥舒适驾驶助手公司 | Shared environment for vehicle occupants and remote users |
| CN111103584A (en) * | 2018-10-10 | 2020-05-05 | Zf 腓德烈斯哈芬股份公司 | Device and method for determining height information of objects in the surroundings of a vehicle |
| CN109823173A (en) * | 2019-03-08 | 2019-05-31 | 浙江吉利汽车研究院有限公司 | A kind of dynamic display method and system of carsickness-proof |
| CN111824177A (en) * | 2019-04-10 | 2020-10-27 | 重庆金康新能源汽车有限公司 | Vehicle instrument system, reminding method, automobile and storage medium |
| CN111103688A (en) * | 2019-12-11 | 2020-05-05 | 塔普翊海（上海）智能科技有限公司 | Anti-dizzy device, system and method |
| CN112839190A (en) * | 2021-01-22 | 2021-05-25 | 九天华纳(北京)科技有限公司 | Method for synchronously recording or live broadcasting video of virtual image and real scene |
| CN113377482A (en) * | 2021-07-06 | 2021-09-10 | 浙江商汤科技开发有限公司 | Display method, display device, electronic equipment and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113986165B (en) | 2024-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11592668B2 (en) | Image generation apparatus and image generation method using frequency lower than display frame rate | |
| EP3491489B1 (en) | Systems and methods for reducing motion-to-photon latency and memory bandwidth in a virtual reality system | |
| US20210170278A1 (en) | Image rendering method, device, and storage medium | |
| US11294535B2 (en) | Virtual reality VR interface generation method and apparatus | |
| US20180146189A1 (en) | Head mounted display and control method therefor | |
| WO2018226676A1 (en) | Smoothly varying foveated rendering | |
| CN108241213A (en) | Head-mounted display and its control method | |
| US11710310B2 (en) | Virtual content positioned based on detected object | |
| CN108596834B (en) | Resolution processing method, image processing device and system, and storage medium | |
| EP3667622B1 (en) | Information processing device, information processing method, and program | |
| US20220269338A1 (en) | Augmented devices | |
| US20230185099A1 (en) | Small field of view display mitigation using transitional visuals | |
| CN114174957A (en) | Tracking using pixel sensors of event cameras | |
| CN113986165B (en) | Display control method, electronic device and readable storage medium | |
| US11366318B2 (en) | Electronic device and control method thereof | |
| US11775051B2 (en) | Apparatus and associated methods for presentation of presentation data | |
| WO2023179442A1 (en) | 3d display method and apparatus | |
| US11301035B1 (en) | Method and device for video presentation | |
| US12034908B2 (en) | Stereoscopic-image playback device and method for generating stereoscopic images | |
| US20170052684A1 (en) | Display control apparatus, display control method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |