CN113891063B - Holographic display method and device - Google Patents
Holographic display method and device Download PDFInfo
- Publication number
- CN113891063B CN113891063B CN202111179077.6A CN202111179077A CN113891063B CN 113891063 B CN113891063 B CN 113891063B CN 202111179077 A CN202111179077 A CN 202111179077A CN 113891063 B CN113891063 B CN 113891063B
- Authority
- CN
- China
- Prior art keywords
- user
- display device
- frequency
- head
- control pen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/398—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
- H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application relates to a holographic display method and a device, wherein the method comprises the following steps: the method comprises the steps of obtaining viewpoint information of a first user, wherein the viewpoint information shows a dual-purpose position of the first user and a dual-purpose view angle of the first user, and the first user is a user with an interactive control pen; acquiring pose information of an interactive control pen; determining a first angle between the viewing angle and the pointing direction; and if the first included angle is larger than the first angle threshold, adjusting the output frequency of the head-mounted display device to a first frequency, and if the first included angle is not larger than the first angle threshold, adjusting the output frequency of the head-mounted display device to a second frequency, wherein the first frequency is larger than the second frequency. In the present specification, according to a first included angle between a viewing angle of a first user and a pointing direction of an interaction control pen, an output frequency of a head-mounted display device is adjusted, so that the first user can identify a part of content which is expected to interact in a hologram. The method is suitable for teaching scenes aiming at multiple persons.
Description
Technical Field
The application relates to the technical field of data processing, in particular to a holographic display method and device.
Background
The holographic display technology (Front-Projected Holographic Display) is also called virtual imaging technology, is a technology for recording and reproducing real three-dimensional images of objects by utilizing interference and diffraction principles, and has the advantages of meeting all the perception of human vision and even enabling a viewer to watch the three-dimensional images without help of auxiliary devices such as helmets, glasses and the like. With the continuous development of display technology, holographic display technology has gained more and more attention.
In application scenes such as cinema, science and technology museum, virtual Reality (VR) helmets, the arc-shaped or annular holographic images can enable viewers to obtain the looking-around effect, so that the watching experience of the viewers is greatly improved, and the viewers feel of being in the scene. However, in the prior art, there are technical solutions that enable a user to interact with a holographic image.
Disclosure of Invention
The application provides a holographic display method and device, which are used for solving the problem that interaction between a user and a holographic image is difficult to realize in the prior art.
In a first aspect, the present application provides a holographic display method, the method being based on a holographic display system comprising: display processing equipment, a sand table display device, a head-mounted display device and an interactive control pen; the display processing equipment is electrically connected with the sand table display device, the head-mounted display device and the interactive control pen respectively; the holographic display method is executed by the display processing device, and the method comprises the following steps:
Obtaining viewpoint information of a first user, wherein the viewpoint information shows a dual-purpose position of the first user and a dual-purpose view angle of the first user, and the first user is a user holding the interaction control pen;
acquiring pose information of the interaction control pen, wherein the pose information shows the pointing direction of the interaction control pen;
determining a first angle between the viewing angle and the pointing direction;
and if the first included angle is larger than a first angle threshold, adjusting the output frequency of the head-mounted display device to a first frequency, and if the first included angle is not larger than the first angle threshold, adjusting the output frequency of the head-mounted display device to a second frequency, wherein the first frequency is larger than the second frequency.
In an optional embodiment of the present disclosure, if the first included angle is greater than a first angle threshold, the output frequency of the head-mounted display device is adjusted to a first frequency, and if the first included angle is less than the first angle threshold, the output frequency of the head-mounted display device is adjusted to a second frequency, where the first frequency is greater than the second frequency, and before the step of adjusting the output frequency of the head-mounted display device, the method further includes:
obtaining the number of users, wherein the users comprise the first user and a second user, and the second user is a user wearing the head-mounted display device and not holding the interaction control pen;
And if the number of the users is larger than the number threshold, adjusting the value of the first frequency to be a first value, and if the number of the users is not larger than the number threshold, adjusting the value of the first frequency to be a second value, wherein the first value is smaller than the second value.
In an optional embodiment of the present disclosure, if the first included angle is greater than a first angle threshold, the output frequency of the head-mounted display device is adjusted to a first frequency, and if the first included angle is less than the first angle threshold, the output frequency of the head-mounted display device is adjusted to a second frequency, where the first frequency is greater than the second frequency, and before the step of adjusting the output frequency of the head-mounted display device, the method further includes:
obtaining viewpoint information of each second user, wherein the viewpoint information shows a dual-purpose position of the second user and a dual-purpose view angle of the second user, and the second user is a user wearing the head-mounted display device and not holding the interaction control pen;
determining the density center of distribution of dual-purpose positions of each second user in a designated environment, wherein the designated environment is the environment in which the sand table type display device is positioned;
determining a connecting line between the density center and a designated point as a designated line, wherein the designated point is an intersection point of the pointing direction of the interactive control pen and the holographic image;
And if the second included angle between the pointing direction and the appointed line is larger than a second angle threshold value, adjusting the output frequency of the sand table type display device to a third frequency, and if the second included angle is not larger than the second angle threshold value, adjusting the output frequency of the sand table type display device to a fourth frequency, wherein the third frequency is larger than the fourth frequency.
In an alternative embodiment of the present disclosure, the viewpoint information includes six degrees of freedom information of a head-mounted display device worn by the first user, wherein the viewpoint information is obtained according to a viewpoint information tracking algorithm.
In an optional embodiment of the present disclosure, the pose information of the interaction control pen includes six degrees of freedom information of the interaction control pen, where position 3 degrees of freedom information in the six degrees of freedom information of the interaction control pen is obtained according to image information collected by a mobile auxiliary camera, and rotation 3 degrees of freedom information in the six degrees of freedom information of the interaction control pen is obtained according to data collected by an IMU module in the interaction control pen, and the mobile auxiliary camera is disposed on the sand table display device.
In an alternative embodiment of the present disclosure, the head-mounted display device includes shutter-type active three-dimensional glasses and at least three reflective marker points embedded on a housing structure of the shutter-type active three-dimensional glasses, where the shutter-type active three-dimensional glasses are used to receive the holographic image transmitted by the sand table display device, so as to obtain correct left and right eye images.
In an optional embodiment of the present disclosure, a first pressure sensor is disposed on the head-mounted display device, and when the head-mounted display device is worn on the head of the user, the first pressure sensor generates a first signal and sends the first signal to the display processing device; an IMU module is arranged in the interactive control pen, and when the gesture of the interactive control pen changes, a second signal is generated and sent to the display processing equipment; the method for acquiring the viewpoint information of the first user comprises the following steps:
and if the first signal is detected at the designated time and the second signal is detected within the designated time range from the designated time, acquiring viewpoint information of the first user.
In a second aspect, the present application provides a holographic display comprising:
a first acquisition module configured to: obtaining viewpoint information of a first user, wherein the viewpoint information shows a dual-purpose position of the first user and a dual-purpose view angle of the first user, and the first user is a user holding the interaction control pen;
a second acquisition module configured to: acquiring pose information of the interaction control pen, wherein the pose information shows the pointing direction of the interaction control pen;
The first included angle determining module is configured to: determining a first angle between the viewing angle and the pointing direction;
a first adjustment module configured to: and if the first included angle is larger than a first angle threshold, adjusting the output frequency of the head-mounted display device to a first frequency, and if the first included angle is not larger than the first angle threshold, adjusting the output frequency of the head-mounted display device to a second frequency, wherein the first frequency is larger than the second frequency.
In a third aspect, the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;
a memory for storing a computer program;
a processor for implementing the steps of any one of the holographic display methods of the first aspect when executing a program stored on a memory.
In a fourth aspect, the present application provides a computer readable storage medium having stored thereon a computer program, characterized in that the computer program when executed by a processor implements the steps of any of the holographic display methods of the first aspect.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages:
According to the holographic display method and device, interaction between the first user and the holographic image is mainly achieved through the interaction control pen, in the method, output frequency of the head-mounted display device is adjusted according to a first included angle between a visual angle of the first user and the direction of the interaction control pen, and under the condition that the first included angle is larger than a first angle threshold value, the fact that larger position difference and/or angle difference exist between parts of content which the first user wants to interact in the holographic image is indicated, the first user is likely to be incapable of accurately selecting the parts of content which the first user wants to interact in the holographic image, at the moment, the output frequency of the head-mounted display device is improved, and the first user is facilitated to identify the parts of content which the first user wants to interact in the holographic image. Under the condition that the first included angle is not larger than the first angle threshold, the condition that the first user and the part of the content which the first user wants to interact with have good interaction is indicated, and at the moment, more users can participate in the watching of the holographic images by reducing the output frequency of the head-mounted display device, so that reasonable distribution of holographic image display resources is facilitated. The method is suitable for teaching scenes aiming at multiple persons.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the application or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a schematic view of a scene involved in a holographic display process according to an embodiment of the present application;
FIG. 2 is a schematic flow chart of a holographic display process according to an embodiment of the present application;
FIG. 3 is a schematic diagram of a holographic display corresponding to some steps of the method of FIG. 2;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The process in this specification is based on a holographic display system comprising: display processing equipment, a sand table display device, a head-mounted display device and an interactive control pen; the display processing device is electrically connected with the sand table display device, the head-mounted display device and the interactive control pen respectively, and an exemplary scenario is shown in fig. 1. The head-mounted display device may be in one-to-one correspondence with the user. Alternatively, different head mounted display devices output pictures to the user at the same frequency. In the case where multiple users (users do not have two or more) simultaneously view holograms displayed on the sand table type display device, the display processing apparatus outputs display signals to the respective head mounted display devices separately.
The method in the specification is suitable for teaching scenes, and in the case that the users are multiple, one of the multiple users is a teacher, and the other users are students.
In a scenario where multiple users simultaneously view a holographic image shown on a sand table display device, the user wearing the head mounted display device and holding the interactive control pen is a first user, and the user wearing the head mounted display device and not holding the interactive control pen is a second user.
As shown in fig. 2, the holographic display method and device in the present specification include the following steps:
s200: and obtaining viewpoint information of the first user.
In this specification, the viewpoint information shows the first user dual-purpose position and the first user dual-purpose view angle, the first user being a user who holds the interactive control pen.
In an alternative embodiment of the present disclosure, the viewpoint information includes six degrees of freedom information of a head-mounted display device worn by the first user, wherein the viewpoint information is obtained according to a viewpoint information tracking algorithm. Optionally, the head-mounted display device comprises shutter type active three-dimensional glasses and at least three reflective mark points, wherein the at least three reflective mark points are embedded on a shell structure of the shutter type active three-dimensional glasses, and the shutter type active three-dimensional glasses are used for receiving holographic images transmitted by the sand table type display device, so that correct left and right eye pictures are obtained.
In a scenario where multiple users view holograms displayed on a sand table display device at the same time, the process of determining the first user among the users may be. For each head mounted display device, a first location of the head mounted display device in a designated environment (i.e., a dual purpose location of a user wearing the head mounted display device) is determined. And determining a second location of the interactive control pen in the designated environment. Among the head-mounted display devices, a head-mounted display device whose first position is within a specified distance range (a preset range, which may be 0.5 m to 1.2 m) from the second position is determined as a first waiting device. And determining a first included angle corresponding to each first pending device according to each first pending device. And determining a first to-be-determined device corresponding to a first included angle which is not greater than a third angle threshold (the third angle threshold is a preset value and is greater than the first angle threshold), and taking the first to-be-determined device as a second to-be-determined device. Among the second pending devices, the second pending device closest to the specified point is determined as a head-mounted display device worn by the first user.
S202: and acquiring pose information of the interaction control pen.
The pose information of the interactive control pen shows the pointing direction of the interactive control pen. In an optional embodiment of the present disclosure, the pose information of the interaction control pen includes six degrees of freedom information of the interaction control pen, where position 3 degrees of freedom information in the six degrees of freedom information of the interaction control pen is obtained according to image information collected by a motion assist camera, and rotation 3 degrees of freedom information in the six degrees of freedom information of the interaction control pen is obtained according to data collected by an IMU module in the interaction control pen, and the motion assist camera is disposed on the sand table display device.
S204: a first angle between the viewing angle and the pointing direction is determined.
In order to determine the positions of the head-mounted display devices and the interactive control pen, the first included angle and the like are determined. In an alternative embodiment of the present disclosure, a three-dimensional coordinate system may be established in a designated environment in advance, with the origin of the coordinates of the three-dimensional coordinate system being the center of the display screen of the sand table display device.
S206: and if the first included angle is larger than a first angle threshold, adjusting the output frequency of the head-mounted display device to a first frequency, and if the first included angle is not larger than the first angle threshold, adjusting the output frequency of the head-mounted display device to a second frequency, wherein the first frequency is larger than the second frequency.
In the present disclosure, according to a first angle between a viewing angle of a first user and a pointing direction of an interaction control pen, an output frequency of a head-mounted display device is adjusted, and when the first angle is greater than a first angle threshold, it is indicated that a large position difference and/or angle difference exists between parts of content that the first user wants to interact in a hologram, which may result in the first user failing to accurately select the parts of content that the first user wants to interact in the hologram, and at this time, the output frequency of the head-mounted display device is increased, which is beneficial for the first user to identify the parts of content that the first user wants to interact in the hologram. Under the condition that the first included angle is not larger than the first angle threshold, the condition that the first user and the part of the content which the first user wants to interact with have good interaction is indicated, and at the moment, more users can participate in the watching of the holographic images by reducing the output frequency of the head-mounted display device, so that reasonable distribution of holographic image display resources is facilitated.
How the first frequency is determined will now be described. In an alternative embodiment of the present disclosure, the number of users is obtained (the number of users may be obtained in real time to adjust the first frequency in real time). Wherein the user includes the first user and a second user, the second user being a user wearing the head-mounted display device and not holding the interactive control pen. And if the number of the users is larger than the number threshold, adjusting the value of the first frequency to be a first value, and if the number of the users is not larger than the number threshold, adjusting the value of the first frequency to be a second value, wherein the first value is smaller than the second value. The first value and the second value may both be preset values, which may be set by the manager of the holographic display system.
Furthermore, the output frequency of the head-mounted display device is adjusted, so that the display resources are reasonably distributed, and the consumption of the resources can be reduced while the ornamental requirement of a user is met. In an optional real-time aspect of the present disclosure, viewpoint information of each second user is acquired (may be acquired in real-time to adjust the output frequency of the sand table display device in real-time). The viewpoint information shows a dual-purpose position of the second user and a dual-purpose view angle of the second user, and the second user is a user wearing the head-mounted display device and not holding the interaction control pen. And determining the density center of the distribution of the dual-purpose positions of each second user in a designated environment, wherein the designated environment is the environment in which the sand table type display device is positioned. And determining a connecting line between the density center and a designated point as a designated line, wherein the designated point is an intersection point of the pointing direction of the interactive control pen and the holographic image. And if the second included angle between the pointing direction and the appointed line is larger than a second angle threshold value, adjusting the output frequency of the sand table type display device to a third frequency, and if the second included angle is not larger than the second angle threshold value, adjusting the output frequency of the sand table type display device to a fourth frequency, wherein the third frequency is larger than the fourth frequency.
In an actual application scenario, there may be a holographic display system that only needs to provide a display to the user, without interaction with the user. In an optional embodiment of the present disclosure, in order to determine whether interaction with a user is required, a first pressure sensor is provided on the head-mounted display device, and when the head-mounted display device is worn on the head of the user, the first pressure sensor generates a first signal and sends the first signal to the display processing device; an IMU module is arranged in the interactive control pen, and when the gesture of the interactive control pen changes, a second signal is generated and sent to the display processing equipment; the method for acquiring the viewpoint information of the first user comprises the following steps: and if the first signal is detected at the designated time and the second signal is detected within the designated time range from the designated time, acquiring viewpoint information of the first user.
In the related art, to realize the LED multi-view 3D display, shutter-type active three-dimensional glasses with a refresh rate of at least 240Hz are required, and a multi-view display function is supported. The existing shutter type active three-dimensional glasses on the market have a refresh rate of only 120Hz, and do not support the multi-view display function.
Illustratively, the receiving frequency of the transmitting device input interface chip cannot reach the 240Hz minimum standard. The transmission frequency can be far higher than 240Hz through network cable communication between the sending device and the 3D display screen. Illustratively, the present specification uses an interface chip with a 4K bandwidth of 60Hz refresh rate, with the amount of input data being equivalent to 1080P bandwidth of 240Hz. The transmitting device in the specification cuts the received 4K pictures into 4 (corresponding to two shutter-type active three-dimensional glasses) 1080P bandwidth pictures and sequentially transmits the 1080P bandwidth pictures to the LED screen receiving card for display at a refresh rate of 240Hz or higher, so that the LED display system capable of displaying 240Hz video streams can be equivalently realized.
In this specification, a plurality of shutter-active three-dimensional glasses receive pictures from the same 3D display screen, and illustratively, a total of 4 pictures matching 2 shutter-active three-dimensional glasses are presented at 4.166ms intervals in the order of left 1, left 2, right 1, right 2. The shutter type active three-dimensional glasses support the 120Hz display refresh rate, but the synchronous signal is a square wave signal, a 60Hz square wave signal, a single period already comprises a peak half period and a trough half period, 120 state switches are carried out per second, and the use of the 120Hz display refresh rate of the common shutter type active three-dimensional glasses can be met.
Moreover, the synchronous mode can effectively distinguish left eyes and right eyes, for example, a peak is defined as a left eye, and a trough is defined as a right eye. Then the frequency of the synchronization signal is 60Hz for a 240Hz 3D image presentation system. With a 60Hz synchronization signal, peaks and valleys can still be used to distinguish between left and right eyes.
In an alternative embodiment of the present disclosure, the shutter-type active three-dimensional glasses are shutter-type active three-dimensional glasses with adjustable signal delay, where the left eye becomes transparent 4.166ms (the peak signal will last 8.333ms, the transparent state only last 4.166ms, when it becomes transparent, the picture on the 3D display screen can be received, when it does not become transparent, the display area can display black), and the right eye becomes transparent 4.166ms when it receives one trough. And then, the signal delay of one of the glasses is adjusted to 4.166ms, so that the glasses No. 1 and No. 2 can be distinguished.
The interaction mode is not particularly limited in this specification, and for example, the interaction mode may be to zoom in, zoom out, move, rotate, select and replace the holographic image output by the sand table display device.
In an alternative embodiment of the present description, the sand table display device is an LED (Light Emitting Diode ) display device. The image specification corresponding to the first display signal is 1920 pixels by 1080 pixels, and the output frequency of the first display signal is 120 Hz, so that the binocular alternating output picture of a user at the frequency of 60Hz is realized.
After receiving the first display signal, the sand table type display device outputs a holographic image according to the first display signal so as to be watched by a user wearing the head-mounted display device.
In order to enable the sand table type display device and the head-mounted display device to be matched, the display processing equipment generates a synchronous signal according to the left-eye first display signal and the right-eye first display signal, so that the head-mounted display device acquires holographic images output by the sand table type display device according to the synchronous signal, and the acquired holographic images are displayed to a user wearing the head-mounted display device alternately. It can be seen that the synchronization signal is used to achieve a binocular alternating output picture to the user.
In an alternative embodiment of the present specification, the head mounted display device is shutter type 3D glasses.
Further, when the hologram display system in the present specification provides hologram display for a plurality of users at the same time, since the viewpoints of each user (i.e., the viewpoints of the head-mounted display devices worn by the users) are different to some extent, the display processing apparatus in the present specification determines the viewpoints thereof for each head-mounted display device. Because the number of the head-mounted display devices is not unique, the first display signals received by the sand table display devices are not unique, and the sand table display devices need to display holographic images to different head-mounted display devices respectively according to different first display signals.
Further, in an alternative embodiment of the present disclosure, the hologram displayed by the sand table display device may also cooperate with an interactive handle to provide a user with a more interactive experience. Specifically, the display processing device judges whether the outline of the holographic image displayed by the sand table type display device intersects with the indication end of the interactive handle. If not, indicating that the indication end of the interactive handle is not pointed on the holographic image, and causing the indication position of the interactive handle on the holographic image to be ambiguous, amplifying the holographic image displayed by the sand table display device until the outline of the holographic image is intersected with the indication end of the interactive handle.
From the foregoing, it can be seen that the holographic display in this description requires a sand table display device to be mated with a head mounted display device. The coordination is to some extent achieved by means of a synchronization signal. In an alternative embodiment of the present disclosure, control of all head-mounted display devices may be achieved by one synchronization signal; in another alternative embodiment of the present disclosure, the synchronization signal may be generated separately for each head mounted display device separately to control the different head mounted display devices separately.
Specifically, aiming at a certain head-mounted display device, the synchronous signal controls the head-mounted display device to collect the content displayed by the sand table display device when the sand table display device displays the holographic image under the viewpoint of the head-mounted display device, and displays the content to a user according to the collected result.
In an alternative embodiment of the present disclosure, the head-mounted display device collects the hologram image output from the sand table display device according to the synchronization signal, so as to alternately display the collected hologram image to a user wearing the head-mounted display device.
According to the holographic display method, the sand table display device and the head-mounted display device are matched, so that the holographic images are displayed for users, the sand table display device is high in controllability, the displayed brightness can be adjusted according to the brightness of the scene where the sand table display device is located, and good holographic image display effect can be achieved even in darker scenes. Because holographic image in this description is by sand table display device auxiliary display, then wear-type display device in this description compares current VR glasses, need not to carry out comparatively complicated data processing, is favorable to reducing wear-type display device's volume and weight for user's somatosensory more comfortable.
In addition, existing 3D display products generally only have a narrow viewing point or only can see an ideal effect at a fixed position, i.e., the existing 3D display products only support a single point of view, but the 3D interactive display system of the single point of view display is increasingly unable to meet the needs of customers. In the holographic display method in the specification, the sand table display device and the head-mounted display device are matched, so that even if the viewpoint of a user changes (which can be caused by movement of the user), holographic images with stereoscopic impression can be displayed to the user, and the improvement of user experience is facilitated.
In addition, the display processing equipment in the holographic display system controls the display of the sand table type display device according to the viewpoint of the head-mounted display device, and even if the head-mounted display device moves along with a user, the head-mounted display device can acquire holographic images suitable for the user to watch based on the content displayed by the sand table type display device. Further, the holographic display system comprises a plurality of head-mounted display devices, when different head-mounted display devices are worn by different users, the different head-mounted display devices can be caused to have different viewpoints, and by the method in the specification, holographic image display can be simultaneously carried out on the plurality of head-mounted display devices with different viewpoints through the same sand table type display device.
In order to flexibly and efficiently control the sand table display device, in an optional embodiment of the present specification, after generating the first display signals corresponding to each view point, the display processing device performs a merging process on the first display signals corresponding to each view point; and outputting the composite signal obtained after the combination processing to the sand table type display device.
In an alternative embodiment of the present disclosure, the image specification corresponding to the composite signal is 1920 pixels×1080 pixels. The output frequency of the composite signal is 120 x k hz. Where k is the number of head mounted display devices. When k is equal to 2, the output frequency of the composite signal is 240 hz.
In order to realize data transmission between the display processing device and the sand table display device and effectively drive the sand table display device in cooperation with the scene of multi-view output, in an alternative embodiment of the present specification, the holographic display system may further include a receiving card. The display processing device outputs the composite signal to the receiving card after generating the composite signal. The receiving card restores the composite signal to each first display signal, and drives the sand table type display device to display the holographic image according to each first display signal.
Specifically, the receiving card outputs each first display signal to the sand table type display device in a time-sharing manner, so that the sand table type display device performs holographic image display according to each first display signal in a time-sharing manner. When the sand table type display device displays the hologram according to the first display signal corresponding to the ith (i can be any integer and represents any one) head-mounted display device, the ith head-mounted display device acquires the hologram displayed by the sand table type display device according to the synchronous signal, and the acquired result is matched with the viewpoint of the ith head-mounted display device.
Therefore, the receiving card in the specification has a certain interface function so as to cooperate with a plurality of sand table type display devices to display the holographic images simultaneously and/or cooperate with sand table type display devices of different types to display the holographic images.
By the holographic display method in the specification, the holographic image with strong stereoscopic impression and high image quality can be displayed for a user in various scenes with different brightness. In an actual scene, a user may move in a place where the sand table display device is disposed according to the user's own needs, and there is a possibility that a hologram displayed by the sand table display device is not matched with an actual viewpoint of the user due to the movement of the user.
In order to provide a hologram with excellent display effect and display holograms at different viewpoints for different simultaneous applications during movement of a user, in an alternative embodiment of the present specification, the holographic display system further includes: and a dynamic camera. The dynamic camera is arranged on the sand table type display device. The number of the dynamic capturing cameras and the setting positions and shooting angles on the sand table type display device in this specification are determined according to the setting placement, shape, size, and the like of the sand table type display device. Specifically, the number of the dynamic cameras is 4, and the dynamic cameras are respectively arranged at corners of the sand table type display device. The dynamic camera is used for collecting (shooting) images of the environment around the sand table type display device so as to capture the position of a user in the scene and further obtain the viewpoint of the head-mounted display device.
In other implementations of the present disclosure, the dynamic camera may be disposed above the sand table display device to capture images of the environment from a bird's eye view.
The motion capture camera may perform image acquisition under control of the display processing device.
In an optional embodiment of the present disclosure, the motion capture camera first acquires 3D coordinate information of the head-mounted display device in space, and then combines the acquired eye viewpoint coordinate information of the user wearing the head-mounted display device in the motion capture space, so as to complete tracking and positioning of the viewing angle of the user, and then transmits the positioning information to the display processing device. And synchronizing a position signal of the display processing device in the motion capture space to the hologram, and taking the three-dimensional position of the head-mounted display device in the motion capture space as the position of the virtual camera in the hologram (namely, the position of the head-mounted display device) so as to calculate the viewpoint picture of the virtual camera.
Specifically, the display processing device may include: a display server, a display processor and a synchronization transmitter. The first display signal is generated by a display server; the composite signal and/or the synchronization signal is generated by the display processor; the synchronization signal is sent by the synchronization transmitter to the head mounted display device. Optionally, the aforementioned left-eye display signal and right-eye display signal are generated by a display server, and the display server sends the generated left-eye display signal and right-eye display signal to a display processor. The display processor generates a first display signal according to the left eye display signal and the right eye display signal and sends the first display signal to the sand table type display device. The synchronization signal is sent by the synchronization transmitter to the head mounted display device.
Optionally, the display server is electrically connected with the display processor through a DP or HDMI line; the display processor is electrically connected with the receiving card through the network port; the display processor is electrically connected with the synchronous transmitter through a cable. The receiving card is electrically connected with the sand table type display device through a flat cable.
In an alternative embodiment of the present disclosure, the sand table display device may be composed of a small-pitch LED display screen, and the sand table display device includes an LED display screen body, a three-dimensional video fusion device, a three-dimensional signal transmitter, and the like.
The three-dimensional video fusion device is connected with the sending card of the LED display screen body. The three-dimensional signal transmitter is connected to the three-dimensional video fusion device, the three-dimensional video fusion device receives viewpoint picture information of the virtual camera (namely, the head-mounted display device) processed by the display processor in the display processing device, the display frequency is adjusted, pictures are displayed on the LED display screen body through the transmitting card, so that left and right eye pictures are displayed, and the holographic three-dimensional display algorithm is carried in the display processor. The three-dimensional signal transmitter synchronously transmits the display frequency to the holographic 3D glasses so as to realize real-time display of pictures which are adjusted according to different viewpoint positions of users wearing the holographic 3D glasses.
In the present description, in the virtual three-dimensional scene, the three-dimensional position of the head-mounted display device in the motion capture space is taken as the position of the virtual camera in the virtual space, so that the position of one virtual camera can be simulated to capture the picture of the position of the head-mounted display device, and the virtual three-dimensional scene is set according to the position of the virtual camera in the virtual space.
The picture photographed by the virtual camera (i.e., the picture under the viewpoint of the head-mounted display device) is the three-dimensional virtual scene picture (i.e., the hologram) seen by the viewpoint of the user wearing the head-mounted display device, i.e., the virtual three-dimensional scene photographed by the virtual camera is the 3D viewpoint picture seen by the user. The display processing equipment can process the picture to be displayed in real time according to the viewpoint position information of the head-mounted display device in the motion capture space, and simultaneously adopts the sand table type display device to display the viewpoint picture, so that the excellent holographic three-dimensional display effect can be realized, and the excellent screen-out feeling and holographic visual feeling are obtained.
Compared with other products, the holographic display system provided by the application has the advantages that the cost is greatly reduced, the picture display is finer and richer, and the color is richer. The display effect has strong stability, the use of the user is more convenient, and the operation control is simpler. The sand table type display device is fine in display effect, high in brightness and low in cost, and the LED active 3D stereoscopic display technology is combined with the space position information of the observation view point, so that the 3D stereoscopic effect that the virtual object is suspended on the LED display screen is achieved, the user's impression can be improved, and the holographic display effect is improved.
In addition, in an alternative embodiment of the present specification, the process in the present specification can be used not only to present a hologram to a user, but also to enable interaction with the user. Specifically, when the display processing device receives the interaction instruction, a second display signal is generated and output to the sand table type display device, so that the sand table type display device outputs a holographic image for displaying the interaction handle according to the second display signal, and a user can operate the interaction handle to realize interaction.
Optionally, the interaction instruction is triggered by a specified action performed by the user through the interaction control pen, which may be acquired by the dynamic capture camera. The hologram of the interactive handle may be a bar-shaped hologram, one end of the interactive handle being coordinated with the hand movements of the user, following the movements of the user's hand moving in the hologram generated by the sand table display device.
Based on the same considerations, the present description further provides a holographic display, as shown in fig. 3, comprising one or more of the following modules:
the first acquisition module 300 is configured to: obtaining viewpoint information of a first user, wherein the viewpoint information shows a dual-purpose position of the first user and a dual-purpose view angle of the first user, and the first user is a user holding the interaction control pen;
a second acquisition module 302 configured to: acquiring pose information of the interaction control pen, wherein the pose information shows the pointing direction of the interaction control pen;
the first included angle determining module 304 is configured to: determining a first angle between the viewing angle and the pointing direction;
a first adjustment module 306 configured to: and if the first included angle is larger than a first angle threshold, adjusting the output frequency of the head-mounted display device to a first frequency, and if the first included angle is not larger than the first angle threshold, adjusting the output frequency of the head-mounted display device to a second frequency, wherein the first frequency is larger than the second frequency.
In an alternative embodiment of the present disclosure, the holographic display further comprises a second adjustment module. The second adjustment module is configured to: obtaining the number of users, wherein the users comprise the first user and a second user, and the second user is a user wearing the head-mounted display device and not holding the interaction control pen; and if the number of the users is larger than the number threshold, adjusting the value of the first frequency to be a first value, and if the number of the users is not larger than the number threshold, adjusting the value of the first frequency to be a second value, wherein the first value is smaller than the second value.
In an alternative embodiment of the present disclosure, the holographic display further comprises a third adjustment module configured to: obtaining viewpoint information of each second user, wherein the viewpoint information shows a dual-purpose position of the second user and a dual-purpose view angle of the second user, and the second user is a user wearing the head-mounted display device and not holding the interaction control pen; determining the density center of distribution of dual-purpose positions of each second user in a designated environment, wherein the designated environment is the environment in which the sand table type display device is positioned; determining a connecting line between the density center and a designated point as a designated line, wherein the designated point is an intersection point of the pointing direction of the interactive control pen and the holographic image; and if the second included angle between the pointing direction and the appointed line is larger than a second angle threshold value, adjusting the output frequency of the sand table type display device to a third frequency, and if the second included angle is not larger than the second angle threshold value, adjusting the output frequency of the sand table type display device to a fourth frequency, wherein the third frequency is larger than the fourth frequency.
In an alternative embodiment of the present disclosure, the viewpoint information includes six degrees of freedom information of a head-mounted display device worn by the first user, wherein the viewpoint information is obtained according to a viewpoint information tracking algorithm.
In an optional embodiment of the present disclosure, the pose information of the interaction control pen includes six degrees of freedom information of the interaction control pen, where position 3 degrees of freedom information in the six degrees of freedom information of the interaction control pen is obtained according to image information collected by a mobile auxiliary camera, and rotation 3 degrees of freedom information in the six degrees of freedom information of the interaction control pen is obtained according to data collected by an IMU module in the interaction control pen, and the mobile auxiliary camera is disposed on the sand table display device.
In an alternative embodiment of the present disclosure, the head-mounted display device includes shutter-type active three-dimensional glasses and at least three reflective marker points embedded on a housing structure of the shutter-type active three-dimensional glasses, where the shutter-type active three-dimensional glasses are used to receive the holographic image transmitted by the sand table display device, so as to obtain correct left and right eye images.
In an optional embodiment of the present disclosure, a first pressure sensor is disposed on the head-mounted display device, and when the head-mounted display device is worn on the head of the user, the first pressure sensor generates a first signal and sends the first signal to the display processing device; an IMU module is arranged in the interactive control pen, and when the gesture of the interactive control pen changes, a second signal is generated and sent to the display processing equipment; the first obtaining module 300 is specifically configured to: and if the first signal is detected at the designated time and the second signal is detected within the designated time range from the designated time, acquiring viewpoint information of the first user.
Fig. 4 is a schematic structural view of an electronic device according to an embodiment of the present application. Referring to fig. 4, at the hardware level, the electronic device includes a processor, and optionally an internal bus, a network interface, and a memory. The Memory may include a Memory, such as a Random-Access Memory (RAM), and may further include a non-volatile Memory (non-volatile Memory), such as at least 1 disk Memory. Of course, the electronic device may also include hardware required for other services.
The processor, network interface, and memory may be interconnected by an internal bus, which may be an ISA (Industry Standard Architecture ) bus, a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus, or EISA (Extended Industry Standard Architecture ) bus, among others. The buses may be classified as address buses, data buses, control buses, etc. For ease of illustration, only one bi-directional arrow is shown in FIG. 4, but not only one bus or type of bus.
And the memory is used for storing programs. In particular, the program may include program code including computer-operating instructions. The memory may include memory and non-volatile storage and provide instructions and data to the processor.
The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs to form a holographic display and/or a second holographic display on a logic level. And the processor is used for executing the program stored in the memory and particularly executing any one of the holographic display processes.
It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises an element.
The foregoing is merely exemplary of embodiments of the present invention to enable those skilled in the art to understand or practice the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A holographic display method, the method being based on a holographic display system, the holographic display system comprising: display processing equipment, a sand table display device, a head-mounted display device and an interactive control pen; the display processing equipment is electrically connected with the sand table display device, the head-mounted display device and the interactive control pen respectively; the holographic display method is performed by the display processing device, the method comprising:
obtaining viewpoint information of a first user, wherein the viewpoint information shows a dual-purpose position of the first user and a dual-purpose view angle of the first user, and the first user is a user holding the interaction control pen;
acquiring pose information of the interaction control pen, wherein the pose information shows the pointing direction of the interaction control pen;
determining a first angle between the viewing angle and the pointing direction;
and if the first included angle is larger than a first angle threshold, adjusting the output frequency of the head-mounted display device to a first frequency, and if the first included angle is not larger than the first angle threshold, adjusting the output frequency of the head-mounted display device to a second frequency, wherein the first frequency is larger than the second frequency.
2. The method of claim 1, wherein the output frequency of the head mounted display device is adjusted to a first frequency if the first included angle is greater than a first angle threshold, and is adjusted to a second frequency if the first included angle is less than the first angle threshold, the method further comprising, prior to the first frequency being greater than the second frequency:
obtaining the number of users, wherein the users comprise the first user and a second user, and the second user is a user wearing the head-mounted display device and not holding the interaction control pen;
and if the number of the users is larger than the number threshold, adjusting the value of the first frequency to be a first value, and if the number of the users is not larger than the number threshold, adjusting the value of the first frequency to be a second value, wherein the first value is smaller than the second value.
3. The method of claim 1, wherein the output frequency of the head mounted display device is adjusted to a first frequency if the first included angle is greater than a first angle threshold, and is adjusted to a second frequency if the first included angle is less than the first angle threshold, the method further comprising, prior to the first frequency being greater than the second frequency:
Obtaining viewpoint information of each second user, wherein the viewpoint information shows a dual-purpose position of the second user and a dual-purpose view angle of the second user, and the second user is a user wearing the head-mounted display device and not holding the interaction control pen;
determining the density center of distribution of dual-purpose positions of each second user in a designated environment, wherein the designated environment is the environment in which the sand table type display device is positioned;
determining a connecting line between the density center and a designated point as a designated line, wherein the designated point is an intersection point of the pointing direction of the interactive control pen and the holographic image;
and if the second included angle between the pointing direction and the appointed line is larger than a second angle threshold value, adjusting the output frequency of the sand table type display device to a third frequency, and if the second included angle is not larger than the second angle threshold value, adjusting the output frequency of the sand table type display device to a fourth frequency, wherein the third frequency is larger than the fourth frequency.
4. The method of claim 1, wherein the viewpoint information comprises six degrees of freedom information of a head mounted display device worn by the first user, wherein the viewpoint information is derived from a viewpoint information tracking algorithm.
5. The method of claim 1, wherein the pose information of the interactive control pen comprises six degrees of freedom information of the interactive control pen, wherein position 3 degrees of freedom information in the six degrees of freedom information of the interactive control pen is obtained according to image information acquired by a mobile auxiliary camera, and wherein rotation 3 degrees of freedom information in the six degrees of freedom information of the interactive control pen is obtained according to data acquired by an IMU module in the interactive control pen, and the mobile auxiliary camera is arranged on the sand table display device.
6. The method of claim 1, wherein the head-mounted display device comprises shutter-type active three-dimensional glasses and at least three reflective marker points embedded on a housing structure of the shutter-type active three-dimensional glasses, the shutter-type active three-dimensional glasses being configured to receive the holographic image transmitted by the sand table display device, thereby obtaining correct left and right eye images.
7. The method of claim 1, wherein a first pressure sensor is disposed on the head mounted display device, the first pressure sensor generating a first signal when the head mounted display device is worn on a user's head, and transmitting the first signal to the display processing device; an IMU module is arranged in the interactive control pen, and when the gesture of the interactive control pen changes, a second signal is generated and sent to the display processing equipment; the method for acquiring the viewpoint information of the first user comprises the following steps:
And if the first signal is detected at the designated time and the second signal is detected within the designated time range from the designated time, acquiring viewpoint information of the first user.
8. A holographic display, the device comprising:
a first acquisition module configured to: the method comprises the steps of obtaining viewpoint information of a first user, wherein the viewpoint information shows a dual-purpose position of the first user and a dual-purpose view angle of the first user, and the first user is a user with an interaction control pen;
a second acquisition module configured to: acquiring pose information of the interaction control pen, wherein the pose information shows the pointing direction of the interaction control pen;
the first included angle determining module is configured to: determining a first angle between the viewing angle and the pointing direction;
a first adjustment module configured to: and if the first included angle is larger than a first angle threshold, adjusting the output frequency of the head-mounted display device to a first frequency, and if the first included angle is not larger than the first angle threshold, adjusting the output frequency of the head-mounted display device to a second frequency, wherein the first frequency is larger than the second frequency.
9. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
a memory for storing a computer program;
a processor for implementing the steps of the holographic display method of any of claims 1-7 when executing a program stored on a memory.
10. A computer-readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of the holographic display method of any of claims 1-7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111179077.6A CN113891063B (en) | 2021-10-09 | 2021-10-09 | Holographic display method and device |
| PCT/CN2022/116191 WO2023056803A1 (en) | 2021-10-09 | 2022-08-31 | Holographic presentation method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111179077.6A CN113891063B (en) | 2021-10-09 | 2021-10-09 | Holographic display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113891063A CN113891063A (en) | 2022-01-04 |
| CN113891063B true CN113891063B (en) | 2023-09-01 |
Family
ID=79005810
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111179077.6A Active CN113891063B (en) | 2021-10-09 | 2021-10-09 | Holographic display method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113891063B (en) |
| WO (1) | WO2023056803A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113891063B (en) * | 2021-10-09 | 2023-09-01 | 深圳市瑞立视多媒体科技有限公司 | Holographic display method and device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106200985A (en) * | 2016-08-10 | 2016-12-07 | 北京天远景润科技有限公司 | Desktop type individual immerses virtual reality interactive device |
| CN106291930A (en) * | 2015-06-24 | 2017-01-04 | 联发科技股份有限公司 | Head mounted display |
| CN109445595A (en) * | 2018-11-02 | 2019-03-08 | 京东方科技集团股份有限公司 | A kind of virtual reality device and its driving method |
| CN113206991A (en) * | 2021-04-23 | 2021-08-03 | 深圳市瑞立视多媒体科技有限公司 | Holographic display method, system, computer program product and storage medium |
| CN213934416U (en) * | 2021-01-29 | 2021-08-10 | 南京盛世光幻科技有限公司 | Control handle of MR head display holographic device |
| CN113382224A (en) * | 2021-05-27 | 2021-09-10 | 深圳市瑞立视多媒体科技有限公司 | Interactive handle display method and device based on holographic sand table |
| CN113376858A (en) * | 2021-05-27 | 2021-09-10 | 深圳市瑞立视多媒体科技有限公司 | Holographic display method and device based on holographic sand table |
| CN113485547A (en) * | 2021-06-17 | 2021-10-08 | 深圳市瑞立视多媒体科技有限公司 | Interaction method and device applied to holographic sand table |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7268774B2 (en) * | 1998-08-18 | 2007-09-11 | Candledragon, Inc. | Tracking motion of a writing instrument |
| US10304247B2 (en) * | 2015-12-09 | 2019-05-28 | Microsoft Technology Licensing, Llc | Third party holographic portal |
| KR20180028796A (en) * | 2016-09-09 | 2018-03-19 | 삼성전자주식회사 | Method, storage medium and electronic device for displaying images |
| EP3316080B1 (en) * | 2016-10-26 | 2021-08-25 | HTC Corporation | Virtual reality interaction method, apparatus and system |
| CN109714588A (en) * | 2019-02-16 | 2019-05-03 | 深圳市未来感知科技有限公司 | Multi-viewpoint stereo image positions output method, device, equipment and storage medium |
| CN110430420A (en) * | 2019-06-24 | 2019-11-08 | 南方电网调峰调频发电有限公司 | A kind of five face CAVE display system integrated approaches based on small spacing LED |
| CN113891063B (en) * | 2021-10-09 | 2023-09-01 | 深圳市瑞立视多媒体科技有限公司 | Holographic display method and device |
-
2021
- 2021-10-09 CN CN202111179077.6A patent/CN113891063B/en active Active
-
2022
- 2022-08-31 WO PCT/CN2022/116191 patent/WO2023056803A1/en unknown
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106291930A (en) * | 2015-06-24 | 2017-01-04 | 联发科技股份有限公司 | Head mounted display |
| CN106200985A (en) * | 2016-08-10 | 2016-12-07 | 北京天远景润科技有限公司 | Desktop type individual immerses virtual reality interactive device |
| CN109445595A (en) * | 2018-11-02 | 2019-03-08 | 京东方科技集团股份有限公司 | A kind of virtual reality device and its driving method |
| CN213934416U (en) * | 2021-01-29 | 2021-08-10 | 南京盛世光幻科技有限公司 | Control handle of MR head display holographic device |
| CN113206991A (en) * | 2021-04-23 | 2021-08-03 | 深圳市瑞立视多媒体科技有限公司 | Holographic display method, system, computer program product and storage medium |
| CN113382224A (en) * | 2021-05-27 | 2021-09-10 | 深圳市瑞立视多媒体科技有限公司 | Interactive handle display method and device based on holographic sand table |
| CN113376858A (en) * | 2021-05-27 | 2021-09-10 | 深圳市瑞立视多媒体科技有限公司 | Holographic display method and device based on holographic sand table |
| CN113485547A (en) * | 2021-06-17 | 2021-10-08 | 深圳市瑞立视多媒体科技有限公司 | Interaction method and device applied to holographic sand table |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023056803A1 (en) | 2023-04-13 |
| CN113891063A (en) | 2022-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6583808B2 (en) | Method and system for stereo videoconferencing | |
| US20150358539A1 (en) | Mobile Virtual Reality Camera, Method, And System | |
| CN101636747A (en) | Two dimensional/three dimensional digital information obtains and display device | |
| US20160269685A1 (en) | Video interaction between physical locations | |
| CN113382224B (en) | Interactive handle display method and device based on holographic sand table | |
| JP2007501950A (en) | 3D image display device | |
| CN106980369A (en) | The synthesis of 3rd multi-view video of virtual reality project and output system and method | |
| WO2017173890A1 (en) | Helmet having dual cameras | |
| CN113891063B (en) | Holographic display method and device | |
| CN107948631A (en) | It is a kind of based on cluster and the bore hole 3D systems that render | |
| CN114371779A (en) | Visual enhancement method for sight depth guidance | |
| KR20200115631A (en) | Multi-viewing virtual reality user interface | |
| JP6207640B2 (en) | 2D image stereoscopic display device | |
| Ferre et al. | Stereoscopic video images for telerobotic applications | |
| CN113382222B (en) | Display method based on holographic sand table in user moving process | |
| JP3425402B2 (en) | Apparatus and method for displaying stereoscopic image | |
| CN113376858A (en) | Holographic display method and device based on holographic sand table | |
| CN109429057A (en) | Synchronous 3D panoramic video playing system | |
| CN115423916A (en) | XR (X-ray diffraction) technology-based immersive interactive live broadcast construction method, system and medium | |
| WO2018094045A2 (en) | Multi-camera scene representation including stereo video for vr display | |
| CN113485547A (en) | Interaction method and device applied to holographic sand table | |
| CN113206991A (en) | Holographic display method, system, computer program product and storage medium | |
| US11388378B2 (en) | Image processing apparatus, image processing method and projection system | |
| CN113382229B (en) | Dynamic auxiliary camera adjusting method and device based on holographic sand table | |
| CN113382225B (en) | Binocular holographic display method and device based on holographic sand table |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |