CN110544316B - Virtual reality playback method, system, equipment and storage medium - Google Patents
Virtual reality playback method, system, equipment and storage medium Download PDFInfo
- Publication number
- CN110544316B CN110544316B CN201910841658.8A CN201910841658A CN110544316B CN 110544316 B CN110544316 B CN 110544316B CN 201910841658 A CN201910841658 A CN 201910841658A CN 110544316 B CN110544316 B CN 110544316B
- Authority
- CN
- China
- Prior art keywords
- virtual reality
- speed parameter
- image
- record
- playback
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 230000008569 process Effects 0.000 claims abstract description 23
- 238000005516 engineering process Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004088 simulation Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 108010001267 Protein Subunits Proteins 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Geometry (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the application provides a virtual reality playback method, a system, equipment and a storage medium, which can acquire the record of the speed parameter of virtual reality equipment in the process of displaying virtual reality images and determine the position of a viewport according to the speed parameter, so as to control a three-dimensional engine to generate a virtual reality image displayed in the virtual reality equipment according to the input viewport position, and therefore, the application can display the generated virtual reality image for virtual reality playback. Because the speed parameter used by the application for virtual reality playback is the same as the speed parameter in the process of realizing the virtual reality image of the virtual reality device, the virtual reality image realized by the application is the same as the virtual reality image realized by the virtual reality device, and the virtual reality playback is realized.
Description
Technical Field
The present application relates to the field of virtual reality, and in particular, to a virtual reality playback method, system, device, and storage medium.
Background
With the development of technology, the popularity of virtual reality technology is also increasing.
After the user wears the virtual reality device, the virtual reality device can display the virtual reality image, so that the user obtains immersive experience, and the user seems to be in the virtual panoramic scene. Virtual reality technology is increasingly used in various life scenes such as games, medical treatment, education, experiments and the like.
In some cases, the user himself or herself or another person may need to view playback of the virtual reality image that the user previously viewed, but there is no technology that can achieve virtual reality playback.
Disclosure of Invention
In view of the above, the present application provides a virtual reality playback method, system, device and storage medium, and the technical scheme is as follows:
a virtual reality playback method, the method comprising:
obtaining a record of a speed parameter of the virtual reality device in displaying the virtual reality image, wherein the record of the speed parameter comprises: the speed parameter acquired by the speed parameter sensor in the virtual reality equipment and the acquisition time corresponding to the speed parameter;
determining a view port position matched with the speed parameter according to the speed parameter;
inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to generate a virtual reality image displayed in the virtual reality equipment according to the input viewport position;
and displaying the generated virtual reality image for virtual reality playback.
Optionally, the controlling the three-dimensional engine to generate the virtual reality image displayed in the virtual reality device according to the input viewport position includes:
controlling the three-dimensional engine to determine a displayed three-dimensional digital model part in the virtual reality equipment according to the input view port position;
and controlling the three-dimensional engine to generate a virtual reality image of the three-dimensional digital model part.
Optionally, the speed parameter is an angular speed, and determining, according to the speed parameter, a viewport position matched with the speed parameter includes:
determining a view field angle at the acquisition time corresponding to the angular speed according to the angular speed;
and determining the position of the viewing port matched with the angular speed according to the view field angle.
Optionally, the method further comprises:
obtaining an image record of a virtual reality device in displaying a virtual reality image, wherein the image record comprises: the method comprises the steps that part or all of virtual reality images displayed by the virtual reality equipment are displayed at display moments corresponding to the virtual reality images;
and sequentially displaying each virtual reality image in the obtained image records according to the display time so as to carry out virtual reality playback.
Optionally, the obtaining the record of the speed parameter of the virtual reality device in the process of displaying the virtual reality image includes:
obtaining data to be analyzed sent by virtual reality equipment through an application program interface of the virtual reality equipment;
and analyzing the data to be analyzed to obtain a record of the speed parameter of the virtual reality equipment in the process of displaying the virtual reality image.
A virtual reality playback system, the system comprising: a record obtaining unit, a view port determining unit, an image generating unit and an image display unit,
the record obtaining unit is configured to obtain a record of a speed parameter of the virtual reality device during displaying the virtual reality image, where the record of the speed parameter includes: the speed parameter acquired by the speed parameter sensor in the virtual reality equipment and the acquisition time corresponding to the speed parameter;
the view port determining unit is used for determining a view port position matched with the speed parameter according to the speed parameter;
the image generation unit is used for inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to generate a virtual reality image displayed in the virtual reality device according to the input viewport position;
the image display unit is used for displaying the generated virtual reality image to perform virtual reality playback.
Optionally, the image generating unit includes: a model determination subunit and an image generation subunit,
the model determining subunit is used for inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to determine the displayed three-dimensional digital model part in the virtual reality equipment according to the input viewport position;
the image generation subunit is used for controlling the three-dimensional engine to generate a virtual reality image of the three-dimensional digital model part.
Optionally, the speed parameter is an angular speed, and the viewport determining unit includes: an angle determination subunit and a position determination subunit,
the angle determining subunit is used for determining a view field angle at the acquisition time corresponding to the angular speed according to the angular speed;
the position determining subunit is used for determining the position of the viewing port matched with the angular speed according to the view field angle.
A virtual reality playback device, comprising: a processor and a memory;
wherein the processor is configured to execute a program stored in the memory;
the memory is used for storing a program, and the program is used for at least:
obtaining a record of a speed parameter of the virtual reality device in displaying the virtual reality image, wherein the record of the speed parameter comprises: the speed parameter acquired by the speed parameter sensor in the virtual reality equipment and the acquisition time corresponding to the speed parameter;
determining a view port position matched with the speed parameter according to the speed parameter;
inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to generate a virtual reality image displayed in the virtual reality equipment according to the input viewport position;
and displaying the generated virtual reality image for virtual reality playback.
A storage medium having stored therein computer executable instructions that, when loaded and executed by a processor, implement any one of the virtual reality playback methods provided by the embodiments of the present application.
The embodiment of the application provides a virtual reality playback method, a system, equipment and a storage medium, which can acquire the record of the speed parameter of virtual reality equipment in the process of displaying virtual reality images and determine the position of a viewport according to the speed parameter, so as to control a three-dimensional engine to generate a virtual reality image displayed in the virtual reality equipment according to the input viewport position, and therefore, the application can display the generated virtual reality image for virtual reality playback. Because the speed parameter used by the application for virtual reality playback is the same as the speed parameter in the process of realizing the virtual reality image of the virtual reality device, the virtual reality image realized by the application is the same as the virtual reality image realized by the virtual reality device, and the virtual reality playback is realized.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
Fig. 1 is a flowchart of a virtual reality playback method according to an embodiment of the present application;
fig. 2 is a flowchart of another virtual reality playback method according to an embodiment of the present application;
FIG. 3 is a schematic view of a viewport according to an embodiment of the application;
fig. 4 is a schematic structural diagram of a virtual reality playback system according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a virtual reality playback device according to an embodiment of the present application.
Detailed Description
The application discloses a virtual reality playback method, a system, equipment and a storage medium, and a person skilled in the art can refer to the content of the text to properly improve the implementation of technological parameters. It is expressly noted that all such similar substitutions and modifications will be apparent to those skilled in the art, and are deemed to be included in the present application. While the methods and applications of this application have been described in terms of preferred embodiments, it will be apparent to those skilled in the relevant art that variations and modifications can be made in the methods and applications described herein, and in the practice and application of the techniques of this application, without departing from the spirit or scope of the application.
As shown in fig. 1, an embodiment of the present application provides a virtual reality playback method, which may include:
s100, obtaining a record of a speed parameter of the virtual reality device in the process of displaying the virtual reality image, wherein the record of the speed parameter comprises the following steps: the speed parameter acquired by the speed parameter sensor in the virtual reality equipment and the acquisition time corresponding to the speed parameter;
the virtual reality device can be a virtual reality helmet, a mobile phone and the like, and the virtual reality technology (VirtualReality, VR) is a simulation system capable of creating and experiencing a virtual world, and generates a simulation environment by using the virtual reality device, so that the system simulation of the multi-source information fusion and interactive three-dimensional dynamic view and entity behaviors is realized, and a user is immersed in the environment.
Optionally, the method shown in fig. 1 may be applied to a virtual reality playback device, where the virtual reality playback device may be an electronic device such as a computer, a mobile phone, or a tablet computer. Further, the virtual reality playback device may also include an optical device for viewing 3D imagery (e.g., 3D glasses worn on the user's head or a wearable device with at least two lenses, etc.). Alternatively, the virtual reality playback device of the present application may be the same or a different device than the virtual reality device.
Wherein the speed parameter sensor may comprise: gyroscopes and/or accelerometers. The gyroscope is an angular motion detection device which uses a momentum moment sensitive shell of a high-speed revolving body to rotate around one or two axes orthogonal to a rotation shaft relative to an inertia space. The accelerometer can measure acceleration and gravity of the device.
Alternatively, when the speed parameter sensor comprises a gyroscope, the format of the record of the speed parameter may be:
{
time:current_time,
gyrodata:{x:x1,y:y1,z:z1}
}。
the current_time represents the acquisition time of the speed parameter, and is in units of milliseconds.
gyrodata represents the speed parameter acquired at the current_time.
Optionally, as the virtual reality device continuously displays the virtual reality image, a record of the speed parameter is continuously generated. The application can record the speed parameters of the virtual reality equipment in the process of displaying the virtual reality image for a plurality of times according to the preset time period, thereby forming records of a plurality of speed parameters.
In practical applications, step S100 may specifically include:
obtaining data to be analyzed sent by virtual reality equipment through an application program interface of the virtual reality equipment;
and analyzing the data to be analyzed to obtain a record of the speed parameter of the virtual reality equipment in the process of displaying the virtual reality image.
The virtual reality device may compress, modulate, etc. the record of the speed parameter to obtain the data to be parsed, so that the data to be parsed may be transmitted to the virtual reality playback device according to a preset communication protocol. The preset communication protocol may be: http, socke, webservice, etc. Correspondingly, after the virtual reality playback device obtains the data to be analyzed, analysis processing such as decompression and demodulation can be performed, so that the record of the speed parameter is obtained.
In practical applications, the record of the speed parameter may be directly sent to the virtual reality playback device of the present application by the virtual reality device, or may be sent to the virtual reality playback device of the present application by the virtual reality device through other devices, where the other devices may be various, such as a server, and the present application is not limited herein.
The virtual reality playback device of the present application can save the speed parameter locally after obtaining a record of it.
The virtual reality playback device of the present application may be a device such as a computer that does not have a speed parameter sensor.
S200, determining a view port position matched with the speed parameter according to the speed parameter;
the specific implementation procedure of step S200 may include:
determining a view field angle at the acquisition time corresponding to the angular speed according to the angular speed;
and determining the position of the viewing port matched with the angular speed according to the view field angle.
Fig. 3 shows a schematic view of the viewport 151, and in the process that the user views the virtual reality image through the virtual reality device 103, the image that the user sees is the display content included in the viewport 151. The viewport locations may be coordinates of the viewport 151. One XYZ coordinate system is shown in fig. 3, although other coordinate systems may be used. As the user's head moves or otherwise manipulates, the position of viewport 151 changes accordingly, resulting in a change in the image seen by the user through viewport 151.
The angle of the field of view is also called the field of view in optical engineering, and the size of the angle of the field of view determines the field of view. The angle of the field of view is shown in dashed lines in fig. 3. It will be appreciated that the field angle varies with the angle of the user's head.
S300, inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to generate a virtual reality image displayed in the virtual reality device according to the input viewport position;
the three-dimensional engine (also called 3D engine) is a collection of algorithm implementations that abstract real matters into expressions such as polygons or various curves, perform correlation calculations in a virtual reality playback device, and output a final image. The 3D engine can determine a displayed three-dimensional digital model part in the virtual reality device according to the input view port position, and generate a virtual reality image of the three-dimensional digital model part.
Therefore, the controlling the three-dimensional engine to generate the virtual reality image displayed in the virtual reality device according to the input viewport position may specifically include:
controlling the three-dimensional engine to determine a displayed three-dimensional digital model part in the virtual reality equipment according to the input view port position;
and controlling the three-dimensional engine to generate a virtual reality image of the three-dimensional digital model part.
The three-dimensional digital model is a three-dimensional model built by three-dimensional software and comprises various buildings, figures, vegetation, machinery and the like. As shown in fig. 3, by determining the position of the viewport, the virtual reality playback device of the present application can control the three-dimensional engine to determine the portion of the three-dimensional digital model that is viewed through the viewport (e.g., the portion of the three-dimensional digital model that is viewed through the viewport 151 shown in fig. 3), so that a virtual reality image of the portion of the three-dimensional digital model can be displayed.
Specifically, the virtual reality playback device of the present application may have the same virtual reality software source code as the virtual reality device, where the software source code includes: the three-dimensional digital model and the setting effect parameters, the display effect parameters and the like of the three-dimensional digital model.
And S400, displaying the generated virtual reality image to perform virtual reality playback.
It can be understood that, because the virtual reality playback device of the present application can obtain a record of a speed parameter of the virtual reality device in the process of displaying the virtual reality image, and determine a viewport position according to the speed parameter, and further control the three-dimensional engine to generate a virtual reality image displayed in the virtual reality device according to the input viewport position, the present application can display the generated virtual reality image for virtual reality playback. Because the speed parameter used by the application for virtual reality playback is the same as the speed parameter in the process of realizing the virtual reality image of the virtual reality device, the virtual reality image realized by the application is the same as the virtual reality image realized by the virtual reality device, and the virtual reality playback is realized.
As shown in fig. 2, another virtual reality playback method provided by the embodiment of the present application may further include:
s500, obtaining an image record of the virtual reality device in the process of displaying the virtual reality image, wherein the image record comprises: the method comprises the steps that part or all of virtual reality images displayed by the virtual reality equipment are displayed at display moments corresponding to the virtual reality images;
wherein the image record may be generated by screen capturing, and in practical application, the virtual reality playback device of the present application may control the virtual reality device to perform screen capturing multiple times at a certain frequency (e.g., 100 times per second).
And S600, sequentially displaying each virtual reality image in the obtained image records according to the display time so as to carry out virtual reality playback.
When the obtained image records are large, each of the virtual reality images in the obtained image records is displayed at one time according to the display time, so that an animation effect like "discharge shadow" can be realized, that is, the animation effect is realized by continuously displaying a plurality of still pictures in a short time.
The execution sequence between steps S500 and S600 and the four steps shown in fig. 1 is not limited in the present application. Preferably, step S500 and step S100 may be performed simultaneously, so that the recording of the speed parameter and the recording of the image may be transmitted together, reducing the number of transmissions. Step S600 and step S400 may be performed simultaneously, so that the virtual reality playback performed by the speed parameter and the virtual reality playback performed by the image recording may be performed simultaneously, so that the user may know the virtual reality image displayed by the virtual reality device in multiple angles.
Corresponding to the embodiment of the method, the embodiment of the application also provides a virtual reality playback system. As shown in fig. 4, the system may include: a record obtaining unit 100, a viewport determining unit 200, an image generating unit 300 and an image display unit 400,
the record obtaining unit 100 is configured to obtain a record of a speed parameter of the virtual reality device during displaying the virtual reality image, where the record of the speed parameter includes: the speed parameter acquired by the speed parameter sensor in the virtual reality equipment and the acquisition time corresponding to the speed parameter;
the viewport determining unit 200 is configured to determine a viewport position matched with the speed parameter according to the speed parameter;
the image generating unit 300 is configured to input, according to the acquisition time, a viewport position matched with the speed parameter into a three-dimensional engine, and control the three-dimensional engine to generate, according to the input viewport position, a virtual reality image displayed in the virtual reality device;
the image display unit 400 is configured to display the generated virtual reality image for virtual reality playback.
Optionally, the image generating unit 300 may include: a model determination subunit and an image generation subunit,
the model determining subunit is used for inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to determine the displayed three-dimensional digital model part in the virtual reality equipment according to the input viewport position;
the image generation subunit is used for controlling the three-dimensional engine to generate a virtual reality image of the three-dimensional digital model part.
Optionally, the speed parameter is an angular speed, and the viewport determining unit 200 may include: an angle determination subunit and a position determination subunit,
the angle determining subunit is used for determining a view field angle at the acquisition time corresponding to the angular speed according to the angular speed;
the position determining subunit is used for determining the position of the viewing port matched with the angular speed according to the view field angle.
Alternatively, the record obtaining unit 100 may include: a data acquisition sub-unit and a parsing sub-unit,
the data obtaining subunit is used for obtaining data to be analyzed sent by the virtual reality equipment through an application program interface of the virtual reality equipment;
the analysis subunit is used for analyzing the data to be analyzed to obtain a record of the speed parameter of the virtual reality equipment in the process of displaying the virtual reality image.
Optionally, the system shown in fig. 4 may further include: an image recording unit and an image playback unit,
the image recording unit is used for obtaining an image record of the virtual reality device in the process of displaying the virtual reality image, wherein the image record comprises: the method comprises the steps that part or all of virtual reality images displayed by the virtual reality equipment are displayed at display moments corresponding to the virtual reality images;
and the image playback unit is used for sequentially displaying each virtual reality image in the obtained image records according to the display time so as to carry out virtual reality playback.
The method and the device can acquire the record of the speed parameter of the virtual reality equipment in the process of displaying the virtual reality image, determine the position of the viewport according to the speed parameter, and further control the three-dimensional engine to generate the virtual reality image displayed in the virtual reality equipment according to the input viewport position, so that the generated virtual reality image can be displayed for virtual reality playback. Because the speed parameter used by the application for virtual reality playback is the same as the speed parameter in the process of realizing the virtual reality image of the virtual reality device, the virtual reality image realized by the application is the same as the virtual reality image realized by the virtual reality device, and the virtual reality playback is realized.
As shown in fig. 5, the present application further provides a virtual reality playback device 50, which may include: a processor 501 and a memory 502;
wherein the processor 501 is configured to execute a program stored in the memory 502;
the memory 502 is configured to store a program, where the program is configured to at least:
obtaining a record of a speed parameter of the virtual reality device in displaying the virtual reality image, wherein the record of the speed parameter comprises: the speed parameter acquired by the speed parameter sensor in the virtual reality equipment and the acquisition time corresponding to the speed parameter;
determining a view port position matched with the speed parameter according to the speed parameter;
inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to generate a virtual reality image displayed in the virtual reality equipment according to the input viewport position;
and displaying the generated virtual reality image for virtual reality playback.
Of course, as shown in fig. 5, the virtual reality playback device 50 may also include a bus 503, and the processor 501 and the memory 502 may communicate over the bus 503.
The application also provides a storage medium, wherein the storage medium stores computer executable instructions, and when the computer executable instructions are loaded and executed by a processor, any one of the virtual reality playback methods provided by the embodiment of the application is realized.
The above-described record obtaining unit 100, the viewport determining unit 200, the image generating unit 300, the image display unit 400, and the like are stored in the memory as program units, and the above-described program units stored in the memory are executed by the processor to realize the corresponding functions.
The processor includes a kernel, and the kernel fetches the corresponding program unit from the memory. The kernel may set one or more of the virtual reality playback by adjusting the kernel parameters.
The embodiment of the application provides a processor which is used for running a program, wherein the virtual reality playback method is executed when the program runs.
The application also provides a computer program product adapted to perform, when executed on a data processing device, a program initialized with the method steps of:
obtaining a record of a speed parameter of the virtual reality device in displaying the virtual reality image, wherein the record of the speed parameter comprises: the speed parameter acquired by the speed parameter sensor in the virtual reality equipment and the acquisition time corresponding to the speed parameter;
determining a view port position matched with the speed parameter according to the speed parameter;
inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to generate a virtual reality image displayed in the virtual reality equipment according to the input viewport position;
and displaying the generated virtual reality image for virtual reality playback.
Optionally, the controlling the three-dimensional engine to generate the virtual reality image displayed in the virtual reality device according to the input viewport position includes:
controlling the three-dimensional engine to determine a displayed three-dimensional digital model part in the virtual reality equipment according to the input view port position;
and controlling the three-dimensional engine to generate a virtual reality image of the three-dimensional digital model part.
Optionally, the speed parameter is an angular speed, and determining, according to the speed parameter, a viewport position matched with the speed parameter includes:
determining a view field angle at the acquisition time corresponding to the angular speed according to the angular speed;
and determining the position of the viewing port matched with the angular speed according to the view field angle.
Optionally, the method further comprises:
obtaining an image record of a virtual reality device in displaying a virtual reality image, wherein the image record comprises: the method comprises the steps that part or all of virtual reality images displayed by the virtual reality equipment are displayed at display moments corresponding to the virtual reality images;
and sequentially displaying each virtual reality image in the obtained image records according to the display time so as to carry out virtual reality playback.
Optionally, the obtaining the record of the speed parameter of the virtual reality device in the process of displaying the virtual reality image includes:
obtaining data to be analyzed sent by virtual reality equipment through an application program interface of the virtual reality equipment;
and analyzing the data to be analyzed to obtain a record of the speed parameter of the virtual reality equipment in the process of displaying the virtual reality image.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, the device includes one or more processors (CPUs), memory, and a bus. The device may also include input/output interfaces, network interfaces, and the like.
The memory may include volatile memory, random Access Memory (RAM), and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM), among other forms in computer readable media, the memory including at least one memory chip. Memory is an example of a computer-readable medium.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and variations of the present application will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. which come within the spirit and principles of the application are to be included in the scope of the claims of the present application.
Claims (9)
1. A virtual reality playback method, applied to a virtual reality playback device, the method comprising:
obtaining a record of a speed parameter of the virtual reality device in displaying the virtual reality image, wherein the record of the speed parameter comprises: the speed parameter acquired by the speed parameter sensor in the virtual reality equipment and the acquisition time corresponding to the speed parameter;
determining a view port position matched with the speed parameter according to the speed parameter;
inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to generate a virtual reality image displayed in the virtual reality equipment according to the input viewport position;
displaying the generated virtual reality image for virtual reality playback;
obtaining an image record of a virtual reality device in displaying a virtual reality image, wherein the image record comprises: the method comprises the steps that part or all of virtual reality images displayed by the virtual reality equipment are displayed at display moments corresponding to the virtual reality images;
and sequentially displaying each virtual reality image in the obtained image records according to the display time so as to carry out virtual reality playback.
2. The method of claim 1, wherein the controlling the three-dimensional engine to generate the virtual reality image that has been displayed in the virtual reality device from the input viewport position comprises:
controlling the three-dimensional engine to determine a displayed three-dimensional digital model part in the virtual reality equipment according to the input view port position;
and controlling the three-dimensional engine to generate a virtual reality image of the three-dimensional digital model part.
3. The method of claim 1, wherein the speed parameter is an angular speed, and wherein the determining a viewport position matching the speed parameter based on the speed parameter comprises:
determining a view field angle at the acquisition time corresponding to the angular speed according to the angular speed;
and determining the position of the viewing port matched with the angular speed according to the view field angle.
4. The method of claim 1, wherein obtaining a record of a speed parameter of the virtual reality device during display of the virtual reality image comprises:
obtaining data to be analyzed sent by virtual reality equipment through an application program interface of the virtual reality equipment;
and analyzing the data to be analyzed to obtain a record of the speed parameter of the virtual reality equipment in the process of displaying the virtual reality image.
5. A virtual reality playback system for application to a virtual reality playback device, the system comprising: a record obtaining unit, a view port determining unit, an image generating unit and an image display unit,
the record obtaining unit is configured to obtain a record of a speed parameter of the virtual reality device during displaying the virtual reality image, where the record of the speed parameter includes: the speed parameter acquired by the speed parameter sensor in the virtual reality equipment and the acquisition time corresponding to the speed parameter;
the view port determining unit is used for determining a view port position matched with the speed parameter according to the speed parameter;
the image generation unit is used for inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to generate a virtual reality image displayed in the virtual reality device according to the input viewport position;
the image display unit is used for displaying the generated virtual reality image to perform virtual reality playback.
6. The system of claim 5, wherein the image generation unit comprises: a model determination subunit and an image generation subunit,
the model determining subunit is used for inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to determine the displayed three-dimensional digital model part in the virtual reality equipment according to the input viewport position;
the image generation subunit is used for controlling the three-dimensional engine to generate a virtual reality image of the three-dimensional digital model part.
7. The system according to claim 5, wherein the speed parameter is an angular speed, and the viewport determination unit comprises: an angle determination subunit and a position determination subunit,
the angle determining subunit is used for determining a view field angle at the acquisition time corresponding to the angular speed according to the angular speed;
the position determining subunit is used for determining the position of the viewing port matched with the angular speed according to the view field angle.
8. A virtual reality playback device, comprising: a processor and a memory;
wherein the processor is configured to execute a program stored in the memory;
the memory is used for storing a program, and the program is used for at least:
obtaining a record of a speed parameter of the virtual reality device in displaying the virtual reality image, wherein the record of the speed parameter comprises: the speed parameter acquired by the speed parameter sensor in the virtual reality equipment and the acquisition time corresponding to the speed parameter;
determining a view port position matched with the speed parameter according to the speed parameter;
inputting the position of the viewport matched with the speed parameter into a three-dimensional engine according to the acquisition time, and controlling the three-dimensional engine to generate a virtual reality image displayed in the virtual reality equipment according to the input viewport position;
and displaying the generated virtual reality image for virtual reality playback.
9. A storage medium having stored therein computer executable instructions which when loaded and executed by a processor implement the virtual reality playback method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910841658.8A CN110544316B (en) | 2019-09-06 | 2019-09-06 | Virtual reality playback method, system, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910841658.8A CN110544316B (en) | 2019-09-06 | 2019-09-06 | Virtual reality playback method, system, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110544316A CN110544316A (en) | 2019-12-06 |
| CN110544316B true CN110544316B (en) | 2023-12-01 |
Family
ID=68712739
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910841658.8A Active CN110544316B (en) | 2019-09-06 | 2019-09-06 | Virtual reality playback method, system, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110544316B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111935534B (en) * | 2020-07-30 | 2022-09-27 | 视伴科技(北京)有限公司 | Method and device for playing back recorded video |
| CN115953520B (en) * | 2023-03-10 | 2023-07-14 | 浪潮电子信息产业股份有限公司 | Recording and playback method and device for virtual scene, electronic equipment and medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106687886A (en) * | 2014-07-25 | 2017-05-17 | 微软技术许可有限责任公司 | Three-dimensional mixed-reality viewport |
| WO2019141903A1 (en) * | 2018-01-17 | 2019-07-25 | Nokia Technologies Oy | Providing virtual content based on user context |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7022077B2 (en) * | 2016-05-25 | 2022-02-17 | コニンクリーケ・ケイピーエヌ・ナムローゼ・フェンノートシャップ | Spatial tiling omnidirectional video streaming |
| GB2570708A (en) * | 2018-02-05 | 2019-08-07 | Nokia Technologies Oy | Switching between multidirectional and limited viewport video content |
-
2019
- 2019-09-06 CN CN201910841658.8A patent/CN110544316B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106687886A (en) * | 2014-07-25 | 2017-05-17 | 微软技术许可有限责任公司 | Three-dimensional mixed-reality viewport |
| WO2019141903A1 (en) * | 2018-01-17 | 2019-07-25 | Nokia Technologies Oy | Providing virtual content based on user context |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110544316A (en) | 2019-12-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3051525B1 (en) | Display | |
| US10726625B2 (en) | Method and system for improving the transmission and processing of data regarding a multi-user virtual environment | |
| JP7008730B2 (en) | Shadow generation for image content inserted into an image | |
| CN107636534A (en) | General sphere catching method | |
| IL242810A (en) | Perception based predictive tracking for head mounted displays | |
| CN107479712B (en) | Information processing method and device based on head-mounted display equipment | |
| CN110544316B (en) | Virtual reality playback method, system, equipment and storage medium | |
| CN110568923A (en) | unity 3D-based virtual reality interaction method, device, equipment and storage medium | |
| US20180169517A1 (en) | Reactive animation for virtual reality | |
| CN112114667A (en) | AR display method and system based on binocular camera and VR equipment | |
| CN113965773A (en) | Live broadcast display method and device, storage medium and electronic equipment | |
| US10582190B2 (en) | Virtual training system | |
| US20190295324A1 (en) | Optimized content sharing interaction using a mixed reality environment | |
| CN109218252A (en) | A kind of display methods of virtual reality, device and its equipment | |
| CN112085853A (en) | AR display method and system based on camera and VR equipment | |
| CN107038746B (en) | Information processing method and electronic equipment | |
| KR101741149B1 (en) | Method and device for controlling a virtual camera's orientation | |
| CN116212361B (en) | Virtual object display method and device and head-mounted display device | |
| US20240149159A1 (en) | Capturing computer game output mid-render for 2d to 3d conversion, accessibility, and other effects | |
| US11946744B2 (en) | Synchronization of a gyroscope in a virtual-reality environment | |
| WO2023140004A1 (en) | Information processing device and information processing method | |
| CN117991891A (en) | Interaction method, device, head-mounted equipment, interaction system and storage medium | |
| CN111679806A (en) | Play control method and device, electronic equipment and storage medium | |
| CN117152385A (en) | Image processing method, device, electronic equipment and storage medium | |
| CN117899456A (en) | Display processing method, device, equipment and medium of two-dimensional assembly |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |