CN113209604A - Large-view VR rendering method and system - Google Patents
Large-view VR rendering method and system Download PDFInfo
- Publication number
- CN113209604A CN113209604A CN202110470226.8A CN202110470226A CN113209604A CN 113209604 A CN113209604 A CN 113209604A CN 202110470226 A CN202110470226 A CN 202110470226A CN 113209604 A CN113209604 A CN 113209604A
- Authority
- CN
- China
- Prior art keywords
- picture
- frame
- current frame
- generate
- angle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
- A63F2300/8082—Virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
The application relates to a method and a system for large-view VR rendering, wherein the method comprises the following steps: the picture set displayed by the VR head display unit is formed by the crossed arrangement of the preset frame picture and the non-preset frame picture; and under the condition that the current frame picture is judged to be the preset frame picture, setting a first rendering parameter to render the current frame picture to generate a first picture, transmitting the first picture to the VR head display unit for display, under the condition that the current frame picture is judged to be the non-preset frame picture, setting a second rendering parameter to render the current frame picture to generate a second picture, processing the first picture generated by the previous frame and the second picture generated by the current frame, generating a third picture, and transmitting the third picture to the VR head display unit for display. Through the method and the device, the problem that the VR content rendering is low in efficiency is solved, and the efficient rendering of the VR content independent of a specific GPU is realized.
Description
Technical Field
The present application relates to the field of virtual reality, and in particular, to a method and system for large-view VR rendering.
Background
With the rapid development of Virtual Reality technology (Virtual Reality), various VR software and VR games are issued by various software game manufacturers, and VR devices corresponding to the VR software and VR games are also layered endlessly, wherein VR software and VR head display units supporting large field angles can significantly improve VR immersion experience, but at the same time, there are problems that VR content rendering speed can be reduced, and hardware requirements and cost for VR devices are increased.
At present, no effective solution is provided for the problem of low efficiency of VR content rendering in the related technology.
Disclosure of Invention
The embodiment of the application provides a large-view VR rendering method and system, which are used for at least solving the problem of low efficiency of VR content rendering in the related art.
In a first aspect, an embodiment of the present application provides a method for large-view VR rendering, where the method includes:
the frame set displayed by the VR head display unit comprises a preset frame and a non-preset frame, wherein the frame set is formed by the crossed arrangement of the preset frame and the non-preset frame;
under the condition that the current frame picture is judged to be the preset frame picture, setting a first rendering parameter to render the current frame picture to generate a first picture, and transmitting the first picture to the VR head display unit for displaying;
and under the condition that the current frame picture is judged to be the non-preset frame picture, setting a second rendering parameter to render the current frame picture to generate a second picture, processing the first picture generated by the previous frame and the second picture generated by the current frame to generate a third picture, and transmitting the third picture to the VR head display unit for displaying.
In some embodiments, when it is determined that a current frame picture is the preset frame picture, setting a first rendering parameter to render the current frame picture to generate a first picture, and transmitting the first picture to the VR head display unit for displaying includes:
and under the condition that the current frame picture is judged to be an even frame picture, setting a large-field-angle rendering parameter to render the current frame picture to generate a large-field-angle picture, and transmitting the large-field-angle picture to the VR head display unit for displaying.
In some embodiments, when it is determined that a current frame picture is the non-preset frame picture, setting a second rendering parameter to render the current frame picture to generate a second picture, processing the first picture generated by a previous frame and the second picture generated by the current frame to generate a third picture, and transmitting the third picture to the VR head display unit for display includes:
and under the condition that the current frame picture is judged to be an odd frame picture, setting a small-field-angle rendering parameter to render the current frame picture to generate a small-field-angle picture, processing a large-field-angle picture generated by a previous frame and the small-field-angle picture generated by the current frame to generate a combined picture, and transmitting the combined picture to the VR head display unit for display.
In some embodiments, processing the large field angle picture generated in the previous frame and the small field angle picture generated in the current frame, and generating the combined picture includes:
and comparing the large-field-angle picture generated in the previous frame with the small-field-angle picture generated in the current frame to obtain a missing picture of the small-field-angle picture, and filling the small-field-angle picture according to the missing picture to generate a large-field-angle filling picture.
In some embodiments, when the current frame picture is determined to be the preset frame picture, setting a first rendering parameter to render the current frame picture to generate a first picture; under the condition that the current frame picture is judged to be the non-preset frame picture, setting a second rendering parameter to render the current frame picture to generate a second picture comprises the following steps:
under the condition that the current frame picture is judged to be the preset frame picture, obtaining rendering parameters of the VR head display unit, generating a projection matrix according to the rendering parameters, and setting first rendering parameters according to the projection matrix to render the current frame picture to generate a first picture;
and under the condition that the current frame picture is judged to be the non-preset frame picture, obtaining rendering parameters of the VR head display unit, generating a projection matrix according to the rendering parameters, and setting second rendering parameters according to the projection matrix to render the current frame picture to generate a second picture.
In a second aspect, an embodiment of the present application provides a system for large-view VR rendering, where the system includes a processing unit and a VR head display unit;
the picture set displayed by the VR head display unit comprises a preset frame picture and a non-preset frame picture, wherein the picture set is formed by the crossed arrangement of the preset frame picture and the non-preset frame picture;
the processing unit sets a first rendering parameter to render the current frame picture to generate a first picture under the condition that the current frame picture is judged to be the preset frame picture, and transmits the first picture to the VR head display unit for displaying;
and the processing unit sets a second rendering parameter to render the current frame picture to generate a second picture under the condition that the current frame picture is judged to be the non-preset frame picture, processes the first picture generated by the previous frame and the second picture generated by the current frame to generate a third picture, and transmits the third picture to the VR head display unit for display.
In some embodiments, when determining that a current frame picture is the preset frame picture, the processing unit sets a first rendering parameter to render the current frame picture to generate a first picture, and transmits the first picture to the VR head display unit for display includes:
the processing unit sets a large-field-angle rendering parameter to render the current frame picture to generate a large-field-angle picture under the condition that the current frame picture is judged to be an even frame picture, and transmits the large-field-angle picture to the VR head display unit for displaying.
In some embodiments, when determining that a current frame picture is the non-preset frame picture, the processing unit sets a second rendering parameter to render the current frame picture to generate a second picture, processes the first picture generated by a previous frame and the second picture generated by the current frame to generate a third picture, and transmits the third picture to the VR head display unit for display, where the step of rendering the current frame picture includes:
the processing unit sets a small-field-angle rendering parameter to render the current frame picture to generate a small-field-angle picture under the condition that the current frame picture is judged to be an odd frame picture, processes a large-field-angle picture generated by a previous frame and the small-field-angle picture generated by the current frame to generate a combined picture, and transmits the combined picture to the VR head display unit for display.
In some embodiments, the processing unit processes the large field angle picture generated in the previous frame and the small field angle picture generated in the current frame, and generating the combined picture includes:
the processing unit compares a large-field-angle picture generated by a previous frame with a small-field-angle picture generated by a current frame to obtain a missing picture of the small-field-angle picture, and fills the small-field-angle picture according to the missing picture to generate a large-field-angle filling picture.
In some embodiments, the processing unit sets a first rendering parameter to render the current frame picture to generate a first picture when determining that the current frame picture is the preset frame picture; the processing unit sets a second rendering parameter to render the current frame picture to generate a second picture when the current frame picture is judged to be the non-preset frame picture, and the step of:
the processing unit acquires rendering parameters of the VR head display unit under the condition that the current frame picture is judged to be the preset frame picture, generates a projection matrix according to the rendering parameters, and sets first rendering parameters according to the projection matrix to render the current frame picture to generate a first picture;
the processing unit acquires rendering parameters of the VR head display unit under the condition that the current frame picture is judged to be the non-preset frame picture, generates a projection matrix according to the rendering parameters, and sets second rendering parameters according to the projection matrix to render the current frame picture to generate a second picture.
Compared with the related art, in the method and the system for large-view-angle VR rendering provided by the embodiment of the present application, a frame set displayed by a VR head display unit includes a preset frame and a non-preset frame, where the frame set is formed by cross arrangement of the preset frame and the non-preset frame; the method comprises the steps of setting a first rendering parameter to render a current frame picture to generate a first picture by judging the current frame picture to be under the condition of a preset frame picture, transmitting the first picture to a VR head display unit for display, setting a second rendering parameter to render the current frame picture to generate a second picture by judging the current frame picture to be under the condition of a non-preset frame picture, processing the first picture generated by a previous frame and the second picture generated by the current frame, generating a third picture and transmitting the third picture to the VR head display unit for display, solving the problem of low efficiency in VR content rendering, and realizing efficient rendering of VR content which is not dependent on a specific GPU.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a flowchart illustrating a VR rendering method according to the related art;
FIG. 2 is a block diagram of a large-view VR rendering system in accordance with an embodiment of the application;
fig. 3 is a flowchart of steps of a large-view VR rendering method according to an embodiment of the application;
fig. 4 is a flowchart illustrating a large-view VR rendering method according to an embodiment of the present application.
Description of the drawings: 20. a processing unit; 21. a VR head display unit.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application.
It is obvious that the drawings in the following description are only examples or embodiments of the present application, and that it is also possible for a person skilled in the art to apply the present application to other similar contexts on the basis of these drawings without inventive effort. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of ordinary skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms referred to herein shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar words throughout this application are not to be construed as limiting in number, and may refer to the singular or the plural. The present application is directed to the use of the terms "including," "comprising," "having," and any variations thereof, which are intended to cover non-exclusive inclusions; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or elements, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Reference to "connected," "coupled," and the like in this application is not intended to be limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The term "plurality" as referred to herein means two or more. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. Reference herein to the terms "first," "second," "third," and the like, are merely to distinguish similar objects and do not denote a particular ordering for the objects.
In the related art, fig. 1 is a schematic flow diagram of a VR rendering method in the related art, and as shown in fig. 1, a general VR content rendering usually sets a fixed field angle parameter for rendering, and specifically includes the following steps:
step 1, obtaining rendering parameters such as a field angle of VR head display equipment;
step 2, setting appropriate rendering parameters (a projection matrix, rendering resolution and the like) by referring to the rendering parameters such as the field angle and the like;
step 3, rendering the current frame picture to generate a VR picture, and transmitting the VR picture to VR head display equipment for display;
and 4, waiting for finishing the display of the VR head display equipment, and continuously executing the step 3.
As can be seen from steps 1 to 4 in the related art, rendering of VR content is performed by setting a fixed field angle parameter, and in order to improve VR immersive experience, the VR immersive experience can be improved by increasing the field angle of VR head display equipment, but increasing the field angle and setting the fixed field angle parameter to render VR content will inevitably reduce the VR content rendering speed, and improve the requirements and cost for VR hardware; although the current industry mainly reduces the quality of the picture edge to improve the rendering speed through the point-of-regard rendering technology, the point-of-regard rendering technology can be realized only by the support of a graphics card (GPU) specific technology, so that the problem of low efficiency exists in the aspect of VR content rendering when the immersive experience of VR is to be improved in the related technology.
An embodiment of the present application provides a large-view VR rendering system, and fig. 2 is a block diagram of a structure of the large-view VR rendering system according to the embodiment of the present application, and as shown in fig. 2, the system includes a processing unit 20 and a VR head display unit 21;
the picture set displayed by the VR head display unit 21 includes a preset frame picture and a non-preset frame picture, wherein the picture set is formed by alternately arranging the preset frame picture and the non-preset frame picture;
the processing unit 20 sets a first rendering parameter to render the current frame picture to generate a first picture under the condition that the current frame picture is judged to be the preset frame picture, and transmits the first picture to the VR head display unit 21 for displaying;
the processing unit 20 sets a second rendering parameter to render the current frame picture to generate a second picture, processes the first picture generated by the previous frame and the second picture generated by the current frame to generate a third picture, and transmits the third picture to the VR head display unit 21 for displaying, when the current frame picture is determined to be the non-preset frame picture.
According to the embodiment of the application, the picture set displayed by the VR head display unit 21 includes a preset frame picture and a non-preset frame picture, wherein the picture set is formed by the preset frame picture and the non-preset frame picture in a crossed arrangement; the processing unit 20 sets a first rendering parameter to render the current frame picture to generate a first picture and transmits the first picture to the VR head display unit 21 to display under the condition that the current frame picture is judged to be the preset frame picture, and the processing unit 20 sets a second rendering parameter to render the current frame picture to generate a second picture under the condition that the current frame picture is judged to be the non-preset frame picture, processes the first picture generated by the previous frame and the second picture generated by the current frame, generates a third picture and transmits the third picture to the VR head display unit 21 to display, so that the problem of low efficiency in VR content rendering is solved, and efficient rendering of VR content which is not dependent on a specific GPU is realized.
In some embodiments, when determining that the current frame picture is the preset frame picture, the processing unit 20 sets a first rendering parameter to render the current frame picture to generate a first picture, and transmitting the first picture to the VR head display unit 21 for display includes:
when the current frame picture is judged to be an even frame picture, the processing unit 20 sets a large-field-angle rendering parameter to render the current frame picture to generate a large-field-angle picture, and transmits the large-field-angle picture to the VR head display unit 21 for displaying.
In some embodiments, when determining that the current frame picture is a non-preset frame picture, the processing unit 20 sets a second rendering parameter to render the current frame picture to generate a second picture, processes the first picture generated by the previous frame and the second picture generated by the current frame to generate a third picture, and transmits the third picture to the VR head display unit 21 for display, where the second rendering parameter includes:
when the current frame picture is judged to be an odd frame picture, the processing unit 20 sets a small-field-angle rendering parameter to render the current frame picture to generate a small-field-angle picture, processes the large-field-angle picture generated by the previous frame and the small-field-angle picture generated by the current frame to generate a combined picture, and transmits the combined picture to the VR head display unit 21 for display.
In some of these embodiments, the processing unit 20 processes the large field angle picture generated by the previous frame and the small field angle picture generated by the current frame, and generating the combined picture includes:
the processing unit 20 compares the large-field-angle picture generated by the previous frame with the small-field-angle picture generated by the current frame to obtain a missing picture of the small-field-angle picture, and fills the small-field-angle picture according to the missing picture to generate a large-field-angle filling picture;
it should be noted that, in this embodiment, it is not emphasized that a specific filling strategy is used, and optionally, a partial image in which a large-field-angle image of a previous frame is more than a small-field-angle image of a current frame is used, the small-field-angle image of the current frame is filled (directly copied), and then smoothing processing is performed at a seam of the image, where the partial image in which the large-field-angle image is more than the small-field-angle image can be obtained by calculating coordinates of the more partial image through a rendering parameter of the large-field-angle image and a rendering parameter of the small field angle.
In some embodiments, the processing unit 20 sets a first rendering parameter to render the current frame picture to generate a first picture when determining that the current frame picture is the preset frame picture; when the processing unit 20 determines that the current frame picture is a non-preset frame picture, setting a second rendering parameter to render the current frame picture to generate a second picture includes:
the processing unit 20 obtains rendering parameters of the VR head display unit 21 when determining that the current frame picture is the preset frame picture, generates a projection matrix according to the rendering parameters, and sets first rendering parameters according to the projection matrix to render the current frame picture to generate a first picture;
the processing unit 20 obtains the rendering parameters of the VR head display unit 21 when determining that the current frame picture is a non-preset frame picture, generates a projection matrix according to the rendering parameters, and sets a second rendering parameter according to the projection matrix to render the current frame picture to generate a second picture.
An embodiment of the present application provides a large-view VR rendering method, and fig. 3 is a flowchart illustrating steps of the large-view VR rendering method according to the embodiment of the present application, and as shown in fig. 3, the method includes the following steps:
s302, a picture set displayed by the VR head display unit 21 includes a preset frame picture and a non-preset frame picture, where the picture set is formed by alternately arranging the preset frame picture and the non-preset frame picture, and when it is determined that the current frame picture is the preset frame picture, a first rendering parameter is set to render the current frame picture to generate a first picture;
s304, transmitting the first picture to the VR head display unit 21 for displaying;
s306, under the condition that the current frame picture is judged to be the non-preset frame picture, setting a second rendering parameter to render the current frame picture to generate a second picture;
s308, processing the first picture generated by the previous frame and the second picture generated by the current frame to generate a third picture, and transmitting the third picture to the VR head display unit 21 for displaying.
Through steps S302 to S308 in this embodiment, a picture set displayed by the VR head display unit 21 includes a preset frame picture and a non-preset frame picture, where the picture set is formed by cross arrangement of the preset frame picture and the non-preset frame picture, when it is determined that a current frame picture is the preset frame picture, a first rendering parameter is set to render the current frame picture to generate a first picture, and the first picture is transmitted to the VR head display unit 21 for display, when it is determined that the current frame picture is the non-preset frame picture, a second rendering parameter is set to render the current frame picture to generate a second picture, the first picture generated by a previous frame and the second picture generated by the current frame are processed, a third picture is generated, and the third picture is transmitted to the VR head display unit 21 for display; rendering the preset frame picture into a first picture, rendering the non-preset frame picture into a second picture, and processing the first picture and the second picture of two adjacent frames to obtain a third picture, so that the problem of low efficiency in VR content rendering is solved, and the high-efficiency rendering of VR content independent of a specific GPU is realized.
In some embodiments, when the current frame picture is determined to be the preset frame picture, setting a first rendering parameter to render the current frame picture to generate a first picture, and transmitting the first picture to the VR head display unit 21 for displaying includes:
and under the condition that the current frame picture is judged to be an even frame picture, setting a large-field-angle rendering parameter to render the current frame picture to generate a large-field-angle picture, and transmitting the large-field-angle picture to the VR head display unit 21 for display.
In some embodiments, when it is determined that the current frame picture is a non-preset frame picture, setting a second rendering parameter to render the current frame picture to generate a second picture, processing the first picture generated by the previous frame and the second picture generated by the current frame to generate a third picture, and transmitting the third picture to the VR head display unit 21 for display includes:
and under the condition that the current frame picture is judged to be an odd frame picture, setting a small-field-angle rendering parameter to render the current frame picture to generate a small-field-angle picture, processing a large-field-angle picture generated by a previous frame and a small-field-angle picture generated by the current frame to generate a combined picture, and transmitting the combined picture to the VR head display unit 21 for display.
In some embodiments, processing the large field angle picture generated in the previous frame and the small field angle picture generated in the current frame, and generating the combined picture includes:
and comparing the large-field-angle picture generated in the previous frame with the small-field-angle picture generated in the current frame to obtain a missing picture of the small-field-angle picture, and filling the small-field-angle picture according to the missing picture to generate a large-field-angle filling picture.
In some embodiments, under the condition that the current frame picture is judged to be the preset frame picture, setting a first rendering parameter to render the current frame picture to generate a first picture; under the condition that the current frame picture is judged to be the non-preset frame picture, setting a second rendering parameter to render the current frame picture to generate a second picture comprises the following steps:
under the condition that the current frame picture is judged to be the preset frame picture, the rendering parameters of the VR head display unit 21 are obtained, a projection matrix is generated according to the rendering parameters, and a first rendering parameter is set according to the projection matrix to render the current frame picture to generate a first picture;
and under the condition that the current frame picture is judged to be the non-preset frame picture, obtaining rendering parameters of the VR head display unit 21, generating a projection matrix according to the rendering parameters, and setting second rendering parameters according to the projection matrix to render the current frame picture to generate a second picture.
A method for rendering a large-view VR is provided in a specific embodiment of the present application, and fig. 4 is a schematic flow diagram of the large-view VR rendering method according to the specific embodiment of the present application, and as shown in fig. 4, the method includes the following steps:
step 1, determining a current frame picture to be displayed of the VR head display unit 21:
executing step 2 under the condition that the current frame picture is judged to be an even frame picture; and 3, executing the step under the condition that the current frame picture is judged to be the odd frame picture.
Step 2, rendering the current frame as an even frame with a large field angle:
acquiring rendering parameters such as the angle of view of the VR head display unit 21, generating a projection matrix according to the large angle of view, setting the large angle of view rendering parameters to render the current frame picture to generate a large angle of view picture, and executing step 5.
Step 3, rendering the current frame as an odd frame at a small field angle:
acquiring rendering parameters such as the field angle of the VR head display unit 21, generating a projection matrix according to the small field angle, setting the small field angle rendering parameters to render the current frame picture to generate a small field angle picture, and executing the step 4.
Step 4, missing picture filling is carried out on the small field angle picture:
and (5) comparing the large-field-angle picture generated in the previous frame with the small-field-angle picture generated in the current frame to obtain a missing picture of the small-field-angle picture, filling the small-field-angle picture according to the missing picture to generate a large-field-angle filling picture, and executing the step.
And 5, transmitting the rendered VR picture to the VR head display unit 21 for display, and continuously executing the step 1.
Through steps 1 to 5 in the embodiment of the present application, field angle rendering parameters of different sizes are set for an even frame picture and an odd frame picture, then missing picture filling is performed on a small field angle rendered picture through a large field angle rendered picture, and the small field angle picture is processed to generate a large field angle picture, so that the problem of low efficiency in large field angle VR content rendering is solved, and efficient rendering of large field angle VR content rendered by setting a dynamic field angle is realized without depending on a specific technology of a specific GPU.
It should be understood by those skilled in the art that various features of the above-described embodiments can be combined in any combination, and for the sake of brevity, all possible combinations of features in the above-described embodiments are not described in detail, but rather, all combinations of features which are not inconsistent with each other should be construed as being within the scope of the present disclosure.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A method of large-view VR rendering, the method comprising:
the frame set displayed by the VR head display unit comprises a preset frame and a non-preset frame, wherein the frame set is formed by the crossed arrangement of the preset frame and the non-preset frame;
under the condition that the current frame picture is judged to be the preset frame picture, setting a first rendering parameter to render the current frame picture to generate a first picture, and transmitting the first picture to the VR head display unit for displaying;
and under the condition that the current frame picture is judged to be the non-preset frame picture, setting a second rendering parameter to render the current frame picture to generate a second picture, processing the first picture generated by the previous frame and the second picture generated by the current frame to generate a third picture, and transmitting the third picture to the VR head display unit for displaying.
2. The method of claim 1, wherein in a case that a current frame is determined to be the preset frame, setting a first rendering parameter to render the current frame to generate a first frame, and transmitting the first frame to the VR head display unit for displaying comprises:
and under the condition that the current frame picture is judged to be an even frame picture, setting a large-field-angle rendering parameter to render the current frame picture to generate a large-field-angle picture, and transmitting the large-field-angle picture to the VR head display unit for displaying.
3. The method of claim 1, wherein in a case that a current frame is determined to be the non-preset frame, setting a second rendering parameter to render the current frame to generate a second frame, processing the first frame generated from a previous frame and the second frame generated from the current frame to generate a third frame, and transmitting the third frame to the VR head display unit for displaying comprises:
and under the condition that the current frame picture is judged to be an odd frame picture, setting a small-field-angle rendering parameter to render the current frame picture to generate a small-field-angle picture, processing a large-field-angle picture generated by a previous frame and the small-field-angle picture generated by the current frame to generate a combined picture, and transmitting the combined picture to the VR head display unit for display.
4. The method of claim 3, wherein processing the large field angle picture generated in the previous frame and the small field angle picture generated in the current frame, and wherein generating a combined picture comprises:
and comparing the large-field-angle picture generated in the previous frame with the small-field-angle picture generated in the current frame to obtain a missing picture of the small-field-angle picture, and filling the small-field-angle picture according to the missing picture to generate a large-field-angle filling picture.
5. The method according to claim 1, wherein when the current frame is determined to be the preset frame, a first rendering parameter is set to render the current frame to generate a first picture; under the condition that the current frame picture is judged to be the non-preset frame picture, setting a second rendering parameter to render the current frame picture to generate a second picture comprises the following steps:
under the condition that the current frame picture is judged to be the preset frame picture, obtaining rendering parameters of the VR head display unit, generating a projection matrix according to the rendering parameters, and setting first rendering parameters according to the projection matrix to render the current frame picture to generate a first picture;
and under the condition that the current frame picture is judged to be the non-preset frame picture, obtaining rendering parameters of the VR head display unit, generating a projection matrix according to the rendering parameters, and setting second rendering parameters according to the projection matrix to render the current frame picture to generate a second picture.
6. A system for large-view VR rendering, the system comprising a processing unit and a VR head display unit;
the picture set displayed by the VR head display unit comprises a preset frame picture and a non-preset frame picture, wherein the picture set is formed by the crossed arrangement of the preset frame picture and the non-preset frame picture;
the processing unit sets a first rendering parameter to render the current frame picture to generate a first picture under the condition that the current frame picture is judged to be the preset frame picture, and transmits the first picture to the VR head display unit for displaying;
and the processing unit sets a second rendering parameter to render the current frame picture to generate a second picture under the condition that the current frame picture is judged to be the non-preset frame picture, processes the first picture generated by the previous frame and the second picture generated by the current frame to generate a third picture, and transmits the third picture to the VR head display unit for display.
7. The system of claim 6, wherein the processing unit, when determining that a current frame is the preset frame, sets a first rendering parameter to render the current frame to generate a first frame, and transmits the first frame to the VR head display unit for display, includes:
the processing unit sets a large-field-angle rendering parameter to render the current frame picture to generate a large-field-angle picture under the condition that the current frame picture is judged to be an even frame picture, and transmits the large-field-angle picture to the VR head display unit for displaying.
8. The system of claim 6, wherein the processing unit, when determining that a current frame is the non-preset frame, sets a second rendering parameter to render the current frame to generate a second frame, processes the first frame generated from a previous frame and the second frame generated from the current frame to generate a third frame, and transmits the third frame to the VR head display unit for display, and the processing unit further comprises:
the processing unit sets a small-field-angle rendering parameter to render the current frame picture to generate a small-field-angle picture under the condition that the current frame picture is judged to be an odd frame picture, processes a large-field-angle picture generated by a previous frame and the small-field-angle picture generated by the current frame to generate a combined picture, and transmits the combined picture to the VR head display unit for display.
9. The system of claim 8, wherein the processing unit processes the large field angle picture generated by the previous frame and the small field angle picture generated by the current frame, and wherein generating the combined picture comprises:
the processing unit compares a large-field-angle picture generated by a previous frame with a small-field-angle picture generated by a current frame to obtain a missing picture of the small-field-angle picture, and fills the small-field-angle picture according to the missing picture to generate a large-field-angle filling picture.
10. The system according to claim 6, wherein the processing unit sets a first rendering parameter to render the current frame picture to generate a first picture when the current frame picture is determined to be the preset frame picture; the processing unit sets a second rendering parameter to render the current frame picture to generate a second picture when the current frame picture is judged to be the non-preset frame picture, and the step of:
the processing unit acquires rendering parameters of the VR head display unit under the condition that the current frame picture is judged to be the preset frame picture, generates a projection matrix according to the rendering parameters, and sets first rendering parameters according to the projection matrix to render the current frame picture to generate a first picture;
the processing unit acquires rendering parameters of the VR head display unit under the condition that the current frame picture is judged to be the non-preset frame picture, generates a projection matrix according to the rendering parameters, and sets second rendering parameters according to the projection matrix to render the current frame picture to generate a second picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110470226.8A CN113209604A (en) | 2021-04-28 | 2021-04-28 | Large-view VR rendering method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110470226.8A CN113209604A (en) | 2021-04-28 | 2021-04-28 | Large-view VR rendering method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113209604A true CN113209604A (en) | 2021-08-06 |
Family
ID=77089866
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110470226.8A Pending CN113209604A (en) | 2021-04-28 | 2021-04-28 | Large-view VR rendering method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113209604A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105468353A (en) * | 2015-11-06 | 2016-04-06 | 网易（杭州）网络有限公司 | Implementation method and apparatus for interface animation, mobile terminal, and computer terminal |
| CN106412669A (en) * | 2016-09-13 | 2017-02-15 | 微鲸科技有限公司 | Method and device for rendering panoramic video |
| EP3236306A1 (en) * | 2016-04-20 | 2017-10-25 | Hexkraft GmbH | A method for rendering a 3d virtual reality and a virtual reality equipment for implementing the method |
| CN109727305A (en) * | 2019-01-02 | 2019-05-07 | 京东方科技集团股份有限公司 | Virtual reality system picture processing method, device and storage medium |
| CN109741289A (en) * | 2019-01-25 | 2019-05-10 | 京东方科技集团股份有限公司 | Image fusion method and VR equipment |
| CN110488977A (en) * | 2019-08-21 | 2019-11-22 | 京东方科技集团股份有限公司 | Virtual reality display methods, device, system and storage medium |
| CN110930307A (en) * | 2019-10-31 | 2020-03-27 | 北京视博云科技有限公司 | Image processing method and device |
| US20200183166A1 (en) * | 2017-08-14 | 2020-06-11 | Goertek Inc. | Graphics rendering method and apparatus of virtual reality |
| CN112494932A (en) * | 2020-11-27 | 2021-03-16 | 努比亚技术有限公司 | Game frame supplementing method and device, terminal and computer readable storage medium |
-
2021
- 2021-04-28 CN CN202110470226.8A patent/CN113209604A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105468353A (en) * | 2015-11-06 | 2016-04-06 | 网易（杭州）网络有限公司 | Implementation method and apparatus for interface animation, mobile terminal, and computer terminal |
| EP3236306A1 (en) * | 2016-04-20 | 2017-10-25 | Hexkraft GmbH | A method for rendering a 3d virtual reality and a virtual reality equipment for implementing the method |
| CN106412669A (en) * | 2016-09-13 | 2017-02-15 | 微鲸科技有限公司 | Method and device for rendering panoramic video |
| US20200183166A1 (en) * | 2017-08-14 | 2020-06-11 | Goertek Inc. | Graphics rendering method and apparatus of virtual reality |
| CN109727305A (en) * | 2019-01-02 | 2019-05-07 | 京东方科技集团股份有限公司 | Virtual reality system picture processing method, device and storage medium |
| CN109741289A (en) * | 2019-01-25 | 2019-05-10 | 京东方科技集团股份有限公司 | Image fusion method and VR equipment |
| CN110488977A (en) * | 2019-08-21 | 2019-11-22 | 京东方科技集团股份有限公司 | Virtual reality display methods, device, system and storage medium |
| CN110930307A (en) * | 2019-10-31 | 2020-03-27 | 北京视博云科技有限公司 | Image processing method and device |
| CN112494932A (en) * | 2020-11-27 | 2021-03-16 | 努比亚技术有限公司 | Game frame supplementing method and device, terminal and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109992226A (en) | Image display method and device and spliced display screen | |
| CN108287678B (en) | Image processing method, device, equipment and medium based on virtual reality | |
| US9824429B2 (en) | Image processing apparatus and method, and program | |
| CN111064863B (en) | Image data processing method and related device | |
| CN116389831B (en) | Yun Yuansheng-based offline rendering system and method | |
| CN107027068A (en) | Rendering intent, coding/decoding method, the method and device for playing multimedia data stream | |
| CN113206993A (en) | Method for adjusting display screen and display device | |
| CN111161685A (en) | Virtual reality display equipment and control method thereof | |
| CN109242761B (en) | Picture display method and device | |
| CN113209604A (en) | Large-view VR rendering method and system | |
| EP1408453A1 (en) | Rendering method | |
| CN112184538B (en) | Image acceleration method, related device, equipment and storage medium | |
| CN106407009A (en) | Picture display method and device | |
| CN106331764A (en) | Panoramic video sharing method and panoramic video sharing device | |
| CN111028180B (en) | Image processing method, video processing method and corresponding devices | |
| CN110941413B (en) | Display screen generation method and related device | |
| US6833841B2 (en) | Image forming method, computer program for forming image, and image forming apparatus | |
| CN113223183B (en) | Rendering method and system based on existing VR content | |
| CN108171671A (en) | One kind puts ox-eyed U.S. type method and device | |
| CN107396030A (en) | A kind of processing method of video calling and scheduling controlling end | |
| CN110858389B (en) | Method, device, terminal and transcoding equipment for enhancing video image quality | |
| CN109302617B (en) | Multi-element-designated video microphone connecting method, device, equipment and storage medium | |
| CN110288652A (en) | Image processing method and equipment | |
| CN112245902A (en) | Switching method and device of terminal equipment | |
| CN109741465A (en) | Image processing method and device, display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210806 |