CN106873929B - Image refreshing method and device based on virtual reality technology - Google Patents
Image refreshing method and device based on virtual reality technology Download PDFInfo
- Publication number
- CN106873929B CN106873929B CN201611178744.8A CN201611178744A CN106873929B CN 106873929 B CN106873929 B CN 106873929B CN 201611178744 A CN201611178744 A CN 201611178744A CN 106873929 B CN106873929 B CN 106873929B
- Authority
- CN
- China
- Prior art keywords
- area
- display screen
- refreshing
- image data
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1415—Digital output to display device ; Cooperation and interconnection of the display device with other functional units with means for detecting differences between the image stored in the host and the images displayed on the displays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
The invention discloses an image refreshing method and device based on a virtual reality technology, wherein the method comprises the following steps: when the position state of the terminal equipment changes, determining a first area and a second area on a display screen according to the position state change information; and refreshing the image of the first area by using the old image data displayed on the display screen in the previous position state, and acquiring new image data according to the position state change information to refresh the image of the second area. Therefore, when the position state of the terminal equipment changes, the first area of the display screen without the change of the image content is determined on the display screen, and the image refreshing is directly carried out by using the old image data aiming at the first area, so that the processes of recalculating, acquiring new image data and transmitting data are omitted, the calculated amount and the transmission amount are greatly reduced, the image refreshing speed is improved, the time of a user waiting for refreshing the picture is shortened, the reality sense of the picture is enhanced, and the dizzy sense is reduced or eliminated.
Description
Technical Field
The invention relates to the technical field of virtual reality, in particular to an image refreshing method and device based on a virtual reality technology.
Background
Virtual Reality (VR) technology is a computer simulation system that can create and experience a Virtual world, which uses a computer to create a simulated environment, which is a systematic simulation of interactive three-dimensional dynamic views and physical behaviors with multi-source information fusion, and immerses users in the environment. With the rapid development of virtual reality technology and wearable technology, head-mounted virtual reality devices, particularly virtual reality glasses (VR glasses), have opened a completely new consumer electronics market.
The image displayed by the display screen of the virtual reality equipment is refreshed in real time along with the movement of the user, so that a sense of reality is created, and the faster the refreshing speed is, the stronger the sense of reality is. In the prior art, the general flow of image refresh is as follows:
(1) firstly, acquiring attitude information of a user, wherein the step is about 1-2 ms;
(2) Then, the processor recalculates according to the current attitude information to acquire new image data, and the step is about 1-3 ms;
(3) Then the processor transmits new image data to the display screen, and the step is about 11 ms;
(4) and finally, refreshing the image of the whole display screen area by the display screen by using the new image data, namely, lightening the display screen and displaying the new image data, wherein the step is about 1-2 ms.
As can be seen from the above steps, the whole image refresh process takes about 14-18ms, wherein the steps (2) and (3) are the most time-consuming steps in the whole process, and the refresh rate is seriously affected. The slower the image refresh rate, the longer the user waits for the refresh of the picture, thereby reducing the realism of the picture and causing the user to feel dizzy, thereby seriously affecting the user experience.
Disclosure of Invention
The invention mainly aims to provide an image refreshing method based on a virtual reality technology, aiming at improving the image refreshing speed and enhancing the reality of a picture.
In order to achieve the above object, the present invention provides an image refreshing method based on virtual reality technology, the method comprising the following steps:
When the position state of the terminal equipment changes, determining a first area and a second area on a display screen according to the position state change information;
and refreshing the image of the first area by using the old image data displayed on the display screen in the previous position state, and acquiring new image data according to the position state change information to refresh the image of the second area.
Optionally, the step of determining the first area and the second area on the display screen according to the position state change information includes: and taking the area of the display screen, which is overlapped with the position of the display screen in the previous position state, as a first area, and taking the area outside the first area on the display screen as a second area.
optionally, the step of refreshing the image of the first area with old image data displayed on the display screen in the previous position state includes:
Determining a first direction and a first distance of the terminal equipment according to the position state change information;
And moving the old image data to the reverse direction of the first direction by the first distance on the display screen, and displaying the moved old image data in the first area.
optionally, the step of refreshing the image of the first area with old image data displayed on the display screen in the previous position state includes:
and acquiring old image data displayed in an area, which is overlapped with the position of the display screen in the current position state, on the display screen in the previous position state, and displaying the acquired old image data in the first area.
Optionally, the step of obtaining new image data according to the position state change information to refresh the image of the second area includes:
And acquiring difference information between the position of the display screen in the current position state and the position of the display screen in the previous position state, calculating by using a preset algorithm according to the difference information to acquire new image data, and displaying the new image data in the second area.
Optionally, the preset algorithm is an asynchronous time warping algorithm.
Optionally, the step of refreshing the image of the first area with old image data displayed on the display screen in the previous position state includes:
And the display screen acquires the stored old image data from the memory and refreshes the image of the first area by using the old image data.
Optionally, the step of obtaining new image data according to the position state change information to refresh the image of the second area includes:
the processor acquires new image data according to the position state change information and transmits the new image data to the display screen;
the display screen refreshes the image of the second area with the new image data.
Optionally, the method further comprises:
Refreshing the image of the first area, and then refreshing the image of the second area.
Optionally, the terminal device is a head-mounted virtual reality device.
Optionally, the head-mounted virtual reality device is virtual reality glasses or a virtual reality helmet.
Optionally, the terminal device is a mobile terminal.
the invention also provides an image refreshing device based on the virtual reality technology, which comprises:
the terminal equipment comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining a first area and a second area on a display screen according to position state change information when the position state of the terminal equipment changes;
And the refreshing module is used for refreshing the image of the first area by using the old image data displayed on the display screen in the previous position state and acquiring new image data according to the position state change information to refresh the image of the second area.
Optionally, the determining module is configured to:
And taking the area of the display screen, which is overlapped with the position of the display screen in the previous position state, as a first area, and taking the area outside the first area on the display screen as a second area.
optionally, the refresh module includes a first refresh unit, and the first refresh unit is configured to:
Determining a first direction and a first distance of the terminal equipment according to the position state change information; and moving the old image data to the reverse direction of the first direction by the first distance on the display screen, and displaying the moved old image data in the first area.
optionally, the refresh module includes a first refresh unit, and the first refresh unit is configured to:
And acquiring old image data displayed in an area, which is overlapped with the position of the display screen in the current position state, on the display screen in the previous position state, and displaying the acquired old image data in the first area.
Optionally, the refresh module includes a second refresh unit, and the second refresh unit is configured to:
And acquiring difference information between the position of the display screen in the current position state and the position of the display screen in the previous position state, calculating by using a preset algorithm according to the difference information to acquire new image data, and displaying the new image data in the second area.
Optionally, the refresh module is configured to:
and acquiring the stored old image data from the memory through the display screen, and refreshing the image of the first area by using the old image data.
Optionally, the refresh module is configured to:
Acquiring new image data according to the position state change information through a processor, and transmitting the new image data to the display screen; refreshing an image of the second region with the new image data via the display screen.
optionally, the refresh module is configured to: refreshing the image of the first area, and then refreshing the image of the second area.
According to the image refreshing method based on the virtual reality technology, when the position state of the terminal device changes, the first area where the image content of the display screen does not change is determined on the display screen, and the first area is directly refreshed by the old image data, so that the processes of recalculating, acquiring new image data and transmitting data are omitted, the calculation amount and the transmission amount are greatly reduced, the image refreshing speed is improved, the time for a user to wait for refreshing the picture is shortened, the reality of the picture is enhanced, the dizzy feeling is reduced or eliminated, and the user experience is improved.
Drawings
FIG. 1 is a flow chart of an image refreshing method based on virtual reality technology according to a first embodiment of the present invention;
FIG. 2 is a schematic diagram of the displacement of the display screen when the position state of the terminal device changes in the embodiment of the present invention;
FIG. 3 is a schematic diagram comparing changes in area before and after movement of the display screen of FIG. 2;
FIG. 4 is a flowchart of an image refreshing method based on virtual reality technology according to a second embodiment of the present invention;
FIG. 5 is a schematic diagram comparing a further change in area before and after movement of the display screen of FIG. 2;
FIG. 6 is a block diagram of an image refreshing apparatus based on virtual reality technology according to a second embodiment of the present invention;
FIG. 7 is a block diagram of the refresh module of FIG. 6.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
it should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
it will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As will be appreciated by those skilled in the art, "terminal" as used herein includes both devices that are wireless signal receivers, devices that have only wireless signal receivers without transmit capability, and devices that include receive and transmit hardware, devices that have receive and transmit hardware capable of performing two-way communication over a two-way communication link. Such a device may include: a cellular or other communication device having a single line display or a multi-line display or a cellular or other communication device without a multi-line display; PCS (Personal Communications Service), which may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant), which may include a radio frequency receiver, a pager, internet/intranet access, a web browser, a notepad, a calendar and/or a GPS (Global Positioning System) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "terminal" or "terminal device" may be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. As used herein, a "terminal Device" may also be a communication terminal, a web terminal, a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, or a smart tv, a set-top box, etc.
Example one
referring to fig. 1, an image refreshing method based on virtual reality technology is proposed in a first embodiment of the present invention, and the method includes the following steps:
and S11, when the position state of the terminal equipment changes, determining the first area and the second area on the display screen according to the position state change information.
in the embodiment of the invention, when the position state of the terminal equipment is detected to be changed, the first area and the second area are immediately determined on the display screen according to the position state change information. The first area is an area where the content of the image data of the display screen is not changed, new image data does not need to be acquired for image refreshing, and only old image data needs to be directly utilized for image refreshing; the second area is an area where the content of the image data of the display screen has changed, and new image data needs to be acquired for image refresh as in the prior art. Position state change information, i.e., change information of the current position state with respect to the previous position state (i.e., the position state before the change).
Specifically, the terminal device collects attitude information of the user through a sensor, and the attitude information is position state information of the terminal device. When the position state is detected to be changed through the sensor, an area, which is overlapped with the position of the display screen in the previous position state, on the display screen in the current position state is used as a first area, and an area, which is not the first area, on the display screen is used as a second area.
referring to fig. 2 and 3, fig. 2 is a schematic diagram illustrating a display screen moving to the left when a position state of the terminal device changes, and fig. 3 is a schematic diagram illustrating a comparison of area changes before and after the display screen moves. In fig. 2, a thin line frame indicates the display screen 10 in the previous position state (before movement), and a thick line frame indicates the display screen 20 in the current position state (after movement); in fig. 3, an upper thick-line frame indicates the display screen 10 in the previous position state, and a lower thick-line frame indicates the display screen 20 in the current position state. As shown in fig. 2 and 3, when the display screen moves to the left and the region of the display screen 20 in the current position state, which coincides with the position of the display screen 10 in the previous position state, is the C region, the C region is set as the first region, and the D region of the display screen 20 other than the C region is set as the second region.
The terminal device may move in any direction, such as right, downward, upward, obliquely downward, and the like, besides moving to the left, and the first area and the second area may also be determined in the above manner.
It will be appreciated by those skilled in the art that other ways than the foregoing illustrative way of determining the first and second regions may be used, and the invention is not limited in this respect.
S12, the image of the first area is refreshed by using the old image data displayed on the display screen in the previous position state, and the image of the second area is refreshed by acquiring the new image data according to the position state change information.
In the embodiment of the invention, after the first area and the second area are determined, the image of the first area is refreshed by directly utilizing the old image data displayed on the display screen in the previous position state, the new image data is obtained by recalculating only the second area, and compared with the recalculation performed on the whole display screen area, the calculation amount and the transmission amount are greatly reduced, and the image refreshing speed is improved.
In specific implementation, since the image data displayed on the display screen is stored in the memory (e.g., the memory of the display screen), the display screen of the terminal device directly obtains the stored old image data from the memory, and refreshes the image of the first area by using the old image data. And the processor of the terminal equipment recalculates according to the position state change information to acquire new image data and transmits the new image data to the display screen, and the display screen refreshes the image of the second area by using the new image data and stores the new image data in the memory.
Preferably, in the embodiment of the present invention, the terminal device refreshes the image of the first area first and then refreshes the image of the second area, and since the first area does not need to be recalculated, the image refresh speed is fast, so that the user can see the refreshed image on the display screen immediately after moving. Of course, the refresh operation of the image of the second area may also be performed simultaneously while the image of the first area is refreshed.
The terminal device may refresh the image of the first area with the old image data in the following two ways:
The first method is as follows: the terminal equipment firstly determines a first direction and a first distance of the movement of the terminal equipment according to the position state change information; and then, moving the old image data on the display screen to the reverse direction of the first direction by a first distance, displaying the moved-in old image data in a first area, and discarding the old image data moved out of the display screen from the memory.
As shown in fig. 2 and 3, the first direction of movement of the terminal device is the left side, the distance of movement is the width distance of the D area, the opposite direction of the first direction is the right side, and the image data displayed in the a and B areas of the display screen 10 in the previous position state is the old image data. When the image data of the a and B areas are moved to the right by the same distance as each other on the display screen 20 in the current position state, the image data of the B area is moved into the C area of the display screen 20, and the image data of the a area is moved out of the display screen 20 to become invalid data. And finally, displaying the image data of the B area in the C area, and discarding the image data of the A area in the memory.
The second method comprises the following steps: the terminal device acquires old image data displayed in an area, which is overlapped with the position of the display screen in the current position state, on the display screen in the previous position state, and displays the acquired old image data in the first area.
as shown in fig. 2 and 3, if the image data displayed in the a and B areas of the display screen 10 in the previous position state is old image data, and the area on the display screen 10 coinciding with the position of the display screen 20 in the current position state is a B area, the image data displayed in the B area is acquired from the memory, the image data in the B area is displayed in the first area C of the display screen 20 in the current position state, and the image data in the a area in the memory is discarded.
It will be appreciated by those skilled in the art that other ways may be used in addition to refreshing the image of the first region with old image data in the manner illustrated above, and the invention is not limited in this regard.
The terminal device may refresh the image of the second area in the following manner: the method comprises the steps of firstly obtaining difference information between the position of a display screen in a current position state and the position of the display screen in a previous position state, then calculating by using a preset algorithm according to the difference information to obtain new image data, and finally displaying the new image data in a second area. The preset algorithm is preferably an asynchronous time warping algorithm, but may be other similar algorithms, which is not limited in the present invention.
As shown in fig. 2 and fig. 3, the difference information between the position of the display screen 20 in the current position state and the position of the display screen 10 in the previous position state is shifted leftward by the width distance of the D region, so that the image data in the D region is recalculated by using the asynchronous time warping algorithm, new image data is obtained, and the new image data is displayed in the second region. The specific calculation method is the same as that in the prior art, and is not described herein.
It will be appreciated by those skilled in the art that other similar ways may be used in addition to refreshing the image of the second region in the manner illustrated above, and the invention is not limited in this respect.
by adopting the image refreshing method provided by the embodiment of the invention, the refreshing speed can be greatly improved, the time for a user to wait for refreshing the picture is greatly shortened, the reality sense of the picture is enhanced, and the dizzy sense is reduced.
Example two
Referring to fig. 4, an image refreshing method based on virtual reality technology according to a second embodiment of the present invention is proposed, which includes the following steps:
And S21, monitoring the position state of the terminal equipment. It is judged whether or not the position state of the terminal device has changed, and when it has changed, the flow proceeds to step S22.
and S22, determining the first area and the second area on the display screen according to the position state change information.
S23, the image of the first area is refreshed by using the old image data displayed on the display screen in the previous position state.
And S24, acquiring new image data according to the position state change information to refresh the image of the second area.
In this embodiment, the display screen of the terminal device refreshes the image of the first area in advance according to the special instruction, and since the first area does not need to be recalculated, the image refreshing speed is fast, so that the user can see the refreshed picture on the display screen immediately after moving, that is, the user has seen the refreshed picture in step S23. During the process of viewing the refresh picture by the user, the terminal device continues to execute step S24 in the background, and continues to refresh the image of the second area without affecting the video viewed by the user. Therefore, the image refreshing speed is greatly improved, the real-time refreshing of the image is realized, and the reality sense of the picture is greatly enhanced.
for example, as shown in fig. 5, the area defined by the outer frame of the display screen (10, 20) corresponds to the whole memory space, and the area defined by the inner frame corresponds to the actual display space, that is, the area corresponding to the memory space is larger than the area corresponding to the actual display space at any time. When the user moves a certain distance to the left, the display screen moves the same distance to the left, and the display content shifts by 64 pixels to the left. At this time, the upper thick-line frame in fig. 5 indicates the display screen 10 in the previous position state, including A, B, C three areas; the following bold line boxes represent the display 20 in the current position state, including D, E, F three regions. Since the D area and the E area on the display screen 20 coincide with the position of the display screen 10, the D area and the E area are determined as the first area, and the F area is determined as the second area.
the display screen 20 refreshes the images of the first area, namely the D area and the E area, firstly, as the D area and the E area on the display screen 20 are overlapped with the C area and the B area on the display screen 10, the image data of the B area and the C area are directly obtained from the memory to refresh the images of the D area and the E area, so that the image data of the left parts of the C area and the B area are displayed in the E area in real time, new image data are obtained without recalculation, the image refreshing speed of the E area is greatly improved, and a user can immediately see the refreshed images. Since the image data of the area a in the memory is not within the range of the current display screen 20, the image data is invalid data and is discarded from the memory.
The display screen 20 then refreshes the image data of the second region, i.e., the F region, at this time, the processor needs to recalculate the F region to obtain new image data, and then transmits the new image data to the display screen, and the display screen refreshes the F region by using the new image data and stores the new image data in the memory. Since the F area is not in the area corresponding to the actual display space, the refresh process of the F area is performed in the background, and has no influence on the actual display screen.
According to the image refreshing method provided by the embodiment of the invention, when the position state of the terminal equipment changes, the first area with unchanged image content of the display screen is determined on the display screen, and the image refreshing is directly carried out by using the old image data aiming at the first area, so that the processes of recalculating, acquiring new image data and transmitting data are omitted, the calculated amount and the transmission amount are greatly reduced, the image refreshing speed is improved, the time of a user waiting for refreshing the picture is shortened, the sense of reality of the picture is enhanced, the dizzy sense is reduced or eliminated, and the user experience is improved.
EXAMPLE III
referring to fig. 6, an image refreshing apparatus based on virtual reality technology according to a third embodiment of the present invention is proposed, the apparatus including a determining module and a refreshing module, wherein:
a determination module: and the display screen is used for determining the first area and the second area according to the position state change information when the position state of the terminal equipment is changed.
In the embodiment of the invention, when the position state of the terminal equipment is changed, the determining module immediately determines the first area and the second area on the display screen according to the position state change information. The first area is an area where the content of the image data of the display screen is not changed, new image data does not need to be acquired for image refreshing, and only old image data needs to be directly utilized for image refreshing; the second area is an area where the content of the image data of the display screen has changed, and new image data needs to be acquired for image refresh as in the prior art. Position state change information, i.e., change information of the current position state with respect to the previous position state (i.e., the position state before the change).
specifically, the terminal device collects attitude information of the user through a sensor, and the attitude information is position state information of the terminal device. When the position state is detected to be changed through the sensor, the determining module takes an area, which is overlapped with the position of the display screen in the previous position state, on the display screen in the current position state as a first area, and takes an area, which is not the first area, on the display screen as a second area.
Referring to fig. 2 and 3, fig. 2 is a schematic diagram illustrating a display screen moving to the left when a position state of the terminal device changes, and fig. 3 is a schematic diagram illustrating a comparison of area changes before and after the display screen moves. In fig. 2, a thin line frame indicates the display screen 10 in the previous position state (before movement), and a thick line frame indicates the display screen 20 in the current position state (after movement); in fig. 3, an upper thick-line frame indicates the display screen 10 in the previous position state, and a lower thick-line frame indicates the display screen 20 in the current position state. As shown in fig. 2 and 3, after the display screen moves to the left, the region of the display screen 20 in the current position state, which coincides with the position of the display screen 10 in the previous position state, is the C region, and the determination module takes the C region as the first region and takes the D region outside the C region of the display screen 20 as the second region.
The terminal device may move in any direction, such as right, downward, upward, obliquely downward, and the like, besides moving to the left, and the determining module may also determine the first area and the second area in the above manner.
it will be appreciated by those skilled in the art that other ways than the foregoing illustrative way of determining the first and second regions may be used, and the invention is not limited in this respect.
A refresh module: and the image refreshing module is used for refreshing the image of the first area by using the old image data displayed on the display screen in the previous position state and acquiring the new image data according to the position state change information to refresh the image of the second area.
In the embodiment of the invention, after the first area and the second area are determined, the refreshing module directly refreshes the image of the first area by using the old image data displayed on the display screen in the state of the previous position, and only recalculates the second area to obtain the new image data, so that the calculation amount and the transmission amount are greatly reduced and the image refreshing speed is improved compared with the recalculation of the whole display screen area.
in specific implementation, since the image data displayed on the display screen is stored in the memory (e.g., the memory of the display screen), the refresh module directly obtains the stored old image data from the memory through the display screen, and refreshes the image of the first area by using the old image data. And the refreshing module performs recalculation according to the position state change information through the processor to acquire new image data, transmits the new image data to the display screen, refreshes the image of the second area by using the new image data through the display screen, and stores the new image data in the memory.
preferably, in the embodiment of the present invention, the refreshing module refreshes the image of the first area first and then refreshes the image of the second area, and since the first area does not need to be recalculated, the image refreshing speed is fast, so that the user can see the refreshed image on the display screen immediately after moving. Of course, the refreshing module may also perform the refreshing operation of the image of the second region at the same time as the refreshing of the image of the first region.
as shown in fig. 7, the refresh module includes a first refresh unit and a second refresh unit, wherein:
a first refresh unit: for refreshing the image of the first area with old image data displayed on the display screen in the state of the previous position.
Specifically, the first refreshing unit may refresh the image of the first area with the old image data in the following two ways:
the first method is as follows: the first refreshing unit firstly determines a first direction and a first distance of the movement of the terminal equipment according to the position state change information; and then, moving the old image data on the display screen to the reverse direction of the first direction by a first distance, displaying the moved-in old image data in a first area, and discarding the old image data moved out of the display screen from the memory.
as shown in fig. 2 and 3, the first direction of movement of the terminal device is the left side, the distance of movement is the width distance of the D area, the opposite direction of the first direction is the right side, and the image data displayed in the a and B areas of the display screen 10 in the previous position state is the old image data. The first refreshing unit moves the image data of the area a and the area B to the right by the same distance on the display screen 20 in the current position state, so that the image data of the area B moves into the area C of the display screen 20, and the image data of the area a moves out of the display screen 20 and becomes invalid data. And finally, displaying the image data of the B area in the C area, and discarding the image data of the A area in the memory.
the second method comprises the following steps: the first refreshing unit acquires old image data displayed in an area, which is overlapped with the position of the display screen in the current position state, on the display screen in the previous position state, and displays the acquired old image data in the first area.
As shown in fig. 2 and 3, the image data displayed in the a and B areas of the display screen 10 in the previous position state is old image data, the area on the display screen 10 in the previous position state coinciding with the position of the display screen 20 in the current position state is a B area, the first refreshing unit obtains the image data displayed in the B area from the memory, displays the image data in the B area in the first area C of the display screen 20 in the current position state, and discards the image data in the a area in the memory.
it will be appreciated by those skilled in the art that other ways may be used in addition to refreshing the image of the first region with old image data in the manner illustrated above, and the invention is not limited in this regard.
A second refresh unit: and the image refreshing module is used for acquiring new image data according to the position state change information to refresh the image of the second area.
Specifically, the second refreshing unit may refresh the image of the second area in the following manner: the method comprises the steps of firstly obtaining difference information between the position of a display screen in a current position state and the position of the display screen in a previous position state, then calculating by using a preset algorithm according to the difference information to obtain new image data, and finally displaying the new image data in a second area. The preset algorithm is preferably an asynchronous time warping algorithm, but may be other similar algorithms, which is not limited in the present invention.
as shown in fig. 2 and fig. 3, the difference information between the position of the display screen 20 in the current position state and the position of the display screen 10 in the previous position state is shifted leftward by the width distance of the D region, so that the second refreshing unit recalculates the image data of the D region by using the asynchronous time warping algorithm, obtains new image data, and displays the new image data in the second region. The specific calculation method is the same as that in the prior art, and is not described herein.
it will be appreciated by those skilled in the art that other similar ways may be used in addition to refreshing the image of the second region in the manner illustrated above, and the invention is not limited in this respect.
according to the image refreshing device provided by the embodiment of the invention, when the position state of the terminal equipment is changed, the first area with unchanged image content of the display screen is determined on the display screen, and the image refreshing is directly carried out by using the old image data aiming at the first area, so that the process of recalculating to obtain new image data and transmitting data is omitted, the calculated amount and the transmission amount are greatly reduced, the image refreshing speed is improved, the time of a user waiting for refreshing the image is shortened, the sense of reality of the image is enhanced, the dizzy feeling is reduced or eliminated, and the user experience is improved.
The image refreshing method and device based on the virtual reality technology are mainly applied to virtual reality equipment, such as head-mounted virtual reality equipment including virtual reality glasses, virtual reality helmets and the like, can also be applied to mobile terminals such as mobile phones and tablets and can also be applied to other terminal equipment.
those skilled in the art will appreciate that the present invention includes apparatus directed to performing one or more of the operations described in the present application. These devices may be specially designed and manufactured for the required purposes, or they may comprise known devices in general-purpose computers. These devices have stored therein computer programs that are selectively activated or reconfigured. Such a computer program may be stored in a device (e.g., computer) readable medium, including, but not limited to, any type of disk including floppy disks, hard disks, optical disks, CD-ROMs, and magnetic-optical disks, ROMs (Read-Only memories), RAMs (Random Access memories), EPROMs (Erasable Programmable Read-Only memories), EEPROMs (Electrically Erasable Programmable Read-Only memories), flash memories, magnetic cards, or optical cards, or any type of media suitable for storing electronic instructions, and each coupled to a bus. That is, a readable medium includes any medium that stores or transmits information in a form readable by a device (e.g., a computer).
It will be understood by those within the art that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by computer program instructions. Those skilled in the art will appreciate that the computer program instructions may be implemented by a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, implement the features specified in the block or blocks of the block diagrams and/or flowchart illustrations of the present disclosure.
Those of skill in the art will appreciate that various operations, methods, steps in the processes, acts, or solutions discussed in the present application may be alternated, modified, combined, or deleted. Further, various operations, methods, steps in the flows, which have been discussed in the present application, may be interchanged, modified, rearranged, decomposed, combined, or eliminated. Further, steps, measures, schemes in the various operations, methods, procedures disclosed in the prior art and the present invention can also be alternated, changed, rearranged, decomposed, combined, or deleted.
the above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (24)
1. an image refreshing method based on virtual reality technology is characterized by comprising the following steps:
When the position state of the terminal equipment changes, the area included by the display screen of the terminal equipment is the area corresponding to the actual display space or the area corresponding to the whole memory space, and a first area and a second area are determined from the area corresponding to the actual display space or the area corresponding to the whole memory space according to the position state change information; the first area is an area where the content of the image data of the display screen is not changed; the second area is an area where the content of the image data of the display screen is changed;
And refreshing the image of the first area by using the old image data displayed on the display screen in the previous position state, and acquiring new image data according to the position state change information to refresh the image of the second area.
2. The virtual reality technology-based image refreshing method according to claim 1, wherein the step of determining the first region and the second region on the display screen according to the position state change information comprises: and taking the area of the display screen, which is overlapped with the position of the display screen in the previous position state, as a first area, and taking the area outside the first area on the display screen as a second area.
3. The virtual reality technology-based image refreshing method according to claim 1, wherein the step of refreshing the image of the first area with old image data displayed on the display screen in a previous position state comprises:
Determining a first direction and a first distance of the terminal equipment according to the position state change information;
And moving the old image data to the reverse direction of the first direction by the first distance on the display screen, and displaying the moved old image data in the first area.
4. The virtual reality technology-based image refreshing method according to claim 1, wherein the step of refreshing the image of the first area with old image data displayed on the display screen in a previous position state comprises:
and acquiring old image data displayed in an area, which is overlapped with the position of the display screen in the current position state, on the display screen in the previous position state, and displaying the acquired old image data in the first area.
5. the virtual reality technology-based image refreshing method according to claim 1, wherein the step of obtaining new image data to refresh the image of the second region according to the position state change information comprises:
And acquiring difference information between the position of the display screen in the current position state and the position of the display screen in the previous position state, calculating by using a preset algorithm according to the difference information to acquire new image data, and displaying the new image data in the second area.
6. The virtual reality technology-based image refreshing method according to claim 5, wherein the preset algorithm is an asynchronous time warping algorithm.
7. The virtual reality technology-based image refreshing method according to any one of claims 1 to 6, wherein the step of refreshing the image of the first region using old image data displayed on the display screen in a previous position state comprises:
and the display screen acquires the stored old image data from the memory and refreshes the image of the first area by using the old image data.
8. The virtual reality technology-based image refreshing method according to any one of claims 1 to 6, wherein the step of obtaining new image data to refresh the image of the second region according to the position state change information includes:
The processor acquires new image data according to the position state change information and transmits the new image data to the display screen;
The display screen refreshes the image of the second area with the new image data.
9. A virtual reality technology-based image refreshing method according to any one of claims 1 to 6, further comprising:
Refreshing the image of the first area, and then refreshing the image of the second area.
10. the image refreshing method based on virtual reality technology according to any one of claims 1-6, wherein the terminal device is a head-mounted virtual reality device.
11. The virtual reality technology-based image refreshing method according to claim 10, wherein the head-mounted virtual reality device is a virtual reality glasses or a virtual reality helmet.
12. The virtual reality technology-based image refreshing method according to any one of claims 1 to 6, wherein the terminal device is a mobile terminal.
13. An image refreshing apparatus based on virtual reality technology, comprising:
The terminal device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining a first area and a second area from the area corresponding to the actual display space or the area corresponding to the whole memory space according to the position state change information when the position state of the terminal device changes, and the area included by a display screen of the terminal device is the area corresponding to the actual display space or the area corresponding to the whole memory space; the first area is an area where the content of the image data of the display screen is not changed; the second area is an area where the content of the image data of the display screen is changed;
and the refreshing module is used for refreshing the image of the first area by using the old image data displayed on the display screen in the previous position state and acquiring new image data according to the position state change information to refresh the image of the second area.
14. The virtual reality technology-based image refreshing apparatus according to claim 13, wherein the determining module is configured to:
And taking the area of the display screen, which is overlapped with the position of the display screen in the previous position state, as a first area, and taking the area outside the first area on the display screen as a second area.
15. The virtual reality technology-based image refreshing apparatus according to claim 13, wherein the refreshing module comprises a first refreshing unit, and the first refreshing unit is configured to:
Determining a first direction and a first distance of the terminal equipment according to the position state change information; and moving the old image data to the reverse direction of the first direction by the first distance on the display screen, and displaying the moved old image data in the first area.
16. the virtual reality technology-based image refreshing apparatus according to claim 13, wherein the refreshing module comprises a first refreshing unit, and the first refreshing unit is configured to:
And acquiring old image data displayed in an area, which is overlapped with the position of the display screen in the current position state, on the display screen in the previous position state, and displaying the acquired old image data in the first area.
17. The virtual reality technology-based image refreshing apparatus according to claim 13, wherein the refreshing module comprises a second refreshing unit, and the second refreshing unit is configured to:
And acquiring difference information between the position of the display screen in the current position state and the position of the display screen in the previous position state, calculating by using a preset algorithm according to the difference information to acquire new image data, and displaying the new image data in the second area.
18. The virtual reality technology-based image refreshing apparatus according to claim 17, wherein the preset algorithm is an asynchronous time warping algorithm.
19. The virtual reality technology-based image refreshing apparatus according to any one of claims 13 to 18, wherein the refreshing module is configured to:
And acquiring the stored old image data from the memory through the display screen, and refreshing the image of the first area by using the old image data.
20. The virtual reality technology-based image refreshing apparatus according to any one of claims 13 to 18, wherein the refreshing module is configured to:
Acquiring new image data according to the position state change information through a processor, and transmitting the new image data to the display screen; refreshing an image of the second region with the new image data via the display screen.
21. The virtual reality technology-based image refreshing apparatus according to any one of claims 13 to 18, wherein the refreshing module is configured to: refreshing the image of the first area, and then refreshing the image of the second area.
22. An image refreshing apparatus based on virtual reality technology according to any one of claims 13-18, wherein the terminal device is a head-mounted virtual reality device.
23. the virtual reality technology-based image refreshing apparatus according to claim 22, wherein the head-mounted virtual reality device is a virtual reality glasses or a virtual reality helmet.
24. The virtual reality technology-based image refreshing apparatus according to any one of claims 13-18, wherein the terminal device is a mobile terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611178744.8A CN106873929B (en) | 2016-12-19 | 2016-12-19 | Image refreshing method and device based on virtual reality technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611178744.8A CN106873929B (en) | 2016-12-19 | 2016-12-19 | Image refreshing method and device based on virtual reality technology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106873929A CN106873929A (en) | 2017-06-20 |
| CN106873929B true CN106873929B (en) | 2019-12-17 |
Family
ID=59164737
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611178744.8A Active CN106873929B (en) | 2016-12-19 | 2016-12-19 | Image refreshing method and device based on virtual reality technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106873929B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10559276B2 (en) * | 2018-02-03 | 2020-02-11 | Facebook Technologies, Llc | Apparatus, system, and method for mitigating motion-to-photon latency in head-mounted displays |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105975273A (en) * | 2016-05-04 | 2016-09-28 | 腾讯科技（深圳）有限公司 | Particle animation realization method and system as well as purification process display method and system for optimization tool |
| CN106098022A (en) * | 2016-06-07 | 2016-11-09 | 北京小鸟看看科技有限公司 | A kind of method and apparatus shortening picture delay |
| CN106095366A (en) * | 2016-06-07 | 2016-11-09 | 北京小鸟看看科技有限公司 | A kind of shorten the method for picture delay, device and virtual reality device |
| CN106161940A (en) * | 2016-07-29 | 2016-11-23 | 维沃移动通信有限公司 | A kind of image processing method and mobile terminal |
-
2016
- 2016-12-19 CN CN201611178744.8A patent/CN106873929B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105975273A (en) * | 2016-05-04 | 2016-09-28 | 腾讯科技（深圳）有限公司 | Particle animation realization method and system as well as purification process display method and system for optimization tool |
| CN106098022A (en) * | 2016-06-07 | 2016-11-09 | 北京小鸟看看科技有限公司 | A kind of method and apparatus shortening picture delay |
| CN106095366A (en) * | 2016-06-07 | 2016-11-09 | 北京小鸟看看科技有限公司 | A kind of shorten the method for picture delay, device and virtual reality device |
| CN106161940A (en) * | 2016-07-29 | 2016-11-23 | 维沃移动通信有限公司 | A kind of image processing method and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106873929A (en) | 2017-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9118970B2 (en) | System and method for embedding and viewing media files within a virtual and augmented reality scene | |
| US11574613B2 (en) | Image display method, image processing method and relevant devices | |
| US10650598B2 (en) | Augmented reality-based information acquiring method and apparatus | |
| EP2859463B1 (en) | Rendering method of 3d web-page and terminal using the same | |
| US20130088514A1 (en) | Mobile electronic device, method and webpage for visualizing location-based augmented reality content | |
| KR20100075315A (en) | Mobile terminal and method for providing location based service thereof | |
| EP3667622B1 (en) | Information processing device, information processing method, and program | |
| EP4009144A1 (en) | Head mounted display device and processing method of head mounted display device | |
| CN112561840B (en) | Video clipping method and device, storage medium and electronic equipment | |
| CN113923515A (en) | Video production method and device, electronic equipment and storage medium | |
| EP4300943A1 (en) | Subtitle rendering method and apparatus for virtual reality space, device, and medium | |
| CN114610428B (en) | Information stream display method, device, apparatus, storage medium, and program | |
| TWI799000B (en) | Method, processing device, and display system for information display | |
| CN106873929B (en) | Image refreshing method and device based on virtual reality technology | |
| CN111818265B (en) | Interaction method and device based on augmented reality model, electronic equipment and medium | |
| CN112489224A (en) | Image drawing method and device, readable medium and electronic equipment | |
| CN111225293B (en) | Video data processing method and device and computer storage medium | |
| KR20190059666A (en) | Method and device for processing an image and recording medium thereof | |
| US20170154466A1 (en) | Interactively augmented reality enable system | |
| US20170186401A1 (en) | Server device, client device and dynamic image transmission method for virtual desktop infrastructure | |
| CN115619904A (en) | Image processing method, device and equipment | |
| CN113194265B (en) | Streetscape video generation method and device, electronic equipment and storage medium | |
| CN110619615A (en) | Method and apparatus for processing image | |
| CN114332224A (en) | Method, device and equipment for generating 3D target detection sample and storage medium | |
| JP5660573B2 (en) | Display control apparatus, display control method, program, and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |