WO2022042039A1 - Data transmission method for virtual reality system and related apparatus - Google Patents

Data transmission method for virtual reality system and related apparatus Download PDF

Info

Publication number
WO2022042039A1
WO2022042039A1 PCT/CN2021/104473 CN2021104473W WO2022042039A1 WO 2022042039 A1 WO2022042039 A1 WO 2022042039A1 CN 2021104473 W CN2021104473 W CN 2021104473W WO 2022042039 A1 WO2022042039 A1 WO 2022042039A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
virtual reality
transmitted
refresh rate
reality device
Prior art date
Application number
PCT/CN2021/104473
Other languages
French (fr)
Chinese (zh)
Inventor
王雪丰
李文宇
苗京花
李茜
王龙辉
刘梓荷
陈丽莉
张�浩
Original Assignee
京东方科技集团股份有限公司
北京京东方光电科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司, 北京京东方光电科技有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US17/921,292 priority Critical patent/US20230186537A1/en
Publication of WO2022042039A1 publication Critical patent/WO2022042039A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/10—Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels

Definitions

  • the present disclosure relates to the field of display technology, and in particular, to a data transmission method and related device of a virtual reality system.
  • VR Virtual Reality
  • VR display belongs to the field of near-eye display.
  • there are higher requirements for the resolution and refresh rate of the VR display screen which leads to an increase in the transmission bandwidth in the virtual reality system. The problem.
  • the present disclosure provides a data transmission method for a virtual reality system, including:
  • the virtual reality host intercepts the image in the set area of the image to be transmitted to obtain the first image, and compresses the image in the display area of the image to be transmitted to obtain the second image; the set area is the image in the display area. partial area;
  • the virtual reality host transmits the first image and the second image to the virtual reality device in a specific order
  • the virtual reality device receives the first image and the second image
  • the virtual reality device stretches the second image, and fuses the first image with the stretched second image to obtain an image to be displayed;
  • the virtual reality device displays the to-be-displayed image.
  • an embodiment of the present disclosure also provides a data transmission method for a virtual reality system, including:
  • the first image is obtained by intercepting the image in the set area in the image to be transmitted, and the second image is obtained by compressing the image in the display area of the image to be transmitted;
  • the set area is a partial area in the display area;
  • the first image and the second image are transmitted to the virtual reality device in a specific order.
  • the first image is obtained by intercepting an image in a set area in the image to be transmitted
  • the second image is obtained by compressing the image to be transmitted, including:
  • image sampling is performed on the set area of the to-be-transmitted image to obtain the first image
  • image sampling is performed on the display area of the to-be-transmitted image to obtain the second image
  • the first resolution is the same as the second resolution, the first angle of view is smaller than the second angle of view, and the first refresh rate is greater than or equal to the second refresh rate.
  • the first refresh rate and the second refresh rate are determined in the following manner:
  • the first refresh rate of the first image and the second refresh rate of the second image are determined according to the refresh rate of the virtual reality device and the posture information of the virtual reality device.
  • the transmitting the first image and the second image to the virtual reality device in a specific order includes:
  • frame arrangement is performed on the first image and the second image to obtain an image sequence composed of the first image and the second image, and the image sequence is transmitted to the virtual reality device.
  • the first image is obtained by intercepting an image in a set area in the image to be transmitted
  • the second image is obtained by compressing the image in the display area in the image to be transmitted, including:
  • Mark bit information is added to the first image and the second image respectively; the marker bit information is used to distinguish the first image and the second image.
  • an embodiment of the present disclosure also provides a data transmission method for a virtual reality system, including:
  • the to-be-displayed image is displayed.
  • the receiving the first image and the second image includes:
  • the first image is stored in a first memory and the second image is stored in a second memory.
  • the stretching of the second image in the sequence of images is performed by stretching the first image in the sequence of images with the stretched second image.
  • the images are fused to obtain an image to be displayed, including:
  • the first image and the stretched second image are fused to obtain the to-be-displayed image.
  • an embodiment of the present disclosure also provides a virtual reality host, including:
  • the image processing module is used for intercepting the image in the set area of the image to be transmitted to obtain the first image, and compressing the image in the display area of the image to be transmitted to obtain the second image;
  • the set area is the display area part of the area;
  • a transmission module configured to transmit the first image and the second image to the virtual reality device in a specific order.
  • the image processing module is specifically configured to: use a preset first resolution, a first field of view, and a first refresh rate to set the image to be transmitted
  • the first image is obtained by image sampling in the area
  • the second image is obtained by image sampling of the display area of the to-be-transmitted image by adopting a preset second resolution, a second field of view and a second refresh rate
  • the first resolution is the same as the second resolution
  • the first refresh rate is greater than or equal to the second refresh rate.
  • the transmission module is specifically configured to: determine the first image of the first image according to the refresh rate of the virtual reality device and the posture information of the virtual reality device a refresh rate and the second refresh rate of the second image; according to the first refresh rate and the second refresh rate, frame arrangement of the first image and the second image to obtain the first An image sequence consisting of an image and a second image is transmitted to the virtual reality device.
  • an embodiment of the present disclosure also provides a virtual reality device, including:
  • a receiving module for receiving the first image and the second image transmitted by the virtual reality host
  • an image fusion module configured to stretch the second image, and fuse the first image with the stretched second image to obtain an image to be displayed
  • a display module configured to display the to-be-displayed image.
  • the receiving module is specifically configured to: receive the first image and the second image, and distinguish the first image and the second image according to flag bit information ; storing the first image in a first memory and storing the second image in a second memory.
  • the image fusion module is specifically configured to: acquire the first image and the second image from the first memory and the second memory, respectively; stretch the second image so that the resolution of the stretched second image is the same as the display resolution of the virtual reality device; stretch the first image and the stretched second image fused to obtain the to-be-displayed image.
  • an embodiment of the present disclosure further provides a virtual reality system, which includes: any of the foregoing virtual reality hosts and any of the foregoing virtual reality devices.
  • FIG. 1 is one of the flowcharts of a data transmission method of a virtual reality system provided by an embodiment of the present disclosure
  • FIG. 2 is the second flow chart of the data transmission method of the virtual reality system provided by the embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of an image to be transmitted in an embodiment of the disclosure.
  • FIG. 4 is one of the schematic diagrams of the transmission sequence of the first image and the second image in the embodiment of the present disclosure
  • FIG. 5 is the second schematic diagram of the transmission sequence of the first image and the second image in the embodiment of the present disclosure
  • FIG. 6 is a schematic diagram of a process in which a virtual reality device fuses a first image and a second image
  • FIG. 7 is the third flowchart of the data transmission method of the virtual reality system provided by the embodiment of the present disclosure.
  • FIG. 8 is a schematic structural diagram of a virtual reality host provided by an embodiment of the present disclosure.
  • FIG. 9 is a schematic structural diagram of a virtual reality device provided by an embodiment of the present disclosure.
  • FIG. 10 is a schematic structural diagram of a virtual reality system provided by an embodiment of the present disclosure.
  • the embodiments of the present disclosure provide a data transmission method and a related device in a virtual reality system.
  • An embodiment of the present disclosure provides a data transmission method for a virtual reality system, as shown in FIG. 1 , including:
  • the virtual reality host intercepts the image in the set area in the image to be transmitted to obtain the first image, and compresses the image in the display area of the image to be transmitted to obtain the second image;
  • the set area is a partial area in the display area;
  • the virtual reality host transmits the first image and the second image to the virtual reality device in a specific order
  • the virtual reality device receives the first image and the second image
  • the virtual reality device stretches the second image, and fuses the first image with the stretched second image to obtain an image to be displayed;
  • the virtual reality device displays the image to be displayed.
  • the virtual reality host obtains the first image by intercepting the image in the set area in the image to be transmitted, and compresses the image in the display area of the image to be transmitted to obtain the second image,
  • the first image and the second image are transmitted in a specific order. Since the data amount of the first image and the second image is smaller than the data amount of the image to be transmitted, the transmission bandwidth is greatly reduced, and the virtual reality device can The received second image is stretched, and the stretched second image is fused with the received first image, and the obtained image to be displayed can meet the display requirements of the virtual reality system. Therefore, the embodiments of the present disclosure provide The data transmission method can greatly reduce the transmission bandwidth and improve the user experience on the basis of meeting the display requirements of the virtual reality system.
  • an embodiment of the present disclosure also provides a data transmission method for a virtual reality system, as shown in FIG. 2 , which may include:
  • S101 intercepting an image in a set area in an image to be transmitted to obtain a first image, and compressing an image in a display area in the image to be transmitted to obtain a second image;
  • the set area is a partial area in the display area;
  • the virtual reality host obtains the first image by intercepting the image in the set area in the image to be transmitted, and compresses the image in the display area of the image to be transmitted to obtain the second image,
  • the first image and the second image are transmitted in a specific order. Since the data amount of the first image and the second image are both smaller than the data amount of the to-be-transmitted image, the transmission bandwidth is greatly reduced.
  • the data transmission method shown in FIG. 2 may be executed on the side of the virtual reality host, and the virtual reality host and the virtual reality device may implement communication connection in a wired or wireless manner.
  • the virtual reality host may be a computer, Devices with processing functions, such as mobile phones and tablet computers.
  • FIG. 3 is a schematic diagram of an image to be transmitted according to an embodiment of the present disclosure.
  • the resolution of the display area A is m*n.
  • the image in area C in FIG. 3 is intercepted to obtain a first image with a resolution of x*y.
  • the clarity of the obtained first image is the same as that in area C of the image to be transmitted, so the obtained first image will not be changed.
  • the definition of an image, that is, the first image is still a high-definition image, and the data amount of the first image is smaller than the data amount of the image to be transmitted.
  • the second image is obtained by compressing the image in the display area of the image to be transmitted.
  • the second image is obtained by compressing the image to be transmitted, the data volume of the second image is smaller than that of the image to be transmitted, and the data volume of the second image is smaller than that of the image to be transmitted.
  • the sharpness is less than the sharpness of the image to be transmitted.
  • the first image and the second image are transmitted to the virtual reality device in a specific order, that is, during the transmission process, the first image and the second image are not transmitted at the same time, for example, according to FIG. 4 or The transmission is performed in the sequence shown in FIG. 5 , since the data amount of the first image and the second image is smaller than that of the to-be-transmitted image, the transmission bandwidth is greatly reduced.
  • the virtual reality device After receiving the first image and the second image, the virtual reality device stretches the second image, and fuses the stretched second image with the first image, and the obtained image to be displayed corresponds to the set area
  • the area of is the image with higher definition
  • the rest area is the image with lower definition.
  • the human eye when the user is using the virtual reality device, the human eye mainly focuses on part of the screen area, such as the central area of the screen.
  • the user mainly turns his head instead of turning his eyes to watch, so
  • the to-be-displayed image obtained in the embodiment of the present disclosure can meet the image definition requirements, and can reduce the transmission bandwidth and the time delay in the image transmission process, so that the user can watch the picture more smoothly and improve the user experience.
  • the above step S101 may include:
  • image sampling is performed on a set area C of an image to be transmitted to obtain a first image; in specific implementation, the above setting
  • the area C may be the gaze area of the user when viewing the screen, for example, the set area C may be the central area in the display area A.
  • image sampling is performed on the display area A of the image to be transmitted to obtain the second image
  • the first resolution is the same as the second resolution (for example, both are x*y), the first angle of view ⁇ is smaller than the second angle of view ⁇ , and the first refresh rate r1 is greater than or equal to the second refresh rate r2.
  • the first angle of view ⁇ may be the viewing angle of the user viewing the set area C
  • the second angle of view ⁇ may be the user’s viewing angle
  • Viewing the viewing angle of the display area A can make the image to be displayed obtained by the fusion of the subsequent virtual reality device more in line with the viewing angle of the user, enabling an immersive experience.
  • the second refresh rate r2 may be smaller than the first refresh rate r1 to ensure high definition of the user's gaze area.
  • the resolutions of the first image and the second image are the same, so that the resolutions of each image during the transmission process can be the same, thereby ensuring the smoothness of the transmission process.
  • the transmission bandwidth is m*n*r.
  • the transmission bandwidth for transmitting the first image and the second image is x*y*r, where r represents the refresh rate of the virtual reality device. It can be seen that the transmission bandwidth in the embodiment of the present disclosure is significantly reduced, and the compression ratio of the transmission bandwidth is (m *n)/(x*y).
  • the sampling resolution of the first image and the second image is the same, but the sampling area of the second image is larger than that of the first image, so the obtained first image has higher definition than the second image.
  • the first refresh rate and the second refresh rate may be determined in the following manner:
  • the first refresh rate of the first image and the second refresh rate of the second image are determined.
  • sensors such as gyroscopes are generally provided in the virtual reality device.
  • the virtual reality device can obtain attitude information through sensors such as gyroscopes, and determine whether the virtual reality device is in a motion state or a static state according to the attitude information. For example, you can set the corresponding When the posture information is greater than the threshold, it means that the virtual reality device is in a moving state, and when the posture information is less than the threshold, it means that the virtual reality device is in a static state.
  • the sensitivity to the clarity of the picture is reduced due to the dynamic blur of the human eye.
  • the proportion of the first image in the image sequence can be reduced, that is, the first refresh rate of the first image can be reduced.
  • the first image Q1 and the second image Q2 may be transmitted alternately as shown in FIG. 5 , that is, the first refresh rate may be equal to the second refresh rate.
  • the virtual reality device When the virtual reality device is in a static state, the sensitivity of the human eye to the picture definition increases, that is, the first refresh rate of the first image needs to be increased. At this time, the ratio of the first image in the image sequence needs to be increased.
  • the sequence of continuous transmission of k first images Q1 and transmission of one second image Q2 shown in FIG. 4 is periodic transmission, that is, the first refresh rate is greater than the second refresh rate.
  • At least two transmission modes may be preset, for example, two transmission modes may be set, the first transmission mode is suitable for the motion state, wherein the first refresh rate is equal to the second refresh rate, and the second transmission mode is suitable for Static state, in which the first refresh rate is greater than the second refresh rate, the specific values of the first refresh rate and the second refresh rate in each transmission mode can be determined in combination with the refresh rate of the virtual reality device, and more transmission modes can be set, There is no limitation here.
  • the first image may be obtained by sampling the set area according to the determined first refresh rate
  • the second image may be obtained by sampling the display area according to the second refresh rate, so that the final image The image to be displayed is more in line with the current state of the user.
  • the above-mentioned step S102 may include:
  • the frames of the first image and the second image are arranged to obtain an image sequence composed of the first image and the second image, and the image sequence is transmitted to the virtual reality device.
  • the refresh rate of the virtual reality device is 90Hz, that is, 90 times per second, it can be periodically transmitted in the order of 9 frames of the first image and 1 frame of the second image.
  • the refresh rate of the second image is 9Hz.
  • k first images Q1 and one second image Q2 may be transmitted periodically in the order of continuous transmission.
  • the first image Q1 and the second image Q2 may be transmitted alternately. .
  • a memory may be set in the virtual reality host to store the first image and the second image obtained in the above step S101, for example, two memories may be set to store the first image and the second image respectively, and the virtual reality host A counter is set in the host, and the refresh rate of the virtual reality device is 90Hz, and it is periodically transmitted in the order of 9 frames of the first image and 1 frame of the second image. Take the memory address of 9 frames of the first image, and transmit each first image in sequence, read the memory address of 1 frame of the second image at 9 time, and transmit the second image, and the counter is cleared at the same time, that is, a cycle is completed transmission of image sequences.
  • the above-mentioned step S101 may include:
  • Mark bit information is added to the first image and the second image respectively; the marker bit information is used to distinguish the first image and the second image.
  • the first data of the first image and the first row of the second image may be set as flag data as the flag information, and the flag bit information may also be set in other positions, which is not limited here.
  • the flag information in the first image is different from the flag information in the second image, so the first image and the second image can be distinguished by the flag information.
  • the virtual reality device can identify the first image and the second image through the marker bit information, which is convenient for subsequent processing of the first image and the second image.
  • a first memory and a second memory may be set in the virtual reality device, and after the virtual reality device recognizes each image in the image sequence, the first image is stored in the first memory, and the second image is stored In the second memory, therefore, in the subsequent processing process, the first image and the second image can be acquired in the first memory and the second memory respectively in the corresponding order, thereby reducing the amount of calculation in the subsequent processing process, avoiding Either the first image or the second image is omitted.
  • the first memory and the second memory can store the image of the previous frame.
  • the image is discarded, so that the first image and the second image stored in the first memory and the second memory are the images required by the current frame, so that the first image and the second image can be directly obtained in the first memory and the second memory, There is no need to consider the order of image frames to reduce the amount of data computation.
  • FIG. 6 is a schematic diagram of the process of fusing the first image and the second image by the virtual reality device.
  • the virtual reality device obtains the first image Q1 and the second image Q2 from the first memory and the second memory, respectively.
  • the second image Q2 is stretched so that the resolution of the stretched second image Q2 is the same as the display resolution of the virtual reality device.
  • the resolution is stretched from x*y to m*n.
  • the first image Q1 is fused with the stretched second image Q2, and the first image Q1 is replaced by the stretched image.
  • the first image Q1 is set in the gaze area of the user, and an image to be displayed with a resolution of m*n is obtained by fusion.
  • the to-be-displayed image may be processed by a high-definition fusion algorithm to blur the boundary between the first image and the second image.
  • an embodiment of the present disclosure also provides a data transmission method for a virtual reality system, as shown in FIG. 7 , which may include:
  • the received first image is obtained by the virtual reality host intercepting the image in the set area of the image to be transmitted, and the received second image is the virtual reality host to be transmitted.
  • the image in the display area of the image is obtained by compressing the image. Therefore, the data amount of the first image and the second image is smaller than the data amount of the image to be transmitted, thus greatly reducing the transmission bandwidth.
  • the obtained image to be displayed can meet the display requirements of the virtual reality system. Therefore, the display provided by the embodiments of the present disclosure The method can greatly reduce the transmission bandwidth and improve the user experience on the basis of satisfying the display requirements of the virtual reality system.
  • the data transmission method shown in FIG. 7 may be executed on the side of the virtual reality device.
  • the above step S201 may include:
  • the first image is stored in the first memory and the second image is stored in the second memory.
  • the virtual reality device can identify the first image and the second image through the marker bit information, which is convenient for subsequent identification of the first image and the second image.
  • the second image is processed.
  • a first memory and a second memory may be set in the virtual reality device, and after the virtual reality device recognizes each image in the image sequence, the first image is stored in the first memory, and the second image is stored In the second memory, therefore, in the subsequent processing process, the first image and the second image can be acquired in the first memory and the second memory respectively in the corresponding order, thereby reducing the amount of calculation in the subsequent processing process, avoiding Either the first image or the second image is omitted.
  • the above-mentioned step S202 may include:
  • the second image Q2 is stretched so that the resolution of the stretched second image Q2 is the same as the display resolution of the virtual reality device.
  • the resolution of the second image Q2 is stretched from x*y to m*n;
  • the first image Q1 and the stretched second image Q2 are fused to obtain an image to be displayed.
  • the first image Q1 is replaced by the stretched second image Q2
  • the first image Q1 is set in the gaze area of the user, and the image to be displayed with a resolution of m*n is obtained by fusion.
  • the to-be-displayed image can be processed through a high-definition fusion algorithm to blur the boundary between the first image and the second image.
  • the following methods can be used to process the to-be-displayed image:
  • Mode 1 Weighted Average: Compare the pixel values on both sides of the boundary between the first image and the second image, and perform a weighted average on the pixel values on both sides of the boundary.
  • Edge Diffusion The pixel values of the first image are multiplexed outward, so that the boundary between the first image and the second image is extended outward, so that the boundary between the first image and the second image is in the gaze of the human eye. Outside the area, the boundary of the gaze area of the human eye cannot be seen, and the peripheral vision of the human eye cannot see the boundary.
  • Method 3 Gradient blurring; perform gradient blurring processing on the place near the edge of the first image to reduce the sharpness difference on both sides of the boundary, so that the fusion effect of the first image and the second image at the boundary is better. You can't feel the existence of boundaries when watching.
  • an embodiment of the present disclosure also provides a virtual reality host. Since the principle of solving the problem of the virtual reality host is similar to the above-mentioned data transmission method, the implementation of the virtual reality host can refer to the implementation of the above-mentioned data transmission method, The repetition will not be repeated.
  • FIG. 8 is a schematic structural diagram of a virtual reality host provided by an embodiment of the present disclosure.
  • the virtual reality host 30 in the embodiment of the present disclosure may include:
  • the image processing module 301 is used for intercepting the image in the set area of the image to be transmitted to obtain the first image, and compressing the image in the display area of the image to be transmitted to obtain the second image; the set area is a partial area in the display area;
  • the transmission module 302 is used for transmitting the first image and the second image to the virtual reality device in a specific order.
  • the image processing module 301 is specifically configured to: adopt a preset first resolution, a first field of view, and a first refresh rate to set the image to be transmitted.
  • the first image is obtained by performing image sampling in a fixed area; using the preset second resolution, the second field of view and the second refresh rate, the second image is obtained by image sampling in the display area of the image to be transmitted;
  • the two resolutions are the same, and the first refresh rate is greater than or equal to the second refresh rate.
  • the transmission module 302 is specifically configured to: determine the first refresh rate and The second refresh rate of the second image; according to the first refresh rate and the second refresh rate, the frame arrangement of the first image and the second image is performed to obtain an image sequence composed of the first image and the second image, and the image sequence is transmitted to a virtual reality device.
  • the image processing module 301 is further configured to: add flag bit information to the first image and the second image respectively; the flag bit information is used to distinguish the first image and the second image. Second image.
  • an embodiment of the present disclosure also provides a virtual reality device. Since the principle of solving the problem of the virtual reality device is similar to the above-mentioned data transmission method, the implementation of the virtual reality device may refer to the implementation of the above-mentioned data transmission method, The repetition will not be repeated.
  • FIG. 9 is a schematic structural diagram of a virtual reality device provided by an embodiment of the present disclosure.
  • a virtual reality device 40 provided by an embodiment of the present disclosure may include:
  • a receiving module 401 configured to receive the first image and the second image transmitted by the virtual reality host
  • An image fusion module 402 configured to stretch the second image, and fuse the first image with the stretched second image to obtain an image to be displayed;
  • the display module 403 is used for displaying the image to be displayed.
  • the receiving module 401 is specifically configured to: receive the first image and the second image, and distinguish the first image and the second image according to the flag information; The image is stored in the first memory and the second image is stored in the second memory.
  • the image fusion module 402 is specifically configured to: obtain the first image and the second image from the first memory and the second memory respectively; pull the second image stretching, so that the resolution of the stretched second image is the same as the display resolution of the virtual reality device; the first image and the stretched second image are fused to obtain an image to be displayed.
  • an embodiment of the present disclosure also provides a virtual reality system. Since the principle of solving problems of the virtual reality system is similar to the above-mentioned virtual reality host and virtual reality device, the implementation of the virtual reality system can refer to the above-mentioned virtual reality system The implementation of the host and the virtual reality device will not be repeated here.
  • FIG. 10 is a schematic structural diagram of a virtual reality system provided by an embodiment of the present disclosure.
  • the virtual reality system provided by an embodiment of the present disclosure may include: any of the above-mentioned virtual reality hosts 30 and any of the above-mentioned virtual reality devices 40.
  • a first image is obtained by intercepting an image in a set area in an image to be transmitted, and a second image is obtained by compressing an image in a display area in the image to be transmitted , and transmit the first image and the second image in a specific order. Since the data amount of the first image and the second image are both smaller than the data amount of the image to be transmitted, the transmission bandwidth is greatly reduced, and the virtual reality device can The received second image is stretched, and the stretched second image is fused with the received first image, and the obtained image to be displayed can meet the display requirements of the virtual reality system. Therefore, the embodiments of the present disclosure provide The data transmission method can greatly reduce the transmission bandwidth and improve the user experience on the basis of meeting the display requirements of the virtual reality system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Information Transfer Between Computers (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

A data transmission method for a virtual reality system and a related apparatus. The data transmission method comprises: a virtual reality host captures an image in a set region of an image to be transmitted, to obtain a first image, and compresses an image in a display region of the image to be transmitted, to obtain a second image, the set region being a part of the display region (S101); the virtual reality host transmits the first image and the second image to a virtual reality device in a specific order (S102); the virtual reality device receives the first image and the second image (S103); the virtual reality device stretches the second image, and fuses the first image with the stretched second image to obtain an image to be displayed (S104); and the virtual reality device displays the image to be displayed (S105). According to the data transmission method, the display requirements of a virtual reality system are met, transmission bandwidth is greatly reduced, and user experience is improved.

Description

虚拟现实***的数据传输方法及相关装置Data transmission method and related device of virtual reality system
相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS
本申请要求在2020年08月26日提交中国专利局、申请号为202010872960.2、申请名称为“虚拟现实***的数据传输方法及相关装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed on August 26, 2020 with the application number 202010872960.2 and titled "Data Transmission Method and Related Device for Virtual Reality System", the entire contents of which are incorporated by reference in in this application.
技术领域technical field
本公开涉及显示技术领域，尤指一种虚拟现实***的数据传输方法及相关装置。The present disclosure relates to the field of display technology, and in particular, to a data transmission method and related device of a virtual reality system.
背景技术Background technique
虚拟现实(Virtual Reality，VR)技术是最近几年新兴的技术领域。VR显示属于近眼显示领域，为了让用户无法感受到屏幕纱窗效应，达到沉浸式体验，对VR显示屏幕的分辨率和刷新率有较高的要求，这就导致虚拟现实***中的传输带宽增大的问题。Virtual Reality (VR) technology is an emerging technology field in recent years. VR display belongs to the field of near-eye display. In order to prevent users from feeling the screen screen effect and achieve an immersive experience, there are higher requirements for the resolution and refresh rate of the VR display screen, which leads to an increase in the transmission bandwidth in the virtual reality system. The problem.
发明内容SUMMARY OF THE INVENTION
本公开实施提供的虚拟现实***的数据传输方法，其中，包括：The present disclosure provides a data transmission method for a virtual reality system, including:
虚拟现实主机截取待传输图像中设定区域中的图像得到第一图像，对所述待传输图像中显示区域中的图像进行压缩得到第二图像；所述设定区域为所述显示区域中的部分区域；The virtual reality host intercepts the image in the set area of the image to be transmitted to obtain the first image, and compresses the image in the display area of the image to be transmitted to obtain the second image; the set area is the image in the display area. partial area;
所述虚拟现实主机将所述第一图像和所述第二图像按特定顺序传输至虚拟现实设备；The virtual reality host transmits the first image and the second image to the virtual reality device in a specific order;
所述虚拟现实设备接收所述第一图像和所述第二图像；the virtual reality device receives the first image and the second image;
所述虚拟现实设备对所述第二图像进行拉伸，将所述第一图像与拉伸后的所述第二图像进行融合，得到待显示图像；The virtual reality device stretches the second image, and fuses the first image with the stretched second image to obtain an image to be displayed;
所述虚拟现实设备显示所述待显示图像。The virtual reality device displays the to-be-displayed image.
相应地，本公开实施例还提供了一种虚拟现实***的数据传输方法，其中，包括：Correspondingly, an embodiment of the present disclosure also provides a data transmission method for a virtual reality system, including:
截取待传输图像中设定区域中的图像得到第一图像，对所述待传输图像中显示区域中的图像进行压缩得到第二图像；所述设定区域为所述显示区域中的部分区域；The first image is obtained by intercepting the image in the set area in the image to be transmitted, and the second image is obtained by compressing the image in the display area of the image to be transmitted; the set area is a partial area in the display area;
将所述第一图像和所述第二图像按特定顺序传输至虚拟现实设备。The first image and the second image are transmitted to the virtual reality device in a specific order.
可选地，在本公开实施例中，所述截取待传输图像中设定区域中的图像得到第一图像，对待传输图像进行压缩得到第二图像，包括：Optionally, in this embodiment of the present disclosure, the first image is obtained by intercepting an image in a set area in the image to be transmitted, and the second image is obtained by compressing the image to be transmitted, including:
采用预设的第一分辨率、第一视场角以及第一刷新率，对所述待传输图像的设定区域进行图像采样得到所述第一图像；Using a preset first resolution, a first field of view, and a first refresh rate, image sampling is performed on the set area of the to-be-transmitted image to obtain the first image;
采用预设的第二分辨率、第二视场角以及第二刷新率，对所述待传输图像的显示区域进行图像采样得到所述第二图像；Using a preset second resolution, a second field of view and a second refresh rate, image sampling is performed on the display area of the to-be-transmitted image to obtain the second image;
所述第一分辨率与所述第二分辨率相同，所述第一视场角小于所述第二视场角，所述第一刷新率大于或等于所述第二刷新率。The first resolution is the same as the second resolution, the first angle of view is smaller than the second angle of view, and the first refresh rate is greater than or equal to the second refresh rate.
可选地，在本公开实施例中，所述第一刷新率和所述第二刷新率按照以下方式确定：Optionally, in this embodiment of the present disclosure, the first refresh rate and the second refresh rate are determined in the following manner:
根据所述虚拟现实设备的刷新率，以及所述虚拟现实设备的姿态信息，确定所述第一图像的所述第一刷新率和所述第二图像的所述第二刷新率。The first refresh rate of the first image and the second refresh rate of the second image are determined according to the refresh rate of the virtual reality device and the posture information of the virtual reality device.
可选地，在本公开实施例中，所述将所述第一图像和所述第二图像按特定顺序传输至所述虚拟现实设备，包括：Optionally, in this embodiment of the present disclosure, the transmitting the first image and the second image to the virtual reality device in a specific order includes:
根据所述第一刷新率和所述第二刷新率，对所述第一图像和所述第二图像进行帧排列，得到第一图像和第二图像组成的图像序列，并将所述图像序列传输至所述虚拟现实设备。According to the first refresh rate and the second refresh rate, frame arrangement is performed on the first image and the second image to obtain an image sequence composed of the first image and the second image, and the image sequence is transmitted to the virtual reality device.
可选地，在本公开实施例中，所述截取待传输图像中设定区域中的图像得到第一图像，对待传输图像中显示区域中的图像进行压缩得到第二图像，包括：Optionally, in the embodiment of the present disclosure, the first image is obtained by intercepting an image in a set area in the image to be transmitted, and the second image is obtained by compressing the image in the display area in the image to be transmitted, including:
在所述第一图像和所述第二图像中分别增加标志位信息；所述标志位信息用于区分所述第一图像和所述第二图像。Mark bit information is added to the first image and the second image respectively; the marker bit information is used to distinguish the first image and the second image.
相应地，本公开实施例还提供了一种虚拟现实***的数据传输方法，包括：Correspondingly, an embodiment of the present disclosure also provides a data transmission method for a virtual reality system, including:
接收虚拟现实主机传输的第一图像和第二图像；receiving the first image and the second image transmitted by the virtual reality host;
对所述第二图像进行拉伸，将所述第一图像与拉伸后的所述第二图像进行融合，得到待显示图像；Stretching the second image, and fusing the first image with the stretched second image to obtain an image to be displayed;
显示所述待显示图像。The to-be-displayed image is displayed.
可选地，在本公开实施例中，所述接收所述第一图像和所述第二图像，包括：Optionally, in this embodiment of the present disclosure, the receiving the first image and the second image includes:
接收所述第一图像和所述第二图像，并根据标志位信息区分所述第一图像和所述第二图像；receiving the first image and the second image, and distinguishing the first image and the second image according to the flag bit information;
将所述第一图像存储在第一存储器中，将所述第二图像存储在第二存储器中。The first image is stored in a first memory and the second image is stored in a second memory.
可选地，在本公开实施例中，所述对所述图像序列中的所述第二图像进行拉伸，将所述图像序列中的所述第一图像与拉伸后的所述第二图像进行融合，得到待显示图像，包括：Optionally, in this embodiment of the present disclosure, the stretching of the second image in the sequence of images is performed by stretching the first image in the sequence of images with the stretched second image. The images are fused to obtain an image to be displayed, including:
分别从所述第一存储器和所述第二存储器中获取所述第一图像和所述第二图像；obtaining the first image and the second image from the first memory and the second memory, respectively;
对所述第二图像进行拉伸，使拉伸后的所述第二图像的分辨率与所述虚拟现实设备的显示分辨率相同；Stretching the second image, so that the resolution of the stretched second image is the same as the display resolution of the virtual reality device;
将所述第一图像与拉伸后的所述第二图像进行融合，以得到所述待显示图像。The first image and the stretched second image are fused to obtain the to-be-displayed image.
相应地，本公开实施例还提供了一种虚拟现实主机，其中，包括：Correspondingly, an embodiment of the present disclosure also provides a virtual reality host, including:
图像处理模块，用于截取待传输图像中设定区域中的图像得到第一图像，对所述待传输图像中显示区域中的图像进行压缩得到第二图像；所述设定区域为所述显示区域中的部分区域；The image processing module is used for intercepting the image in the set area of the image to be transmitted to obtain the first image, and compressing the image in the display area of the image to be transmitted to obtain the second image; the set area is the display area part of the area;
传输模块，用于将所述第一图像和所述第二图像按特定顺序传输至所述虚拟现实设备。A transmission module, configured to transmit the first image and the second image to the virtual reality device in a specific order.
可选地，在本公开实施例中，所述图像处理模块，具体用于：采用预设的第一分辨率、第一视场角以及第一刷新率，对所述待传输图像的设定区域进行图像采样得到所述第一图像；采用预设的第二分辨率、第二视场角以及第二刷新率，对所述待传输图像的显示区域进行图像采样得到所述第二图像；所述第一分辨率与所述第二分辨率相同，所述第一刷新率大于或等于所述第二刷新率。Optionally, in this embodiment of the present disclosure, the image processing module is specifically configured to: use a preset first resolution, a first field of view, and a first refresh rate to set the image to be transmitted The first image is obtained by image sampling in the area; the second image is obtained by image sampling of the display area of the to-be-transmitted image by adopting a preset second resolution, a second field of view and a second refresh rate; The first resolution is the same as the second resolution, and the first refresh rate is greater than or equal to the second refresh rate.
可选地，在本公开实施例中，所述传输模块，具体用于：根据所述虚拟现实设备的刷新率，以及所述虚拟现实设备的姿态信息，确定所述第一图像的所述第一刷新率和所述第二图像的所述第二刷新率；根据所述第一刷新率和所述第二刷新率，对所述第一图像和所述第二图像进行帧排列，得到第一图像和第二图像组成的图像序列，并将所述图像序列传输至所述虚拟现实设备。Optionally, in the embodiment of the present disclosure, the transmission module is specifically configured to: determine the first image of the first image according to the refresh rate of the virtual reality device and the posture information of the virtual reality device a refresh rate and the second refresh rate of the second image; according to the first refresh rate and the second refresh rate, frame arrangement of the first image and the second image to obtain the first An image sequence consisting of an image and a second image is transmitted to the virtual reality device.
相应地，本公开实施例还提供了一种虚拟现实设备，其中，包括：Correspondingly, an embodiment of the present disclosure also provides a virtual reality device, including:
接收模块，用于接收虚拟现实主机传输的第一图像和第二图像；a receiving module for receiving the first image and the second image transmitted by the virtual reality host;
图像融合模块，用于对所述第二图像进行拉伸，将所述第一图像与拉伸后的所述第二图像进行融合，得到待显示图像；an image fusion module, configured to stretch the second image, and fuse the first image with the stretched second image to obtain an image to be displayed;
显示模块，用于显示所述待显示图像。A display module, configured to display the to-be-displayed image.
可选地，在本公开实施例中，所述接收模块，具体用于：接收所述第一图像和所述第二图像，并根据标志位信息区分所述第一图像和所述第二图像；将所述第一图像存储在第一存储器中，将所述第二图像存储在第二存储器中。Optionally, in this embodiment of the present disclosure, the receiving module is specifically configured to: receive the first image and the second image, and distinguish the first image and the second image according to flag bit information ; storing the first image in a first memory and storing the second image in a second memory.
可选地，在本公开实施例中，所述图像融合模块，具体用于：分别从所述第一存储器和所述第二存储器中获取所述第一图像和所述第二图像；对所述第二图像进行拉伸，使拉伸后的所述第二图像的分辨率与所述虚拟现实设备的显示分辨率相同；将所述第一图像与拉伸后的所述第二图像进行融合，以得到所述待显示图像。Optionally, in this embodiment of the present disclosure, the image fusion module is specifically configured to: acquire the first image and the second image from the first memory and the second memory, respectively; stretch the second image so that the resolution of the stretched second image is the same as the display resolution of the virtual reality device; stretch the first image and the stretched second image fused to obtain the to-be-displayed image.
相应地，本公开实施例还提供了一种虚拟现实***，其中，包括：上述任一虚拟现实主机，以及上述任一虚拟现实设备。Correspondingly, an embodiment of the present disclosure further provides a virtual reality system, which includes: any of the foregoing virtual reality hosts and any of the foregoing virtual reality devices.
附图说明Description of drawings
图1为本公开实施例提供的虚拟现实***的数据传输方法的流程图之一；FIG. 1 is one of the flowcharts of a data transmission method of a virtual reality system provided by an embodiment of the present disclosure;
图2为本公开实施例提供的虚拟现实***的数据传输方法的流程图之二；FIG. 2 is the second flow chart of the data transmission method of the virtual reality system provided by the embodiment of the present disclosure;
图3为本公开实施例中待传输图像的示意图；3 is a schematic diagram of an image to be transmitted in an embodiment of the disclosure;
图4为本公开实施例中第一图像和第二图像的传输顺序示意图之一；FIG. 4 is one of the schematic diagrams of the transmission sequence of the first image and the second image in the embodiment of the present disclosure;
图5为本公开实施例中第一图像和第二图像的传输顺序示意图之二；FIG. 5 is the second schematic diagram of the transmission sequence of the first image and the second image in the embodiment of the present disclosure;
图6为虚拟现实设备对第一图像和第二图像进行融合的过程示意图；6 is a schematic diagram of a process in which a virtual reality device fuses a first image and a second image;
图7为本公开实施例提供的虚拟现实***的数据传输方法的流程图之三；FIG. 7 is the third flowchart of the data transmission method of the virtual reality system provided by the embodiment of the present disclosure;
图8为本公开实施例提供的虚拟现实主机的结构示意图；FIG. 8 is a schematic structural diagram of a virtual reality host provided by an embodiment of the present disclosure;
图9为本公开实施例提供的虚拟现实设备的结构示意图；FIG. 9 is a schematic structural diagram of a virtual reality device provided by an embodiment of the present disclosure;
图10为本公开实施例提供的虚拟现实***的结构示意图。FIG. 10 is a schematic structural diagram of a virtual reality system provided by an embodiment of the present disclosure.
具体实施方式detailed description
针对相关技术中存在的虚拟现实***中的传输带宽较大的问题，本公开实施例提供了一种虚拟现实***的数据传输方法及相关装置。Aiming at the problem of large transmission bandwidth in a virtual reality system existing in the related art, the embodiments of the present disclosure provide a data transmission method and a related device in a virtual reality system.
下面结合附图，对本公开实施例提供的虚拟现实***的数据传输方法及相关装置的具体实施方式进行详细地说明。附图中各部分的大小和形状不反映真实比例，目的只是示意说明本公开内容。The specific implementations of the data transmission method and related apparatus of the virtual reality system provided by the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. The size and shape of the various parts in the drawings do not reflect true scale, and are intended only to illustrate the present disclosure.
本公开实施例提供了一种虚拟现实***的数据传输方法，如图1所示，包括：An embodiment of the present disclosure provides a data transmission method for a virtual reality system, as shown in FIG. 1 , including:
S101、虚拟现实主机截取待传输图像中设定区域中的图像得到第一图像，对待传输图像中显示区域中的图像进行压缩得到第二图像；设定区域为显示区域中的部分区域；S101, the virtual reality host intercepts the image in the set area in the image to be transmitted to obtain the first image, and compresses the image in the display area of the image to be transmitted to obtain the second image; the set area is a partial area in the display area;
S102、虚拟现实主机将第一图像和第二图像按特定顺序传输至虚拟现实 设备；S102, the virtual reality host transmits the first image and the second image to the virtual reality device in a specific order;
S103、虚拟现实设备接收第一图像和第二图像；S103, the virtual reality device receives the first image and the second image;
S104、虚拟现实设备对第二图像进行拉伸，将第一图像与拉伸后的第二图像进行融合，得到待显示图像；S104, the virtual reality device stretches the second image, and fuses the first image with the stretched second image to obtain an image to be displayed;
S105、虚拟现实设备显示待显示图像。S105, the virtual reality device displays the image to be displayed.
本公开实施例提供的虚拟现实***的数据传输方法，虚拟现实主机通过截取待传输图像中设定区域中的图像得到第一图像，对待传输图像中显示区域中的图像进行压缩得到第二图像，并将第一图像和第二图像按特定顺序传输，由于第一图像和第二图像的数据量均小于待传输图像的数据量，因而大幅度减小了传输带宽，并且，虚拟现实设备可以对接收到的第二图像进行拉伸，并将拉伸后的第二图像与接收的第一图像进行融合，得到的待显示图像能够满足虚拟现实***的显示需求，因此，本公开实施例提供的数据传输方法，能够在满足虚拟现实***的显示需求的基础上，大幅降低传输带宽，提升了用户体验度。In the data transmission method of the virtual reality system provided by the embodiment of the present disclosure, the virtual reality host obtains the first image by intercepting the image in the set area in the image to be transmitted, and compresses the image in the display area of the image to be transmitted to obtain the second image, The first image and the second image are transmitted in a specific order. Since the data amount of the first image and the second image is smaller than the data amount of the image to be transmitted, the transmission bandwidth is greatly reduced, and the virtual reality device can The received second image is stretched, and the stretched second image is fused with the received first image, and the obtained image to be displayed can meet the display requirements of the virtual reality system. Therefore, the embodiments of the present disclosure provide The data transmission method can greatly reduce the transmission bandwidth and improve the user experience on the basis of meeting the display requirements of the virtual reality system.
基于同一发明构思，本公开实施例还提供了一种虚拟现实***的数据传输方法，如图2所示，可以包括：Based on the same inventive concept, an embodiment of the present disclosure also provides a data transmission method for a virtual reality system, as shown in FIG. 2 , which may include:
S101、截取待传输图像中设定区域中的图像得到第一图像，对待传输图像中显示区域中的图像进行压缩得到第二图像；设定区域为显示区域中的部分区域；S101, intercepting an image in a set area in an image to be transmitted to obtain a first image, and compressing an image in a display area in the image to be transmitted to obtain a second image; the set area is a partial area in the display area;
S102、将第一图像和第二图像按特定顺序传输至虚拟现实设备。S102. Transmit the first image and the second image to the virtual reality device in a specific order.
本公开实施例提供的虚拟现实***的数据传输方法，虚拟现实主机通过截取待传输图像中设定区域中的图像得到第一图像，对待传输图像中显示区域中的图像进行压缩得到第二图像，并将第一图像和第二图像按特定顺序传输，由于第一图像和第二图像的数据量均小于待传输图像的数据量，因而大幅度减小了传输带宽。In the data transmission method of the virtual reality system provided by the embodiment of the present disclosure, the virtual reality host obtains the first image by intercepting the image in the set area in the image to be transmitted, and compresses the image in the display area of the image to be transmitted to obtain the second image, The first image and the second image are transmitted in a specific order. Since the data amount of the first image and the second image are both smaller than the data amount of the to-be-transmitted image, the transmission bandwidth is greatly reduced.
本公开实施例中，图2所示的数据传输方法可以在虚拟现实主机侧执行，虚拟现实主机与虚拟现实设备可以采用有线或无线的方式实现通信连接，具 体地，虚拟现实主机可以为计算机、手机、平板电脑等具有处理功能的设备。In the embodiment of the present disclosure, the data transmission method shown in FIG. 2 may be executed on the side of the virtual reality host, and the virtual reality host and the virtual reality device may implement communication connection in a wired or wireless manner. Specifically, the virtual reality host may be a computer, Devices with processing functions, such as mobile phones and tablet computers.
图3为本公开实施例中待传输图像的示意图，如图3所示，显示区域A的分辨率为m*n，在上述步骤S101中，截取待传输图像中设定区域中的图像，例如截取图3中区域C中的图像，得到分辨率为x*y的第一图像，得到的第一图像的清晰度与待传输图像的区域C中的清晰度相同，因而不会改变得到的第一图像的清晰度，即第一图像仍为高清图像，并且，第一图像的数据量小于待传输图像的数据量。通过对待传输图像中显示区域中的图像进行压缩得到第二图像，由于第二图像是待传输图像压缩得到的，因而第二图像的数据量小于待传输图像的数据量，并且，第二图像的清晰度小于待传输图像的清晰度。FIG. 3 is a schematic diagram of an image to be transmitted according to an embodiment of the present disclosure. As shown in FIG. 3 , the resolution of the display area A is m*n. The image in area C in FIG. 3 is intercepted to obtain a first image with a resolution of x*y. The clarity of the obtained first image is the same as that in area C of the image to be transmitted, so the obtained first image will not be changed. The definition of an image, that is, the first image is still a high-definition image, and the data amount of the first image is smaller than the data amount of the image to be transmitted. The second image is obtained by compressing the image in the display area of the image to be transmitted. Since the second image is obtained by compressing the image to be transmitted, the data volume of the second image is smaller than that of the image to be transmitted, and the data volume of the second image is smaller than that of the image to be transmitted. The sharpness is less than the sharpness of the image to be transmitted.
在上述步骤S102中，将第一图像和第二图像按特定顺序传输至虚拟现实设备，也就是说，在传输过程中，第一图像与第二图像不同时传输，例如，可以按照图4或图5所示的顺序进行传输，由于第一图像和第二图像的数据量均小于待传输图像，因而，大幅度降低了传输带宽。In the above step S102, the first image and the second image are transmitted to the virtual reality device in a specific order, that is, during the transmission process, the first image and the second image are not transmitted at the same time, for example, according to FIG. 4 or The transmission is performed in the sequence shown in FIG. 5 , since the data amount of the first image and the second image is smaller than that of the to-be-transmitted image, the transmission bandwidth is greatly reduced.
虚拟现实设备接收到第一图像和第二图像后，对第二图像进行拉伸，并将拉伸后的第二图像与第一图像进行融合，得到的待显示图像中，与设定区域对应的区域为清晰度较高的图像，其余区域为清晰度较低的图像。在具体实施时，用户在使用虚拟现实设备时，人眼主要关注屏幕的部分区域，例如屏幕的中心区域，当需要观看周围环境时，用户主要通过转头而不是转动眼球的方式来观看，所以，本公开实施例中得到的待显示图像能够满足图像清晰度要求，并且，可以减少传输带宽，降低图像传输过程中的时延，使用户观看的画面更加流畅，提高了用户体验度。After receiving the first image and the second image, the virtual reality device stretches the second image, and fuses the stretched second image with the first image, and the obtained image to be displayed corresponds to the set area The area of is the image with higher definition, and the rest area is the image with lower definition. In the specific implementation, when the user is using the virtual reality device, the human eye mainly focuses on part of the screen area, such as the central area of the screen. When the user needs to watch the surrounding environment, the user mainly turns his head instead of turning his eyes to watch, so The to-be-displayed image obtained in the embodiment of the present disclosure can meet the image definition requirements, and can reduce the transmission bandwidth and the time delay in the image transmission process, so that the user can watch the picture more smoothly and improve the user experience.
具体地，本公开实施例提供的上述数据传输方法中，上述步骤S101，可以包括：Specifically, in the above data transmission method provided by the embodiment of the present disclosure, the above step S101 may include:
参照图3，采用预设的第一分辨率、第一视场角α以及第一刷新率r1，对待传输图像的设定区域C进行图像采样得到第一图像；在具体实施时，上述设定区域C可以为用户观看屏幕时的注视区域，例如，设定区域C可以为显 示区域A中的中心区域。Referring to FIG. 3 , using a preset first resolution, a first field of view angle α and a first refresh rate r1, image sampling is performed on a set area C of an image to be transmitted to obtain a first image; in specific implementation, the above setting The area C may be the gaze area of the user when viewing the screen, for example, the set area C may be the central area in the display area A.
采用预设的第二分辨率、第二视场角β以及第二刷新率r2，对待传输图像的显示区域A进行图像采样得到第二图像；Using the preset second resolution, the second field of view angle β and the second refresh rate r2, image sampling is performed on the display area A of the image to be transmitted to obtain the second image;
第一分辨率与第二分辨率相同(例如均为x*y)，第一视场角α小于第二视场角β，第一刷新率r1大于或等于第二刷新率r2。The first resolution is the same as the second resolution (for example, both are x*y), the first angle of view α is smaller than the second angle of view β, and the first refresh rate r1 is greater than or equal to the second refresh rate r2.
在采用过程中，结合第一视场角α和第二视场角β，参照图3，第一视场角α可以为用户观看设定区域C的视角，第二视场角β可以为用户观看显示区域A的视角，可以使后续虚拟现实设备融合得到的待显示图像，与用户的观看视角更加契合，能够实现沉浸式体验。由于第一图像对应于用户的注视区域，而第二图像对应于周边区域，因而，第二刷新率r2可以小于第一刷新率r1，以保证用户的注视区域的清晰度较高。In the process of adoption, combined with the first angle of view α and the second angle of view β, referring to FIG. 3 , the first angle of view α may be the viewing angle of the user viewing the set area C, and the second angle of view β may be the user’s viewing angle Viewing the viewing angle of the display area A can make the image to be displayed obtained by the fusion of the subsequent virtual reality device more in line with the viewing angle of the user, enabling an immersive experience. Since the first image corresponds to the user's gaze area, and the second image corresponds to the peripheral area, the second refresh rate r2 may be smaller than the first refresh rate r1 to ensure high definition of the user's gaze area.
并且，第一图像和第二图像的分辨率相同，可以使传输过程中各图像的分辨率是相同的，保证传输过程的流畅性。举例来说，以显示区域A的分辨率为m*n，第一分辨率为x*y为例，若直接传输待传输图像，则传输带宽为m*n*r，本公开实施例中，传输第一图像和第二图像的传输带宽为x*y*r，其中，r表示虚拟现实设备的刷新率，可见，本公开实施例中的传输带宽明显降低，传输带宽的压缩比例为(m*n)/(x*y)。另外，对第一图像和第二图像的采样分辨率相同，但是对第二图像的采样区域大于第一图像的采样区域，因而，得到的第一图像比第二图像的清晰度更高。Moreover, the resolutions of the first image and the second image are the same, so that the resolutions of each image during the transmission process can be the same, thereby ensuring the smoothness of the transmission process. For example, taking the resolution of the display area A as m*n and the first resolution as x*y as an example, if the image to be transmitted is directly transmitted, the transmission bandwidth is m*n*r. In this embodiment of the present disclosure, The transmission bandwidth for transmitting the first image and the second image is x*y*r, where r represents the refresh rate of the virtual reality device. It can be seen that the transmission bandwidth in the embodiment of the present disclosure is significantly reduced, and the compression ratio of the transmission bandwidth is (m *n)/(x*y). In addition, the sampling resolution of the first image and the second image is the same, but the sampling area of the second image is larger than that of the first image, so the obtained first image has higher definition than the second image.
在具体实施时，本公开实施例提供的上述数据传输方法中，上述第一刷新率和第二刷新率可以按照以下方式确定：During specific implementation, in the data transmission method provided by the embodiment of the present disclosure, the first refresh rate and the second refresh rate may be determined in the following manner:
根据虚拟现实设备的刷新率，以及虚拟现实设备的姿态信息，确定第一图像的第一刷新率和第二图像的第二刷新率。According to the refresh rate of the virtual reality device and the posture information of the virtual reality device, the first refresh rate of the first image and the second refresh rate of the second image are determined.
在具体实施时，在虚拟现实设备中一般设有陀螺仪等传感器，虚拟现实设备可以通过陀螺仪等传感器获得姿态信息，并根据姿态信息确定虚拟现实设备为运动状态还是静止状态，例如可以设置相应的阈值，姿态信息大于阈值时，表示虚拟现实设备为运动状态，姿态信息小于阈值时，表示虚拟现实 设备为静止状态。当虚拟现实设备为运动状态时，由于人眼的动态模糊情况，对于画面的清晰度的敏感度降低，此时，可以降低图像序列中第一图像的比例，即降低第一图像的第一刷新率，例如可以按照图5所示的第一图像Q1与第二图像Q2交替传输的方式进行传输，即第一刷新率可以与第二刷新率相等。当虚拟现实设备为静止状态时，由于人眼对画面清晰度的敏感度上升，即需要提高第一图像的第一刷新率，此时，需要提高图像序列中第一图像的比例，例如可以按照图4所示的连续传输k个第一图像Q1、传输1个第二图像Q2的顺序周期性传输，即第一刷新率大于第二刷新率。During specific implementation, sensors such as gyroscopes are generally provided in the virtual reality device. The virtual reality device can obtain attitude information through sensors such as gyroscopes, and determine whether the virtual reality device is in a motion state or a static state according to the attitude information. For example, you can set the corresponding When the posture information is greater than the threshold, it means that the virtual reality device is in a moving state, and when the posture information is less than the threshold, it means that the virtual reality device is in a static state. When the virtual reality device is in motion, the sensitivity to the clarity of the picture is reduced due to the dynamic blur of the human eye. At this time, the proportion of the first image in the image sequence can be reduced, that is, the first refresh rate of the first image can be reduced. For example, the first image Q1 and the second image Q2 may be transmitted alternately as shown in FIG. 5 , that is, the first refresh rate may be equal to the second refresh rate. When the virtual reality device is in a static state, the sensitivity of the human eye to the picture definition increases, that is, the first refresh rate of the first image needs to be increased. At this time, the ratio of the first image in the image sequence needs to be increased. The sequence of continuous transmission of k first images Q1 and transmission of one second image Q2 shown in FIG. 4 is periodic transmission, that is, the first refresh rate is greater than the second refresh rate.
在具体实施时，可以预先设置至少两个传输模式，例如，可以设置两种传输模式，第一传输模式适用于运动状态，其中，第一刷新率等于第二刷新率，第二传输模式适用于静止状态，其中，第一刷新率大于第二刷新率，可以结合虚拟现实设备的刷新率，确定各传输模式中第一刷新率和第二刷新率的具体数值，也可以设置更多传输模式，此处不做限定。在具体实施时，在上述步骤S101中，可以根据确定的第一刷新率对设定区域进行采样得到第一图像，根据第二刷新率对显示区域进行采样得到第二图像，以使最终形成的待显示图像与用户当前状态更加契合。During specific implementation, at least two transmission modes may be preset, for example, two transmission modes may be set, the first transmission mode is suitable for the motion state, wherein the first refresh rate is equal to the second refresh rate, and the second transmission mode is suitable for Static state, in which the first refresh rate is greater than the second refresh rate, the specific values of the first refresh rate and the second refresh rate in each transmission mode can be determined in combination with the refresh rate of the virtual reality device, and more transmission modes can be set, There is no limitation here. During specific implementation, in the above step S101, the first image may be obtained by sampling the set area according to the determined first refresh rate, and the second image may be obtained by sampling the display area according to the second refresh rate, so that the final image The image to be displayed is more in line with the current state of the user.
在具体实施时，本公开实施例提供的上述数据传输方法中，上述步骤S102，可以包括：During specific implementation, in the above-mentioned data transmission method provided by the embodiment of the present disclosure, the above-mentioned step S102 may include:
根据第一刷新率和第二刷新率，对第一图像和第二图像进行帧排列，得到第一图像和第二图像组成的图像序列，并将图像序列传输至虚拟现实设备。According to the first refresh rate and the second refresh rate, the frames of the first image and the second image are arranged to obtain an image sequence composed of the first image and the second image, and the image sequence is transmitted to the virtual reality device.
在虚拟现实设备的显示过程中，屏幕显示的画面是不断变化的，为了保证虚拟现实设备显示画面的连续性，虚拟现实主机需要持续地向虚拟现实设备传输第一图像和第二图像。具体地，可以根据虚拟现实设备的刷新率，对第一图像和第二图像进行帧排列，其中，第一图像的刷新率与第二图像的刷新率之和，为虚拟现实设备的刷新率，即r＝r1+r2，其中，r表示虚拟现实设备的刷新率，r1表示第一图像的刷新率，r2表示第二图像的刷新率。例如虚拟现实设备的刷新率为90Hz，也就是每秒刷新90次，则可以按照9帧第一 图像、1帧第二图像的顺序周期性传输，其中，第一图像的刷新率为81Hz，第二图像的刷新率为9Hz。如图4所示，可以按照连续传输k个第一图像Q1、传输1个第二图像Q2的顺序周期性传输，如图5所示，也可以按照第一图像Q1和第二图像Q2交替传输。During the display process of the virtual reality device, the images displayed on the screen are constantly changing. In order to ensure the continuity of the displayed images of the virtual reality device, the virtual reality host needs to continuously transmit the first image and the second image to the virtual reality device. Specifically, the frame arrangement of the first image and the second image may be performed according to the refresh rate of the virtual reality device, wherein the sum of the refresh rate of the first image and the refresh rate of the second image is the refresh rate of the virtual reality device, That is, r=r1+r2, where r represents the refresh rate of the virtual reality device, r1 represents the refresh rate of the first image, and r2 represents the refresh rate of the second image. For example, if the refresh rate of the virtual reality device is 90Hz, that is, 90 times per second, it can be periodically transmitted in the order of 9 frames of the first image and 1 frame of the second image. The refresh rate of the second image is 9Hz. As shown in FIG. 4 , k first images Q1 and one second image Q2 may be transmitted periodically in the order of continuous transmission. As shown in FIG. 5 , the first image Q1 and the second image Q2 may be transmitted alternately. .
在具体实施时，可以在虚拟现实主机中设置存储器，以存储上述步骤S101中得到的第一图像和第二图像，例如可以设置两个存储器分别存储第一图像和第二图像，并在虚拟现实主机中设置计数器，以虚拟现实设备的刷新率为90Hz，按照9帧第一图像、1帧第二图像的顺序周期性传输为例，虚拟现实主机会控制计数器进行计数，0～8时刻分别读取9帧第一图像的内存地址，并将各第一图像依次传输出去，9时刻读取1帧第二图像的内存地址，并将第二图像传输出去，同时计数器清零，即完成一个周期的图像序列的传输。During specific implementation, a memory may be set in the virtual reality host to store the first image and the second image obtained in the above step S101, for example, two memories may be set to store the first image and the second image respectively, and the virtual reality host A counter is set in the host, and the refresh rate of the virtual reality device is 90Hz, and it is periodically transmitted in the order of 9 frames of the first image and 1 frame of the second image. Take the memory address of 9 frames of the first image, and transmit each first image in sequence, read the memory address of 1 frame of the second image at 9 time, and transmit the second image, and the counter is cleared at the same time, that is, a cycle is completed transmission of image sequences.
在具体实施时，本公开实施例提供的上述数据传输方法中，上述步骤S101，可以包括：During specific implementation, in the above-mentioned data transmission method provided by the embodiment of the present disclosure, the above-mentioned step S101 may include:
在第一图像和第二图像中分别增加标志位信息；标志位信息用于区分第一图像和第二图像。例如，可以在第一图像和第二图像的第一行前a个数据设置为标志数据，以作为标志信息，也可以将标志位信息设置在其他位置，此处不做限定。并且，第一图像中的标志信息与第二图像中的标志信息不同，因而可以通过标志信息区分第一图像和第二图像。Mark bit information is added to the first image and the second image respectively; the marker bit information is used to distinguish the first image and the second image. For example, the first data of the first image and the first row of the second image may be set as flag data as the flag information, and the flag bit information may also be set in other positions, which is not limited here. Moreover, the flag information in the first image is different from the flag information in the second image, so the first image and the second image can be distinguished by the flag information.
通过在第一图像和第二图像中增加标志位信息，虚拟现实设备接收到图像序列后，可以通过标志位信息识别第一图像和第二图像，便于后续对第一图像和第二图像进行处理。并且，在具体实施时，可以在虚拟现实设备中设置第一存储器和第二存储器，虚拟现实设备识别图像序列中的各图像后，将第一图像存储在第一存储器中，将第二图像存储在第二存储器中，因而，在后续处理过程中，可以按照相应的顺序在第一存储器和第二存储器中分别获取第一图像和第二图像，从而减小后续处理过程中的计算量，避免遗漏第一图像或第二图像。By adding the marker bit information to the first image and the second image, after receiving the image sequence, the virtual reality device can identify the first image and the second image through the marker bit information, which is convenient for subsequent processing of the first image and the second image. . In addition, during specific implementation, a first memory and a second memory may be set in the virtual reality device, and after the virtual reality device recognizes each image in the image sequence, the first image is stored in the first memory, and the second image is stored In the second memory, therefore, in the subsequent processing process, the first image and the second image can be acquired in the first memory and the second memory respectively in the corresponding order, thereby reducing the amount of calculation in the subsequent processing process, avoiding Either the first image or the second image is omitted.
并且，通过在第一图像和第二图像中设置标志位信息，在第一存储器和 第二存储器中存入新一帧画面的图像，则第一存储器和第二存储器可以将前一帧画面的图像舍弃，使第一存储器和第二存储器中存储的第一图像和第二图像为当前帧需要的图像，这样，可以直接在第一存储器和第二存储器中获取第一图像和第二图像，无需考虑图像帧的顺序，以减小数据计算量。In addition, by setting the flag bit information in the first image and the second image, and storing the image of a new frame in the first memory and the second memory, the first memory and the second memory can store the image of the previous frame. The image is discarded, so that the first image and the second image stored in the first memory and the second memory are the images required by the current frame, so that the first image and the second image can be directly obtained in the first memory and the second memory, There is no need to consider the order of image frames to reduce the amount of data computation.
图6为虚拟现实设备对第一图像和第二图像进行融合的过程示意图，如图6所示，虚拟现实设备分别从第一存储器和第二存储器中获取第一图像Q1和第二图像Q2，如图中箭头T1所示的过程，对第二图像Q2进行拉伸，使拉伸后的第二图像Q2的分辨率与虚拟现实设备的显示分辨率相同，例如图中将第二图像Q2的分辨率从x*y拉伸为m*n，如图中箭头T2所示的过程，将第一图像Q1与拉伸后的第二图像Q2进行融合，将第一图像Q1替代拉伸后的第二图像Q2中虚线框所示的位置处，即将第一图像Q1设置在用户的注视区域中，经融合得到分辨率为m*n的待显示图像。此外，可以通过高清融合算法对待显示图像进行处理，以模糊第一图像与第二图像之间的界限。FIG. 6 is a schematic diagram of the process of fusing the first image and the second image by the virtual reality device. As shown in FIG. 6 , the virtual reality device obtains the first image Q1 and the second image Q2 from the first memory and the second memory, respectively, In the process shown by the arrow T1 in the figure, the second image Q2 is stretched so that the resolution of the stretched second image Q2 is the same as the display resolution of the virtual reality device. The resolution is stretched from x*y to m*n. In the process shown by the arrow T2 in the figure, the first image Q1 is fused with the stretched second image Q2, and the first image Q1 is replaced by the stretched image. At the position shown by the dotted box in the second image Q2, that is, the first image Q1 is set in the gaze area of the user, and an image to be displayed with a resolution of m*n is obtained by fusion. In addition, the to-be-displayed image may be processed by a high-definition fusion algorithm to blur the boundary between the first image and the second image.
基于同一发明构思，本公开实施例还提供了一种虚拟现实***的数据传输方法，如图7所示，可以包括：Based on the same inventive concept, an embodiment of the present disclosure also provides a data transmission method for a virtual reality system, as shown in FIG. 7 , which may include:
S201、接收虚拟现实主机传输的第一图像和第二图像；S201, receiving the first image and the second image transmitted by the virtual reality host;
S202、对第二图像进行拉伸，将第一图像与拉伸后的第二图像进行融合，得到待显示图像；S202, stretching the second image, and fusing the first image with the stretched second image to obtain an image to be displayed;
S203、显示待显示图像。S203, displaying the image to be displayed.
本公开实施例提供的虚拟显示***的数据传输方法，接收到的第一图像为虚拟现实主机截取待传输图像中设定区域中的图像得到的，接收到的第二图像为虚拟现实主机对待传输图像中显示区域中的图像进行压缩得到的，因而，第一图像和第二图像的数据量均小于待传输图像的数据量，因而大幅度减小了传输带宽。并且，通过对第二图像进行拉伸，并将拉伸后的第二图像与第一图像进行融合，得到的待显示图像能够满足虚拟现实***的显示需求，因此，本公开实施例提供的显示方法，能够在满足虚拟现实***的显示需求的基础上，大幅降低传输带宽，提升了用户体验度。In the data transmission method of the virtual display system provided by the embodiment of the present disclosure, the received first image is obtained by the virtual reality host intercepting the image in the set area of the image to be transmitted, and the received second image is the virtual reality host to be transmitted. The image in the display area of the image is obtained by compressing the image. Therefore, the data amount of the first image and the second image is smaller than the data amount of the image to be transmitted, thus greatly reducing the transmission bandwidth. In addition, by stretching the second image and fusing the stretched second image with the first image, the obtained image to be displayed can meet the display requirements of the virtual reality system. Therefore, the display provided by the embodiments of the present disclosure The method can greatly reduce the transmission bandwidth and improve the user experience on the basis of satisfying the display requirements of the virtual reality system.
本公开实施例中，图7所示的数据传输方法可以在虚拟现实设备侧执行。In this embodiment of the present disclosure, the data transmission method shown in FIG. 7 may be executed on the side of the virtual reality device.
可选地，本公开实施例提供的上述数据传输方法中，上述步骤S201，可以包括：Optionally, in the above data transmission method provided by the embodiment of the present disclosure, the above step S201 may include:
接收第一图像和第二图像，并根据标志位信息区分第一图像和第二图像；receiving the first image and the second image, and distinguishing the first image and the second image according to the flag bit information;
将第一图像存储在第一存储器中，将第二图像存储在第二存储器中。The first image is stored in the first memory and the second image is stored in the second memory.
由于第一图像和第二图像中设有标志位信息，虚拟现实设备接收到第一图像和第二图像后，可以通过标志位信息识别第一图像和第二图像，便于后续对第一图像和第二图像进行处理。并且，在具体实施时，可以在虚拟现实设备中设置第一存储器和第二存储器，虚拟现实设备识别图像序列中的各图像后，将第一图像存储在第一存储器中，将第二图像存储在第二存储器中，因而，在后续处理过程中，可以按照相应的顺序在第一存储器和第二存储器中分别获取第一图像和第二图像，从而减小后续处理过程中的计算量，避免遗漏第一图像或第二图像。Since the first image and the second image are provided with the marker bit information, after receiving the first image and the second image, the virtual reality device can identify the first image and the second image through the marker bit information, which is convenient for subsequent identification of the first image and the second image. The second image is processed. In addition, during specific implementation, a first memory and a second memory may be set in the virtual reality device, and after the virtual reality device recognizes each image in the image sequence, the first image is stored in the first memory, and the second image is stored In the second memory, therefore, in the subsequent processing process, the first image and the second image can be acquired in the first memory and the second memory respectively in the corresponding order, thereby reducing the amount of calculation in the subsequent processing process, avoiding Either the first image or the second image is omitted.
在具体实施时，本公开实施例提供的上述数据传输方法中，上述步骤S202，可以包括：During specific implementation, in the above-mentioned data transmission method provided by the embodiment of the present disclosure, the above-mentioned step S202 may include:
分别从第一存储器和第二存储器中获取第一图像和第二图像；obtaining the first image and the second image from the first memory and the second memory, respectively;
参照图6，如图中箭头T1所示的过程，对第二图像Q2进行拉伸，使拉伸后的第二图像Q2的分辨率与虚拟现实设备的显示分辨率相同，例如图中将第二图像Q2的分辨率从x*y拉伸为m*n；Referring to FIG. 6 , in the process shown by the arrow T1 in the figure, the second image Q2 is stretched so that the resolution of the stretched second image Q2 is the same as the display resolution of the virtual reality device. The resolution of the second image Q2 is stretched from x*y to m*n;
如图中箭头T2所示的过程，将第一图像Q1与拉伸后的第二图像Q2进行融合，以得到待显示图像，如图中将第一图像Q1替代拉伸后的第二图像Q2中虚线框所示的位置处，即将第一图像Q1设置在用户的注视区域中，经融合得到分辨率为m*n的待显示图像。In the process shown by the arrow T2 in the figure, the first image Q1 and the stretched second image Q2 are fused to obtain an image to be displayed. As shown in the figure, the first image Q1 is replaced by the stretched second image Q2 At the position shown by the dotted box, that is, the first image Q1 is set in the gaze area of the user, and the image to be displayed with a resolution of m*n is obtained by fusion.
此外，可以通过高清融合算法对待显示图像进行处理，以模糊第一图像与第二图像之间的界限，具体地，可以采用以下几种方式，对待显示图像进行处理：In addition, the to-be-displayed image can be processed through a high-definition fusion algorithm to blur the boundary between the first image and the second image. Specifically, the following methods can be used to process the to-be-displayed image:
方式一：加权平均：比较第一图像与第二图像之间的界限两边的像素值， 对界限两边的像素值进行加权平均。Mode 1: Weighted Average: Compare the pixel values on both sides of the boundary between the first image and the second image, and perform a weighted average on the pixel values on both sides of the boundary.
方式二：边缘扩散：将第一图像的像素值向外复用，使第一图像和第二图像之间的界限向外延伸，从而使第一图像和第二图像的边界在人眼的注视区域外侧，使人眼的注视区域看不到界限，并且人眼的余光看不清界限。Method 2: Edge Diffusion: The pixel values of the first image are multiplexed outward, so that the boundary between the first image and the second image is extended outward, so that the boundary between the first image and the second image is in the gaze of the human eye. Outside the area, the boundary of the gaze area of the human eye cannot be seen, and the peripheral vision of the human eye cannot see the boundary.
方式三：渐变模糊；对第一图像靠近边缘的地方，进行渐变模糊处理，减小界限两侧的清晰度差异，使第一图像和第二图像在界限处的融合效果更好，人眼在观看时感觉不到界限的存在。Method 3: Gradient blurring; perform gradient blurring processing on the place near the edge of the first image to reduce the sharpness difference on both sides of the boundary, so that the fusion effect of the first image and the second image at the boundary is better. You can't feel the existence of boundaries when watching.
基于同一发明构思，本公开实施例还提供了一种虚拟现实主机，由于该虚拟现实主机解决问题的原理与上述数据传输方法相似，因此该虚拟现实主机的实施可以参见上述数据传输方法的实施，重复之处不再赘述。Based on the same inventive concept, an embodiment of the present disclosure also provides a virtual reality host. Since the principle of solving the problem of the virtual reality host is similar to the above-mentioned data transmission method, the implementation of the virtual reality host can refer to the implementation of the above-mentioned data transmission method, The repetition will not be repeated.
图8为本公开实施例提供的虚拟现实主机的结构示意图，如图8所示，本公开实施例中的虚拟现实主机30，可以包括：FIG. 8 is a schematic structural diagram of a virtual reality host provided by an embodiment of the present disclosure. As shown in FIG. 8 , the virtual reality host 30 in the embodiment of the present disclosure may include:
图像处理模块301，用于截取待传输图像中设定区域中的图像得到第一图像，对待传输图像中显示区域中的图像进行压缩得到第二图像；设定区域为显示区域中的部分区域；The image processing module 301 is used for intercepting the image in the set area of the image to be transmitted to obtain the first image, and compressing the image in the display area of the image to be transmitted to obtain the second image; the set area is a partial area in the display area;
传输模块302，用于将第一图像和第二图像按特定顺序传输至虚拟现实设备。The transmission module 302 is used for transmitting the first image and the second image to the virtual reality device in a specific order.
可选地，本公开实施例提供的上述虚拟现实主机中，图像处理模块301，具体用于：采用预设的第一分辨率、第一视场角以及第一刷新率，对待传输图像的设定区域进行图像采样得到第一图像；采用预设的第二分辨率、第二视场角以及第二刷新率，对待传输图像的显示区域进行图像采样得到第二图像；第一分辨率与第二分辨率相同，第一刷新率大于或等于第二刷新率。Optionally, in the above-mentioned virtual reality host provided by the embodiment of the present disclosure, the image processing module 301 is specifically configured to: adopt a preset first resolution, a first field of view, and a first refresh rate to set the image to be transmitted. The first image is obtained by performing image sampling in a fixed area; using the preset second resolution, the second field of view and the second refresh rate, the second image is obtained by image sampling in the display area of the image to be transmitted; The two resolutions are the same, and the first refresh rate is greater than or equal to the second refresh rate.
可选地，本公开实施例提供的上述虚拟现实主机中，传输模块302，具体用于：根据虚拟现实设备的刷新率，以及虚拟现实设备的姿态信息，确定第一图像的第一刷新率和第二图像的第二刷新率；根据第一刷新率和第二刷新率，对第一图像和第二图像进行帧排列，得到第一图像和第二图像组成的图像序列，并将图像序列传输至虚拟现实设备。Optionally, in the above-mentioned virtual reality host provided by the embodiment of the present disclosure, the transmission module 302 is specifically configured to: determine the first refresh rate and The second refresh rate of the second image; according to the first refresh rate and the second refresh rate, the frame arrangement of the first image and the second image is performed to obtain an image sequence composed of the first image and the second image, and the image sequence is transmitted to a virtual reality device.
可选地，本公开实施例提供的上述虚拟现实主机中，图像处理模块301，还用于：第一图像和第二图像中分别增加标志位信息；标志位信息用于区分第一图像和第二图像。Optionally, in the above-mentioned virtual reality host provided by the embodiment of the present disclosure, the image processing module 301 is further configured to: add flag bit information to the first image and the second image respectively; the flag bit information is used to distinguish the first image and the second image. Second image.
基于同一发明构思，本公开实施例还提供了一种虚拟现实设备，由于该虚拟现实设备解决问题的原理与上述数据传输方法相似，因此该虚拟现实设备的实施可以参见上述数据传输方法的实施，重复之处不再赘述。Based on the same inventive concept, an embodiment of the present disclosure also provides a virtual reality device. Since the principle of solving the problem of the virtual reality device is similar to the above-mentioned data transmission method, the implementation of the virtual reality device may refer to the implementation of the above-mentioned data transmission method, The repetition will not be repeated.
图9为本公开实施例提供的虚拟现实设备的结构示意图，如图9所示，本公开实施例提供的虚拟现实设备40，可以包括：FIG. 9 is a schematic structural diagram of a virtual reality device provided by an embodiment of the present disclosure. As shown in FIG. 9 , a virtual reality device 40 provided by an embodiment of the present disclosure may include:
接收模块401，用于接收虚拟现实主机传输的第一图像和第二图像；a receiving module 401, configured to receive the first image and the second image transmitted by the virtual reality host;
图像融合模块402，用于对第二图像进行拉伸，将第一图像与拉伸后的第二图像进行融合，得到待显示图像；An image fusion module 402, configured to stretch the second image, and fuse the first image with the stretched second image to obtain an image to be displayed;
显示模块403，用于显示待显示图像。The display module 403 is used for displaying the image to be displayed.
可选地，本公开实施例提供的上述虚拟现实设备中，接收模块401，具体用于：接收第一图像和第二图像，并根据标志位信息区分第一图像和第二图像；将第一图像存储在第一存储器中，将第二图像存储在第二存储器中。Optionally, in the above-mentioned virtual reality device provided by the embodiment of the present disclosure, the receiving module 401 is specifically configured to: receive the first image and the second image, and distinguish the first image and the second image according to the flag information; The image is stored in the first memory and the second image is stored in the second memory.
可选地，本公开实施例提供的上述虚拟现实设备中，图像融合模块402，具体用于：分别从第一存储器和第二存储器中获取第一图像和第二图像；对第二图像进行拉伸，使拉伸后的第二图像的分辨率与虚拟现实设备的显示分辨率相同；将第一图像与拉伸后的第二图像进行融合，以得到待显示图像。Optionally, in the above-mentioned virtual reality device provided by the embodiment of the present disclosure, the image fusion module 402 is specifically configured to: obtain the first image and the second image from the first memory and the second memory respectively; pull the second image stretching, so that the resolution of the stretched second image is the same as the display resolution of the virtual reality device; the first image and the stretched second image are fused to obtain an image to be displayed.
基于同一发明构思，本公开实施例还提供了一种虚拟现实***，由于该虚拟现实***解决问题的原理与上述虚拟现实主机和虚拟现实设备相似，因此该虚拟现实***的实施可以参见上述虚拟现实主机和虚拟现实设备的实施，重复之处不再赘述。Based on the same inventive concept, an embodiment of the present disclosure also provides a virtual reality system. Since the principle of solving problems of the virtual reality system is similar to the above-mentioned virtual reality host and virtual reality device, the implementation of the virtual reality system can refer to the above-mentioned virtual reality system The implementation of the host and the virtual reality device will not be repeated here.
图10为本公开实施例提供的虚拟现实***的结构示意图，如图10所示，本公开实施例提供的虚拟现实***，可以包括：上述任一虚拟现实主机30，以及上述任一虚拟现实设备40。FIG. 10 is a schematic structural diagram of a virtual reality system provided by an embodiment of the present disclosure. As shown in FIG. 10 , the virtual reality system provided by an embodiment of the present disclosure may include: any of the above-mentioned virtual reality hosts 30 and any of the above-mentioned virtual reality devices 40.
本公开实施例提供的虚拟现实***的数据传输方法及相关装置，通过截 取待传输图像中设定区域中的图像得到第一图像，并对待传输图像中显示区域中的图像进行压缩得到第二图像，并将第一图像和第二图像按特定顺序传输，由于第一图像和第二图像的数据量均小于待传输图像的数据量，因而大幅度减小了传输带宽，并且，虚拟现实设备可以对接收到的第二图像进行拉伸，并将拉伸后的第二图像与接收的第一图像进行融合，得到的待显示图像能够满足虚拟现实***的显示需求，因此，本公开实施例提供的数据传输方法，能够在满足虚拟现实***的显示需求的基础上，大幅降低传输带宽，提升了用户体验度。In the data transmission method and related device of a virtual reality system provided by the embodiments of the present disclosure, a first image is obtained by intercepting an image in a set area in an image to be transmitted, and a second image is obtained by compressing an image in a display area in the image to be transmitted , and transmit the first image and the second image in a specific order. Since the data amount of the first image and the second image are both smaller than the data amount of the image to be transmitted, the transmission bandwidth is greatly reduced, and the virtual reality device can The received second image is stretched, and the stretched second image is fused with the received first image, and the obtained image to be displayed can meet the display requirements of the virtual reality system. Therefore, the embodiments of the present disclosure provide The data transmission method can greatly reduce the transmission bandwidth and improve the user experience on the basis of meeting the display requirements of the virtual reality system.
显然，本领域的技术人员可以对本公开进行各种改动和变型而不脱离本公开的精神和范围。这样，倘若本公开的这些修改和变型属于本公开权利要求及其等同技术的范围之内，则本公开也意图包含这些改动和变型在内。It will be apparent to those skilled in the art that various modifications and variations can be made in the present disclosure without departing from the spirit and scope of the present disclosure. Thus, provided that these modifications and variations of the present disclosure fall within the scope of the claims of the present disclosure and their equivalents, the present disclosure is also intended to cover such modifications and variations.

Claims (16)

  1. 一种虚拟显示***的数据传输方法，其中，包括：A data transmission method for a virtual display system, comprising:
    虚拟现实主机截取待传输图像中设定区域中的图像得到第一图像，对所述待传输图像中显示区域中的图像进行压缩得到第二图像；所述设定区域为所述显示区域中的部分区域；The virtual reality host intercepts the image in the set area of the image to be transmitted to obtain the first image, and compresses the image in the display area of the image to be transmitted to obtain the second image; the set area is the image in the display area. partial area;
    所述虚拟现实主机将所述第一图像和所述第二图像按特定顺序传输至虚拟现实设备；The virtual reality host transmits the first image and the second image to the virtual reality device in a specific order;
    所述虚拟现实设备接收所述第一图像和所述第二图像；the virtual reality device receives the first image and the second image;
    所述虚拟现实设备对所述第二图像进行拉伸，将所述第一图像与拉伸后的所述第二图像进行融合，得到待显示图像；The virtual reality device stretches the second image, and fuses the first image with the stretched second image to obtain an image to be displayed;
    所述虚拟现实设备显示所述待显示图像。The virtual reality device displays the to-be-displayed image.
  2. 一种虚拟现实***的数据传输方法，其中，包括：A data transmission method for a virtual reality system, comprising:
    截取待传输图像中设定区域中的图像得到第一图像，对所述待传输图像中显示区域中的图像进行压缩得到第二图像；所述设定区域为所述显示区域中的部分区域；The first image is obtained by intercepting the image in the set area in the image to be transmitted, and the second image is obtained by compressing the image in the display area of the image to be transmitted; the set area is a partial area in the display area;
    将所述第一图像和所述第二图像按特定顺序传输至虚拟现实设备。The first image and the second image are transmitted to the virtual reality device in a specific order.
  3. 如权利要求2所述的数据传输方法，其中，所述截取待传输图像中设定区域中的图像得到第一图像，对待传输图像进行压缩得到第二图像，包括：The data transmission method according to claim 2, wherein the first image is obtained by intercepting the image in the set area in the image to be transmitted, and the second image is obtained by compressing the to-be-transmitted image, comprising:
    采用预设的第一分辨率、第一视场角以及第一刷新率，对所述待传输图像的设定区域进行图像采样得到所述第一图像；Using a preset first resolution, a first field of view, and a first refresh rate, image sampling is performed on the set area of the to-be-transmitted image to obtain the first image;
    采用预设的第二分辨率、第二视场角以及第二刷新率，对所述待传输图像的显示区域进行图像采样得到所述第二图像；Using a preset second resolution, a second field of view and a second refresh rate, image sampling is performed on the display area of the to-be-transmitted image to obtain the second image;
    所述第一分辨率与所述第二分辨率相同，所述第一视场角小于所述第二视场角，所述第一刷新率大于或等于所述第二刷新率。The first resolution is the same as the second resolution, the first angle of view is smaller than the second angle of view, and the first refresh rate is greater than or equal to the second refresh rate.
  4. 如权利要求3所述的数据传输方法，其中，所述第一刷新率和所述第二刷新率按照以下方式确定：The data transmission method of claim 3, wherein the first refresh rate and the second refresh rate are determined in the following manner:
    根据所述虚拟现实设备的刷新率，以及所述虚拟现实设备的姿态信息，确定所述第一图像的所述第一刷新率和所述第二图像的所述第二刷新率。The first refresh rate of the first image and the second refresh rate of the second image are determined according to the refresh rate of the virtual reality device and the posture information of the virtual reality device.
  5. 如权利要求3所述的数据传输方法，其中，所述将所述第一图像和所述第二图像按特定顺序传输至所述虚拟现实设备，包括：The data transmission method of claim 3, wherein the transmitting the first image and the second image to the virtual reality device in a specific order comprises:
    根据所述第一刷新率和所述第二刷新率，对所述第一图像和所述第二图像进行帧排列，得到第一图像和第二图像组成的图像序列，并将所述图像序列传输至所述虚拟现实设备。According to the first refresh rate and the second refresh rate, frame arrangement is performed on the first image and the second image to obtain an image sequence composed of the first image and the second image, and the image sequence is transmitted to the virtual reality device.
  6. 如权利要求1所述的数据传输方法，其中，所述截取待传输图像中设定区域中的图像得到第一图像，对待传输图像中显示区域中的图像进行压缩得到第二图像，包括：The data transmission method according to claim 1, wherein the first image is obtained by intercepting the image in the set area of the image to be transmitted, and the second image is obtained by compressing the image in the display area of the image to be transmitted, comprising:
    在所述第一图像和所述第二图像中分别增加标志位信息；所述标志位信息用于区分所述第一图像和所述第二图像。Mark bit information is added to the first image and the second image respectively; the marker bit information is used to distinguish the first image and the second image.
  7. 一种虚拟现实***的数据传输方法，其中，包括：A data transmission method for a virtual reality system, comprising:
    接收虚拟现实主机传输的第一图像和第二图像；receiving the first image and the second image transmitted by the virtual reality host;
    对所述第二图像进行拉伸，将所述第一图像与拉伸后的所述第二图像进行融合，得到待显示图像；Stretching the second image, and fusing the first image with the stretched second image to obtain an image to be displayed;
    显示所述待显示图像。The to-be-displayed image is displayed.
  8. 如权利要求7所述的数据传输方法，其中，所述接收所述第一图像和所述第二图像，包括：The data transmission method of claim 7, wherein the receiving the first image and the second image comprises:
    接收所述第一图像和所述第二图像，并根据标志位信息区分所述第一图像和所述第二图像；receiving the first image and the second image, and distinguishing the first image and the second image according to the flag bit information;
    将所述第一图像存储在第一存储器中，将所述第二图像存储在第二存储器中。The first image is stored in a first memory and the second image is stored in a second memory.
  9. 如权利要求8所述的数据传输方法，其中，所述对所述图像序列中的所述第二图像进行拉伸，将所述图像序列中的所述第一图像与拉伸后的所述第二图像进行融合，得到待显示图像，包括：The data transmission method according to claim 8, wherein the stretching of the second image in the image sequence, the stretching of the first image in the image sequence and the stretched The second image is fused to obtain an image to be displayed, including:
    分别从所述第一存储器和所述第二存储器中获取所述第一图像和所述第 二图像；obtaining the first image and the second image from the first memory and the second memory, respectively;
    对所述第二图像进行拉伸，使拉伸后的所述第二图像的分辨率与所述虚拟现实设备的显示分辨率相同；Stretching the second image, so that the resolution of the stretched second image is the same as the display resolution of the virtual reality device;
    将所述第一图像与拉伸后的所述第二图像进行融合，以得到所述待显示图像。The first image and the stretched second image are fused to obtain the to-be-displayed image.
  10. 一种虚拟现实主机，其中，包括：A virtual reality host comprising:
    图像处理模块，用于截取待传输图像中设定区域中的图像得到第一图像，对所述待传输图像中显示区域中的图像进行压缩得到第二图像；所述设定区域为所述显示区域中的部分区域；The image processing module is used for intercepting the image in the set area of the image to be transmitted to obtain the first image, and compressing the image in the display area of the image to be transmitted to obtain the second image; the set area is the display area part of the area;
    传输模块，用于将所述第一图像和所述第二图像按特定顺序传输至所述虚拟现实设备。A transmission module, configured to transmit the first image and the second image to the virtual reality device in a specific order.
  11. 如权利要求10所述的虚拟现实主机，其中，所述图像处理模块，具体用于：采用预设的第一分辨率、第一视场角以及第一刷新率，对所述待传输图像的设定区域进行图像采样得到所述第一图像；采用预设的第二分辨率、第二视场角以及第二刷新率，对所述待传输图像的显示区域进行图像采样得到所述第二图像；所述第一分辨率与所述第二分辨率相同，所述第一刷新率大于或等于所述第二刷新率。The virtual reality host according to claim 10, wherein the image processing module is specifically configured to: use a preset first resolution, a first field of view and a first refresh rate to The first image is obtained by performing image sampling in the set area; the second preset resolution, the second field of view and the second refresh rate are used to perform image sampling on the display area of the to-be-transmitted image to obtain the second image. image; the first resolution is the same as the second resolution, and the first refresh rate is greater than or equal to the second refresh rate.
  12. 如权利要求11所述的虚拟现实主机，其中，所述传输模块，具体用于：根据所述虚拟现实设备的刷新率，以及所述虚拟现实设备的姿态信息，确定所述第一图像的所述第一刷新率和所述第二图像的所述第二刷新率；根据所述第一刷新率和所述第二刷新率，对所述第一图像和所述第二图像进行帧排列，得到第一图像和第二图像组成的图像序列，并将所述图像序列传输至所述虚拟现实设备。The virtual reality host according to claim 11, wherein the transmission module is specifically configured to: determine all of the first image according to the refresh rate of the virtual reality device and the posture information of the virtual reality device. the first refresh rate and the second refresh rate of the second image; performing frame arrangement on the first image and the second image according to the first refresh rate and the second refresh rate, An image sequence composed of the first image and the second image is obtained, and the image sequence is transmitted to the virtual reality device.
  13. 一种虚拟现实设备，其中，包括：A virtual reality device, comprising:
    接收模块，用于接收虚拟现实主机传输的第一图像和第二图像；a receiving module for receiving the first image and the second image transmitted by the virtual reality host;
    图像融合模块，用于对所述第二图像进行拉伸，将所述第一图像与拉伸后的所述第二图像进行融合，得到待显示图像；an image fusion module, configured to stretch the second image, and fuse the first image with the stretched second image to obtain an image to be displayed;
    显示模块，用于显示所述待显示图像。A display module, configured to display the to-be-displayed image.
  14. 如权利要求13所述的虚拟现实设备，其中，所述接收模块，具体用于：接收所述第一图像和所述第二图像，并根据标志位信息区分所述第一图像和所述第二图像；将所述第一图像存储在第一存储器中，将所述第二图像存储在第二存储器中。The virtual reality device according to claim 13, wherein the receiving module is specifically configured to: receive the first image and the second image, and distinguish the first image and the second image according to flag bit information Two images; the first image is stored in the first memory, and the second image is stored in the second memory.
  15. 如权利要求14所述的虚拟现实设备，其中，所述图像融合模块，具体用于：分别从所述第一存储器和所述第二存储器中获取所述第一图像和所述第二图像；对所述第二图像进行拉伸，使拉伸后的所述第二图像的分辨率与所述虚拟现实设备的显示分辨率相同；将所述第一图像与拉伸后的所述第二图像进行融合，以得到所述待显示图像。The virtual reality device according to claim 14, wherein the image fusion module is specifically configured to: acquire the first image and the second image from the first memory and the second memory, respectively; stretching the second image, so that the resolution of the stretched second image is the same as the display resolution of the virtual reality device; and stretching the first image and the stretched second image The images are fused to obtain the to-be-displayed image.
  16. 一种虚拟现实***，其中，包括：如权利要求10～12任一项所述的虚拟现实主机，以及如权利要求13～15任一项所述的虚拟现实设备。A virtual reality system, comprising: the virtual reality host according to any one of claims 10-12, and the virtual reality device according to any one of claims 13-15.
PCT/CN2021/104473 2020-08-26 2021-07-05 Data transmission method for virtual reality system and related apparatus WO2022042039A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/921,292 US20230186537A1 (en) 2020-08-26 2021-07-05 Data transmission method and related device for virtual reality system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010872960.2A CN112015273B (en) 2020-08-26 2020-08-26 Data transmission method and related device of virtual reality system
CN202010872960.2 2020-08-26

Publications (1)

Publication Number Publication Date
WO2022042039A1 true WO2022042039A1 (en) 2022-03-03

Family

ID=73502538

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/104473 WO2022042039A1 (en) 2020-08-26 2021-07-05 Data transmission method for virtual reality system and related apparatus

Country Status (3)

Country Link
US (1) US20230186537A1 (en)
CN (1) CN112015273B (en)
WO (1) WO2022042039A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112015273B (en) * 2020-08-26 2024-05-24 京东方科技集团股份有限公司 Data transmission method and related device of virtual reality system
CN113066431B (en) * 2021-03-09 2022-03-18 昀光微电子（上海）有限公司 Data transmission equipment and method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107065197A (en) * 2017-06-20 2017-08-18 合肥工业大学 Towards the tracing of human eye remote rendering real-time display method and system of VR glasses
CN107317987A (en) * 2017-08-14 2017-11-03 歌尔股份有限公司 The display data compression method and equipment of virtual reality, system
US20180356886A1 (en) * 2017-06-08 2018-12-13 Raydium Semiconductor Corporation Virtual reality display system and display driving apparatus
CN110913199A (en) * 2018-09-14 2020-03-24 北京恒信彩虹信息技术有限公司 VR image transmission method
CN110913198A (en) * 2018-09-14 2020-03-24 北京恒信彩虹信息技术有限公司 VR image transmission method
CN112015273A (en) * 2020-08-26 2020-12-01 京东方科技集团股份有限公司 Data transmission method of virtual reality system and related device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7068813B2 (en) * 2001-03-28 2006-06-27 Koninklijke Philips Electronics N.V. Method and apparatus for eye gazing smart display
US11962819B2 (en) * 2018-07-17 2024-04-16 Dolby Laboratories Licensing Corporation Foviation and HDR
EP3824371B1 (en) * 2018-07-20 2023-01-04 Tobii AB Distributed foveated rendering based on user gaze

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180356886A1 (en) * 2017-06-08 2018-12-13 Raydium Semiconductor Corporation Virtual reality display system and display driving apparatus
CN107065197A (en) * 2017-06-20 2017-08-18 合肥工业大学 Towards the tracing of human eye remote rendering real-time display method and system of VR glasses
CN107317987A (en) * 2017-08-14 2017-11-03 歌尔股份有限公司 The display data compression method and equipment of virtual reality, system
CN110913199A (en) * 2018-09-14 2020-03-24 北京恒信彩虹信息技术有限公司 VR image transmission method
CN110913198A (en) * 2018-09-14 2020-03-24 北京恒信彩虹信息技术有限公司 VR image transmission method
CN112015273A (en) * 2020-08-26 2020-12-01 京东方科技集团股份有限公司 Data transmission method of virtual reality system and related device

Also Published As

Publication number Publication date
CN112015273A (en) 2020-12-01
CN112015273B (en) 2024-05-24
US20230186537A1 (en) 2023-06-15

Similar Documents

Publication Publication Date Title
US11321906B2 (en) Asynchronous time and space warp with determination of region of interest
US10693938B2 (en) Method and system for interactive transmission of panoramic video
US10534428B2 (en) Image processing device and image processing method, display device and display method, and image display system
CN110050250B (en) Display synchronized image warping
CN109743626B (en) Image display method, image processing method and related equipment
WO2022042039A1 (en) Data transmission method for virtual reality system and related apparatus
US20180146189A1 (en) Head mounted display and control method therefor
US11303871B2 (en) Server and display apparatus, and control methods thereof
US11119719B2 (en) Screen sharing for display in VR
CN109887065B (en) Image rendering method and device
US20210358200A1 (en) Rendering method, computer product and display apparatus
US9766458B2 (en) Image generating system, image generating method, and information storage medium
CN112887646B (en) Image processing method and device, augmented reality system, computer device and medium
US20210158481A1 (en) Image processing method, device and apparatus, image fitting method and device, display method and apparatus, and computer readable medium
US11126001B2 (en) Image generating apparatus, head-mounted display, content processing system and image displaying method
WO2022166712A1 (en) Image display method, apparatus, readable medium, and electronic device
JP2023090721A (en) Image display device, program for image display, and image display method
KR20180113149A (en) Display apparatus consisting a multi display system and control method thereof
CN108243293B (en) Image display method and system based on virtual reality equipment
US10628113B2 (en) Information processing apparatus
EP3330839A1 (en) Method and device for adapting an immersive content to the field of view of a user
WO2019056577A1 (en) Method for displaying high definition image in vr integrated machine, and vr integrated machine
WO2024093835A1 (en) Image data processing method and related device
WO2022089046A1 (en) Virtual reality display method and device, and storage medium
EP3598271A1 (en) Method and device for disconnecting user's attention

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21859879

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21859879

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 13.09.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21859879

Country of ref document: EP

Kind code of ref document: A1