WO2019056577A1 - Method for displaying high definition image in vr integrated machine, and vr integrated machine - Google Patents

Method for displaying high definition image in vr integrated machine, and vr integrated machine Download PDF

Info

Publication number
WO2019056577A1
WO2019056577A1 PCT/CN2017/113972 CN2017113972W WO2019056577A1 WO 2019056577 A1 WO2019056577 A1 WO 2019056577A1 CN 2017113972 W CN2017113972 W CN 2017113972W WO 2019056577 A1 WO2019056577 A1 WO 2019056577A1
Authority
WO
WIPO (PCT)
Prior art keywords
sub
image frame
image
integrated machine
displayed
Prior art date
Application number
PCT/CN2017/113972
Other languages
French (fr)
Chinese (zh)
Inventor
高进宝
Original Assignee
歌尔科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 歌尔科技有限公司 filed Critical 歌尔科技有限公司
Publication of WO2019056577A1 publication Critical patent/WO2019056577A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display

Definitions

  • the present invention relates to the field of virtual reality technologies, and in particular, to a method for displaying a high definition image on a VR integrated machine and a VR integrated machine.
  • VR Virtual Reality
  • VR products are becoming more and more mature and play an increasingly important role in people's daily work, life and entertainment.
  • the VR box can be directly inserted into the mobile phone, and the user can watch the VR video in the mobile phone through the VR box.
  • the resolution of the mobile phone screen is limited, and the combination of the VR box and the mobile phone cannot provide a clear visual experience for the user.
  • the existing VR all-in-one can use a very high resolution display such as a 4K display.
  • a very high resolution display such as a 4K display.
  • the data processing capability of the VR integrated machine is limited. How to smoothly display the high-definition picture in the VR integrated machine becomes a technical problem to be solved urgently.
  • the invention provides a method for displaying a high-definition image on a VR integrated machine and a VR integrated machine for smoothly displaying high-definition video in a VR integrated machine.
  • the invention provides a method for displaying a high-definition image on a VR integrated machine, comprising:
  • transmitting the sub-image frame to the VR application layer for display comprises: transmitting the sub-image frame to a VR application layer, so that the VR application layer splices the sub-image frame into a to-be-displayed An image frame; and, the image frame to be displayed is distorted and the distorted image frame to be displayed is displayed on a display screen of the VR integrated machine.
  • the VR application layer splicing the sub-image frames into image frames to be displayed, including:
  • the VR application layer splices the sub-image frames with the same time stamps into one image frame to be displayed; or splices the sub-image frames that match the additional identification tags into one image frame to be displayed; or, the pixel values of the labeled pixel blocks are The corresponding sub-image frames are spliced into one image frame to be displayed.
  • any two sub-image frames in the sub-image frame are the same size.
  • the number of the sub image frames is two frames.
  • the invention also provides a VR integrated machine, comprising: a memory and a processor;
  • the memory is configured to: store one or more computer instructions; the processor is configured to execute the one or more computer instructions for: acquiring an original high-definition image frame input through an HDMI interface;
  • the processor is specifically configured to: transmit the sub-image frame to a VR application layer, so that the VR application layer splices the sub-image frame into an image frame to be displayed;
  • the image frame to be displayed is subjected to distortion processing and the distorted image frame to be displayed is displayed on the display screen of the VR all-in-one.
  • the processor is specifically configured to: the VR application layer splicing the sub-image frames with the same time stamp into one image frame to be displayed; or sub-image frames matching the additional identification tags Splicing into an image frame to be displayed; or splicing the sub-image frames corresponding to the pixel values of the marked pixel block into a to-be-displayed image frame.
  • the processor is specifically configured to: cut the original high-definition image frame by the image cutting chip to obtain a sub-image frame of the same size.
  • the processor is specifically configured to: cut the original high-definition image frame by using the image cutting chip to obtain two frames of sub-image frames.
  • the invention provides a method for displaying a high-definition image on a VR integrated machine and a VR integrated machine, and an HDMI interface is opened on the VR integrated machine, and the original high-definition image frame is obtained through the HDMI interface.
  • the original high-definition image frame is cut into sub-image frames, and the sub-image frame is transmitted to the VR application layer for display by using a data channel matching the number of sub-image frames, and the transmission efficiency is high. Furthermore, when the high-definition film source is displayed in the VR integrated machine, a smooth display effect can be achieved.
  • FIG. 1 is a flow chart showing a method for displaying a high-definition image on a VR integrated machine according to an embodiment of the present invention
  • FIG. 2 is a schematic flowchart diagram of another method for displaying a high-definition image on a VR integrated machine according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a VR integrated machine according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram showing the internal configuration of the VR integrated machine 400 in some embodiments provided by the present invention.
  • FIG. 1 is a schematic flowchart diagram of a method for displaying a high-definition image on a VR integrated machine according to an embodiment of the present invention. Referring to FIG. 1, the method includes:
  • Step 101 Acquire an original high-definition image frame input through an HDMI interface on the VR integrated machine.
  • Step 102 Cutting an original high-definition image frame by an image cutting chip on the VR integrated machine to obtain a sub-image frame.
  • Step 102 The sub-image frame is transmitted to the VR application layer for display by using a data channel that matches the number of the sub-image frames.
  • an HDMI interface (High Definition Multimedia Interface) may be disposed on the VR integrated machine.
  • the HDMI interface is a dedicated digital interface for image transmission that transmits both audio and video signals at high transmission rates.
  • high definition refers to a resolution of 720p or more, for example, 1080p, 2k, 4k, and 4k or more.
  • the high-definition picture has high definition and high color reproduction, which can bring a good experience to users.
  • the original HD image frame can be an external HD image signal frame input through the HDMI interface.
  • step 102 after the high-definition image signal frame is input from the HDMI interface, it needs to be sent to the VR application layer for display.
  • the high-definition image signal input by the HDMI interface may be cut, and each original high-definition image frame is cut into at least two sub-image frames. After cutting, the data volume of each sub-image frame is only one-third of the original high-definition image frame.
  • the transmission rate of the transmitted sub-image frame is high, and the VR integrated machine is prevented from displaying HD. A stuttering phenomenon that may occur with images.
  • the sub-image frame is transmitted to the VR application layer for display.
  • a data channel that matches the number of sub-picture frames is transmitted.
  • each data channel only needs to transmit half of the data volume of the original high-definition image frame, thereby reducing the length of time that the high-definition image signal frame is transmitted to the VR application layer, so that the screen of the VR integrated machine is on the screen.
  • the original high-definition image frame is obtained through the HDMI interface opened on the VR integrated machine, and after the original high-definition image frame is acquired, the original high-definition image frame is cut into the sub-image frame, and the data channel matching the number of the sub-image frames is adopted.
  • the sub-image frame is transmitted to the VR application layer for display, and the transmission efficiency is high. Furthermore, when the high-definition film source is displayed in the VR integrated machine, a smooth display effect can be achieved.
  • FIG. 2 is a schematic flowchart diagram of another method for displaying a high-definition image on a VR integrated machine according to an embodiment of the present invention. Referring to FIG. 2, the method includes:
  • Step 201 Acquire an original high-definition image frame input through an HDMI interface on the VR integrated machine.
  • Step 202 Cut the original high-definition image frame into N-frame sub-image frames of the same size by using an image cutting chip on the VR integrated machine.
  • Step 203 transmitting N frame sub-image frames to the VR application layer through the N data channels.
  • Step 204 The VR application layer splices the N frame sub-image frames into image frames to be displayed.
  • Step 205 The VR application layer performs distortion processing on the image frame to be displayed and displays the distorted image frame to be displayed on the display screen of the VR integrated machine.
  • step 201 the original high-definition image frame input through the HDMI interface on the VR all-in-one is acquired.
  • cutting the original high definition image frame can be implemented by using an image cutting chip.
  • the original high-definition image can be cut into sub-image frames of the same size, thereby ensuring that each sub-image frame consumes the same transmission time during transmission.
  • the use of such a cutting method can reduce the probability that sub-image frames of the same original high-definition image frame are not synchronized during transmission.
  • the original high-definition image frame can be cut into sub-image frames of the same N frame size, N ⁇ 2. If the data amount of the original high-definition image frame is S, the data amount of each sub-image frame is S/N.
  • N the transmission efficiency of the sub-picture frame and the efficiency of the spliced sub-image frame can be considered. That is to say, the original high-definition image frame can be cut into two sub-image frames of the same size by the image cutting chip, and the efficiency of the data channel transmitting the sub-image frame and the efficiency of the VR application layer splicing the sub-image frame can be balanced. Achieve smoother playback.
  • the data channel is required to transmit the hard-cut sub-image frame to the upper VR application layer.
  • the data channel needs to transmit the sub-image frame to the application layer VR application via the kernel layer, the hardware layer, and the framework layer.
  • each data channel needs to be transmitted only once to transmit the sub-image frames corresponding to an original high-definition image frame to the VR application layer.
  • Such a transmission process not only ensures transmission efficiency but also ensures the reliability of the transmission process.
  • the sub-picture frame may have a frame loss, a transmission timeout, or a transmission failure during the transmission process, which may cause a splicing error when the VR application layer splicing the sub-image frame.
  • the sub-image frame of the original high-definition image frame A is spliced together with the sub-image frame of the original high-definition image frame B.
  • the sub-image frames may be spliced as follows:
  • the sub-image frames of an original high-definition image frame are simultaneously cut and synchronously transmitted. Therefore, the sub-image frames with the same transmission time stamps should belong to the same original high-definition image frame.
  • the VR application layer may acquire a transmission timestamp of each sub-image frame, and concatenate the sub-image frames with the same transmission timestamp into a to-be-displayed image frame. Furthermore, it is avoided that the sub-image frames with different transmission time stamps are spliced together, resulting in splicing errors.
  • additional identification tags may be added to the sub-image frames of the same original high definition image frame during transmission.
  • the VR application layer can read the additional identification tags of each sub-image frame, and splicing the sub-image frames matching the additional identification tags into a to-be-displayed image frame.
  • the additional identification tag may be the number of the sub-image frame. For example, the first Sub-picture frame numbers 101, 102 of an original high-definition image frame; sub-picture frame numbers 201, 202 of a second original high-definition image frame.
  • the sub-image frames numbered 101 and 102 are spliced together to obtain a first image frame to be displayed, and the sub-image frames numbered 201 and 202 are spliced together to obtain a second image frame to be displayed.
  • the marked pixel block can be placed in the sub-image frame of the same original high definition image frame after the cutting is completed.
  • a pixel block of a coordinate area in a sub-image frame is set as a marker pixel block, and a pixel value of the marker image block is set to a special value.
  • the VR application layer can read the pixel values of the labeled pixel blocks in the sub-image frame when each sub-image frame is received.
  • the two or more sub-image frames may be considered to belong to the same original high-definition image frame, and the two or more sub-image frames may be spliced into An image frame is to be displayed.
  • the above three splicing methods are all optional splicing modes, and this embodiment does not limit which one is adopted. However, the above three splicing methods can improve the splicing correctness of the sub-image frame, and avoid the situation that the splicing result is wrong when the sub-image frame is lost during the data transmission process, thereby ensuring the user's viewing experience.
  • the VR application layer After the VR application layer obtains the image frame to be displayed, the VR application layer performs distortion processing on the image frame to be displayed and displays the image to be displayed after being distorted on the display screen of the VR integrated machine, so that the user can view through the lens on the VR integrated machine.
  • the visual effects of the high-definition images displayed on the VR all-in-one can achieve cinema effects of tens to hundreds of inches, greatly improving the user experience.
  • the VR integrated machine provided by the embodiment provides a method for displaying a high-definition image, and an HDMI interface is opened on the VR integrated machine, and the original high-definition image frame is obtained through the HDMI interface. After obtaining the original high-definition image frame, the original high-definition image frame is cut into sub-image frames, and the sub-image frame is transmitted to the VR application layer for display by using a data channel matching the number of sub-image frames, and the transmission efficiency is high. Furthermore, when the high-definition film source is displayed in the VR integrated machine, a smooth display effect can be achieved.
  • the special splicing method is used to splicing the sub-image frames into image frames to be displayed, which avoids the situation that the splicing result is wrong when the sub-image frames are lost during the data transmission process, thereby ensuring the user's viewing experience.
  • the method for displaying high-definition images in the VR integrated machine and the VR integrated machine provided by the present invention can be applied not only to the field of VR technology but also to AR (Augmented Reality) technology which is close to the field of VR technology.
  • Domain and MR Mat reality
  • an HDMI interface can be opened on the AR integrated machine, and the original high-definition image frame can be obtained through the HDMI interface.
  • the original high-definition image frame is cut into sub-image frames, and the sub-image frame is transmitted to the AR application for display by using the data channel matching the number of sub-image frames; similarly, the MR technology can be analogized.
  • the specific implementation method reference may be made to the content described in the embodiments of the present invention, and details are not described herein.
  • FIG. 3 is a schematic structural diagram of a VR integrated machine according to an embodiment of the present invention.
  • the VR integrated machine includes a memory 301 and a processor 302.
  • the memory 301 is configured to: store one or more computer instructions.
  • the processor 302 is configured to execute the one or more computer instructions for: acquiring an original high-definition image frame input through an HDMI interface; cutting the original high-definition image frame by an image cutting chip on the VR integrated machine, Obtaining a sub-image frame; transmitting the sub-image frame to a VR application layer for display by a data channel matching the number of the sub-image frames.
  • the processor 302 is specifically configured to: transmit the sub-image frame to a VR application layer, so that the VR application layer splices the sub-image frame into an image frame to be displayed;
  • the display image frame is subjected to distortion processing and the distorted image frame to be displayed is displayed on the display screen of the VR integrated machine.
  • the processor 302 is specifically configured to: the VR application layer splicing the sub-image frames with the same time stamps into one image frame to be displayed; or splicing the sub-image frames matching the additional identification tags into one The image frame to be displayed; or, the sub-image frame corresponding to the pixel value of the marked pixel block is spliced into a to-be-displayed image frame.
  • the processor 302 is specifically configured to: cut the original high-definition image frame by the image cutting chip 303 to obtain sub-image frames of the same size.
  • the processor 302 is specifically configured to: cut the chip 303 through the image The original high definition image frame is cut to obtain two frames of sub image frames.
  • the VR integrated machine provided in this embodiment provides an HDMI interface on the VR integrated machine, and acquires the original high-definition image frame through the HDMI interface. After obtaining the original high-definition image frame, the original high-definition image frame is cut into sub-image frames, and the sub-image frame is transmitted to the VR application layer for display by using a data channel matching the number of sub-image frames, and the transmission efficiency is high. Furthermore, when the high-definition film source is displayed in the VR integrated machine, a smooth display effect can be achieved.
  • FIG. 4 shows a schematic diagram of the internal configuration of the VR all-in-one 400 in some embodiments.
  • the display unit 401 may include a display panel disposed on a side surface of the VR integrated machine 400 facing the user's face, and may be a whole panel or a left panel and a right panel corresponding to the left and right eyes of the user, respectively.
  • the display panel may be an electroluminescence (EL) element, a liquid crystal display or a microdisplay having a similar structure, or a laser-scanned display in which the retina may be directly displayed or similar.
  • EL electroluminescence
  • the virtual image optical unit 402 photographs the image displayed by the display unit 401 in an enlarged manner and allows the user to observe the displayed image in the enlarged virtual image.
  • the display image outputted to the display unit 401 it may be an image of a virtual scene supplied from a content reproduction device (a Blu-ray disc or a DVD player) or a streaming server, or an image of a real scene photographed using an external camera 410.
  • virtual image optical unit 402 can include a lens unit, such as a spherical lens, an aspheric lens, a Fresnel lens, and the like.
  • the input operation unit 403 includes at least one operation member for performing an input operation, such as a button, a button, a switch, or other similarly functioned component, receives a user instruction through the operation member, and outputs an instruction to the control unit 407.
  • an input operation such as a button, a button, a switch, or other similarly functioned component
  • the status information acquisition unit 404 is configured to acquire status information of the user wearing the VR integrated machine 400.
  • the status information acquisition unit 404 may include various types of sensors for detecting status information by itself, and may acquire status information from an external device such as a smartphone, a wristwatch, and other multi-function terminals worn by the user through the communication unit 405.
  • the status information acquisition unit 404 can acquire location information and/or posture information of the user's head.
  • the status information acquisition unit 404 may include one or more of a gyro sensor, an acceleration sensor, a global positioning system (GPS) sensor, a geomagnetic sensor, a Doppler effect sensor, an infrared sensor, and a radio frequency field intensity sensor.
  • GPS global positioning system
  • the element 404 acquires state information of the user wearing the VR integrated machine 400, for example, acquires an operation state of the user (whether the user wears the VR all-in-one 400), an action state of the user (such as a stationary state, walking, running, and the like, a mobile state, hand Or the posture of the fingertip, the open or closed state of the eye, the direction of the line of sight, the size of the pupil, the mental state (whether the user is immersed in the image displayed by the observation, and the like), or even the physiological state.
  • an operation state of the user whether the user wears the VR all-in-one 400
  • an action state of the user such as a stationary state, walking, running, and the like, a mobile state, hand Or the posture of the fingertip, the open or closed state of the eye, the direction of the line of sight, the size of the pupil, the mental state (whether the user is immersed in the image displayed by the observation, and the like), or even the physiological state.
  • the communication unit 405 performs communication processing, modulation and demodulation processing with an external device, and encoding and decoding processing of the communication signal.
  • the control unit 407 can transmit transmission data from the communication unit 405 to an external device.
  • the communication method may be wired or wireless, such as mobile high-definition link (MHL) or universal serial bus (USB), high-definition multimedia interface (HDMI), wireless fidelity (Wi-Fi), Bluetooth communication, or low-power Bluetooth communication. And the mesh network of the IEEE802.11s standard.
  • communication unit 405 can be a cellular wireless transceiver that operates in accordance with Wideband Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), and the like.
  • W-CDMA Wideband Code Division Multiple Access
  • LTE Long Term Evolution
  • the VR all-in-one 400 may also include a storage unit, which is a mass storage device configured to have a solid state drive (SSD) or the like.
  • storage unit 406 can store applications or various types of data. For example, content viewed by a user using the VR all-in-one 400 may be stored in the storage unit 406.
  • the VR all-in-one 400 may further include a control unit, and the control unit 407 may include a computer processing unit (CPU) or other device having similar functions.
  • control unit 407 can be used to execute an application stored by storage unit 406, or control unit 407 can also be used to perform the methods, functions, and operations disclosed in some embodiments of the present application.
  • the image processing unit 408 is for performing signal processing such as image quality correction related to the image signal output from the control unit 407, and converting its resolution into a resolution according to the screen of the display unit 401. Then, the display driving unit 409 sequentially selects each row of pixels of the display unit 401, and sequentially scans each row of pixels of the display unit 401 line by line, thereby providing pixel signals based on the signal-processed image signals.
  • the VR all-in-one 400 can also include an external camera.
  • the external camera 410 may be disposed on the front surface of the main body of the VR integrated machine 400, and the external camera 410 may be one or more. External The camera 410 can acquire three-dimensional information and can also be used as a distance sensor. Additionally, a position sensitive detector (PSD) or other type of distance sensor that detects reflected signals from the object can be used with the external camera 410.
  • PSD position sensitive detector
  • the external camera 410 and the distance sensor can be used to detect the body position, posture, and shape of the user wearing the VR integrated machine 400. In addition, under certain conditions, the user can directly view or preview the real scene through the external camera 410.
  • the VR all-in-one 400 may further include a sound processing unit 411 that may perform sound quality correction or sound amplification of the sound signal output from the control unit 407, signal processing of the input sound signal, and the like. Then, the sound input/output unit 412 outputs the sound to the outside and the sound from the microphone after the sound processing.
  • a sound processing unit 411 may perform sound quality correction or sound amplification of the sound signal output from the control unit 407, signal processing of the input sound signal, and the like. Then, the sound input/output unit 412 outputs the sound to the outside and the sound from the microphone after the sound processing.
  • the structure or component shown by the dotted line in FIG. 4 may be independent of the VR integrated machine 400, for example, may be disposed in an external processing system (for example, a computer system) for use with the VR integrated machine 400; or, a dotted line
  • the illustrated structure or components may be disposed inside or on the surface of the VR integrated machine 400.
  • the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)

Abstract

The present invention provides a method for displaying a high definition image in a VR integrated machine, and a VR integrated machine. The method comprises the following steps: acquiring initial high definition image frames inputted by means of an HDMI interface on a VR integrated machine; cutting the initial high definition image frames by means of an image cutting chip on the VR integrated machine, so as to obtain sub-image frames; and transmitting to a VR application layer the sub-image frames through data channels of which the number matches the number of the sub-image frames, and displaying same. The technical solution provided in the present invention can smoothly display a high definition video in a VR integrated machine.

Description

在VR一体机显示高清图像的方法及VR一体机Method for displaying high-definition image on VR integrated machine and VR integrated machine
交叉引用cross reference
本申请引用于2017年9月20日递交的名称为“在VR一体机显示高清图像的方法及VR一体机”的第2017108511155号中国专利申请，其通过引用被全部并入本申请。The present application is hereby incorporated by reference in its entirety in its entirety in its entirety in its entirety in the the the the the the the the the the the the the
技术领域Technical field
本发明涉及虚拟现实技术领域，尤其涉及一种在VR一体机显示高清图像的方法及VR一体机。The present invention relates to the field of virtual reality technologies, and in particular, to a method for displaying a high definition image on a VR integrated machine and a VR integrated machine.
背景技术Background technique
目前，随着VR(Virtual Reality虚拟现实)技术的发展，VR产品日趋成熟并在人们的日常工作、生活以及娱乐中扮演着越来越重要的角色。在现有的VR产品中，VR盒子可以直接***手机使用，用户可以通过VR盒子观看到手机内的VR视频。但是手机屏幕的分辨率有限，VR盒子与手机的搭配无法为用户带来清晰的视觉体验。At present, with the development of VR (Virtual Reality) technology, VR products are becoming more and more mature and play an increasingly important role in people's daily work, life and entertainment. In the existing VR products, the VR box can be directly inserted into the mobile phone, and the user can watch the VR video in the mobile phone through the VR box. However, the resolution of the mobile phone screen is limited, and the combination of the VR box and the mobile phone cannot provide a clear visual experience for the user.
现有的VR一体机，可以采用很高分辨率的显示屏，如4K的显示屏。但是VR一体机的数据处理能力有限，如何在VR一体机中流畅地显示高清画面成为一个亟待解决的技术问题。The existing VR all-in-one can use a very high resolution display such as a 4K display. However, the data processing capability of the VR integrated machine is limited. How to smoothly display the high-definition picture in the VR integrated machine becomes a technical problem to be solved urgently.
发明内容Summary of the invention
本发明提供一种在VR一体机显示高清图像的方法及VR一体机，用以在VR一体机中流畅地显示高清视频。The invention provides a method for displaying a high-definition image on a VR integrated machine and a VR integrated machine for smoothly displaying high-definition video in a VR integrated machine.
本发明提供一种在VR一体机显示高清图像的方法，包括： The invention provides a method for displaying a high-definition image on a VR integrated machine, comprising:
获取通过VR一体机上的HDMI接口输入的原高清图像帧；通过所述VR一体机上的图像切割芯片切割所述原高清图像帧，以得到子图像帧；通过与所述子图像帧的数量匹配的数据通道，将所述子图像帧传输至VR应用层进行显示。Obtaining an original high-definition image frame input through an HDMI interface on the VR integrated machine; cutting the original high-definition image frame by an image cutting chip on the VR integrated machine to obtain a sub-image frame; and matching the number of the sub-image frames The data channel transmits the sub-image frame to the VR application layer for display.
进一步可选地，将所述子图像帧传输至VR应用层进行显示，包括：将所述子图像帧传输至VR应用层，以使所述VR应用层将所述子图像帧拼接成待显示图像帧；以及，对所述待显示图像帧进行畸变处理并在VR一体机的显示屏上显示畸变后的所述待显示图像帧。Further optionally, transmitting the sub-image frame to the VR application layer for display comprises: transmitting the sub-image frame to a VR application layer, so that the VR application layer splices the sub-image frame into a to-be-displayed An image frame; and, the image frame to be displayed is distorted and the distorted image frame to be displayed is displayed on a display screen of the VR integrated machine.
进一步可选地，所述VR应用层将所述子图像帧拼接成待显示图像帧，包括：Further optionally, the VR application layer splicing the sub-image frames into image frames to be displayed, including:
所述VR应用层将发送时间戳相同的子图像帧拼接成一待显示图像帧；或，将附加识别标签相匹配的子图像帧拼接为一待显示图像帧；或，将标记像素块的像素值相对应的子图像帧拼接为一待显示图像帧。The VR application layer splices the sub-image frames with the same time stamps into one image frame to be displayed; or splices the sub-image frames that match the additional identification tags into one image frame to be displayed; or, the pixel values of the labeled pixel blocks are The corresponding sub-image frames are spliced into one image frame to be displayed.
进一步可选地，所述子图像帧中的任意两个子图像帧尺寸相同。Further optionally, any two sub-image frames in the sub-image frame are the same size.
进一步可选地，所述子图像帧的数量为两帧。Further optionally, the number of the sub image frames is two frames.
本发明还提供一种VR一体机，包括：存储器以及处理器；The invention also provides a VR integrated machine, comprising: a memory and a processor;
所述存储器用于：存储一条或多条计算机指令；所述处理器用于执行所述一条或多条计算机指令，以用于：获取通过HDMI接口输入的原高清图像帧；The memory is configured to: store one or more computer instructions; the processor is configured to execute the one or more computer instructions for: acquiring an original high-definition image frame input through an HDMI interface;
通过所述VR一体机上的图像切割芯片切割所述原高清图像帧，以得到子图像帧；通过与所述子图像帧的数量匹配的数据通道，将所述子图像帧传输至VR应用层进行显示。Cutting the original high-definition image frame by the image cutting chip on the VR integrated machine to obtain a sub-image frame; transmitting the sub-image frame to the VR application layer by using a data channel matching the number of the sub-image frames display.
进一步可选地，所述处理器具体用于：将所述子图像帧传输至VR应用层，以使所述VR应用层将所述子图像帧拼接成待显示图像帧；以及，对所述待显示图像帧进行畸变处理并在VR一体机的显示屏上显示畸变后的所述待显示图像帧。Further optionally, the processor is specifically configured to: transmit the sub-image frame to a VR application layer, so that the VR application layer splices the sub-image frame into an image frame to be displayed; The image frame to be displayed is subjected to distortion processing and the distorted image frame to be displayed is displayed on the display screen of the VR all-in-one.
进一步可选地，所述处理器具体用于：所述VR应用层将发送时间戳相同的子图像帧拼接成一待显示图像帧；或，将附加识别标签相匹配的子图像帧 拼接为一待显示图像帧；或，将标记像素块的像素值相对应的子图像帧拼接为一待显示图像帧。Further optionally, the processor is specifically configured to: the VR application layer splicing the sub-image frames with the same time stamp into one image frame to be displayed; or sub-image frames matching the additional identification tags Splicing into an image frame to be displayed; or splicing the sub-image frames corresponding to the pixel values of the marked pixel block into a to-be-displayed image frame.
进一步可选地，所述处理器具体用于：通过所述图像切割芯片切割所述原高清图像帧，以得到尺寸相同的子图像帧。Further optionally, the processor is specifically configured to: cut the original high-definition image frame by the image cutting chip to obtain a sub-image frame of the same size.
进一步可选地，所述处理器具体用于：通过所述图像切割芯片切割所述原高清图像帧，以得到两帧子图像帧。Further optionally, the processor is specifically configured to: cut the original high-definition image frame by using the image cutting chip to obtain two frames of sub-image frames.
本发明提供一种在VR一体机显示高清图像的方法及VR一体机，在VR一体机上开设HDMI接口，并通过HDMI接口获取原高清图像帧。在获取到原高清图像帧后，将原高清图像帧切割成子图像帧，并采用与子图像帧的数量匹配的数据通道将子图像帧传输至VR应用层进行显示，传输效率高。进而，高清片源在VR一体机中显示时，可实现流畅的显示效果。The invention provides a method for displaying a high-definition image on a VR integrated machine and a VR integrated machine, and an HDMI interface is opened on the VR integrated machine, and the original high-definition image frame is obtained through the HDMI interface. After obtaining the original high-definition image frame, the original high-definition image frame is cut into sub-image frames, and the sub-image frame is transmitted to the VR application layer for display by using a data channel matching the number of sub-image frames, and the transmission efficiency is high. Furthermore, when the high-definition film source is displayed in the VR integrated machine, a smooth display effect can be achieved.
附图说明DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.
图1是本发明实施例提供的一在VR一体机显示高清图像的方法的流程图示意图；1 is a flow chart showing a method for displaying a high-definition image on a VR integrated machine according to an embodiment of the present invention;
图2是本发明实施例提供的另一在VR一体机显示高清图像的方法的流程图示意图；FIG. 2 is a schematic flowchart diagram of another method for displaying a high-definition image on a VR integrated machine according to an embodiment of the present invention; FIG.
图3是本发明实施例提供的VR一体机的结构示意图；3 is a schematic structural diagram of a VR integrated machine according to an embodiment of the present invention;
图4是本发明提供的一些实施例中VR一体机400的内部配置结构示意图。FIG. 4 is a schematic diagram showing the internal configuration of the VR integrated machine 400 in some embodiments provided by the present invention.
具体实施方式Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发 明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the following will be combined with the present invention. The technical solutions in the embodiments of the present invention are clearly and completely described in the drawings, and the embodiments are described as a part of the embodiments of the present invention, rather than all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
图1是本发明实施例提供的一在VR一体机显示高清图像的方法的流程图示意图，结合图1，该方法包括：FIG. 1 is a schematic flowchart diagram of a method for displaying a high-definition image on a VR integrated machine according to an embodiment of the present invention. Referring to FIG. 1, the method includes:
步骤101、获取通过VR一体机上的HDMI接口输入的原高清图像帧。Step 101: Acquire an original high-definition image frame input through an HDMI interface on the VR integrated machine.
步骤102、通过VR一体机上的图像切割芯片切割原高清图像帧，以得到子图像帧。Step 102: Cutting an original high-definition image frame by an image cutting chip on the VR integrated machine to obtain a sub-image frame.
步骤102、通过与所述子图像帧的数量匹配的数据通道，将所述子图像帧传输至VR应用层进行显示。Step 102: The sub-image frame is transmitted to the VR application layer for display by using a data channel that matches the number of the sub-image frames.
针对步骤101，可选的，为将高清图像信号输入VR一体机，可在VR一体机上设置HDMI接口(High Definition Multimedia Interface，高清晰度多媒体接口)。HDMI接口，是一种适用于影像传输的专用数字化接口，可同时传送音频和影像信号，传输速率高。For step 101, optionally, in order to input the high-definition image signal into the VR integrated machine, an HDMI interface (High Definition Multimedia Interface) may be disposed on the VR integrated machine. The HDMI interface is a dedicated digital interface for image transmission that transmits both audio and video signals at high transmission rates.
在本发明中，高清(High Definition，高分辨率)指的是720p或1080i以上的分辨率，例如1080p、2k、4k及4k以上的分辨率。高清画面清晰度高以及色彩还原度高的优势，能够为用户带来良好的体验。原高清图像帧，可以是通过HDMI接口输入的外部高清图像信号帧。In the present invention, high definition refers to a resolution of 720p or more, for example, 1080p, 2k, 4k, and 4k or more. The high-definition picture has high definition and high color reproduction, which can bring a good experience to users. The original HD image frame can be an external HD image signal frame input through the HDMI interface.
针对步骤102，高清图像信号帧从HDMI接口输入之后，需要发送至VR应用层进行显示。在本步骤中，在将高清图像信号帧发送至应用层之前，可对HDMI接口输入的高清图像信号进行切割，将每一原高清图像帧切割成至少两个子图像帧。在切割之后，每个子图像帧的数据量都只有原高清图像帧的数分之一，与直接向应用层传输高清图像相比，传输子图像帧的传输速率高，避免了VR一体机显示高清图像时可能出现的卡顿现象。For step 102, after the high-definition image signal frame is input from the HDMI interface, it needs to be sent to the VR application layer for display. In this step, before the high-definition image signal frame is sent to the application layer, the high-definition image signal input by the HDMI interface may be cut, and each original high-definition image frame is cut into at least two sub-image frames. After cutting, the data volume of each sub-image frame is only one-third of the original high-definition image frame. Compared with transmitting the high-definition image directly to the application layer, the transmission rate of the transmitted sub-image frame is high, and the VR integrated machine is prevented from displaying HD. A stuttering phenomenon that may occur with images.
针对步骤103，得到切割之后的子图像帧后，将子图像帧传输至VR应用层进行显示。可选的，本实施例中，在传输子图像帧至VR应用层时，可采用 与子图像帧的数量匹配的数据通道进行传输。例如，一原高清图像帧被切割为两帧子图像帧，则可采用两个数据通道将这两个子图像个帧发送至VR应用层。在这样的实施方式中，每个数据通道只需承担原高清图像帧的一半数据量的传输工作，进而可降低高清图像信号帧传输至VR应用层所消耗的时长，使得VR一体机的屏幕上能够流畅地显示高清图像。For step 103, after the cut sub-image frame is obtained, the sub-image frame is transmitted to the VR application layer for display. Optionally, in this embodiment, when the sub-image frame is transmitted to the VR application layer, A data channel that matches the number of sub-picture frames is transmitted. For example, if an original high-definition image frame is cut into two sub-image frames, the two sub-image frames can be sent to the VR application layer by using two data channels. In such an embodiment, each data channel only needs to transmit half of the data volume of the original high-definition image frame, thereby reducing the length of time that the high-definition image signal frame is transmitted to the VR application layer, so that the screen of the VR integrated machine is on the screen. Ability to display high-definition images smoothly.
本实施例中，通过VR一体机上开设的HDMI接口获取原高清图像帧，在获取到原高清图像帧后，将原高清图像帧切割成子图像帧，并采用与子图像帧的数量匹配的数据通道将子图像帧传输至VR应用层进行显示，传输效率高。进而，高清片源在VR一体机中显示时，可实现流畅的显示效果。In this embodiment, the original high-definition image frame is obtained through the HDMI interface opened on the VR integrated machine, and after the original high-definition image frame is acquired, the original high-definition image frame is cut into the sub-image frame, and the data channel matching the number of the sub-image frames is adopted. The sub-image frame is transmitted to the VR application layer for display, and the transmission efficiency is high. Furthermore, when the high-definition film source is displayed in the VR integrated machine, a smooth display effect can be achieved.
图2是本发明实施例提供的另一在VR一体机显示高清图像的方法的流程图示意图，结合图2，该方法包括：FIG. 2 is a schematic flowchart diagram of another method for displaying a high-definition image on a VR integrated machine according to an embodiment of the present invention. Referring to FIG. 2, the method includes:
步骤201、获取通过VR一体机上的HDMI接口输入的原高清图像帧。Step 201: Acquire an original high-definition image frame input through an HDMI interface on the VR integrated machine.
步骤202、通过VR一体机上的图像切割芯片将原高清图像帧切割成尺寸相同的N帧子图像帧。Step 202: Cut the original high-definition image frame into N-frame sub-image frames of the same size by using an image cutting chip on the VR integrated machine.
步骤203，通过N个数据通道，将N帧子图像帧传输至VR应用层。 Step 203, transmitting N frame sub-image frames to the VR application layer through the N data channels.
步骤204、VR应用层将所述N帧子图像帧拼接成待显示图像帧。Step 204: The VR application layer splices the N frame sub-image frames into image frames to be displayed.
步骤205、VR应用层对所述待显示图像帧进行畸变处理并在VR一体机的显示屏上分屏显示畸变后的所述待显示图像帧。Step 205: The VR application layer performs distortion processing on the image frame to be displayed and displays the distorted image frame to be displayed on the display screen of the VR integrated machine.
针对步骤201，获取通过VR一体机上的HDMI接口输入的原高清图像帧。For step 201, the original high-definition image frame input through the HDMI interface on the VR all-in-one is acquired.
针对步骤202，切割原高清图像帧可以采用图像切割芯片实现。在切割原高清图像时，可以将原高清图像切割成尺寸相同的子图像帧，进而可以保证每个子图像帧在传输过程中，耗费相同的传输时间。采用这样的切割方式能够降低同一原高清图像帧的子图像帧，在传输过程中不同步的概率。For step 202, cutting the original high definition image frame can be implemented by using an image cutting chip. When the original high-definition image is cut, the original high-definition image can be cut into sub-image frames of the same size, thereby ensuring that each sub-image frame consumes the same transmission time during transmission. The use of such a cutting method can reduce the probability that sub-image frames of the same original high-definition image frame are not synchronized during transmission.
可选的，可将原高清图像帧切割成N帧尺寸相同的子图像帧，N≥2。若原高清图像帧的数据量为S，则每个子图像帧的数据量为S/N。Optionally, the original high-definition image frame can be cut into sub-image frames of the same N frame size, N≥2. If the data amount of the original high-definition image frame is S, the data amount of each sub-image frame is S/N.
应当理解，当N逐渐增大时，每个子图像帧的数据量逐渐减小，子图像 帧的传输速率得到提升，但后续拼接子图像帧时的计算量会随之增大。优选的，N＝2时，可以兼顾子图像帧的传输效率以及拼接子图像帧的效率。也就是说，可通过图像切割芯片将原高清图像帧切割成尺寸相同的两帧子图像帧，此时数据通道传输子图像帧的效率和VR应用层拼接子图像帧的效率可以达到平衡，能够实现较流畅的播放效果。It should be understood that as N gradually increases, the amount of data of each sub-image frame gradually decreases, and the sub-image The transmission rate of the frame is improved, but the amount of calculation when the subsequent sub-image frames are spliced increases. Preferably, when N=2, the transmission efficiency of the sub-picture frame and the efficiency of the spliced sub-image frame can be considered. That is to say, the original high-definition image frame can be cut into two sub-image frames of the same size by the image cutting chip, and the efficiency of the data channel transmitting the sub-image frame and the efficiency of the VR application layer splicing the sub-image frame can be balanced. Achieve smoother playback.
针对步骤203，由于原高清图像帧的切割是由图像切割芯片完成的硬切割，因此，需要数据通道将硬切割完成的子图像帧传输至上层VR应用层。例如，若VR一体机搭载的是Android***，则数据通道需经由kernel(内核)层、hardware(硬件)层以及framework(框架)层，将子图像帧传输至应用层的VR应用。For step 203, since the cutting of the original high-definition image frame is a hard cut by the image cutting chip, the data channel is required to transmit the hard-cut sub-image frame to the upper VR application layer. For example, if the VR machine is equipped with an Android system, the data channel needs to transmit the sub-image frame to the application layer VR application via the kernel layer, the hardware layer, and the framework layer.
若数据通道的数量与一高清图像帧所对应的子图像帧的数量相同，则每个数据通道仅需传输一次即可将一原高清图像帧对应的子图像帧都传输至VR应用层。这样的传输过程既保证了传输效率，也保证了传输过程的可靠性。If the number of data channels is the same as the number of sub-image frames corresponding to a high-definition image frame, each data channel needs to be transmitted only once to transmit the sub-image frames corresponding to an original high-definition image frame to the VR application layer. Such a transmission process not only ensures transmission efficiency but also ensures the reliability of the transmission process.
针对步骤204，在一种可能的情况下，子图像帧在传输的过程中会出现丢帧、传输超时或传输失败的情况，这些情况会导致VR应用层拼接子图像帧时，出现拼接错误。例如，将原高清图像帧A的子图像帧与原高清图像帧B的子图像帧拼接在一起。为避免上述错误，本实施例中，可采用如下的方式对子图像帧进行拼接：For the step 204, in a possible case, the sub-picture frame may have a frame loss, a transmission timeout, or a transmission failure during the transmission process, which may cause a splicing error when the VR application layer splicing the sub-image frame. For example, the sub-image frame of the original high-definition image frame A is spliced together with the sub-image frame of the original high-definition image frame B. In order to avoid the above error, in this embodiment, the sub-image frames may be spliced as follows:
在一种可选的实施方式中，一原高清图像帧的子图像帧是同时完成切割并同步传输的，因此，发送时间戳相同的子图像帧应属于同一原高清图像帧。VR应用层在接收到每一子图像帧时，可获取每一子图像帧的发送时间戳，并将发送时间戳相同的子图像帧拼接成一待显示图像帧。进而，避免了将发送时间戳不同的子图像帧拼接在一起，导致拼接错误。In an optional implementation manner, the sub-image frames of an original high-definition image frame are simultaneously cut and synchronously transmitted. Therefore, the sub-image frames with the same transmission time stamps should belong to the same original high-definition image frame. When receiving each sub-image frame, the VR application layer may acquire a transmission timestamp of each sub-image frame, and concatenate the sub-image frames with the same transmission timestamp into a to-be-displayed image frame. Furthermore, it is avoided that the sub-image frames with different transmission time stamps are spliced together, resulting in splicing errors.
在一种可选的实施方式中，可在传输的过程中，为同一原高清图像帧的子图像帧添加附加的识别标签。VR应用层接收到子图像帧后，可读取每一子图像帧的附加识别标签，并将附加识别标签相匹配的子图像帧拼接为一待显示图像帧。可选的，附加的识别标签可以是子图像帧的编号。例如，可对第 一原高清图像帧的子图像帧编号101、102；对第二原高清图像帧的子图像帧编号201、202。VR应用层拼接时，可将编号为101以及102的子图像帧拼接在一起得到第一待显示图像帧，将将编号为201以及202的子图像帧拼接在一起得到第二待显示图像帧。In an alternative embodiment, additional identification tags may be added to the sub-image frames of the same original high definition image frame during transmission. After receiving the sub-image frame, the VR application layer can read the additional identification tags of each sub-image frame, and splicing the sub-image frames matching the additional identification tags into a to-be-displayed image frame. Optionally, the additional identification tag may be the number of the sub-image frame. For example, the first Sub-picture frame numbers 101, 102 of an original high-definition image frame; sub-picture frame numbers 201, 202 of a second original high-definition image frame. When the VR application layer is spliced, the sub-image frames numbered 101 and 102 are spliced together to obtain a first image frame to be displayed, and the sub-image frames numbered 201 and 202 are spliced together to obtain a second image frame to be displayed.
在一种可选的实施方式中，可在切割完成后，在同一原高清图像帧的子图像帧中设置标记像素块。例如，将子图像帧中设定坐标区域的像素块作为标记像素块，并将标记图像块的像素值设置成特殊值。应当理解，针对不同的原高清图像帧，子图像帧中的标记像素块的特殊值不同。VR应用层在接收到每一子图像帧时，可读取子图像帧中标记像素块的像素值。若两帧或多帧子图像帧的标记像素块的像素值相同，可认为该两帧或多帧子图像帧属于同一原高清图像帧，并可将该两帧或多帧子图像帧拼接为一待显示图像帧。In an alternative embodiment, the marked pixel block can be placed in the sub-image frame of the same original high definition image frame after the cutting is completed. For example, a pixel block of a coordinate area in a sub-image frame is set as a marker pixel block, and a pixel value of the marker image block is set to a special value. It should be understood that the particular values of the marked pixel blocks in the sub-image frames are different for different original high definition image frames. The VR application layer can read the pixel values of the labeled pixel blocks in the sub-image frame when each sub-image frame is received. If the pixel values of the labeled pixel blocks of the two or more sub-image frames are the same, the two or more sub-image frames may be considered to belong to the same original high-definition image frame, and the two or more sub-image frames may be spliced into An image frame is to be displayed.
上述三种拼接方式均为可选的拼接方式，本实施例不限制采用哪一种。但是上述三种拼接方式均能提升子图像帧的拼接正确性，避免了在数据传输过程中丢失子图像帧时，拼接结果出错的情况，保证了用户的观看体验。The above three splicing methods are all optional splicing modes, and this embodiment does not limit which one is adopted. However, the above three splicing methods can improve the splicing correctness of the sub-image frame, and avoid the situation that the splicing result is wrong when the sub-image frame is lost during the data transmission process, thereby ensuring the user's viewing experience.
针对步骤205，VR应用层得到待显示图像帧后，对待显示图像帧进行畸变处理并在VR一体机的显示屏上分屏显示畸变后的待显示图像，进而用户可通过VR一体机上的透镜观看到高清图像，相对于电视上所展示的高清图像而言，VR一体机上展示的高清图像的视觉效果能够达到几十至几百英寸的影院效果，极大提升了用户体验。After the VR application layer obtains the image frame to be displayed, the VR application layer performs distortion processing on the image frame to be displayed and displays the image to be displayed after being distorted on the display screen of the VR integrated machine, so that the user can view through the lens on the VR integrated machine. To high-definition images, compared to the high-definition images displayed on the TV, the visual effects of the high-definition images displayed on the VR all-in-one can achieve cinema effects of tens to hundreds of inches, greatly improving the user experience.
本实施例提供的VR一体机显示高清图像的方法，在VR一体机上开设HDMI接口，并通过HDMI接口获取原高清图像帧。在获取到原高清图像帧后，将原高清图像帧切割成子图像帧，并采用与子图像帧的数量匹配的数据通道将子图像帧传输至VR应用层进行显示，传输效率高。进而，高清片源在VR一体机中显示时，可实现流畅的显示效果。除此之外，采用特殊的拼接方式将子图像帧拼接成待显示图像帧，避免了在数据传输过程中丢失子图像帧时，拼接结果出错的情况，保证了用户的观看体验。 The VR integrated machine provided by the embodiment provides a method for displaying a high-definition image, and an HDMI interface is opened on the VR integrated machine, and the original high-definition image frame is obtained through the HDMI interface. After obtaining the original high-definition image frame, the original high-definition image frame is cut into sub-image frames, and the sub-image frame is transmitted to the VR application layer for display by using a data channel matching the number of sub-image frames, and the transmission efficiency is high. Furthermore, when the high-definition film source is displayed in the VR integrated machine, a smooth display effect can be achieved. In addition, the special splicing method is used to splicing the sub-image frames into image frames to be displayed, which avoids the situation that the splicing result is wrong when the sub-image frames are lost during the data transmission process, thereby ensuring the user's viewing experience.
值得说明的是，本发明提供的在VR一体机显示高清图像的方法及VR一体机，不仅可以应用于VR技术领域，也可以应用于与VR技术领域接近的AR(Augmented Reality，增强现实)技术领域以及MR(Mix reality，混合现实)技术领域。在应用于AR技术领域时，可在AR一体机上开设HDMI接口，并通过HDMI接口获取原高清图像帧。在获取到原高清图像帧后，将原高清图像帧切割成子图像帧，并采用与子图像帧的数量匹配的数据通道将子图像帧传输至AR应用进行显示；同理，可以类推至MR技术领域,具体的实现方法可以参考本发明实施例所记载的内容，不再赘述。It should be noted that the method for displaying high-definition images in the VR integrated machine and the VR integrated machine provided by the present invention can be applied not only to the field of VR technology but also to AR (Augmented Reality) technology which is close to the field of VR technology. Domain and MR (Mix reality) technology. When applied to the AR technology field, an HDMI interface can be opened on the AR integrated machine, and the original high-definition image frame can be obtained through the HDMI interface. After obtaining the original high-definition image frame, the original high-definition image frame is cut into sub-image frames, and the sub-image frame is transmitted to the AR application for display by using the data channel matching the number of sub-image frames; similarly, the MR technology can be analogized. For the specific implementation method, reference may be made to the content described in the embodiments of the present invention, and details are not described herein.
图3是本发明实施例提供的VR一体机的结构示意图，结合图3，该VR一体机包括：存储器301以及处理器302。FIG. 3 is a schematic structural diagram of a VR integrated machine according to an embodiment of the present invention. Referring to FIG. 3, the VR integrated machine includes a memory 301 and a processor 302.
其中，所述存储器301用于：存储一条或多条计算机指令。The memory 301 is configured to: store one or more computer instructions.
所述处理器302用于执行所述一条或多条计算机指令，以用于：获取通过HDMI接口输入的原高清图像帧；通过所述VR一体机上的图像切割芯片切割所述原高清图像帧，以得到子图像帧；通过与所述子图像帧的数量匹配的数据通道，将所述子图像帧传输至VR应用层进行显示。The processor 302 is configured to execute the one or more computer instructions for: acquiring an original high-definition image frame input through an HDMI interface; cutting the original high-definition image frame by an image cutting chip on the VR integrated machine, Obtaining a sub-image frame; transmitting the sub-image frame to a VR application layer for display by a data channel matching the number of the sub-image frames.
进一步可选地，所述处理器302具体用于：将所述子图像帧传输至VR应用层，以使所述VR应用层将所述子图像帧拼接成待显示图像帧；以及，对所述待显示图像帧进行畸变处理并在VR一体机的显示屏上显示畸变后的所述待显示图像帧。Further, the processor 302 is specifically configured to: transmit the sub-image frame to a VR application layer, so that the VR application layer splices the sub-image frame into an image frame to be displayed; The display image frame is subjected to distortion processing and the distorted image frame to be displayed is displayed on the display screen of the VR integrated machine.
进一步可选地，所述处理器302具体用于：所述VR应用层将发送时间戳相同的子图像帧拼接成一待显示图像帧；或，将附加识别标签相匹配的子图像帧拼接为一待显示图像帧；或，将标记像素块的像素值相对应的子图像帧拼接为一待显示图像帧。Further, the processor 302 is specifically configured to: the VR application layer splicing the sub-image frames with the same time stamps into one image frame to be displayed; or splicing the sub-image frames matching the additional identification tags into one The image frame to be displayed; or, the sub-image frame corresponding to the pixel value of the marked pixel block is spliced into a to-be-displayed image frame.
进一步可选地，所述处理器302具体用于：通过所述图像切割芯片303切割所述原高清图像帧，以得到尺寸相同的子图像帧。Further optionally, the processor 302 is specifically configured to: cut the original high-definition image frame by the image cutting chip 303 to obtain sub-image frames of the same size.
进一步可选地，所述处理器302具体用于：通过所述图像切割芯片303 切割所述原高清图像帧，以得到两帧子图像帧。Further optionally, the processor 302 is specifically configured to: cut the chip 303 through the image The original high definition image frame is cut to obtain two frames of sub image frames.
本实施例提供的VR一体机，在VR一体机上开设HDMI接口，并通过HDMI接口获取原高清图像帧。在获取到原高清图像帧后，将原高清图像帧切割成子图像帧，并采用与子图像帧的数量匹配的数据通道将子图像帧传输至VR应用层进行显示，传输效率高。进而，高清片源在VR一体机中显示时，可实现流畅的显示效果。The VR integrated machine provided in this embodiment provides an HDMI interface on the VR integrated machine, and acquires the original high-definition image frame through the HDMI interface. After obtaining the original high-definition image frame, the original high-definition image frame is cut into sub-image frames, and the sub-image frame is transmitted to the VR application layer for display by using a data channel matching the number of sub-image frames, and the transmission efficiency is high. Furthermore, when the high-definition film source is displayed in the VR integrated machine, a smooth display effect can be achieved.
图4示出了一些实施例中VR一体机400的内部配置结构示意图。FIG. 4 shows a schematic diagram of the internal configuration of the VR all-in-one 400 in some embodiments.
显示单元401可以包括显示面板，显示面板设置在VR一体机400上面向用户面部的侧表面，可以为一整块面板、或者为分别对应用户左眼和右眼的左面板和右面板。显示面板可以为电致发光(EL)元件、液晶显示器或具有类似结构的微型显示器、或者视网膜可直接显示或类似的激光扫描式显示器。The display unit 401 may include a display panel disposed on a side surface of the VR integrated machine 400 facing the user's face, and may be a whole panel or a left panel and a right panel corresponding to the left and right eyes of the user, respectively. The display panel may be an electroluminescence (EL) element, a liquid crystal display or a microdisplay having a similar structure, or a laser-scanned display in which the retina may be directly displayed or similar.
虚拟图像光学单元402以放大方式拍摄显示单元401所显示的图像，并允许用户按放大的虚拟图像观察所显示的图像。作为输出到显示单元401上的显示图像，可以是从内容再现设备(蓝光光碟或DVD播放器)或流媒体服务器提供的虚拟场景的图像、或者使用外部相机410拍摄的现实场景的图像。一些实施例中，虚拟图像光学单元402可以包括透镜单元，例如球面透镜、非球面透镜、菲涅尔透镜等。The virtual image optical unit 402 photographs the image displayed by the display unit 401 in an enlarged manner and allows the user to observe the displayed image in the enlarged virtual image. As the display image outputted to the display unit 401, it may be an image of a virtual scene supplied from a content reproduction device (a Blu-ray disc or a DVD player) or a streaming server, or an image of a real scene photographed using an external camera 410. In some embodiments, virtual image optical unit 402 can include a lens unit, such as a spherical lens, an aspheric lens, a Fresnel lens, and the like.
输入操作单元403包括至少一个用来执行输入操作的操作部件，例如按键、按钮、开关或者其他具有类似功能的部件，通过操作部件接收用户指令，并且向控制单元407输出指令。The input operation unit 403 includes at least one operation member for performing an input operation, such as a button, a button, a switch, or other similarly functioned component, receives a user instruction through the operation member, and outputs an instruction to the control unit 407.
状态信息获取单元404用于获取穿戴VR一体机400的用户的状态信息。状态信息获取单元404可以包括各种类型的传感器，用于自身检测状态信息，并可以通过通信单元405从外部设备(例如智能手机、腕表和用户穿戴的其它多功能终端)获取状态信息。状态信息获取单元404可以获取用户的头部的位置信息和/或姿态信息。状态信息获取单元404可以包括陀螺仪传感器、加速度传感器、全球定位***(GPS)传感器、地磁传感器、多普勒效应传感器、红外传感器、射频场强度传感器中的一个或者多个。此外，状态信息获取单 元404获取穿戴VR一体机400的用户的状态信息，例如获取例如用户的操作状态(用户是否穿戴VR一体机400)、用户的动作状态(诸如静止、行走、跑动和诸如此类的移动状态，手或指尖的姿势、眼睛的开或闭状态、视线方向、瞳孔尺寸)、精神状态(用户是否沉浸在观察所显示的图像以及诸如此类的)，甚至生理状态。The status information acquisition unit 404 is configured to acquire status information of the user wearing the VR integrated machine 400. The status information acquisition unit 404 may include various types of sensors for detecting status information by itself, and may acquire status information from an external device such as a smartphone, a wristwatch, and other multi-function terminals worn by the user through the communication unit 405. The status information acquisition unit 404 can acquire location information and/or posture information of the user's head. The status information acquisition unit 404 may include one or more of a gyro sensor, an acceleration sensor, a global positioning system (GPS) sensor, a geomagnetic sensor, a Doppler effect sensor, an infrared sensor, and a radio frequency field intensity sensor. In addition, status information acquisition form The element 404 acquires state information of the user wearing the VR integrated machine 400, for example, acquires an operation state of the user (whether the user wears the VR all-in-one 400), an action state of the user (such as a stationary state, walking, running, and the like, a mobile state, hand Or the posture of the fingertip, the open or closed state of the eye, the direction of the line of sight, the size of the pupil, the mental state (whether the user is immersed in the image displayed by the observation, and the like), or even the physiological state.
通信单元405执行与外部装置的通信处理、调制和解调处理、以及通信信号的编码和解码处理。另外，控制单元407可以从通信单元405向外部装置发送传输数据。通信方式可以是有线或者无线形式，例如移动高清链接(MHL)或通用串行总线(USB)、高清多媒体接口(HDMI)、无线保真(Wi-Fi)、蓝牙通信或低功耗蓝牙通信，以及IEEE802.11s标准的网状网络等。另外，通信单元405可以是根据宽带码分多址(W-CDMA)、长期演进(LTE)和类似标准操作的蜂窝无线收发器。The communication unit 405 performs communication processing, modulation and demodulation processing with an external device, and encoding and decoding processing of the communication signal. In addition, the control unit 407 can transmit transmission data from the communication unit 405 to an external device. The communication method may be wired or wireless, such as mobile high-definition link (MHL) or universal serial bus (USB), high-definition multimedia interface (HDMI), wireless fidelity (Wi-Fi), Bluetooth communication, or low-power Bluetooth communication. And the mesh network of the IEEE802.11s standard. Additionally, communication unit 405 can be a cellular wireless transceiver that operates in accordance with Wideband Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), and the like.
一些实施例中，VR一体机400还可以包括存储单元，存储单元406是配置为具有固态驱动器(SSD)等的大容量存储设备。一些实施例中，存储单元406可以存储应用程序或各种类型的数据。例如，用户使用VR一体机400观看的内容可以存储在存储单元406中。In some embodiments, the VR all-in-one 400 may also include a storage unit, which is a mass storage device configured to have a solid state drive (SSD) or the like. In some embodiments, storage unit 406 can store applications or various types of data. For example, content viewed by a user using the VR all-in-one 400 may be stored in the storage unit 406.
一些实施例中，VR一体机400还可以包括控制单元，控制单元407可以包括计算机处理单元(CPU)或者其他具有类似功能的设备。一些实施例中，控制单元407可以用于执行存储单元406存储的应用程序，或者控制单元407还可以用于执行本申请一些实施例公开的方法、功能和操作的电路。In some embodiments, the VR all-in-one 400 may further include a control unit, and the control unit 407 may include a computer processing unit (CPU) or other device having similar functions. In some embodiments, control unit 407 can be used to execute an application stored by storage unit 406, or control unit 407 can also be used to perform the methods, functions, and operations disclosed in some embodiments of the present application.
图像处理单元408用于执行信号处理，比如与从控制单元407输出的图像信号相关的图像质量校正，以及将其分辨率转换为根据显示单元401的屏幕的分辨率。然后，显示驱动单元409依次选择显示单元401的每行像素，并逐行依次扫描显示单元401的每行像素，因而提供基于经信号处理的图像信号的像素信号。The image processing unit 408 is for performing signal processing such as image quality correction related to the image signal output from the control unit 407, and converting its resolution into a resolution according to the screen of the display unit 401. Then, the display driving unit 409 sequentially selects each row of pixels of the display unit 401, and sequentially scans each row of pixels of the display unit 401 line by line, thereby providing pixel signals based on the signal-processed image signals.
一些实施例中，VR一体机400还可以包括外部相机。外部相机410可以设置在VR一体机400主体前表面，外部相机410可以为一个或者多个。外部 相机410可以获取三维信息，并且也可以用作距离传感器。另外，探测来自物体的反射信号的位置灵敏探测器(PSD)或者其他类型的距离传感器可以与外部相机410一起使用。外部相机410和距离传感器可以用于检测穿戴VR一体机400的用户的身***置、姿态和形状。另外，一定条件下用户可以通过外部相机410直接观看或者预览现实场景。In some embodiments, the VR all-in-one 400 can also include an external camera. The external camera 410 may be disposed on the front surface of the main body of the VR integrated machine 400, and the external camera 410 may be one or more. External The camera 410 can acquire three-dimensional information and can also be used as a distance sensor. Additionally, a position sensitive detector (PSD) or other type of distance sensor that detects reflected signals from the object can be used with the external camera 410. The external camera 410 and the distance sensor can be used to detect the body position, posture, and shape of the user wearing the VR integrated machine 400. In addition, under certain conditions, the user can directly view or preview the real scene through the external camera 410.
一些实施例中，VR一体机400还可以包括声音处理单元，声音处理单元411可以执行从控制单元407输出的声音信号的声音质量校正或声音放大，以及输入声音信号的信号处理等。然后，声音输入/输出单元412在声音处理后向外部输出声音以及输入来自麦克风的声音。In some embodiments, the VR all-in-one 400 may further include a sound processing unit 411 that may perform sound quality correction or sound amplification of the sound signal output from the control unit 407, signal processing of the input sound signal, and the like. Then, the sound input/output unit 412 outputs the sound to the outside and the sound from the microphone after the sound processing.
需要说明的是，图4中虚线框示出的结构或部件可以独立于VR一体机400之外，例如可以设置在外部处理***(例如计算机***)中与VR一体机400配合使用；或者，虚线框示出的结构或部件可以设置在VR一体机400内部或者表面上。It should be noted that the structure or component shown by the dotted line in FIG. 4 may be independent of the VR integrated machine 400, for example, may be disposed in an external processing system (for example, a computer system) for use with the VR integrated machine 400; or, a dotted line The illustrated structure or components may be disposed inside or on the surface of the VR integrated machine 400.
以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下，即可以理解并实施。The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件。基于这样的理解，上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware. Based on such understanding, the above-described technical solutions may be embodied in the form of software products in essence or in the form of software products, which may be stored in a computer readable storage medium such as ROM/RAM, magnetic Discs, optical discs, etc., include instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments or portions of the embodiments.
最后应说明的是：以上实施例仅用以说明本发明的技术方案，而非对其 限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。 Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention, rather than The present invention has been described in detail with reference to the foregoing embodiments, and those skilled in the art should understand that the technical solutions described in the foregoing embodiments may be modified or equivalently substituted for some of the technical features. The modifications and substitutions of the present invention do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

  1. 一种在VR一体机显示高清图像的方法，其特征在于，包括：A method for displaying a high definition image on a VR integrated machine, comprising:
    获取通过VR一体机上的HDMI接口输入的原高清图像帧；Obtain the original HD image frame input through the HDMI interface on the VR all-in-one;
    通过所述VR一体机上的图像切割芯片切割所述原高清图像帧，以得到子图像帧；Cutting the original high-definition image frame by an image cutting chip on the VR integrated machine to obtain a sub-image frame;
    通过与所述子图像帧的数量匹配的数据通道，将所述子图像帧传输至VR应用层进行显示。The sub-image frames are transmitted to the VR application layer for display by a data channel that matches the number of the sub-image frames.
  2. 根据权利要求1所述的方法，其特征在于，将所述子图像帧传输至VR应用层进行显示，包括：The method according to claim 1, wherein the transmitting the sub-image frame to the VR application layer for display comprises:
    将所述子图像帧传输至VR应用层，以使所述VR应用层将所述子图像帧拼接成待显示图像帧；以及，对所述待显示图像帧进行畸变处理并在VR一体机的显示屏上显示畸变后的所述待显示图像帧。Transmitting the sub-image frame to a VR application layer, so that the VR application layer splices the sub-image frame into an image frame to be displayed; and performing distortion processing on the image frame to be displayed and in the VR integrated machine The image frame to be displayed after distortion is displayed on the display screen.
  3. 根据权利要求2所述的方法，其特征在于，所述VR应用层将所述子图像帧拼接成待显示图像帧，包括：The method according to claim 2, wherein the VR application layer splices the sub-image frames into image frames to be displayed, including:
    所述VR应用层将发送时间戳相同的子图像帧拼接成一待显示图像帧；或，The VR application layer splices the sub-image frames with the same time stamps into one image frame to be displayed; or
    将附加识别标签相匹配的子图像帧拼接为一待显示图像帧；或，Splicing the sub-image frames matching the additional identification tags into one image frame to be displayed; or
    将标记像素块的像素值相对应的子图像帧拼接为一待显示图像帧。The sub-image frames corresponding to the pixel values of the marked pixel block are spliced into one image frame to be displayed.
  4. 根据权利要求1-3中任一项所述的方法，其特征在于，所述子图像帧中的任意两个子图像帧尺寸相同。The method according to any one of claims 1 to 3, wherein any two sub-image frames in the sub-image frame are the same size.
  5. 根据权利要求4所述的方法，其特征在于，所述子图像帧的数量为两帧。The method of claim 4 wherein the number of sub-image frames is two frames.
  6. 一种VR一体机，其特征在于，包括：存储器以及处理器；A VR integrated machine, comprising: a memory and a processor;
    所述存储器用于：存储一条或多条计算机指令；The memory is configured to: store one or more computer instructions;
    所述处理器用于执行所述一条或多条计算机指令，以用于：The processor is configured to execute the one or more computer instructions for:
    获取通过HDMI接口输入的原高清图像帧；Obtain the original high-definition image frame input through the HDMI interface;
    通过所述VR一体机上的图像切割芯片切割所述原高清图像帧，以得到子图像帧； Cutting the original high-definition image frame by an image cutting chip on the VR integrated machine to obtain a sub-image frame;
    通过与所述子图像帧的数量匹配的数据通道，将所述子图像帧传输至VR应用层进行显示。The sub-image frames are transmitted to the VR application layer for display by a data channel that matches the number of the sub-image frames.
  7. 根据权利要求6所述的VR一体机，其特征在于，所述处理器具体用于：The VR integrated machine according to claim 6, wherein the processor is specifically configured to:
    将所述子图像帧传输至VR应用层，以使所述VR应用层将所述子图像帧拼接成待显示图像帧；以及，对所述待显示图像帧进行畸变处理并在VR一体机的显示屏上显示畸变后的所述待显示图像帧。Transmitting the sub-image frame to a VR application layer, so that the VR application layer splices the sub-image frame into an image frame to be displayed; and performing distortion processing on the image frame to be displayed and in the VR integrated machine The image frame to be displayed after distortion is displayed on the display screen.
  8. 根据权利要求7所述的VR一体机，其特征在于，所述处理器具体用于：The VR integrated machine according to claim 7, wherein the processor is specifically configured to:
    所述VR应用层将发送时间戳相同的子图像帧拼接成一待显示图像帧；或，The VR application layer splices the sub-image frames with the same time stamps into one image frame to be displayed; or
    将附加识别标签相匹配的子图像帧拼接为一待显示图像帧；或，Splicing the sub-image frames matching the additional identification tags into one image frame to be displayed; or
    将标记像素块的像素值相对应的子图像帧拼接为一待显示图像帧。The sub-image frames corresponding to the pixel values of the marked pixel block are spliced into one image frame to be displayed.
  9. 根据权利要求6-8中任一项所述的VR一体机，其特征在于，所述处理器具体用于：The VR integrated machine according to any one of claims 6-8, wherein the processor is specifically configured to:
    通过所述图像切割芯片切割所述原高清图像帧，以得到尺寸相同的子图像帧。The original high definition image frame is cut by the image cutting chip to obtain sub-image frames of the same size.
  10. 根据权利要求9所述的VR一体机，其特征在于，所述处理器具体用于：The VR integrated machine according to claim 9, wherein the processor is specifically configured to:
    通过所述图像切割芯片切割所述原高清图像帧，以得到两帧子图像帧。 The original high definition image frame is cut by the image cutting chip to obtain two frames of sub image frames.
PCT/CN2017/113972 2017-09-20 2017-11-30 Method for displaying high definition image in vr integrated machine, and vr integrated machine WO2019056577A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710851115.5A CN107483914A (en) 2017-09-20 2017-09-20 The method and VR all-in-ones of high-definition image are shown in VR all-in-ones
CN201710851115.5 2017-09-20

Publications (1)

Publication Number Publication Date
WO2019056577A1 true WO2019056577A1 (en) 2019-03-28

Family

ID=60586017

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/113972 WO2019056577A1 (en) 2017-09-20 2017-11-30 Method for displaying high definition image in vr integrated machine, and vr integrated machine

Country Status (2)

Country Link
CN (1) CN107483914A (en)
WO (1) WO2019056577A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109936761A (en) * 2017-12-19 2019-06-25 深圳市冠旭电子股份有限公司 VR all-in-one machine and the synchronous method of external terminal, system and VR all-in-one machine

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130076872A1 (en) * 2011-09-23 2013-03-28 Himax Technologies Limited System and Method of Detecting and Correcting an Improper Rendering Condition in Stereoscopic Images
CN103021377A (en) * 2012-12-21 2013-04-03 北京牡丹视源电子有限责任公司 Ultrahigh-definition multi-screen image processing system
CN105141876A (en) * 2015-09-24 2015-12-09 京东方科技集团股份有限公司 Video signal conversion method, video signal conversion device and display system
CN105791769A (en) * 2016-03-11 2016-07-20 广东威创视讯科技股份有限公司 Ultra-high-definition video display method and system of splicing wall
CN105915990A (en) * 2016-05-25 2016-08-31 青岛歌尔声学科技有限公司 Virtual reality (VR) helmet and using method thereof
CN106257543A (en) * 2016-09-23 2016-12-28 珠海市杰理科技股份有限公司 Vehicle-running recording system based on virtual reality visual angle
CN206224381U (en) * 2016-08-22 2017-06-06 杜晓红 Using the 3D virtual reality interactive education systems of high definition 3D head-mounted displays

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015119373A (en) * 2013-12-19 2015-06-25 ソニー株式会社 Image processor and method, and program
CN105611213A (en) * 2016-01-04 2016-05-25 京东方科技集团股份有限公司 Image processing method, image play method and related device and system
CN205812280U (en) * 2016-05-25 2016-12-14 青岛歌尔声学科技有限公司 A kind of virtual implementing helmet
CN106603953A (en) * 2016-09-28 2017-04-26 杭州青杉奇勋科技有限公司 Video display method and video display system of converting HDMI interface into MIPI interface

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130076872A1 (en) * 2011-09-23 2013-03-28 Himax Technologies Limited System and Method of Detecting and Correcting an Improper Rendering Condition in Stereoscopic Images
CN103021377A (en) * 2012-12-21 2013-04-03 北京牡丹视源电子有限责任公司 Ultrahigh-definition multi-screen image processing system
CN105141876A (en) * 2015-09-24 2015-12-09 京东方科技集团股份有限公司 Video signal conversion method, video signal conversion device and display system
CN105791769A (en) * 2016-03-11 2016-07-20 广东威创视讯科技股份有限公司 Ultra-high-definition video display method and system of splicing wall
CN105915990A (en) * 2016-05-25 2016-08-31 青岛歌尔声学科技有限公司 Virtual reality (VR) helmet and using method thereof
CN206224381U (en) * 2016-08-22 2017-06-06 杜晓红 Using the 3D virtual reality interactive education systems of high definition 3D head-mounted displays
CN106257543A (en) * 2016-09-23 2016-12-28 珠海市杰理科技股份有限公司 Vehicle-running recording system based on virtual reality visual angle

Also Published As

Publication number Publication date
CN107483914A (en) 2017-12-15

Similar Documents

Publication Publication Date Title
US10956113B2 (en) Facilitation of concurrent consumption of media content by multiple users using superimposed animation
US10534428B2 (en) Image processing device and image processing method, display device and display method, and image display system
KR102462206B1 (en) Method and apparatus for rendering timed text and graphics in virtual reality video
WO2020192458A1 (en) Image processing method and head-mounted display device
WO2015107817A1 (en) Image display device and image display method, image output device and image output method, and image display system
US20120224070A1 (en) Eyeglasses with Integrated Camera for Video Streaming
WO2020140758A1 (en) Image display method, image processing method, and related devices
WO2018223663A1 (en) Vr image processing method, device, and apparatus
US9535250B2 (en) Head mounted display device and method for controlling the same
CN102918855A (en) Method and apparaus for making intelligent use of active space in frame packing format
JP6391423B2 (en) Image generating apparatus, image extracting apparatus, image generating method, and image extracting method
US20230319247A1 (en) Cloud-based Rendering of Interactive Augmented/Virtual Reality Experiences
WO2019015249A1 (en) Virtual-reality-based image display method and apparatus, and virtual reality helmet device
WO2019061800A1 (en) Virtual scene switching method and head-mounted display device
WO2020042494A1 (en) Method for screenshot of vr scene, device and storage medium
WO2019019232A1 (en) Method for playing video based on vr head-mounted device, and vr head-mounted device
US8681205B2 (en) Systems and methods for controlling a three dimensional (3D) compatible viewing device
WO2016155227A1 (en) Method and apparatus for displaying viewfinding information
US20210192681A1 (en) Frame reprojection for virtual reality and augmented reality
WO2019056577A1 (en) Method for displaying high definition image in vr integrated machine, and vr integrated machine
JP2013015741A (en) Image output device, image output method and program
CN107426522B (en) Video method and system based on virtual reality equipment
CN111736692B (en) Display method, display device, storage medium and head-mounted device
WO2019085109A1 (en) Image writing control method and apparatus, and electronic device
CN113099237A (en) Video processing method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17925821

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17925821

Country of ref document: EP

Kind code of ref document: A1