CN117440351A - Virtual reality device, data transmission method and device thereof and storage medium - Google Patents
Virtual reality device, data transmission method and device thereof and storage medium Download PDFInfo
- Publication number
- CN117440351A CN117440351A CN202210828236.9A CN202210828236A CN117440351A CN 117440351 A CN117440351 A CN 117440351A CN 202210828236 A CN202210828236 A CN 202210828236A CN 117440351 A CN117440351 A CN 117440351A
- Authority
- CN
- China
- Prior art keywords
- chip
- wireless
- sub
- wireless communication
- communication mode
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 240
- 238000000034 method Methods 0.000 title claims abstract description 68
- 238000004891 communication Methods 0.000 claims abstract description 294
- 230000002093 peripheral effect Effects 0.000 claims abstract description 156
- 230000007958 sleep Effects 0.000 claims description 27
- 238000004590 computer program Methods 0.000 claims description 11
- 238000001514 detection method Methods 0.000 claims description 4
- 230000001360 synchronised effect Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 11
- 230000007613 environmental effect Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000005059 dormancy Effects 0.000 description 4
- 230000002618 waking effect Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000006855 networking Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000007659 motor function Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W56/00—Synchronisation arrangements
- H04W56/0005—Synchronisation arrangements synchronizing of arrival of multiple uplinks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/10—Connection setup
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The application provides virtual reality equipment, a data transmission method, a data transmission device and a storage medium thereof. The apparatus includes: the head-mounted display comprises a first wireless chip, the peripheral device comprises a second wireless chip, the first wireless chip and the second wireless chip are communicated through a first wireless communication mode and a second wireless communication mode, so that transmission of first-order data is carried out between the head-mounted display and the peripheral device through the first wireless communication mode, and transmission of second-order data is carried out through the second wireless communication mode. The dual-wireless transmission architecture between the head-mounted display and the peripheral device is adopted, so that the dual-wireless transmission architecture meets the high-efficiency transmission requirements of data of different orders, and high-efficiency data transmission under different orders of magnitude between the head-mounted display and the peripheral device is realized, thereby greatly reducing transmission delay in data transmission and ensuring timeliness of data transmission.
Description
Technical Field
The embodiment of the application relates to the technical field of data processing, in particular to virtual reality equipment, a data transmission method, a data transmission device and a storage medium.
Background
Virtual Reality (VR) devices currently mainly employ optical tracking principles to implement location tracking of various devices (e.g., head mounted displays, handles, etc.) therein. At this time, the head-mounted display generally only needs to acquire inertial sensing data of external devices such as a handle through a simple wireless transmission module, so that the relative position relationship between the external devices such as the handle and the head-mounted display can be tracked, and further the positioning tracking of the external devices is realized. However, considering that peripheral devices such as handles are limited by the Field of View (FOV) of each optical camera in the head-mounted display, a blind area exists in use, so that when the peripheral device is out of the Field of View, positioning tracking of the peripheral device cannot be realized.
At present, devices such as a head-mounted display and a handle in VR equipment can generally realize the positioning tracking of the head-mounted display and other peripheral devices by sharing relatively complex big data such as environmental point cloud data and camera images between the head-mounted display and the handle. At this time, because the transmission bandwidth of wireless modules such as bluetooth and WiFi configured in the VR device is low, when there is a large amount of data transmission demands between the head-mounted display and the peripheral device, the timeliness of data transmission can be greatly affected, so that there is a large data transmission delay between the head-mounted display and the peripheral device.
Disclosure of Invention
The application provides virtual reality equipment, a data transmission method, a data transmission device and a storage medium thereof, which adopt a dual-wireless transmission architecture to realize high-efficiency data transmission between a head-mounted display and a peripheral device under different quantity levels, greatly reduce transmission delay during data transmission and ensure timeliness of data transmission.
In a first aspect, embodiments of the present application provide a virtual reality device, including: the device comprises a head-mounted display and a peripheral device, wherein the head-mounted display comprises a first wireless chip, the peripheral device comprises a second wireless chip, and the first wireless chip and the second wireless chip are communicated through a first wireless communication mode and a second wireless communication mode; wherein,
and transmitting the first magnitude data through the first wireless communication mode, and transmitting the second magnitude data through the second wireless communication mode.
In a second aspect, an embodiment of the present application provides a data transmission method, which is applied to the head-mounted display of the virtual reality device provided in the first aspect, where the method includes the following non-sequentially performed steps:
transmitting first magnitude data to a second wireless chip configured in the external device through a first wireless communication mode supported by the configured first wireless chip;
Transmitting second-order data to a second wireless chip configured in the external device through a second wireless communication mode supported by the configured first wireless chip;
the first wireless communication mode is ultra-wideband wireless communication, and the second wireless communication mode is other wireless communication modes except ultra-wideband wireless communication.
In a third aspect, an embodiment of the present application provides a data transmission method, which is applied to the peripheral device of the virtual reality device provided in the first aspect, where the method includes the following non-sequentially executed steps:
transmitting first magnitude data to a first wireless chip configured in the head-mounted display through a first wireless communication mode supported by a configured second wireless chip;
transmitting second-order data to a first wireless chip configured in the head-mounted display through a second wireless communication mode supported by a configured second wireless chip;
the first wireless communication mode is ultra-wideband wireless communication, and the second wireless communication mode is other wireless communication modes except ultra-wideband wireless communication.
In a fourth aspect, an embodiment of the present application provides a data transmission device configured in a head-mounted display of the virtual reality device provided in the first aspect, where the device includes:
The first transmission module is used for transmitting first-order data to a second wireless chip configured in the external device in a first wireless communication mode supported by the configured first wireless chip;
the second transmission module is used for transmitting second-order data to a second wireless chip configured in the external device in a second wireless communication mode supported by the configured first wireless chip;
the first wireless communication mode is ultra-wideband wireless communication, and the second wireless communication mode is other wireless communication modes except ultra-wideband wireless communication.
In a fifth aspect, an embodiment of the present application provides a data transmission apparatus configured in a peripheral device of the virtual reality device provided in the first aspect, where the apparatus includes:
the third transmission module is used for transmitting first-order data to the first wireless chip configured in the head-mounted display in a first wireless communication mode supported by the configured second wireless chip;
a fourth transmission module, configured to transmit second-order data to the first wireless chip configured in the head-mounted display through a second wireless communication mode supported by the configured second wireless chip;
the first wireless communication mode is ultra-wideband wireless communication, and the second wireless communication mode is other wireless communication modes except ultra-wideband wireless communication.
In a sixth aspect, embodiments of the present application provide a computer-readable storage medium storing a computer program that causes a computer to execute the data transmission method as provided in the second or third aspect of the present application.
In a seventh aspect, embodiments of the present application provide a computer program product comprising a computer program/instruction, characterized in that the computer program/instruction, when executed by a processor, implements a data transmission method as provided in the second or third aspect of the present application.
According to the virtual reality device, the first wireless chip is configured in the head-mounted display of the VR device, the second wireless chip is configured in the peripheral device of the VR device, and the first wireless chip and the second wireless chip can communicate through the first wireless communication mode and the second wireless communication mode, so that transmission of first-order data is executed between the head-mounted display and the peripheral device through the first wireless communication mode, transmission of second-order data is executed through the second wireless communication mode, a dual-wireless transmission framework between the head-mounted display and the peripheral device is jointly formed through the first wireless communication mode and the second wireless communication mode, high-efficiency transmission requirements of different-order data are met, high-efficiency data transmission under different volume levels between the head-mounted display and the peripheral device is achieved, transmission delay in data transmission is greatly reduced, and timeliness of data transmission is ensured.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a VR device in the prior art;
fig. 2 is a block diagram of a virtual reality device according to an embodiment of the present application;
fig. 3 is a schematic diagram of a second order data transmission by a second wireless communication method according to an embodiment of the present application;
fig. 4 is a schematic diagram of a first order data transmission by a first wireless communication manner according to an embodiment of the present application;
fig. 5 is a schematic diagram of networking between a head-mounted display and a peripheral device according to an embodiment of the present application;
fig. 6 is a schematic diagram of a pairing process between a first wireless sub-chip and a third wireless sub-chip according to an embodiment of the present disclosure;
fig. 7 is a flowchart of a data transmission method according to an embodiment of the present application;
FIG. 8 is a flow chart of another data transmission method according to an embodiment of the present application;
Fig. 9 is a schematic block diagram of a data transmission device according to an embodiment of the present application;
fig. 10 is a schematic block diagram of another data transmission device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Prior to introducing the technical solution of the present application, the following describes the existing structure of VR devices:
VR devices are used primarily to simulate a variety of real-world environments, while providing immersive virtual environments for users in various industries. VR devices typically include two parts, a head mounted display and peripheral devices. As shown in fig. 1, the peripheral device may be a device for assisting in detecting a motion state of a user, such as a left handle and a right handle.
At this time, when the head-mounted display and the peripheral device in the VR device implement positioning tracking of the head-mounted display and the peripheral device, in order to ensure accuracy of positioning tracking, environment-related data of the other party is generally required to be shared between the head-mounted display and the peripheral device, so as to ensure authenticity of modeling a virtual environment and accuracy of a relative positional relationship of the head-mounted display and the peripheral device. As shown in fig. 1, the environmental related data may include environmental point cloud data, optical image data, inertial sensing data, and the like, which are acquired by using cameras, inertial measurement unit (Inertial Measurement Unit, IMU) sensors, and the like, which have been configured by themselves, in the head mounted display and the peripheral device, respectively.
In addition, considering that the left and right handles in the VR device currently start to support the broadband motor function, as shown in fig. 1, the head-mounted display transmits audio control data of the broadband motor to the left and right handles, so that the broadband motor in the left and right handles can vibrate according to the vibration frequency set by the audio control data, and the consistency of the vibration of the broadband motor in the left and right handles is ensured.
From the foregoing, it can be seen that, in order to achieve successful execution of the various functions supported by the VR device, there is a large data transmission requirement between the head-mounted display and the peripheral device, and the data to be transmitted between the head-mounted display and the peripheral device is also classified into different orders. At this time, because the transmission bandwidth supported by the existing configured wireless chips such as bluetooth and WiFi in the VR device is low, the device cannot adapt to the requirement of a large amount of data transmission between the head-mounted display and the peripheral device, and the timeliness of the data transmission is greatly affected, so that a large data transmission delay exists between the head-mounted display and the peripheral device.
In order to solve the technical problem, the first wireless chip is additionally configured in the head-mounted display and the second wireless chip is additionally configured in the peripheral device on the basis of the existing structure of the VR device, and the first wireless chip and the second wireless chip can communicate through the first wireless communication mode and the second wireless communication mode, so that the head-mounted display and the peripheral device can execute transmission of first-order data through the first wireless communication mode and execute transmission of second-order data through the second wireless communication mode, a dual-wireless transmission structure between the head-mounted display and the peripheral device is jointly formed by the first wireless communication mode and the second wireless communication mode, the high-efficiency transmission requirements of different-order data are met, the high-efficiency data transmission under different volume levels between the head-mounted display and the peripheral device is realized, the transmission delay during data transmission is greatly reduced, and the timeliness of the data transmission is ensured.
It should be noted that, in the present application, a data transmission manner between a head-mounted display and a peripheral device in a VR device is mainly described, but each functional module configured in an existing structure in the VR device still performs the same function, so as to assist in performing normal data transmission between the head-mounted display and the peripheral device in the VR device.
The technical scheme of the application will be described in detail as follows:
fig. 2 is a block diagram of a virtual reality device according to an embodiment of the present application. As shown in fig. 2, the virtual reality device includes two parts, a head mounted display 210 and a peripheral device 220.
The head-mounted display 210 includes a first wireless chip 211, the peripheral device 220 includes a second wireless chip 221, and the first wireless chip and the second wireless chip communicate with each other in a first wireless communication manner and a second wireless communication manner, so that a dual-wireless transmission architecture is adopted between the head-mounted display 210 and the peripheral device 220 to meet transmission requirements of data of different magnitudes.
Specifically, the transmission of the first magnitude data is performed by the first wireless communication method between the head-mounted display 210 and the peripheral device 220, and the transmission of the second magnitude data is performed by the second wireless communication method.
In this application, in order to ensure accuracy of positioning and tracking of the head mounted display 210 and the peripheral device 220 themselves in the VR device, the head mounted display 210 and the peripheral device 220 need to learn environmental related data collected by each other, for example, environmental point cloud data, optical image data, inertial sensing data, and the like collected by using cameras, IMU sensors, and the like that have been respectively configured. Furthermore, through sharing of environment-related data between the head-mounted display 210 and the peripheral device 220, better See-through experience can be achieved between the head-mounted display 210 and the peripheral device 220, and immersive experience of a user in the virtual space is improved. Moreover, in order to make the user better perceive the handle operation, the head mounted display 210 also transmits audio control data of the broadband motor to the external device 220 so that the broadband motor is driven to vibrate by using the audio control data.
As can be seen from the above description, in the normal operation process of the VR device, the variety of data transmitted between the head-mounted display 210 and the peripheral device 220 is large, and there are different data transmission requirements. In order to solve the problem that the transmission bandwidth of the existing wireless chip is low and high-efficiency transmission of large data is not supported, the method and the device aim at various data which need to be transmitted between the head-mounted display 210 and the peripheral device 220, firstly, magnitude division is carried out according to the magnitude of the data, and then the first magnitude data and the second magnitude data in the method and the device are obtained.
The first magnitude data is data with a data amount in the head-mounted display 210 and the peripheral device 220 being greater than or equal to a preset transmission threshold, for example, environmental point cloud data and camera image data collected by the head-mounted display 210 and the peripheral device 220 through a camera and the like configured by the head-mounted display 210 and the peripheral device 220, and audio control data transmitted by the head-mounted display 210 to the peripheral device 220 and used for driving a broadband motor, and the like.
The second level data is data in which the data amount in the head-mounted display 210 and the peripheral device 220 is smaller than a preset transmission threshold, for example, position inertial sensing data collected by the head-mounted display 210 and the peripheral device 220 through an IMU sensor configured by the head-mounted display and the peripheral device.
Then, in order to achieve efficient transmission of different magnitude data between the head-mounted display 210 and the peripheral device 220, a transmission architecture meeting the transmission requirement of the magnitude data is set between the head-mounted display 210 and the peripheral device 220 for each magnitude data, so as to support low-delay efficient transmission of the different magnitude data between the head-mounted display 210 and the peripheral device 220.
Specifically, as shown in fig. 2, two communication connections, that is, a first wireless communication mode and a second wireless communication mode, may be established between a first wireless chip 211 configured in the head-mounted display 210 and a second wireless chip 221 configured in the peripheral device 220, where a transmission architecture of the first wireless communication mode is used for transmitting first-order data in the head-mounted display 210 and the peripheral device 220, and a transmission architecture of the second wireless communication mode is used for transmitting second-order data in the head-mounted display 210 and the peripheral device 220.
The first wireless communication mode in the application may be ultra-wideband wireless communication, and the second wireless communication mode may be other wireless communication modes except ultra-wideband wireless communication. The second wireless communication mode may be, for example, a low-power 2.4G wireless communication or a bluetooth communication.
At this time, the minimum transmission bandwidth of the ultra-wideband wireless communication is 500M, data transmission over 100M can be normally supported, the transmission frequency is between 3.1GHz and 10.6G, and the data transmission between the head-mounted display 210 and the peripheral device 220 can be performed by adopting high bandwidth and extremely short pulse, so that the anti-interference capability is strong. Therefore, the present application can perform low-latency efficient transmission of the first order data between the head-mounted display 210 and the peripheral device 220 using the above-described big data efficient transmission function supported by ultra-wideband wireless communication, and reduce power consumption at the time of data transmission.
The second wireless communication mode represented by 2.4G wireless communication, bluetooth communication, etc. is used as a transmission medium of the second level data between the head-mounted display 210 and the peripheral device 220, and although the transmission bandwidth is low, the normal transmission of the low level data between the head-mounted display 210 and the peripheral device 220 can be supported, and the device has the characteristics of low power consumption, so that the timeliness of the low level data transmission is ensured.
In summary, according to the transmission requirements of different magnitude data, the dual wireless transmission architecture is implemented between the head-mounted display 210 and the peripheral device 220, so as to support low-delay efficient transmission of the first magnitude data and the second magnitude data respectively, and ensure timeliness of data transmission.
It should be noted that, according to specific transmission requirements, the present application may divide transmission data between the head-mounted display 210 and the peripheral device 220 into multiple orders, and design the multi-wireless transmission architecture according to the dual-wireless transmission architecture in the present application, so as to adapt to the efficient transmission requirements of data of each order. At this time, the transmission logic of the plurality of magnitude data is performed between the head-mounted display 210 and the peripheral device 220 through the plurality of wireless transmission architectures, which is the same as the transmission logic of the first magnitude data and the second magnitude data performed by using the dual wireless transmission architecture in the present application, and is not explained in detail in the present application.
As an alternative implementation in the present application, for the second-order data transmission between the head-mounted display 210 and the peripheral device 220, the second wireless communication manner may employ a wireless channel with periodic frequency hopping to transmit the second-order data.
Illustratively, as shown in fig. 3, taking the peripheral device 230 of the VR device as a left and right handle, the head mounted display 210 transmits the second magnitude data to either one of the left and right handles. At a particular point in time, if the head mounted display 210 transmits a second magnitude of data to the left or right handle, both the head mounted display 210 and the current handle operate under the handle channel 1. At this point, the head mounted display 210 is in the transmit state and the current handle is in the receive state. Then, after the current handle receives the beacon signal, the current handle switches to the transmitting state, and data is transmitted to the head-mounted display 210 at a specific time point, and the head-mounted display 210 switches to the receiving state. After a certain period, both the head mounted display 210 and the current handle will hop to operate down the handle channel 2.
For a first order of data transfer between the head mounted display 210 and the peripheral device 220, as shown in fig. 4, the peripheral device 230 of the VR device is exemplified as a left and right handle. The head-mounted display 210 firstly transmits the first magnitude data to the first wireless chip 211 through the head-mounted processor, and then the first wireless chip 211 synchronously transmits the first magnitude data to the second wireless chips 221 in the left and right handles in a first wireless communication mode. At this time, the first order data transmission may pass a certain time of flight due to the difference in distance between the head mounted display 210 and the left and right handles. Then, after receiving the first magnitude data, the second wireless chips 221 of the left and right handles send the first magnitude data to the handle processor for analysis, and the handle processor collects the first magnitude data related to the handles according to the head-wearing command and continues to send the first magnitude data to the second wireless chips 221 of the corresponding handles. Further, the second wireless chip 221 of the left handle is switched to a transmitting state, and the first magnitude data related to the left handle is transmitted to the first wireless chip 211 in the head-mounted display 210 by adopting the first wireless communication mode, and is forwarded to the head-mounted processor by the first wireless chip 211 for analysis processing. And the second wireless chip 221 of the right handle may be delayed for a period of time after receiving the first magnitude data related to the handle sent by the right handle processor, for waiting for the left handle to send the first magnitude data to the head mounted display 210. After a specific delay, the second wireless chip 221 of the right handle is switched to a transmitting state, and the first magnitude data related to the right handle is transmitted to the first wireless chip 211 in the head-mounted display 210 by adopting a first wireless communication mode, and is forwarded to the head-mounted processor by the first wireless chip 211 for analysis processing.
At this time, after data transmission between the head-mounted display 210 and the peripheral device 220, correlation processing is required for data at the same time to ensure accuracy of location tracking and command validity in the VR device. Therefore, before data transmission is performed between the head-mounted display 210 and the peripheral device 220, the head-mounted display 210 and the peripheral device 220 are first synchronized in system time, so that the transmission data of the two devices have timestamp identification under the same time system.
In particular, the wireless system employed for system time synchronization between head mounted display 210 and peripheral device 220 may be implemented via proprietary protocols. In the case where the distance between the head mounted display 210 and the peripheral device 220 is not changed, the time of flight at the time of data transmission between the head mounted display 210 and the peripheral device 220 is a fixed value. With this feature, the head mounted display 210 can transmit a time-synchronized broadcast signal to the second wireless chip 221 through the first wireless chip 211 to achieve time synchronization between the head mounted display 210 and the peripheral device 220.
The broadcast packet in the time synchronization broadcast signal sent by the head-mounted display 210 may include the local time of the head-mounted display 210, and the peripheral device 220 receives the received packet when receiving the time synchronization broadcast signal, so that the time system synchronization between the head-mounted display 210 and the peripheral device 220 is achieved through the actual receiving time and the fixed delay of the received packet. At this time, the local time precision of the peripheral device 220 and the head-mounted display 210 is higher, and when the wireless system has a packet loss condition, the synchronous time stamp can ensure that the camera configured on the head-mounted display 210 can still collect the light emitting diode image of the handle. Each wireless communication is used to correct the time deviation between the head-mounted display 210 and the peripheral device 220 caused by crystal oscillator, etc., so as to ensure the stable synchronization of the time system when the system operates for a long time.
At this time, after the peripheral device 220 is a left handle and a right handle and the system time is synchronized, the camera module configured on the head-mounted display 210 and the handle light spots on the left handle and the right handle have the same time system, so that the camera module and the handle light spots can be controlled to respectively start the camera exposure and the handle light spots at the same time, thereby realizing the positioning tracking of the moving operation handle.
Moreover, corresponding system time synchronization needs to be performed between the respective functional modules configured within the head mounted display 210 and the peripheral device 220.
Taking synchronization between the headset processor and the first wireless chip as an example, the headset processor and the first wireless chip 211 achieve synchronization through an interrupt signal and a communication interface. The head-mounted processor acquires a clock signal T1 of the first wireless chip 211 through a communication interface when the signal is interrupted; the interrupt signal triggers the internal timing T of the headset processor, and the headset processor receives the interrupt signal of the first wireless chip 211 at the clock signal T2, and in combination with the headset timer T, the clock difference between the headset processor and the first wireless chip 211 can be determined. The same principle can be used to achieve system time synchronization between the functional modules within the peripheral device 220.
Further, in order to ensure successful data transmission between the head-mounted display 210 and the peripheral device 220, before performing data transmission, network networking settings between the respective wireless chips in the head-mounted display 210 and the peripheral device 220, such as pairing between the first wireless chip 211 and the second wireless chip 221 in the first wireless communication mode and the second wireless communication mode, etc., need to be implemented first.
At this time, the wireless network between the head mounted display 210 and the peripheral device 220 is divided into a pairing state and a data transmission state. In the pairing state, the respective wireless chips configured in the head-mounted display 210 and the peripheral device 220 use fixed broadcast and reception addresses, so that wireless system networking can be completed using a new device. As shown in fig. 5, taking the peripheral device 220 as a left handle and a right handle as an example, the data transmission between the head-mounted display 210 and the left handle and the right handle can use a head-mounted wireless chip device identifier and a left handle and right handle identifier, the head-mounted wireless chip device identifier can ensure that each set of VR device system can have a unique data broadcasting address, so as to avoid mutual interference between multiple sets of VR device networks, and the left handle and the right handle identifier can avoid related interference of the data transmission of the left handle and the right handle.
As an alternative implementation in the present application, considering that the first wireless communication manner between the first wireless chip 211 and the second wireless chip 221 is used to transmit the first magnitude data of the high data amount, and the second wireless communication manner between the first wireless chip 211 and the second wireless chip 221 is used to transmit the second magnitude data of the low data amount, the power consumption is larger when the data is transmitted between the first wireless chip 211 and the second wireless chip 221 through the first wireless communication manner than the second wireless communication manner.
Therefore, in order to reduce the data transmission power consumption between the head-mounted display 210 and the peripheral device 220, the present application may first establish a communication connection in the second wireless communication mode between the first wireless chip 211 and the second wireless chip 221, so as to complete pairing in the second wireless communication mode. Then, the configuration information related to the first wireless communication scheme is transmitted between the first wireless chip 211 and the second wireless chip 221 by the second wireless communication scheme after the communication connection. According to the configuration information, a communication connection of the first wireless communication mode may be established between the first wireless chip 211 and the second wireless chip 221 to complete pairing in the first wireless communication mode.
For example, to ensure accurate pairing in the first wireless communication manner and the second wireless communication manner, the first wireless chip 211 in the present application may include at least a first wireless sub-chip and a second wireless sub-chip, and the second wireless chip 221 may include at least a third wireless sub-chip and a fourth wireless sub-chip. The first wireless sub-chip and the third wireless sub-chip may be ultra-wideband chips, and the second wireless sub-chip and the fourth wireless sub-chip may be other wireless chips except ultra-wideband chips. For example, the second wireless sub-chip and the fourth wireless sub-chip are low-power 2.4G wireless chips or bluetooth chips.
Then, communication connection of the second wireless communication mode can be established between the second wireless sub-chip and the fourth wireless sub-chip through manual operation, so that pairing between the second wireless sub-chip and the fourth wireless sub-chip is completed. Illustratively, the head-mounted display 210 may enter into a setting interface for pairing the second wireless sub-chip according to a user trigger, and the user may generate a pairing command of the second wireless sub-chip in the handle by executing a corresponding handle adding operation in the setting interface. Then, according to the pairing command, the head-mounted display 210 detects in real time whether the fourth wireless sub-chip in the pairing state exists. Meanwhile, the user controls the fourth wireless sub-chip in the peripheral device 220 to enter the pairing state through a manual trigger operation. For example, the user controls a fourth wireless sub-chip configured in the handle to enter a pairing state through key operation (such as a Home key and a trigger key long press) at the handle end. Therefore, the head-mounted display 210 detects the fourth wireless sub-chip in the paired state, and establishes a communication connection of the second wireless communication scheme between the second wireless sub-chip and the fourth wireless sub-chip according to the data broadcast address set as described above. And further, data interaction is performed through the second wireless sub-chip and the fourth wireless sub-chip, so that pairing between the second wireless sub-chip and the fourth wireless sub-chip is completed.
Then, considering that power consumption is large when data is transmitted between the first wireless chip 211 and the second wireless chip 221 through the first wireless communication method, the first wireless communication method may be implemented by pairing the first wireless sub-chip and the third wireless chip. Then, in order to avoid the complexity of manual pairing between the first wireless sub-chip and the third wireless sub-chip, the pairing may be accomplished by automatically wirelessly transmitting configuration information between the paired second wireless chip 212 and fourth wireless chip 222.
For example, as shown in fig. 6, after pairing is completed between the second wireless sub-chip and the fourth wireless sub-chip, a communication connection of the second wireless communication mode is already established between the second wireless sub-chip and the fourth wireless sub-chip, so as to realize transmission of pairing configuration information between the first wireless sub-chip and the third wireless sub-chip through the second wireless communication mode after the communication connection. Then, by setting pairing information between the first wireless sub-chip and the third wireless sub-chip (such as adding an ultra wideband handle in the setting, etc.), the head-mounted display 210 may transmit, to the fourth wireless sub-chip configured in the external device 220 by using the second wireless sub-chip and using the second wireless communication method, main pairing information of the first wireless sub-chip in the first wireless sub-chip 211, where the main pairing information may include a media access control (Media Access Control, abbreviated as MAC) address, a device role, a supported data channel, a used data channel, a data reporting frequency, a chip start time, a data transmission length, etc. of the first wireless sub-chip. Then, after receiving the master pairing information of the first wireless sub-chip in the head-mounted display 210, the peripheral device 220 obtains the slave pairing information of the third wireless sub-chip configured in the peripheral device, where the slave pairing information may include the MAC address, the device role, the data channel, the data reporting frequency, the chip starting time, the data transmission length, the left and right handle flag bits, and the like of the third wireless sub-chip. And the slave pairing information of the third wireless sub-chip is replied to the second wireless sub-chip by the fourth wireless sub-chip by adopting a second wireless communication mode. At this time, the master pairing information of the first wireless sub-chip and the slave pairing information of the third wireless sub-chip can be known in both the head-mounted display 210 and the peripheral device 220. And then, according to the master pairing information and the slave pairing information, communication connection of a first wireless communication mode can be established between the first wireless sub-chip and the third wireless sub-chip so as to complete pairing between the first wireless sub-chip and the third wireless sub-chip.
In addition, because there is greater power consumption when transmitting first order data between first wireless sub-chip and the third wireless sub-chip, so in order to reduce the consumption in the VR equipment, first wireless sub-chip and third wireless sub-chip can go into sleep mode with stepping into after accomplishing the pairing in this application. And then, after the transmission requirement of the first magnitude data exists between the first wireless sub-chip and the third wireless sub-chip, a corresponding target transmission command can be transmitted between the second wireless sub-chip and the fourth wireless sub-chip in a second wireless communication mode, and the first wireless sub-chip and the third wireless sub-chip are synchronously awakened from a sleep mode according to the target transmission command so as to transmit the first magnitude data between the first wireless sub-chip and the third wireless sub-chip. And finally, after the transmission of the first magnitude data is completed, controlling the first wireless sub-chip and the third wireless sub-chip to enter the sleep mode again. That is, the first wireless sub-chip and the third wireless sub-chip in the present application are only woken up when there is a transmission requirement of the first level data, and are always in the sleep mode under other conditions, so as to reduce the working power consumption.
For example, when the head-mounted display 210 actively transmits the first magnitude data to the external device 220, the second wireless communication mode is adopted first, and the target transmission command is transmitted to the fourth wireless sub-chip through the second wireless sub-chip, where the target transmission command is used for indicating that the transmission of the first magnitude data exists. The head mounted display 210 and the peripheral device 220 then synchronize the wake-up time points set in the target transmission command to wake-up the first wireless sub-chip and the third wireless sub-chip from the sleep mode. Further, the head mounted display 210 transmits the first magnitude data to the third wireless sub-chip after waking up in the external device 220 through the first wireless sub-chip after waking up. And after the transmission is completed, the head-mounted display 210 controls the first wireless sub-chip to enter the sleep mode again, and the peripheral device 220 controls the third wireless sub-chip to enter the sleep mode again.
However, when the peripheral device 220 actively transmits the first level data to the head-mounted display 210, the second wireless communication manner is adopted first, and the target transmission request is transmitted to the second wireless sub-chip through the fourth wireless sub-chip, so as to prompt the head-mounted display 210 to need to send the target transmission command for waking up the first wireless sub-chip and the third wireless sub-chip. Then, after receiving the target transmission request through the second wireless sub-chip, the head-mounted display 210 continues to transmit the target transmission command to the fourth wireless sub-chip through the second wireless sub-chip, so that the head-mounted display 210 and the peripheral device 220 synchronously wake up the first wireless sub-chip and the third wireless sub-chip from the sleep mode at a wake-up time point set in the target transmission command. The peripheral device 220 then transmits the first magnitude data to the awakened first wireless chiplet through the awakened third wireless chiplet. And after the transmission is completed, the head-mounted display 210 controls the first wireless sub-chip to enter the sleep mode again, and the peripheral device 220 controls the third wireless sub-chip to enter the sleep mode again.
According to the VR device, the first wireless chip is configured in the head-mounted display of the VR device, the second wireless chip is configured in the peripheral device of the VR device, and the first wireless chip and the second wireless chip can communicate through the first wireless communication mode and the second wireless communication mode, so that the first-order data transmission is performed between the head-mounted display and the peripheral device through the first wireless communication mode, the second-order data transmission is performed through the second wireless communication mode, a dual-wireless transmission framework between the head-mounted display and the peripheral device is jointly formed through the first wireless communication mode and the second wireless communication mode, the high-efficiency transmission requirements of different-order data are met, the high-efficiency data transmission between the head-mounted display and the peripheral device under different quantity levels is achieved, the transmission delay during data transmission is greatly reduced, and the timeliness of the data transmission is ensured.
Specific steps for data transmission between the head mounted display and the peripheral devices in the integrated VR device will be described in detail below.
Fig. 7 is a flowchart of a data transmission method shown in an embodiment of the present application, where the embodiment is mainly applied to a head-mounted display in a VR device provided in the foregoing embodiment. Referring to fig. 7, the method may specifically include the following non-sequentially performed steps:
S710, transmitting the first magnitude data to a second wireless chip configured in the external device through a first wireless communication mode supported by the configured first wireless chip.
In order to solve the problem that the transmission bandwidth of the existing wireless chip is low and high-efficiency transmission of big data is not supported, the method and the device aim at various data which need to be transmitted between the head-mounted display and the peripheral device, firstly, magnitude division is carried out according to the magnitude of the data, and then the first magnitude data and the second magnitude data in the method and the device are obtained.
The first order data are data with the data quantity in the head-mounted display and the peripheral device being larger than or equal to a preset transmission threshold, such as environment point cloud data and camera image data acquired by the head-mounted display and the peripheral device through a camera and the like configured by the head-mounted display and the peripheral device, and audio control data transmitted by the head-mounted display to the peripheral device and used for driving a broadband motor.
The second magnitude data is data with the data volume in the head-mounted display and the peripheral device smaller than a preset transmission threshold, such as position inertial sensing data acquired by the head-mounted display and the peripheral device through an IMU sensor configured by the head-mounted display and the peripheral device.
Then, in order to realize the high-efficient transmission of different magnitude data between the head-mounted display and the peripheral device, the transmission architecture meeting the transmission requirement of the magnitude data is set for each magnitude data between the head-mounted display and the peripheral device respectively, so that the low-delay high-efficient transmission of different magnitude data between the head-mounted display and the peripheral device is supported.
Two communication connections, namely a first wireless communication mode and a second wireless communication mode, can be established between a first wireless chip configured in the head-mounted display and a second wireless chip configured in the peripheral device.
In addition, the first wireless communication mode in the present application may be an ultra-wideband wireless communication, and the second wireless communication mode may be another wireless communication mode other than the ultra-wideband wireless communication. The second wireless communication mode may be, for example, a low-power 2.4G wireless communication or a bluetooth communication.
In the application, when the head-mounted display transmits the first-order data to the external device, a first wireless communication mode meeting the transmission requirement of the first-order data can be adopted to realize low-delay high-efficiency transmission of the first-order data.
S720, transmitting second-order data to a second wireless chip configured in the external device through a second wireless communication mode supported by the configured first wireless chip.
When the head-mounted display transmits second-order data to the external device, a second wireless communication mode meeting the second-order data transmission requirement can be adopted to realize low-delay high-efficiency transmission of the second-order data.
In addition, in order to reduce data transmission power consumption between the head-mounted display and the peripheral device, the application can firstly establish communication connection in a second wireless communication mode between the first wireless chip and the second wireless chip so as to complete pairing in the second wireless communication mode. Then, configuration information related to the first wireless communication method is transmitted between the first wireless chip and the second wireless chip through a second wireless communication method after communication connection. According to the configuration information, communication connection of the first wireless communication mode can be established between the first wireless chip and the second wireless chip so as to complete pairing in the first wireless communication mode.
For example, to ensure accurate pairing in the first wireless communication mode and the second wireless communication mode, the first wireless chip in the present application may include at least a first wireless sub-chip and a second wireless sub-chip, and the second wireless chip may include at least a third wireless sub-chip and a fourth wireless sub-chip. The first wireless sub-chip and the third wireless sub-chip may be ultra-wideband chips, and the second wireless sub-chip and the fourth wireless sub-chip may be other wireless chips except ultra-wideband chips. For example, the second wireless sub-chip and the fourth wireless sub-chip are low-power 2.4G wireless chips or bluetooth chips.
Then, communication connection of the second wireless communication mode can be established between the second wireless sub-chip and the fourth wireless sub-chip through manual operation, so that the pairing between the second wireless sub-chip and the fourth wireless sub-chip is completed.
The head-mounted display can enter a setting interface for pairing the second wireless sub-chip according to the triggering of the user, and the user can generate a pairing command of the second wireless sub-chip in the handle by executing corresponding handle adding operation in the setting interface. Then, the head-mounted display detects in real time whether there is a fourth wireless sub-chip in a paired state in response to the pairing command. Then, when the fourth wireless sub-chip in the paired state is detected, a communication connection of the second wireless communication scheme can be established between the second wireless sub-chip and the fourth wireless sub-chip according to the set data broadcast address. And further, data interaction is performed through the second wireless sub-chip and the fourth wireless sub-chip, so that pairing between the second wireless sub-chip and the fourth wireless sub-chip is completed.
Then, the pairing procedure of the head-mounted display for the first wireless sub-chip and the third wireless sub-chip related to the first communication mode may be: transmitting main pairing information of a first wireless sub-chip in the first wireless chip to an external device through a second wireless communication mode; receiving slave pairing information of a third wireless sub-chip in the second wireless chip replied by the peripheral device through a second wireless communication mode; and establishing communication connection of the first wireless communication mode between the first wireless sub-chip and the third wireless sub-chip according to the master pairing information and the slave pairing information so as to complete pairing between the first wireless sub-chip and the third wireless sub-chip.
After the pairing between the first wireless sub-chip and the third wireless sub-chip is completed, the head-mounted display can control the first wireless sub-chip to enter a sleep mode, so that power consumption is reduced.
As an alternative implementation scheme in the application, when the head-mounted display actively transmits the first magnitude data to the external device, a target transmission command is transmitted to the fourth wireless sub-chip through the second wireless sub-chip, and the target transmission command is used for indicating that the transmission of the first magnitude data exists. Then, the head-mounted display and the peripheral device will synchronously wake up the first wireless sub-chip and the third wireless sub-chip from the sleep mode at the wake-up time point set in the target transmission command. And then, the head-mounted display transmits the first magnitude data to a third wireless sub-chip which is arranged in the external device and is awakened through the awakened first wireless sub-chip. And after the transmission is completed, the head-mounted display controls the first wireless sub-chip to enter the sleep mode again.
Fig. 8 is a flowchart of another data transmission method shown in the embodiment of the present application, where the embodiment is mainly applied to a peripheral device in a VR device provided in the foregoing embodiment. Referring to fig. 8, the method may specifically include the following non-sequentially performed steps:
and S810, transmitting first-order data to a first wireless chip configured in the head-mounted display through a first wireless communication mode supported by the configured second wireless chip.
In the application, when the peripheral device transmits the first-order data to the head-mounted display, a first wireless communication mode meeting the transmission requirement of the first-order data can be adopted to realize low-delay high-efficiency transmission of the first-order data.
S820, transmitting second-order data to the first wireless chip configured in the head-mounted display through a second wireless communication mode supported by the configured second wireless chip.
When the peripheral device transmits second-order data to the head-mounted display, a second wireless communication mode meeting the second-order data transmission requirement can be adopted to realize low-delay high-efficiency transmission of the second-order data.
In addition, in order to reduce the data transmission power consumption between the head-mounted display and the peripheral device, the present application may first establish a communication connection in the second wireless communication mode between the first wireless chip 211 and the second wireless chip 221, so as to complete pairing in the second wireless communication mode. Then, the configuration information related to the first wireless communication scheme is transmitted between the first wireless chip 211 and the second wireless chip 221 by the second wireless communication scheme after the communication connection. According to the configuration information, a communication connection of the first wireless communication mode may be established between the first wireless chip 211 and the second wireless chip 221 to complete pairing in the first wireless communication mode.
For example, to ensure accurate pairing in the first wireless communication mode and the second wireless communication mode, the first wireless chip in the present application may include at least a first wireless sub-chip and a second wireless sub-chip, and the second wireless chip may include at least a third wireless sub-chip and a fourth wireless sub-chip.
Then, communication connection of the second wireless communication mode can be established between the second wireless sub-chip and the fourth wireless sub-chip through manual operation, so that pairing between the second wireless sub-chip and the fourth wireless sub-chip is completed.
The pairing operation of the fourth wireless sub-chip is obtained by manual triggering operation under the action of a user on the peripheral device. And further controlling a fourth wireless sub-chip in the peripheral device to enter a pairing state in response to the pairing operation. For example, the user controls a fourth wireless sub-chip configured in the handle to enter a pairing state through key operation (such as a Home key and a trigger key long press) at the handle end. At this time, after the head-mounted display detects the fourth wireless sub-chip in the pairing state, data interaction is performed through the second wireless sub-chip and the fourth wireless sub-chip according to the set data broadcast address. Therefore, according to the pairing detection result of the second wireless sub-chip to the fourth wireless sub-chip, communication connection of the second wireless communication mode is established between the second wireless sub-chip and the fourth wireless sub-chip, so that the pairing between the second wireless sub-chip and the fourth wireless sub-chip is completed.
Then, the pairing procedure of the peripheral device for the first wireless sub-chip and the third wireless sub-chip may be: if the master pairing information of the first wireless sub-chip in the first wireless chip is received, transmitting the slave pairing information of the third wireless sub-chip to the second wireless sub-chip in a second wireless communication mode through the fourth wireless sub-chip; and establishing communication connection of the first wireless communication mode between the first wireless sub-chip and the third wireless sub-chip according to the master pairing information and the slave pairing information so as to complete pairing between the first wireless sub-chip and the third wireless sub-chip.
After the pairing between the first wireless sub-chip and the third wireless sub-chip is completed, the peripheral device can control the third wireless sub-chip to enter a sleep mode, so that power consumption is reduced.
As an optional implementation scheme in the application, when the peripheral device actively transmits the first order data to the head-mounted display, the target transmission request is transmitted to the second wireless sub-chip through the fourth wireless sub-chip, so as to prompt the head-mounted display to need to send the target transmission command for waking up the first wireless sub-chip and the third wireless sub-chip. Then, the peripheral device receives a target transmission command transmitted by the head-mounted display, so that the head-mounted display and the peripheral device synchronously wake up the first wireless sub-chip and the third wireless sub-chip from the sleep mode at a wake-up time point set in the target transmission command. And then, the peripheral device transmits the first magnitude data to the awakened first wireless sub-chip through the awakened third wireless sub-chip. And after the transmission is completed, the peripheral device controls the third wireless sub-chip to enter the sleep mode again.
According to the technical scheme, the first wireless chip is configured in the head-mounted display of the VR device, the second wireless chip is configured in the peripheral device of the VR device, and the first wireless chip and the second wireless chip can communicate through the first wireless communication mode and the second wireless communication mode, so that the head-mounted display and the peripheral device can execute transmission of first-order data through the first wireless communication mode, and execute transmission of second-order data through the second wireless communication mode, and accordingly a dual-wireless transmission framework between the head-mounted display and the peripheral device is jointly formed through the first wireless communication mode and the second wireless communication mode, high-efficiency transmission requirements of different-order data are met, high-efficiency data transmission between the head-mounted display and the peripheral device under different quantity levels is achieved, transmission delay in data transmission is greatly reduced, and timeliness of data transmission is guaranteed.
Fig. 9 is a schematic block diagram of a data transmission device according to an embodiment of the present application, which may be configured in the head-mounted display of the virtual reality device provided in the foregoing embodiment. As shown in fig. 9, the apparatus 900 may include:
a first transmission module 910, configured to transmit first order data to a second wireless chip configured in the external device through a first wireless communication manner supported by the configured first wireless chip;
A second transmission module 920, configured to transmit second magnitude data to a second wireless chip configured in the external device through a second wireless communication manner supported by the configured first wireless chip;
the first wireless communication mode is ultra-wideband wireless communication, and the second wireless communication mode is other wireless communication modes except ultra-wideband wireless communication.
Further, the data transmission apparatus 900 may further include:
the first pairing module is used for responding to a pairing command of the second wireless sub-chip, detecting a fourth wireless sub-chip in a pairing state, and completing pairing between the second wireless sub-chip and the fourth wireless sub-chip by establishing communication connection in the second wireless communication mode between the second wireless sub-chip and the fourth wireless sub-chip.
Further, the data transmission apparatus 900 may further include:
the second pairing module is used for transmitting main pairing information of the first wireless sub-chip in the first wireless chip to an external device through the second wireless communication mode; receiving slave pairing information of a third wireless sub-chip in the second wireless chip replied by the peripheral device through the second wireless communication mode; and establishing communication connection of the first wireless communication mode between the first wireless sub-chip and the third wireless sub-chip according to the master pairing information and the slave pairing information so as to complete pairing between the first wireless sub-chip and the third wireless sub-chip.
Further, the data transmission apparatus 900 may further include:
and the first dormancy module is used for controlling the first wireless sub-chip to enter a dormancy mode.
Further, the first transmission module 910 may be specifically configured to:
transmitting a target transmission command to a fourth wireless sub-chip in the second wireless chip through the second wireless communication mode so as to synchronously wake up the first wireless sub-chip and the third wireless sub-chip from a sleep mode;
and transmitting first magnitude data to the awakened third wireless sub-chip by adopting the first wireless communication mode through the awakened first wireless sub-chip, and controlling the first wireless sub-chip to enter a sleep mode again after the transmission is completed.
In the embodiment of the application, the first wireless chip is configured in the head-mounted display of the VR device, the second wireless chip is configured in the peripheral device of the VR device, and the first wireless chip and the second wireless chip can communicate through the first wireless communication mode and the second wireless communication mode, so that the head-mounted display and the peripheral device can execute the transmission of first-order data through the first wireless communication mode, and execute the transmission of second-order data through the second wireless communication mode, thereby the first wireless communication mode and the second wireless communication mode jointly form a dual-wireless transmission architecture between the head-mounted display and the peripheral device, so that the dual-wireless transmission architecture can meet the high-efficiency transmission requirements of different-order data, the high-efficiency data transmission between the head-mounted display and the peripheral device under different quantity levels can be realized, the transmission delay during the data transmission can be greatly reduced, and the timeliness of the data transmission can be ensured.
Fig. 10 is a schematic block diagram of another data transmission apparatus according to an embodiment of the present application, which may be configured in a peripheral device of the virtual reality apparatus provided in the foregoing embodiment. As shown in fig. 10, the apparatus 1000 may include:
a third transmission module 1010, configured to transmit first magnitude data to a first wireless chip configured in the head-mounted display through a first wireless communication manner supported by a configured second wireless chip;
a fourth transmission module 1020, configured to transmit second magnitude data to the first wireless core configured in the head-mounted display through a second wireless communication manner supported by the configured second wireless core;
the first wireless communication mode is ultra-wideband wireless communication, and the second wireless communication mode is other wireless communication modes except ultra-wideband wireless communication.
Further, the data transmission apparatus 1000 may further include:
the third pairing module is used for responding to the pairing operation of the fourth wireless sub-chip and entering a pairing state; and establishing communication connection of the second wireless communication mode between the second wireless sub-chip and the fourth wireless sub-chip according to the pairing detection result of the second wireless sub-chip on the fourth wireless sub-chip so as to complete pairing between the second wireless sub-chip and the fourth wireless sub-chip.
Further, the data transmission apparatus 1000 may further include:
a fourth pairing module, configured to transmit, if primary pairing information of a first wireless sub-chip in the first wireless chip is received, secondary pairing information of the third wireless sub-chip to the second wireless sub-chip through the fourth wireless sub-chip by adopting the second wireless communication mode; and establishing communication connection of the first wireless communication mode between the first wireless sub-chip and the third wireless sub-chip according to the master pairing information and the slave pairing information so as to complete pairing between the first wireless sub-chip and the third wireless sub-chip.
Further, the data transmission apparatus 1000 may further include:
and the second dormancy module is used for controlling the third wireless sub-chip to enter a dormancy mode.
Further, the third transmission module 1010 may be specifically configured to:
transmitting a target transmission request to a second wireless sub-chip in the first wireless chip through the second wireless communication mode;
receiving a target transmission command transmitted by the second wireless sub-chip to the fourth wireless sub-chip according to the target transmission request, so as to synchronously wake up the first wireless sub-chip and the third wireless sub-chip from a sleep mode;
And transmitting first magnitude data to the awakened first wireless sub-chip by adopting the first wireless communication mode through the awakened third wireless sub-chip, and controlling the third wireless sub-chip to enter a sleep mode again after the transmission is completed.
In the embodiment of the application, the first wireless chip is configured in the head-mounted display of the VR device, the second wireless chip is configured in the peripheral device of the VR device, and the first wireless chip and the second wireless chip can communicate through the first wireless communication mode and the second wireless communication mode, so that the head-mounted display and the peripheral device can execute the transmission of first-order data through the first wireless communication mode, and execute the transmission of second-order data through the second wireless communication mode, thereby the first wireless communication mode and the second wireless communication mode jointly form a dual-wireless transmission architecture between the head-mounted display and the peripheral device, so that the dual-wireless transmission architecture can meet the high-efficiency transmission requirements of different-order data, the high-efficiency data transmission between the head-mounted display and the peripheral device under different quantity levels can be realized, the transmission delay during the data transmission can be greatly reduced, and the timeliness of the data transmission can be ensured.
It should be understood that apparatus embodiments and method embodiments may correspond with each other and that similar descriptions may refer to the method embodiments. To avoid repetition, no further description is provided here. Specifically, the apparatus 900 shown in fig. 9 may perform the method embodiment provided in the application in the head-mounted display, the apparatus 1000 shown in fig. 10 may perform the method embodiment provided in the application in the peripheral device, and the foregoing and other operations and/or functions of each module in the apparatus 900 and the apparatus 1000 are respectively for implementing corresponding flows in each method in the embodiment of the application, which is not repeated herein for brevity.
The apparatus 900 and the apparatus 1000 of the embodiments of the present application are described above from the perspective of functional modules in connection with the accompanying drawings. It should be understood that the functional module may be implemented in hardware, or may be implemented by instructions in software, or may be implemented by a combination of hardware and software modules. Specifically, each step of the method embodiments in the embodiments of the present application may be implemented by an integrated logic circuit of hardware in a processor and/or an instruction in software form, and the steps of the method disclosed in connection with the embodiments of the present application may be directly implemented as a hardware decoding processor or implemented by a combination of hardware and software modules in the decoding processor. Alternatively, the software modules may be located in a well-established storage medium in the art such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, and the like. The storage medium is located in a memory, and the processor reads information in the memory, and in combination with hardware, performs the steps in the above method embodiments.
The present application also provides a computer storage medium having stored thereon a computer program which, when executed by a computer, enables the computer to perform the method of the above-described method embodiments. Alternatively, embodiments of the present application also provide a computer program product comprising instructions which, when executed by a computer, cause the computer to perform the method of the method embodiments described above.
When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces, in whole or in part, a flow or function consistent with embodiments of the present application. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a digital video disc (digital video disc, DVD)), or a semiconductor medium (e.g., a Solid State Disk (SSD)), or the like.
Those of ordinary skill in the art will appreciate that the various illustrative modules and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, and for example, the division of the modules is merely a logical function division, and there may be additional divisions when actually implemented, for example, multiple modules or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or modules, which may be in electrical, mechanical, or other forms.
The modules illustrated as separate components may or may not be physically separate, and components shown as modules may or may not be physical modules, i.e., may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. For example, functional modules in the embodiments of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules may be integrated into one module.
The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes or substitutions are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (20)
1. A virtual reality device, comprising: the device comprises a head-mounted display and a peripheral device, wherein the head-mounted display comprises a first wireless chip, the peripheral device comprises a second wireless chip, and the first wireless chip and the second wireless chip are communicated through a first wireless communication mode and a second wireless communication mode; wherein,
And transmitting the first magnitude data through the first wireless communication mode, and transmitting the second magnitude data through the second wireless communication mode.
2. The apparatus of claim 1, wherein the first wireless communication mode is ultra-wideband wireless communication and the second wireless communication mode is other wireless communication mode than ultra-wideband wireless communication.
3. The apparatus of claim 1, wherein the first magnitude of data is data having an amount of data within the head mounted display and the peripheral device greater than or equal to a preset transmission threshold, and the second magnitude of data is data having an amount of data within the head mounted display and the peripheral device less than a preset transmission threshold.
4. The apparatus of claim 1, wherein the first wireless chip comprises at least a first wireless sub-chip and a second wireless sub-chip, the second wireless chip comprises at least a third wireless sub-chip and a fourth wireless sub-chip;
the second wireless sub-chip and the fourth wireless sub-chip are paired by establishing communication connection in the second wireless communication mode;
and the communication connection of the first wireless communication mode is established through the configuration information transmitted by the second wireless communication mode between the first wireless sub-chip and the third wireless sub-chip so as to complete pairing.
5. The apparatus of claim 4, wherein the first wireless sub-chip and the third wireless sub-chip enter a sleep mode after pairing is completed and complete synchronous wake-up by a target transmission command of the second wireless communication mode to transmit the first magnitude data.
6. The apparatus of claim 1, wherein the second wireless communication mode employs a periodically frequency hopped wireless channel to transmit the second magnitude data.
7. A data transmission method, applied to the head-mounted display of the virtual reality device according to any one of claims 1-6, the method comprising the following non-sequentially performed steps:
transmitting first magnitude data to a second wireless chip configured in the external device through a first wireless communication mode supported by the configured first wireless chip;
transmitting second-order data to a second wireless chip configured in the external device through a second wireless communication mode supported by the configured first wireless chip;
the first wireless communication mode is ultra-wideband wireless communication, and the second wireless communication mode is other wireless communication modes except ultra-wideband wireless communication.
8. The method of claim 7, wherein the first wireless chip comprises at least a first wireless sub-chip and a second wireless sub-chip, the second wireless chip comprises at least a third wireless sub-chip and a fourth wireless sub-chip, the method further comprising:
and responding to a pairing command of the second wireless sub-chip, detecting a fourth wireless sub-chip in a pairing state, and completing pairing between the second wireless sub-chip and the fourth wireless sub-chip by establishing communication connection of the second wireless communication mode between the second wireless sub-chip and the fourth wireless sub-chip.
9. The method of claim 8, further comprising, after completing pairing between the second wireless sub-chip and the fourth wireless sub-chip by establishing a communication connection of the second wireless communication scheme between the second wireless sub-chip and the fourth wireless sub-chip:
transmitting main pairing information of a first wireless sub-chip in the first wireless chip to an external device through the second wireless communication mode;
receiving slave pairing information of a third wireless sub-chip in the second wireless chip replied by the peripheral device through the second wireless communication mode;
And establishing communication connection of the first wireless communication mode between the first wireless sub-chip and the third wireless sub-chip according to the master pairing information and the slave pairing information so as to complete pairing between the first wireless sub-chip and the third wireless sub-chip.
10. The method of claim 9, further comprising, after establishing a communication connection of the first wireless communication scheme between the first wireless sub-chip and the third wireless sub-chip based on the master pairing information and the slave pairing information to complete pairing between the first wireless sub-chip and the third wireless sub-chip:
and controlling the first wireless sub-chip to enter a sleep mode.
11. The method of claim 10, wherein the transmitting the first magnitude data to the second wireless chip configured within the external device via the first wireless communication means supported by the configured first wireless chip comprises:
transmitting a target transmission command to a fourth wireless sub-chip in the second wireless chip through the second wireless communication mode so as to synchronously wake up the first wireless sub-chip and the third wireless sub-chip from a sleep mode;
And transmitting first magnitude data to the awakened third wireless sub-chip by adopting the first wireless communication mode through the awakened first wireless sub-chip, and controlling the first wireless sub-chip to enter a sleep mode again after the transmission is completed.
12. A data transmission method, applied to the peripheral device of the virtual reality device according to any one of claims 1-6, the method comprising the following non-sequentially performed steps:
transmitting first magnitude data to a first wireless chip configured in the head-mounted display through a first wireless communication mode supported by a configured second wireless chip;
transmitting second-order data to a first wireless chip configured in the head-mounted display through a second wireless communication mode supported by a configured second wireless chip;
the first wireless communication mode is ultra-wideband wireless communication, and the second wireless communication mode is other wireless communication modes except ultra-wideband wireless communication.
13. The method of claim 12, wherein the first wireless chip comprises at least a first wireless sub-chip and a second wireless sub-chip, the second wireless chip comprises at least a third wireless sub-chip and a fourth wireless sub-chip, the method further comprising:
Responding to pairing operation of the fourth wireless sub-chip, and entering a pairing state;
and establishing communication connection of the second wireless communication mode between the second wireless sub-chip and the fourth wireless sub-chip according to the pairing detection result of the second wireless sub-chip on the fourth wireless sub-chip so as to complete pairing between the second wireless sub-chip and the fourth wireless sub-chip.
14. The method of claim 13, further comprising, after establishing a communication connection in the second wireless communication manner between the second wireless sub-chip and the fourth wireless sub-chip according to a pairing detection result of the second wireless sub-chip to the fourth wireless sub-chip, completing pairing between the second wireless sub-chip and the fourth wireless sub-chip:
if the master pairing information of the first wireless sub-chip in the first wireless chip is received, transmitting the slave pairing information of the third wireless sub-chip to the second wireless sub-chip in the second wireless communication mode through the fourth wireless sub-chip;
and establishing communication connection of the first wireless communication mode between the first wireless sub-chip and the third wireless sub-chip according to the master pairing information and the slave pairing information so as to complete pairing between the first wireless sub-chip and the third wireless sub-chip.
15. The method of claim 14, further comprising, after establishing a communication connection of the first wireless communication scheme between the first wireless sub-chip and the third wireless sub-chip based on the master pairing information and the slave pairing information to complete pairing between the first wireless sub-chip and the third wireless sub-chip:
and controlling the third wireless sub-chip to enter a sleep mode.
16. The method of claim 15, wherein the transmitting the first magnitude data to the first wireless chip configured within the head-mounted display via the first wireless communication means supported by the configured second wireless chip comprises:
transmitting a target transmission request to a second wireless sub-chip in the first wireless chip through the second wireless communication mode;
receiving a target transmission command transmitted by the second wireless sub-chip to the fourth wireless sub-chip according to the target transmission request, so as to synchronously wake up the first wireless sub-chip and the third wireless sub-chip from a sleep mode;
and transmitting first magnitude data to the awakened first wireless sub-chip by adopting the first wireless communication mode through the awakened third wireless sub-chip, and controlling the third wireless sub-chip to enter a sleep mode again after the transmission is completed.
17. A data transmission apparatus, configured in a head mounted display of a virtual reality device according to any one of claims 1-6, the apparatus comprising:
the first transmission module is used for transmitting first-order data to a second wireless chip configured in the external device in a first wireless communication mode supported by the configured first wireless chip;
the second transmission module is used for transmitting second-order data to a second wireless chip configured in the external device in a second wireless communication mode supported by the configured first wireless chip;
the first wireless communication mode is ultra-wideband wireless communication, and the second wireless communication mode is other wireless communication modes except ultra-wideband wireless communication.
18. A data transmission apparatus, configured in a peripheral device of the virtual reality device of any one of claims 1-6, the apparatus comprising:
the third transmission module is used for transmitting first-order data to the first wireless chip configured in the head-mounted display in a first wireless communication mode supported by the configured second wireless chip;
a fourth transmission module, configured to transmit second-order data to the first wireless chip configured in the head-mounted display through a second wireless communication mode supported by the configured second wireless chip;
The first wireless communication mode is ultra-wideband wireless communication, and the second wireless communication mode is other wireless communication modes except ultra-wideband wireless communication.
19. A computer-readable storage medium storing a computer program for causing a computer to execute the data transmission method according to any one of claims 7 to 16.
20. A computer program product comprising computer programs/instructions which, when executed by a processor, implement a data transmission method as claimed in any one of claims 7 to 16.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210828236.9A CN117440351A (en) | 2022-07-13 | 2022-07-13 | Virtual reality device, data transmission method and device thereof and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210828236.9A CN117440351A (en) | 2022-07-13 | 2022-07-13 | Virtual reality device, data transmission method and device thereof and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN117440351A true CN117440351A (en) | 2024-01-23 |
Family
ID=89557027
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210828236.9A Pending CN117440351A (en) | 2022-07-13 | 2022-07-13 | Virtual reality device, data transmission method and device thereof and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN117440351A (en) |
-
2022
- 2022-07-13 CN CN202210828236.9A patent/CN117440351A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10911930B2 (en) | Wireless system, wireless device, non-transitory computer-readable storage medium having stored therein communication program, and communication method | |
US10904832B2 (en) | Wireless system, wireless device, non-transitory computer-readable storage medium having stored therein communication program, and communication method | |
US11856487B2 (en) | Method and apparatus for measuring location of multiple electronic devices based on time scheduling information in connection with ultra-wide band communication | |
JP5027955B2 (en) | Wireless communication apparatus, wireless communication system, and channel switching method | |
US10397868B2 (en) | Wireless system, wireless device, non-transitory computer-readable storage medium having stored therein communication program, and communication method | |
US20180152840A1 (en) | Wearable apparatus, information terminal, communication system, electronic apparatus, and communication control method | |
CN102892183A (en) | Wireless communication system for determining mobile devices positions and related method | |
CN112291703A (en) | System and method for establishing communications for exchanging ranging information | |
WO2020154959A1 (en) | Multi-load image transmission method, control system, control terminal, unmanned aerial vehicle, and server | |
EP3837894B1 (en) | Apparatus and method for communication between devices in close proximity in wireless network | |
TW201234820A (en) | Mixed-mode wireless device operation | |
KR101797032B1 (en) | Wireless router device with IoT gateway function | |
US20080136606A1 (en) | Separable device for controlling node and sensor network node | |
CN111149313B (en) | Data transmission method and equipment | |
CN113170497A (en) | Electronic device and method for scheduling communication data link thereof | |
CN117440351A (en) | Virtual reality device, data transmission method and device thereof and storage medium | |
JP2010206631A (en) | Base station apparatus, terminal apparatus, and communication method | |
US8595351B2 (en) | Monitoring system | |
KR20210080937A (en) | Electronic device and method for controlling NAN based communication thereof | |
JPWO2017104205A1 (en) | Information processing apparatus, information processing method, and program | |
CN112714454B (en) | Monitoring method of wireless sensor network and related equipment | |
CN209805837U (en) | VR time synchronizer | |
CN115956239A (en) | Time synchronization method and related equipment | |
JP6036983B2 (en) | Information processing apparatus and activation control program | |
JP2008113319A (en) | Network device and its control method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |