CN111338080A - Head-mounted device and electronic device - Google Patents
Head-mounted device and electronic device Download PDFInfo
- Publication number
- CN111338080A CN111338080A CN202010111923.XA CN202010111923A CN111338080A CN 111338080 A CN111338080 A CN 111338080A CN 202010111923 A CN202010111923 A CN 202010111923A CN 111338080 A CN111338080 A CN 111338080A
- Authority
- CN
- China
- Prior art keywords
- module
- interface
- data
- serial
- interface module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000006243 chemical reaction Methods 0.000 claims abstract description 83
- 238000012545 processing Methods 0.000 claims description 57
- 230000006837 decompression Effects 0.000 claims description 18
- 238000013144 data compression Methods 0.000 claims description 16
- 238000007726 management method Methods 0.000 claims description 9
- 230000004424 eye movement Effects 0.000 claims description 7
- 238000013480 data collection Methods 0.000 claims description 4
- 238000000034 method Methods 0.000 abstract description 5
- 230000008569 process Effects 0.000 abstract description 4
- 210000003128 head Anatomy 0.000 description 36
- 210000001508 eye Anatomy 0.000 description 14
- 238000010586 diagram Methods 0.000 description 12
- 230000005540 biological transmission Effects 0.000 description 11
- 238000001514 detection method Methods 0.000 description 8
- 239000011521 glass Substances 0.000 description 7
- 238000004891 communication Methods 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 238000007906 compression Methods 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 239000004020 conductor Substances 0.000 description 2
- 230000001934 delay Effects 0.000 description 2
- 230000020169 heat generation Effects 0.000 description 2
- 208000037909 invasive meningococcal disease Diseases 0.000 description 2
- 229910052751 metal Inorganic materials 0.000 description 2
- 239000002184 metal Substances 0.000 description 2
- 230000008054 signal transmission Effects 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 229910052782 aluminium Inorganic materials 0.000 description 1
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000011982 device technology Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000013021 overheating Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/40—Bus structure
- G06F13/4063—Device-to-bus coupling
- G06F13/4068—Electrical coupling
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/2092—Details of a display terminals using a flat panel, the details relating to the control arrangement of the display terminal and to the interfaces thereto
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/2092—Details of a display terminals using a flat panel, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G3/2096—Details of the interface to the display terminal specific for a flat panel
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F2213/0002—Serial port, e.g. RS232C
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Optics & Photonics (AREA)
- Information Transfer Systems (AREA)
Abstract
The present disclosure provides a head-mounted device and an electronic device. The head-mounted device includes: a head-mounted unit; the head-mounted unit includes: the device comprises a data acquisition module, a data output module, a serial interface and an integrated circuit; the integrated circuit includes: the data conversion module and the interface module; the data conversion module is connected with the serial interface and is respectively connected with the data acquisition module and the data output module through the interface module; the data conversion module is used for carrying out serialization conversion on the data acquired from the data acquisition module through the interface module and outputting the converted serial data through a serial interface so as to process the serial data; and converting the serial data received through the serial interface to convert the serial data into interface data matched with an interface protocol of the interface module, transmitting the converted interface data to the data output module through the interface module, and outputting the converted interface data to a user through the data output module.
Description
Technical Field
The present disclosure relates to wearable device technologies, and in particular, to a head-mounted device and an electronic device.
Background
The head-mounted device can achieve different effects such as Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR) and the like by transmitting an optical signal to the eyes of the wearer, such as VR glasses, AR glasses, MR glasses and the like.
The existing head-mounted equipment can be roughly divided into a split type and an integrated type in form. The integrated device integrates all functional modules together, including a processor, a battery and the like, and although the integrated device is convenient to carry, the integrated device has the disadvantages of large weight and volume and uncomfortable head wear; the size of the integrated equipment is limited, and the volume and the capacity of a used battery are limited, so that the endurance time of the integrated equipment is short; in addition, since the processor is also integrated into the unitary device, the heat generated by the processor may also affect the user experience when the device is running.
The split type device includes a head-mounted display portion (hereinafter referred to as a head display portion) and also includes a host portion. The head display part only comprises necessary functional modules such as a display module, a camera module, an environment sensor module and the like, and modules such as a processor, a battery and the like are arranged on the host part. The head display part can be lighter and thinner to a certain extent, and the wearing is more comfortable; in addition, the processor is not positioned at the head display part, so that the problem of wearing discomfort caused by overheating of the processor does not occur.
However, when the split type head-mounted device in the related art processes and transmits data, problems such as high power consumption, large volume, long time delay and the like of a power consumption processing chip still exist.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
The present disclosure provides a head-mounted device and an electronic device.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows, or in part will be obvious from the description, or may be learned by practice of the disclosure.
According to an aspect of the present disclosure, there is provided a head-mounted device including: a head-mounted unit; the head-mounted unit includes: a data acquisition module; a data output module; a first serial interface; and a first integrated circuit comprising: the device comprises a first data conversion module and a first interface module; the first data conversion module is connected with the first serial interface and is respectively connected with the data acquisition module and the data output module through the first interface module; the first data conversion module is used for performing serialization conversion on the data acquired from the data acquisition module through the first interface module and outputting the converted serial data to the processing equipment connected with the head-mounted unit through the first serial interface; and converting the serial data received through the first serial interface to convert the serial data into interface data matched with the interface protocol of the first interface module, and transmitting the converted interface data to the data output module through the first interface module.
According to another aspect of the present disclosure, there is also provided an electronic device including: a processing module; the electronic equipment is connected with the head-mounted display equipment through the serial interface; and an integrated circuit, comprising: the data conversion module and the interface module; the data conversion module is connected with the serial interface and is connected with the processing module through the interface module; the data conversion module is used for converting serial data received from the head-mounted display device through the serial interface so as to convert the serial data into interface data matched with an interface protocol of the interface module, and transmitting the converted interface data to the processing module through the interface module; the processing module is used for processing the interface data converted by the data conversion module; the data conversion module is further configured to serialize the processed data received from the processing module through the interface module, and output the converted serial data to the head-mounted display device through the serial interface.
According to the head-mounted device provided by the embodiment of the disclosure, the integrated circuit chip is used in the head-mounted unit, the data is acquired through the interface module in the integrated circuit chip, and the acquired data and the data received from the host unit are converted in a centralized manner through the data conversion module, so that on one hand, the space and the volume of the head-mounted unit can be greatly reduced, and the light and thin head-mounted unit is favorably realized; on the other hand, the power consumption of the chip can be reduced, the heat generation of the head-mounted unit is reduced, and the user experience is improved; moreover, centralized conversion may also reduce overall data processing delays of the head-mounted device.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
Fig. 1 is a schematic diagram illustrating a configuration of a head-mounted device according to an exemplary embodiment.
Fig. 2A is a schematic diagram of a head unit shown according to an example.
Fig. 2B is a schematic diagram of another head-mounted unit shown according to an example.
Fig. 3 is a schematic diagram illustrating another head-mounted unit according to an exemplary embodiment.
Fig. 4 is a schematic diagram illustrating another headset configuration according to an exemplary embodiment.
Fig. 5 is a schematic diagram illustrating another host unit configuration according to an example embodiment.
Fig. 6 is a schematic structural diagram of an electronic device according to an exemplary embodiment.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or first integrated circuits, or in different networks and/or processor means and/or microcontroller means.
Further, in the description of the present disclosure, "a plurality" means at least two, e.g., two, three, etc., unless explicitly specifically limited otherwise. The terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.
In the related art, a separate vision processing unit is still provided in the head display portion of the partially split head-mounted device. The vision processing unit can perform processing operations such as a 6DOF algorithm, and also generate a large amount of heat in the head display portion. If the device capable of dissipating heat is added, the weight and the volume of the head display part are increased, and the light and thin of the head display part are not facilitated.
In addition, in the related art, a bridge (bridge) scheme is adopted in the head display portion of the partial split type head-mounted device to process data, for example, a plurality of MIPI (Mobile Industry Processor Interface) data-to-USB serial data chips are used to convert different MIPI data, and data output by the plurality of MIPI data-to-USB serial data chips is transmitted to a USB Interface through a USB HUB (USB HUB) chip to be output. In addition, for data (such as display data) received from the USB interface, an additional display data-to-MIPI chip is required to be used for conversion, and then the data is displayed through the head display part. The use of these multiple chips makes it difficult to make the head display portion thin and light, and also makes the head display portion generate heat seriously due to its high power consumption. In addition, it is also difficult to control system latency due to the bridging scheme.
Therefore, the embodiments of the present disclosure provide a head-mounted device, which can overcome the above technical problems in the related art to a certain extent, thereby implementing a split head-mounted device with low power consumption, small volume and good real-time performance.
Hereinafter, a head-mounted device in an exemplary embodiment of the present disclosure will be described in more detail with reference to the drawings and the embodiment.
Fig. 1 is a schematic diagram illustrating a configuration of a head-mounted device according to an exemplary embodiment.
The head-mounted device 1 shown in fig. 1 may be VR glasses, AR glasses, MR glasses, or other smart glasses that can be worn on the head, for example.
Referring to fig. 1, the head-mounted apparatus 1 includes: a head unit 11.
Fig. 2A and 2B are schematic views of different head units, respectively, shown according to an example. The head-mounted unit 11 may be, for example, closed as shown in fig. 2A, and integrally mounted on the head of the user; alternatively, it may be in the form of glasses having a display part a and two temples B as shown in fig. 2B. It should be noted that the present disclosure does not limit the shape and/or style of the head unit 11, and fig. 2A and 2B are only examples and do not limit the present disclosure.
As shown in fig. 1, the head unit 11 includes: a data acquisition module 111, a data output module 112, a serial interface 113 and an integrated circuit module 114.
The serial interface 113 may be, for example, a USB interface satisfying USB 2.0 specification, USB3.0 specification, and USB3.1 specification, and includes: micro USB interface or USB TYPE-C interface. Furthermore, the serial interface 113 may also be any other type of serial interface capable of being used for serial data transmission.
The integrated circuit module 114 includes: the data conversion module 1141 and the interface module 1142, the data conversion module 1141 is connected to the data acquisition module 111 and the data output module 112 through the interface module 1142, respectively.
The data conversion module 1141 is configured to perform serialization conversion on the data acquired from the data acquisition module 111 through the interface module 1142, and output the converted serial data through the serial interface 113, so as to process the converted serial data, for example, transmit the converted serial data to a host unit or an electronic device, which will be described below, for processing.
The data conversion module 1141 is further configured to convert serial data received through the serial interface 113 to convert the received serial data into interface data matching with an interface protocol of the interface module 1142, and transmit the converted interface data to the data output module 112 through the interface module 1142, so as to output the converted interface data to a user through the data output module 112.
The integrated circuit module 114 may be implemented as an ASIC (Application Specific integrated circuit) data integration processing chip, for example, or may also be implemented as an FPGA (Field programmable gate Array).
According to the head-mounted device provided by the embodiment of the disclosure, the integrated circuit chip is used in the head-mounted unit, the data is acquired through the interface module in the integrated circuit chip, and the acquired data and the data received from the host unit are converted in a centralized manner through the data conversion module, so that on one hand, the space and the volume of the head-mounted unit can be greatly reduced, and the light and thin head-mounted unit is favorably realized; on the other hand, the power consumption of the chip can be reduced, the heat generation of the head-mounted unit is reduced, and the user experience is improved; in addition, centralized conversion may also reduce overall data processing delays for the head-mounted device.
Fig. 3 is a schematic diagram illustrating another head-mounted unit according to an exemplary embodiment. The integrated circuit module 114 in the head unit 21 shown in fig. 3 includes a plurality of interface modules 1142, for example, the plurality of interface modules 1142 may be an I2C interface module, an SPI interface module, an I2S interface module, a SLIMBus interface module, and a MIPI interface module, respectively.
The I2C interface module communicates with the connected modules using the I2C bus, which is a simple, bi-directional two-wire synchronous serial bus, I2C. It requires only two wires to transfer information between devices connected to the bus. The master device is used to initiate the bus to transfer data and to generate a clock to open up the devices that are transferring, when any addressed device is considered a slave device. If the master device is to send data to the slave device, the master device addresses the slave device first, then actively sends the data to the slave device, and finally the master device terminates data transmission; if the master is to receive the slave's data, the slave is first addressed by the master. The master device is responsible for generating the timing clock and terminating the data transfer. Generally, I2C is a control interface for transmitting control signaling.
And the SPI interface module communicates with the connected modules by using an SPI bus. The SPI bus is a high-speed, full-duplex synchronous communication bus. The SPI communication principle is simple and it works in a master-slave mode, which usually has a master and one or more slaves, requiring 4 lines for master data input, master data output, clock signal transmission, and enable signal transmission for master output, respectively. Usually, the SPI interface is also a control interface for transmitting control signaling.
The I2S interface module communicates with connected modules using an I2S bus. The I2S bus is a bus standard established for audio data transmission between digital audio devices (e.g., CD players, digital sound processors, digital television sound systems). The design of independent wire transmission clock and data signal is adopted, and the data and clock signal are separated, so that the distortion caused by time difference is avoided, the cost for purchasing professional equipment for resisting audio jitter is saved for users, and the method is widely applied to various multimedia systems. A standard I2S bus cable is made up of 3 serial conductors: 1 is a Time Division Multiplexing (TDM) data line; 1 is a word selection line; the 1 root is the clock line.
The SLIMBus interface module communicates with connected modules using a SLIMBus bus. The SLIMBus bus is an audio interface specified by the MIPI alliance for connecting a baseband/application processor and an audio chip, typically for transmitting audio data. The two ends of the SLIMbus are composed of an interface device and one to a plurality of functional devices, the interface device and the functional devices are connected by one to a plurality of ports, and the ports can be only input, only output or bidirectional. The SLIMBus bus supports dynamic stop and restart and supports all sampling frequencies.
The MIPI interface module and the connected module adopt MIPI interface specifications for communication. MIPI is an open standard and a specification established by the MIPI alliance for mobile application processors. The purpose is to standardize the interfaces in the mobile phone, such as a camera, a display screen interface, a radio frequency/baseband interface and the like, thereby reducing the complexity of the mobile phone design and increasing the design flexibility. The MIPI multimedia specification is largely divided into three layers, namely an application layer, a protocol layer and a physical layer. The interface mainly applies to the interfaces of the camera, the display and other devices, including the camera interface csi (camera Serial interface), the display interface dsi (displayserial interface) and so on.
As shown in fig. 3, the head-mounted unit 21 may include a plurality of data acquisition modules 111, for example, the plurality of data acquisition modules 111 may be: the device comprises an audio data acquisition module, a video data acquisition module, an eye movement tracking module and a sensing data acquisition module.
The audio data acquisition module may include, for example, a microphone and an audio Codec (Codec). The audio codec audio-encodes the data collected by the microphone.
The video data acquisition module may for example comprise a camera, such as a lens of a normal camera, an IR lens of an IR camera, etc.
Eye tracking is a scientific application technology, when the eyes of a person look at different directions, the eyes can slightly change, the changes can generate extractable features, and a computer can extract the features through image capture or scanning, so that the changes of the eyes can be tracked in real time, the state and the demand of a user can be predicted, response is carried out, the purpose of controlling equipment by the eyes is achieved, and for example, the user can turn pages without touching a screen. In principle, eye movement tracking mainly studies the acquisition, modeling and simulation of eyeball movement information, and has wide application. Besides the eye tracker, the equipment for acquiring the eye movement information can also be image acquisition equipment, even a camera on a common computer or a mobile phone, and the eye movement information acquisition equipment can also realize eye tracking under the support of software.
The eye tracking module may include an eye tracker, an image capture device, etc., as described above.
The sensing data acquisition module may include, for example: proximity sensors (Proximity sensors), IMDs (Inertial Measurement units), visible Light sensors (Ambient Light sensors), and the like.
Among them, the proximity sensor is a generic name of a sensor for detecting without touching a detection object, instead of a contact detection method such as a limit switch. The movement information and the presence information of the detection object can be converted into an electric signal. The detection principle of the induction type proximity sensor is to detect a magnetic loss caused by an eddy current generated on a surface of a conductor by the influence of an external magnetic field. An alternating magnetic field is generated in the detection coil, and a change in impedance due to an eddy current generated in the metal body of the detection body is detected. In addition, as another embodiment, an aluminum detection sensor that detects a frequency-phase component, an all-metal sensor that detects only an impedance change component by a working coil, and the like are included.
IMD is a device for measuring the three-axis attitude angle (or angular rate) and acceleration of an object. Generally, an IMU includes three single-axis accelerometers and three single-axis gyroscopes, the accelerometers detect acceleration signals of an object in three independent axes of a carrier coordinate system, and the gyroscopes detect angular velocity signals of the carrier relative to a navigation coordinate system, and measure angular velocity and acceleration of the object in three-dimensional space, and then solve the attitude of the object.
The visible light sensor is a device which takes visible light as a detection object and converts the visible light into an output signal. The visible light sensor can sense the regularly measured quantity and convert the regularly measured quantity into a device or a device of a usable output signal.
As shown in fig. 3, the audio data acquisition module 111 may be connected to the data conversion module 1141 through a SLIMBus interface module 1142 and an SPI interface module 1142, for example. Control signals can be transmitted between the audio data acquisition module 111 and the SPI interface module 1142, and audio data can be transmitted between the audio data acquisition module 111 and the SLIMBus interface module 1142.
The video data acquisition module 111 may be connected to the data conversion module 1141 through the MIPI interface module 1142 and the I2C interface module 1142. The video data acquisition module 111 and the MIPI interface module 1142 may transmit video data therebetween, and the control signal may be transmitted between the video data acquisition module 111 and the I2C interface module 1142.
The eye tracking module 111 may be connected to the data conversion module 1141 via the MIPI interface module 1142 and the I2C interface module 1142. The eye tracking module 111 and the MIPI interface module 1142 may transmit eye tracking data therebetween, and the eye tracking module 111 and the I2C interface module 1142 may transmit control signals therebetween.
The sensing data collection module 111 may be connected to the data conversion module 1141 via an I2C interface module 1142, for example. The sensing data acquisition module 111 and the I2C interface module 1142 may transmit sensing data and control signals.
With continued reference to fig. 3, the head unit 21 may also include a plurality of data output modules 112, for example. The plurality of data output modules 112 may include, for example, a display module 112 and an audio data output module 112.
The display module 112 may be, for example, a glasses-type display as shown in fig. 2A and 2B.
The audio data output module 112 may include, for example, a speaker and/or a headphone interface, and outputs audio data through an external headphone.
The display module 112 may be connected to the data conversion module 1141 through the MIPO interface module 1142 and the I2C interface module 1142. The display module 112 and the MIPO interface module 1142 may transmit video data to be displayed, and the display module 112 and the I2C interface module 1142 may transmit control signals.
The audio data output module 112 may be connected to the data conversion module 1141 via the I2S interface module 1142 and the I2C interface module 1142. The audio data output module 112 and the I2S interface module 1142 may transmit audio data to be output therebetween, and the audio data output module 112 and the I2C interface module 1142 may transmit control signals therebetween.
In addition, the integrated circuit module 114 may further include a clock module 1143, which is respectively connected to the data conversion module 1141 and each interface module 1142, and configured to output a clock signal to each module.
In some embodiments, the integrated circuit module 114 may further include: a data compression module 1144 and a data decompression module 1145.
The data compression module 1144 and the data decompression module 1145 are respectively connected between the data conversion module 1141 and the serial interface 113.
The data compression module 1144 is configured to compress serial data to be output before the data conversion module 1141 outputs the converted serial data through the serial interface 113, and output the compressed serial data through the serial interface 113.
The data decompression module 1145 is configured to decompress the serial data received through the serial interface 113 before the data conversion module 1141 receives the serial data through the serial interface 113, and transmit the decompressed serial data to the data conversion module 1141 for conversion.
By compressing the data to be transmitted, the transmission bandwidth can be saved, and the transmission rate is improved, so that the real-time performance of the data is further ensured, and the user experience is improved. It should be noted that the present disclosure does not limit the data compression/decompression algorithm used, and the specific algorithm can be selected according to the requirement in practical application.
In some embodiments, the head unit 21 may further include: and the power management module 215 is connected to the serial interface 113 and is configured to receive the power provided by the power supply device connected to the serial interface 113 through the serial interface 113 to supply power to the head-mounted unit 21. The power supply device may be a host unit as described below.
Fig. 4 is a schematic diagram illustrating another headset configuration according to an exemplary embodiment.
As shown in fig. 4, the head-mounted device 1 may further include: a host unit 12.
The head unit in fig. 4 is exemplified by the head unit 11 shown in fig. 1 for the sake of simplicity of illustration, but may be the head unit 21 shown in fig. 3.
As shown in fig. 4, the host unit 12 includes: a processing module 121, a serial interface 122, and an integrated circuit module 123.
The processing module 121 is connected to the integrated circuit module 123. The processing module 121 may be, for example, an Application Processor (AP) for processing data received from the head unit 11 and returning the processed data (video data and/or audio data) to the head unit 11 through the integrated circuit module 123 for output.
Corresponding to the serial interface 113, the serial interface 122 may also be a USB interface satisfying the USB 2.0 specification, the USB3.0 specification, and the USB3.1 specification, and includes: micro USB interface or USB TYPE-C interface. Furthermore, the serial interface 122 may be any other type of serial interface capable of being used for serial data transmission.
A cable is connected between the serial interface 122 and the serial interface 113, and the host unit 12 and the head unit 11 can be connected.
The integrated circuit module 123 includes: a data transmission module 1231 and an interface module 1232.
The data conversion module 1231 is connected to the processing module 121 through the interface module 1232.
The data conversion module 1231 is configured to convert serial data received from the head unit 11 through the serial interface 122, so as to convert the received serial data into interface data matching with an interface protocol of the interface module 1232, and transmit the converted interface data to the processing module 121 through the interface module 1232.
The data conversion module 1231 is further configured to serialize the processed data (audio data and/or video data) received from the processing module 121 through the interface module 1232, and output the converted serial data to the head unit 11 through the serial interface 122.
It will be understood by those skilled in the art that the host unit 12 may be a dedicated device configured with the head unit 11, or the host unit 12 may be an electronic device (e.g., a smart phone, a tablet computer, etc.) configured with the integrated circuit module 123. A processor (e.g., a CPU or an AP) in the electronic device may be the processing module 121, and the processor may perform corresponding processing on data received through the integrated circuit module 123 by installing a corresponding application program in the electronic device.
By configuring and using an integrated circuit corresponding to the head-mounted unit in the host unit, matched transmission and processing of data between the host unit and the head-mounted unit can be realized.
Fig. 5 is a schematic diagram illustrating another host unit configuration according to an example embodiment.
As shown in fig. 5, the integrated circuit module 123 in the host unit 22 may include a plurality of interface modules 1232, and the plurality of interface modules 1232 may also be an I2C interface module, an SPI interface module, an I2S interface module, a SLIMBus interface module, and a MIPI interface module, respectively.
The data conversion module 1231 may transmit the converted audio data to the processing module 121 through the SLIMBus interface module 1232 and the SPI interface module 1232; the data conversion module 1231 may transmit the converted video data to the processing module 121 through the MIPI interface module 1232 and the I2C interface module 1232; the data conversion module 1231 may transmit the converted eye movement tracking data to the processing module 121 through the MIPI interface module 1232 and the I2C interface module 1232; the data conversion module 1231 may transmit the converted sensing data to the processing module 121 through the I2C interface module 1232.
The integrated circuit module 123 may further include a clock module 1233 for transmitting a clock signal to the data conversion module 1231 and each interface module 1232.
In some embodiments, the integrated circuit module 123 may further include: a data compression module 1234 and a data decompression module 1235.
The data compression module 1234 and the data decompression module 1235 are respectively connected between the data conversion module 1231 and the serial interface 122.
The data decompression module 1235 is configured to decompress serial data received through the serial interface 122 before the data conversion module 1231 receives the serial data from the head unit 11 through the serial interface 122, and transmit the decompressed serial data to the data conversion module 1231 for conversion.
The data compression module 1234 is configured to compress serial data to be output before the data conversion module 1231 outputs the converted serial data through the serial interface 122, and output the compressed serial data to the head unit 11 through the serial interface 122.
It will be understood by those skilled in the art that the compression algorithm used by the data compression module 1144 in the head unit 21 should match the decompression algorithm used by the data decompression module 1235 in the host unit 22, and the compression algorithm used by the data compression module 1234 in the host unit 22 should match the decompression algorithm used by the data decompression module 1145 in the head unit 21.
By compressing the data to be transmitted, the transmission bandwidth can be saved, and the transmission rate is improved, so that the real-time performance of the data is further ensured, and the user experience is improved. It should be noted that the present disclosure does not limit the data compression/decompression algorithm used, and the specific algorithm can be selected according to the requirement in practical application.
In some embodiments, the host unit 21 may further include: a power management module 224 and a battery 225. The power management module 224 is respectively connected to the battery 225 and the serial interface 122, and is used for providing the power provided by the battery 225 to the head-mounted unit 11 through the serial interface 122 to power the head-mounted unit 11.
As mentioned above, the host unit may also be implemented as an electronic device.
An electronic device 800 according to this embodiment of the disclosure is described below with reference to fig. 6. The electronic device 800 shown in fig. 6 is only an example and should not bring any limitations to the functionality and scope of use of the embodiments of the present disclosure.
As shown in fig. 6, electronic device 800 is in the form of a general purpose computing device. The components of the electronic device 800 may include, but are not limited to: the at least one processing unit 810, the at least one memory unit 820, and a bus 830 that couples the various system components including the memory unit 820 and the processing unit 810.
The storage unit 820 may include a readable medium in the form of a volatile memory unit, such as a random access memory unit (RAM)8201 and/or a cache memory unit 8202, and may further include a read only memory unit (ROM) 8203.
The storage unit 820 may also include a program/utility 8204 having a set (at least one) of program modules 8205, such program modules 8205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The electronic device 800 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 800, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 800 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 850. Also, the electronic device 800 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 860. As shown, the network adapter 860 communicates with the other modules of the electronic device 800 via the bus 830. It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with the electronic device 800, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 810, which may be the processing module 121 in the host unit 12 or 22 as described above, is coupled to the integrated circuit module 870 in the electronic device 800. The specific structure of the integrated circuit module 870 can be seen in fig. 4 or fig. 5, and is not described herein again. Further, the input/output interface 850 may be used to implement the serial interface 122 described above.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
Claims (16)
1. A head-mounted device, comprising: a head-mounted unit; the head-mounted unit includes:
a data acquisition module;
a data output module;
a first serial interface; and
a first integrated circuit comprising: the device comprises a first data conversion module and a first interface module; the first data conversion module is connected with the first serial interface and is respectively connected with the data acquisition module and the data output module through the first interface module;
the first data conversion module is used for performing serialization conversion on the data acquired from the data acquisition module through the first interface module and outputting the converted serial data to the processing equipment connected with the head-mounted unit through the first serial interface; and converting the serial data received through the first serial interface to convert the serial data into interface data matched with the interface protocol of the first interface module, and transmitting the converted interface data to the data output module through the first interface module.
2. The headset of claim 1, wherein the first interface module comprises at least one of the following: first I2C interface module, first SPI interface module, first I2S interface module, first SLIMBUS interface module and first MIPI interface module.
3. The headset of claim 2 wherein the data acquisition module comprises at least one of the following: the device comprises an audio data acquisition module, a video data acquisition module, an eye movement tracking module and a sensing data acquisition module.
4. The headset of claim 3, wherein the audio data collection module is connected to the first data conversion module through a first SLIMBUS interface module of the first interface module and a first SPI interface module of the first interface module, the video data collection module is connected to the first data conversion module through a first MIPI interface module of the first interface module and a first I2C interface module of the first interface module, the eye movement tracking module is connected to the first data conversion module through a first MIPI interface module of the first interface module and a first I2C interface module of the first interface module, and the sensing data collection module is connected to the first data conversion module through a first I2C interface module of the first interface module.
5. The head-mounted device of claim 2, wherein the data output module comprises: the display module and the audio data output module; the display module is connected with the first data conversion module through a first MIPI interface module in the first interface module and a first I2C interface module in the first interface module, and the audio data output module is connected with the first data conversion module through a first I2S interface module in the first interface module and a first I2C interface module in the first interface module.
6. The headset of claim 1, wherein the first integrated circuit further comprises: the first data compression module and the first data decompression module are respectively connected between the first data conversion module and the first serial interface;
the first data compression module is used for compressing the serial data and outputting the compressed serial data through the first serial interface before the first data conversion module outputs the converted serial data through the first serial interface;
the first data decompression module is used for decompressing the serial data received through the first serial interface before the first data conversion module receives the serial data through the first serial interface, and transmitting the decompressed serial data to the first data conversion module for conversion.
7. The headset of any one of claims 1-6, further comprising: a host unit; the host unit is the processing device; the host unit includes:
a processing module;
the host unit is connected with the head-mounted unit through the second serial interface; and
a second integrated circuit comprising: the second data conversion module and the second interface module; the second data conversion module is connected with the second serial interface and is connected with the processing module through the second interface module;
the second data conversion module is used for converting serial data received from the head-mounted unit through the second serial interface so as to convert the serial data into interface data matched with an interface protocol of the second interface module, and transmitting the converted interface data to the processing module through the second interface module;
the processing module is used for processing the interface data converted by the second data conversion module;
the second data conversion module is further configured to serialize the processed data received from the processing module through the second interface module, and output the converted serial data to the head-mounted unit through the second serial interface.
8. The headset of claim 7, wherein the second interface module comprises at least one of: a second I2C interface module, a second SPI interface module, a second I2S interface module, a second SLIMBus interface module, and a second MIPI interface module.
9. The headset of claim 8, wherein the second data conversion module is configured to transmit the converted audio data to the processing module through a second SLIMBus interface module of the second interface module and a second SPI interface module of the second interface module, transmit the converted video data to the processing module through a second MIPI interface module of the second interface module and a second I2C interface module of the second interface module, transmit the converted eye tracking data to the processing module through a second MIPI interface module of the second interface module and a second I2C interface module of the second interface module, and transmit the converted sensing data to the processing module through a second I2C interface module of the second interface module.
10. The headset of claim 7, wherein the head-mounted unit further comprises: a first power management module; the host unit further comprises: a battery and a second power management module; the second power management module is used for providing the electric energy provided by the battery to the first power management module through the second serial interface and the first serial interface so as to supply power to the head-mounted unit.
11. The headset of claim 7, wherein the second integrated circuit further comprises: the second data compression module and the second data decompression module are respectively connected between the second data conversion module and the second serial interface;
the second data decompression module is used for decompressing the serial data received through the second serial interface before the second data conversion module receives the serial data from the head-mounted unit and transmitting the decompressed serial data to the second data conversion module;
the second data compression module is used for compressing the serial data and outputting the compressed serial data through the second serial interface before the second data conversion module outputs the converted serial data through the second serial interface.
12. An electronic device, comprising:
a processing module;
the electronic equipment is connected with the head-mounted display equipment through the serial interface; and
an integrated circuit, comprising: the data conversion module and the interface module; the data conversion module is connected with the serial interface and is connected with the processing module through the interface module;
the data conversion module is used for converting serial data received from the head-mounted display device through the serial interface so as to convert the serial data into interface data matched with an interface protocol of the interface module, and transmitting the converted interface data to the processing module through the interface module;
the processing module is used for processing the interface data converted by the data conversion module;
the data conversion module is further configured to serialize the processed data received from the processing module through the interface module, and output the converted serial data to the head-mounted display device through the serial interface.
13. The electronic device of claim 12, wherein the interface module comprises at least one of: an I2C interface module, an SPI interface module, an I2S interface module, a SLIMbus interface module and a MIPI interface module.
14. The electronic device of claim 13, wherein the data conversion module is configured to transmit the converted audio data to the processing module through a SLIMBus interface module of the interface module and an SPI interface module of the interface module, transmit the converted video data to the processing module through a MIPI interface module of the interface module and an I2C interface module of the interface module, transmit the converted eye-tracking data to the processing module through a MIPI interface module of the interface module and an I2C interface module of the interface module, and transmit the converted sensing data to the processing module through an I2C interface module of the interface module.
15. The electronic device of claim 12, further comprising: a battery and power management module; the power management module is used for providing the electric energy provided by the battery to the head-mounted display equipment through the serial interface so as to supply power to the head-mounted display equipment.
16. The electronic device of any of claims 12-15, wherein the integrated circuit further comprises: the data compression module and the decompression module are respectively connected between the second data conversion module and the second serial interface;
the data decompression module is used for decompressing the serial data received through the serial interface before the data conversion module receives the serial data from the head-mounted display device and transmitting the decompressed serial data to the data conversion module;
the data compression module is used for compressing the serial data and outputting the compressed serial data through the serial interface before the data conversion module outputs the converted serial data through the serial interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010111923.XA CN111338080A (en) | 2020-02-24 | 2020-02-24 | Head-mounted device and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010111923.XA CN111338080A (en) | 2020-02-24 | 2020-02-24 | Head-mounted device and electronic device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111338080A true CN111338080A (en) | 2020-06-26 |
Family
ID=71183642
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010111923.XA Pending CN111338080A (en) | 2020-02-24 | 2020-02-24 | Head-mounted device and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111338080A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112596244A (en) * | 2020-12-28 | 2021-04-02 | 北京枭龙防务科技有限公司 | Split type AR intelligent glasses and data transmission method thereof |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101419339A (en) * | 2008-11-24 | 2009-04-29 | 电子科技大学 | Head-mounted display |
| CN101482856A (en) * | 2009-01-05 | 2009-07-15 | 东南大学 | Serial-parallel protocol conversion apparatus based on field programmable gate array |
| CN104462013A (en) * | 2014-06-26 | 2015-03-25 | 深圳奥比中光科技有限公司 | ASIC chip system special for optical three-dimensional sensing |
| CN105979465A (en) * | 2016-06-29 | 2016-09-28 | 北京小米移动软件有限公司 | Method and device for determining maximum output power value of earphone equipment |
| CN106095007A (en) * | 2016-07-29 | 2016-11-09 | 北京小鸟看看科技有限公司 | One wears display device |
| CN106708763A (en) * | 2016-08-31 | 2017-05-24 | 北京亮亮视野科技有限公司 | Head-mounted display device and data transmission system of intelligent host |
| CN206498499U (en) * | 2017-02-15 | 2017-09-15 | 苏州芯盟慧显电子科技有限公司 | A kind of display device of wear-type augmented reality |
| CN206541288U (en) * | 2017-01-07 | 2017-10-03 | 北京国承万通信息科技有限公司 | A kind of virtual reality system, main frame and head-mounted display apparatus |
| CN107315250A (en) * | 2017-05-23 | 2017-11-03 | 杭州蓝斯特科技有限公司 | The wear-type wireless display and its implementation of a kind of low delay |
| CN108345559A (en) * | 2018-02-09 | 2018-07-31 | 京东方科技集团股份有限公司 | Virtual reality data input unit and virtual reality device |
-
2020
- 2020-02-24 CN CN202010111923.XA patent/CN111338080A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101419339A (en) * | 2008-11-24 | 2009-04-29 | 电子科技大学 | Head-mounted display |
| CN101482856A (en) * | 2009-01-05 | 2009-07-15 | 东南大学 | Serial-parallel protocol conversion apparatus based on field programmable gate array |
| CN104462013A (en) * | 2014-06-26 | 2015-03-25 | 深圳奥比中光科技有限公司 | ASIC chip system special for optical three-dimensional sensing |
| CN105979465A (en) * | 2016-06-29 | 2016-09-28 | 北京小米移动软件有限公司 | Method and device for determining maximum output power value of earphone equipment |
| CN106095007A (en) * | 2016-07-29 | 2016-11-09 | 北京小鸟看看科技有限公司 | One wears display device |
| CN106708763A (en) * | 2016-08-31 | 2017-05-24 | 北京亮亮视野科技有限公司 | Head-mounted display device and data transmission system of intelligent host |
| CN206541288U (en) * | 2017-01-07 | 2017-10-03 | 北京国承万通信息科技有限公司 | A kind of virtual reality system, main frame and head-mounted display apparatus |
| CN206498499U (en) * | 2017-02-15 | 2017-09-15 | 苏州芯盟慧显电子科技有限公司 | A kind of display device of wear-type augmented reality |
| CN107315250A (en) * | 2017-05-23 | 2017-11-03 | 杭州蓝斯特科技有限公司 | The wear-type wireless display and its implementation of a kind of low delay |
| CN108345559A (en) * | 2018-02-09 | 2018-07-31 | 京东方科技集团股份有限公司 | Virtual reality data input unit and virtual reality device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112596244A (en) * | 2020-12-28 | 2021-04-02 | 北京枭龙防务科技有限公司 | Split type AR intelligent glasses and data transmission method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112445012B (en) | A coupling assembling and wearable equipment for wearable equipment | |
| US9785190B2 (en) | Virtual reality glasses | |
| US20140379952A1 (en) | Tablet electronic device | |
| WO2021018070A1 (en) | Image display method and electronic device | |
| WO2017107445A1 (en) | Method and system for acquiring immersed feeling in virtual reality system, and intelligent glove | |
| US20170026744A1 (en) | Microphone Arranged in Cavity for Enhanced Voice Isolation | |
| KR20150070436A (en) | Multi-touch interface schemes | |
| JP2020182028A (en) | Electronic apparatus and control method | |
| WO2023226888A1 (en) | Vehicle-mounted communication system based on virtual reality, and vehicle-mounted communication method based on virtual reality | |
| CN111479148B (en) | Wearable device, glasses terminal, processing terminal, data interaction method and medium | |
| CN111338080A (en) | Head-mounted device and electronic device | |
| CN208766396U (en) | A kind of wearable AR equipment and AR display system | |
| WO2022100258A1 (en) | Wearing assembly for wearable device, and wearable device | |
| CN112394519B (en) | Wearing component for wearable device and wearable device | |
| CN111327342A (en) | Head-mounted device and electronic device | |
| WO2023124972A1 (en) | Display state switching method, apparatus and system, electronic device and storage medium | |
| CN207124680U (en) | A kind of external camera assembly | |
| CN115733549A (en) | PCIE network card and switching method of interface modes thereof, electronic equipment and storage medium | |
| US9535519B1 (en) | Smart housing for extending trackpad sensing | |
| CN111308708B (en) | Head-mounted device | |
| US20200241656A1 (en) | Information processing apparatus, information processing method, and program | |
| WO2022179279A1 (en) | Interaction method, electronic device, and interaction system | |
| CN113189794B (en) | Intelligent glasses and control method thereof | |
| CN113489880B (en) | Electronic device, information synchronization method, and computer-readable storage medium | |
| CN214409449U (en) | Wearable device and wearing assembly thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200626 |