CN113852826A - Image data transmission method, device and system - Google Patents
Image data transmission method, device and system Download PDFInfo
- Publication number
- CN113852826A CN113852826A CN202111039294.5A CN202111039294A CN113852826A CN 113852826 A CN113852826 A CN 113852826A CN 202111039294 A CN202111039294 A CN 202111039294A CN 113852826 A CN113852826 A CN 113852826A
- Authority
- CN
- China
- Prior art keywords
- image data
- display screen
- display
- processing unit
- programmable logic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 56
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000006835 compression Effects 0.000 claims abstract description 58
- 238000007906 compression Methods 0.000 claims abstract description 58
- 230000006837 decompression Effects 0.000 claims abstract description 37
- 238000004806 packaging method and process Methods 0.000 claims description 15
- 230000000694 effects Effects 0.000 abstract description 5
- 238000005516 engineering process Methods 0.000 description 9
- 238000005538 encapsulation Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 230000000007 visual effect Effects 0.000 description 3
- 230000003139 buffering effect Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 2
- 239000010703 silicon Substances 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/398—Synchronisation thereof; Control thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses an image data transmission method, a device and a system, wherein the method is applied to a programmable logic device, the programmable logic device is bridged between a graphic processing unit and a display screen of AR equipment through a display interface, and the method comprises the following steps: receiving first image data transmitted by the graphics processing unit, wherein the first image data is obtained by the graphics processing unit compressing original image data according to a preset compression algorithm; decompressing the first image data according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data; and transmitting the second image data to the display screen so that the display screen can display the second image data. The invention reduces the data transmission pressure of the graphic processing unit while ensuring the image display effect of the AR equipment.
Description
Technical Field
The present invention relates to the field of AR technologies, and in particular, to a method, an apparatus, and a system for transmitting image data.
Background
The Augmented Reality (AR) technology is a technology that skillfully fuses virtual information and a real world, and the virtual-real fusion display technology in the three technical points of AR aims to enable related contents of the virtual world to be overlaid in the real world, wherein the involved display technology has very high requirements on the resolution and refresh rate of images. At present, AR systems have higher and higher requirements for display, such as 2K monocular resolution, 2 x 2K binocular resolution, and combined with AR experience requirements, the refresh rate is up to 100Hz, or even higher 120 Hz. Processing and transmitting such large data volumes in real time imposes high requirements on the interface transmission throughput of the graphics processing unit. For such a situation, the graphics processing unit is required to compress the source data stream to reduce the data transmission pressure of the graphics processing unit, but at present, the display screen of the AR device cannot support the decompression function, so that the data transmission pressure of the graphics processing unit cannot be reduced by a compression processing method.
Disclosure of Invention
The invention mainly aims to provide an image data transmission method, an image data transmission device and an image data transmission system, and aims to solve the technical problem that the data transmission pressure of a graphic processing unit cannot be reduced in a compression processing mode due to the fact that a display screen of an existing AR device cannot support a decompression function.
In order to achieve the above object, the present invention provides an image data transmission method, where the image data transmission method is applied to a programmable logic device, the programmable logic device is bridged between a graphic processing unit and a display screen of an AR device through a display interface, and the image data transmission method includes the following steps:
receiving first image data transmitted by the graphics processing unit, wherein the first image data is obtained by the graphics processing unit compressing original image data according to a preset compression algorithm;
decompressing the first image data according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data;
and transmitting the second image data to the display screen so that the display screen can display the second image data.
Optionally, the step of receiving the first image data transmitted by the graphics processing unit includes:
receiving the first image data which is transmitted by the graphic processing unit and packaged according to a first packaging mode;
the received first image data is parsed.
Optionally, the step of decompressing the first image data according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data includes:
caching the first image data to a buffer of the programmable logic device according to the display time sequence of the display screen;
and decompressing the first image data in the buffer according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data.
Optionally, the step of transmitting the second image data to the display screen for the display screen to display the second image data includes:
converting the second image data according to the frame format of the display screen;
and packaging the converted second image data according to a second packaging mode corresponding to an interface protocol corresponding to the display screen, and transmitting the packaged second image data to the display screen for display by the display screen.
Optionally, the preset compression algorithm is a single-channel compression ratio 2:1 DSC compression algorithm.
In order to achieve the above object, the present invention further provides an image data transmission apparatus, where the image data transmission apparatus is disposed in a programmable logic device, the programmable logic device is bridged between a graphics processing unit and a display screen of an AR device through a display interface, and the image data transmission apparatus includes:
the receiving module is used for receiving first image data transmitted by the graphics processing unit, wherein the first image data is obtained by compressing original image data by the graphics processing unit according to a preset compression algorithm;
the decompression module is used for decompressing the first image data according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data;
and the output module is used for transmitting the second image data to the display screen so that the display screen can display the second image data.
In order to achieve the above object, the present invention further provides an image data transmission system, where the image data transmission system includes a graphics processing unit and a display screen of an AR device, and further includes a programmable logic device bridged between the graphics processing unit and the display screen through a display interface, and the programmable logic device is used in the steps of the image data transmission method described above.
Optionally, the display screen is an LCOS display screen.
The invention sets a programmable logic device which is bridged between a graphic processing unit of AR equipment and a display screen through a display interface, the graphic processing unit compresses original image data according to a preset compression algorithm to obtain first image data and transmits the first image data to the programmable logic device, the programmable logic device receives the first image data, decompresses the first image data according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data, and outputs the second image data to the display screen for display. The first image data output by the graphic processing unit is obtained by compression, the data volume is smaller than that of original image data, so that the data transmission pressure of the graphic processing unit is reduced, decompression and frame format conversion are carried out by taking the programmable logic device as a bridging component, the decompressed image data is output to a display screen for display, and the image display effect of the AR equipment is ensured.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments or the conventional technologies of the present application, the drawings used in the descriptions of the embodiments or the conventional technologies will be briefly introduced below, it is obvious that the drawings in the following descriptions are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flowchart illustrating a first embodiment of an image data transmission method according to the present invention;
FIG. 2 is a functional block diagram of an image data transmission apparatus according to a preferred embodiment of the present invention;
fig. 3 is a schematic structural diagram of an image data transmission system according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a flowchart illustrating an image data transmission method according to a first embodiment of the present invention.
While a logical order is shown in the flow chart, in some cases, the steps shown or described may be performed in an order different than that shown or described herein. The image data transmission method of the present invention is applied to a programmable logic device, and in this embodiment, the image data transmission method includes:
step S10, receiving first image data transmitted by the graphics processing unit, where the first image data is obtained by the graphics processing unit compressing original image data according to a preset compression algorithm;
in this embodiment, in order to solve the technical problem that the data transmission pressure of a Graphics Processing Unit (GPU) cannot be reduced by a compression processing manner because a display screen of an AR device cannot support a decompression function at present, a programmable logic device is proposed as a bridge component between the graphics processing unit and the display screen, and the decompression function is implemented by the programmable logic device. And, data transmission between the graphic processing unit and the display screen in the AR device needs low delay, so the programmable logic device is adopted as a bridge component to realize the decompression function, compared with a method for realizing the decompression function by executing software through a microprocessor, the data decompression speed is higher, and the requirement of low delay can be met better.
The Programmable logic device may be an editable Gate Array (FPGA), a Complex Programmable Logic Device (CPLD), or the like, and is not limited in this embodiment. The programmable logic device is bridged between the graphic processing unit and the display screen of the AR equipment through the display interface. The AR device may be an AR glasses, an AR helmet, or the like, and is not limited herein; the display screen may be a display screen commonly used for AR devices, such as an LCOS (Liquid Crystal on Silicon) display screen. That is, the programmable logic device is connected with the graphic processing unit through the display interface, and is also connected with the display screen through the display interface. The Display Interface may adopt a commonly used Display Interface, for example, an MIPI (Mobile Industry Processor Interface) DSI (Display Serial Interface SpecificaTIon) Display Interface, which is not limited in this embodiment. It should be noted that the display interface used between the graphics processing unit and the programmable logic device may be the same as or different from the display interface used between the programmable logic device and the display screen, and is not limited in this embodiment, for example, MIPIDSI display interfaces may be used. Inside the programmable logic device, the design is carried out through a hardware description language, so that the programmable logic device has a decompression function.
The image processing unit compresses the original image data according to a preset compression algorithm to obtain compressed image data (hereinafter, the compressed image data is referred to as first image data for distinguishing), and outputs the first image data to the programmable logic device through the display interface. In this embodiment, the original image data is encapsulated and then compressed before being output, and compared with the case that the original image data is directly output by the graphics processing unit, the bandwidth requirement on an output interface of the graphics processing unit is lower, so that the data transmission pressure of the graphics processing unit is reduced. The preset compression algorithm can adopt a visual lossless compression algorithm, so that the image display effect of the AR equipment can be ensured while the data transmission pressure of the graphic processing unit is ensured to be reduced. It should be noted that, the graphics processing unit may compress the image data to be rendered transmitted from the AR device main processor, and then perform rendering on the basis of the compressed image data to be rendered to obtain the first image data, where the original image data refers to the image data to be rendered.
The programmable logic device receives first image data output by the graphic processing unit. The first image data may be image data in units of frames or image data in units of lines; if the frame is taken as a unit, the graphics processing unit receives each frame of image data to be rendered, which is sequentially transmitted from the main processor to the left eye and the right eye of the AR device, and sequentially renders and compresses each frame of image data to be rendered to obtain each frame of first image data, and sequentially outputs the first image data to the programmable logic device.
Step S20, decompressing the first image data according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data;
after receiving the first image data, the programmable logic device decompresses the first image data according to a decompression algorithm corresponding to a preset compression algorithm to obtain second image data. It should be noted that, the image data is compressed according to a compression algorithm and decompressed according to a decompression algorithm, which is different according to different specifically adopted algorithms, and detailed description is not given in this embodiment.
Step S30, transmitting the second image data to the display screen, so that the display screen displays the second image data.
After the programmable logic device obtains the second image data, the second image data can be transmitted to the display screen through the display interface. And the display screen displays the second image data after receiving the second image data.
In an embodiment, after the graphics processing unit obtains the first image data by compression, the graphics processing unit may first cache the first image data in a frame buffer in the graphics processing unit according to a display timing sequence of the display screen, and then obtain the first image data from the frame buffer according to the display timing sequence of the display screen and output the first image data to the programmable logic device, and the programmable logic device directly outputs the first image data to the display screen for display after receiving and decompressing the second image data, that is, timing synchronization between the graphics processing unit and the display screen is performed by the graphics processing unit. In other embodiments, timing synchronization of the GPU and the display screen can also be performed by a programmable logic device. And is not limited in this embodiment.
In an embodiment, if the data format of the decompressed second image data is not the frame format of the display screen, the programmable logic device may convert the data format of the second image data into the frame format of the display screen, and then transmit the converted data format to the display screen for display. In another embodiment, the second image data may be transmitted to the display panel by the programmable logic device, and the data format of the second image data may be converted into the frame format of the display panel by a driver IC (integrated circuit) of the display panel and then displayed.
In this embodiment, a programmable logic device is provided, which is bridged between a graphics processing unit of the AR device and a display screen through a display interface, the graphics processing unit compresses original image data according to a preset compression algorithm to obtain first image data and transmits the first image data to the programmable logic device, the programmable logic device receives the first image data, decompresses the first image data according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data, and outputs the second image data to the display screen for display. The first image data output by the graphic processing unit is obtained by compression, the data volume is smaller than that of original image data, so that the data transmission pressure of the graphic processing unit is reduced, the programmable logic device is used as a bridging component for decompression, the decompressed image data is output to a display screen for display, and the image display effect of the AR equipment is ensured.
Further, a second embodiment of the image data transmission method of the present invention is proposed based on the above-described first embodiment, and in this embodiment, the step S10 includes:
step S101, receiving the first image data encapsulated according to a first encapsulation method transmitted by the graphics processing unit.
Step S102, analyzing the received first image data.
The graphics processing unit packages and compresses the original image data according to a first packaging mode to obtain first image data, the first image data can be packaged according to an interface protocol corresponding to the display interface, and the compressed first image data is output to the programmable logic device through the display interface. The specific encapsulation of the first encapsulation mode is directly encapsulated according to the original image data. After receiving the first image data, analyzing the first image data to acquire accurate first image data.
Further, in an embodiment, a second example of the image data transmission method of the present invention is provided, and in this example, the step S20 includes:
step S201, caching the first image data to a buffer of the programmable logic device according to the display time sequence of the display screen;
in this embodiment, the timing synchronization between the gpu and the display screen can also be performed by a programmable logic device. Specifically, after the graphics processing unit obtains first image data after packaging and compressing, the first image data is output to the programmable logic device; the programmable logic device is provided with a buffer, and after the first image data is received, the first image data is cached to the buffer of the programmable logic device according to the display time sequence of the display screen. It should be noted that the display timing may be represented by a display sequence and a frequency of the display screen for the frame image, and the position of the first image data stored in the buffer may be determined according to the programmable logic device of the display timing, and the display timings of the display screens of different AR devices are different, so that the specific process of buffering the first image data into the buffer according to the display timing is also different. For example, assuming that the display timing of the display screen is to display the frame image for the left eye when a vertical synchronization signal arrives, the frame image for the right eye is displayed at a time T/2 after the vertical synchronization signal, and T is a time interval between two vertical synchronization signals, the programmable logic device may buffer the latest first image data for the right eye in the right-eye data buffer in the buffer when a vertical synchronization signal arrives, and display the latest first image data for the left eye in the left-eye data buffer in the buffer at a time T/2 after the vertical synchronization signal.
Step S202, decompressing the first image data in the buffer according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data;
after the first image data is cached in the buffer by the programmable logic device, the first image data in the buffer is decompressed according to a decompression algorithm corresponding to a preset compression algorithm, and the decompressed second image data is still stored in the buffer.
Further, in an embodiment, the step S30 includes:
step S302, converting the second image data according to the frame format of the display screen.
If the data format of the second image data obtained by the decompression of the programmable logic device is not the frame format of the display screen, the data format of the second image data can be converted into the frame format of the display screen and then transmitted to the display screen for display. Further, in an embodiment, the programmable logic device may also convert the data format of the second image data into a frame format of the display screen, and then encapsulate the data format according to an interface protocol and transmit the encapsulated data to the display screen. The frame Format of the display screen may be a Planar Format (Planar Format), where R of all pixels is stored continuously, G of all pixels is stored, and then B of all pixels is stored.
Step S302, the converted second image data is packaged according to a second packaging mode corresponding to an interface protocol corresponding to the display screen and then transmitted to the display screen for display by the display screen.
After the programmable logic device decompresses to obtain the second image data, the programmable logic device may first convert the second image data according to the frame format of the display screen, and then encapsulate the converted second image data in a second encapsulation manner, where the second encapsulation manner may be the same as or different from the first encapsulation manner. In this embodiment, the second encapsulation method is different from the first encapsulation method, and specifically, after the converted second image data is encapsulated according to rows, each row may be output to a display screen to display the second image data. And after receiving the encapsulated second image data, the display screen analyzes and displays the second image data according to the interface protocol corresponding to the display screen. It should be noted that, if the display interface used between the graphic processing unit and the programmable logic device is different from the display interface used between the programmable logic device and the display screen, the interface protocol used by the graphic processing unit and the programmable logic device to package and analyze the first image data is also different from the interface protocol used by the programmable logic device and the display screen to package and analyze the second image data.
Further, in an embodiment, the step S30 includes:
and step S303, acquiring the second image data from the buffer according to the display time sequence, and transmitting the second image data to the display screen.
After the programmable logic device obtains the second image data, the second image data can be obtained from the buffer according to the display time sequence of the display screen and transmitted to the display screen, and the display time sequences of the display screens of different AR devices are different, so that the specific processes of obtaining the second image data from the buffer and transmitting the second image data to the display screen according to the display time sequences are different. For example, assuming that the display timing of the display screen is to display the frame image of the left eye when a vertical synchronization signal arrives, the frame image of the right eye is displayed at a time T/2 after the vertical synchronization signal, and T is a time interval between two vertical synchronization signals, the programmable logic device may acquire the latest second image data of the left eye from the left eye buffer of the buffer to transmit to the display screen when a vertical synchronization signal arrives, and acquire the latest second image data of the right eye from the right eye buffer of the buffer to transmit to the display screen at a time T/2 after the vertical synchronization signal.
Further, in an embodiment, the preset Compression algorithm may adopt a single-channel Compression ratio 2:1 DSC (Display Stream Compression) Compression algorithm, which is a visually lossless Display Stream Compression algorithm. The display resolution and the refresh rate of the AR equipment are gradually improved, under the condition that the existing graphic processing unit and the display screen are not matched, the display screen of the embodiment is an LCOS (liquid Crystal on silicon) screen, by means of a hardware programmable logic technology, a single-channel DSC (dynamic stability control) 2:1 visual lossless compression technology corresponding to the LCOS screen is adopted, the AR equipment can bear high resolution and high frame rate visual experience, and the display effect and the smoothness of the AR equipment are greatly improved.
In addition, an embodiment of the present invention further provides an image data transmission apparatus, where the image data transmission apparatus is disposed in a programmable logic device, and the programmable logic device is bridged between a graphics processing unit and a display screen of an AR device through a display interface, and with reference to fig. 2, the image data transmission apparatus includes:
a receiving module 10, configured to receive first image data transmitted by the graphics processing unit, where the first image data is obtained by the graphics processing unit compressing original image data according to a preset compression algorithm;
the decompression module 20 is configured to decompress the first image data according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data;
and the output module 30 is configured to transmit the second image data to the display screen, so that the display screen displays the second image data.
Further, the receiving module 10 includes:
the receiving unit is used for receiving the first image data which is transmitted by the graphic processing unit and packaged according to a first packaging mode;
and the analysis unit is used for analyzing the received first image data.
Further, the decompression module 20 includes:
the buffer unit is used for buffering the first image data to a buffer of the programmable logic device according to the display time sequence of the display screen;
and the decompression unit is used for decompressing the first image data in the buffer according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data.
Further, the output module 30 includes:
the conversion unit is used for converting the second image data according to the frame format of the display screen;
and the output unit is used for packaging the converted second image data according to a second packaging mode corresponding to the interface protocol corresponding to the display screen and then transmitting the packaged second image data to the display screen for display by the display screen.
Further, the preset compression algorithm is a DSC compression algorithm with a single-channel compression rate of 2: 1.
The specific implementation of the image data transmission device of the present invention is basically the same as the embodiments of the image data transmission method, and is not described herein again.
In addition, an embodiment of the present invention further provides an image data transmission system, as shown in fig. 3, where the image data transmission system includes a graphics processing unit and a display screen of an AR device, and further includes a programmable logic device bridged between the graphics processing unit and the display screen through a display interface, and the programmable logic device is configured to implement the following steps:
receiving first image data transmitted by the graphics processing unit, wherein the first image data is obtained by the graphics processing unit compressing original image data according to a preset compression algorithm;
decompressing the first image data according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data;
and transmitting the second image data to the display screen so that the display screen can display the second image data.
Further, the step of receiving the first image data transmitted by the graphics processing unit comprises:
receiving the first image data which is transmitted by the graphic processing unit and packaged according to a first packaging mode;
the received first image data is parsed.
Further, the step of decompressing the first image data according to the decompression algorithm corresponding to the preset compression algorithm to obtain the second image data includes:
caching the first image data to a buffer of the programmable logic device according to the display time sequence of the display screen;
and decompressing the first image data in the buffer according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data.
Further, the step of transmitting the second image data to the display screen for the display screen to display the second image data includes:
converting the second image data according to the frame format of the display screen;
and packaging the converted second image data according to a second packaging mode corresponding to an interface protocol corresponding to the display screen, and transmitting the packaged second image data to the display screen for display by the display screen.
Further, the preset compression algorithm is a DSC compression algorithm with a single-channel compression rate of 2: 1.
The specific implementation of the image data transmission system of the present invention is basically the same as the embodiments of the image data transmission method, and is not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (8)
1. An image data transmission method is applied to a programmable logic device, the programmable logic device is bridged between a graphic processing unit and a display screen of AR equipment through a display interface, and the image data transmission method comprises the following steps:
receiving first image data transmitted by the graphics processing unit, wherein the first image data is obtained by the graphics processing unit compressing original image data according to a preset compression algorithm;
decompressing the first image data according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data;
and transmitting the second image data to the display screen so that the display screen can display the second image data.
2. The image data transmission method according to claim 1, wherein the step of receiving the first image data transmitted by the graphic processing unit includes:
receiving the first image data which is transmitted by the graphic processing unit and packaged according to a first packaging mode;
the received first image data is parsed.
3. The image data transmission method according to claim 1, wherein the step of decompressing the first image data according to the decompression algorithm corresponding to the preset compression algorithm to obtain the second image data comprises:
caching the first image data to a buffer of the programmable logic device according to the display time sequence of the display screen;
and decompressing the first image data in the buffer according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data.
4. The image data transmission method according to claim 1, wherein the step of transmitting the second image data to the display screen for the display screen to display the second image data comprises:
converting the second image data according to the frame format of the display screen;
and packaging the converted second image data according to a second packaging mode corresponding to an interface protocol corresponding to the display screen, and transmitting the packaged second image data to the display screen for display by the display screen.
5. The image data transmission method according to claim 1, wherein the preset compression algorithm is a single-channel compression ratio 2:1 DSC compression algorithm.
6. An image data transmission device, wherein the image data transmission device is disposed in a programmable logic device, the programmable logic device is bridged between a graphic processing unit and a display screen of an AR device through a display interface, the image data transmission device comprises:
the receiving module is used for receiving first image data transmitted by the graphics processing unit, wherein the first image data is obtained by compressing original image data by the graphics processing unit according to a preset compression algorithm;
the decompression module is used for decompressing the first image data according to a decompression algorithm corresponding to the preset compression algorithm to obtain second image data;
and the output module is used for transmitting the second image data to the display screen so that the display screen can display the second image data.
7. An image data transmission system, characterized in that the image data transmission system comprises a graphics processing unit and a display screen of an AR device, and further comprises a programmable logic device bridged between the graphics processing unit and the display screen through a display interface, the programmable logic device being configured to implement the steps of the image data transmission method according to any one of claims 1 to 5.
8. The image data transmission system of claim 7, wherein the display screen is an LCOS display screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111039294.5A CN113852826B (en) | 2021-09-06 | Image data transmission method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111039294.5A CN113852826B (en) | 2021-09-06 | Image data transmission method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113852826A true CN113852826A (en) | 2021-12-28 |
| CN113852826B CN113852826B (en) | 2024-07-02 |
Family
ID=
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103795953A (en) * | 2013-12-27 | 2014-05-14 | 天津三星电子有限公司 | Display interface card and display system |
| CN104503739A (en) * | 2014-12-02 | 2015-04-08 | 苏州长风航空电子有限公司 | Airborne display graphic generation device and generation method |
| CN106603953A (en) * | 2016-09-28 | 2017-04-26 | 杭州青杉奇勋科技有限公司 | Video display method and video display system of converting HDMI interface into MIPI interface |
| CN108307128A (en) * | 2018-03-21 | 2018-07-20 | 中国航空工业集团公司洛阳电光设备研究所 | A kind of video display processing device |
| CN108696727A (en) * | 2018-08-10 | 2018-10-23 | 杭州言曼科技有限公司 | Industrial camera |
| US20180336659A1 (en) * | 2017-05-16 | 2018-11-22 | Qualcomm Incorporated | Systems and methods for reducing memory bandwidth via multiview compression/decompression |
| CN109426473A (en) * | 2017-08-25 | 2019-03-05 | 微软技术许可有限责任公司 | Wireless programmable medium processing system |
| CN110221802A (en) * | 2019-06-12 | 2019-09-10 | 京东方科技集团股份有限公司 | Display device and driving method thereof |
| CN112367509A (en) * | 2020-11-10 | 2021-02-12 | 北京计算机技术及应用研究所 | Method for realizing domestic four-way super-definition image comprehensive display device |
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103795953A (en) * | 2013-12-27 | 2014-05-14 | 天津三星电子有限公司 | Display interface card and display system |
| CN104503739A (en) * | 2014-12-02 | 2015-04-08 | 苏州长风航空电子有限公司 | Airborne display graphic generation device and generation method |
| CN106603953A (en) * | 2016-09-28 | 2017-04-26 | 杭州青杉奇勋科技有限公司 | Video display method and video display system of converting HDMI interface into MIPI interface |
| US20180336659A1 (en) * | 2017-05-16 | 2018-11-22 | Qualcomm Incorporated | Systems and methods for reducing memory bandwidth via multiview compression/decompression |
| CN109426473A (en) * | 2017-08-25 | 2019-03-05 | 微软技术许可有限责任公司 | Wireless programmable medium processing system |
| CN108307128A (en) * | 2018-03-21 | 2018-07-20 | 中国航空工业集团公司洛阳电光设备研究所 | A kind of video display processing device |
| CN108696727A (en) * | 2018-08-10 | 2018-10-23 | 杭州言曼科技有限公司 | Industrial camera |
| CN110221802A (en) * | 2019-06-12 | 2019-09-10 | 京东方科技集团股份有限公司 | Display device and driving method thereof |
| CN112367509A (en) * | 2020-11-10 | 2021-02-12 | 北京计算机技术及应用研究所 | Method for realizing domestic four-way super-definition image comprehensive display device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI529656B (en) | Image display system and image processing method | |
| US11217201B2 (en) | Video frame interfaces for logically-defined pixels | |
| US11106422B2 (en) | Method for processing display data | |
| JP4116006B2 (en) | Screen transfer device, screen transfer system, screen transfer method, and program | |
| CN102857738A (en) | Multi-screen control image display system, multi-screen control method and multi-screen control device | |
| KR20170033806A (en) | Device for av play, method and storage medium for data display | |
| JP4427599B1 (en) | Image processing apparatus, receiving apparatus, and display apparatus | |
| CN102611869A (en) | Output-oriented network transmission technique of multi-screen splicing system | |
| CN103165104A (en) | Video signal synchronously displaying method of spliced screen | |
| CN102170579B (en) | Graphic image processing system, method and chip | |
| CN111625211B (en) | Screen projection method and device, android device and display device | |
| US20210183331A1 (en) | Display device and driving method thereof | |
| US20200029068A1 (en) | Method and apparatus for dual-screen display, video glasses, chip and processor | |
| CN118044179A (en) | Image processing apparatus and method thereof | |
| CN113852826B (en) | Image data transmission method, device and system | |
| CN113852826A (en) | Image data transmission method, device and system | |
| CN104717397A (en) | Image data processing method and electronic device | |
| CN116248889A (en) | Image encoding and decoding method and device and electronic equipment | |
| EP2693426A1 (en) | Display apparatus, image post-processing apparatus and method for image post-processing of contents | |
| WO2018182447A1 (en) | Video signal processing method | |
| CN108243293B (en) | Image display method and system based on virtual reality equipment | |
| US9361860B2 (en) | Display apparatus, image post-processing apparatus and method for image post-processing of contents | |
| JP4960433B2 (en) | Image processing apparatus, receiving apparatus, and display apparatus | |
| CN115988270A (en) | Method, device, storage medium and system for video OSD self-adapting image resolution | |
| CN116774957A (en) | Multi-screen display method and device, terminal equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221116 Address after: 266104 No. 500, Songling Road, Laoshan District, Qingdao, Shandong Applicant after: GOERTEK TECHNOLOGY Co.,Ltd. Address before: 261031 workshop 1, phase III, Geer Photoelectric Industrial Park, 3999 Huixian Road, Yongchun community, Qingchi street, high tech Zone, Weifang City, Shandong Province Applicant before: GoerTek Optical Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant |