CN118173042A - Light domain controller framework capable of realizing real-time display and realizing method - Google Patents

Abstract

The invention provides a lamplight domain controller framework capable of realizing real-time display and a realization method thereof, wherein a system-on-chip SOC (system on a chip) level chip is used for carrying a corresponding digital storage chip DDR (double data rate) and an embedded storage chip EMMC (direct memory cell), so that real-time video transmission and display of micro LED (light emitting diode) or digital micromirror device DMD (digital micromirror device) modules are realized; the system on chip SOC comprises a processor MAC, a graphics processor GPU and an image processor; the MAC is a software protocol for establishing Ethernet communication; the GPU is used for integrating and calculating the input data information; the Image process is used for processing pictures in the video; the components are connected with each other. The invention can realize high-definition real-time display without delay and can realize high-efficiency man-machine interaction display function.

Description

Light domain controller framework capable of realizing real-time display and realizing method

Technical Field

The invention relates to the technical field of SOC systems, in particular to a lamplight domain controller framework capable of realizing real-time display and an implementation method.

Background

With the development of automobile intellectualization, the requirements for intelligent interaction are increased year by year, the defects of lower pixels exist in pictures displayed in the interaction process in the past, people pursue beauty and definition instinctively, and how to realize real-time high-definition display is an urgent need of the market. High definition pictures will necessarily be of larger data size and have higher requirements on bandwidth, which is not economical if the solution is to update bandwidth.

Patent document CN115384394a (application number: CN 202211138146.3) discloses a control system, a domain controller, a method and a storage medium of an automobile light system, wherein the control system of the automobile light system comprises: the system comprises an automobile lamplight system, a control system and a control system, wherein the automobile lamplight system comprises one or more lamplight modules and lamplight controllers corresponding to the lamplight modules; the input assembly is used for receiving control instructions of one or more light modules in the automobile light system input by a user; and the domain controller is used for receiving the control instruction of the input assembly and forwarding the control instruction to the corresponding light controllers, so that the light controllers of one or more light modules light up or turn off the corresponding light modules. However, this patent does not fully solve the above technical problems.

Disclosure of Invention

Aiming at the defects in the prior art, the invention aims to provide a lamplight domain controller framework capable of realizing real-time display and an implementation method.

According to the lamplight domain controller framework capable of realizing real-time display, the system-on-chip SOC level chip is used, and corresponding digital storage chips DDR and embedded storage chips EMMC are carried, so that real-time video transmission and display of micro LED or digital micromirror device DMD modules are realized;

The system on chip SOC comprises a processor MAC, a graphics processor GPU and an image processor; the MAC, the GPU and the image process are all connected with the SOC;

the MAC is a software protocol for establishing Ethernet communication;

The GPU is used for integrating and calculating the input data information;

the Image process is used for processing pictures in the video;

The SOC, the DDR and the EMMC are connected with each other.

Preferably, the system-on-chip SOC comprises:

Data transmission is carried out through the Ethernet, the data is a compressed packet of video and audio, the format of the compressed packet is MP4 video or audio, the compressed format of the compressed packet is H264, and the communication protocol of the Ethernet comprises RGMII, RMII and MII;

the power supply module KL30 is connected with the SOC system and supplies power to the whole SOC system;

The control signal CAN FD of the whole lamp is connected with the SOC system and is linked with CAN signals in the lamp light domain controller framework;

the watchdog WDT is connected with the SOC system and is responsible for safety monitoring of the whole system;

The hard disk EMMC and the memory LDDR are connected with the SOC system and used for storing audio and video;

RGB88, a protocol for video parallel transmission;

The Serializer is connected with the SOC system to realize parallel-serial connection;

GMSL and FPD Link, serial protocols;

LVDS is a vehicle-specification-level video parallel transmission protocol.

According to the method for realizing the light domain controller framework capable of realizing real-time display, the following steps are executed: downloading video and picture files from the cloud, performing Ethernet decoding processing through a data link layer of the Ethernet, performing decoding and decompression processing by using a video processing module in the SOC, performing image processing by using an image sensing module in the SOC, converting the generated serial data into parallel data, and transmitting the parallel data to a corresponding module.

Preferably, the image processing includes: filling a pattern and carrying out gridding treatment; texturing a pattern; coloring the picture; and (5) performing three-dimensional geometric transformation on the picture.

Preferably, the KL30 supplies power to the SOC system, when receiving video or audio transmitted by the upper system, the video or audio is an h.264 compressed packet in MP4 format, and after receiving the compressed packet, the KL30 transmits data into the system via ethernet, and the data is received via the ethernet transceiver PHY.

Preferably, CAN communication is provided for a control SOC system of the whole vehicle level, and the CAN communication of the SOC system is selected according to actual needs or the CAN communication in a lamp light domain controller framework is selected; meanwhile, safety of the SOC system is monitored in real time through the watchdog WDT.

Preferably, the processed data is required to be selected according to actual needs by a user through a parallel protocol, namely RGB88 or LVDS, then the data is updated from parallel to serial through a serializer, and finally the data is transmitted to a display module of the terminal through a serial protocol GMSL or FPD Link.

Preferably, the SOC system interacts with the lamp light domain controller framework through an SPI protocol, the MCU displays the image processed by the mapping algorithm through the high-definition rendering algorithm, the image is transmitted to the inside of the SOC through QSPI to be converted in data format and then is output to the module, and the image and the module cooperate to realize real-time display of the lamp light system of the whole vehicle.

Preferably, the low pixels are corrected to the desired format picture by stretching and filling of the pixels.

Preferably, the compression and conversion are automatically performed by the codec processing module of the video processing unit, so as to adapt to the current bandwidth requirement.

Compared with the prior art, the invention has the following beneficial effects:

(1) The system-on-chip SOC chip is used for carrying corresponding digital memory chips DDR, embedded memory chips EMMC and the like, so that real-time video real-time transmission and display of micro LEDs or digital micromirror device DMD modules are realized, time-delay-free high-definition real-time display can be realized, and compared with the prior scheme, the system-on-chip SOC chip is capable of realizing an efficient human-computer interaction display function;

(2) By adopting the SOC system, the picture display of higher pixels can be realized; the decompression conversion operation of the compressed video which is put down by the whole vehicle end can be realized, so that the current bandwidth requirement is met; the system of the next stage is provided with a plurality of serial information choices, and the system is provided with greater flexibility through GMSL or FPD Llink, so that the system is more convenient and has changeable actual situation needs; by adopting the SOC system, audio processing and virtual acceleration can be realized; under the condition of maintaining the bandwidth unchanged, the efficient transmission of the data is realized through the process of compressing and decompressing the video.

Drawings

Other features, objects and advantages of the present invention will become more apparent upon reading of the detailed description of non-limiting embodiments, given with reference to the accompanying drawings in which:

FIG. 1 is a schematic diagram of a light domain controller architecture capable of implementing real-time display in accordance with the present invention.

Detailed Description

The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the present invention, but are not intended to limit the invention in any way. It should be noted that variations and modifications could be made by those skilled in the art without departing from the inventive concept. These are all within the scope of the present invention.

Examples

As shown in fig. 1, the present invention provides a light domain controller architecture capable of realizing real-time display, comprising:

When the video pixels transmitted by the upper system are very high, such as 130 ten thousand pixels, the SOC system performs data transmission through the ethernet, the data is a compressed packet of video and audio, the format of the compressed packet is MP4 video or audio, the compressed format is H264, the PHY is an ethernet transceiver, and RGMII, RMII, MII is a communication protocol of the ethernet. Ethernet is a common way of high-definition signal transmission in the whole vehicle industry.

The KL30 power supply module supplies power to the whole SOC system.

The CAN FD is a control signal of the whole lamp, namely, is linked with a CAN signal in the lamp light domain controller framework, and the control of the whole lamp CAN be realized through the lamp light domain controller framework or CAN be controlled through a CAN in the SOC. CAN be either MCU (processor) or SOC.

WDT is a watchdog responsible for security monitoring of the entire system.

SOC is composed of three important components, MAC, GPU and image process. The MAC is a software protocol for establishing Ethernet communication; the GPU performs integration calculation on the input data information; the Image process specifically processes the pictures in the video, so that the pictures in any format and any state can be ensured to be processed into the pictures meeting the output requirement of the system no matter what the picture input by the input end is.

First, the vehicle owner downloads video and picture files with any format and any resolution from the cloud. Second, the decoding process of the ethernet is performed through the data link layer of the ethernet. Thirdly, the video processing module in the SOC is used for decoding and decompressing MPEG4 (video format) and H.264 (compression format). And fourthly, performing image processing including resolution processing, color space transformation, trapezoidal correction processing, an edge fusion algorithm, a track intelligent fusion algorithm, a lane tracking prediction algorithm, a light type laminating algorithm, an intelligent anti-shake algorithm, a light type online anti-distortion algorithm and a light type intelligent control algorithm by utilizing an image sensing module in the SOC. Fifthly, converting the serial data generated in the last step into parallel data, and sending the parallel data to the corresponding module.

First, the pattern is filled and the pattern is first rasterized. Second, texturing of the graphics. Third, the picture is subjected to coloring treatment, and fourth, the picture is subjected to three-dimensional geometric transformation such as translation, scaling and the like.

And processing by using a resolution adjustment module of the SOC part. The SOC can sequentially interact with the lamp light domain controller framework through an SPI protocol.

The SOC system performs system calculation processing on the video and audio data input from the upper stage, and decompresses the video and audio data.

The storage size of the EMMC, namely the hard disk, can be adjusted according to the actual system requirement, and the invention takes 32GB as an example. Only to EMMC.

LDDR4 is a memory, the storage size of which can be adjusted according to the actual system requirement, and the invention takes 4GB as an example.

The storage locations of the audio and video are EMMC.

RGB88 is a protocol for video parallel transmission.

Seriizer is a Serializer that can be implemented as a parallel-to-serial. The method comprises the following steps: and converting the serial data with lower bandwidth requirements into parallel data with higher bandwidth requirements for transmission.

GMSL is a serial protocol.

LVDS is a vehicle-specification-level video parallel transmission protocol, RGB88 or LVDS can be selected according to actual transmission requirements, RGB88 and LVDS are formats of pictures, and the terminals transmit the processed pictures to a final display module. And the picture processing module is the forefront end of the whole system and is used for processing pictures.

The FPD Link is another serial protocol, which may be selected according to the actual transmission requirements or GMSL protocol.

The above is the output part of the SOC system, which releases the processed video to the display module of the terminal.

The present embodiment works by the following steps:

The KL30 supplies power to the SOC system, and when the video or the audio transmitted by the upper system is received, the video or the audio is an H.264 compressed packet in MP4 format. After receiving the compressed packet, the data is transmitted into the system through the Ethernet, and the data is received through the PHY Ethernet transceiver. The CAN communication is also provided for the control SOC system of the whole vehicle level, namely the CAN communication of the SOC system CAN be selected according to actual needs, and the CAN communication in the lamp light domain controller framework CAN also be selected. Meanwhile, the system has WDT, namely a watchdog, and the safety of the system is monitored in real time.

Data is transmitted into the SOC system to process and calculate the data, and the work of the part is realized through the MAC and the GPU. Meanwhile, in order to ensure that the data can be applied to the next stage, the image processing is needed to process the picture, and the processing of resolution processing, color space conversion, trapezoidal correction processing, edge fusion algorithm, track intelligent fusion algorithm, lane tracking prediction algorithm, light type laminating algorithm, intelligent anti-shake algorithm, light type online anti-distortion algorithm and light type intelligent control algorithm are carried out. For example, the client downloads 1920×1200 BMP format pictures from the cloud, and the SOC can adjust the video to the pictures with the corresponding module resolution by using the internal resolution adjustment module.

After the data is processed, the output part of the data is next.

The system provides a hard disk EMMC and a memory LDDR, the specific storage size of which can be taken as an example of 32GB and 4GB according to the actual project requirements.

The processed data needs to pass through a parallel protocol, namely RGB88 or LVDS, the system provides two processing protocols, and a user can select according to the actual needs. The data will then pass through a serializer, updating it from parallel to serial. And finally transmitted to a display module of the terminal, such as a module of a headlight, through a serial protocol GMSL or FPD Link.

The SOC interacts with the lamp light domain controller framework through the SPI, the MCU displays the image processed by the mapping algorithm through the high-definition rendering algorithm, the image is transmitted to the inside of the SOC through QSPI to be converted into a data format and then is output to the module, and the image and the module cooperate to realize real-time display of a light system of the whole vehicle.

The low pixels are pictures that are corrected to the desired format by stretching and filling of the pixels.

The encoding and decoding processing module of the video processing unit automatically compresses and converts the video to adapt to the current bandwidth requirement.

By employing an SOC system, audio processing and virtual acceleration, such as accelerating the processing and feedback time of the ADB, can be achieved. For example, when the terminal user uses the automobile, the audio frequency that wants the automobile end to control the large screen to display, the music that responds in the sound box, and the audio frequency picture that the automobile end module is showing outward keep the same with the automobile end to control the large screen, can carry out further expansion processing through the bridging processing technology of audio and video.

In the description of the present application, it should be understood that the terms "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, are merely for convenience in describing the present application and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present application.

Those skilled in the art will appreciate that the systems, apparatus, and their respective modules provided herein may be implemented entirely by logic programming of method steps such that the systems, apparatus, and their respective modules are implemented as logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers, etc., in addition to the systems, apparatus, and their respective modules being implemented as pure computer readable program code. Therefore, the system, the apparatus, and the respective modules thereof provided by the present invention may be regarded as one hardware component, and the modules included therein for implementing various programs may also be regarded as structures within the hardware component; modules for implementing various functions may also be regarded as being either software programs for implementing the methods or structures within hardware components.

The foregoing describes specific embodiments of the present application. It is to be understood that the application is not limited to the particular embodiments described above, and that various changes or modifications may be made by those skilled in the art within the scope of the appended claims without affecting the spirit of the application. The embodiments of the application and the features of the embodiments may be combined with each other arbitrarily without conflict.

Claims (10)

1. The light domain controller framework capable of realizing real-time display is characterized in that a system-on-chip (SOC) level chip is used, a corresponding digital storage chip DDR and an embedded storage chip EMMC are carried, and real-time video transmission and display of micro LED or digital micromirror device DMD modules are realized;

The system on chip SOC comprises a processor MAC, a graphics processor GPU and an image processor; the MAC, the GPU and the image process are all connected with the SOC;

the MAC is a software protocol for establishing Ethernet communication;

The GPU is used for integrating and calculating the input data information;

the Image process is used for processing pictures in the video;

The SOC, the DDR and the EMMC are connected with each other.

2. The light domain controller architecture capable of real-time display of claim 1, wherein the system-on-chip SOC comprises:

Data transmission is carried out through the Ethernet, the data is a compressed packet of video and audio, the format of the compressed packet is MP4 video or audio, the compressed format of the compressed packet is H264, and the communication protocol of the Ethernet comprises RGMII, RMII and MII;

the power supply module KL30 is connected with the SOC system and supplies power to the whole SOC system;

The control signal CAN FD of the whole lamp is connected with the SOC system and is linked with CAN signals in the lamp light domain controller framework;

the watchdog WDT is connected with the SOC system and is responsible for safety monitoring of the whole system;

The hard disk EMMC and the memory LDDR are connected with the SOC system and used for storing audio and video;

RGB88, a protocol for video parallel transmission;

The Serializer is connected with the SOC system to realize parallel-serial connection;

GMSL and FPD Link, serial protocols;

LVDS is a vehicle-specification-level video parallel transmission protocol.

3. A method for realizing a light domain controller framework capable of realizing real-time display, characterized in that the light domain controller framework capable of realizing real-time display as claimed in claim 1 or 2 is adopted to execute the following steps: downloading video and picture files from the cloud, performing Ethernet decoding processing through a data link layer of the Ethernet, performing decoding and decompression processing by using a video processing module in the SOC, performing image processing by using an image sensing module in the SOC, converting the generated serial data into parallel data, and transmitting the parallel data to a corresponding module.

4. A method for implementing a light domain controller architecture capable of implementing a real-time display as defined in claim 3, wherein the image processing comprises: filling a pattern and carrying out gridding treatment; texturing a pattern; coloring the picture; and (5) performing three-dimensional geometric transformation on the picture.

5. The method for implementing a light domain controller architecture capable of implementing real-time display according to claim 3, wherein KL30 supplies power to the SOC system, and when receiving video or audio transmitted from a superior system, the video or audio is an h.264 compressed packet in MP4 format, and after receiving the compressed packet, data is transmitted into the system via ethernet, and data reception is completed via ethernet transceiver PHY.

6. The method for realizing the light domain controller framework capable of realizing real-time display according to claim 3, wherein CAN communication is provided for a control SOC system of a whole vehicle level, the CAN communication of the SOC system is selected according to actual needs, or the CAN communication in the light domain controller framework is selected; meanwhile, safety of the SOC system is monitored in real time through the watchdog WDT.

7. A method for implementing a light domain controller architecture capable of implementing real-time display according to claim 3, wherein the processed data is required to be selected by a user according to actual needs through a parallel protocol, namely RGB88 or LVDS, then the data is updated from parallel to serial through a serializer, and finally the data is transmitted to a display module of a terminal through a serial protocol GMSL or FPD Link.

8. The method for realizing the light domain controller framework capable of realizing real-time display according to claim 3, wherein the SOC system interacts with the light domain controller framework through an SPI protocol, the MCU transmits the image processed by the display mapping algorithm of the high definition rendering algorithm to the inside of the SOC through QSPI for data format conversion and then outputs the image to the module, and the two cooperate together to realize real-time display of the light system of the whole vehicle.

9. A method for implementing a light domain controller architecture capable of implementing a real-time display according to claim 3, wherein the low pixels are modified to a desired format picture by stretching and filling the pixels.

10. The method for implementing a real-time display light domain controller architecture according to claim 3, wherein the encoding and decoding processing modules of the video processing unit automatically compress and convert the video data to adapt to the current bandwidth requirements.