CN113923080A - Video signal monitoring platform based on vehicle-mounted Ethernet and data analysis method - Google Patents
Video signal monitoring platform based on vehicle-mounted Ethernet and data analysis method Download PDFInfo
- Publication number
- CN113923080A CN113923080A CN202111182926.3A CN202111182926A CN113923080A CN 113923080 A CN113923080 A CN 113923080A CN 202111182926 A CN202111182926 A CN 202111182926A CN 113923080 A CN113923080 A CN 113923080A
- Authority
- CN
- China
- Prior art keywords
- data
- avb
- protocol
- switch
- ethernet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000012544 monitoring process Methods 0.000 title claims abstract description 17
- 238000007405 data analysis Methods 0.000 title claims abstract description 15
- 238000004458 analytical method Methods 0.000 claims abstract description 35
- 102100034112 Alkyldihydroxyacetonephosphate synthase, peroxisomal Human genes 0.000 claims abstract description 15
- 101000799143 Homo sapiens Alkyldihydroxyacetonephosphate synthase, peroxisomal Proteins 0.000 claims abstract description 15
- 238000000848 angular dependent Auger electron spectroscopy Methods 0.000 claims abstract description 15
- 230000008676 import Effects 0.000 claims abstract description 11
- 230000000694 effects Effects 0.000 claims abstract description 10
- 238000013515 script Methods 0.000 claims description 66
- 230000006870 function Effects 0.000 claims description 50
- 230000008569 process Effects 0.000 claims description 19
- 238000004422 calculation algorithm Methods 0.000 claims description 17
- 230000005540 biological transmission Effects 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 11
- 238000012360 testing method Methods 0.000 claims description 11
- 230000003044 adaptive effect Effects 0.000 claims description 10
- 238000004088 simulation Methods 0.000 claims description 9
- 239000000284 extract Substances 0.000 claims description 8
- 230000001360 synchronised effect Effects 0.000 claims description 8
- 238000011161 development Methods 0.000 claims description 5
- 238000000605 extraction Methods 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000013500 data storage Methods 0.000 claims description 3
- 208000035708 Autosomal dominant striatal neurodegeneration Diseases 0.000 claims 3
- 208000036182 autosomal dominant striatal degeneration Diseases 0.000 claims 3
- 238000013461 design Methods 0.000 abstract description 3
- 238000003058 natural language processing Methods 0.000 description 6
- 238000005457 optimization Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000004927 fusion Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/18—Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Small-Scale Networks (AREA)
Abstract
The invention provides a video signal monitoring platform based on a vehicle-mounted Ethernet and a data analysis method, which are applied to the field of vehicle-mounted gateways; one interface of the Switch is configured to be a mirror image port, and the interface is connected with a PC end through a 100BASE-TX interface or connected with an SOC processor through an SGMII interface at a single time; transmitting the data of the AVB port to the PC end through the Switch, or transmitting the data of the AVB port to the SOC processor through the Switch; the PC end can call preset network data monitoring software to import an AVB protocol analysis plug-in, analyze and apply AVB data, and the SOC processor can analyze functional elements required by applications such as ADAS and the like according to AVB video signals; according to the invention, the Switch relay module is added to be matched with the software and hardware design so as to achieve the relatively simple and stable effect; the invention acquires and analyzes AVB video data by configuring the mirror image port of Switch so as to achieve the effects of low cost and strong universality.
Description
Technical Field
The invention relates to the field of vehicle-mounted gateways, in particular to a video signal monitoring platform based on a vehicle-mounted Ethernet and a data analysis method.
Background
With the increasing requirements of entertainment and safe driving systems in automobiles on bandwidth and real-time performance of networks in automobiles, the vehicle-mounted Ethernet technology is widely applied to automobiles at foreign countries and domestic. Related chip functions are also rapidly developed, a multi-channel PHY transceiver is integrated in a vehicle-mounted Ethernet switch chip RTL9047A released by Realtek corporation, the design of peripheral hardware is reduced, the reliability is improved, and standard AVB protocol clusters such as SRP, FQTSS, gPTP and the like are supported on software.
However, in the prior art, most Switch nodes in the prior art do not support the AVB software protocol, so when a Switch node added with pure hardware is used for monitoring or analysis testing in a system based on AVB video transmission, the video function of the original system is disordered or unsynchronized, and some foreign vehicle-mounted ethernet testing devices supporting the AVB have the disadvantage of being incapable of being implemented in a platform and a product. And the technical scheme is realized based on the FPGA, so that the cost is relatively high and the system is closed.
In view of the above, the present invention provides a video signal monitoring platform based on a vehicle-mounted ethernet and a data analysis method, on the basis of not affecting the original AVB system function, a Switch module relay is added, AVB video data or other SOME/IP-based data is collected by configuring a mirror image port of Switch, and these data can be extracted for secondary development, and can also be connected to a PC for data monitoring through a conventional ethernet interface.
Disclosure of Invention
The invention aims to solve the problems that the video function is disordered or asynchronous and the video function cannot be platformized and commercialized, and provides a video signal monitoring platform based on a vehicle-mounted Ethernet and a data analysis method.
The invention provides a video signal monitoring platform based on a vehicle-mounted Ethernet, which comprises:
the transmission unit is used for configuring a Switch interface as a mirror image port, respectively connecting a PC (personal computer) end, a 100BASE-TX interface and an SOC (system on chip) processor to the Switch interface by the PC end through transmission of an AVB data structure, transmitting an AVB data format to the Switch interface by the 100BASE-TX interface, and calling preset network data monitoring software to import AVB protocol scripts of the PC end and the 100BASE-TX interface into a first protocol script and a second protocol script respectively;
and the extracting unit is used for analyzing the first protocol script and the second protocol script, recording the first protocol script and the second protocol script into the Switch through a PC (personal computer) end and a 100BASE-TX (BASE-Transmit) interface, respectively obtaining first protocol data and second protocol data by the Switch end through a preset algorithm, respectively obtaining first protocol data elements and second protocol data elements, accessing a mirror image port through a preset SOC (System on chip) processor, collecting video data and gateway data, and transmitting all Ethernet frame data including AVB (audio video bus) data to the Switch end back and forth through the SOC processor.
Further, the transmission unit further includes:
the connection subunit is used for configuring the Switch interface as a mirror image port and respectively connecting the PC terminal, the 100BASE-TX interface and the SOC processor at a time;
the transmission subunit is used for transmitting the AVB data structure to the Switch interface through the PC terminal and transmitting the AVB data format to the Switch interface through the 100BASE-TX interface;
and the importing subunit is used for calling preset network data monitoring software to import the AVB protocol scripts of the PC end and the 100BASE-TX interface into a first protocol script and a second protocol script respectively.
Further, the extraction unit further includes:
the receiving and recording subunit is used for analyzing the first protocol script and the second protocol script, receiving and recording the first protocol script and the second protocol script into the Switch through a PC (personal computer) end and a 100BASE-TX (BASE-TX) interface, wherein the first protocol data and the second protocol data are respectively recorded;
the extracting subunit is used for the Switch end to extract data elements from the first protocol data and the second protocol data through a preset algorithm, wherein the data elements are respectively a first protocol data element and a second protocol data element;
and the backflow subunit is used for accessing the mirror image port through a preset SOC processor, acquiring video data and gateway data, and transmitting all Ethernet frame data including AVB data to the Switch end back and forth through the SOC processor.
The invention also provides a video signal data analysis method based on the vehicle-mounted Ethernet, which comprises the following steps:
configuring a Switch interface as a mirror image port, and respectively connecting a PC (personal computer) end, a 100BASE-TX interface and an SOC (system on chip) processor at a single time;
transmitting an AVB data structure to a Switch interface through the PC end, and transmitting an AVB data format to the Switch interface through the 100BASE-TX interface;
calling preset network data monitoring software to import AVB protocol scripts of the PC end and the 100BASE-TX interface into a first protocol script and a second protocol script respectively;
analyzing the first protocol script and the second protocol script, recording the first protocol script and the second protocol script into a Switch through a PC (personal computer) end and a 100BASE-TX (BASE-TX) interface, and respectively acquiring first protocol data and second protocol data;
the Switch end extracts data elements from the first protocol data and the second protocol data through a preset algorithm, wherein the data elements are respectively a first protocol data element and a second protocol data element;
the method comprises the steps of accessing a mirror image port through a preset SOC (system on chip) processor, collecting video data and gateway data, and transmitting all Ethernet frame data including AVB data to a Switch end back and forth through the SOC processor.
Further, before the step of transmitting the AVB data structure to the Switch interface through the PC terminal, the method further includes:
setting and constructing the AVB data of the Ethernet frame according to requirements, wherein the AVB data of the Ethernet frame comprises a field value of the AVB data of the Ethernet frame, a source address of the AVB data of the Ethernet frame and an execution command of the AVB data of the Ethernet frame;
inputting the field value of the built Ethernet frame AVB data to a Switch end to obtain a node of the Ethernet frame AVB data corresponding to the field value of the built Ethernet frame AVB data,
inputting the source address of the built Ethernet AVB data to a Switch end to obtain the MAC address corresponding to the built source address,
and inputting the execution command of the built Ethernet frame AVB data to a Switch end to obtain an operation program of the Ethernet frame AVB data corresponding to the execution command of the built Ethernet frame AVB data.
Further, the step of calling the preset protocol script PC end imported by the network data monitoring software and the 100BASE-TX interface further includes:
the converged Ethernet AVB data storage medium includes data capacity and data bytes, the data capacity and data bytes are packed into an Ethernet AVB data frame block,
converting the Ethernet AVB data frame block into a data format corresponding to a Switch end to obtain imported protocol script data;
and detecting whether the data format of the imported protocol script is matched with the data format of the Switch or not through the preset network data monitoring software.
Further, the step of analyzing the protocol script further comprises:
respectively acquiring source codes of the PC port and the 100BASE-TX interface to obtain a first port source code and a second port source code;
according to the first port source code and the second port source code, performing auxiliary operation through code simulation to perfect the first port source code and the second port source code to obtain a script engine corresponding to a script language corresponding to the first port source code and a script engine corresponding to the second port source code,
and inputting the script language corresponding to the first port source code and the script engine corresponding to the second port source code into the virtual machine of the Switch end for analysis and execution.
Further, before the step of extracting the data elements from the protocol data through the preset algorithm, the method further comprises:
the Switch end is preset with a coding device adaptive to the protocol data and an image processor for the protocol data,
the output end of the coding device adaptive to the protocol data is connected with the input end of the image processor for the protocol data, the input end of the coding device adaptive to the protocol data is connected with the Switch end through a network connecting line,
the Switch end transmits protocol data to coding equipment, and a protocol video stream signal is obtained through an equipment code conversion protocol data structure;
and the Switch end transmission analysis instruction is combined with the protocol video stream signal through coding equipment and input into the image processor, and is decomposed to obtain a protocol video stream digital signal and a protocol video stream analog signal.
Further, after the step of extracting the data elements from the protocol data by the preset algorithm, the method further comprises the following steps:
testing the vehicle-mounted process and the function thereof through the protocol video stream digital signal and the protocol video stream analog signal, wherein the vehicle-mounted process and the function thereof comprise but are not limited to an automatic driving function or an ADAS function;
returning the protocol video stream analog signal to the Switch end, performing data matching operation with the ADAS function to test whether the protocol video stream analog signal and the ADAS function can generate simulation effect to realize linkage,
and returning the protocol video stream digital signal to a PC end, and carrying out data synchronization operation with the automatic driving function to test whether the protocol video stream digital signal and the automatic driving function can realize simulation effect and realize linkage.
Further, the mirror image port is accessed through a preset SOC processor, and the step of collecting video data and gateway data further comprises the following steps:
carrying out secondary development on the video data and the gateway data collected by the mirror image port, wherein the developed video data comprises relevant parameters and states for synchronously displaying videos, the developed gateway data comprises relevant parameters and states recorded for a vehicle-mounted process,
the related parameters and states of the synchronous display video are based on video stream data, an integrated image processing library and are processed through natural language, and the function of automatic driving is achieved;
and realizing the function of ADAS by integrating the relevant parameters and states recorded in the vehicle-mounted process based on video stream data and an image processing library and matching keywords.
The invention provides a video signal monitoring platform based on a vehicle-mounted Ethernet and a data analysis method, which have the following beneficial effects:
1. according to the invention, the Switch relay module is added to be matched with the software and hardware design so as to achieve the relatively simple and stable effect;
2. the invention acquires AVB video data by configuring the mirror image port of Switch to achieve the effects of low cost and strong universality.
Drawings
FIG. 1 is a general block diagram of an embodiment of a video signal monitoring platform based on a vehicle-mounted Ethernet according to the present invention;
FIG. 2 is a flowchart illustrating the overall operation of an embodiment of a video signal data analysis method based on a vehicle-mounted Ethernet according to the present invention;
the implementation, functional features and advantages of the present invention will be further described with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a video signal monitoring platform based on a vehicle ethernet according to an embodiment of the present invention includes:
the transmission unit is used for configuring the Switch interface as a mirror image port, respectively connecting the PC end, the 100BASE-TX interface and the SOC processor at a time, transmitting an AVB data structure to the Switch interface through the PC end, transmitting an AVB data format to the Switch interface through the 100BASE-TX interface, and calling preset network data monitoring software to import AVB protocol scripts of the PC end and the 100BASE-TX interface into a first protocol script and a second protocol script respectively;
and the extracting unit is used for analyzing the first protocol script and the second protocol script, recording the first protocol script and the second protocol script into the Switch through a PC (personal computer) end and a 100BASE-TX (BASE-Transmit) interface, respectively obtaining first protocol data and second protocol data by the Switch end through a preset algorithm, respectively obtaining first protocol data elements and second protocol data elements, accessing a mirror image port through a preset SOC (System on chip) processor, collecting video data and gateway data, and transmitting all Ethernet frame data including AVB (audio video bus) data to the Switch end back and forth through the SOC processor.
In a specific embodiment: the Switch port supports the independent connection of the PC end, the 100BASE-TX interface and the SOC, all the Ethernet frame AVB data are transmitted through the PC end and the 100BASE-TX interface, the Ethernet frame AVB data are secondarily developed through the SOC, for example, related parameters and states of a synchronous display video are displayed, and a specific product is designed by combining other functions; or video stream data based on an AVB protocol is collected, an Opencv and other image processing libraries are integrated, and functions such as automatic driving or ADAS are achieved through a specific algorithm.
Referring to fig. 2, a method for analyzing video signal data based on a vehicle ethernet according to an embodiment of the present invention includes:
s1, configuring 100BASE-TX interfaces as a first mirror image port, a second mirror image port and a third mirror image port which are respectively connected with a PC end,
s2, transmitting an Ethernet frame data structure through the first mirror image port, and transmitting an Ethernet frame data format to the PC end through the second mirror image port;
s3, calling network data monitoring software preset at the PC end to import the protocol scripts of the first mirror image port and the second mirror image port into a first protocol script and a second protocol script respectively;
s4, analyzing the first protocol script and the second protocol script, and recording the first protocol script and the second protocol script into a vehicle-mounted Ethernet through a PC (personal computer) end, wherein the first protocol script and the second protocol script are respectively first protocol data and second protocol data;
s5, the PC side extracts data elements from the first protocol data and the second protocol data through a preset algorithm, and the data elements are respectively a first protocol data element and a second protocol data element;
and S6, accessing the third mirror image port through a preset SOC processor, acquiring video data and gateway data, and transmitting all Ethernet frame data to the PC end back and forth through the SOC processor.
In a specific embodiment: the Switch port supports the independent connection of the PC end, the 100BASE-TX interface and the SOC, all the Ethernet frame AVB data are transmitted through the PC end and the 100BASE-TX interface, the Ethernet frame AVB data are secondarily developed through the SOC, for example, related parameters and states of a synchronous display video are displayed, and a specific product is designed by combining other functions; or video stream data based on an AVB protocol is collected, an Opencv and other image processing libraries are integrated, and functions such as automatic driving or ADAS are achieved through a specific algorithm.
In one embodiment: before the step of transmitting the AVB data structure to the Switch interface through the PC terminal, the method further includes:
setting and constructing the AVB data of the Ethernet frame according to requirements, wherein the AVB data of the Ethernet frame comprises a field value of the AVB data of the Ethernet frame, a source address of the AVB data of the Ethernet frame and an execution command of the AVB data of the Ethernet frame;
inputting the field value of the built Ethernet frame AVB data to a Switch end to obtain a node of the Ethernet frame AVB data corresponding to the field value of the built Ethernet frame AVB data,
inputting the source address of the built Ethernet AVB data to a Switch end to obtain the MAC address corresponding to the built source address,
and inputting the execution command of the built Ethernet frame AVB data to a Switch end to obtain an operation program of the Ethernet frame AVB data corresponding to the execution command of the built Ethernet frame AVB data.
In a specific embodiment: the user can set the field value of the Ethernet AVB data according to the requirement, thereby constructing the Ethernet frame; checking the Ethernet data frame, executing a command, verifying the constructed Ethernet frame, performing packet capture on the Ethernet frame, and seeing a forged source MAC address and a forged target MAC address in a link layer; in order to be not discovered by other hosts, a false source MAC address can be specified when a data packet is constructed, however, the data packet can be sent only once each time the data packet is constructed, and if a plurality of data packets need to be sent, the data packet needs to be constructed for many times;
for example: input execution command obtaining output information 00:0c: SC: E6: 77 is the source MAC address, SC for the current host: e6: 77 is MAC address, 00:0c is an Ethernet type; constructing an Ethernet frame, setting a source address to be 00:0c:79: A4:8a:43, destination MAC address 01:02:03:04:05:06, output information: e thernet 00:0c:79: A4:8a: 43- >01:02: 03:04:05:06
In order to verify the constructed Ethernet frame, a tool is used for packet capture, a forged source MAC address and a forged target MAC address are seen in a link layer, and the information is as follows: EtherI I, Src: Vmware _ c4:8a: de (00:0c:79: A4:8a:43), Dst: Woonsang _04:05:06(01:02:03:04:05:06)
For convenience, tools may be used to temporarily modify the MAC address, so that no false MAC addresses need to be constructed.
In one embodiment: the method for calling the preset protocol script PC end imported by the network data monitoring software and the 100BASE-TX interface further comprises the following steps:
the converged Ethernet AVB data storage medium includes data capacity and data bytes, the data capacity and data bytes are packed into an Ethernet AVB data frame block,
converting the Ethernet AVB data frame block into a data format corresponding to a Switch end to obtain imported protocol script data;
and detecting whether the data format of the imported protocol script is matched with the data format of the Switch or not through the preset network data monitoring software.
In a specific embodiment: after the Ethernet receives the data packet from the network layer, the data of the Internet layer is decomposed into smaller frame blocks according to the requirement of the vehicle-mounted condition so as to meet the requirement of the Ethernet frame data section; the whole size of the Ethernet frame must be between 64 bytes and 1518 bytes, after the data block is packed into frames, each frame contains data and vehicle-mounted information, and the information is required by the Ethernet network adapter for processing the frames; passing the data frames to a back-end component corresponding to the mirror port, which converts the frames to a bit stream and transmits them over a transmission medium; the ethernet network adapter receives the frame, checks the destination address, and if the destination address matches the address of the network adapter, the adapter will process the received frame and pass the data to the higher layer in the protocol data.
In one embodiment: the step of analyzing the protocol script further comprises the following steps:
respectively acquiring source codes of the PC port and the 100BASE-TX interface to obtain a first port source code and a second port source code;
according to the first port source code and the second port source code, performing auxiliary operation through code simulation to perfect the first port source code and the second port source code to obtain a script engine corresponding to a script language corresponding to the first port source code and a script engine corresponding to the second port source code,
and inputting the script language corresponding to the first port source code and the script engine corresponding to the second port source code into the virtual machine of the Switch end for analysis and execution.
In a specific embodiment: entering an agent program to a specified process through an Instrumentation function of Java to acquire all loaded vehicle-mounted information of the specified process, including the name of a vehicle-mounted class, the byte code of the vehicle-mounted class and the program of the vehicle-mounted class, inputting a source code class to be checked when a user operates a remote device, acquiring all classes which can be loaded by a target process in advance through the Instrumentation function, and acquiring loaded classes which can be returned in the target process by calling various interfaces provided by the Instrumentation;
establishing a communication channel between a scripting language and a scripting engine program to be developed and a target process by using the Attach function of Java, sending a source code to remote equipment through a port through an IP address and a port number of the target equipment, and determining the scripting language and the scripting engine in the target process;
receiving the script language and the script engine selected by the target equipment through the port, acquiring the byte code corresponding to the target class through the communication channel, and calling a pre-configured compiling tool in the target equipment to perform compiling operation on the byte code so as to finish the parsing operation of the script language and the script engine.
In one embodiment: before the step of extracting the data elements from the protocol data through a preset algorithm, the method further comprises the following steps:
before the step of extracting the data elements from the protocol data through a preset algorithm, the method further comprises the following steps:
the Switch end is preset with a coding device adaptive to the protocol data and an image processor for the protocol data,
the output end of the coding device adaptive to the protocol data is connected with the input end of the image processor for the protocol data, the input end of the coding device adaptive to the protocol data is connected with the Switch end through a network connecting line,
the Switch end transmits protocol data to coding equipment, and a protocol video stream signal is obtained through an equipment code conversion protocol data structure;
and the Switch end transmission analysis instruction is combined with the protocol video stream signal through coding equipment and input into the image processor, and is decomposed to obtain a protocol video stream digital signal and a protocol video stream analog signal.
In a specific embodiment: extracting data of the received video stream signal to coding equipment and an image processor, generating codes for processing video files, storing the video files, analyzing the received control instructions, and generating execution instructions;
acquiring data of an entity class and data of a set, modifying fields of the entity class through an interface by using mapping, filling packet headers of corresponding protocols to form data packets of encapsulated protocols, and completing rate adaptation to obtain protocol video stream digital signals and protocol video stream analog signals of adapted rates;
for example: the PC end sends the protocol data to the Switch, the control information necessary for the application layer of the PC end to contact the application layer of the Switch is sent to the presentation layer through a protocol header, data and a protocol tail which are added in advance on the data, and the presentation layer adds the protocol header or the protocol tail which is the control information understood by the presentation layer of the Switch; the size of the information is increased along with the addition of a protocol head and a protocol tail, the protocol head and the protocol tail contain control information required by a Switch corresponding layer, and the whole information unit is transmitted through a network medium;
the physical layer in the Switch receives the information unit and transmits the information unit to the data link layer, and the control information which is added to the protocol head or the protocol tail in advance by the data link layer at the PC end is read from the data link layer in the Switch; the rest is transmitted to the network layer, and each layer executes the same action; reading a protocol header and a protocol trailer from a corresponding layer, and sending the residual information to an application layer;
after the application layer is executed, the data is transmitted to the application program receiving end in Switch, and the digital signal and the analog signal of the protocol video stream with the data being the adaptive rate are received.
In one embodiment: the method for extracting the data elements from the protocol data through the preset algorithm further comprises the following steps:
testing the vehicle-mounted process and the function thereof through the protocol video stream digital signal and the protocol video stream analog signal, wherein the vehicle-mounted process and the function thereof comprise but are not limited to an automatic driving function or an ADAS function;
returning the protocol video stream analog signal to the Switch end, performing data matching operation with the ADAS function to test whether the protocol video stream analog signal and the ADAS function can generate simulation effect to realize linkage,
and returning the protocol video stream digital signal to a PC end, and carrying out data synchronization operation with the automatic driving function to test whether the protocol video stream digital signal and the automatic driving function can realize simulation effect and realize linkage.
In a specific embodiment: the streaming multimedia application with single target and multiple targets is realized through the playing performance of the real-time streaming protocol RTSP, and the cooperative working capability between the client and the server is supported;
in RTSP, each presentation and its corresponding media stream are identified by an RTSP URL, and the entire presentation and media characteristics are defined in a presentation description file, which includes media encoding mode, language, RTSP URLs, destination address and port, before a user requests a certain continuous media stream service from a server, the user must first obtain the presentation description file of the media stream from the server to obtain necessary parameters, and the obtaining of the presentation description file can use HTTP or other methods;
for example: before a Switch end requests a PC end for video digital analog service, firstly, a demonstration description file which is used for automatically driving the requested video service is acquired from a Web server through an HTTP (hyper text transport protocol), and a video service address and coding mode information of the video service are positioned by utilizing information provided by the file;
the Switch end requests the PC end for the video service according to the information, after the video service is initialized, the video server establishes a video service flow for the Switch end, the Switch end and the server operate a real-time flow control protocol RTSP to exchange various control signals for the flow, such as operation, stop, acceleration or deceleration, and after the service is finished, the Switch end provides a disconnection request to finish the resource transmission of the video flow signal.
In one embodiment: the mirror image port is accessed through a preset SOC processor, and the step of collecting video data and gateway data further comprises the following steps:
carrying out secondary development on the video data and the gateway data collected by the mirror image port, wherein the developed video data comprises relevant parameters and states for synchronously displaying videos, the developed gateway data comprises relevant parameters and states recorded for a vehicle-mounted process,
the related parameters and states of the synchronous display video are based on video stream data, an integrated image processing library and are processed through natural language, and the function of automatic driving is achieved;
and realizing the function of ADAS by integrating the relevant parameters and states recorded in the vehicle-mounted process based on video stream data and an image processing library and matching keywords.
In a specific embodiment: receiving the video data and gateway data uploaded to the Switch, the Switch captures the video data and the gateway data through an added SOC processor and carries out secondary development,
fusing a live-action three-dimensional model and a BIM (building information modeling) model to the video data to obtain model fusion data; optimizing the model fusion data according to the AR technology in the SOC processor to obtain model optimization data; the model optimization data comprises three-dimensional data; loading the three-dimensional data of the model optimization data into a target scene of a Web end for displaying;
for example: loading three-dimensional data of model optimization data including a state of a synchronous display video, parameters of the synchronous display video and a text of the synchronous display video into a target scene of a Web end for displaying, in one possible implementation mode, optimizing model fusion data according to an AR technology to obtain optimized model data, performing natural language processing on the optimized model data,
acquiring data which are not marked from the optimization model data, marking the data which are not marked, and storing the marked data to the SOC processor; acquiring labeled data from the SOC, training the labeled data to generate a natural language processing model, and storing the natural language processing model into the SOC; the method comprises the steps of obtaining a file corresponding to a natural language processing service model from an SOC (system on chip), generating a service log containing a text to be recognized by using a label provided by the natural language processing model according to the natural language processing service model, storing the service log into the SOC, obtaining new data to be labeled from the service text by the SOC, and converting the total number of the data to be labeled into labeled data to realize the automatic driving function.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (10)
1. Video signal monitoring platform based on-vehicle ethernet, its characterized in that includes:
the transmission unit is used for configuring the Switch interface as a mirror image port, and is connected to the PC end through a 100BASE-TX interface or connected to the SOC processor through an SGMII interface; the data of the AVB port is transmitted to the PC end through the Switch, and the data of the AVB port is transmitted to the SOC processor through the Switch;
the system comprises an extraction unit, an SOC processor and a data processing unit, wherein the extraction unit is used for leading in an AVB protocol analysis plug-in by calling preset network data monitoring software at a PC end and leading in the AVB protocol analysis plug-in by the SOC processor to obtain first protocol analysis data and second protocol analysis data; and the Switch end extracts data elements from the first protocol analysis data and the second protocol analysis data through a preset algorithm, the first protocol analysis data extracts the functions of analyzing and applying the AVB data, and the second protocol analysis data extracts the functions of obtaining the AVB video signal and the ADSD.
2. The vehicle ethernet-based video signal monitoring platform according to claim 1, wherein said transmission unit further comprises:
the configuration subunit is used for configuring the Switch interface as a mirror image port, and connecting the Switch interface to the PC end through a 100BASE-TX interface or connecting the Switch interface to the SOC processor through an SGMII interface;
and the transmission subunit is used for transmitting the data of the AVB port to the PC terminal through the Switch and transmitting the data of the AVB port to the SOC processor through the Switch.
3. The vehicle ethernet-based video signal monitoring platform according to claim 1, wherein said extraction unit further comprises:
the system comprises an importing subunit, an SOC (System on a chip) processor and a monitoring unit, wherein the importing subunit is used for a PC (personal computer) end to call preset network data monitoring software to import an AVB (Audio video bus) protocol analysis plug-in, and the SOC processor imports the AVB protocol analysis plug-in to obtain first protocol analysis data and second protocol analysis data;
and the extracting subunit is used for the Switch end to extract data elements from the first protocol analysis data and the second protocol analysis data through a preset algorithm, wherein the first protocol analysis data has the function of extracting, analyzing and applying AVB data, and the second protocol analysis data has the function of extracting and obtaining AVB video signals and the application function of ADSD.
4. The video signal data analysis method based on the vehicle-mounted Ethernet is characterized in that the video signal data analysis method based on the vehicle-mounted Ethernet is adopted to execute the video signal monitoring platform based on the vehicle-mounted Ethernet according to any one of claims 1 to 3, and the video signal data analysis method based on the vehicle-mounted Ethernet comprises the following steps:
configuring a Switch interface as a mirror image port, and connecting the Switch interface to a PC (personal computer) end through a 100BASE-TX interface or connecting the Switch interface to an SOC (system on chip) processor through an SGMII (service gateway interface);
the data of the AVB port is transmitted to the PC end through the Switch, and the data of the AVB port is transmitted to the SOC processor through the Switch;
the PC terminal calls preset network data monitoring software to import an AVB protocol analysis plug-in, and the SOC processor imports the AVB protocol analysis plug-in to obtain first protocol analysis data and second protocol analysis data;
and the Switch end extracts data elements from the first protocol analysis data and the second protocol analysis data through a preset algorithm, the first protocol analysis data extracts the functions of analyzing and applying the AVB data, and the second protocol analysis data extracts the functions of obtaining the AVB video signal and the ADSD.
5. The method for analyzing video signal data based on vehicular ethernet according to claim 4, wherein before the step of transmitting the data of the AVB port to the PC terminal via Switch, the method further comprises:
setting and constructing the AVB data of the Ethernet frame according to requirements, wherein the AVB data of the Ethernet frame comprises a field value of the AVB data of the Ethernet frame, a source address of the AVB data of the Ethernet frame and an execution command of the AVB data of the Ethernet frame;
inputting the field value of the built Ethernet frame AVB data to a Switch end to obtain a node of the Ethernet frame AVB data corresponding to the field value of the built Ethernet frame AVB data,
inputting the source address of the built Ethernet AVB data to a Switch end to obtain the MAC address corresponding to the built source address,
and inputting the execution command of the built Ethernet frame AVB data to a Switch end to obtain an operation program of the Ethernet frame AVB data corresponding to the execution command of the built Ethernet frame AVB data.
6. The vehicle-mounted ethernet-based video signal data analysis method according to claim 4, wherein the step of invoking the preset network data monitoring software by the PC terminal to import the AVB protocol analysis plug-in further comprises:
the converged Ethernet AVB data storage medium includes data capacity and data bytes, the data capacity and data bytes are packed into an Ethernet AVB data frame block,
converting the Ethernet AVB data frame block into a data format corresponding to a Switch end to obtain imported protocol script data;
and detecting whether the data format of the imported protocol script is matched with the data format of the Switch or not through the preset network data monitoring software.
7. The vehicle ethernet-based video signal data analysis method of claim 4, wherein the step of importing the AVB protocol analysis plug-in by the SOC processor further comprises:
respectively obtaining source codes of the SOC processor and the SGMII interface to obtain a first source code and a second source code;
according to the first source code and the second source code, performing auxiliary operation through code simulation to perfect the first source code and the second source code to obtain a script engine corresponding to the script language corresponding to the first source code and the script engine corresponding to the second source code,
and inputting the script language corresponding to the first source code and the script engine corresponding to the second source code into a virtual machine at the Switch end for analysis and execution.
8. The method for analyzing video signal data based on vehicular ethernet according to claim 4, wherein the step of the Switch end extracting data elements from the protocol data by using a preset algorithm further comprises:
the Switch end is preset with a coding device adaptive to the protocol data and an image processor for the protocol data,
the output end of the coding device adaptive to the protocol data is connected with the input end of the image processor for the protocol data, the input end of the coding device adaptive to the protocol data is connected with the Switch end through a network connecting line,
the Switch end transmits protocol data to coding equipment, and a protocol video stream signal is obtained through an equipment code conversion protocol data structure;
and the Switch end transmission analysis instruction is combined with the protocol video stream signal through coding equipment and input into the image processor, and is decomposed to obtain a protocol video stream digital signal and a protocol video stream analog signal.
9. The method for analyzing video signal data based on vehicular ethernet according to claim 8, wherein the step of extracting data elements from the protocol data by a predetermined algorithm further comprises:
testing the vehicle-mounted process and the function thereof through the protocol video stream digital signal and the protocol video stream analog signal, wherein the vehicle-mounted process and the function thereof comprise but are not limited to an automatic driving function or an ADAS function;
returning the protocol video stream analog signal to the Switch end, performing data matching operation with the ADAS function to test whether the protocol video stream analog signal and the ADAS function can generate simulation effect to realize linkage,
and returning the protocol video stream digital signal to a PC end, and carrying out data synchronization operation with the automatic driving function to test whether the protocol video stream digital signal and the automatic driving function can realize simulation effect and realize linkage.
10. The vehicle ethernet-based video signal data analysis method according to claim 4, wherein said step of extracting protocol analysis data further comprises:
carrying out secondary development on the video data and the gateway data collected by the mirror image port, wherein the developed video data comprises relevant parameters and states for synchronously displaying videos, the developed gateway data comprises relevant parameters and states recorded for a vehicle-mounted process,
the related parameters and states of the synchronous display video are based on video stream data, an integrated image processing library and are processed through natural language, and the function of automatic driving is achieved;
and realizing the function of ADAS by integrating the relevant parameters and states recorded in the vehicle-mounted process based on video stream data and an image processing library and matching keywords.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111182926.3A CN113923080B (en) | 2021-10-11 | 2021-10-11 | Video signal monitoring platform based on vehicle-mounted Ethernet and data analysis method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111182926.3A CN113923080B (en) | 2021-10-11 | 2021-10-11 | Video signal monitoring platform based on vehicle-mounted Ethernet and data analysis method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113923080A true CN113923080A (en) | 2022-01-11 |
| CN113923080B CN113923080B (en) | 2023-12-19 |
Family
ID=79239206
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111182926.3A Active CN113923080B (en) | 2021-10-11 | 2021-10-11 | Video signal monitoring platform based on vehicle-mounted Ethernet and data analysis method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113923080B (en) |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1399738A (en) * | 1999-08-27 | 2003-02-26 | 国际商业机器公司 | Network switch and components and method of operation |
| CN1728686A (en) * | 2004-07-15 | 2006-02-01 | 美国博通公司 | Method and system for a gigabit Ethernet data |
| CN101159591A (en) * | 2007-08-06 | 2008-04-09 | 中兴通讯股份有限公司 | Method and system of implementing different type port image |
| CN102457698A (en) * | 2010-10-27 | 2012-05-16 | 深圳市誉融科技有限公司 | Video communication bridge-connection system and method |
| US8392631B1 (en) * | 2008-10-02 | 2013-03-05 | Apple Inc. | Methods and apparatus for transmitting data streams via a heterogeneous network |
| WO2015033333A1 (en) * | 2013-09-09 | 2015-03-12 | N-Sip Ltd | Communication channel between plugin application and browser script |
| US20170048312A1 (en) * | 2015-08-12 | 2017-02-16 | Brocade Communications Systems, Inc. | Sdn-based mirroring of traffic flows for in-band network analytics |
| CN106453148A (en) * | 2015-08-12 | 2017-02-22 | 现代自动车株式会社 | Operation method of communication node in network |
| CN107735987A (en) * | 2015-06-02 | 2018-02-23 | 三菱电机大楼技术服务株式会社 | Relay, network monitoring system and program |
| US20180102987A1 (en) * | 2016-10-07 | 2018-04-12 | Hyundai Motor Company | Operation method of communication node for mirroring in vehicle network |
| KR20180038957A (en) * | 2016-10-07 | 2018-04-17 | 현대자동차주식회사 | Operation method of communication node for mirroring in vehicle network |
| CN108390809A (en) * | 2017-02-03 | 2018-08-10 | 华耀(中国)科技有限公司 | A kind of bridging method and its system based on VF promiscuous modes |
| US10241745B1 (en) * | 2016-01-15 | 2019-03-26 | McDowell Signal Processing, LLC. | Apparatus, a system and a method of creating modifiable analog processing |
| CN209126668U (en) * | 2018-12-06 | 2019-07-19 | 深圳市易成自动驾驶技术有限公司 | The hybrid network system of automatic Pilot platform |
| CN110113345A (en) * | 2019-05-13 | 2019-08-09 | 四川长虹电器股份有限公司 | A method of the assets based on Internet of Things flow are found automatically |
| CN110971620A (en) * | 2020-01-03 | 2020-04-07 | 清华大学深圳国际研究生院 | Intelligent gateway flow security policy method |
| CN110995547A (en) * | 2019-12-24 | 2020-04-10 | 国汽(北京)智能网联汽车研究院有限公司 | Vehicle-mounted high-speed network testing system and method |
| US20210185070A1 (en) * | 2019-12-13 | 2021-06-17 | Electronics And Telecommunications Research Institute | Lightweight intrusion detection apparatus and method for vehicle network |
-
2021
- 2021-10-11 CN CN202111182926.3A patent/CN113923080B/en active Active
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1399738A (en) * | 1999-08-27 | 2003-02-26 | 国际商业机器公司 | Network switch and components and method of operation |
| CN1728686A (en) * | 2004-07-15 | 2006-02-01 | 美国博通公司 | Method and system for a gigabit Ethernet data |
| CN101159591A (en) * | 2007-08-06 | 2008-04-09 | 中兴通讯股份有限公司 | Method and system of implementing different type port image |
| US8392631B1 (en) * | 2008-10-02 | 2013-03-05 | Apple Inc. | Methods and apparatus for transmitting data streams via a heterogeneous network |
| CN102457698A (en) * | 2010-10-27 | 2012-05-16 | 深圳市誉融科技有限公司 | Video communication bridge-connection system and method |
| WO2015033333A1 (en) * | 2013-09-09 | 2015-03-12 | N-Sip Ltd | Communication channel between plugin application and browser script |
| CN107735987A (en) * | 2015-06-02 | 2018-02-23 | 三菱电机大楼技术服务株式会社 | Relay, network monitoring system and program |
| CN106453148A (en) * | 2015-08-12 | 2017-02-22 | 现代自动车株式会社 | Operation method of communication node in network |
| US20170048312A1 (en) * | 2015-08-12 | 2017-02-16 | Brocade Communications Systems, Inc. | Sdn-based mirroring of traffic flows for in-band network analytics |
| US10241745B1 (en) * | 2016-01-15 | 2019-03-26 | McDowell Signal Processing, LLC. | Apparatus, a system and a method of creating modifiable analog processing |
| US20180102987A1 (en) * | 2016-10-07 | 2018-04-12 | Hyundai Motor Company | Operation method of communication node for mirroring in vehicle network |
| KR20180038957A (en) * | 2016-10-07 | 2018-04-17 | 현대자동차주식회사 | Operation method of communication node for mirroring in vehicle network |
| CN108390809A (en) * | 2017-02-03 | 2018-08-10 | 华耀(中国)科技有限公司 | A kind of bridging method and its system based on VF promiscuous modes |
| CN209126668U (en) * | 2018-12-06 | 2019-07-19 | 深圳市易成自动驾驶技术有限公司 | The hybrid network system of automatic Pilot platform |
| CN110113345A (en) * | 2019-05-13 | 2019-08-09 | 四川长虹电器股份有限公司 | A method of the assets based on Internet of Things flow are found automatically |
| US20210185070A1 (en) * | 2019-12-13 | 2021-06-17 | Electronics And Telecommunications Research Institute | Lightweight intrusion detection apparatus and method for vehicle network |
| CN110995547A (en) * | 2019-12-24 | 2020-04-10 | 国汽(北京)智能网联汽车研究院有限公司 | Vehicle-mounted high-speed network testing system and method |
| CN110971620A (en) * | 2020-01-03 | 2020-04-07 | 清华大学深圳国际研究生院 | Intelligent gateway flow security policy method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113923080B (en) | 2023-12-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110493351B (en) | Video networking access method, device, equipment and storage medium | |
| CN113810791B (en) | Method for improving intelligent network card/DPU network telemetering technology performance | |
| CN111294235B (en) | Data processing method, device, gateway and readable storage medium | |
| US8583269B2 (en) | Isochronous audio network software interface | |
| CN113271479B (en) | Playing processing method and device and related equipment | |
| CN110662017B (en) | Video playing quality detection method and device | |
| CN112702576A (en) | Data acquisition plug-flow display method for vehicle-mounted video | |
| CN112565224A (en) | Video processing method and device | |
| CN112929419A (en) | Data packet transmission method and device, electronic equipment and readable storage medium | |
| KR20050106288A (en) | Network i/f card for supporting multi-streaming format and method thereof | |
| US7853709B2 (en) | Multimedia data sharing system and method for MOST network | |
| CN112968750B (en) | Satellite image compressed data block analysis method and system based on AOS frame | |
| CN112468757B (en) | Adaptive resolution ARINC818 video conversion circuit based on FPGA | |
| CN113923080B (en) | Video signal monitoring platform based on vehicle-mounted Ethernet and data analysis method | |
| CN102137414A (en) | Time-delay-evaluating method and device for mobile video service | |
| CN109802990B (en) | Resource log reading and writing method and device for reducing data redundancy | |
| CN114024598B (en) | Forwarding interface test method and device | |
| CN115866331A (en) | Video frame extraction analysis method, device, equipment and storage medium | |
| CN104065490A (en) | System and method for simulating transceiver signaling based on online charging environment | |
| CN111935316B (en) | Method and device for acquiring front-end equipment catalog | |
| CN113660540A (en) | Image information processing method, system, display method, device and storage medium | |
| CN108809900B (en) | Framework and method for unified resource access | |
| CN117251129B (en) | Cross-platform same-screen method based on transfer compiling | |
| CN108200481A (en) | A kind of RTP-PS method for stream processing, device, equipment and storage medium | |
| CN112291210B (en) | Method and device for acquiring front-end equipment catalog |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 518000 Room 201, building G5, TCL International e city, Shuguang community, Xili street, Nanshan District, Shenzhen, Guangdong Applicant after: China recognition vehicle networking technology service (Shenzhen) Co.,Ltd. Address before: C10H, TCL International e city, 1001 Zhongshan Garden Road, Xili street, Nanshan District, Shenzhen, Guangdong 518000 Applicant before: China recognition vehicle networking technology service (Shenzhen) Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |