CN117809395A - Collected data association method, data recharging method and device of vehicle-mounted equipment - Google Patents

Collected data association method, data recharging method and device of vehicle-mounted equipment Download PDF

Info

Publication number
CN117809395A
CN117809395A CN202311854497.9A CN202311854497A CN117809395A CN 117809395 A CN117809395 A CN 117809395A CN 202311854497 A CN202311854497 A CN 202311854497A CN 117809395 A CN117809395 A CN 117809395A
Authority
CN
China
Prior art keywords
data
external
data packet
video data
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311854497.9A
Other languages
Chinese (zh)
Inventor
蒋灿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Streamax Technology Co Ltd
Original Assignee
Streamax Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Streamax Technology Co Ltd filed Critical Streamax Technology Co Ltd
Priority to CN202311854497.9A priority Critical patent/CN117809395A/en
Publication of CN117809395A publication Critical patent/CN117809395A/en
Pending legal-status Critical Current

Links

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a method, a device, equipment and a medium for associating acquired data of vehicle-mounted equipment with each other and recharging the data. The collected data association method of the vehicle-mounted equipment comprises the following steps: collecting video data and various external data; filtering the collected video data, and classifying and packaging the external data based on the collection source of the external data to obtain at least one external data packet; inputting each target video data into a preset operation model to obtain operation time parameters, frame acquisition time marking values and marking information matched with each target video data, and obtaining each video data packet; and carrying out association packaging on each video data packet and each external data packet according to a preset packaging rule according to the time length and the frame acquisition time stamp value in each video data packet. By the technical scheme, the invention ensures the data correlation between the collected data and the recharged data, and realizes the collection and recharging of various data of the vehicle-mounted equipment.

Description

Collected data association method, data recharging method and device of vehicle-mounted equipment
Technical Field
The present invention relates to the field of data processing, and in particular, to a method, apparatus, device, and medium for associating collected data with vehicle-mounted devices.
Background
Along with the gradual development and perfection of deep learning, intelligent driving and artificial intelligence, external data of the vehicle-mounted terminal are accessed into various scenes with more and more types and higher speeds, and the scenes are required to be subjected to strict simulation scene tests to ensure the safety and usability of the scenes before the vehicle-mounted terminal is put into practical use.
In the actual driving process, the scenes experienced by the vehicle are usually compounded, but the prior art does not perform data acquisition and data recharging according to the compound full scene in the real vehicle environment, but mainly performs data acquisition and data recharging aiming at a single peripheral interface in a single scene, so that the problem that the real vehicle needs to acquire data through a plurality of peripheral interfaces in the compound environment is not solved, and the problem of how to recharge a plurality of data types is not solved.
Meanwhile, in the prior art, when each type of data is acquired, the independent data is acquired through each independent peripheral interface, so that no relevance exists before each independent data, and when the simulation scene is restored through single data, each related data cannot be combined to form a composite simulation scene, so that the simulation verification effect of the real vehicle environment is poor.
Disclosure of Invention
The invention provides a method for associating acquired data of vehicle-mounted equipment, a method, a device, equipment and a medium for recharging data, which can solve the problem that the prior art cannot acquire and recharge data through various peripheral interfaces, and simultaneously solve the problem that the acquired data through the various peripheral interfaces have no association.
In a first aspect, an embodiment of the present invention provides a method for associating acquired data of a vehicle-mounted device, which is executed by an acquisition system, where the method includes:
collecting all video data and all external data of a target vehicle within a preset time length in real time; wherein each item of video data comprises a video frame and a length of time matched to the video frame;
filtering all the collected video data based on a preset video filtering rule to obtain all target video data conforming to the preset filtering rule, and classifying and packaging all the external data based on the collection source of the external data to obtain at least one external data packet;
inputting each target video data into a preset operation model to obtain operation time parameters, frame acquisition time marking values and marking information matched with each target video data, and packaging the operation time parameters, the frame acquisition time marking values and the marking information with the matched target video data to obtain each video data packet;
And carrying out association packaging on each video data packet and each external data packet according to a preset packaging rule according to the time length and the frame acquisition time mark value in each video data packet so as to be used for data reading by a data recharging system.
In a second aspect, an embodiment of the present invention provides a data recharging method of an in-vehicle apparatus, performed by a data recharging system configured with a plurality of data transmission modules, the method including:
responding to a user data recharging command, and acquiring at least one target packaging result in the external storage module; the external storage module is a storage module with a connection relation with the acquisition system;
splitting each target packaging result to obtain each video data packet and each external data packet matched with each packaging result, and recharging the video data packets to a target system through an audio/video transmission module;
analyzing each external data packet to obtain a source mark value matched with each external data packet;
and carrying out data classification on each external data packet according to the source marking value, and calling at least one data transmission module to respectively send each external data packet based on the classification result so as to recharge each external data packet to the target system.
In a third aspect, an embodiment of the present invention provides an acquisition data association apparatus of an in-vehicle device, performed by an acquisition system, the apparatus including:
the data acquisition module is used for acquiring various video data and various external data of the target vehicle within a preset time length in real time; wherein each item of video data comprises a video frame and a length of time matched to the video frame;
the external data packaging module is used for filtering all the collected video data based on a preset video filtering rule to obtain all the target video data conforming to the preset filtering rule, and classifying and packaging all the external data based on the collection source of the external data to obtain at least one external data packet;
the video data packaging module is used for inputting each target video data into a preset operation model to obtain operation time parameters, frame acquisition time marking values and marking information matched with each target video data, and packaging the operation time parameters, the frame acquisition time marking values and the marking information with the matched target video data to obtain each video data packet;
and the association packaging module is used for carrying out association packaging on each video data packet and each external data packet according to a preset packaging rule according to the time length and the frame acquisition time mark value in each video data packet so as to be used for data reading of the data recharging system.
In a fourth aspect, an embodiment of the present invention provides a data recharging apparatus for an in-vehicle device, which is executed by a data recharging system configured with a plurality of data transmission modules, the apparatus comprising:
the packaging result acquisition module is used for responding to the user data recharging command and acquiring at least one target packaging result in the external storage module; the external storage module is a storage module with a connection relation with the acquisition system;
the video data recharging module is used for splitting each target packaging result, obtaining each video data packet matched with each packaging result and each external data packet, and recharging the video data packet to the target system through the audio/video transmission module;
the data analysis module is used for analyzing each external data packet to obtain a source marking value matched with each external data packet;
and the external data recharging module is used for carrying out data classification on each external data packet according to the source marking value, and calling at least one data transmission module to respectively send each external data packet based on the classification result so as to recharge each external data packet to the target system.
In a fifth aspect, an embodiment of the present invention provides an electronic device, including:
At least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor, so that the at least one processor can execute the collected data association method of the vehicle-mounted device and the data recharging method of the vehicle-mounted device according to any embodiment of the present invention.
In a sixth aspect, an embodiment of the present invention provides a computer readable storage medium, where computer instructions are stored in the computer readable storage medium, where the computer instructions are configured to enable, when executed by a processor, the method for associating acquired data with vehicle-mounted equipment and the method for recharging data of vehicle-mounted equipment according to any one of the embodiments of the present invention.
According to the technical scheme, on one hand, all video data and all external data of a target vehicle within a preset time length are acquired in real time through an acquisition system, then all the acquired video data are filtered based on a preset video filtering rule to obtain all the target video data conforming to the preset filtering rule, all the external data are classified and packed based on an acquisition source of the external data to obtain at least one external data packet, all the target video data are input into a preset operation model to obtain operation time parameters, frame acquisition time stamp values and stamp information matched with all the target video data, the operation time parameters, the frame acquisition time stamp values and the stamp information are packed with the matched target video data to obtain all the video data packets, and finally all the video data packets and all the external data packets are associated and packed according to a preset packing rule according to the time length and the frame acquisition time stamp values in all the video data packets so as to be used for data reading by a data recharging system; on the other hand, the data recharging system responds to a user data recharging command to obtain at least one target packaging result in the external storage module, then splits each target packaging result to obtain each video data packet matched with each packaging result and each external data packet, recharges each video data packet to the target system through the audio/video transmission module, analyzes each external data packet to obtain a source marking value matched with each external data packet, classifies data of each external data packet according to the source marking value, invokes at least one data transmission module to respectively send each external data packet based on the classification result, recharges each external data packet to the target system, solves the problem that data collection and recharging cannot be carried out through multiple peripheral interfaces in the prior art, simultaneously solves the problem that there is no correlation between data collected through multiple peripheral interfaces, ensures the data correlation between collected and recharged data, and realizes collection and recharging of multiple types of data of vehicle-mounted equipment.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of a method for associating acquired data of an in-vehicle apparatus according to a first embodiment of the present invention;
fig. 2 is a flowchart of a data recharging method of a vehicle-mounted device according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of an apparatus for associating acquired data of a vehicle-mounted device according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a data recharging device for a vehicle-mounted device according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device implementing a method for associating acquired data of an on-board device and a method for recharging data of an on-board device according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
Fig. 1 is a flowchart of a method for associating acquired data of a vehicle-mounted device according to a first embodiment of the present invention, where the method may be performed by an apparatus for associating acquired data of a vehicle-mounted device, and the apparatus for associating acquired data of a vehicle-mounted device may be implemented in hardware and/or software, and the apparatus for associating acquired data of a vehicle-mounted device may be configured in an acquisition system having an apparatus for associating acquired data of a vehicle-mounted device.
As shown in fig. 1, the method includes:
s110, acquiring various video data and various external data of the target vehicle within a preset time length in real time.
Wherein each item of video data includes a video frame and a length of time that matches the video frame.
Wherein, the video data is a video frame in YUV format; specifically, the existing video acquisition methods are divided into two types: acquiring a sensor camera or an AHD camera; on the one hand, for the sensor camera, after receiving the data from the sensor camera, the acquisition system of the embodiment receives the RAW data of the sensor according to the MIPI protocol, calculates and converts the RAW data into a YUV data format; on the other hand, for an AHD camera, the acquisition system firstly converts the A/D analog-to-digital conversion into a YUV format, and then directly receives YUV data according to MIPI protocol.
Further, the external data may be all remaining formats of data that the target vehicle can produce, except video data; by way of example, the external data may be various data such as vehicle speed, steering, gear, gps positioning, and radar from various interfaces such as CAN, UART, I/O.
In this embodiment, each individual video frame is an independent video data, i.e. each item of video data carries only one video frame of known time length.
Further, the time length of the video frame matching can be obtained by a pts (Presentation Time Stamp, display time stamp) time stamp of the video; furthermore, for a video, each video frame forming the video has a pts time stamp to indicate the playing time of the video frame in the video, meanwhile, when playing the video, we need to control the displaying time of each frame according to pts to ensure that the playing speed of the video is matched with the frame rate of the video, and also ensure the synchronization of the audio and the video. The prior art typically uses a frame rate and frame sequence number to calculate a timestamp for each frame; illustratively, if the frame rate of the video is 25fps, the time stamp of the first frame is 0, the time stamp of the second frame is 0.04s (1/25), and the time stamp of the third frame is 0.08s (2/25), i.e., the time length of each video frame is 0.04s relative to the video described above.
S120, filtering the collected video data based on a preset video filtering rule to obtain target video data conforming to the preset filtering rule, and classifying and packaging the external data based on the collection source of the external data to obtain at least one external data packet.
In this embodiment, the preset video filtering rule may be set by the relevant staff according to the actual needs and according to the load of the acquisition system; for example, if the preset video filtering rule is set to be a rule of 1 frame loss per 5 frames, and 25 video data, that is, 25 video frames with a time length, are received in total in a certain period of time, at this time, the collecting system filters the 5 th frame, the 10 th frame, the 15 th frame, the 20 th frame, and the 25 th frame according to the receiving order of each video data when filtering, and takes the remaining 20 video data as each target video data according to the preset filtering rule.
Wherein, based on the collection source of external data carry out classification packing to external data, include: when each external data is acquired, identifying the acquisition source of each external data in real time; wherein the acquisition source comprises: CAN interface, I/O interface, serial port data interface and network data interface; generating a source marking value according to the acquisition source of each external storage data, and carrying out association packaging on each external storage data and the source marking value matched with each external storage data to generate each external data packet. The data recharging system classifies the data according to the source mark value of each video data packet.
For example, in a specific implementation manner of this embodiment, the acquisition system acquires external data in real time through a preset external interface (such as a CAN interface, a UART serial port, an I/O level hard line interface, etc.), where the external data may include data such as a vehicle speed, a gear, a vehicle left-right steering, and gps positioning; after receiving each external data, the acquisition system classifies the data acquired from different interfaces; illustratively, vehicle speed data obtained from the CAN interface is categorized into CAN interface data; the vehicle speed obtained from the GPS is classified as serial interface data; the steering obtained from the I/O is classified as I/O data, and finally, all external data is classified and packaged.
According to the acquisition system, the external data is classified and packed based on the acquisition source of the external data, preparation is made for data recharging work of subsequent work, various data of the equipment end of a vehicle are acquired from which interface during data recharging, recharging is carried out from which interface during recharging, independence and integrity among the external data are guaranteed while various types of data can be acquired from various external ports, various types of data are not mixed during recharging of the acquired data, and establishment of the actual vehicle environment at the time of actual return visit is facilitated.
S130, inputting each target video data into a preset operation model to obtain operation time parameters, frame acquisition time marking values and marking information matched with each target video data, and packaging the operation time parameters, the frame acquisition time marking values and the marking information with the matched target video data to obtain each video data packet.
The operation time parameter can be the calibration parameter of the target video data, the attribute data of the video frames such as a threshold factor and the like; the frame acquisition time stamp value is data for identifying the acquisition time of the current target video data; the marking information is alarm information matched with the target video data, alarm grade state information and the like; further, as known to those skilled in the art, the processing of the video data by the algorithm model to obtain the above information is a mature prior art, which is not described in detail in this embodiment.
And S140, according to the time length and the frame acquisition time mark value in each video data packet, carrying out association packaging on each video data packet and each external data packet according to a preset packaging rule so as to be used for data reading by a data recharging system.
Specifically, in this embodiment, according to the time length and the frame acquisition time stamp value in each video data packet, each video data packet and each external data packet are associated and packaged according to a preset packaging rule, including: sequencing all video data packets according to the acquisition sequence of all video frames in all video data packets, and sequentially acquiring current video data packets according to sequencing results; determining a packaging time period corresponding to a current video data packet according to the time length and a frame acquisition time stamp value in the current video data packet; identifying at least one external data packet acquired in a packaging time period from all external data packets as a target external data packet, and carrying out association packaging on each target external data packet and the current video data packet; and returning to execute the operation of sequentially acquiring the current video data packets according to the sequencing result until the associated packaging processing of all the video data packets is completed.
It is easy to understand that, since each video data is filtered in S120, the corresponding video frame in each video data that is finally packed is discontinuous in time, for example, if the frame rate of the video is 6fps, the timestamp of the first frame is 0, the timestamp of the second frame is 0.04S (1/6), the timestamp of the third frame is 0.08S (2/6), and so on, the timestamp of the fifth frame is 0.16S (5/6), the timestamp of the sixth frame is 0.20S (6/6), if the preset video filtering rule is set to be a uniform rule that 1 frame is lost every 5 frames, and 6 video frames with timestamps are received in total in a certain time, at this time, the acquisition system filters out the 5 th frame according to the receiving sequence of each video data, on the basis of the above, the timestamps in each video frame contained in the packed are respectively 0.04S,0.08S,0.12,0.20S, and the specific length of each video after the time is calculated on the basis of the time stamp: first frame 0.04, second frame 0.04, third frame 0.04, fourth frame 0.08.
It should be noted that, since the external data has no time stamp when received, the external data does not include a time concept, and each video data packet includes a time length and a frame acquisition time stamp value concept, so when the video data packet and the external data packet are associated and packed, at least one external data packet acquired in a packing time period is identified as a target external data packet and is associated and packed with a current video data packet, which results in a situation that multiple pieces of external data are received within one video frame time; for example, if a video packet corresponds to a time length of 40ms, the external data of the vehicle may change continuously within 40ms after the frame acquisition time stamp value, for example, a turn signal, a vehicle speed change signal, etc. are generated within 40ms, so that more than one external packet is matched with the video packet matched with the video frame when the video packet is associated and packed.
According to the technical scheme, all video data and all external data of a target vehicle within a preset time length are acquired in real time through an acquisition system, all acquired video data are filtered based on preset video filtering rules to obtain all target video data conforming to the preset filtering rules, all external data are classified and packed based on acquisition sources of the external data to obtain at least one external data packet, all target video data are input into a preset operation model to obtain operation time parameters, frame acquisition time stamp values and marking information matched with all target video data, the operation time parameters, frame acquisition time stamp values and marking information are packed with the matched target video data to obtain all video data packets, finally all video data packets and all external data packets are associated and packed according to the time length and frame acquisition time stamp values in all video data packets, so that data recharging systems can read data, the data correlation of the acquired data is guaranteed, and the acquisition of various types of data of vehicle-mounted equipment is realized.
Example two
Fig. 2 is a flowchart of a data recharging method of a vehicle-mounted device according to a second embodiment of the present invention, where the method may be performed by a data recharging device of the vehicle-mounted device, and the data recharging device of the vehicle-mounted device may be implemented in hardware and/or software, and the data recharging device of the vehicle-mounted device may be configured in a data recharging system configured with a plurality of data transmission modules.
As shown in fig. 2, the method includes:
s210, responding to a user data recharging command, and acquiring at least one target packaging result in the external storage module.
The external storage module is a storage module with a connection relation with the acquisition system.
In this embodiment, the external storage module includes: TF external memory card or hard disk with storage function.
In practical application, the data recharging command of the user may be to acquire all the target packaging results in the external storage module, or may be to acquire one or more target packaging results set by the user based on the selection operation of the user.
S220, splitting each target packaging result to obtain each video data packet and each external data packet matched with each packaging result, and recharging the video data packets to the target system through the audio/video transmission module.
S230, analyzing each external data packet to obtain a source mark value matched with each external data packet.
S240, carrying out data classification on each external data packet according to the source mark value, and calling at least one data transmission module to respectively send each external data packet based on the classification result so as to recharge each external data packet to the target system.
The method for classifying the data of each external data packet according to the source mark value, and calling at least one data transmission module to respectively transmit each external data packet based on the classification result comprises the following steps: analyzing the source marking values to obtain the acquisition sources of the external data packets; calling a CAN data transmission module to transmit an external data packet with a collection source of a CAN interface; calling an I/O data transmission module to transmit an external data packet with an acquisition source of an I/O interface; calling a serial data transmission module to transmit an external data packet with a collection source being a serial data interface; and calling a network data transmission module to transmit the external data packet with the acquisition source of the network data interface.
Optionally, in this embodiment, the external storage module includes: TF external memory card or hard disk with storage function.
By the scheme of the embodiment, all video data and external data in a specific time period can be recharged; in the prior art, when the scene simulation of the vehicle is carried out, only one data type is usually recharged for simulation; for example, if the prior art wants to recharge video data when recharging the data, only the video data can be recharged but other types of data cannot be recharged, and when scene simulation is performed based on the video data, only the simulation of the vehicle in the video scene can be performed, but the composite simulation of the speed, gear, left and right steering of the vehicle, gps positioning and the like of the vehicle in the current video scene cannot be performed; by means of the scheme, when video data recharging is carried out, the recharging system can recharge external data matched with the video data to the target system, and when scene simulation of the vehicle is carried out on the basis, video simulation of the vehicle under the conditions of current speed, gear, left and right steering of the vehicle, gps positioning and the like can be carried out, and simulation verification effect of the vehicle environment is greatly improved.
According to the technical scheme, the data recharging system firstly responds to a user data recharging command to obtain at least one target packaging result in the external storage module, then the target packaging results are split to obtain video data packets matched with the packaging results and external data packets, the video data packets are recharged to the target system through the audio and video transmission module, then the external data packets are analyzed to obtain source marking values matched with the external data packets, data classification is carried out on the external data packets according to the source marking values, at least one data transmission module is called based on the classification results to respectively send the external data packets to the target system, the data correlation of the recharged data is guaranteed, and recharging of various types of data of vehicle-mounted equipment is achieved.
Example III
Fig. 3 is a schematic structural diagram of a data collection association device of a vehicle-mounted device according to a third embodiment of the present invention.
As shown in fig. 3, the apparatus includes:
the data acquisition module 310 is configured to acquire, in real time, each item of video data and each item of external data of the target vehicle within a preset time period; wherein each item of video data comprises a video frame and a length of time matched to the video frame;
the external data packaging module 320 is configured to filter each collected video data based on a preset video filtering rule to obtain each target video data according with the preset filtering rule, and meanwhile, classify and package each external data based on a collection source of the external data to obtain at least one external data packet;
the video data packaging module 330 is configured to input each target video data into a preset operation model, obtain an operation time parameter, a frame acquisition time stamp value and stamp information that are matched with each target video data, and package the operation time parameter, the frame acquisition time stamp value and the stamp information with the matched target video data to obtain each video data packet;
the association packing module 340 is configured to perform association packing on each video data packet and each external data packet according to a preset packing rule according to a time length and a frame acquisition time stamp value in each video data packet, so as to enable the data recharging system to perform data reading.
According to the technical scheme, all video data and all external data of a target vehicle within a preset time length are acquired in real time through an acquisition system, all acquired video data are filtered based on preset video filtering rules to obtain all target video data conforming to the preset filtering rules, all external data are classified and packed based on acquisition sources of the external data to obtain at least one external data packet, all target video data are input into a preset operation model to obtain operation time parameters, frame acquisition time stamp values and marking information matched with all target video data, the operation time parameters, frame acquisition time stamp values and marking information are packed with the matched target video data to obtain all video data packets, finally all video data packets and all external data packets are associated and packed according to the time length and frame acquisition time stamp values in all video data packets, so that data recharging systems can read data, the data correlation of the acquired data is guaranteed, and the acquisition of various types of data of vehicle-mounted equipment is realized.
Based on the above embodiment, the association packing module 340 further includes:
the data packet sequencing unit is used for sequencing each video data packet according to the acquisition sequence of each video frame in each video data packet and sequentially acquiring the current video data packet according to the sequencing result;
a packing time period determining unit, configured to determine a packing time period corresponding to a current video data packet according to a time length and a frame acquisition time stamp value in the current video data packet;
the association packaging unit is used for identifying at least one external data packet acquired in a packaging time period from all external data packets as a target external data packet, and carrying out association packaging on each target external data packet and the current video data packet;
and the return execution unit is used for returning and executing the operation of sequentially acquiring the current video data packets according to the sequencing result until the associated packaging processing of all the video data packets is completed.
Based on the above embodiment, the external data packing module 320 further includes:
the acquisition source identification unit is used for identifying the acquisition source of each external data in real time when each external data is acquired; wherein the acquisition source comprises: CAN interface, I/O interface, serial port data interface and network data interface;
The tag value generating unit is used for generating a source tag value according to the acquisition source of each external storage data, and carrying out association packaging on each external storage data and the source tag value matched with each external storage data to generate each external data packet. The data recharging system classifies the data according to the source mark value of each video data packet.
The collected data association device of the vehicle-mounted equipment provided by the embodiment of the invention can execute the collected data association method of the vehicle-mounted equipment provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example IV
Fig. 4 is a schematic structural diagram of a data recharging device for a vehicle-mounted device according to a fourth embodiment of the present invention.
As shown in fig. 4, the apparatus includes:
a packaging result obtaining module 410, configured to obtain at least one target packaging result in the external storage module in response to a user data recharging command; the external storage module is a storage module with a connection relation with the acquisition system;
the video data recharging module 420 is configured to split each target packaging result, obtain each video data packet and each external data packet that are matched with each packaging result, and recharge the video data packet to the target system through the audio/video transmission module;
The data parsing module 430 is configured to parse each external data packet to obtain a source tag value matched with each external data packet;
the external data recharging module 440 is configured to classify data of each external data packet according to the source tag value, and call at least one data transmission module to respectively send each external data packet based on the classification result, so as to recharge each external data packet to the target system.
According to the technical scheme, the data recharging system firstly responds to a user data recharging command to obtain at least one target packaging result in the external storage module, then the target packaging results are split to obtain video data packets matched with the packaging results and external data packets, the video data packets are recharged to the target system through the audio and video transmission module, then the external data packets are analyzed to obtain source marking values matched with the external data packets, data classification is carried out on the external data packets according to the source marking values, at least one data transmission module is called based on the classification results to respectively send the external data packets to the target system, the data correlation of the recharged data is guaranteed, and recharging of various types of data of vehicle-mounted equipment is achieved.
Based on the above embodiment, the external data recharging module 440 further includes:
the analyzing unit is used for analyzing the source marking values to obtain the acquisition sources of the external data packets;
the first sending unit is used for calling the CAN data transmission module to send the external data packet with the acquisition source of the CAN interface;
the second sending unit is used for calling the I/O data transmission module to send the external data packet with the acquisition source of the I/O interface;
the third sending unit is used for calling the serial data transmission module to send the external data packet with the acquisition source being the serial data interface;
and the fourth sending unit is used for calling the network data transmission module to send the external data packet with the acquisition source being the network data interface.
The data recharging device of the vehicle-mounted equipment provided by the embodiment of the invention can execute the data recharging method of the vehicle-mounted equipment provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example five
Fig. 5 shows a schematic diagram of the structure of an electronic device 10 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 5, the electronic device 10 includes at least one processor 11, and a memory, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, etc., communicatively connected to the at least one processor 11, in which the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various appropriate actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 may also be stored. The processor 11, the ROM 12 and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.
Various components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, etc.; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 11 performs the respective methods and processes described above, such as the collected data association method of the in-vehicle apparatus and the data recharging method of the in-vehicle apparatus.
Correspondingly, the collected data association method of the vehicle-mounted equipment comprises the following steps:
collecting all video data and all external data of a target vehicle within a preset time length in real time; wherein each item of video data comprises a video frame and a length of time matched to the video frame;
filtering all the collected video data based on a preset video filtering rule to obtain all target video data conforming to the preset filtering rule, and classifying and packaging all the external data based on the collection source of the external data to obtain at least one external data packet;
inputting each target video data into a preset operation model to obtain operation time parameters, frame acquisition time marking values and marking information matched with each target video data, and packaging the operation time parameters, the frame acquisition time marking values and the marking information with the matched target video data to obtain each video data packet;
And carrying out association packaging on each video data packet and each external data packet according to a preset packaging rule according to the time length and the frame acquisition time mark value in each video data packet so as to be used for data reading by a data recharging system.
In some embodiments, the collected data association method of the in-vehicle device and the data recharging method of the in-vehicle device may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the collected data association method of the in-vehicle apparatus and the data recharging method of the in-vehicle apparatus described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the collected data association method of the in-vehicle device and the data recharging method of the in-vehicle device in any other suitable manner (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.

Claims (10)

1. An acquisition data association method of an in-vehicle apparatus, executed by an acquisition system, characterized by comprising:
collecting all video data and all external data of a target vehicle within a preset time length in real time; wherein each item of video data comprises a video frame and a length of time matched to the video frame;
Filtering all the collected video data based on a preset video filtering rule to obtain all target video data conforming to the preset filtering rule, and classifying and packaging all the external data based on the collection source of the external data to obtain at least one external data packet;
inputting each target video data into a preset operation model to obtain operation time parameters, frame acquisition time marking values and marking information matched with each target video data, and packaging the operation time parameters, the frame acquisition time marking values and the marking information with the matched target video data to obtain each video data packet;
and carrying out association packaging on each video data packet and each external data packet according to a preset packaging rule according to the time length and the frame acquisition time mark value in each video data packet so as to be used for data reading by a data recharging system.
2. The method of claim 1, wherein associating and packing each video data packet and each external data packet according to a predetermined packing rule based on a time length and a frame acquisition time stamp value in each video data packet, comprises:
sequencing all video data packets according to the acquisition sequence of all video frames in all video data packets, and sequentially acquiring current video data packets according to sequencing results;
Determining a packaging time period corresponding to a current video data packet according to the time length and a frame acquisition time stamp value in the current video data packet;
identifying at least one external data packet acquired in a packaging time period from all external data packets as a target external data packet, and carrying out association packaging on each target external data packet and the current video data packet;
and returning to execute the operation of sequentially acquiring the current video data packets according to the sequencing result until the associated packaging processing of all the video data packets is completed.
3. The method of claim 1, wherein classifying and packaging the external data based on the acquisition source of the external data comprises:
when each external data is acquired, identifying the acquisition source of each external data in real time; wherein the acquisition source comprises: CAN interface, I/O interface, serial port data interface and network data interface;
generating a source marking value according to the acquisition source of each external storage data, and carrying out association packaging on each external storage data and the source marking value matched with each external storage data to generate each external data packet so as to enable the data recharging system to carry out data classification according to the source marking value of each video data packet.
4. A data recharging method of an in-vehicle apparatus, performed by a data recharging system configured with a plurality of data transmission modules, comprising:
responding to a user data recharging command, and acquiring at least one target packaging result in the external storage module; the external storage module is a storage module with a connection relation with the acquisition system;
splitting each target packaging result to obtain each video data packet and each external data packet matched with each packaging result, and recharging the video data packets to a target system through an audio/video transmission module;
analyzing each external data packet to obtain a source mark value matched with each external data packet;
and carrying out data classification on each external data packet according to the source marking value, and calling at least one data transmission module to respectively send each external data packet based on the classification result so as to recharge each external data packet to the target system.
5. The method of claim 4, wherein classifying the external data packets according to the source tag value and invoking at least one data transmission module to transmit each external data packet based on the classification result, respectively, comprises:
Analyzing the source marking values to obtain the acquisition sources of the external data packets;
calling a CAN data transmission module to transmit an external data packet with a collection source of a CAN interface;
calling an I/O data transmission module to transmit an external data packet with an acquisition source of an I/O interface;
calling a serial data transmission module to transmit an external data packet with a collection source being a serial data interface;
and calling a network data transmission module to transmit the external data packet with the acquisition source of the network data interface.
6. The method of claim 5, wherein the external storage module comprises:
TF external memory card or hard disk with storage function.
7. An acquisition data associating apparatus of an in-vehicle device, which is executed by an acquisition system, comprising:
the data acquisition module is used for acquiring various video data and various external data of the target vehicle within a preset time length in real time; wherein each item of video data comprises a video frame and a length of time matched to the video frame;
the external data packaging module is used for filtering all the collected video data based on a preset video filtering rule to obtain all the target video data conforming to the preset filtering rule, and classifying and packaging all the external data based on the collection source of the external data to obtain at least one external data packet;
The video data packaging module is used for inputting each target video data into a preset operation model to obtain operation time parameters, frame acquisition time marking values and marking information matched with each target video data, and packaging the operation time parameters, the frame acquisition time marking values and the marking information with the matched target video data to obtain each video data packet;
and the association packaging module is used for carrying out association packaging on each video data packet and each external data packet according to a preset packaging rule according to the time length and the frame acquisition time mark value in each video data packet so as to be used for data reading of the data recharging system.
8. A data recharging apparatus of an in-vehicle device, which is executed by a data recharging system configured with a plurality of data transmission modules, comprising:
the packaging result acquisition module is used for responding to the user data recharging command and acquiring at least one target packaging result in the external storage module; the external storage module is a storage module with a connection relation with the acquisition system;
the video data recharging module is used for splitting each target packaging result, obtaining each video data packet matched with each packaging result and each external data packet, and recharging the video data packet to the target system through the audio/video transmission module;
The data analysis module is used for analyzing each external data packet to obtain a source marking value matched with each external data packet;
and the external data recharging module is used for carrying out data classification on each external data packet according to the source marking value, and calling at least one data transmission module to respectively send each external data packet based on the classification result so as to recharge each external data packet to the target system.
9. An electronic device, the electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the collected data association method of the in-vehicle apparatus and the data recharging method of the in-vehicle apparatus according to any one of claims 1 to 7.
10. A computer-readable storage medium storing computer instructions for causing a processor to implement the collected data association method of the in-vehicle apparatus and the data recharging method of the in-vehicle apparatus according to any one of claims 1 to 7 when executed.
CN202311854497.9A 2023-12-28 2023-12-28 Collected data association method, data recharging method and device of vehicle-mounted equipment Pending CN117809395A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311854497.9A CN117809395A (en) 2023-12-28 2023-12-28 Collected data association method, data recharging method and device of vehicle-mounted equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311854497.9A CN117809395A (en) 2023-12-28 2023-12-28 Collected data association method, data recharging method and device of vehicle-mounted equipment

Publications (1)

Publication Number Publication Date
CN117809395A true CN117809395A (en) 2024-04-02

Family

ID=90419690

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311854497.9A Pending CN117809395A (en) 2023-12-28 2023-12-28 Collected data association method, data recharging method and device of vehicle-mounted equipment

Country Status (1)

Country Link
CN (1) CN117809395A (en)

Similar Documents

Publication Publication Date Title
CN112994980B (en) Time delay test method, device, electronic equipment and storage medium
CN111275011A (en) Mobile traffic light detection method and device, electronic equipment and storage medium
CN113467875A (en) Training method, prediction method, device, electronic equipment and automatic driving vehicle
EP4020312B1 (en) Traffic light recognition method, apparatus, storage medium and program product
CN113641544B (en) Method, apparatus, device, medium and product for detecting application state
CN114419493A (en) Image annotation method and device, electronic equipment and storage medium
CN117809395A (en) Collected data association method, data recharging method and device of vehicle-mounted equipment
CN114861321A (en) Problem scene extraction method, device, equipment and medium for traffic flow simulation
CN114880498A (en) Event information display method and device, equipment and medium
CN113838477A (en) Packet loss recovery method and device for audio data packet, electronic equipment and storage medium
CN113869439A (en) Data fusion method and device and electronic equipment
CN113408475A (en) Indication signal recognition method, indication signal recognition apparatus, and computer storage medium
CN113836291B (en) Data processing method, device, equipment and storage medium
CN117539840B (en) Log acquisition method, device, equipment and medium
CN116186019B (en) Function integrated intelligent analysis method and device applied to civil aircraft avionics system
CN114299522B (en) Image recognition method device, apparatus and storage medium
CN116340342A (en) Data filtering method and device, electronic equipment and storage medium
CN117201228A (en) Data recharging method and device, electronic equipment and storage medium
CN114490421A (en) Method, device, equipment and storage medium for detecting native rendering performance of application
CN114494945A (en) Traffic light image sampling method and device, electronic equipment and edge computing equipment
CN114332706A (en) Target event determination method and device, storage medium and electronic device
CN118155026A (en) Fusion effect detection method and device, electronic equipment and storage medium
CN115422056A (en) Method and device for processing automatic driving simulation data and electronic equipment
CN116225568A (en) Management method, device and equipment of application system interface and storage medium
CN117041099A (en) Method, device, equipment and medium for determining delay time

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination