CN113301381A - Multi-source data playback system - Google Patents
Multi-source data playback system Download PDFInfo
- Publication number
- CN113301381A CN113301381A CN202110532311.2A CN202110532311A CN113301381A CN 113301381 A CN113301381 A CN 113301381A CN 202110532311 A CN202110532311 A CN 202110532311A CN 113301381 A CN113301381 A CN 113301381A
- Authority
- CN
- China
- Prior art keywords
- data
- playback
- key
- video stream
- control device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23106—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/008—Registering or indicating the working of vehicles communicating information to a remotely located station
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/41422—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance located in transportation means, e.g. personal vehicle
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The present invention provides a multi-source data playback system, comprising: the single-machine side control device is used for collecting and processing data generated by components of the hoisting machinery, converting the data into data with a uniform format and uploading the data, wherein the data comprises key-value data and video streams; and the central control side control device is used for receiving and storing the data from the single machine control device and synchronously playing back the key-value data and the video stream. According to the invention, by collecting multi-source data and synchronously replaying component data and video streams in real time, dock technicians can be assisted to quickly locate faults and accidents, and problems can be quickly solved.
Description
Technical Field
The invention relates to automatic crane calculation, in particular to a multi-source data playback system suitable for an automatic crane.
Background
Along with the automation degree of the port crane is higher and higher, the number of sensing devices on each crane device is larger and larger, such as various sensors, variable frequency driving devices, high-precision detection devices, industrial cameras and the like. The automated hoisting equipment also needs to receive the instructions of the equipment management system and the dispatching system and work cooperatively with the control system. The cooperation relation of each system of the crane is precise and complex, and once a fault or accident occurs, the technical requirements on personnel for troubleshooting and solving the problem are higher.
Disclosure of Invention
Accordingly, the present invention provides a multi-source data playback system suitable for use in an automated lifting machine.
In order to solve the technical problems, the invention adopts the following technical scheme:
a multi-source data playback system according to an embodiment of the present invention includes:
the single-machine side control device is used for collecting and processing data generated by components of the hoisting machinery, converting the data into data with a uniform format and uploading the data, wherein the data comprises key-value data and video streams;
and the middle control side control device is used for receiving and storing the data from the single machine control device and synchronously playing back the key-value data and the video stream.
Further, the stand-alone side control device includes:
the detector is used for acquiring and processing data generated by components of the hoisting machinery;
and the data gateway is used for classifying the data acquired by the detector and uploading the data to the central control and control device.
Further, the data gateway is configured to:
encapsulating the key-vlaue data into a message body and transmitting the message body to the central control side control device;
and compressing the video stream corresponding to the key-value and transmitting the compressed video stream to the central control side control device.
Further, the center-control-side control device includes:
the monitoring video server is used for storing video stream data uploaded by the data gateway;
the time sequence database is used for storing key-value data uploaded by the data gateway;
and the synchronous playback client is used for synchronously playing back the stored video stream data and the key-value data according to frames.
Further, the synchronized playback client is to: and controlling the frame position of video stream playing by taking the time of key-value data playback as a baseline so as to synchronously play back the key-value data and the video stream data.
Further, the synchronized playback client is to: and after the image data of the video stream is cached in a segmented mode, playing the video stream.
Further, playing back the stored video stream data and key-value data in frame synchronization includes:
when the playback starts, the synchronous playback client calls a playback start interface to start the playback;
when the playback is stopped, the synchronous playback client calls a playback stop interface to stop the playback;
and when the frame jumps, the synchronous playback client calls a frame jump interface and inputs the target frame time to carry out frame jump.
Furthermore, when the synchronous playback client calls the playback start interface, the synchronous playback client searches whether the image data of the target frame moment is cached or not,
if the cache exists, directly playing the data image;
if no buffer memory exists, the buffered data is cleared, the image data in a period of time after the target frame time is obtained again and buffered, and the image data at the target frame time is played.
Further, the target frame time is within the range of the playback period input by the playback start interface.
Further, the data gateway is used for acquiring data through the embedded driver.
Compared with the prior art, the heavy carrier roller device has at least one of the following beneficial effects:
1. the embodiment of the invention adopts a plurality of sensing devices to monitor the hoisting machinery and store a plurality of corresponding data and videos, thereby being beneficial to the rapid playback and positioning of engineering personnel;
2. in addition, the embodiment of the invention plays back the data in a frame playback mode, so that the data and the video playback are consistent and continuous and smooth.
Drawings
FIG. 1 is an architecture diagram of a multi-source data playback system according to an embodiment of the present invention;
fig. 2 is a block diagram of an SoC of a multi-source data playback system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without any inventive step, are within the scope of the present invention.
The cooperation relationship of each system of the crane is precise and complex, and once a fault or an accident occurs, technicians need to inquire various systems to trace problems, which takes a long time. According to the invention, a multi-source data playback system is adopted, so that the monitoring key-value data of a plurality of components on the hoisting machinery is extracted and played back synchronously with the video data, and the problem troubleshooting efficiency is effectively improved.
Referring to fig. 1, fig. 1 is an architecture diagram of a multi-source data playback system, as shown in fig. 1, the architecture diagram includes a single-machine-side control device and a central control device, the single-machine-side control device includes a plurality of detectors 110 and a data gateway 111, and the central control device includes a monitoring video server 120, a timing database 121, and a synchronous playback client 122.
The single-machine side control device is used for collecting and processing data generated by components of the hoisting machinery, converting the data into data with a uniform format and uploading the data, specifically, the detector 110 in the single-machine side control device is used for collecting and processing data generated by various components of the hoisting machinery, and the detector 110 may include one or more of a camera, a single-machine control system and an intelligent sensing system. For example, the camera may record an operation video of the hoisting machine, and the stand-alone control system may collect information including a motor, a frequency converter, a sensor, and the like of the hoisting machine. The use of the probes 110 to gather information from multiple sources may allow the system to playback more comprehensive information in the event of a failure, thereby helping to locate problems quickly.
Specifically, the data gateway 111 in the stand-alone side control device is used for classifying data collected by the detector 110 and uploading the data to the central control device, and the data gateway 111 supports a common crane control system and acquires PLC (Programmable Logic Controller) data through an embedded driver. The PLC is a computer dedicated to industrial control, and stores therein instructions for performing operations such as logic operation, sequence control, timing, counting, and arithmetic operation, and controls various types of hoisting machinery through digital or analog input/output, and data of the detector 110, such as data of a frequency converter, a motor, and the like, can be acquired and recorded by the PLC. Thus, problems can be accurately located at the time of playback. Meanwhile, the data gateway 111 may support communication between message buses such as MQTT (message Queuing telemeasurement transport), mq (message queue) and the like and a scheduling system, a spreader management system and the like, where MQTT is a message queue Telemetry transport protocol, which is a lightweight communication protocol based on a publish/subscribe mode, and may provide real-time and reliable message service for connecting remote devices with very few codes and limited bandwidth, thereby reducing bandwidth pressure of the data gateway 111 and connecting more subordinate systems.
After receiving the data collected by the detector 110, the data gateway 111 classifies and uploads the data. In particular, the data gateway 111 may separate the data into two categories.
The first type is key-value data, which is a kind of key-value pair data. In the present invention, the detector 110 data is used to store time and corresponding time. In addition, the data gateway 111 may encapsulate the key-value data and transmit the key-value data to the timing database 121 in the central control side control device, for example, the key-value data may be encapsulated into a custom protobuf message body and transmitted to the infiluxdb timing database 121, and the protobuf message body is encoded by using a highly compressed binary system, and has the advantages of cross-language, high transmission efficiency, high extensibility, and the like, so that a large amount of timing data may be quickly transmitted.
The second type is video streaming, and specifically, the data gateway 111 compresses the video streaming collected by the camera and uploads the compressed video streaming to the monitoring video server of the central control side control device.
The central control side control device is used for receiving and storing the data from the single machine control device and synchronously playing back the key-value data and the video stream. Specifically, the center-control-side control device includes: the monitoring video server is used for storing video stream data uploaded by the data gateway 111; the time sequence database 121 is used for storing key-value data uploaded by the data gateway 111; and a synchronous playback client 122 for playing back the stored video stream data and key-value data in frame synchronization. When the user plays back data using the synchronized playback client 122, the synchronized playback client 122 initiates a playback request to the timing database 121 and the monitoring video server, and retrieves the key-value data and the video stream data to start playing back the data.
In one embodiment of the present application, the synchronous playback client 122 controls the frame position of the video stream playing based on the time of key-value data playback, and the synchronous playback client 122 is in the process of data playback. Due to the fact that the playback speed is adjusted in the playback process, the playing speed of the key-value data and the playing speed of the video data are not always consistent, and the key-value data and the video data are not played synchronously. Therefore, the hollow side control device controls the frame position of video stream playing by taking the time of key-value data playback as a baseline, and controls the frame position of video stream playing by acquiring the playing time of each frame of image when the key-value data is played back, so that the playback can be carried out according to frames, and the two can be played synchronously.
Further, when the stored video stream data and key-value data are played back in frame synchronization, the interface may be called to control playing, specifically, when playback starts, the synchronized playback client 122 calls a playback start interface to start playback, more specifically, a video source and a playback time period may be input in the interface to start playback, and after playback starts, an identifier of a playback task is returned, where the identifier of the playback task is an internally defined data structure for distinguishing and operating different playback tasks.
When stopping the playback, the synchronous playback client 122 calls the playback stop interface to stop the playback, and more specifically, an identifier of the playback task may be input to the interface, and the interface finds a corresponding playback task using the identifier of the playback task and stops the playback.
When frame skipping, the synchronous playback client 122 calls a frame skipping interface, and inputs a target frame time to perform frame skipping. More specifically, the identifier of the playback task and the target frame time may be input to the interface to perform frame skipping, the interface searches for the corresponding playback task and performs frame skipping by using the identifier of the playback task and the target frame time, and in addition, the target frame time needs to be within the playback time period input by the playback start interface, otherwise, an error may be returned.
Still further, the synchronized playback client 122 may invoke the frame hop interface to achieve further playback synchronization, and specifically, the synchronized playback client 122 performs the frame hop interface for the playback task of each data and passes the same playback target time to the multiple playback task frame hop interfaces to achieve synchronization.
In addition, the synchronized playback client 122 may buffer video data that may be played in segments, and when the synchronized playback client 122 calls a playback start interface, search for image data at the target frame time with or without buffer, and if there is buffer, directly play data images; if no buffer memory exists, the buffered data is cleared, the image data in a period of time after the target frame time is obtained again and buffered, and the image data at the target frame time is played.
Referring now to fig. 2, shown is a block diagram of a SoC (System on Chip) 1300 in accordance with an embodiment of the present application. In fig. 2, similar components have the same reference numerals. In addition, the dashed box is an optional feature of more advanced socs. In fig. 2, SoC1300 includes: an interconnect unit 1350 coupled to the application processor 1310; a system agent unit 1380; a bus controller unit 1390; an integrated memory controller unit 1340; a set or one or more coprocessors 1320 which may include integrated graphics logic, an image processor, an audio processor, and a video processor; a Static Random Access Memory (SRAM) unit 1330; a Direct Memory Access (DMA) unit 1360. In one embodiment, the coprocessor 1320 includes a special-purpose processor, such as, for example, a network or communication processor, compression engine, GPGPU, a high-throughput MIC processor, embedded processor, or the like.
Included in Static Random Access Memory (SRAM) unit 1330 may be one or more computer-readable media for storing data and/or instructions. A computer-readable storage medium may have stored therein instructions, and in particular, temporary and permanent copies of the instructions.
The foregoing is a preferred embodiment of the present invention, and it should be noted that it is obvious to those skilled in the art that various modifications and improvements can be made without departing from the principle of the present invention, and these modifications and improvements should be construed as the protection scope of the present invention.
Claims (10)
1. A multi-source data playback system, comprising:
the single-machine side control device is used for collecting and processing data generated by components of the hoisting machinery, converting the data into data with a uniform format and uploading the data, wherein the data comprises key-value data and video streams;
and the central control side control device is used for receiving and storing the data from the single machine control device and synchronously playing back the key-value data and the video stream.
2. The playback system according to claim 1, wherein the stand-alone side control means includes:
the detector is used for acquiring and processing data generated by components of the hoisting machinery;
and the data gateway is used for classifying the data collected by the detector and uploading the data to the central control and measurement control device.
3. The playback system of claim 2, wherein the data gateway is configured to:
encapsulating the key-vlaue data into a message body and transmitting the message body to the central control side control device;
and compressing the video stream corresponding to the key-value and transmitting the compressed video stream to the central control side control device.
4. The playback system according to claim 2, wherein the center-control-side control means includes:
the monitoring video server is used for storing the video stream data uploaded by the data gateway;
the time sequence database is used for storing the key-value data uploaded by the data gateway;
and the synchronous playback client is used for synchronously playing back the stored video stream data and key-value data according to frames.
5. The playback system of claim 4, wherein the synchronized playback client is configured to: and controlling the frame position of the video stream playing by taking the time of the key-value data playback as a baseline so as to synchronously play back the key-value data and the video stream data.
6. The playback system of claim 5, wherein the synchronized playback client is configured to:
and after the image data of the video stream is cached in a segmented mode, playing the video stream.
7. The playback system according to claim 6, wherein the frame-synchronous playback of the stored video stream data and key-value data includes:
when the playback is started, the synchronous playback client calls a playback start interface to start the playback;
when the playback is stopped, the synchronous playback client calls a playback stop interface to stop the playback;
and when the frame is jumped, the synchronous playback client calls a frame jump interface and inputs the target frame moment to carry out frame jump.
8. The playback system according to claim 7, wherein the synchronous playback client searches for the presence or absence of the buffered image data at the target frame time when calling a playback start interface,
if the cache exists, directly playing the data image;
if no buffer memory exists, the buffered data is cleared, the image data in a period of time after the target frame time is obtained again and buffered, and the image data at the target frame time is played.
9. The playback system of claim 8, wherein the target frame time is within a range of a playback time period input by the playback start interface.
10. The playback system of claim 1, wherein the data gateway is configured to retrieve data via an embedded driver.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110532311.2A CN113301381A (en) | 2021-05-17 | 2021-05-17 | Multi-source data playback system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110532311.2A CN113301381A (en) | 2021-05-17 | 2021-05-17 | Multi-source data playback system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113301381A true CN113301381A (en) | 2021-08-24 |
Family
ID=77322490
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110532311.2A Pending CN113301381A (en) | 2021-05-17 | 2021-05-17 | Multi-source data playback system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113301381A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115766986A (en) * | 2022-09-27 | 2023-03-07 | 天津津航计算技术研究所 | Double-channel video recording device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101224854A (en) * | 2008-01-30 | 2008-07-23 | 太原重工股份有限公司 | Crane integrated observation system and method |
| CN105712220A (en) * | 2014-12-05 | 2016-06-29 | 上海市特种设备监督检验技术研究院 | Black box based on crane monitoring system |
| CN106698197A (en) * | 2016-12-01 | 2017-05-24 | 上海振华重工电气有限公司 | System for online diagnosis and preventive maintenance of container crane based on big data |
| CN109033335A (en) * | 2018-07-20 | 2018-12-18 | 广州酷狗计算机科技有限公司 | Audio recording method, apparatus, terminal and storage medium |
| CN110032112A (en) * | 2019-04-23 | 2019-07-19 | 上海振华重工(集团)股份有限公司 | Harbour service status display system |
-
2021
- 2021-05-17 CN CN202110532311.2A patent/CN113301381A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101224854A (en) * | 2008-01-30 | 2008-07-23 | 太原重工股份有限公司 | Crane integrated observation system and method |
| CN105712220A (en) * | 2014-12-05 | 2016-06-29 | 上海市特种设备监督检验技术研究院 | Black box based on crane monitoring system |
| CN106698197A (en) * | 2016-12-01 | 2017-05-24 | 上海振华重工电气有限公司 | System for online diagnosis and preventive maintenance of container crane based on big data |
| CN109033335A (en) * | 2018-07-20 | 2018-12-18 | 广州酷狗计算机科技有限公司 | Audio recording method, apparatus, terminal and storage medium |
| CN110032112A (en) * | 2019-04-23 | 2019-07-19 | 上海振华重工(集团)股份有限公司 | Harbour service status display system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115766986A (en) * | 2022-09-27 | 2023-03-07 | 天津津航计算技术研究所 | Double-channel video recording device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7936372B2 (en) | Image processing method and system for generating and analyzing metadata and server for such system | |
| US10284808B2 (en) | System and method for supporting selective backtracking data recording | |
| JP7166767B2 (en) | Equipment, manufacturing methods and systems | |
| CN115129430B (en) | Robot remote control instruction issuing method and system based on 5g network | |
| CN113468168B (en) | Multi-source heterogeneous data high-speed acquisition and processing soft control method for hoisting machinery | |
| CN113852785A (en) | Intelligent monitoring and scheduling method, device and system based on 5G | |
| CN109167979B (en) | Processing method and system for artificial intelligence analysis of multi-path monitoring videos | |
| CN113301381A (en) | Multi-source data playback system | |
| US20190302751A1 (en) | System and method for diagnosing automation systems | |
| CN106412474B (en) | A kind of high-speed lossless ultra high-definition industrial vision detection method and system | |
| CN105712220A (en) | Black box based on crane monitoring system | |
| CN111614784A (en) | Edge computing box for heterogeneous data of a worksite | |
| CN114827140A (en) | Real-time data centralized management and control system for wind tunnel site | |
| CN116996112A (en) | Real-time preprocessing method for remote sensing satellite data | |
| US20220245946A1 (en) | Modular surveillance system for an infrastructure and/or a vehicle | |
| CN115643312A (en) | Multi-protocol data acquisition and protocol conversion device based on cloud gateway | |
| CN114727070A (en) | Camera real-time video data processing method and device | |
| JP3957509B2 (en) | Video distribution server and video distribution system | |
| CN111639134A (en) | Industrial link supervision method and system based on block chain | |
| KR20190074271A (en) | Gateway Platform | |
| CN217607830U (en) | Comprehensive network management for smart city | |
| JPH07182032A (en) | Monitoring device for plant data | |
| CN117944041A (en) | Inspection robot control system, inspection robot control method, electronic equipment and storage medium | |
| Xia et al. | Research and Design of Multi-source Signal Integrated Intelligent Monitoring System for Large Ships | |
| CN117676129A (en) | Video stream analysis method, system, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |