CN116563792A - Factory equipment operation data processing method and system applied to safety production management - Google Patents
Factory equipment operation data processing method and system applied to safety production management Download PDFInfo
- Publication number
- CN116563792A CN116563792A CN202310538581.3A CN202310538581A CN116563792A CN 116563792 A CN116563792 A CN 116563792A CN 202310538581 A CN202310538581 A CN 202310538581A CN 116563792 A CN116563792 A CN 116563792A
- Authority
- CN
- China
- Prior art keywords
- video
- key information
- data
- operation monitoring
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004519 manufacturing process Methods 0.000 title claims abstract description 51
- 238000003672 processing method Methods 0.000 title claims abstract description 17
- 238000012544 monitoring process Methods 0.000 claims abstract description 276
- 238000005457 optimization Methods 0.000 claims abstract description 185
- 238000004458 analytical method Methods 0.000 claims abstract description 52
- 238000000034 method Methods 0.000 claims abstract description 27
- 238000005065 mining Methods 0.000 claims description 96
- 239000013598 vector Substances 0.000 claims description 83
- 238000012790 confirmation Methods 0.000 claims description 54
- 238000012545 processing Methods 0.000 claims description 38
- 238000012512 characterization method Methods 0.000 claims description 30
- 230000010354 integration Effects 0.000 claims description 26
- 238000004590 computer program Methods 0.000 claims description 6
- 238000013473 artificial intelligence Methods 0.000 abstract description 9
- 238000007405 data analysis Methods 0.000 abstract description 5
- 230000000875 corresponding effect Effects 0.000 description 164
- 238000005516 engineering process Methods 0.000 description 11
- 238000010801 machine learning Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 239000000284 extract Substances 0.000 description 4
- 238000013507 mapping Methods 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000004913 activation Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 230000002787 reinforcement Effects 0.000 description 1
- 238000013526 transfer learning Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/048—Activation functions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Medical Informatics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Molecular Biology (AREA)
- General Engineering & Computer Science (AREA)
- Mathematical Physics (AREA)
- Testing And Monitoring For Control Systems (AREA)
Abstract
The invention provides a factory equipment operation data processing method and system applied to safety production management, and relates to the technical field of artificial intelligence. In the invention, a plurality of pieces of typical equipment operation information are extracted, wherein the typical equipment operation information comprises a typical equipment operation monitoring video and a typical optimization operation monitoring video; updating and adjusting the initial video optimization network according to the operation information of a plurality of typical devices; the method comprises the steps that through updating an adjusted initial video optimization network, video optimization operation is conducted on a target equipment operation monitoring video to be processed, so that a target optimization operation monitoring video corresponding to the target equipment operation monitoring video is formed; and performing operation state analysis operation on the target optimization operation monitoring video through an equipment operation state analysis network formed by updating and adjusting operation so as to output operation state analysis data corresponding to the target factory equipment. Based on the above, the reliability of the operation data analysis can be improved to some extent.
Description
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a factory equipment operation data processing method and system applied to safe production management.
Background
In the safety production management of a factory, operation data collection operation of factory equipment is generally performed first, for example, operation video monitoring is performed on the factory equipment to obtain a corresponding monitoring video, then operation state analysis operation can be performed on the monitoring video through analysis, for example, operation state analysis can be performed on the monitoring video based on an artificial intelligence technology. The artificial intelligence technology is a comprehensive discipline, and has a hardware level technology and a software level technology. Artificial intelligence infrastructure technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technologies, operation/interaction systems, electromechanical integration, and the like. The artificial intelligence software technology mainly comprises a computer vision technology, a voice processing technology, a natural language processing technology, machine learning/deep learning, automatic driving, intelligent traffic and other directions. Among them, machine learning (MachineLearning, ML) is a multi-domain interdisciplinary, involving multiple disciplines such as probability theory, statistics, approximation theory, convex analysis, algorithm complexity theory, etc. It is specially studied how a computer simulates or implements learning behavior of a human to acquire new knowledge or skills, and reorganizes existing knowledge structures to continuously improve own performance. Machine learning is the core of artificial intelligence, a fundamental approach to letting computers have intelligence, which is applied throughout various areas of artificial intelligence. Machine learning and deep learning typically include techniques such as artificial neural networks, confidence networks, reinforcement learning, transfer learning, induction learning, teaching learning, and the like.
However, in the prior art, in the process of analyzing the monitoring video based on the artificial intelligence technology, there is a problem that the reliability of analysis is not high.
Disclosure of Invention
In view of the above, the present invention is directed to a method and a system for processing operation data of a plant equipment, which are applied to safety production management, so as to improve the reliability of the operation data analysis to a certain extent.
In order to achieve the above purpose, the embodiment of the present invention adopts the following technical scheme:
a plant operation data processing method applied to secure production management, the plant operation data processing method comprising:
extracting a plurality of pieces of typical equipment operation information, wherein the typical equipment operation information comprises a typical equipment operation monitoring video and a typical optimization operation monitoring video corresponding to the typical equipment operation monitoring video;
updating and adjusting the initial video optimization network according to the operation information of the plurality of typical devices;
performing video optimization operation on the target equipment operation monitoring video to be processed through updating the adjusted initial video optimization network to form target optimization operation monitoring video corresponding to the target equipment operation monitoring video, wherein the number of video frames included in the target optimization operation monitoring video is smaller than or equal to the number of video frames included in the target equipment operation monitoring video, and the target equipment operation monitoring video is formed based on video monitoring on target factory equipment;
And performing operation state analysis operation on the target optimized operation monitoring video through an equipment operation state analysis network formed by updating and adjusting operation so as to output operation state analysis data corresponding to the target plant equipment, wherein the operation state analysis data is used for reflecting the operation safety degree of the target plant equipment and is used as a basis for safety production management.
In some preferred embodiments, in the plant operation data processing method applied to the safety production management, the step of updating and adjusting the initial video optimization network according to the plurality of typical plant operation information includes:
analyzing typical video representing data corresponding to the typical optimization operation monitoring video according to a pending video frame cluster and the typical optimization operation monitoring video, wherein the pending video frame cluster comprises a plurality of pending video frames, and the typical video representing data is used for reflecting probability parameters of each pending video frame belonging to the typical optimization operation monitoring video;
analyzing and mining the typical equipment operation monitoring video through the initial video optimization network to output corresponding mining video representing data, wherein the mining video representing data are used for reflecting probability parameters of mining optimization operation monitoring video corresponding to the typical equipment operation monitoring video of each pending video frame;
And updating and adjusting the initial video optimization network according to the representative video data and the mined video representative data.
In some preferred embodiments, in the above plant operation data processing method applied to safety production management, the initial video optimization network includes a key information mining model, a key information integration model and a key information restoration model, and the step of performing, by the initial video optimization network, analysis mining operation on the typical plant operation monitoring video to output corresponding mined video representative data includes:
performing key information mining operation on the typical equipment operation monitoring video through the key information mining model so as to output video key information description vectors corresponding to each monitoring video segment in the typical equipment operation monitoring video;
vector integration operation is carried out on the multiple excavated video key information description vectors through the key information integration model so as to output corresponding integrated key information description vectors;
and carrying out key information restoration operation according to the integrated key information description vector through the key information restoration model so as to output corresponding mining video representing data.
In some preferred embodiments, in the above plant operation data processing method applied to safety production management, the mined video representing data includes local mined video representing data corresponding to a plurality of frame coordinates in the mined optimized operation monitoring video, the local mined video representing data includes a mined video representing parameter corresponding to each of the pending video frames, and the mined video representing parameter is used for reflecting a probability parameter that the pending video frame belongs to a video frame on a corresponding frame coordinate in the mined optimized operation monitoring video;
the step of performing key information restoration operation according to the integrated key information description vector through the key information restoration model to output corresponding mining video representing data includes:
performing key information restoration operation on the integrated key information description vector through the key information restoration model to output corresponding previous local mining video representing data, and marking a to-be-determined video frame corresponding to a mining video representing parameter with the maximum value in the previous local mining video representing data to be marked as a first optimized video frame;
And carrying out key information restoration operation on the integrated key information description vector based on the marked optimized video frame through the key information restoration model so as to output corresponding subsequent local mining video representing data, marking the to-be-determined video frame corresponding to the mining video representing parameter with the maximum value in the subsequent local mining video representing data so as to be marked as a second optimized video frame, and finishing when the marked optimized video frame belongs to an ending video frame, wherein the ending video frame is a blank video frame and is used for reflecting the video end of the mining optimized operation monitoring video.
In some preferred embodiments, in the plant operation data processing method applied to the safety production management, the typical video representing data includes local typical video representing data corresponding to a plurality of frame coordinates in the typical optimization operation monitoring video, the local typical video representing data is used for reflecting probability parameters of each of the pending video frames belonging to a video frame on a corresponding frame coordinate in the typical optimization operation monitoring video, the mining video representing data includes local mining video representing data corresponding to a plurality of frame coordinates in the mining optimization operation monitoring video, and the local mining video representing data is used for reflecting probability parameters of each of the pending video frames belonging to a video frame on a corresponding frame coordinate in the mining optimization operation monitoring video;
The step of updating and adjusting the initial video optimization network according to the representative video data and the mined video representative data comprises the following steps:
according to the distinguishing information between the local mining video representing data and the local typical video representing data corresponding to each frame coordinate, analyzing a local error index corresponding to each frame coordinate;
according to the analyzed local error indexes, calculating a corresponding target error index, wherein the target error index and the local error indexes have positive correlation corresponding relations;
and updating and adjusting the initial video optimization network according to the target error index.
In some preferred embodiments, in the above method for processing plant operation data applied to safety production management, the step of performing video optimization operation on a target device operation monitoring video to be processed by updating the adjusted initial video optimization network to form a target optimization operation monitoring video corresponding to the target device operation monitoring video includes:
analyzing and mining the target equipment operation monitoring video through the initial video optimization network to output corresponding video representing data, and analyzing a plurality of confirmation video frames belonging to the target optimization operation monitoring video from a plurality of pending video frames included in a pending video frame cluster based on the video representing data, wherein the video representing data is used for reflecting probability parameters of each pending video frame belonging to the target optimization operation monitoring video corresponding to the target equipment operation monitoring video;
And carrying out combination operation on each confirmation video frame to form a target optimization operation monitoring video corresponding to the target equipment operation monitoring video.
In some preferred embodiments, in the above plant operation data processing method applied to safety production management, the initial video optimization network includes a key information mining model, a key information integration model and a key information restoration model, the step of performing, by the initial video optimization network, an analysis mining operation on the target plant operation monitoring video to output corresponding video representative data, and analyzing, based on the video representative data, a plurality of confirm video frames belonging to the target optimization operation monitoring video from a plurality of pending video frames included in a pending video frame cluster, includes:
performing key information mining operation on the target equipment operation monitoring video through the key information mining model so as to output video key information characterization vectors corresponding to each monitoring video segment in the target equipment operation monitoring video;
vector integration operation is carried out on the multiple excavated video key information characterization vectors through the key information integration model so as to output corresponding integrated key information characterization vectors;
Performing key information restoration operation according to the integrated key information characterization vector through the key information restoration model to output corresponding video representation data, and analyzing a plurality of confirmation video frames belonging to the target optimization operation monitoring video from a plurality of undetermined video frames based on the video representation data;
the step of performing key information mining operation on the target device operation monitoring video by the key information mining model to output video key information characterization vectors corresponding to each monitoring video segment in the target device operation monitoring video comprises the following steps:
analyzing local ending video frames in the operation monitoring video of the target equipment through the key information mining model, marking video frames before the first local ending video frame to be marked as one monitoring video segment, and marking video frames between every two local ending video frames to be marked as one monitoring video segment; and carrying out key information mining operation on each monitoring video segment through the key information mining model so as to output a video key information characterization vector corresponding to each monitoring video segment.
In some preferred embodiments, in the plant operation data processing method applied to safety production management, the video representing data includes local video representing data corresponding to a plurality of frame coordinates in the target optimized operation monitoring video, the local video representing data includes video representing parameters corresponding to each of the pending video frames, and the video representing parameters are used for reflecting probability parameters that the pending video frames belong to video frames on corresponding frame coordinates in the target optimized operation monitoring video;
the step of performing key information restoration operation according to the integrated key information characterization vector through the key information restoration model to output corresponding video representation data, and analyzing a plurality of confirmation video frames belonging to the target optimization operation monitoring video from a plurality of undetermined video frames based on the video representation data, includes:
performing key information restoration operation on the integrated key information representation vector through the key information restoration model to output corresponding previous local video representation data, and marking a to-be-determined video frame corresponding to a video representation parameter with the maximum value in the previous local video representation data to be a first confirmation video frame;
And carrying out key information restoration operation on the integrated key information characterization vector based on the marked confirmation video frame through the key information restoration model so as to output corresponding subsequent local video representation data, marking the to-be-determined video frame corresponding to the video representation parameter with the maximum value in the subsequent local video representation data so as to be marked as a second confirmation video frame, and finishing when the marked confirmation video frame is an ending video frame, wherein the ending video frame is a blank video frame and is used for reflecting the video end of the target optimization operation monitoring video.
In some preferred embodiments, in the plant operation data processing method applied to safety production management, the video representing data includes local video representing data corresponding to a plurality of frame coordinates in the target optimized operation monitoring video, the local video representing data includes video representing parameters corresponding to each of the pending video frames, and the video representing parameters are used for reflecting probability parameters that the pending video frames belong to video frames on corresponding frame coordinates in the target optimized operation monitoring video;
the step of performing key information restoration operation according to the integrated key information characterization vector through the key information restoration model to output corresponding video representation data, and analyzing a plurality of confirmation video frames belonging to the target optimization operation monitoring video from a plurality of undetermined video frames based on the video representation data, includes:
Performing key information restoration operation on the integrated key information representation vector based on different video frames through the key information restoration model to output a plurality of video representation data, marking a pending video frame corresponding to a video representation parameter with the maximum value in each local video representation data in the video representation data for each video representation data to be a confirmation video frame, and performing combination operation on the marked plurality of confirmation video frames to form a confirmation video frame cluster corresponding to the video representation data;
analyzing the combined video representing parameters corresponding to each confirmation video frame cluster, wherein the combined video representing parameters and the video representing parameters corresponding to a plurality of confirmation video frames in the confirmation video frame cluster have a positive correlation corresponding relation;
and determining a plurality of confirmation video frames in the confirmation video frame cluster with the maximum merging video representing parameter from the confirmation video frame clusters.
The embodiment of the invention also provides a factory equipment operation data processing system applied to safety production management, which comprises a processor and a memory, wherein the memory is used for storing a computer program, and the processor is used for executing the computer program to realize the method.
The method and the system for processing the operation data of the factory equipment, which are applied to the safety production management, can firstly extract a plurality of pieces of typical equipment operation information, wherein the typical equipment operation information comprises a typical equipment operation monitoring video and a typical optimization operation monitoring video; updating and adjusting the initial video optimization network according to the operation information of a plurality of typical devices; the method comprises the steps that through updating an adjusted initial video optimization network, video optimization operation is conducted on a target equipment operation monitoring video to be processed, so that a target optimization operation monitoring video corresponding to the target equipment operation monitoring video is formed; and performing operation state analysis operation on the target optimization operation monitoring video through an equipment operation state analysis network formed by updating and adjusting operation so as to output operation state analysis data corresponding to the target factory equipment. Based on the foregoing, before the operation state analysis operation is performed, the video optimization operation is performed on the target device operation monitoring video based on the updated and adjusted initial video optimization network, so that the obtained target optimization operation monitoring video is more simplified to a certain extent, that is, the number of video frames included in the target optimization operation monitoring video is less than or equal to the number of video frames included in the target device operation monitoring video, that is, the basis of the operation state analysis operation is more simplified, so that the reliability of operation data analysis can be improved to a certain extent, and the problem of low reliability in the prior art can be solved.
In order to make the above objects, features and advantages of the present invention more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
FIG. 1 is a block diagram of a plant operation data processing system for secure production management according to an embodiment of the present invention.
Fig. 2 is a schematic flow chart of steps involved in a method for processing plant operation data applied to safety production management according to an embodiment of the present invention.
FIG. 3 is a schematic diagram of modules included in a plant operation data processing apparatus for secure production management according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only some embodiments of the present invention, but not all embodiments of the present invention. The components of the embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the invention, as presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
As shown in FIG. 1, an embodiment of the present invention provides a plant operation data processing system for secure production management. Wherein the plant operation data processing system applied to the safety production management may include a memory and a processor.
In detail, the memory and the processor are electrically connected directly or indirectly to realize transmission or interaction of data. For example, electrical connection may be made to each other via one or more communication buses or signal lines. The memory may store at least one software functional module (computer program) that may exist in the form of software or firmware. The processor may be configured to execute the executable computer program stored in the memory, so as to implement the factory equipment operation data processing method applied to the safety production management provided by the embodiment of the invention.
It is to be appreciated that in some embodiments, the Memory can be, but is not limited to, random access Memory (RandomAccessMemory, RAM), read Only Memory (ROM), programmable Read Only Memory (PROM), erasable Programmable Read Only Memory (EPROM), electrically erasable programmable Read Only Memory (ElectricErasableProgrammable Read-OnlyMemory, EEPROM), and the like.
It will be appreciated that in some specific embodiments, the processor may be a general purpose processor, including a central processor (CentralProcessingUnit, CPU), a network processor (NetworkProcessor, NP), a system on chip (SystemonChip, soC), and the like; but also Digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
It will be appreciated that in some embodiments, the plant operating data processing system for secure production management may be a server having data processing capabilities.
With reference to fig. 2, an embodiment of the present invention further provides a method for processing plant operation data applied to secure production management, which may be applied to the above-mentioned plant operation data processing system applied to secure production management. The method steps defined by the flow related to the factory equipment operation data processing method applied to the safety production management can be realized by the factory equipment operation data processing system applied to the safety production management. The specific flow shown in fig. 2 will be described in detail.
Step S110 extracts a plurality of typical device operation information.
In an embodiment of the present invention, the plant operation data processing system applied to the safety production management may extract a plurality of typical plant operation information. The typical equipment operation information comprises typical equipment operation monitoring videos and typical optimization operation monitoring videos corresponding to the typical equipment operation monitoring videos, wherein the typical optimization operation monitoring videos belong to the monitoring videos after the typical equipment operation monitoring videos are simplified and can be used as corresponding tag videos. In addition, the typical device operation monitoring video can be obtained by manually simplifying the typical operation monitoring video, wherein in the manual simplifying process, the typical device operation monitoring video comprises, but is not limited to, screening out video frames, editing and replacing video frames and the like.
Step S120, updating and adjusting the initial video optimization network according to the plurality of typical device operation information.
In the embodiment of the invention, the factory equipment operation data processing system applied to the safety production management can update and adjust the initial video optimization network according to the plurality of pieces of typical equipment operation information (including typical equipment operation monitoring videos and corresponding typical optimization operation monitoring videos). In this way, the updated and adjusted initial video optimization network can learn the mapping relation between the typical equipment operation monitoring video and the corresponding typical optimization operation monitoring video, so that the updated and adjusted initial video optimization network can perform video optimization operation on the target equipment operation monitoring video to be processed based on the mapping relation, and the corresponding target optimization operation monitoring video is obtained.
And step S130, performing video optimization operation on the target equipment operation monitoring video to be processed through updating the adjusted initial video optimization network so as to form a target optimization operation monitoring video corresponding to the target equipment operation monitoring video.
In the embodiment of the invention, the factory equipment operation data processing system applied to the safety production management can perform video optimization operation on the target equipment operation monitoring video to be processed through updating the adjusted initial video optimization network so as to form a target optimization operation monitoring video corresponding to the target equipment operation monitoring video. The number of video frames included in the target optimization operation monitoring video is smaller than or equal to the number of video frames included in the target equipment operation monitoring video, namely, the video frames are simplified and optimized to a certain extent, and the target equipment operation monitoring video is formed based on video monitoring of target factory equipment.
And step S140, performing operation state analysis operation on the target optimized operation monitoring video through an equipment operation state analysis network formed by updating and adjusting operation so as to output operation state analysis data corresponding to the target plant equipment.
In the embodiment of the invention, the plant equipment operation data processing system applied to the safety production management can perform operation state analysis operation on the target optimized operation monitoring video through an equipment operation state analysis network formed by updating and adjusting operation so as to output operation state analysis data corresponding to the target plant equipment. The operation state analysis data is used for reflecting the operation safety degree of the target plant equipment and is used as a basis for safety production management, for example, the operation safety degree is used as a condition for triggering operations such as safety production alarm and the like. The equipment operation state analysis network can learn through the corresponding operation monitoring video and the corresponding operation state label so as to learn the mapping relation therein, namely the equipment operation state analysis network has the function of operation state analysis.
Based on the foregoing, before the operation state analysis operation is performed, the video optimization operation is performed on the target device operation monitoring video based on the updated and adjusted initial video optimization network, so that the obtained target optimization operation monitoring video is more simplified to a certain extent, that is, the number of video frames included in the target optimization operation monitoring video is less than or equal to the number of video frames included in the target device operation monitoring video, that is, the basis of the operation state analysis operation is more simplified, so that the reliability of operation data analysis can be improved to a certain extent, and the problem of low reliability in the prior art (such as more redundancy of the basis of analysis in the prior art) can be improved.
It should be understood that, in some specific embodiments, step S110 in the foregoing embodiments, that is, the step of extracting operation information of a plurality of typical devices, may further include implementation matters described below:
extracting a plurality of initial typical equipment operation information, wherein the initial typical equipment operation information comprises the typical equipment operation monitoring video and an initial optimization operation monitoring video corresponding to the typical equipment operation monitoring video, and the initial optimization operation monitoring video comprises at least two video generalized description information and video detailed description information corresponding to each video generalized description information (namely corresponding monitoring video frames, for example, video detailed description information corresponding to one video generalized description information is obtained by video monitoring of one of at least two local equipment of typical plant equipment);
for each initial typical equipment operation information, dividing the initial optimal operation monitoring video based on at least two video generalized description information in the initial optimal operation monitoring video to form at least two typical optimal operation monitoring videos, wherein each typical optimal operation monitoring video comprises video detailed description information corresponding to one video generalized description information, namely the video detailed description information is taken as a typical optimal operation monitoring video, and combining the typical equipment operation monitoring video with at least two typical optimal operation monitoring videos to form at least two typical equipment operation information.
It may be appreciated that, in some specific embodiments, step S120 in the foregoing embodiments, that is, the step of updating and adjusting the initial video optimization network according to the plurality of typical device operation information, may further include implementation matters described below:
and updating and adjusting one initial video optimization network according to the plurality of pieces of typical equipment operation information corresponding to the same video generalized description information to form at least two initial video optimization networks, namely, because different initial optimization operation monitoring videos comprise the same video generalized description information, a plurality of pieces of typical equipment operation information corresponding to the same video generalized description information exist.
It may be understood that, in some specific embodiments, step S130 in the foregoing embodiments, that is, the step of performing, by updating the adjusted initial video optimization network, video optimization operation on the target device operation monitoring video to be processed to form a target optimization operation monitoring video corresponding to the target device operation monitoring video, further includes the following implementation contents described below:
Operating monitoring videos based on the target equipment respectively through at least two initial video optimization networks, and outputting video detailed description information corresponding to each piece of video generalized description information;
and merging the output at least two video detailed description information (corresponding to at least two initial video optimization networks) and at least two video generalized description information to form a target optimization operation monitoring video corresponding to the target equipment operation monitoring video.
For example, initial typical device operation information a and initial typical device operation information B may be acquired, where the initial typical device operation information a includes a typical device operation monitor video A1 and an initial optimal operation monitor video A2, the initial optimal operation monitor video A2 includes video detailed description information corresponding to the video general description information "local device 1" and video detailed description information corresponding to the video general description information "local device 2", so that the initial optimal operation monitor video A1 is split according to the video general description information to obtain a typical optimal operation monitor video A1 and a typical optimal operation monitor video A2, the typical optimal operation monitor video A1 includes video detailed description information corresponding to the video general description information "local device 1", and the typical optimal operation monitor video A2 includes video detailed description information corresponding to the video general description information "local device 2". Then, the typical equipment operation monitoring video A1 and the typical optimization operation monitoring video A1 may be combined to obtain typical equipment operation information A3, and the typical equipment operation monitoring video A1 and the typical optimization operation monitoring video a2 may be combined to obtain typical equipment operation information A4. In addition, the initial typical device operation information B includes a typical device operation monitor video B1 and an initial optimization operation monitor video B2, the initial optimization operation monitor video B2 includes video detailed description information corresponding to the video general description information "local device 1" (the video detailed description information corresponding to the initial optimization operation monitor video A2 includes the video general description information "local device 1" may correspond to different monitoring angles, etc.) and video detailed description information corresponding to the video general description information "local device 2", and then the initial optimization operation monitor video B2 may be split according to the video general description information to obtain a typical optimization operation monitor video B1 and a typical optimization operation monitor video B2, the typical optimization operation monitor video B1 includes video detailed description information corresponding to the video general description information "local device 1", and the typical optimization operation monitor video B2 includes video detailed description information corresponding to the video general description information "local device 2". Then, the typical device operation monitoring video B1 and the typical optimization operation monitoring video B1 may be combined to obtain the typical device operation information B3, and the typical device operation monitoring video B1 and the typical optimization operation monitoring video B2 may be combined to obtain the typical device operation information B4. Wherein, the typical device operation information A3 and the typical device operation information B3 are typical data corresponding to the video general description information "local device 1", and therefore, the initial video optimization network C1 may be updated and adjusted based on the typical device operation information A3 and the typical device operation information B3, and the initial video optimization network C1 is used for generating the video detailed description information corresponding to the video general description information "local device 1". The typical device operation information A4 and the typical device operation information B4 are typical data corresponding to the video general description information "local device 2", and thus, the initial video optimization network C2 may be updated and adjusted based on the typical device operation information A4 and the typical device operation information B4, and the initial video optimization network C2 is used to generate video detailed description information corresponding to the video general description information "local device 2". Based on this, the video detailed description information D1 corresponding to the video general description information "local device 1" may be generated by operating the monitoring video according to the target device through the initial video optimization network C1, and the video detailed description information D2 corresponding to the video general description information "local device 2" may be generated by operating the monitoring video according to the target device through the initial video optimization network C2. Then, the video general description information "local device 1", the video detailed description information D1, the video general description information "local device 2" and the video detailed description information D2 may be combined to obtain a target optimization operation monitoring video corresponding to the target device operation monitoring video.
It will be appreciated that, in some specific embodiments, step S120 in the foregoing embodiment, that is, the step of updating and adjusting the initial video optimization network according to the plurality of typical device operation information, may further include implementation matters described below:
analyzing typical video representing data corresponding to the typical optimization operation monitoring video according to a pending video frame cluster and the typical optimization operation monitoring video, wherein the pending video frame cluster comprises a plurality of pending video frames, the typical video representing data is used for reflecting probability parameters of each pending video frame belonging to the typical optimization operation monitoring video, and each pending video frame included in the pending video frame cluster can be formed by manually screening, editing and the like based on historical monitoring video frames;
analyzing and mining the typical equipment operation monitoring video through the initial video optimization network to output corresponding mining video representing data, wherein the mining video representing data are used for reflecting probability parameters, namely probability values, of the mining optimization operation monitoring video corresponding to the typical equipment operation monitoring video, of each undetermined video frame;
And updating and adjusting the initial video optimization network according to the typical video representing data and the mined video representing data (distinguishing information between the typical video representing data and the mined video representing data).
It will be appreciated that, in some specific embodiments, the initial video optimization network may include a key information mining model, a key information integration model, and a key information restoration model, based on which the steps of performing, by the initial video optimization network, analysis mining operations on the monitoring video of the typical device to output corresponding mined video representative data may further include implementation matters described below:
performing key information mining operation, such as convolution operation, on the monitoring video operated by the typical equipment through the key information mining model so as to output video key information description vectors corresponding to each monitoring video segment in the monitoring video operated by the typical equipment;
vector integration operation is performed on the mined multiple video key information description vectors through the key information integration model to output corresponding integrated key information description vectors, for example, superposition or cascade combination and other operations can be performed on the mined multiple video key information description vectors to obtain integrated key information description vectors, or further convolution operation can be performed on the results of the superposition or cascade combination and other operations to obtain integrated key information description vectors, or focus feature analysis operation can be performed on the multiple video key information description vectors in pairs, and then superposition or cascade combination and other operations are performed on the results of each focus feature analysis operation;
And carrying out key information restoration operation according to the integrated key information description vector through the key information restoration model so as to output corresponding mining video representing data, for example, carrying out full connection processing and activation processing on the integrated key information description vector, and thus obtaining the corresponding mining video representing data.
It may be appreciated that, in some specific embodiments, the mined video representation data may include local mined video representation data corresponding to a plurality of frame coordinates in the mined optimized operation monitoring video, where the local mined video representation data includes a mined video representation parameter corresponding to each of the pending video frames, where the mined video representation parameter is used to reflect a probability parameter that the pending video frame belongs to a video frame on a corresponding frame coordinate in the mined optimized operation monitoring video, based on which, by the key information restoration model, performing a key information restoration operation according to the integrated key information description vector to output a corresponding mined video representation data, and may further include implementation contents described below:
performing key information restoration operation on the integrated key information description vector through the key information restoration model to output corresponding previous local mining video representing data, and marking a to-be-determined video frame corresponding to a mining video representing parameter with the maximum value in the previous local mining video representing data to be marked as a first optimized video frame;
And carrying out key information restoration operation on the integrated key information description vector based on the marked optimized video frame by the key information restoration model so as to output corresponding subsequent local mining video representing data, and marking the pending video frame corresponding to the mining video representing parameter with the maximum value in the subsequent local mining video representing data as a second optimized video frame, so that the process can be carried out circularly, and the process can be completed when the marked optimized video frame belongs to an end video frame, wherein the end video frame is a blank video frame and is used for reflecting the video end of the mining optimized operation monitoring video, namely, the process of representing that the key information restoration operation is completed.
It will be appreciated that in some specific embodiments, the representative video data may include local representative video data corresponding to a plurality of frame coordinates in the representative optimization run monitor video, the local representative video representative data being used to reflect probability parameters of each of the pending video frames belonging to video frames on a corresponding frame coordinate in the representative optimization run monitor video, the mined video representative data may include local representative mined video data corresponding to a plurality of frame coordinates in the mined optimization run monitor video, the local representative mined video data being used to reflect probability parameters of each of the pending video frames belonging to video frames on a corresponding frame coordinate in the mined optimization run monitor video, based on which the step of updating the initial video optimization network according to the representative video representative data and the mined video representative data may further include the following implementation steps:
According to the distinguishing information between the local mining video representing data and the local typical video representing data corresponding to each frame coordinate, analyzing a local error index corresponding to each frame coordinate, wherein the local error index and the distinguishing information can be positively correlated;
according to the analyzed local error indexes, corresponding target error indexes are calculated, and the target error indexes and the local error indexes have positive correlation corresponding relations, for example, the local error indexes can be summed or weighted and summed;
and updating and adjusting the initial video optimization network according to the target error index, for example, updating and adjusting network parameters included in the initial video optimization network based on the requirement of reducing the target error index until the current target error index is smaller than a preset value, and the like.
It may be appreciated that, in some specific embodiments, step S130 in the foregoing embodiments, that is, the step of performing, by updating the adjusted initial video optimization network, video optimization operation on the target device operation monitoring video to be processed to form a target optimized operation monitoring video corresponding to the target device operation monitoring video may further include implementation contents described below:
Analyzing and mining the target equipment operation monitoring video through the initial video optimization network to output corresponding video representing data, and analyzing a plurality of confirmation video frames belonging to the target optimization operation monitoring video from a plurality of pending video frames included in a pending video frame cluster based on the video representing data, wherein the video representing data is used for reflecting probability parameters, namely probability values, of the target optimization operation monitoring video corresponding to the target equipment operation monitoring video, of each pending video frame;
and carrying out combination operation on each confirmation video frame to form a target optimization operation monitoring video corresponding to the target equipment operation monitoring video, namely, the target optimization operation monitoring video can comprise each confirmation video frame.
It will be appreciated that in some specific embodiments, the initial video optimization network may include a key information mining model, a key information integration model, and a key information restoration model, based on which, the steps of performing, by the initial video optimization network, analysis mining operations on the target device operation monitoring video to output corresponding video representative data, and analyzing, based on the video representative data, a plurality of acknowledgement video frames belonging to the target optimization operation monitoring video from a plurality of pending video frames included in a pending video frame cluster, further include implementation contents described below:
Performing key information mining operation on the target equipment operation monitoring video through the key information mining model so as to output video key information characterization vectors corresponding to each monitoring video segment in the target equipment operation monitoring video;
vector integration operation is carried out on the excavated multiple video key information characterization vectors through the key information integration model so as to output corresponding integrated key information characterization vectors, the vector integration operation can refer to the related description, and the characterization vectors and the description vectors refer to representation of corresponding key information through vector forms;
and carrying out key information restoration operation according to the integrated key information characterization vector through the key information restoration model so as to output corresponding video representing data, and analyzing a plurality of confirmation video frames belonging to the target optimization operation monitoring video from a plurality of undetermined video frames based on the video representing data.
It may be appreciated that in some specific embodiments, the target device operation monitoring video may include a local end video frame, where the local end video frame is used to reflect a video segment end of the monitoring video segment, based on this, the step of performing, by using the key information mining model, key information mining operation on the target device operation monitoring video to output a video key information characterization vector corresponding to each monitoring video segment in the target device operation monitoring video may further include implementation content described below:
Analyzing local ending video frames in the target equipment operation monitoring video through the key information mining model, marking video frames before the first local ending video frame to be one monitoring video segment, and marking video frames between every two local ending video frames to be one monitoring video segment, namely, determining that the target equipment operation monitoring video is one-country-free monitoring video segment in the monitoring video, wherein the local ending video frames can belong to blank video frames and serve as marks for ending or dividing the video segments;
and performing key information mining operation on each monitoring video segment through the key information mining model, for example, performing convolution operation on the monitoring video segments to output video key information characterization vectors corresponding to each monitoring video segment.
It may be appreciated that in some specific embodiments, the video representative data may include local video representative data corresponding to a plurality of frame coordinates in the target optimization operation monitoring video, where the local video representative data includes a video representative parameter corresponding to each of the pending video frames, where the video representative parameter is used to reflect a probability parameter that the pending video frame belongs to a video frame on a corresponding frame coordinate in the target optimization operation monitoring video, based on which, by the key information restoration model, a key information restoration operation is performed according to the integrated key information characterization vector to output corresponding video representative data, and based on the video representative data, the step of analyzing, from a plurality of the pending video frames, a plurality of acknowledgement video frames belonging to the target optimization operation monitoring video may further include implementation steps described below:
Performing key information restoration operation on the integrated key information representation vector through the key information restoration model to output corresponding previous local video representation data, and marking a pending video frame corresponding to a video representation parameter with the maximum value in the previous local video representation data to be marked as a first confirmation video frame, wherein the key information restoration operation can comprise corresponding full connection processing and activation processing, and other possible processing procedures;
and carrying out key information restoration operation on the integrated key information characterization vector based on the marked confirmation video frame through the key information restoration model so as to output corresponding subsequent local video representation data, marking the to-be-determined video frame corresponding to the video representation parameter with the maximum value in the subsequent local video representation data so as to be marked as a second confirmation video frame, and finishing when the marked confirmation video frame is an ending video frame, wherein the ending video frame is a blank video frame and is used for reflecting the video end of the target optimization operation monitoring video.
It may be appreciated that, in some specific embodiments, the video representative data may include local video representative data corresponding to a plurality of frame coordinates in the target optimization operation monitoring video, the local video representative data may include video representative parameters corresponding to each of the pending video frames, the video representative parameters are used to reflect probability parameters of the pending video frames belonging to the video frames on the corresponding frame coordinates in the target optimization operation monitoring video, based on this, the performing, by the key information restoration model, a key information restoration operation according to the integrated key information characterization vector to output corresponding video representative data, and, based on the video representative data, the step of analyzing, from a plurality of the pending video frames, a plurality of acknowledgement video frames belonging to the target optimization operation monitoring video may further include implementation steps described below:
Performing key information restoration operation on the integrated key information representation vector based on different video frames through the key information restoration model to output a plurality of video representation data, marking a pending video frame corresponding to a video representation parameter with the maximum value in each local video representation data in the video representation data for each video representation data to be a confirmation video frame, and performing combination operation on the marked plurality of confirmation video frames to form a confirmation video frame cluster corresponding to the video representation data;
analyzing the merged video representing parameters corresponding to each of the confirmed video frame clusters, wherein the merged video representing parameters and the video representing parameters corresponding to a plurality of confirmed video frames in the confirmed video frame clusters have a corresponding relation of positive correlation, for example, the video representing parameters corresponding to the confirmed video frames can be subjected to average value or summation calculation to obtain the merged video representing parameters;
and determining a plurality of confirmation video frames in the confirmation video frame cluster with the maximum merging video representing parameter from the confirmation video frame clusters.
It may be appreciated that, in some specific embodiments, the step of performing, by the key information restoration model, key information restoration operation on the integrated key information representation vector based on different video frames to output a plurality of the video representation data, and for each of the video representation data, marking a pending video frame corresponding to a video representation parameter having a maximum value in each of the local video representation data to be a confirm video frame, and performing a combination operation on the marked plurality of confirm video frames to form a confirm video frame cluster corresponding to the video representation data may further include the following implementation steps:
performing key information restoration operation on the integrated key information representation vector through the key information restoration model to output previous local video representation data, and marking pending video frames corresponding to a first number of video representation parameters with the maximum value in the previous local video representation data respectively to obtain first confirmation video frames, wherein the number of the video representation data is equal to the first number, and the first confirmation video frames can be used as first frame video frames;
For each first acknowledgement video frame, performing key information restoration operation on the integrated key information characterization vector based on the first acknowledgement video frame through the key information restoration model, so as to output corresponding subsequent local video representing data, marking a pending video frame corresponding to a video representing parameter with the largest value in the subsequent local video representing data as a second acknowledgement video frame, and distributing the second acknowledgement video frame to an acknowledgement video frame cluster to which the first acknowledgement video frame belongs, so that a third acknowledgement video frame, a fifth acknowledgement video frame and the like can be marked in sequence, and when the marked acknowledgement video frame belongs to an end video frame, distributing the end video frame to the acknowledgement video frame cluster to which the first acknowledgement video frame belongs, wherein the end video frame is used for reflecting the video end of the target optimal operation monitoring video, and each first acknowledgement video frame is distributed to a different acknowledgement video frame cluster.
It may be appreciated that, in some specific embodiments, the step of performing, by the key information restoration model, the key information restoration operation on the integrated key information representation vector based on the first acknowledgement video frame to output corresponding subsequent local video representation data may further include implementation content described below:
Performing key information mining operation on the first confirmation video frame through the key information mining model to output a video frame key information description vector corresponding to the first confirmation video frame;
vector integration operation is performed on the video frame key information description vector and the integration key information representation vector so as to output a corresponding first integration representation vector (for other confirmed video frames, vector integration operation can be performed on the video frame key information description vector corresponding to each confirmed video frame and the integration key information representation vector together so as to output a corresponding integration representation vector);
and through the key information restoration model, carrying out key information restoration operation based on the first integrated characterization vector line so as to output corresponding subsequent local video representing data.
With reference to fig. 3, an embodiment of the present invention further provides a plant operation data processing device applied to secure production management, which may be applied to the above-mentioned plant operation data processing system applied to secure production management. Wherein the plant operation data processing apparatus (a software virtual apparatus) applied to the secure production management may include:
The system comprises a typical information extraction module, a storage module and a storage module, wherein the typical information extraction module is used for extracting a plurality of pieces of typical equipment operation information, and the typical equipment operation information comprises typical equipment operation monitoring videos and typical optimization operation monitoring videos corresponding to the typical equipment operation monitoring videos;
the network updating and adjusting module is used for updating and adjusting the initial video optimization network according to the plurality of pieces of typical equipment operation information;
the monitoring video optimization module is used for carrying out video optimization operation on the target equipment operation monitoring video to be processed through updating the adjusted initial video optimization network so as to form target optimization operation monitoring video corresponding to the target equipment operation monitoring video, the number of video frames included in the target optimization operation monitoring video is smaller than or equal to the number of video frames included in the target equipment operation monitoring video, and the target equipment operation monitoring video is formed based on video monitoring on target factory equipment;
the running state analysis module is used for carrying out running state analysis operation on the target optimizing running monitoring video through a device running state analysis network formed by updating and adjusting operation so as to output running state analysis data corresponding to the target plant device, wherein the running state analysis data is used for reflecting the running safety degree of the target plant device and is used as the basis of safety production management.
In summary, the method and the system for processing plant equipment operation data applied to safety production management provided by the invention can extract a plurality of pieces of typical equipment operation information, wherein the typical equipment operation information comprises a typical equipment operation monitoring video and a typical optimization operation monitoring video; updating and adjusting the initial video optimization network according to the operation information of a plurality of typical devices; the method comprises the steps that through updating an adjusted initial video optimization network, video optimization operation is conducted on a target equipment operation monitoring video to be processed, so that a target optimization operation monitoring video corresponding to the target equipment operation monitoring video is formed; and performing operation state analysis operation on the target optimization operation monitoring video through an equipment operation state analysis network formed by updating and adjusting operation so as to output operation state analysis data corresponding to the target factory equipment. Based on the foregoing, before the operation state analysis operation is performed, the video optimization operation is performed on the target device operation monitoring video based on the updated and adjusted initial video optimization network, so that the obtained target optimization operation monitoring video is more simplified to a certain extent, that is, the number of video frames included in the target optimization operation monitoring video is less than or equal to the number of video frames included in the target device operation monitoring video, that is, the basis of the operation state analysis operation is more simplified, so that the reliability of operation data analysis can be improved to a certain extent, and the problem of low reliability in the prior art can be solved.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A plant operation data processing method applied to secure production management, characterized in that the plant operation data processing method comprises:
extracting a plurality of pieces of typical equipment operation information, wherein the typical equipment operation information comprises a typical equipment operation monitoring video and a typical optimization operation monitoring video corresponding to the typical equipment operation monitoring video;
updating and adjusting the initial video optimization network according to the operation information of the plurality of typical devices;
performing video optimization operation on the target equipment operation monitoring video to be processed through updating the adjusted initial video optimization network to form target optimization operation monitoring video corresponding to the target equipment operation monitoring video, wherein the number of video frames included in the target optimization operation monitoring video is smaller than or equal to the number of video frames included in the target equipment operation monitoring video, and the target equipment operation monitoring video is formed based on video monitoring on target factory equipment;
And performing operation state analysis operation on the target optimized operation monitoring video through an equipment operation state analysis network formed by updating and adjusting operation so as to output operation state analysis data corresponding to the target plant equipment, wherein the operation state analysis data is used for reflecting the operation safety degree of the target plant equipment and is used as a basis for safety production management.
2. The method for processing plant operation data for secure production management according to claim 1, wherein the step of updating and adjusting the initial video optimization network according to the plurality of pieces of typical plant operation information comprises:
analyzing typical video representing data corresponding to the typical optimization operation monitoring video according to a pending video frame cluster and the typical optimization operation monitoring video, wherein the pending video frame cluster comprises a plurality of pending video frames, and the typical video representing data is used for reflecting probability parameters of each pending video frame belonging to the typical optimization operation monitoring video;
analyzing and mining the typical equipment operation monitoring video through the initial video optimization network to output corresponding mining video representing data, wherein the mining video representing data are used for reflecting probability parameters of mining optimization operation monitoring video corresponding to the typical equipment operation monitoring video of each pending video frame;
And updating and adjusting the initial video optimization network according to the representative video data and the mined video representative data.
3. The method for processing plant operation data for safety production management according to claim 2, wherein the initial video optimization network includes a key information mining model, a key information integration model and a key information restoration model, and the step of performing an analysis mining operation on the typical plant operation monitoring video through the initial video optimization network to output corresponding mined video representative data includes:
performing key information mining operation on the typical equipment operation monitoring video through the key information mining model so as to output video key information description vectors corresponding to each monitoring video segment in the typical equipment operation monitoring video;
vector integration operation is carried out on the multiple excavated video key information description vectors through the key information integration model so as to output corresponding integrated key information description vectors;
and carrying out key information restoration operation according to the integrated key information description vector through the key information restoration model so as to output corresponding mining video representing data.
4. The method for processing plant operation data applied to safety production management according to claim 3, wherein the mined video representing data comprises locally mined video representing data corresponding to a plurality of frame coordinates in the mined optimized operation monitoring video, the locally mined video representing data comprises mined video representing parameters corresponding to each of the pending video frames, and the mined video representing parameters are used for reflecting probability parameters of the pending video frames belonging to video frames on corresponding frame coordinates in the mined optimized operation monitoring video;
the step of performing key information restoration operation according to the integrated key information description vector through the key information restoration model to output corresponding mining video representing data includes:
performing key information restoration operation on the integrated key information description vector through the key information restoration model to output corresponding previous local mining video representing data, and marking a to-be-determined video frame corresponding to a mining video representing parameter with the maximum value in the previous local mining video representing data to be marked as a first optimized video frame;
And carrying out key information restoration operation on the integrated key information description vector based on the marked optimized video frame through the key information restoration model so as to output corresponding subsequent local mining video representing data, marking the to-be-determined video frame corresponding to the mining video representing parameter with the maximum value in the subsequent local mining video representing data so as to be marked as a second optimized video frame, and finishing when the marked optimized video frame belongs to an ending video frame, wherein the ending video frame is a blank video frame and is used for reflecting the video end of the mining optimized operation monitoring video.
5. The method for processing plant operation data applied to safety production management according to claim 2, wherein the typical video representing data includes local typical video representing data corresponding to a plurality of frame coordinates in the typical optimum operation monitoring video, the local typical video representing data being used for reflecting probability parameters of each of the pending video frames belonging to video frames on the corresponding frame coordinates in the typical optimum operation monitoring video, the mining video representing data including local mining video representing data corresponding to a plurality of frame coordinates in the mining optimum operation monitoring video, the local mining video representing data being used for reflecting probability parameters of each of the pending video frames belonging to video frames on the corresponding frame coordinates in the mining optimum operation monitoring video;
The step of updating and adjusting the initial video optimization network according to the representative video data and the mined video representative data comprises the following steps:
according to the distinguishing information between the local mining video representing data and the local typical video representing data corresponding to each frame coordinate, analyzing a local error index corresponding to each frame coordinate;
according to the analyzed local error indexes, calculating a corresponding target error index, wherein the target error index and the local error indexes have positive correlation corresponding relations;
and updating and adjusting the initial video optimization network according to the target error index.
6. The method for processing plant operation data applied to safe production management according to claim 1, wherein the step of performing video optimization operation on the target device operation monitoring video to be processed by updating the adjusted initial video optimization network to form a target optimization operation monitoring video corresponding to the target device operation monitoring video comprises the steps of:
analyzing and mining the target equipment operation monitoring video through the initial video optimization network to output corresponding video representing data, and analyzing a plurality of confirmation video frames belonging to the target optimization operation monitoring video from a plurality of pending video frames included in a pending video frame cluster based on the video representing data, wherein the video representing data is used for reflecting probability parameters of each pending video frame belonging to the target optimization operation monitoring video corresponding to the target equipment operation monitoring video;
And carrying out combination operation on each confirmation video frame to form a target optimization operation monitoring video corresponding to the target equipment operation monitoring video.
7. The method for processing plant operation data applied to safety production management according to claim 6, wherein the initial video optimization network includes a key information mining model, a key information integration model and a key information restoration model, the step of performing an analysis mining operation on the target plant operation monitoring video through the initial video optimization network to output corresponding video representative data, and analyzing a plurality of confirm video frames belonging to the target optimization operation monitoring video from a plurality of pending video frames included in a pending video frame cluster based on the video representative data, comprises:
performing key information mining operation on the target equipment operation monitoring video through the key information mining model so as to output video key information characterization vectors corresponding to each monitoring video segment in the target equipment operation monitoring video;
vector integration operation is carried out on the multiple excavated video key information characterization vectors through the key information integration model so as to output corresponding integrated key information characterization vectors;
Performing key information restoration operation according to the integrated key information characterization vector through the key information restoration model to output corresponding video representation data, and analyzing a plurality of confirmation video frames belonging to the target optimization operation monitoring video from a plurality of undetermined video frames based on the video representation data;
the step of performing key information mining operation on the target device operation monitoring video by the key information mining model to output video key information characterization vectors corresponding to each monitoring video segment in the target device operation monitoring video comprises the following steps:
analyzing local ending video frames in the operation monitoring video of the target equipment through the key information mining model, marking video frames before the first local ending video frame to be marked as one monitoring video segment, and marking video frames between every two local ending video frames to be marked as one monitoring video segment; and carrying out key information mining operation on each monitoring video segment through the key information mining model so as to output a video key information characterization vector corresponding to each monitoring video segment.
8. The method for processing plant operation data applied to safety production management according to claim 7, wherein the video representing data includes local video representing data corresponding to a plurality of frame coordinates in the target optimal operation monitoring video, the local video representing data includes video representing parameters corresponding to each of the pending video frames, the video representing parameters being used for reflecting probability parameters that the pending video frames belong to video frames on corresponding frame coordinates in the target optimal operation monitoring video;
the step of performing key information restoration operation according to the integrated key information characterization vector through the key information restoration model to output corresponding video representation data, and analyzing a plurality of confirmation video frames belonging to the target optimization operation monitoring video from a plurality of undetermined video frames based on the video representation data, includes:
performing key information restoration operation on the integrated key information representation vector through the key information restoration model to output corresponding previous local video representation data, and marking a to-be-determined video frame corresponding to a video representation parameter with the maximum value in the previous local video representation data to be a first confirmation video frame;
And carrying out key information restoration operation on the integrated key information characterization vector based on the marked confirmation video frame through the key information restoration model so as to output corresponding subsequent local video representation data, marking the to-be-determined video frame corresponding to the video representation parameter with the maximum value in the subsequent local video representation data so as to be marked as a second confirmation video frame, and finishing when the marked confirmation video frame is an ending video frame, wherein the ending video frame is a blank video frame and is used for reflecting the video end of the target optimization operation monitoring video.
9. The method for processing plant operation data applied to safety production management according to claim 7, wherein the video representing data includes local video representing data corresponding to a plurality of frame coordinates in the target optimal operation monitoring video, the local video representing data includes video representing parameters corresponding to each of the pending video frames, the video representing parameters being used for reflecting probability parameters that the pending video frames belong to video frames on corresponding frame coordinates in the target optimal operation monitoring video;
the step of performing key information restoration operation according to the integrated key information characterization vector through the key information restoration model to output corresponding video representation data, and analyzing a plurality of confirmation video frames belonging to the target optimization operation monitoring video from a plurality of undetermined video frames based on the video representation data, includes:
Performing key information restoration operation on the integrated key information representation vector based on different video frames through the key information restoration model to output a plurality of video representation data, marking a pending video frame corresponding to a video representation parameter with the maximum value in each local video representation data in the video representation data for each video representation data to be a confirmation video frame, and performing combination operation on the marked plurality of confirmation video frames to form a confirmation video frame cluster corresponding to the video representation data;
analyzing the combined video representing parameters corresponding to each confirmation video frame cluster, wherein the combined video representing parameters and the video representing parameters corresponding to a plurality of confirmation video frames in the confirmation video frame cluster have a positive correlation corresponding relation;
and determining a plurality of confirmation video frames in the confirmation video frame cluster with the maximum merging video representing parameter from the confirmation video frame clusters.
10. A plant operating data processing system for use in secure production management, comprising a processor and a memory, the memory being for storing a computer program, the processor being for executing the computer program to implement the method of any one of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310538581.3A CN116563792A (en) | 2023-05-15 | 2023-05-15 | Factory equipment operation data processing method and system applied to safety production management |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310538581.3A CN116563792A (en) | 2023-05-15 | 2023-05-15 | Factory equipment operation data processing method and system applied to safety production management |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116563792A true CN116563792A (en) | 2023-08-08 |
Family
ID=87501449
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310538581.3A Pending CN116563792A (en) | 2023-05-15 | 2023-05-15 | Factory equipment operation data processing method and system applied to safety production management |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116563792A (en) |
-
2023
- 2023-05-15 CN CN202310538581.3A patent/CN116563792A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113282461B (en) | Alarm identification method and device for transmission network | |
| CN111435366A (en) | Equipment fault diagnosis method and device and electronic equipment | |
| CN111563524A (en) | Multi-station fusion system operation situation abnormity monitoring and alarm combining method | |
| CN109633369B (en) | Power grid fault diagnosis method based on multi-dimensional data similarity matching | |
| EP3907671A2 (en) | Method and apparatus for incrementally training model | |
| CN112415331B (en) | Power grid secondary system fault diagnosis method based on multi-source fault information | |
| CN116310914B (en) | Unmanned aerial vehicle monitoring method and system based on artificial intelligence | |
| CN113902007A (en) | Model training method and device, image recognition method and device, equipment and medium | |
| CN112651916A (en) | Method, system and medium for pre-training of self-monitoring model | |
| CN114328106A (en) | Log data processing method, device, equipment and storage medium | |
| CN116304341A (en) | Fraud discrimination method and system based on user network big data | |
| CN114139781A (en) | Method and system for predicting operation trend of power system | |
| CN115984158A (en) | Defect analysis method and device, electronic equipment and computer readable storage medium | |
| CN117666546A (en) | Distributed control system fault diagnosis method and device | |
| CN113870052A (en) | Multi-input LSTM-CNN-based work ticket security measure identification method and terminal | |
| CN116737800A (en) | Big data mining method and system applied to supply chain platform service | |
| CN116563792A (en) | Factory equipment operation data processing method and system applied to safety production management | |
| CN116361440A (en) | Digital financial product session interaction method and system based on artificial intelligence | |
| CN114140731B (en) | Traction substation abnormality detection method | |
| CN113821418B (en) | Fault root cause analysis method and device, storage medium and electronic equipment | |
| CN113947195A (en) | Model determination method and device, electronic equipment and memory | |
| CN113886140A (en) | Artificial intelligence model output data judgment system based on credibility verification | |
| CN113159107A (en) | Exception handling method and device | |
| CN117667495B (en) | Association rule and deep learning integrated application system fault prediction method | |
| CN116521761B (en) | Sensor operation behavior mining method and system based on artificial intelligence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |