CN115334122A - Abnormity monitoring method, device and storage medium based on multi-terminal fusion access - Google Patents
Abnormity monitoring method, device and storage medium based on multi-terminal fusion access Download PDFInfo
- Publication number
- CN115334122A CN115334122A CN202211232515.5A CN202211232515A CN115334122A CN 115334122 A CN115334122 A CN 115334122A CN 202211232515 A CN202211232515 A CN 202211232515A CN 115334122 A CN115334122 A CN 115334122A
- Authority
- CN
- China
- Prior art keywords
- data
- image
- terminal
- access
- abnormal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Medical Informatics (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses an anomaly monitoring method, an anomaly monitoring device and a storage medium based on multi-terminal fusion access, wherein the method comprises the following steps: acquiring an abnormal monitoring scheme configured by a user according to an actual application scene; establishing communication connection with a corresponding acquisition terminal through a data access interface and acquiring first data generated by the acquisition terminal; performing data filtering on the first data to obtain second data, and respectively sending the second data to an audio and video storage module and an image recognition engine; comparing the second data by adopting a preset abnormal image identification template, and outputting an image comparison result; if the image comparison result is that an abnormal image exists, generating alarm information corresponding to the abnormal image; and transmitting the second data stored by the audio and video storage module and the alarm information generated by the alarm function module to the superior server in real time. The data access is more flexible, the subsequent expansion is convenient, and the operation and maintenance cost is reduced.
Description
Technical Field
The invention relates to the technical field of data acquisition, in particular to an abnormity monitoring method and device based on multi-terminal fusion access and a storage medium.
Background
With the rapid development of the internet of things technology, technologies such as security monitoring, environment monitoring, access control and the like are gradually developed and matured, and due to safety considerations, applications of various industries emerge endlessly. For industries with diversified functional requirements and high reliability requirements, such as rail transit industry and the like, on one hand, various monitoring devices are extremely numerous and complicated, have diversified types and have high operating pressure; on the other hand, the manpower cost also increases year by year, different subsystems often need different professionals to maintain, and the cost of system operation and maintenance is not small.
Therefore, how to apply a new technology to realize access of various monitoring/monitoring terminals, improve the integration level of the system, automatically perform early warning and reporting on the system, and timely inform operation and maintenance personnel after system failure, thereby reducing labor input becomes a problem to be solved urgently.
Disclosure of Invention
The embodiment of the application aims to realize automatic acquisition of data of various monitoring/monitoring terminals so as to reduce labor cost by providing an abnormity monitoring method, device and storage medium based on multi-terminal fusion access.
In order to achieve the above object, an embodiment of the present application provides an anomaly monitoring method based on multi-terminal convergence access, which is applied to a multi-terminal convergence access device, where the multi-terminal convergence access device includes: the abnormal monitoring method based on multi-terminal fusion access comprises a data acquisition processing module, an information interaction interface, a data access interface, an audio and video storage module, an image recognition engine, an alarm function module and a data transmission interface, wherein one end of the data access interface is connected with an acquisition terminal, the other end of the data access interface is connected with the data acquisition processing module, and the abnormal monitoring method based on multi-terminal fusion access comprises the following steps:
the data acquisition processing module acquires an abnormal monitoring scheme configured by a user according to an actual application scene through the information interaction interface, wherein the abnormal monitoring scheme comprises a data access scheme and an abnormal detection scheme;
the data acquisition processing module establishes communication connection with a corresponding acquisition terminal through the data access interface based on the data access scheme and acquires first data generated by the acquisition terminal, wherein the first data comprises audio and video data;
the data acquisition processing module performs data filtering on the first data to obtain second data, and the second data are respectively sent to the audio and video storage module and the image recognition engine;
the image recognition engine performs image comparison on the second data by adopting a preset abnormal image recognition template based on the abnormal detection scheme, and outputs an image comparison result;
if the image comparison result is that an abnormal image exists, the alarm function module generates alarm information corresponding to the abnormal image, wherein the alarm information comprises the abnormal image;
and the data transmission interface transmits the second data stored by the audio and video storage module and the alarm information generated by the alarm function module to an upper-level server in real time.
In one embodiment, the data access interface includes a first data access subsystem interface, a second data access subsystem interface and a third data access subsystem interface, the first data access subsystem interface is connected with the high-speed transmission device, the second data access subsystem interface is connected with the low-speed transmission device, and the third data access subsystem interface is connected with the analog/digital device.
In an embodiment, the data access scheme includes an MAC address of the acquisition terminal to be accessed, and a serial baud rate and a communication protocol used for data transmission.
In one embodiment, the anomaly detection scheme includes: the method comprises a data source to be detected, an abnormal image identification template library and an image similarity calculation formula.
In one embodiment, the image similarity calculation formula is as follows:
1≤i≤m-M+1，1≤j≤n-N+1
the image size of the template image is M N, the image size of the comparison image is M N, S (i + S-1, j + T-1) represents the pixel coordinate of the upper left corner of the overlapped part of the template image and the comparison image, T (S, T) represents the pixel coordinate of the template image in the comparison image in the image comparison process, and P (i, j) represents the similarity of the overlapped part of the template image and the comparison image at the position of the pixel coordinate (i, j) in the image comparison process.
In an embodiment, the multi-terminal fusion access device further includes a heartbeat generator, and the heartbeat generator is respectively connected with the data acquisition processing module and the alarm function module, and uploads a heartbeat signal with a fixed frequency to a superior server in real time through the data transmission interface.
In an embodiment, the method for monitoring an anomaly based on multi-terminal convergence access further includes:
and judging whether the heartbeat signal generated by the heartbeat generator is abnormal in real time, and reporting to a superior server if the heartbeat signal is abnormal.
In one embodiment, the communication protocol includes any one of USB, TCP, or IP, the collection terminal includes a camera, an intelligent terminal, a printer, and a sensor, and the sensor includes a temperature sensor, a humidity sensor, a light intensity sensor, a gravity sensor, and a distance sensor.
In order to achieve the above object, an embodiment of the present invention further provides a multi-terminal convergence access device, where the multi-terminal convergence access device includes a memory, a processor, and an exception monitoring program stored in the memory and capable of running on the processor, and when the processor executes the exception monitoring program, the method for monitoring an exception based on multi-terminal convergence access as described in any one of the above embodiments is implemented.
In order to achieve the above object, an embodiment of the present invention further provides a computer-readable storage medium, where an anomaly monitoring program is stored on the computer-readable storage medium, and when the anomaly monitoring program is executed by a processor, the method for monitoring an anomaly based on multi-terminal fusion access is implemented as any one of the above methods.
According to the multi-terminal fusion input method, the required initial data can be acquired from different application scenes by arranging the plurality of acquisition terminals, meanwhile, the local machine can acquire the initial data from each acquisition terminal, format the acquired initial data to acquire target data in a standard format, and finally send the target data obtained by formatting to the superior server. Therefore, various data in standard formats can be automatically acquired, professional operation and maintenance personnel are not needed to record and upload data of various scenes, real-time monitoring of the scenes can be achieved, and accordingly labor cost input can be greatly reduced. Therefore, the multi-terminal fusion input method has the advantage of reducing labor cost.
Drawings
In order to more clearly illustrate the embodiments or technical solutions of the present invention, the drawings used in the embodiments or technical solutions of the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the structures shown in the drawings without creative efforts.
Fig. 1 is a functional structure diagram of an embodiment of a multi-terminal convergence access apparatus provided in the present invention;
fig. 2 is a schematic flowchart of an embodiment of an anomaly monitoring method based on multi-terminal fusion access according to the present invention;
fig. 3 is a schematic operation flow diagram of the multi-terminal convergence access apparatus provided in the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
For a better understanding of the above technical solutions, exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of "first," "second," and "third," etc. do not denote any order, and such words are to be interpreted as names.
Referring to fig. 1, fig. 1 is a functional structure diagram of an embodiment of a multi-terminal convergence access apparatus provided in the present invention. In this embodiment, the multi-terminal convergence access apparatus includes: the system comprises a data acquisition processing module 101, an information interaction interface 102, a data access interface 103, an audio and video storage module 104, an image recognition engine 105, an alarm function module 106 and a data transmission interface 107, wherein one end of the data access interface 103 is connected with an acquisition terminal, and the other end of the data access interface 103 is connected with the data acquisition processing module 101.
In an embodiment, as shown in fig. 1, the multi-terminal fusion access apparatus further includes a heartbeat generator 108, and the heartbeat generator 108 is connected to the data acquisition processing module 101 and the alarm function module 106, and uploads a heartbeat signal with a fixed frequency to an upper server in real time through the data transmission interface 107.
In an embodiment, the data acquisition processing module 101 can access different types of acquisition terminals through different types of data access interfaces 103, and the data access interfaces of different types improve the flexibility of data access and facilitate subsequent expansion.
The information interaction interface 102 is used for providing an operation interface for interaction between the multi-terminal fusion access device and the outside, such as system configuration, function management, interface control, and the like, and is convenient for a user to set according to an actual application scenario.
The data access interface 103 comprises a first data access subsystem interface, a second data access subsystem interface and a third data access subsystem interface, wherein the first data access subsystem interface is connected with high-speed transmission equipment, such as an intelligent terminal like a camera; the interface of the second data access subsystem is connected with low-speed transmission equipment, such as a printer and other terminals; the third data access subsystem interface is connected with analog quantity/digital quantity equipment, such as a temperature sensor, a humidity sensor and the like.
The data acquisition processing module 101 is used for accessing the data of the acquisition terminal acquired by the data access interface 103 through communication protocol interfaces such as USB/TCP/IP, performing intelligent analysis processing, filtering the data, and reporting the filtered data to a superior server for further processing.
The audio/video storage module 104 is used for storing the audio and video data collected and analyzed by the data collection processing module 101;
the image recognition engine 105 is configured to recognize whether the video data collected by the data collection processing module 101 is abnormal;
the alarm function module 106 is configured to generate alarm information and report the alarm information when an abnormality occurs;
the data transmission interface 107 is configured to transmit the audio and video data stored in the audio and video storage module 104 and the alarm information generated by the alarm function module 106 to the upper level server in real time through a TCP/IP protocol.
At present, various types of acquisition terminals need operation and maintenance personnel to acquire data regularly, even monitor on duty, the workload is heavy, misoperation is easy to occur, and the problem of untimely problem can occur when the problem is found.
The multi-terminal fusion access device provides a terminal access method with multiple interface types, the number of interfaces is large, the expansion is easy, the analysis and the processing of data are carried out after the collection terminals with different types are fused, and the data are uploaded to an upper-level server, so that the types of subsystem terminals are effectively reduced, and operation and maintenance personnel are simplified. Meanwhile, the multi-terminal fusion access device analyzes whether the accessed acquisition terminal is abnormal and gives an alarm in time by analyzing the acquired terminal data, and reports the running state of the multi-terminal fusion access device in real time through a heartbeat transmission mechanism, so that operation and maintenance personnel can locate system faults in time, and the running reliability of the whole system is ensured.
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating an embodiment of an anomaly monitoring method based on multi-terminal convergence access according to the present invention. In this embodiment, the anomaly monitoring method includes:
s201, the data acquisition processing module acquires an abnormal monitoring scheme configured by a user according to an actual application scene through an information interaction interface, wherein the abnormal monitoring scheme comprises a data access scheme and an abnormal detection scheme;
in this embodiment, a user configures an exception monitoring scheme corresponding to an application scenario to be monitored, such as system configuration, function management, interface control, and the like, through an operation interface provided by an information interaction interface, thereby implementing personalized configuration of exception monitoring schemes for various different types of application scenarios.
In one embodiment, the anomaly monitoring scheme includes a data access scheme and an anomaly detection scheme, wherein the data access scheme includes an MAC address of an acquisition terminal to be accessed, a serial baud rate and a communication protocol used by the multi-terminal fusion access device to directly transmit data with the acquisition terminal, and the anomaly detection scheme includes: the method comprises the steps of detecting a data source to be detected (which can be the MAC address or the IP address of an acquisition terminal), an abnormal image identification template library (which contains images of various abnormal targets to be monitored), and an image similarity calculation formula.
S202, the data acquisition processing module establishes communication connection with a corresponding acquisition terminal through a data access interface based on a data access scheme and acquires first data generated by the acquisition terminal, wherein the first data comprises audio and video data;
in this embodiment, the data acquisition processing module establishes a communication connection with a corresponding acquisition terminal through the data access interface according to parameters such as an MAC address and a communication protocol of the acquisition terminal in the data access scheme, and the acquisition terminal sends acquired or generated first data to the data acquisition processing module for analysis processing by using a specified serial port baud rate.
S203, the data acquisition and processing module performs data filtering on the first data to obtain second data, and the second data are respectively sent to the audio and video storage module and the image recognition engine;
in this embodiment, after acquiring first data (initial data) acquired or generated by the acquisition terminal, the data acquisition processing module performs data filtering, for example, to remove invalid data and redundant data, and then sends filtered second data to the audio/video storage module for storage, and simultaneously sends the filtered second data to the image recognition engine for anomaly analysis.
S204, the image recognition engine performs image comparison on the second data by adopting a preset abnormal image recognition template based on the abnormal detection scheme, and outputs an image comparison result;
in this embodiment, the image recognition engine calls an abnormal image recognition template specified in the abnormal image recognition template library and calculates the similarity between the abnormal image recognition template and the image data in the second data by using a specified image similarity calculation formula, where the specific calculation formula is as follows:
1≤i≤m-M+1，1≤j≤n-N+1
the abnormal image identification template is a template image, the image data in the second data is a comparison image, the size of the template image is M x N (height M and width N), the size of the comparison image is M x N (height M and width N), S (i + S-1, j + T-1) represents the pixel coordinate of the upper left corner of the overlapping part of the template image and the comparison image, T (S, T) represents the pixel coordinate of the template image in the comparison image in the image comparison process, and P (i, j) represents the similarity of the overlapping part of the template image and the comparison image at the position of the pixel coordinate (i, j) in the image comparison process.
S205, if the image comparison result is that an abnormal image exists, the alarm function module generates alarm information corresponding to the abnormal image, wherein the alarm information comprises the abnormal image;
in this embodiment, if the image comparison result indicates that an abnormal image exists, an alarm needs to be given, the alarm function module generates alarm information corresponding to the abnormal image, the alarm information includes the abnormal image, and the alarm information further includes text information and/or voice information, so that a worker can quickly know the specific abnormal condition.
And S206, the data transmission interface transmits the second data stored by the audio and video storage module and the alarm information generated by the alarm function module to the superior server in real time.
In this embodiment, the data transmission interface transmits the analyzed and processed data to the upper-level server in real time through a TCP/IP protocol, and specifically includes second data stored in the audio/video storage module and alarm information generated by the alarm function module.
Referring to fig. 3, fig. 3 is a schematic view of an operation flow of the multi-terminal convergence access device provided in the present invention. In this embodiment, the working flow of the multi-terminal convergence access device is as follows:
step 1, confirming the configuration of a hardware module according to an application scene;
in this embodiment, before the multi-terminal fusion access device is formally used, a worker needs to confirm the hardware module configuration of the acquisition terminal corresponding to the application scene, such as the interface types, supported communication protocols, IP addresses, MAC addresses, and the like of the acquisition terminals such as a camera, an intelligent terminal, a printer, a sensor, and the like, according to the application scene to be monitored.
Step 2, each access subsystem is accessed into the device;
the device refers to a multi-terminal fusion access device (hereinafter referred to as a local machine) which establishes communication connection with a plurality of acquisition terminals through a plurality of terminal data interfaces, wherein the data interfaces can be wired interfaces or wireless interfaces. When the terminal data interface is a wired interface, it may be a USB interface, a PS/2 interface, a 3.5mm audio interface, an optical fiber interface, a coaxial interface, an ethernet interface, or the like. When the terminal data interface is a wireless interface, it may be a bluetooth interface, a 3G interface, a 4G interface, a 5G interface, a WiFi interface, a TCP/IP interface, etc.
The number and type of the terminal data interfaces of the multi-terminal fusion access device can be adaptively adjusted according to the number and type of the accessed acquisition terminals, which is not specifically limited in the present application.
Specifically, after the multi-terminal convergence access device is in wired connection or wireless connection with each acquisition terminal, communication connection can be established with each acquisition terminal, and data exchange can be performed.
Step 3, starting the system, and configuring parameters through an information interaction interface;
the system of the machine is started, and the machine is provided with an information exchange interface which is used for a user to perform system parameter configuration, data management, interface control and other behaviors. Generally, the information interaction interface is configured as a graphical user window to facilitate operation by an operator.
Specifically, an operator can configure system parameters of the local computer correspondingly according to the number and the type of the current acquisition terminals connected with the local computer, such as setting an MAC address, a serial port baud rate, a connection sensor type and the like of the local computer, so as to obtain the optimal local computer configuration parameters, reduce the local computer load and improve the working performance of the local computer.
Step 4, the data acquisition and processing module processes the acquired data in parallel;
specifically, after the parameter configuration of the local computer system is completed, initial data (i.e., monitoring/monitoring data) acquired by the acquisition terminals can be periodically acquired from each acquisition terminal based on a preset data transmission rule. The frequency of acquiring data and the data quantity of the acquired data each time from each acquisition terminal can be adjusted in a targeted manner according to the type of each acquisition terminal so as to optimize the data transmission efficiency.
In an embodiment, the data acquisition processing module further performs formatting processing on different types of initial data to obtain target data in a standard format.
The formatting process is to uniformly convert formats of different types of initial data into a preset data format, namely target data in a standard format, on the basis of keeping the expression content of the initial data unchanged. Further, the formatting process of the terminal data includes, but is not limited to, converting the storage format of the original data, adding information labels, and the like. The machine can convert the initial data of the terminal into the data in the standard format by a corresponding formatting method according to the type of the acquired initial data. For example, for analog data, the terminal can convert the analog data into digital data and label information such as time, objects and the like at the same time; for audio data, the machine can convert the audio data into an mp3 format, and simultaneously mark information such as time, objects and the like; for image data, the native machine can convert the image data into a jpg format and label information such as time, objects and the like at the same time; for video data, the machine can convert the video data into mp4 format and label information such as time, object and the like.
Through the processing, multimodal initial data can be automatically converted into target data in a standard format, so that operation and maintenance personnel are not required to manually modify the format of the initial data, and the labor cost can be greatly saved.
In an embodiment, the data collection processing module further filters the collected data.
Specifically, a preset filtering rule of initial data acquired by the current terminal may be determined according to the type of the acquisition terminal or according to the application scenario of the current acquisition terminal, and the initial data may be filtered based on the preset filtering rule. The preset filtering rule may be adaptively designed according to different types or application scenarios of the acquisition terminal, which is not specifically limited in the present application.
It can be understood that filtering the initial data can reduce the data amount on one hand, and can improve the data accuracy on the other hand, so as to facilitate the subsequent processing.
Step 5, judging whether the acquired data has abnormity through an image recognition engine;
after the initial data are filtered, the image recognition engine carries out abnormity discrimination on the initial data so as to judge whether the initial data transmitted by the acquisition terminal are abnormal or not, if so, the alarm function module generates abnormity information aiming at the abnormal condition and sends alarm information to corresponding workers.
Specifically, the initial data includes image data. The image data includes, but is not limited to, picture data, video data and other image data uploaded by an image capturing terminal such as a camera. The image recognition engine can compare the current image data with the pictures in the preset abnormal image library to judge whether the current image data is abnormal or not, and further judge whether the current image acquisition terminal captures the abnormal images or not. If the current image data is matched with any picture in the abnormal image library, the current image data can be judged to be abnormal, and at the moment, alarm information can be sent to corresponding workers.
It can be understood that through intelligent data analysis, can judge that collection terminal monitoring is unusual to in time report operation and maintenance personnel, the problem location is accurate, makes operation and maintenance personnel main energy put on exception handling, but not on the problem point investigation, and then can effectively improve unusual investigation efficiency.
And 6, reporting the acquired and stored data and the detected abnormal image to a superior server.
The upper server is a server connected with the host computer and used for further processing the formatted target data.
Specifically, the multi-modal terminal acquisition data can be further uploaded to an upper-level server after being formatted by the multi-modal terminal acquisition data processing system, so that the acquisition data can be conveniently subjected to a subsequent processor. In addition, the upper-level server is arranged, so that the local computer is only used for data transfer processing, the system load of the local computer can be reduced, the machine carrying amount of the local computer is increased, and the processing speed of data transfer of the local computer is increased.
It can be understood that a plurality of acquisition terminals are arranged to acquire required initial data from different application scenes, and meanwhile, the local computer can acquire the initial data from each acquisition terminal, format the acquired initial data to acquire target data in a standard format, and finally send the target data obtained by formatting to a superior server. Therefore, various data in standard formats can be automatically acquired, professional operation and maintenance personnel are not needed to record and upload data of various scenes, real-time monitoring of the scenes can be achieved, and accordingly labor cost input can be greatly reduced.
In some embodiments, the method of the present application further comprises:
generating a heartbeat signal based on a preset heartbeat mechanism and uploading the heartbeat signal to an upper-level server;
and if the heartbeat signal is abnormal, generating abnormal information and reporting the abnormal information to a superior server, and simultaneously sending alarm information to corresponding workers.
The heartbeat mechanism is a mechanism that sends a self-defined structure (heartbeat packet) at regular time to let the other party know the working state (online or offline) of the other party so as to ensure the validity of the connection.
Specifically, whether the local computer and the upper server keep connection or not can be determined through the heartbeat signal. When the heartbeat signal is abnormal, the abnormal connection between the local computer and the superior server is indicated, and at the moment, abnormal information can be generated according to the disconnection state, and alarm information is sent to corresponding workers. The corresponding staff member refers to the staff member bound with the native machine. The machine can send alarm information to corresponding staff in the modes of mail, telephone, information and the like.
The problem location is accurate, so that the operation and maintenance personnel can pay attention to the exception processing instead of the problem point troubleshooting, and the exception troubleshooting efficiency can be effectively improved.
The embodiment of the present invention further provides a computer-readable storage medium, which may be any one or any combination of a hard disk, a multimedia card, an SD card, a flash memory card, an SMC, a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), a portable compact disc read only memory (CD-ROM), a USB memory, and the like. The computer readable storage medium includes an anomaly monitoring program, and the specific implementation of the computer readable storage medium of the present invention is substantially the same as the specific implementation of the anomaly monitoring method based on multi-terminal convergence access, which is not described herein again.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. An abnormity monitoring method based on multi-terminal fusion access is applied to a multi-terminal fusion access device, and is characterized in that the multi-terminal fusion access device comprises the following steps: the abnormal monitoring method based on the multi-terminal fusion access comprises a data acquisition processing module, an information interaction interface, a data access interface, an audio and video storage module, an image recognition engine, an alarm function module and a data transmission interface, wherein one end of the data access interface is connected with an acquisition terminal, the other end of the data access interface is connected with the data acquisition processing module, and the abnormal monitoring method based on the multi-terminal fusion access comprises the following steps:
the data acquisition processing module acquires an abnormal monitoring scheme configured by a user according to an actual application scene through the information interaction interface, wherein the abnormal monitoring scheme comprises a data access scheme and an abnormal detection scheme;
the data acquisition processing module establishes communication connection with a corresponding acquisition terminal through the data access interface based on the data access scheme and acquires first data generated by the acquisition terminal, wherein the first data comprises audio and video data;
the data acquisition processing module performs data filtering on the first data to obtain second data, and the second data are respectively sent to the audio and video storage module and the image recognition engine;
the image recognition engine performs image comparison on the second data by adopting a preset abnormal image recognition template based on the abnormal detection scheme, and outputs an image comparison result;
if the image comparison result indicates that an abnormal image exists, the alarm function module generates alarm information corresponding to the abnormal image, wherein the alarm information comprises the abnormal image;
and the data transmission interface transmits the second data stored by the audio and video storage module and the alarm information generated by the alarm function module to an upper-level server in real time.
2. The method for monitoring the abnormality based on the multi-terminal fusion access according to claim 1, wherein the data access interface includes a first data access subsystem interface, a second data access subsystem interface and a third data access subsystem interface, the first data access subsystem interface is connected with a high-speed transmission device, the second data access subsystem interface is connected with a low-speed transmission device, and the third data access subsystem interface is connected with an analog/digital device.
3. The abnormality monitoring method based on the multi-terminal fusion access according to claim 1, characterized in that the data access scheme includes the MAC address of the acquisition terminal to be accessed and the serial baud rate and communication protocol adopted for data transmission.
4. The method for monitoring the abnormality based on the multi-terminal fusion access according to claim 1, wherein the abnormality detecting scheme includes: the method comprises a data source to be detected, an abnormal image identification template library and an image similarity calculation formula.
5. The abnormal monitoring method based on multi-terminal fusion access according to claim 4, wherein the image similarity calculation formula is as follows:
1≤i≤m-M+1，1≤j≤n-N+1
the image size of the template image is M N, the image size of the comparison image is M N, S (i + S-1, j + T-1) represents the pixel coordinate of the upper left corner of the overlapped part of the template image and the comparison image, T (S, T) represents the pixel coordinate of the template image in the comparison image in the image comparison process, and P (i, j) represents the similarity of the overlapped part of the template image and the comparison image at the position of the pixel coordinate (i, j) in the image comparison process.
6. The abnormality monitoring method based on multi-terminal fusion access according to claim 1, characterized in that the multi-terminal fusion access device further comprises a heartbeat generator, the heartbeat generator is respectively connected with the data acquisition processing module and the alarm function module, and uploads a heartbeat signal with a fixed frequency to an upper server in real time through the data transmission interface.
7. The method for monitoring the abnormality based on the multi-terminal converged access of claim 6, wherein the method for monitoring the abnormality based on the multi-terminal converged access further comprises:
and judging whether the heartbeat signal generated by the heartbeat generator is abnormal in real time, and reporting to a superior server if the heartbeat signal is abnormal.
8. The abnormality monitoring method based on multi-terminal convergence access according to claim 3, wherein the communication protocol includes any one of USB, TCP or IP, the acquisition terminal includes a camera, an intelligent terminal, a printer and sensors, and the sensors include a temperature sensor, a humidity sensor, a light intensity sensor, a gravity sensor and a distance sensor.
9. A multi-terminal converged access device, comprising a memory, a processor and an anomaly monitoring program stored in the memory and executable on the processor, wherein the processor implements the anomaly monitoring method based on multi-terminal converged access according to any one of claims 1 to 8 when executing the anomaly monitoring program.
10. A computer-readable storage medium, wherein an anomaly monitoring program is stored on the computer-readable storage medium, and when executed by a processor, the anomaly monitoring program implements the anomaly monitoring method based on multi-terminal converged access according to any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211232515.5A CN115334122B (en) | 2022-10-10 | 2022-10-10 | Abnormity monitoring method, device and storage medium based on multi-terminal fusion access |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211232515.5A CN115334122B (en) | 2022-10-10 | 2022-10-10 | Abnormity monitoring method, device and storage medium based on multi-terminal fusion access |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115334122A true CN115334122A (en) | 2022-11-11 |
| CN115334122B CN115334122B (en) | 2022-12-30 |
Family
ID=83913273
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211232515.5A Active CN115334122B (en) | 2022-10-10 | 2022-10-10 | Abnormity monitoring method, device and storage medium based on multi-terminal fusion access |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115334122B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105578143A (en) * | 2015-12-29 | 2016-05-11 | 成都移动魔方科技有限公司 | Intelligent remote monitoring system |
| CN105743712A (en) * | 2016-04-12 | 2016-07-06 | 中国铁道科学研究院电子计算技术研究所 | PIS (Passenger Information System) external interface monitoring system and method |
| CN106851229A (en) * | 2017-04-01 | 2017-06-13 | 山东瀚岳智能科技股份有限公司 | A kind of method and system of the security protection intelligent decision based on image recognition |
| US10665251B1 (en) * | 2019-02-27 | 2020-05-26 | International Business Machines Corporation | Multi-modal anomaly detection |
| CN111275845A (en) * | 2020-02-21 | 2020-06-12 | 中国科学院声学研究所东海研究站 | Intelligent inspection method, system and storage medium |
| US20210090736A1 (en) * | 2019-09-24 | 2021-03-25 | Shanghai United Imaging Intelligence Co., Ltd. | Systems and methods for anomaly detection for a medical procedure |
| CN114530936A (en) * | 2022-01-27 | 2022-05-24 | 江苏德胜电气股份有限公司 | Data monitoring method and system for power system and storage medium |
-
2022
- 2022-10-10 CN CN202211232515.5A patent/CN115334122B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105578143A (en) * | 2015-12-29 | 2016-05-11 | 成都移动魔方科技有限公司 | Intelligent remote monitoring system |
| CN105743712A (en) * | 2016-04-12 | 2016-07-06 | 中国铁道科学研究院电子计算技术研究所 | PIS (Passenger Information System) external interface monitoring system and method |
| CN106851229A (en) * | 2017-04-01 | 2017-06-13 | 山东瀚岳智能科技股份有限公司 | A kind of method and system of the security protection intelligent decision based on image recognition |
| US10665251B1 (en) * | 2019-02-27 | 2020-05-26 | International Business Machines Corporation | Multi-modal anomaly detection |
| US20210090736A1 (en) * | 2019-09-24 | 2021-03-25 | Shanghai United Imaging Intelligence Co., Ltd. | Systems and methods for anomaly detection for a medical procedure |
| CN111275845A (en) * | 2020-02-21 | 2020-06-12 | 中国科学院声学研究所东海研究站 | Intelligent inspection method, system and storage medium |
| CN114530936A (en) * | 2022-01-27 | 2022-05-24 | 江苏德胜电气股份有限公司 | Data monitoring method and system for power system and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115334122B (en) | 2022-12-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116209963A (en) | Fault diagnosis and solution recommendation method, device, system and storage medium | |
| CN110769175B (en) | Intelligent analysis system, method and device | |
| KR101794005B1 (en) | Error detection system for network camera | |
| CN110807460A (en) | Transformer substation intelligent patrol system based on image recognition and application method thereof | |
| CN109359032B (en) | Test data collection method, device and system and electronic equipment | |
| CN112652085A (en) | Computer room inspection data processing method, device and system and storage medium | |
| CN113343998A (en) | Reading monitoring system and method for electric power mechanical meter, computer equipment and application | |
| CN115334122B (en) | Abnormity monitoring method, device and storage medium based on multi-terminal fusion access | |
| CN104182445A (en) | Method and device for detecting equipment quality of train running monitoring device | |
| CN105530658A (en) | Remote diagnosis method of wireless communication module, device and system | |
| CN116580362A (en) | Transmission operation cross-system fusion data acquisition method and digital asset processing system | |
| CN112711603A (en) | Workpiece detection method and system based on cloud and computer-readable storage medium | |
| CN111062932A (en) | Monitoring method of network service program | |
| CN113052340B (en) | Early warning method, system and storage medium for aggregating multi-source data | |
| CN113421355A (en) | Industrial field short-distance data transmission system and inspection method | |
| TWM528432U (en) | Heat inspection apparatus and system including the same | |
| CN110545202A (en) | Equipment management system based on cloud platform | |
| TWI579581B (en) | Heat Inspection Apparatus, System Including The Same, And Method Thereof | |
| US20240221107A1 (en) | Apparatus and method for image data acquisition and processing | |
| TWI801830B (en) | Monitoring system and method thereof | |
| CN105760481B (en) | A kind of mobile terminal and the associated method of background management system task | |
| CN111225290B (en) | Epidemic situation propaganda video data security processing method and device | |
| CN113810250B (en) | Message tracking method, system and equipment | |
| CN115937877A (en) | Information collection method and device, electronic equipment and information collection system | |
| CN117422952A (en) | Artificial intelligent image recognition model management method and device and cloud edge service platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |