CN116527874A - Multi-device abnormal state monitoring method - Google Patents
Multi-device abnormal state monitoring method Download PDFInfo
- Publication number
- CN116527874A CN116527874A CN202310575154.2A CN202310575154A CN116527874A CN 116527874 A CN116527874 A CN 116527874A CN 202310575154 A CN202310575154 A CN 202310575154A CN 116527874 A CN116527874 A CN 116527874A
- Authority
- CN
- China
- Prior art keywords
- equipment
- monitored
- monitoring point
- monitoring
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 307
- 230000002159 abnormal effect Effects 0.000 title claims abstract description 75
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000003384 imaging method Methods 0.000 claims abstract description 91
- 230000015654 memory Effects 0.000 claims description 20
- 230000005856 abnormality Effects 0.000 claims description 18
- 230000001360 synchronised effect Effects 0.000 abstract description 7
- 238000004891 communication Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 8
- 238000004590 computer program Methods 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 239000003086 colorant Substances 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 208000003464 asthenopia Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/02—Diagnosis, testing or measuring for television systems or their details for colour television signals
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Alarm Systems (AREA)
Abstract
The application provides an abnormal state monitoring method of multiple devices, which comprises the following steps: firstly, acquiring equipment state information of each piece of equipment to be monitored, and acquiring position information of each monitoring point corresponding to the equipment to be monitored according to the equipment state information; acquiring imaging color ranges of all monitoring points of the equipment to be monitored in a normal state within a target time range, and establishing a multi-equipment state database according to equipment state information of the equipment to be monitored, monitoring point position information and the imaging color ranges of the monitoring points; then, according to the multi-equipment state database, obtaining the image information of each monitoring point of the equipment to be monitored; and finally, comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range, and carrying out abnormal alarm according to the comparison result. The scheme can be suitable for multi-state synchronous monitoring of large-scale equipment, and can be used for simultaneously monitoring the running states of a plurality of pieces of equipment, so that the efficiency and the accuracy of monitoring the abnormal states of the equipment can be effectively improved.
Description
Technical Field
The application relates to the technical field of image processing, in particular to an abnormal state monitoring method of multiple devices.
Background
With the development of digital image processing and image devices, video image-based monitoring technology has become a research hotspot, for example, in the aerospace field, there are many shipborne devices of an aerospace survey ship, and a large number of device states need to be monitored.
The state monitoring method adopted by the current shipborne equipment mainly comprises the steps of periodically inspecting the abnormal state of the equipment by a person, or periodically checking the abnormal log record of the equipment, and the like. The method for regular inspection of the abnormal state of the equipment by the personnel is easy to miss key alarm information, has high manpower resource consumption, and particularly is easy to generate visual fatigue during night inspection, and has high abnormal state omission probability; the method for checking the equipment abnormal log records regularly is high in accuracy, complex in operation, poor in instantaneity and easy to cause operation errors, and equipment use is affected. Moreover, the simultaneous monitoring of multiple devices is difficult, special situations cannot be considered, the situation of failure of the devices is considered, and the situation of missing key abnormal states of the devices is easy to occur.
Therefore, a method that is applicable to multi-state synchronous monitoring of large-scale equipment and that can effectively improve monitoring efficiency and accuracy is needed.
Disclosure of Invention
The application provides a multi-equipment abnormal state monitoring method which is applicable to multi-state synchronous monitoring of large-scale equipment and can effectively improve the efficiency and accuracy of multi-equipment abnormal state monitoring.
In one aspect, there is provided a method for monitoring an abnormal state of a plurality of devices, the method comprising:
acquiring equipment state information of equipment to be monitored for each piece of equipment to be monitored, and acquiring position information of each monitoring point corresponding to the equipment to be monitored according to the equipment state information of the equipment to be monitored;
acquiring imaging color ranges of all monitoring points of the equipment to be monitored in a normal state within a target time range;
establishing a multi-equipment state database according to the equipment state information, the monitoring point position information and the monitoring point imaging color range of the equipment to be monitored;
acquiring image information of each monitoring point of the equipment to be monitored according to the multi-equipment state database;
and comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database, and carrying out abnormal alarm according to the comparison result.
In yet another aspect, there is provided an abnormal state monitoring apparatus of a plurality of devices, the apparatus including:
the monitoring point position information acquisition module is used for acquiring equipment state information of the equipment to be monitored for each piece of equipment to be monitored, and acquiring position information of each monitoring point corresponding to the equipment to be monitored according to the equipment state information of the equipment to be monitored;
the imaging color range acquisition module is used for acquiring the imaging color range of each monitoring point of the equipment to be monitored in a normal state within a target time range;
the multi-equipment state database building module is used for building a multi-equipment state database according to the equipment state information, the monitoring point position information and the monitoring point imaging color range of the equipment to be monitored;
the image information acquisition module is used for acquiring the image information of each monitoring point of the equipment to be monitored according to the multi-equipment state database;
and the abnormality alarming module is used for comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database, and carrying out abnormality alarming according to the comparison result.
In a possible implementation manner, the monitoring point location information obtaining module is further configured to:
acquiring a state indicator overall image of the equipment to be monitored through each camera according to the equipment state information of the equipment to be monitored, and extracting image coordinate points corresponding to each monitoring point of the equipment to be monitored from the state indicator overall image to acquire the position information of each monitoring point corresponding to the equipment to be monitored on the state indicator overall image; the respective cameras are mounted at specified positions.
In one possible embodiment, the imaging color range acquisition module is further configured to:
recording imaging conditions of all monitoring points of the equipment to be monitored in a normal state within a target time range through all cameras, and recording;
and determining the imaging color range of each monitoring point of the equipment to be monitored in a normal state according to the recording result.
In a possible implementation manner, the multi-device state database building module is further configured to:
and establishing a multi-equipment state database according to the equipment state information, the monitoring point position information, the monitoring point imaging color range and the pixel number of each monitoring point of the equipment to be monitored, and inputting the multi-equipment state database as an initialization configuration item into a monitoring system.
In a possible implementation manner, the image information acquisition module is further configured to:
and acquiring the image information of each monitoring point of the equipment to be monitored in real time through each camera according to the project information in the multi-equipment state database.
In one possible implementation manner, the abnormality alert module includes:
the color comparison unit is used for comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database; the image information includes an image color value;
the first abnormal alarming unit is used for aiming at the image color value of each monitoring point of the equipment to be monitored, and when the image color value of the monitoring point is in the imaging color range of the corresponding monitoring point in the multi-equipment state database, abnormal alarming is not carried out;
and the second abnormality alarming unit is used for carrying out abnormality alarming on the equipment to be monitored in an abnormal way when the image color value of the monitoring point is not in the imaging color range of the corresponding monitoring point in the multi-equipment state database.
In one possible implementation manner, the second abnormality alert unit is further configured to:
aiming at the equipment to be monitored abnormally, displaying the abnormal state information of the appointed equipment on a monitoring interface, and sending out an alarm prompt.
In yet another aspect, a computer device is provided, the computer device including a processor and a memory, the memory storing at least one instruction, the at least one instruction loaded and executed by the processor to implement the above-described method of monitoring abnormal state of a multi-device.
In yet another aspect, a computer readable storage medium having stored therein at least one instruction loaded and executed by a processor to implement the above-described method of monitoring abnormal state of a multi-device is provided.
The technical scheme that this application provided can include following beneficial effect:
firstly, aiming at each device to be monitored, acquiring the device state information of the device to be monitored, and acquiring the position information of each monitoring point corresponding to the device to be monitored according to the device state information of the device to be monitored; acquiring imaging color ranges of all monitoring points of the equipment to be monitored in a normal state within a target time range, and establishing a multi-equipment state database according to equipment state information, monitoring point position information and monitoring point imaging color ranges of the equipment to be monitored; then, according to the multi-equipment state database, obtaining the image information of each monitoring point of the equipment to be monitored; and finally, comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database, and carrying out abnormal alarm according to the comparison result. The scheme can be suitable for multi-state synchronous monitoring of large-scale equipment, and can be used for simultaneously monitoring the running states of a plurality of pieces of equipment, so that the efficiency and the accuracy of monitoring the abnormal states of the equipment can be effectively improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram showing a configuration of an abnormality monitoring system of a multi-device according to an exemplary embodiment.
FIG. 2 is a method flow diagram illustrating a method of monitoring abnormal status of multiple devices according to an exemplary embodiment.
FIG. 3 is a method flow diagram illustrating a method of monitoring abnormal status of multiple devices according to an exemplary embodiment.
Fig. 4 is a block diagram showing the structure of an abnormality monitoring apparatus of a multi-device according to an exemplary embodiment.
Fig. 5 shows a block diagram of a computer device according to an exemplary embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made apparent and fully in view of the accompanying drawings, in which some, but not all embodiments of the invention are shown. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
It should be understood that, in the embodiments of the present application, the "indication" may be a direct indication, an indirect indication, or an indication having an association relationship. For example, a indicates B, which may mean that a indicates B directly, e.g., B may be obtained by a; it may also indicate that a indicates B indirectly, e.g. a indicates C, B may be obtained by C; it may also be indicated that there is an association between a and B.
In the description of the embodiments of the present application, the term "corresponding" may indicate that there is a direct correspondence or an indirect correspondence between the two, or may indicate that there is an association between the two, or may indicate a relationship between the two and the indicated, configured, or the like.
Fig. 1 is a schematic diagram showing a configuration of an abnormality monitoring system of a multi-device according to an exemplary embodiment. The system includes a server 110, each device to be monitored, and a camera.
Optionally, the system is mainly applied in the field of spaceship survey vessels, a large number of on-board equipment of the spaceship survey vessels are needed to be monitored, and the monitoring of a plurality of equipment is difficult, so that special situations cannot be considered, the situation that the special situations are considered and the equipment is lost easily occurs, and the situation that the key abnormal state of the equipment is missed is avoided.
Each device to be monitored corresponds to one or more monitoring points, and each camera is erected at a designated position and used for carrying out state monitoring on the device to be monitored;
the camera and the device to be monitored can be in communication connection with the server 110 through a transmission network (such as a wireless communication network), and the status monitoring result of the device to be monitored can be uploaded to the server 110 through the wireless communication network, so that the server 110 processes the status monitoring result of the device to be monitored and carries out abnormal alarm according to the status monitoring result.
Optionally, the server 110 may also be a processor such as a CPU or a computer device, which is configured to establish a multi-device status database, so as to implement storage device exception log record, exception status analysis, and exception alarm display.
Optionally, a DSP processing chip may be disposed in each camera, so as to perform computation processing on the status image of each monitoring point.
Optionally, the server 110 may also establish a communication connection to each device to be monitored and the camera through a wireless communication network, and send corresponding algorithm information to the camera, for example, performing calculation processing on the status images of each monitoring point as described above.
Alternatively, the server 110 may be a server cluster or a distributed system formed by a plurality of physical servers, and may also be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs, and technical computing services such as big data and artificial intelligence platforms.
Optionally, the system may further include a management device, where the management device is configured to manage the system (e.g., manage a connection state between each module and the server, etc.), where the management device is connected to the server through a communication network. Optionally, the communication network is a wired network or a wireless network.
Alternatively, the wireless network or wired network described above uses standard communication techniques and/or protocols. The network is typically the internet, but may be any other network including, but not limited to, a local area network, a metropolitan area network, a wide area network, a mobile, a limited or wireless network, a private network, or any combination of virtual private networks. In some embodiments, techniques and/or formats including hypertext markup language, extensible markup language, and the like are used to represent data exchanged over a network. All or some of the links may also be encrypted using conventional encryption techniques such as secure socket layer, transport layer security, virtual private network, internet protocol security, etc. In other embodiments, custom and/or dedicated data communication techniques may also be used in place of or in addition to the data communication techniques described above.
FIG. 2 is a method flow diagram illustrating a method of monitoring abnormal status of multiple devices according to an exemplary embodiment. As shown in fig. 2, the method may include the steps of:
s201, acquiring equipment state information of each equipment to be monitored, and acquiring position information of each monitoring point corresponding to the equipment to be monitored according to the equipment state information of the equipment to be monitored.
In one possible implementation manner, all devices to be monitored are determined as each device to be monitored, at this time, for each device to be monitored, the device state information of the device to be monitored is acquired, and each monitoring point to be monitored by the device to be monitored is determined from the device state information of the device to be monitored.
Each device to be monitored can be provided with one or more monitoring points according to the device state information, and each camera is erected at a designated position and used for acquiring the state image of the device to be monitored corresponding to the monitoring point so as to judge whether the state is abnormal. The specified location is determined based on device status information of the device to be monitored.
Further, the device status information may be determined according to a user monitoring requirement, and, for example, when a user needs to monitor a certain status indicator lamp of the device, if in an application scenario, the status indicator lamp is in a normal green representation status and in an abnormal red representation status, the status indicator lamp data may be configured to be in a normal green state, and if not in a normal green state, the status indicator lamp data may be in an abnormal state, where, because each status indicator lamp corresponds to one monitoring point, the device status information should at least include a monitoring requirement and a monitoring point distribution condition, and each monitoring point may be determined correspondingly according to the device status information.
Furthermore, the specified position can be determined according to the distribution condition of each monitoring point, a camera is erected at the specified position, and each monitoring point needs to be ensured to fall within the imaging range of the camera when the specified position is determined. The camera is set up before the monitoring is put into operation to determine the position information of each monitoring point, the position information of each monitoring point on the imaging picture is determined correspondingly, and then the image coordinates of each monitoring point (the position information of each monitoring point) are input into a multi-device state database to complete configuration. After the configuration is completed, the camera is started, the imaging color of the corresponding monitoring point in the actual camera is compared according to the position information and the color range of each monitoring point in the multi-equipment state database, the comparison result is in the receivable range, the equipment working state is normal, and otherwise, the equipment state is abnormal.
S202, acquiring imaging color ranges of all monitoring points of the equipment to be monitored in a normal state within a target time range.
In one possible embodiment, after acquiring the position information of the respective monitoring points of each device to be monitored on the imaging screen, the imaging color range of the respective monitoring points of each device to be monitored in the normal state is acquired within the target time range. Here, the corresponding device portion to be monitored of each monitoring point may be imaged according to the camera corresponding to the monitoring point, so as to determine the imaging color range of the device portion to be monitored corresponding to each monitoring point of each device to be monitored in a normal state.
Optionally, the target time range may be preset as required, but it is required to meet one of the criteria that an accurate imaging color range can be trained to be used as whether the state is abnormal.
And S203, a multi-device state database is established according to the device state information, the monitoring point position information and the monitoring point imaging color range of the device to be monitored.
In one possible embodiment, for each device to be monitored, the device status information of each device to be monitored, the position information of the respective monitoring points of each device to be monitored, and the imaging color ranges of the respective monitoring points under normal conditions have been acquired through the above steps, and at this time, a multi-device status database indicating the respective features that each device to be monitored should conform to in a normal state may be established according to the device status information of the device to be monitored, the monitoring point position information, and the monitoring point imaging color ranges, and thus, a status anomaly analysis may be performed according to the multi-device status database.
S204, acquiring the image information of each monitoring point of the equipment to be monitored according to the multi-equipment state database.
In one possible implementation manner, after a multi-device status database capable of being used as a status exception analysis standard has been acquired, status monitoring may be performed, taking a target device to be monitored (any device to be monitored) as an example, if the status of the target device to be monitored is monitored, at this time, the monitoring requirement and the monitoring point distribution situation are determined according to the device status information of the target device to be monitored; then, according to the monitoring requirement and the monitoring point distribution condition, determining the mounting position of the monitoring camera (namely, mounting each camera at the designated position); and then, carrying out data calibration of the monitoring point, namely determining the position information of the monitoring point, the color range of the monitoring point and the number of pixels of the monitoring point according to the actual imaging situation of the monitoring point in the monitoring camera. And then configuring a multi-equipment state database according to the equipment state information of the target equipment to be monitored, the position information of the monitoring point, the color range of the monitoring point and the pixel number of the monitoring point, testing and verifying the correctness of the follow-up monitoring data of the target equipment to be monitored through the multi-equipment state database, mainly confirming whether monitoring errors exist, the monitoring point is missed, the abnormal state cannot be monitored and the like, and further perfecting the multi-equipment state database.
Optionally, as stated above, the multi-device status database includes the range of the imaging colors of the monitor points and the number of pixels of each monitor point, so the image information should include the pixel size, the color type, and the image color value (i.e., the color value of each color).
S205, comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database, and carrying out abnormal alarm according to the comparison result.
In a possible implementation manner, the image information should at least contain an image color value, and when the image color value of each monitoring point of the target device to be monitored is within the imaging color range of the corresponding monitoring point in the multi-device state database, the state of the target device to be monitored is normal; and when the image color value of each monitoring point of the target equipment to be monitored is not in the imaging color range of the corresponding monitoring point in the multi-equipment state database, the state of the target equipment to be monitored is abnormal.
In summary, for each device to be monitored, the device status information of the device to be monitored is obtained, and according to the device status information of the device to be monitored, the position information of each monitoring point corresponding to the device to be monitored is obtained; acquiring imaging color ranges of all monitoring points of the equipment to be monitored in a normal state within a target time range, and establishing a multi-equipment state database according to equipment state information, monitoring point position information and monitoring point imaging color ranges of the equipment to be monitored; then, according to the multi-equipment state database, obtaining the image information of each monitoring point of the equipment to be monitored; and finally, comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database, and carrying out abnormal alarm according to the comparison result. The scheme can be suitable for multi-state synchronous monitoring of large-scale equipment, and can be used for simultaneously monitoring the running states of a plurality of pieces of equipment, so that the efficiency and the accuracy of monitoring the abnormal states of the equipment can be effectively improved.
FIG. 3 is a method flow diagram illustrating a method of monitoring abnormal status of multiple devices according to an exemplary embodiment. As shown in fig. 3, the method may include the steps of:
s301, acquiring equipment state information of each equipment to be monitored, and acquiring position information of each monitoring point corresponding to the equipment to be monitored according to the equipment state information of the equipment to be monitored.
In a possible implementation manner, according to the equipment state information of the equipment to be monitored, acquiring a state indicator overall image of the equipment to be monitored through each camera, and extracting image coordinate points corresponding to each monitoring point of the equipment to be monitored respectively from the state indicator overall image to acquire the position information of each monitoring point corresponding to the equipment to be monitored on the state indicator overall image; the respective cameras are mounted at specified positions.
Further, according to the device state information that each device to be monitored needs to monitor in advance, a camera is erected at a designated position to obtain the overall image of the state indicator lamp of each device to be monitored, and then the image coordinate points of the state indicator lamp of each device to be monitored (namely, the image coordinate points corresponding to each monitoring point of the device to be monitored) are extracted to obtain the position information of each monitoring point corresponding to the device to be monitored.
S302, acquiring imaging color ranges of all monitoring points of the equipment to be monitored in a normal state within a target time range.
In one possible implementation manner, the imaging condition of each monitoring point of the device to be monitored in a normal state is recorded by each camera within a target time range, and recording is performed;
and determining the imaging color range of each monitoring point of the equipment to be monitored in a normal state according to the recording result.
Further, since each monitoring point corresponds to one device status indicator lamp, the imaging condition of each monitoring point of each device to be monitored in a normal state is obtained, that is, the imaging condition of each device status indicator lamp of each device to be monitored in a normal state is recorded, and the imaging color range of each device status indicator lamp is recorded within the target time range, so that the imaging color range of each monitoring point of each device to be monitored is obtained.
Furthermore, the above embodiment may be applied to the field of spaceflight measurement vessels, where each device to be monitored is a shipborne device to be monitored, in order to eliminate the image jitter problem caused by factors such as ship vibration, and the condition that single pixel value is easy to have unstable state monitoring, in the actual implementation process, a method of multiple pixel gray values or color average values may be adopted to determine the gray value standard and the color average value standard of each monitoring point in a normal state, so as to perform state anomaly analysis on each monitoring point according to the gray value standard and the color average value standard of each monitoring point in the normal state, and when the real-time gray value of a certain monitoring point is equal to the gray value standard of the pixel point in the normal state of the monitoring point, the state of the monitoring point is normal, and when the gray value of the real-time pixel point of the monitoring point is different from the gray value standard of the gray value of the pixel point in the normal state of the monitoring point is abnormal; when the color average value of a certain monitoring point is equal to the color average value standard of the monitoring point in the normal state, the monitoring point is normal, and when the color average value of the monitoring point is different from the color average value standard of the monitoring point in the normal state, the monitoring point is abnormal.
Further, in order to avoid the change of the gray value of the image caused by the change of light, a color range method is adopted to judge the state of the monitoring point instead of adopting a fixed color value for judgment in the actual implementation process.
S303, a multi-device state database is established according to the device state information, the monitoring point position information and the monitoring point imaging color range of the device to be monitored.
In one possible implementation, a multi-device state database is established according to the device state information, the monitoring point position information, the monitoring point imaging color range and the pixel number of each monitoring point of the device to be monitored, and the multi-device state database is input into the monitoring system as an initialization configuration item.
Furthermore, before the monitoring of the state of the monitoring point, calibration is performed on the monitored configuration parameters, that is, the position information of the monitoring point, the color range of the monitoring point and the number of pixels of the monitoring point are determined according to the actual imaging situation of the monitoring point in the monitoring camera, and the number of pixels is determined according to the actual imaging size.
Further, a multi-device state database is established according to the information such as the device state information, the monitoring point position information, the imaging color range of the monitoring point, the pixel number of each monitoring point and the like of the device to be monitored, and the multi-device state database is used as an initialization configuration item of the monitoring system to be input into the system. The configuration items of the multi-device status database are shown in table 1:
TABLE 1
As shown in table 1, the device to be monitored in table 1 is a device a, the device status information of the device a includes a status type 1 and a status type 2, the number of monitoring points of the device a is 3, and the multi-device status database further includes each monitoring point position information (i.e. a monitoring point position x and a monitoring point position y), a color type (i.e. RGB), a monitoring point imaging color range (from a color 1 minimum value to a color 1 maximum value; from a color 2 minimum value to a color 2 maximum value; from a color 3 minimum value to a color 3 maximum), the number of pixels of each monitoring point, and the number of pixels.
The status type is mainly used for enriching the monitoring status, so as to cope with the situation that different colors of the same monitoring point represent different statuses, for example, green is normal, yellow is primary alarm, blue is secondary alarm, red is unavailable, and more specific fault information is provided for a user through the color range of the status type. The number of the pixels can be determined according to the number of the pixels actually imaged in the normal state of the monitoring point during calibration.
S304, acquiring the image information of each monitoring point of the equipment to be monitored according to the multi-equipment state database.
In one possible implementation, image information of each monitoring point of the device to be monitored is acquired in real time by each camera according to item information in the multi-device status database.
S305, comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database; the image information includes an image color value;
s306, aiming at the image color value of each monitoring point of the equipment to be monitored, if the image color value of the monitoring point is in the imaging color range of the corresponding monitoring point in the multi-equipment state database, abnormal alarm is not carried out;
s307, when the image color value of the monitoring point is not in the imaging color range of the corresponding monitoring point in the multi-device state database, carrying out abnormal alarm on the abnormal device to be monitored.
Further, for any device to be monitored, according to the configuration item (i.e., the item information) of the multi-device state database, image information of each monitoring point of the device to be monitored is obtained in real time, and image color values obtained from the image information of each monitoring point are compared with imaging color ranges in the multi-device state database. If the image color value of each monitoring point is in the imaging color range in the multi-equipment state database, the state of the equipment to be monitored is normal; if the image color value of each monitoring point is not in the imaging color range in the multi-device state database, the state abnormality of the device to be monitored is indicated, and the image color value of the corresponding monitoring point in the abnormal state is recorded.
In one possible implementation, for the device to be monitored abnormally, abnormal state information of the designated device is displayed on a monitoring interface, and an alarm prompt is sent out.
Further, the abnormal alarm mainly comprises an abnormal state display control part, an abnormal state record part, an abnormal state sound alarm part and the like. After the abnormal state of the equipment to be monitored is monitored, the abnormal state of the appointed equipment (the equipment to be monitored is abnormal) is prompted on a monitoring interface, abnormal state information of the appointed equipment (the equipment to be monitored is abnormal) is recorded in a log, and an acoustic alarm is sent out to prompt a user to reasonably treat the abnormal state.
In summary, for each device to be monitored, the device status information of the device to be monitored is obtained, and according to the device status information of the device to be monitored, the position information of each monitoring point corresponding to the device to be monitored is obtained; acquiring imaging color ranges of all monitoring points of the equipment to be monitored in a normal state within a target time range, and establishing a multi-equipment state database according to equipment state information, monitoring point position information and monitoring point imaging color ranges of the equipment to be monitored; then, according to the multi-equipment state database, obtaining the image information of each monitoring point of the equipment to be monitored; and finally, comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database, and carrying out abnormal alarm according to the comparison result. The scheme can be suitable for multi-state synchronous monitoring of large-scale equipment, and can be used for simultaneously monitoring the running states of a plurality of pieces of equipment, so that the efficiency and the accuracy of monitoring the abnormal states of the equipment can be effectively improved.
Fig. 4 is a block diagram showing the structure of an abnormality monitoring apparatus of a multi-device according to an exemplary embodiment. The device comprises:
the monitoring point position information obtaining module 401 is configured to obtain, for each device to be monitored, device state information of the device to be monitored, and obtain, according to the device state information of the device to be monitored, position information of each monitoring point corresponding to the device to be monitored;
an imaging color range obtaining module 402, configured to obtain, in a target time range, an imaging color range of each monitoring point of the device to be monitored in a normal state;
the multi-device state database building module 403 is configured to build a multi-device state database according to the device state information, the monitoring point position information, and the monitoring point imaging color range of the device to be monitored;
an image information obtaining module 404, configured to obtain image information of each monitoring point of the device to be monitored according to the multi-device status database;
and the abnormality alarming module 405 is configured to compare the image information of each monitoring point of the device to be monitored with the imaging color range of the corresponding monitoring point in the multi-device status database, and perform abnormality alarming according to the comparison result.
In a possible implementation manner, the monitor point location information obtaining module 401 is further configured to:
according to the equipment state information of the equipment to be monitored, acquiring a state indicator overall image of the equipment to be monitored through each camera, and extracting image coordinate points corresponding to each monitoring point of the equipment to be monitored from the state indicator overall image to acquire the position information of each monitoring point corresponding to the equipment to be monitored on the state indicator overall image; the respective cameras are mounted at specified positions.
In one possible implementation, the imaging color range acquisition module 402 is further configured to:
recording imaging conditions of all monitoring points of the equipment to be monitored in a normal state within a target time range through all cameras, and recording;
and determining the imaging color range of each monitoring point of the equipment to be monitored in a normal state according to the recording result.
In a possible implementation manner, the multi-device state database building module 403 is further configured to:
and establishing a multi-equipment state database according to the equipment state information, the monitoring point position information and the monitoring point imaging color range of the equipment to be monitored, and inputting the multi-equipment state database as an initialization configuration item into a monitoring system.
In one possible implementation, the image information acquisition module 404 is further configured to:
and acquiring the image information of each monitoring point of the equipment to be monitored in real time through each camera according to the project information in the multi-equipment state database.
In one possible implementation, the anomaly alert module 405 includes:
the color comparison unit is used for comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database; the image information includes an image color value;
the first abnormal alarming unit is used for aiming at the image color value of each monitoring point of the equipment to be monitored, and when the image color value of the monitoring point is in the imaging color range of the corresponding monitoring point in the multi-equipment state database, abnormal alarming is not carried out;
and the second abnormality alarming unit is used for carrying out abnormality alarming on the equipment to be monitored in an abnormal way when the image color value of the monitoring point is not in the imaging color range of the corresponding monitoring point in the multi-equipment state database.
In a possible implementation manner, the second abnormality alert unit is further configured to:
aiming at the equipment to be monitored abnormally, displaying the abnormal state information of the appointed equipment on a monitoring interface, and sending out an alarm prompt.
In summary, for each device to be monitored, the device status information of the device to be monitored is obtained, and according to the device status information of the device to be monitored, the position information of each monitoring point corresponding to the device to be monitored is obtained; acquiring imaging color ranges of all monitoring points of the equipment to be monitored in a normal state within a target time range, and establishing a multi-equipment state database according to equipment state information, monitoring point position information and monitoring point imaging color ranges of the equipment to be monitored; then, according to the multi-equipment state database, obtaining the image information of each monitoring point of the equipment to be monitored; and finally, comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database, and carrying out abnormal alarm according to the comparison result. The scheme can be suitable for multi-state synchronous monitoring of large-scale equipment, and can be used for simultaneously monitoring the running states of a plurality of pieces of equipment, so that the efficiency and the accuracy of monitoring the abnormal states of the equipment can be effectively improved.
Fig. 5 shows a block diagram of a computer device according to an exemplary embodiment of the present application. The computer device comprises a memory and a processor, wherein the memory is used for storing a computer program, and the computer program is executed by the processor to realize the multi-device abnormal state monitoring method.
The processor may be a central processing unit (Central Processing Unit, CPU). The processor may also be any other general purpose processor, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof.
The memory, as a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules, corresponding to the methods in embodiments of the present invention. The processor executes various functional applications of the processor and data processing, i.e., implements the methods of the method embodiments described above, by running non-transitory software programs, instructions, and modules stored in memory.
The memory may include a memory program area and a memory data area, wherein the memory program area may store an operating system, at least one application program required for a function; the storage data area may store data created by the processor, etc. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some implementations, the memory optionally includes memory remotely located relative to the processor, the remote memory being connectable to the processor through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
One embodiment of the present application also provides a computer storage medium storing a computer program, where the computer program is executed by a processor to implement the above-mentioned method for monitoring abnormal states of multiple devices.
It will be appreciated by those skilled in the art that implementing all or part of the above-described methods in the embodiments may be implemented by a computer program for instructing relevant hardware, where the program may be stored in a computer readable storage medium, and where the program may include the steps of the embodiments of the methods described above when executed. Wherein the storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a Flash Memory (Flash Memory), a Hard Disk (HDD), or a Solid State Drive (SSD); the storage medium may also comprise a combination of memories of the kind described above.
Although embodiments of the present invention have been described in connection with the accompanying drawings, various modifications and variations may be made by those skilled in the art without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope of the invention as defined by the appended claims.
Claims (10)
1. A method of monitoring abnormal state of a plurality of devices, the method comprising:
acquiring equipment state information of equipment to be monitored for each piece of equipment to be monitored, and acquiring position information of each monitoring point corresponding to the equipment to be monitored according to the equipment state information of the equipment to be monitored;
acquiring imaging color ranges of all monitoring points of the equipment to be monitored in a normal state within a target time range;
establishing a multi-equipment state database according to the equipment state information, the monitoring point position information and the monitoring point imaging color range of the equipment to be monitored;
acquiring image information of each monitoring point of the equipment to be monitored according to the multi-equipment state database;
and comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database, and carrying out abnormal alarm according to the comparison result.
2. The method of claim 1, wherein the obtaining location information of each monitoring point corresponding to the device to be monitored according to the device status information of the device to be monitored includes:
acquiring a state indicator overall image of the equipment to be monitored through each camera according to the equipment state information of the equipment to be monitored, and extracting image coordinate points corresponding to each monitoring point of the equipment to be monitored from the state indicator overall image to acquire the position information of each monitoring point corresponding to the equipment to be monitored on the state indicator overall image; the respective cameras are mounted at specified positions.
3. The method according to claim 2, wherein the acquiring the imaging color range of each monitoring point of the device to be monitored in the normal state within the target time range includes:
recording imaging conditions of all monitoring points of the equipment to be monitored in a normal state within a target time range through all cameras, and recording;
and determining the imaging color range of each monitoring point of the equipment to be monitored in a normal state according to the recording result.
4. The method of claim 1, wherein the creating a multi-device status database from the device status information, the monitoring point location information, and the monitoring point imaging color range of the device to be monitored comprises:
and establishing a multi-equipment state database according to the equipment state information, the monitoring point position information, the monitoring point imaging color range and the pixel number of each monitoring point of the equipment to be monitored, and inputting the multi-equipment state database as an initialization configuration item into a monitoring system.
5. A method according to claim 3, wherein said obtaining image information of each monitoring point of the device to be monitored from the multi-device status database comprises:
and acquiring the image information of each monitoring point of the equipment to be monitored in real time through each camera according to the project information in the multi-equipment state database.
6. The method according to any one of claims 1 to 5, wherein comparing the image information of each monitoring point of the device to be monitored with the imaging color range of the corresponding monitoring point in the multi-device status database, and performing an anomaly alarm according to the comparison result, comprises:
comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database; the image information includes an image color value;
aiming at the image color value of each monitoring point of the equipment to be monitored, if the image color value of the monitoring point is in the imaging color range of the corresponding monitoring point in the multi-equipment state database, abnormal alarm is not carried out;
and when the image color value of the monitoring point is not in the imaging color range of the corresponding monitoring point in the multi-equipment state database, carrying out abnormal alarm on the equipment to be monitored.
7. The method of claim 6, wherein the alerting for anomalies for the anomaly to be monitored device comprises:
aiming at the equipment to be monitored abnormally, displaying the abnormal state information of the appointed equipment on a monitoring interface, and sending out an alarm prompt.
8. An abnormal state monitoring apparatus for a plurality of devices, the apparatus comprising:
the monitoring point position information acquisition module is used for acquiring equipment state information of the equipment to be monitored for each piece of equipment to be monitored, and acquiring position information of each monitoring point corresponding to the equipment to be monitored according to the equipment state information of the equipment to be monitored;
the imaging color range acquisition module is used for acquiring the imaging color range of each monitoring point of the equipment to be monitored in a normal state within a target time range;
the multi-equipment state database building module is used for building a multi-equipment state database according to the equipment state information, the monitoring point position information and the monitoring point imaging color range of the equipment to be monitored;
the image information acquisition module is used for acquiring the image information of each monitoring point of the equipment to be monitored according to the multi-equipment state database;
and the abnormality alarming module is used for comparing the image information of each monitoring point of the equipment to be monitored with the imaging color range of the corresponding monitoring point in the multi-equipment state database, and carrying out abnormality alarming according to the comparison result.
9. A computer device comprising a processor and a memory having stored therein at least one instruction that is loaded and executed by the processor to implement a multi-device anomaly condition monitoring method according to any one of claims 1 to 7.
10. A computer readable storage medium having stored therein at least one instruction that is loaded and executed by a processor to implement a method of monitoring an abnormal state of a multi-device as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310575154.2A CN116527874A (en) | 2023-05-19 | 2023-05-19 | Multi-device abnormal state monitoring method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310575154.2A CN116527874A (en) | 2023-05-19 | 2023-05-19 | Multi-device abnormal state monitoring method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116527874A true CN116527874A (en) | 2023-08-01 |
Family
ID=87399346
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310575154.2A Pending CN116527874A (en) | 2023-05-19 | 2023-05-19 | Multi-device abnormal state monitoring method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116527874A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004048420A (en) * | 2002-07-12 | 2004-02-12 | Minolta Co Ltd | Imaging device and correcting method |
| CN105100732A (en) * | 2015-08-26 | 2015-11-25 | 深圳市银之杰科技股份有限公司 | Machine room server remote monitoring method and system |
| WO2016013298A1 (en) * | 2014-07-25 | 2016-01-28 | 日本電気株式会社 | Image processing apparatus, monitor system, image processing method, and program |
| CN107341489A (en) * | 2017-06-20 | 2017-11-10 | 清华大学 | A kind of image identification system for center monitoring |
| JP2018032285A (en) * | 2016-08-26 | 2018-03-01 | 京セラドキュメントソリューションズ株式会社 | Remote maintenance system and remote maintenance method |
| KR20190026260A (en) * | 2017-09-04 | 2019-03-13 | 한국후지필름 주식회사 | Photography service system having failure processing function and the method thereof |
| WO2021082644A1 (en) * | 2019-10-29 | 2021-05-06 | 北京海益同展信息科技有限公司 | Fault detection method and apparatus, and storage medium |
| CN115733957A (en) * | 2022-11-17 | 2023-03-03 | 合肥佳讯科技有限公司 | Navigation equipment alarm processing method based on image recognition |
-
2023
- 2023-05-19 CN CN202310575154.2A patent/CN116527874A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004048420A (en) * | 2002-07-12 | 2004-02-12 | Minolta Co Ltd | Imaging device and correcting method |
| WO2016013298A1 (en) * | 2014-07-25 | 2016-01-28 | 日本電気株式会社 | Image processing apparatus, monitor system, image processing method, and program |
| CN105100732A (en) * | 2015-08-26 | 2015-11-25 | 深圳市银之杰科技股份有限公司 | Machine room server remote monitoring method and system |
| JP2018032285A (en) * | 2016-08-26 | 2018-03-01 | 京セラドキュメントソリューションズ株式会社 | Remote maintenance system and remote maintenance method |
| CN107341489A (en) * | 2017-06-20 | 2017-11-10 | 清华大学 | A kind of image identification system for center monitoring |
| KR20190026260A (en) * | 2017-09-04 | 2019-03-13 | 한국후지필름 주식회사 | Photography service system having failure processing function and the method thereof |
| WO2021082644A1 (en) * | 2019-10-29 | 2021-05-06 | 北京海益同展信息科技有限公司 | Fault detection method and apparatus, and storage medium |
| CN115733957A (en) * | 2022-11-17 | 2023-03-03 | 合肥佳讯科技有限公司 | Navigation equipment alarm processing method based on image recognition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105100732B (en) | A kind of server in machine room long-distance monitoring method and system | |
| CN111666186B (en) | Method and device for detecting data access abnormality, storage medium and computer equipment | |
| WO2020057159A1 (en) | Video analysis system and method for food processing violation behavior in university restaurant | |
| CN110599728A (en) | Fire early warning method, device, equipment and storage medium based on block chain | |
| JP2017173290A (en) | Real time remote monitoring method of x-ray security inspection machine | |
| KR101685950B1 (en) | CCTV recording system having self-diagnosis function | |
| CN109327337A (en) | Fault information reporting method, device, terminal device and computer storage medium | |
| CN112164049A (en) | Illegal construction monitoring method and device | |
| US20190355112A1 (en) | System and method of distributed processing for machine-vision analysis | |
| CN107566036A (en) | Mistake in automatic detection communication and automatically determine the wrong source | |
| CN109151463B (en) | Video quality diagnosis system and video quality analysis method | |
| CN110553151A (en) | pipeline leakage monitoring method and system | |
| CN114378862A (en) | Robot abnormity automatic repairing method and device based on cloud platform and robot | |
| CN116527874A (en) | Multi-device abnormal state monitoring method | |
| CN113676723A (en) | Non-homologous network video monitoring fault positioning method and device based on Internet of things | |
| CN116778836A (en) | Information monitoring method, system, device and storage medium of display system | |
| US20220130182A1 (en) | Nautical device diagnosis apparatus, remote nautical device surveillance system, nautical device diagnosis method, and nautical device diagnosis computer-readable media | |
| CN113343841B (en) | Method and device for determining abnormal condition of power tunnel | |
| CN114627569A (en) | Abnormity processing method and device for power line inspection unmanned aerial vehicle and computer equipment | |
| JP6993391B2 (en) | Patrol inspection system and patrol inspection method | |
| CN114707606B (en) | Data processing method and device based on federal learning, equipment and storage medium | |
| JP7018540B2 (en) | Patrol inspection system and patrol inspection method | |
| CN116245962B (en) | Data extraction system and method for wireless transmission to blockchain server | |
| CN117726145B (en) | Cable inspection processing method and device, electronic equipment and computer readable medium | |
| CN111913856B (en) | Fault positioning method, device, equipment and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |