CN114049601A

CN114049601A - Monitoring method, monitoring system, terminal equipment and storage medium

Info

Publication number: CN114049601A
Application number: CN202111220070.4A
Authority: CN
Inventors: 宫德锋; 王猛; 乔东伟; 邹积鹏; 张立; 杨军; 李兆飞; 曹井川; 陆琪; 孙建文
Original assignee: TaiAn Power Supply Co of State Grid Shandong Electric Power Co Ltd
Current assignee: TaiAn Power Supply Co of State Grid Shandong Electric Power Co Ltd
Priority date: 2021-10-20
Filing date: 2021-10-20
Publication date: 2022-02-15

Abstract

The application is applicable to the technical field of power systems, and provides a monitoring method, a monitoring system and terminal equipment, wherein the monitoring method comprises the following steps: identifying monitoring objects in the monitoring image, and determining a monitoring type corresponding to each monitoring object; determining a target detection strategy of each monitored object according to the monitoring type corresponding to the monitored object; and generating a monitoring result corresponding to the monitored object according to the target detection strategy. Therefore, the detection of various monitoring types of the transformer substation is realized, the detection is not limited to various electrical equipment of the transformer substation, and the application range is expanded.

Description

Monitoring method, monitoring system, terminal equipment and storage medium

Technical Field

The present application belongs to the technical field of power systems, and in particular, relates to a monitoring method, a monitoring system, a terminal device, and a computer-readable storage medium.

Background

The transformer substation is a place where a power system converts voltage and current, receives electric energy and distributes the electric energy. In order to ensure the normal operation of various devices in the transformer substation, various devices in the transformer substation need to be patrolled, so that accidents caused by problems are prevented.

However, the existing substation patrol method only performs periodic patrol on various electrical devices of the substation, and the application range is small.

Disclosure of Invention

The embodiment of the application provides a monitoring method, a monitoring system, terminal equipment and a computer-readable storage medium, and can solve the problems that in the prior art, periodic inspection is only performed on various electrical equipment of a transformer substation, and the application range is small.

In a first aspect, an embodiment of the present application provides a monitoring method, including:

identifying monitoring objects in the monitoring image, and determining a monitoring type corresponding to each monitoring object;

determining a target detection strategy of each monitored object according to the monitoring type corresponding to the monitored object;

and generating a monitoring result corresponding to the monitored object according to the target detection strategy.

Optionally, the identifying the monitoring objects in the monitoring image and determining the monitoring type corresponding to each monitoring object includes:

inputting the monitoring image into a preset target detection model for target identification to obtain at least one target identification result corresponding to the monitoring image;

and determining the monitoring type corresponding to each monitored object according to at least one target identification result.

Optionally, the determining a target detection policy of each monitored object according to the monitoring type corresponding to the monitored object includes:

when the monitoring type is a first preset type, taking a strategy for determining that a preset violation behavior exists in the monitored object corresponding to the first preset type as the target detection strategy;

when the monitoring type is a second preset type, taking a strategy for determining the state information of the monitored object corresponding to the second preset type as the target detection strategy;

when the monitoring type is a third preset type, taking a strategy for determining the numerical value of the monitored object corresponding to the third preset type as the target detection strategy;

and when the monitoring type is a fourth preset type, determining a strategy for determining the grade value of the monitored object corresponding to the fourth preset type as the target detection strategy.

Optionally, the generating a monitoring result corresponding to the monitored object according to the target detection policy includes:

when the monitoring type is the first preset type, outputting first prompt information according to a preset violation behavior existing in the monitored object corresponding to the first preset type, and generating the monitoring result according to the first prompt information and the preset violation behavior;

when the monitoring type is the second preset type, outputting second prompt information according to the state information of the monitored object corresponding to the second preset type, and generating the monitoring result according to the second prompt information and the state information;

when the monitoring type is the third preset type, outputting third prompt information according to the numerical value of the monitored object corresponding to the third preset type, and generating the monitoring result according to the third prompt information and the numerical value;

and when the monitoring type is the fourth preset type, outputting fourth prompt information according to the grade value of the monitored object corresponding to the fourth preset type, and generating the monitoring result according to the fourth prompt information and the grade value.

Optionally, after identifying the monitoring objects in the monitoring image and determining the monitoring type corresponding to each monitoring object, the method further includes:

and when the monitoring type is a fifth preset type, generating the monitoring result according to the monitored object.

Optionally, after generating the monitoring result corresponding to the monitored object according to the target detection policy, the method further includes:

and sending the monitoring result to the host equipment.

In a second aspect, an embodiment of the present application provides a monitoring system, including:

the camera shooting equipment is configured to shoot the monitored area to obtain a monitored image;

a terminal device connected to the image pickup device and configured to execute the monitoring method according to any one of the first aspect.

In a third aspect, an embodiment of the present application provides a monitoring apparatus, including:

the identification unit is used for identifying the monitored objects in the monitored image and determining the corresponding monitoring type of each monitored object;

the first determining unit is used for determining a target detection strategy of each monitored object according to the monitoring type corresponding to the monitored object;

and the first generating unit is used for generating a monitoring result corresponding to the monitored object according to the target detection strategy.

In a fourth aspect, an embodiment of the present application provides a terminal device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the steps of the monitoring method according to any one of the first aspect.

In a fifth aspect, the present application provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the computer program implements the steps of the monitoring method according to any one of the first aspect.

In a sixth aspect, an embodiment of the present application provides a computer program product, which, when running on a terminal device, enables the terminal device to execute the monitoring method according to any one of the above first aspects.

Compared with the prior art, the embodiment of the application has the advantages that:

according to the monitoring method provided by the embodiment of the application, the monitoring type corresponding to each monitored object is determined through the identified monitored objects in the monitored image; determining a target detection strategy of each monitored object according to the monitoring type corresponding to the monitored object; that is, different detection strategies can be determined according to different monitoring types, and finally, a monitoring result corresponding to the monitored object is generated according to the target detection strategy; therefore, the detection of various monitoring types of the transformer substation is realized, the detection is not limited to various electrical equipment of the transformer substation, and the application range is expanded.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a monitoring system according to an embodiment of the present application;

fig. 2 is a flowchart of an implementation of a monitoring method according to an embodiment of the present application;

FIG. 3 is a flow chart of an implementation of a monitoring method according to another embodiment of the present application;

FIG. 4 is a flow chart of an implementation of a monitoring method according to another embodiment of the present application;

fig. 5 is a schematic structural diagram of a monitoring device according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a terminal device according to an embodiment of the present application.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to" determining "or" in response to detecting ". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".

Furthermore, in the description of the present application and the appended claims, the terms "first," "second," "third," and the like are used for distinguishing between descriptions and not necessarily for describing or implying relative importance.

Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a monitoring system according to an embodiment of the present application. As shown in fig. 1, the monitoring system includes an image pickup apparatus 10 and a terminal apparatus 20. The image pickup apparatus 10 and the terminal apparatus 20 are communicatively connected. The communication connection method may be a wired communication method or a wireless communication method.

The imaging device 10 is configured to capture a monitoring area to obtain a monitoring image. The monitoring area may be determined according to actual needs, and is not limited herein. For example, in the case of applying the monitoring system to a substation, the monitoring area may be the entire area of the substation. The image pickup apparatus 10 may be a camera.

The terminal device 20 is configured to perform image recognition based on the monitoring image captured by the image capturing device 10 and output a monitoring result corresponding to the monitoring object in the monitoring image. For example, the monitoring system is applied to a transformer substation, and the monitored object may be a pedestrian or an electronic device in the transformer substation. Electronic devices include, but are not limited to, indicator lights, gauges, and the like. The meter refers to a meter for detecting voltage and current.

In one embodiment of the present application, with continued reference to fig. 1, the monitoring system may further include a host device 30. Host device 30 is communicatively connected to terminal device 20. The host device 30 may be a server, and the server may be a computer, a desktop computer, or the like.

The host device 30 is configured to receive the monitoring result transmitted from the terminal device 20, and analyzes and determines the monitoring result.

Continuing to refer to fig. 1, the image capturing apparatus 10 includes, but is not limited to, a first image capturing unit 11, a second image capturing unit 12, and a third image capturing unit 13. The first imaging unit 11, the second imaging unit 12, and the third imaging unit 13 are all communicatively connected to the terminal device 20.

The first imaging unit 11 is configured to image the first monitoring sub-area. Wherein the first monitoring subregion refers to a pedestrian region.

The second imaging unit 12 is configured to image the second monitoring sub-area. Wherein the second monitoring subarea refers to an area where signal lights exist.

And a third imaging unit 13 configured to image the third monitoring sub-area. Wherein the third monitoring sub-region refers to the region where the meter is present.

It should be noted that each camera unit may include a plurality of cameras, so that each sub-monitoring area is comprehensively photographed, and the whole area of the substation is monitored.

Referring to fig. 2, fig. 2 is a flowchart illustrating an implementation of a monitoring method according to an embodiment of the present application. An execution main body of the monitoring method provided by the embodiment of the application is terminal equipment. The terminal device may be a tablet computer or a desktop computer.

The following description will be given taking the monitoring area as the entire area of the substation as an example.

It should be noted that, in all embodiments of the present application, the image capturing device 10 in the monitoring system may capture a monitoring area in real time for 24 hours to obtain a monitoring image, and the terminal device 20 may also perform identification analysis on the monitoring image in real time for 24 hours to generate a monitoring result corresponding to a period.

As shown in fig. 1, the monitoring method provided in an embodiment of the present application may include steps S101 to S103, which are detailed as follows:

in S101, the monitoring objects in the monitoring image are identified, and the monitoring type corresponding to each monitoring object is determined.

In an implementation manner of the embodiment of the application, the terminal device may acquire the monitoring image from the camera device in real time, and perform image recognition on the monitoring image in real time.

In another implementation manner of the embodiment of the application, the terminal device may further acquire and store the monitoring image from the camera device in real time, and perform image recognition on the acquired monitoring image based on a preset time interval. The preset time interval may be set according to actual needs, and is not limited herein.

In the embodiment of the present application, the monitoring areas include, but are not limited to: the monitoring system comprises a first monitoring sub-area, a second monitoring sub-area and a third monitoring sub-area. Thus, monitoring objects include, but are not limited to: pedestrians, signal lamps and meters. The signal lamps include, but are not limited to, indicator lamps and warning lamps. Based on this, when the monitored object is a pedestrian, the corresponding monitoring type can be a first preset type, when the monitored object is a signal lamp, the corresponding monitoring type can be a second preset type, and when the monitored object is a meter, the corresponding monitoring type can be a third preset type.

It should be noted that, because each device of the substation may generate smoke due to a fault, and each pedestrian in the substation may have a smoking violation, each sub-monitoring area may generate smoke, and based on this, the monitoring object may further include smoke, and the corresponding monitoring type may be a fourth preset type.

In an embodiment of the present application, since the monitoring area includes a plurality of sub-monitoring areas, and each sub-monitoring area has its corresponding camera unit, in an embodiment of the present application, the terminal device may need to acquire a monitoring image of the corresponding sub-monitoring area.

For example, when the relevant person only needs to monitor the first monitoring sub-area, a preset instruction for starting the detection of the first monitoring sub-area may be triggered. The preset instruction for starting the detection of the first monitoring sub-region may be set according to actual needs, and is not limited herein. Based on this, the terminal device may respond to a preset instruction for starting the detection of the first monitoring sub-region, and acquire the monitoring image of the first monitoring sub-region through the camera unit corresponding to the first monitoring sub-region.

When the relevant personnel only need to monitor the second monitoring sub-area, a preset instruction for starting the detection of the second monitoring sub-area can be triggered. The preset instruction for starting the detection of the second monitoring sub-region may be set according to actual needs, and is not limited herein. Based on this, the terminal device may respond to a preset instruction for starting the detection of the second monitoring sub-region, and acquire the monitoring image of the second monitoring sub-region through the camera unit corresponding to the second monitoring sub-region.

When the relevant personnel only need to monitor the third monitoring sub-area, a preset instruction for starting the detection of the third monitoring sub-area can be triggered. The preset instruction for starting the detection of the third monitoring sub-region may be set according to actual needs, and is not limited herein. Based on this, the terminal device may acquire the monitoring image of the third monitoring sub-region through the camera unit corresponding to the third monitoring sub-region in response to the preset instruction for starting the detection of the third monitoring sub-region.

In the embodiment of the application, when the camera device shoots the monitored area, the camera device can shoot the monitored image including at least one monitored object, so that the terminal device can identify the monitored object in the monitored image and determine the monitoring type corresponding to each monitored object.

In another embodiment of the present application, the terminal device may specifically determine the monitoring type corresponding to each monitored object through the following steps, which are detailed as follows:

In this embodiment, the target detection model is used to detect a target object in the monitored image and identify the type of the target object. The object detection model may be an existing convolutional neural network-based object detection model.

The target recognition result is used for describing a monitored object contained in the monitored image.

In this embodiment, when detecting that at least one target recognition result exists in the monitored image, the terminal device may determine the monitoring type corresponding to each monitored object according to the target recognition result. For example, when detecting that a target identification result that a monitored object is a pedestrian exists in a monitored image, the terminal device may determine that the corresponding monitoring type is a first preset type, when detecting that the monitored object exists in the monitored image, the terminal device may determine that the corresponding monitoring type is a second preset type, when detecting that the monitored object exists in the monitored image, the terminal device may determine that the corresponding monitoring type is a third preset type, and when detecting that the monitored object exists in the monitored image, the terminal device may determine that the corresponding monitoring type is a fourth preset type.

In S102, a target detection policy of each monitored object is determined according to the monitoring type corresponding to the monitored object.

In the embodiment of the application, different monitoring types can correspond to different detection strategies. Among them, detection strategies include, but are not limited to: the detection strategy comprises a first detection strategy, a second detection strategy, a third detection strategy and a fourth detection strategy. The first detection strategy is a strategy for determining that a preset violation behavior exists in a monitoring object corresponding to a first preset type, the second detection strategy is a strategy for determining state information of the monitoring object corresponding to a second preset type, the third detection strategy is a strategy for determining a numerical value of the monitoring object corresponding to a third preset type, and the fourth detection strategy is a strategy for determining a grade value of the monitoring object corresponding to a fourth preset type. Therefore, when the monitoring type is a first preset type, the terminal device may determine that the first detection policy is the target detection policy, when the monitoring type is a second preset type, the terminal device may determine that the second detection policy is the target detection policy, when the monitoring type is a third preset type, the terminal device may determine that the third detection policy is the target detection policy, and when the monitoring type is a fourth preset type, the terminal device may determine that the fourth detection policy is the target detection policy. The terminal device may store the correspondence between the different monitoring types and the different detection strategies in an associated manner.

Based on this, in an embodiment of the present application, the terminal device may specifically determine the target detection policy through S201 to S204 shown in fig. 3, which is detailed as follows:

in S201, when the monitoring type is a first preset type, a policy that determines that a preset violation exists in the monitored object corresponding to the first preset type is the target detection policy.

In this embodiment, the preset violation may be set according to actual needs, and is not limited here. For example, the predetermined violation may include, but is not limited to: the actions of crossing a safety line, not wearing a safety helmet, not wearing a tool, smoking and the like.

In an embodiment of the present application, the policy for determining that the monitoring object corresponding to the first preset type has the preset violation may specifically be: inputting the monitoring image into a pre-constructed behavior detection model for processing to obtain a behavior probability matrix corresponding to the monitoring image, and determining a preset violation behavior of the monitored object according to the behavior probability matrix.

It should be noted that the behavior detection model is used to detect the probability that a preset violation behavior exists in the monitored object in the monitored image. The behavior detection model can be obtained by training a pre-constructed deep learning model based on a preset sample set. Each sample data in the preset sample set comprises a sample monitoring image and a behavior probability matrix corresponding to the sample monitoring image. And the value of each element in the behavior probability matrix is used for representing the probability that the preset violation behavior corresponding to the element exists in the monitored object in the sample monitored image. When a pre-constructed deep learning model is trained, the sample monitoring image in each sample is used as the input of the deep learning model, the behavior probability matrix corresponding to the sample monitoring image in each sample is used as the output of the deep learning model, through training, the deep learning model can learn the corresponding relation between all possible monitoring images and the behavior probability matrix, and the trained deep learning model is used as the behavior detection model.

Exemplarily, assuming that the behavior probability matrix is [ a, B, C ], where the element a, the element B, and the element C correspond to a preset violation 1, a preset violation 2, and a preset violation 3, respectively, then, a value of the element a is used to indicate a probability that the monitored object in the monitored image has the preset violation 1, a value of the element B is used to indicate a probability that the monitored object in the monitored image has the preset violation 2, and a value of the element C is used to indicate a probability that the monitored object in the monitored image has the preset violation 3.

In this embodiment, the behavior detection model may be composed of a plurality of sub-behavior detection models for detecting different violations. For example, the behavior detection model may include a first sub-behavior detection model for detecting crossing of the safety line, a second sub-behavior detection model for detecting non-wearing of the safety helmet, a third sub-behavior detection model for detecting non-wearing of the tool, and a fourth sub-behavior detection model for detecting smoking.

Based on this, the step of inputting the monitoring image into the pre-constructed behavior detection model by the terminal device for processing may specifically include: and respectively inputting the monitoring image into a plurality of sub-behavior detection models for detecting different illegal behaviors, wherein each sub-behavior detection model outputs a probability value, and a behavior probability matrix formed by each probability value is obtained. Each probability value is used for representing the probability of a certain preset violation behavior of the monitoring image.

After the terminal device obtains the behavior probability matrix, the value of each element in the behavior probability matrix may be compared with a preset probability threshold corresponding to the element.

And if the terminal equipment detects that the value of each element in the behavior probability matrix is smaller than or equal to the preset probability threshold corresponding to the element, determining that the monitored object in the monitored image has no preset violation. And if the terminal equipment detects that the value of at least one element in the behavior probability matrix is greater than the preset probability threshold corresponding to the element, determining that the monitored object in the monitored image has the preset violation corresponding to the element.

It should be noted that the preset probability threshold corresponding to each element may be the same or different, and the preset probability threshold may be set according to actual needs, which is not limited herein.

In S202, when the monitoring type is a second preset type, a policy for determining the state information of the monitored object corresponding to the second preset type is the target detection policy.

In this embodiment, the state information refers to a state value of the monitored object corresponding to the second preset type. And the state value is used for describing the on and off states of the monitored object corresponding to the second preset type. Specifically, when the monitoring object corresponding to the second preset type is in a normally-on state, the corresponding state value may be set to 1, when the monitoring object corresponding to the second preset type is in a blinking state, the corresponding state value may be set to 0.5, and when the monitoring object corresponding to the second preset type is in a turning-off state, the corresponding state value may be set to 0.

In an embodiment of the present application, the terminal device stores in advance a corresponding relationship between each first history image and preset state information, and therefore, a policy for the terminal device to determine the state information of the monitored object corresponding to the second preset type may specifically be: and comparing the monitoring image with each pre-stored first historical image one by one, and determining the state information of the monitoring object corresponding to the second preset type according to the similarity of the monitoring image and the first historical image.

In this embodiment, after determining that the monitoring type of the monitored object is the second preset type, the terminal device may compare the monitored image with each of the first history images stored in advance one by one, and determine, when detecting that a first similar image whose similarity to the monitored image is greater than a first preset similarity threshold exists in each of the first history images, state information corresponding to the first similar image as state information of the monitored object corresponding to the second preset type. The first similarity threshold may be set according to actual needs, and is not limited herein.

In S203, when the monitoring type is a third preset type, a policy for determining a numerical value of the monitored object corresponding to the third preset type is the target detection policy.

In this embodiment, since the third preset type is a meter type, the numerical value of the monitored object corresponding to the third preset type is the count value on the meter. For example, if the count value on a certain meter is 20V, the numerical value of the monitored object corresponding to the third preset type is 20V.

In an embodiment of the present application, the terminal device stores in advance a corresponding relationship between each second history image and a preset value, and therefore, a policy for the terminal device to determine the value of the monitored object corresponding to the third preset type may specifically be: and comparing the monitoring image with each second historical image stored in advance one by one, and determining the numerical value of the monitoring object corresponding to the third preset type according to the similarity of the monitoring image and the second historical image.

In this embodiment, after determining that the monitoring type of the monitored object is the third preset type, the terminal device may compare the monitored image with each of the second historical images stored in advance one by one, and determine a value corresponding to the second similar image as a value of the monitored object corresponding to the third preset type when detecting that a second similar image whose similarity to the monitored image is greater than a second preset similarity threshold exists in each of the second historical images. The second similarity threshold may be set according to actual needs, and is not limited herein.

In S204, when the monitoring type is a fourth preset type, determining a policy for determining a rank value of the monitored object corresponding to the fourth preset type as the target detection policy.

In this embodiment, the grade value is used to describe the size degree of the smoke corresponding to the fourth preset type.

It should be noted that the greater the degree of smoke, the greater the corresponding grade value.

In an embodiment of the present application, the terminal device stores in advance a corresponding relationship between each third history image and a preset rank value, and therefore, a policy for the terminal device to determine the rank value of the monitored object corresponding to the fourth preset type may specifically be: and comparing the monitoring image with each pre-stored third history image one by one, and determining the grade value of the monitoring object corresponding to the fourth preset type according to the similarity of the monitoring image and the third history image.

In this embodiment, after determining that the monitoring type of the monitored object is the fourth preset type, the terminal device may compare the monitored image with each of the third history images stored in advance one by one, and determine, when it is detected that a third similar image whose similarity to the monitored image is greater than a third preset similarity threshold exists in each of the third history images, a rank value corresponding to the third similar image as a rank value of the monitored object corresponding to the fourth preset type. The third similarity threshold may be set according to actual needs, and is not limited herein.

In S103, a monitoring result corresponding to the monitored object is generated according to the target detection policy.

In the embodiment of the application, different target detection strategies can correspond to different generation modes of the monitoring result. When the monitoring type is the first preset type, the target detection policy corresponding to the monitoring type is a policy for determining that a preset violation behavior exists in the monitored object corresponding to the first preset type, that is, the first detection policy. When the monitoring type is the second preset type, the target detection policy corresponding to the monitoring type is a policy for determining state information of the monitored object corresponding to the second preset type, that is, the second detection policy, and therefore, when the monitoring type is the second preset type, the terminal device can generate a monitoring result according to the state information. When the monitoring type is the third preset type, the target detection strategy corresponding to the monitoring type is a strategy for determining a numerical value of the monitored object corresponding to the third preset type, that is, the third detection strategy, and therefore, when the monitoring type is the third preset type, the terminal device can generate a monitoring result according to the numerical value. When the monitoring type is a fourth preset type, the target detection strategy corresponding to the monitoring type is a strategy for determining a rank value of the monitored object corresponding to the fourth preset type, that is, a fourth detection strategy, and therefore, when the monitoring type is the fourth preset type, the terminal device can generate a monitoring result according to the rank value. The terminal device may store the correspondence between the different target detection strategies and the different generation manners of the monitoring results in an associated manner.

Based on this, in an embodiment of the present application, the terminal device may specifically generate the monitoring result through S301 to S304 shown in fig. 4, which is detailed as follows:

in S301, when the monitoring type is the first preset type, outputting first prompt information according to a preset violation existing in the monitored object corresponding to the first preset type, and generating the monitoring result according to the first prompt information and the preset violation.

In this embodiment, the terminal device may output the first prompt information when determining that the monitored object corresponding to the first preset type has a certain preset violation behavior according to the target detection policy. The first prompt information is used for prompting that a certain preset violation behavior exists in the monitored object. Based on this, the terminal device may generate a monitoring result according to the first prompt information and a preset violation behavior existing in the monitored object.

When the terminal device outputs the first prompt information, an error prompt exists, that is, a certain preset violation behavior existing in the monitored object is described incorrectly, so that the terminal device can generate a monitoring result according to the first prompt information and the grade value of the monitored object.

In an embodiment of the present application, the terminal device may be preset with a first monitoring report template corresponding to a first preset type. The first monitoring report template is configured with a plurality of violation monitoring items, image items and prompt information items in advance.

Based on this, when determining that the monitoring object corresponding to the first preset type has a certain preset violation, the terminal device may associate the certain preset violation of the monitoring object with the corresponding violation monitoring item in the first monitoring report template, associate the monitoring image with the image item in the first monitoring report template, and associate the first prompt information with the prompt information item in the first monitoring report template, thereby obtaining the first monitoring report corresponding to the monitoring object. The terminal device may determine the first monitoring report as a monitoring result corresponding to the monitored object.

In S302, when the monitoring type is the second preset type, outputting second prompt information according to the state information of the monitored object corresponding to the second preset type, and generating the monitoring result according to the second prompt information and the state information.

In this embodiment, the terminal device may output the second prompt information when determining the state information of the monitored object corresponding to the second preset type according to the target detection policy. And the second prompt information is used for describing the state value of the monitored object. Based on this, the terminal device may generate a monitoring result according to the second prompt information and the state information corresponding to the monitored object.

When the terminal device outputs the second prompt information, an error prompt exists, that is, the state information of the monitored object is described incorrectly, so that the terminal device can generate a monitoring result according to the second prompt information and the state information of the monitored object.

In an embodiment of the present application, the terminal device may be preset with a second monitoring report template corresponding to a second preset type. The second monitoring report template is configured with a state information monitoring item, an image item and a prompt information item in advance.

Based on this, after determining the state information of the monitored object corresponding to the second preset type, the terminal device may associate the state information of the monitored object with the state information monitoring item in the second monitoring report template, associate the monitored image with the image item in the second monitoring report template, and associate the second prompt information with the prompt information item in the second monitoring report template, so as to obtain the second monitoring report corresponding to the monitored object. The terminal device may determine the second monitoring report as a monitoring result corresponding to the monitored object.

In S303, when the monitoring type is the third preset type, outputting third prompt information according to a numerical value of the monitored object corresponding to the third preset type, and generating the monitoring result according to the third prompt information and the numerical value.

In this embodiment, when determining the value of the monitored object corresponding to the third preset type according to the target detection policy, the terminal device may output third prompt information. And the third prompt information is used for describing the numerical value of the monitored object. Based on this, the terminal device may generate a monitoring result according to the third prompt information and the numerical value of the monitored object.

When the terminal device outputs the third prompt information, an error prompt exists, that is, the numerical value of the monitored object is described incorrectly, so that the terminal device can generate a monitoring result according to the third prompt information and the numerical value of the monitored object.

In an embodiment of the present application, the terminal device may be preset with a third monitoring report template corresponding to a third preset type. The third monitoring report template is pre-configured with a numerical monitoring item, an image item and a prompt information item.

Based on this, after determining the numerical value of the monitored object corresponding to the third preset type, the terminal device may associate the numerical value of the monitored object with the numerical monitoring item in the third monitoring report template, associate the monitored image with the image item in the third monitoring report template, and associate the third prompt information with the prompt information item in the third monitoring report template, thereby obtaining the third monitoring report corresponding to the monitored object. The terminal device may determine the third monitoring report as a monitoring result corresponding to the monitored object.

In another embodiment of the present application, since the count value of the meter is used to describe the voltage or current condition of the corresponding electrical device, and when the voltage or current of the electrical device exceeds the preset range, an accident is easily generated, therefore, after determining the value of the monitoring object corresponding to the third preset type, the terminal device may further detect whether the value is within the preset range. The preset range may be set according to actual needs, and is not limited herein.

And the terminal equipment can output fifth prompt information when detecting that the numerical value is not in the preset range. And the fifth prompt message is used for prompting that the output of the monitoring object corresponding to the third preset type exceeds the preset range. Based on this, the terminal device may generate a monitoring result according to the third prompt information, the fifth prompt information, and the numerical value.

In S304, when the monitoring type is the fourth preset type, outputting fourth prompt information according to the rank value of the monitored object corresponding to the fourth preset type, and generating the monitoring result according to the fourth prompt information and the rank value.

In this embodiment, when determining the rank value of the monitored object corresponding to the fourth preset type according to the target detection policy, the terminal device may output fourth prompt information. And the fourth prompt message is used for describing the grade value of the monitored object.

Since the terminal device may have an error prompt when outputting the fourth prompt information, that is, the rank value of the monitored object is described incorrectly, the terminal device may generate the monitoring result according to the fourth prompt information and the rank value of the monitored object.

In an embodiment of the present application, the terminal device may be preset with a fourth monitoring report template corresponding to a fourth preset type. The fourth monitoring report template is pre-configured with a grade value monitoring item, an image item and a prompt information item.

Based on this, after determining the rank value of the monitored object corresponding to the fourth preset type, the terminal device may associate the rank value of the monitored object with the rank value monitoring item in the fourth monitoring report template, associate the monitored image with the image item in the fourth monitoring report template, and associate the fourth prompt information with the prompt information item in the fourth monitoring report template, so as to obtain the fourth monitoring report corresponding to the monitored object. The terminal device may determine the fourth monitoring report as the monitoring result corresponding to the monitored object.

In another embodiment of the application, when the level value of the smoke is greater than the preset level threshold, it is indicated that some electrical device in the substation fails, and therefore, after determining the level value of the monitoring object corresponding to the fourth preset type, the terminal device may further detect whether the level value is greater than the preset level threshold. The preset level threshold may be set according to actual needs, and is not limited herein. Optionally, the preset level threshold may be set according to the size of smoke generated by the cigarette end.

And the terminal equipment can output sixth prompt information when detecting that the grade value is greater than the preset grade threshold value. And the sixth prompting information is used for prompting that the grade value of the monitoring object corresponding to the fourth preset type exceeds the preset grade threshold value. Based on this, the terminal device may generate a monitoring result according to the fourth prompt information, the sixth prompt information, and the rank value.

In an embodiment of the application, after the terminal device generates the monitoring result corresponding to the monitored object according to the target detection policy, the monitoring result can be sent to the host device, so that the host device can conveniently judge the correctness of the monitoring result generated by the terminal device, and the monitoring accuracy of the monitoring system is further improved.

As can be seen from the above, the monitoring device provided in the embodiment of the present application determines the monitoring type corresponding to each monitored object through the monitored object in the identified monitoring image; determining a target detection strategy of each monitored object according to the monitoring type corresponding to the monitored object; that is, different detection strategies can be determined according to different monitoring types, and finally, a monitoring result corresponding to the monitored object is generated according to the target detection strategy; therefore, the detection of various monitoring types of the transformer substation is realized, the detection is not limited to various electrical equipment of the transformer substation, and the application range is expanded.

In an embodiment of the present application, since the substation has strict control over the preset type existing inside the substation, when it is determined that the monitoring type corresponding to a certain monitoring object is the fifth preset type, the terminal device may directly generate a monitoring result according to the monitoring object. Wherein the fifth predetermined type may be an animal type.

In this embodiment, the monitoring result is used to describe that the type of the monitored object is an animal type.

Through the mode, the terminal equipment can directly generate the monitoring result according to the monitoring object corresponding to the fifth preset type, and the processing efficiency of the terminal equipment is improved.

It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

Fig. 5 shows a block diagram of a monitoring device provided in an embodiment of the present application, which corresponds to a monitoring method described in the foregoing embodiment, and only shows portions related to the embodiment of the present application for convenience of description. Referring to fig. 5, the monitoring apparatus 500 includes: a recognition unit 51, a first determination unit 52, and a first generation unit 53. Wherein:

the identifying unit 51 is configured to identify the monitored objects in the monitored image and determine the corresponding monitoring type of each monitored object.

The first determining unit 52 is configured to determine a target detection policy of each monitored object according to a monitoring type corresponding to the monitored object.

The first generating unit 53 is configured to generate a monitoring result corresponding to the monitored object according to the target detection policy.

In an embodiment of the present application, the identifying unit 51 specifically includes: an input unit and a type determination unit. Wherein:

the input unit is used for inputting the monitoring image into a preset target detection model for target recognition to obtain at least one target recognition result corresponding to the monitoring image.

The type determining unit is used for determining the monitoring type corresponding to each monitoring object according to at least one target identification result.

In an embodiment of the present application, the first determining unit specifically includes: the device comprises a first strategy determining unit, a second strategy determining unit, a third strategy determining unit and a fourth strategy determining unit. Wherein:

the first policy determining unit is configured to, when the monitoring type is a first preset type, determine that a preset violation behavior exists in the monitored object corresponding to the first preset type as the target detection policy.

The second policy determining unit is configured to determine, as the target detection policy, a policy for determining state information of the monitored object corresponding to a second preset type when the monitoring type is the second preset type.

The third policy determining unit is configured to, when the monitoring type is a third preset type, determine a policy for determining a numerical value of the monitored object corresponding to the third preset type as the target detection policy;

and the fourth strategy determining unit is used for determining a strategy for determining the grade value of the monitored object corresponding to the fourth preset type as the target detection strategy when the monitoring type is the fourth preset type.

In an embodiment of the present application, the first generating unit 53 specifically includes: a first result generation unit, a second result generation unit, a third result generation unit, and a fourth result generation unit. Wherein:

and the first result generation unit is used for outputting first prompt information according to a preset violation behavior existing in the monitored object corresponding to the first preset type when the monitoring type is the first preset type, and generating the monitoring result according to the first prompt information and the preset violation behavior.

And the second result generating unit is used for outputting second prompt information according to the state information of the monitored object corresponding to the second preset type when the monitoring type is the second preset type, and generating the monitoring result according to the second prompt information and the state information.

The third result generating unit is used for outputting third prompt information according to the numerical value of the monitored object corresponding to the third preset type when the monitoring type is the third preset type, and generating the monitoring result according to the third prompt information and the numerical value;

and the fourth result generating unit is used for outputting fourth prompt information according to the grade value of the monitored object corresponding to the fourth preset type when the monitoring type is the fourth preset type, and generating the monitoring result according to the fourth prompt information and the grade value.

In one embodiment of the present application, the monitoring apparatus 500 further includes: a fourth result generation unit.

And the fourth result generation unit is used for generating the monitoring result according to the monitoring object when the monitoring type is a fifth preset type.

In one embodiment of the present application, the monitoring apparatus 500 further includes: and a sending unit.

The sending unit is used for sending the monitoring result to the host equipment.

Fig. 6 is a schematic structural diagram of a terminal device according to an embodiment of the present application. As shown in fig. 6, the terminal device 6 of this embodiment includes: at least one processor 60 (only one is shown in fig. 6), a memory 61, and a computer program 62 stored in the memory 61 and executable on the at least one processor 60, the processor 60 implementing the steps in any of the above monitoring method embodiments when executing the computer program 62.

Those skilled in the art will appreciate that fig. 6 is only an example of the terminal device 6, and does not constitute a limitation to the terminal device 6, and may include more or less components than those shown, or combine some components, or different components, such as an input/output device, a network access device, and the like.

The Processor 60 may be a Central Processing Unit (CPU), and the Processor 60 may be other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory 61 may in some embodiments be an internal storage unit of the terminal device 6, such as a hard disk or a memory of the terminal device 6. The memory 61 may also be an external storage device of the terminal device 6 in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are equipped on the terminal device 6. Further, the memory 61 may also include both an internal storage unit and an external storage device of the terminal device 6. The memory 61 is used for storing an operating system, an application program, a BootLoader (BootLoader), data, and other programs, such as program codes of the computer program. The memory 61 may also be used to temporarily store data that has been output or is to be output.

An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the steps in any one of the monitoring method embodiments may be implemented.

The embodiments of the present application provide a computer program product, which when running on a terminal device, enables the terminal device to implement the steps in any of the monitoring method embodiments described above when executed.

It should be noted that, for the information interaction, execution process, and other contents between the above-mentioned devices/units, the specific functions and technical effects thereof are based on the same concept as those of the embodiment of the method of the present application, and specific reference may be made to the part of the embodiment of the method, which is not described herein again.

The embodiment of the present application provides a computer program product, which, when running on a terminal device, enables the terminal device to implement the steps in any of the monitoring method embodiments described above when executed.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiments provided in the present application, it should be understood that the disclosed monitoring device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.

Claims

1. A method of monitoring, comprising:

2. The monitoring method of claim 1, wherein the identifying the monitoring objects in the monitoring image and determining the monitoring type corresponding to each monitoring object comprises:

3. The monitoring method according to claim 1, wherein the determining the target detection policy of each monitored object according to the monitoring type corresponding to the monitored object comprises:

4. The monitoring method according to claim 3, wherein the generating of the monitoring result corresponding to the monitored object according to the target detection policy includes:

5. The monitoring method according to claim 1, wherein after identifying the monitoring objects in the monitoring image and determining the corresponding monitoring type of each monitoring object, the method further comprises:

6. The monitoring method according to any one of claims 1 to 5, further comprising, after generating the monitoring result corresponding to the monitored object according to the target detection policy:

and sending the monitoring result to the host equipment.

7. A monitoring system, comprising:

a terminal device connected to the image pickup device and configured to execute the monitoring method according to any one of claims 1 to 6.

8. The monitoring system according to claim 7, wherein the image pickup apparatus includes:

the first camera unit is connected with the terminal equipment and is configured to shoot a first monitoring subarea; the first monitoring subarea refers to a pedestrian area;

the second camera unit is connected with the terminal equipment and is configured to shoot a second monitoring subarea; the second monitoring subarea refers to an area where signal lamps exist;

the third camera shooting unit is connected with the terminal equipment and is configured to shoot a third monitoring subarea; the third monitoring sub-region refers to the region where the meter is present.

9. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the monitoring method according to any one of claims 1 to 6 when executing the computer program.

10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the monitoring method according to any one of claims 1 to 6.