CN111126321B

CN111126321B - Electric power safety construction protection method and device and computer equipment

Info

Publication number: CN111126321B
Application number: CN201911383183.9A
Authority: CN
Inventors: 羿应棋; 周俊煌; 黄廷城; 范纹郡; 梁志健; 夏晨; 易婷婷; 肖振
Original assignee: Guangzhou Power Electrical Technology Co ltd
Current assignee: Guangzhou Power Electrical Technology Co ltd
Priority date: 2019-12-27
Filing date: 2019-12-27
Publication date: 2023-09-15
Anticipated expiration: 2039-12-27
Also published as: CN111126321A

Abstract

The application discloses a power safety construction protection method, a device and computer equipment, and relates to the technical field of image processing. The electric power safety construction protection method comprises the following steps: acquiring a construction image of an electric power construction site; when a climbing tool and an electric power constructor appear in the construction image, detecting whether the electric power constructor has a climbing action; when the electric power constructor has a climbing action, generating an alarm message; and sending the alarm message to a terminal bound by a construction safety officer, wherein the alarm message is used for indicating the construction safety officer to carry out safety supervision on the electric power construction site corresponding to the alarm message. The method can enable a construction safety person to conduct safety supervision on a plurality of electric power construction sites without being fixedly located in one electric power construction site. Compared with the prior art, the technical scheme reduces the input of human resources and improves the working efficiency.

Description

Electric power safety construction protection method and device and computer equipment

Technical Field

The present application relates to the field of image processing technologies, and in particular, to a method and apparatus for protecting power safety construction, and a computer device.

Background

At present, a certain distance exists between the erection positions of a plurality of power lines and some power equipment to the ground, and in the process of installing and overhauling the power lines and the power equipment, electric power constructors need to reach the erection positions of the power lines and the power equipment by means of ascending tools, namely, the electric power constructors need to execute the installation and overhauling work in the high air, so that the risk of safety accidents of the electric power constructors in the working process is high.

In order to reduce the risk of safety accidents of electric power constructors, the prior proposal is that professional construction safety personnel are arranged on each electric power construction site, the safety performance of climbing tools and the safety protection measures of the electric power constructors are supervised by the construction safety personnel, and the safety of the electric power constructors in working in the high air is improved.

However, arranging a construction safety member on each electric power construction site requires a large amount of human resources, is costly, and causes waste of human resources.

Disclosure of Invention

In view of the foregoing, it is necessary to provide a data analysis method, apparatus, computer device, and storage medium for a service network node, which cannot accurately reflect the operation conditions of the service network node.

In a first aspect, an embodiment of the present application provides a method for protecting electric power safety construction, including:

acquiring a construction image of an electric power construction site; when a climbing tool and an electric power constructor appear in the construction image, detecting whether the electric power constructor has a climbing action; when the electric power constructor has a climbing action, generating an alarm message; and sending an alarm message to a terminal bound by the construction safety personnel, wherein the alarm message is used for indicating the construction safety personnel to carry out safety supervision on the electric power construction site corresponding to the alarm message.

In a second aspect, an embodiment of the present application provides an electric power safety construction protection device, including:

the construction image acquisition module is used for acquiring a construction image of the electric power construction site; the ascending motion detection module is used for detecting whether the electric power constructor has ascending motion when an ascending tool and the electric power constructor appear in the construction image; the alarm message generation module is used for generating an alarm message when the electric power constructor has a climbing action; the alarm message sending module is used for sending an alarm message to a terminal bound by the construction safety personnel, and the alarm message is used for indicating the construction safety personnel to carry out safety supervision on the electric power construction site corresponding to the alarm message.

In a third aspect, there is provided a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, performs the steps of the method of the first aspect described above.

In a fourth aspect, there is provided a computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of the method of the first aspect described above.

The technical scheme provided by the embodiment of the application has the beneficial effects that at least:

by acquiring the construction image of the electric power construction site, when a climbing tool and an electric power constructor appear in the construction image, detecting whether the electric power constructor has a climbing action, generating an alarm message when the electric power constructor has the climbing action, and sending the alarm message to a terminal bound by a construction safety member, wherein the alarm message is used for indicating the construction safety member to carry out safety supervision on the electric power construction site corresponding to the alarm message. In the embodiment of the application, when the terminal bound by the construction safety officer receives the alarm message, the construction safety officer carries out safety supervision on the electric power construction site corresponding to the alarm message, and different alarm messages can correspond to different electric power construction sites, so that the construction safety officer can carry out safety supervision on a plurality of electric power construction sites without being fixedly positioned in one electric power construction site. Therefore, compared with the prior art, the technical scheme reduces the input of human resources and improves the working efficiency.

Drawings

FIG. 1 is a schematic diagram of an implementation environment of a power safety construction protection method according to an embodiment of the present application;

FIG. 2 is a block diagram of a background server according to an embodiment of the present application;

FIG. 3 is a flowchart of a method for protecting power safety construction according to an embodiment of the present application;

FIG. 4 is a flowchart for determining that an electric power constructor has a climbing action according to positions of a climbing tool and the electric power constructor provided by an embodiment of the application;

FIG. 5 is a schematic diagram of a minimum bounding rectangle of a climbing tool and power constructors provided by an embodiment of the present application;

FIG. 6 is a flowchart of determining that an electric power constructor has a climbing action when a plurality of climbing tools and the electric power constructor are provided in a construction image according to an embodiment of the present application;

FIG. 7 is a flowchart of another method for determining that an electric power constructor has a climbing action according to the positions of a climbing tool and the electric power constructor according to an embodiment of the present application;

FIG. 8 is a flowchart for determining that an electric power constructor has a climbing action according to a two-dimensional gesture provided by an embodiment of the present application;

FIG. 9 is a schematic illustration of a human joint according to an embodiment of the present application;

FIG. 10 is a flowchart for determining that an electric power constructor has a climbing action according to the positions and the two-dimensional postures of the climbing tool and the electric power constructor according to the embodiment of the application;

FIG. 11 is a flowchart for determining that an electric power constructor has a climbing action according to the positions and the two-dimensional postures of the climbing tool and the electric power constructor according to the embodiment of the application;

FIG. 12 is a flowchart for determining that an electric power constructor has a climbing action according to a three-dimensional gesture provided by an embodiment of the present application;

FIG. 13 is a flowchart for determining that an electric power constructor has a climbing action according to the positions and three-dimensional postures of the climbing tool and the electric power constructor according to the embodiment of the application;

FIG. 14 is a flowchart for determining that an electric power constructor has a climbing action according to the positions and three-dimensional attitudes of the climbing tool and the electric power constructor according to another embodiment of the present application;

fig. 15 is a block diagram of an electric power safety construction protection device according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the embodiments of the present application will be described in further detail with reference to the accompanying drawings.

Next, an implementation environment related to the power safety construction protection method provided by the embodiment of the present application will be briefly described.

Fig. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application, as shown in fig. 1, where the implementation environment may include an image acquisition device 101, a background server 102, and a terminal 103, where the image acquisition device 101 may be a device that may acquire an image, such as a camera, a smart phone, a tablet computer, or the like. The image acquisition device 101 may acquire an image of the power construction site and transmit the image of the power construction site to the background server in real time.

The background server 12 may communicate with the image acquisition apparatus 101 and the terminal 103 by wired or wireless means, respectively. The background server 101 may acquire a construction image of the power construction site according to the image of the power construction site transmitted by the image acquisition apparatus, detect whether the power constructor has a climbing action when a climbing tool and the power constructor appear in the construction image, and generate an alarm message when the power constructor has the climbing action. And sending an alarm message to a terminal bound by the construction safety personnel.

The terminal 103 is bound with a construction safety person, and the terminal 103 may be a smart phone, a wearable device, a tablet computer, a desktop computer, or the like. The terminal 103 may receive the alert message sent by the background server 102. The safety constructor can carry out safety supervision on the electric power construction site corresponding to the alarm message according to the alarm message.

Referring to fig. 2, the power safety construction protection method provided by the present application may be applied to a background server as shown in fig. 1, and an internal structure diagram of the background server may be shown in fig. 2, where the background server includes a processor, a memory and a network interface connected through a system bus. Wherein the processor of the background server is configured to provide computing and control capabilities. The memory of the background server includes a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface of the background server is used for communicating with an external terminal through network connection. The computer program when executed by a processor implements a power safety construction protection method.

It will be appreciated by those skilled in the art that the structure shown in fig. 2 is merely a block diagram of a portion of the structure associated with the present inventive arrangements and is not limiting of the computer device to which the present inventive arrangements are applied, and that a particular computer device may include more or fewer components than shown in fig. 2, or may combine certain components, or have a different arrangement of components.

Referring to fig. 3, a flowchart of a power safety construction protection method provided by an embodiment of the present application is shown, where the power safety construction protection method may be applied to a background server in the implementation environment shown in fig. 1, and as shown in fig. 3, the power safety construction protection method may include the following steps:

step 301: the background server acquires a construction image of the power construction site.

In the embodiment of the application, the image of the electric power construction site acquired by the image acquisition equipment can be a video or can be a photo.

Alternatively, when the image of the electric power construction site acquired by the image acquisition device is a photograph, the image acquisition device transmits the photograph of the electric power construction site to the background server in real time, and the background server acquires each photograph as a construction image of the electric power construction site.

Alternatively, when the image of the electric power construction site acquired by the image acquisition device is a video, the process of acquiring the construction image of the electric power construction site by the background server may be: and the background server acquires a construction video of the power construction site. The background server acquires a video frame from the construction video, and takes the acquired video frame as a construction image. The background server can decompose the construction video into video frames which are one by one, and each video frame is used as a construction image.

Step 302: when a climbing tool and an electric power constructor appear in the construction image, the background server detects whether the electric power constructor has a climbing action.

Alternatively, in the embodiment of the present application, the climbing tool may be a ladder, an elevator, or the like.

In the embodiment of the application, the background server firstly detects whether the construction image has a climbing tool and an electric power constructor, wherein only the climbing tool in the construction image has no electric power constructor, or only the electric power constructor has no climbing tool, the background server can judge that the scene in the construction image does not meet the basic elements of the climbing operation, so that the detection of the construction image can be finished, and the background server can sequentially detect the next construction image.

When a climbing tool and an electric power constructor coexist in the construction image, the scene in the construction image satisfies the basic elements of the climbing operation. Under this condition, the background server can detect whether the power constructor in the construction image has a climbing action.

In an alternative implementation, as shown in fig. 4, the process of detecting, by the background server, whether the power constructor has a climbing action in the construction image may include the steps of:

step 401: the background server acquires the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the electric power constructor in the construction image.

In the embodiment of the application, the ascending tools and the power constructors can be respectively identified by adopting the deep convolutional neural network, and after identification, the background server can draw the minimum circumscribed rectangle of each ascending tool and each power constructor in the construction image.

Optionally, in the embodiment of the present application, the background server may acquire an abscissa of an upper left corner and an ordinate of a lower right corner (with an upper left corner of the construction image as an origin of coordinates) of a minimum bounding rectangle of each of the climbing tool and the power constructor.

Optionally, because a plurality of electric power constructors and a plurality of ascending tools may appear in one construction image at the same time, the background server may obtain a minimum circumscribed rectangle of a plurality of electric power constructors, and the minimum circumscribed rectangle of each electric power constructor may be represented as follows:

B _p ＝{p _i ＝(xmin _i ,ymin _i ,xmax _i ,ymax _i )},i∈{1,2,...,n}。

Wherein p is _i The i-th electric power constructor is represented, and n represents the number of electric power constructors in the construction image. (xmin) _i ,ymin _i ) Represents the abscissa of the upper left corner, (xmax) _i ,ymax _i ) And represents the abscissa of the lower right corner.

Similarly, the background server may obtain the minimum bounding rectangle of the ascending tools in the construction image, and the minimum bounding rectangle of each ascending tool may be represented as follows:

B _h ＝{h _j ＝(xmin _j ,ymin _j ,xmax _j ,ymax _j )},j∈{1,2,...,m}

wherein h is _j Represents the j-th ascending tool, m represents the number of ascending tools in the construction image, (xmin) _j ,ymin _j ) Represents the abscissa of the upper left corner, (xmax) _j ,ymax _j ) And represents the abscissa of the lower right corner.

Step 402: and the background server determines whether the electric power constructor has the ascending action according to the relative position relation between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the electric power constructor.

Optionally, the background server may determine a relative position of the minimum bounding rectangle of the climbing tool and the minimum bounding rectangle of the electric power constructor according to a position of the minimum bounding rectangle of the electric power constructor in the construction image and a position of the minimum bounding rectangle of the climbing tool in the construction image. The relative positions of the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the electric power constructor can comprise two conditions of position overlapping and position non-overlapping.

Optionally, in the embodiment of the present application, the background server may determine that the electric power constructor in the construction image has a climbing action when the positions of the minimum bounding rectangle of the climbing tool and the minimum bounding rectangle of the electric power constructor overlap. Correspondingly, the background server can determine that the electric power constructor in the construction image does not have the ascending action when the positions of the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the electric power constructor are not overlapped.

Optionally, in the embodiment of the present application, the process that the background server determines whether the electric power constructor has the ascending action according to the relative positional relationship between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the electric power constructor may further be:

a1: the background server can acquire the overlapping area of the minimum circumscribed rectangle of the power constructor and the minimum circumscribed rectangle of the ascending tool.

As shown in FIG. 5, wherein S _P For electric power constructor P _i Is the smallest circumscribed rectangular area of S _I For electric power constructor P _i Minimum bounding rectangle of (1) and ascending tool h _j Is defined as the smallest circumscribed rectangular overlap area.

A2: and the background server determines whether the power constructor has a climbing action according to the area of the overlapping area.

In the embodiment of the application, the background server determines whether the power constructor has the ascending action according to the area of the overlapping area, which can be as follows: overlapping area S of overlapping area of minimum bounding rectangle of electric power constructor and minimum bounding rectangle of climbing tool _I And climbing tool h _j Is the minimum circumscribed rectangular area S _h Ratio S of (2) _I /S _h When the overlapping threshold value is larger than the overlapping threshold value, judging the power constructor P _i Has a climbing action.

Optionally, the step of determining, by the background server, whether the power constructor has a climbing action according to the area of the overlapping area may be:

calculating the electric power constructor P _i Minimum bounding rectangle of (1) and ascending tool h _j Overlapping area S of the smallest bounding rectangle of (2) _I With electric power constructor P _i Is the minimum circumscribed rectangular area S _P Ratio S of (2) _I /S _P 。

In the embodiment of the application, an overlapping threshold A can be set, wherein A is a time interval (0, 1]Is a constant of (c). Alternatively, a may be 0.5. Alternatively, when the ratio S _I /S _P When the overlapping threshold value A is larger than the overlapping threshold value A, the electric power constructor P is judged _i Has a climbing action. When the ratio S _I /S _P When the overlapping threshold value A is smaller than or equal to the overlapping threshold value A, the electric power constructor P is judged _i No ascending action is provided.

Step 303: when the power constructor has a climbing action, the background server generates an alarm message.

In the embodiment of the application, the background server can automatically generate the alarm message when detecting that the power constructor has the ascending action in the construction image.

Step 304: the background server sends an alarm message to a terminal bound by the construction safety personnel.

The alarm message is used for indicating a construction safety person to carry out safety supervision on the electric power construction site corresponding to the alarm message.

In the embodiment of the application, the background server sends the alarm message to the terminal bound by the construction safety personnel, and the construction safety personnel can carry out safety supervision on the electric power construction site corresponding to the alarm message after receiving the alarm message through the bound terminal.

Optionally, after receiving the alarm message, the construction safety personnel can arrive at the power construction site in the construction image corresponding to the alarm message, so as to monitor and standardize the safety protection measures of the working power construction personnel and the safety performance of the ascending tool. Thus, after the safety supervision and the standardization work of one electric power construction site are completed, the construction safety personnel can arrive at another electric power construction site to carry out safety supervision according to the received new alarm message.

Optionally, the background server may further send a construction image corresponding to the alarm message to a terminal bound by the construction safety member, and the construction safety member may receive the construction image at the same time when receiving the alarm message, and then may monitor and normalize the safety protection measures of the working power constructor and the safety performance of the ascending tool on the power construction site according to the received construction image.

In this process, the construction safety officer may not move the position, but determine the safety of the working power constructor and the climbing tool of the power construction site from the construction image. When the safety of the working power constructor and the ascending tool is unreliable, the working power constructor can be contacted with the working power constructor on the power construction site through the instant communication tool so as to complete the safety supervision and the standard work on the power construction site. Thus, the construction safety personnel can conduct safety supervision on the electric power construction sites corresponding to the plurality of alarm messages at the same time.

Optionally, when the electric power constructor has a climbing action in the construction image, the background server may send a construction video to the terminal bound by the construction safety constructor, where the construction video is the construction video recited in step 302.

The construction video can be displayed on a terminal bound with a construction safety person, and the construction safety person can conduct safety supervision on the electric power construction site based on the displayed construction video. That is, the construction safety officer can conduct safety supervision and standardization on the working power constructors and the ascending tools of the power construction site by watching the construction video.

When the terminal bound with the construction safety officer receives a plurality of alarm messages, the construction safety officer can conduct safety supervision on the power construction site reflected by the construction video corresponding to each alarm message.

According to the electric power safety construction protection method provided by the embodiment of the application, when the terminal bound by the construction safety officer receives the alarm message, the construction safety officer carries out safety supervision on the electric power construction site corresponding to the alarm message, and different alarm messages can correspond to different electric power construction sites, so that the construction safety officer can carry out safety supervision on a plurality of electric power construction sites without being fixedly positioned in one electric power construction site. Therefore, compared with the prior art, the technical scheme reduces the input of human resources and improves the working efficiency.

In an alternative implementation, since a plurality of power constructors and a plurality of climbing tools may occur in one construction image at the same time, in this case, as shown in fig. 6, the process of detecting whether the power constructors have a climbing action by the background server may include the steps of:

step 601: for each of the climbing tools, the background server determines a plurality of climbing combinations according to the climbing tool and a plurality of power constructors.

The ascending combination comprises the ascending tool and any one electric power constructor.

In the embodiment of the application, for example, there are 3 ascending tools s1, s2 and s3, and four electric power constructors r1, r2, r3 and r4, then for each ascending tool, for example, the ascending tool s1, is combined with four electric power constructors respectively to obtain four ascending combinations, which may be s1-r1, s1-r2, s1-r3 and s1-r4 respectively. Similarly, four ascending combinations s2-r1, s2-r2, s2-r3, s1-r4, and s3-r1, s3-r2, s3-r3, s3-r4 may also be formed for ascending tools s2 and s3, respectively.

Step 602: for each ascending combination, the background server detects whether the electric power constructor in the ascending combination has an ascending action.

In the embodiment of the application, the background server can acquire the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the electric power constructor in the ascending combination.

The background server may determine whether the electric power constructor has the ascending action in the ascending combination according to the relative position of the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the electric power constructor in the ascending combination, and may refer to the disclosure in step 402.

In any one of the plurality of ascending combinations, if the electric power constructor in the ascending combination has an ascending action, the electric power constructor in the construction image is confirmed to have an ascending action, otherwise, the electric power constructor in the construction image is confirmed to have no ascending action.

The method provided by the embodiment can process the condition that a plurality of ascending tools and a plurality of electric power constructors exist in the construction image, can detect whether the electric power constructors have ascending actions or not more accurately, and improves the detection accuracy.

In an alternative implementation manner, as shown in fig. 7, the process that the background server determines that the power constructor is constructed to have the ascending action according to the position relationship between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor may further include the following steps:

step 701: the background server obtains the first height of the minimum circumscribed rectangle of the power constructor, and determines a height threshold according to the first height.

As shown in fig. 5, the first height of the minimum bounding rectangle of the electric power constructor refers to the height in the vertical direction, and optionally, the background server may obtain the abscissa (xmin _i ,ymin _i ) The abscissa (xmax _i ,ymax _i ) Then the first height can be found to be H1: h1 =ymax _i -ymin _i 。

Alternatively, in the embodiment of the present application, the first height may be used as the height threshold.

Alternatively, in an embodiment of the present application, the height threshold may be a product of the height coefficient and the first height.

Alternatively, in the embodiment of the present application, a height coefficient may be set, and optionally, the height coefficient may be 1/3.

Step 702: the background server obtains a second height from the bottom edge of the smallest circumscribed rectangle of the electric power constructor to the bottom edge of the smallest circumscribed rectangle of the ascending tool.

As shown in fig. 5, the second height may be according to the abscissa (xmax _i ,ymax _i ) And the abscissa and ordinate of the right lower corner of the minimum circumscribed rectangle of the climbing toolxmax _j ,ymax _j ) The second height is calculated as H2: h2 =ymax _j -ymin _i 。

Step 703: and when the second height is greater than or equal to the height threshold value, the background server determines that the power constructor has a climbing action.

In the embodiment of the application, when the second height is greater than or equal to the height threshold value, the overlapping areas of the power constructors and the ascending tool are more, so that the power constructors can be judged to be located on the ascending tool, and the background server can determine that the power constructors have ascending actions.

In an optional implementation manner, the process of determining that the power constructor has the ascending action according to the position relationship between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor by the background server may further be:

the background server can acquire the overlapping area of the minimum circumscribed rectangle of the power constructor and the minimum circumscribed rectangle of the ascending tool.

When the ratio of the area of the overlapping area to the area of the minimum circumscribed rectangle of the power constructor is larger than the overlapping threshold value, the background server can acquire the first height of the minimum circumscribed rectangle of the power constructor, and the height threshold value is determined according to the first height.

The background server obtains a second height from the bottom edge of the smallest circumscribed rectangle of the electric power constructor to the bottom edge of the smallest circumscribed rectangle of the ascending tool.

And when the second height is greater than or equal to the height threshold value, the background server determines that the power constructor has a climbing action.

In an alternative implementation manner, as shown in fig. 8, the process that the background server determines that the power constructor is constructed to have the ascending action according to the position relationship between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor may further include the following steps:

step 801: and the background server intercepts the personnel area image from the construction image according to the minimum circumscribed rectangle of the power constructor.

In the embodiment of the application, the background server can intercept the personnel area image in the construction image through the neural network learning model.

Optionally, when the construction image includes a plurality of electric power constructors, the image of each electric power constructor may be intercepted, and a personnel area image of each electric power constructor may be obtained.

Step 802: and the background server inputs the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the electric power constructor output by the two-dimensional attitude estimation model.

The two-dimensional joint coordinate set comprises two-dimensional coordinates of each joint of the electric power constructor, which are displayed in the personnel area image.

In the embodiment of the application, the two-dimensional attitude estimation model can be a trained deep convolutional neural network model.

For each personnel area image, the background server inputs the personnel area image into a two-dimensional attitude estimation model, and then a two-dimensional joint coordinate set corresponding to the personnel area image can be obtained, for example, the two-dimensional joint coordinate set is:wherein K is _j For the two-dimensional joint coordinate set corresponding to the jth personnel area image, < >>The coordinates of the ith joint in the jth personnel area image are represented, n represents the number of joints, and m represents the number of personnel area images included in one construction image.

As shown in fig. 9, a simplified diagram of a human joint is shown in fig. 9, wherein 17 joints are shown, and each joint is numbered for ease of distinction. According to the personnel area image, a plurality of joint points which can be directly observed in the personnel area image can be obtained, the coordinates of the plurality of joint points which can be directly observed are obtained by taking the upper left corner of the personnel area image as the origin of coordinates, and the coordinates of the plurality of joint points are combined to form a two-dimensional joint coordinate set.

Step 803: and the background server determines whether the electric power constructor has a climbing action according to the two-dimensional joint coordinate set of the electric power constructor.

When a plurality of electric power constructors are included in the construction image, the background server needs to judge a two-dimensional joint coordinate set of each electric power constructor, and when one electric power constructor exists in the plurality of electric power constructors and has a climbing action, the electric power constructor in the construction image is determined to have the climbing action.

Optionally, the process that the background server confirms whether the electric power constructor has the ascending action according to the two-dimensional joint coordinate set of the electric power constructor may include the following steps:

step S1: the background server acquires forearm vectors of the electric power constructors from the two-dimensional joint coordinate set of the electric power constructors.

Since the power constructor may be facing the image observer from the front or from the left or right side in the construction image, the forearm vector may be a left or right forearm vector, or left and right forearm vector.

In the embodiment of the present application, as can be seen in conjunction with fig. 9, the two joint points of the left forearm are the left elbow joint 6 and the left wrist joint 7, and the left forearm vector may be: Coordinates of left elbow joint corresponding to the jth personnel area image>The coordinates of the left wrist joint corresponding to the jth personnel area image.

The two joint points of the right forearm are respectively a right elbow joint 3 and a right wrist joint 4, and the vector of the right forearm can be Coordinates of the right elbow joint corresponding to the jth personnel area image>The coordinates of the right wrist corresponding to the jth personnel area image.

Step S2: the background server determines the included angle between the forearm vector and the longitudinal axis vector according to the forearm vector.

When the forearm vector is a left forearm vector, the angle between the forearm vector and the longitudinal axis vector may be the angle between the left forearm vector and the longitudinal axis vectorThe angle between the left forearm vector and the longitudinal axis vector can be calculated according to formula (1)>Wherein, formula (1) is as follows:

when the forearm vector is a right forearm vector, the angle between the forearm vector and the longitudinal axis vector is the angle between the right forearm vector and the longitudinal axis vectorThe angle between the right forearm vector and the longitudinal axis vector can be calculated according to formula (2)>Wherein, formula (2) is as follows:

step S3: when the included angle is larger than the included angle threshold value, the background server determines that the electric power constructor has a climbing action.

In the embodiment of the application, an included angle threshold value can be set, and the optional included angle threshold value can be 60 degrees.

When the included angle is larger than the included angle threshold value, the included angle formed between the forearm of the electric power constructor and the climbing tool can be considered to be similar to the included angle formed when the electric power constructor climbs, so that the background server judges that the electric power constructor has the climbing action.

Optionally, when the forearm vector includes both a left forearm vector and a right forearm vector, the angle between the left forearm vector and the longitudinal axis vectorAnd the right forearm vector is at an angle to the longitudinal axis vector +.>Any one of the power constructors is larger than the included angle threshold value, and the background server can determine that the power constructors have ascending actions.

In an alternative implementation, as shown in fig. 10, the process of determining whether the power constructor has a climbing action by combining the relative positions of the climbing tool and the power constructor and the posture of the power constructor may be:

step 1001: the background server acquires an overlapping area of the minimum circumscribed rectangle of the power constructor and the minimum circumscribed rectangle of the ascending tool.

Step 1002: when the ratio of the area of the overlapping area to the area of the minimum circumscribed rectangle of the power constructor is larger than the overlapping threshold value, the background server intercepts the personnel area image from the construction image according to the minimum circumscribed rectangle of the power constructor.

Step 1003: and the background server inputs the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the electric power constructor output by the two-dimensional attitude estimation model.

Step 1004: and the background server determines whether the electric power constructor has a climbing action according to the two-dimensional joint coordinate set of the electric power constructor.

In an alternative implementation, as shown in fig. 11, the process of determining whether the power constructor has a climbing action by combining the relative positions of the climbing tool and the power constructor and the posture of the power constructor may be:

step 1101: the background server obtains the first height of the minimum circumscribed rectangle of the power constructor, and determines a height threshold according to the first height.

Step 1102: the background server obtains a second height from the bottom edge of the smallest circumscribed rectangle of the electric power constructor to the bottom edge of the smallest circumscribed rectangle of the ascending tool.

Step 1103: when the second height is greater than or equal to the height threshold, the background server intercepts the personnel area image from the construction image according to the minimum circumscribed rectangle of the power constructor.

Step 1104: and the background server inputs the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the electric power constructor output by the two-dimensional attitude estimation model.

Step 1105: and the background server determines whether the electric power constructor has a climbing action according to the two-dimensional joint coordinate set of the electric power constructor.

In an alternative implementation, the process of determining whether the electric power constructor has a climbing action by combining the relative positions of the climbing tool and the electric power constructor and the posture of the electric power constructor may be:

When the second height is greater than or equal to the height threshold, the background server intercepts the personnel area image from the construction image according to the minimum circumscribed rectangle of the power constructor.

And the background server inputs the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the electric power constructor output by the two-dimensional attitude estimation model.

And the background server determines whether the electric power constructor has a climbing action according to the two-dimensional joint coordinate set of the electric power constructor.

Because the construction image is a two-dimensional plane image, visual errors can occur in the two-dimensional image due to the position relation between the electric power constructor and the ascending tool, so that whether the electric power constructor has the ascending action or not is determined according to the two-dimensional joint coordinate set, and misjudgment is easy to occur. In order to improve the judgment precision, in an alternative implementation manner, as shown in fig. 12, the process of determining, by the background server, that the power constructor has a lifting action in construction according to the positional relationship between the minimum circumscribed rectangle of the lifting tool and the minimum circumscribed rectangle of the power constructor may further include the following steps:

step 1201: and the background server intercepts the personnel area image from the construction image according to the minimum circumscribed rectangle of the power constructor.

Step 1202: and the background server inputs the personnel area image into the three-dimensional posture estimation model to obtain a three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional posture estimation model.

In an alternative implementation, the process of inputting the person region image into the three-dimensional pose estimation model by the background server may be: and inputting the personnel area image into a two-dimensional gesture estimation model to obtain a two-dimensional joint coordinate set, and then inputting the two-dimensional joint coordinate set into a three-dimensional gesture estimation model to obtain a three-dimensional joint coordinate set of the electric power constructor.

The three-dimensional joint coordinate set comprises three-dimensional coordinates of each joint of the electric power constructor, which are displayed in the personnel area image.

In the embodiment of the application, the three-dimensional attitude estimation model can be a trained deep convolutional neural network model.

For each personnel area image, the background server inputs the personnel area image into a three-dimensional attitude estimation model, and then a three-dimensional joint coordinate set corresponding to the personnel area image can be obtained, for example, the three-dimensional joint coordinate set is:wherein T is _j For the three-dimensional joint coordinate set corresponding to the jth personnel area image, < >>The three-dimensional coordinates of the ith joint in the jth personnel area image are represented, n represents the number of joints, and m represents the number of personnel area images included in one construction image.

Step 1203: and the background server determines whether the electric power constructor has a climbing action according to the three-dimensional joint coordinate set of the electric power constructor.

When a plurality of electric power constructors are included in the construction image, the background server needs to judge a three-dimensional joint coordinate set of each electric power constructor, and when one electric power constructor exists in the plurality of electric power constructors and has a climbing action, the electric power constructor in the construction image is determined to have the climbing action.

Optionally, the process that the background server determines whether the electric power constructor has a climbing action according to the three-dimensional joint coordinate set of the electric power constructor may include the following steps:

b1: the background server acquires forearm vectors of the electric power constructors from the three-dimensional joint coordinate set of the electric power constructors.

Wherein the forearm vector comprises a left forearm vector and/or a right forearm vector.

Wherein the left forearm vector may beThree-dimensional coordinates of left elbow joint corresponding to the jth personnel area image +.>And the three-dimensional coordinates of the left wrist joint corresponding to the jth personnel area image.

The right forearm vector may be Three-dimensional coordinates of the right elbow joint corresponding to the jth personnel area image +. >And the three-dimensional coordinates of the right wrist joint corresponding to the jth personnel area image.

B2: and the background server determines the included angle between the forearm vector and the ground normal vector according to the forearm vector.

When the forearm vector is the left forearm vector, the included angle between the forearm vector and the ground normal vector is

When the forearm vector is the right forearm vector, the included angle between the forearm vector and the ground normal vector is

B3: when the included angle is larger than the included angle threshold value, the background server determines that the electric power constructor has a climbing action.

In the embodiment of the application, when the forearm vector comprises a left forearm vector and a right forearm vector at the same time, the included angle between the left forearm vector and the ground normal vectorAnd the right forearm vector is in an angle of +.>When any one of the power constructors is larger than the included angle threshold value, the background server can determine that the power constructors have ascending actions.

In an alternative implementation, as shown in fig. 13, the process of determining whether the power constructor has a climbing action by combining the relative positions of the climbing tool and the power constructor and the posture of the power constructor may be:

step 1301: the background server acquires an overlapping area of the minimum circumscribed rectangle of the power constructor and the minimum circumscribed rectangle of the ascending tool.

Step 1302: when the ratio of the area of the overlapping area to the area of the minimum circumscribed rectangle of the power constructor is larger than the overlapping threshold value, the background server intercepts the personnel area image from the construction image according to the minimum circumscribed rectangle of the power constructor.

Step 1303: and the background server inputs the personnel area image into the three-dimensional posture estimation model to obtain a three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional posture estimation model.

Step 1304: and the background server determines whether the electric power constructor has a climbing action according to the three-dimensional joint coordinate set of the electric power constructor.

In an alternative implementation, as shown in fig. 14, the process of determining whether the power constructor has a climbing action by combining the relative positions of the climbing tool and the power constructor and the posture of the power constructor may be:

step 1401: the background server obtains the first height of the minimum circumscribed rectangle of the power constructor, and determines a height threshold according to the first height.

Step 1402: the background server obtains a second height from the bottom edge of the smallest circumscribed rectangle of the electric power constructor to the bottom edge of the smallest circumscribed rectangle of the ascending tool.

Step 1403: when the second height is greater than or equal to the height threshold, the background server intercepts the personnel area image from the construction image according to the minimum circumscribed rectangle of the power constructor.

Step 1404: and the background server inputs the personnel area image into the three-dimensional posture estimation model to obtain a three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional posture estimation model.

Step 1405: and the background server determines whether the electric power constructor has a climbing action according to the three-dimensional joint coordinate set of the electric power constructor.

And the background server inputs the personnel area image into the three-dimensional posture estimation model to obtain a three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional posture estimation model.

And the background server determines whether the electric power constructor has a climbing action according to the three-dimensional joint coordinate set of the electric power constructor.

The background server can input the two-dimensional joint coordinate set into the three-dimensional posture estimation model to obtain the three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional posture estimation model.

And the background server determines whether the electric power constructor has a climbing action according to the two-dimensional joint coordinate set and the three-dimensional joint coordinate set of the electric power constructor.

When it is confirmed that the electric power constructor has a climbing action based on either one of the two-dimensional joint coordinate set or the three-dimensional joint coordinate set, it is possible to determine that the electric power constructor in the construction image has a climbing action.

Referring to fig. 15, a block diagram of a power safety construction protection device according to an embodiment of the present application is shown, where the power safety construction protection device may be configured in a background server in the implementation environment shown in fig. 1. As shown in fig. 15, the power safety construction protection device may include a construction image acquisition module 1501, a climbing action detection module 1502, an alarm message generation module 1503, and an alarm message transmission module 1504, wherein:

A construction image acquisition module 1501 for acquiring a construction image of an electric power construction site; a climbing action detection module 1502, configured to detect, when a climbing tool and an electric power constructor appear in a construction image, whether the electric power constructor has a climbing action; the alarm message generating module 1503 is configured to generate an alarm message when the electric power constructor has a climbing action; the alarm message sending module 1504 is configured to send an alarm message to a terminal bound by a construction safety officer, where the alarm message is used to instruct the construction safety officer to perform safety supervision on an electric power construction site corresponding to the alarm message.

In one embodiment of the present application, the construction image acquisition module 1501 is further configured to acquire a construction video of the power construction site; and acquiring a video frame from the construction video, and taking the acquired video frame as a construction image.

In one embodiment of the present application, the alarm message generating module 1503 is further configured to send a construction video to the terminal when the power constructor has a climbing action, where the construction video is used for being displayed on the terminal, so that the construction safety officer can perform safety supervision on the power construction site based on the displayed construction video.

In one embodiment of the present application, the ascending motion detection module 1502 is further configured to obtain a minimum bounding rectangle of an ascending tool in the construction image and a minimum bounding rectangle of an electric power constructor; and determining whether the electric power constructor has the ascending action according to the relative position relation between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the electric power constructor.

In one embodiment of the present application, the ascending motion detection module 1502 is further configured to obtain an overlapping area of a minimum bounding rectangle of the electric power constructor and a minimum bounding rectangle of the ascending tool; and determining whether the electric power constructor has a climbing action according to the area of the overlapping area.

In one embodiment of the present application, the ascending motion detection module 1502 is further configured to determine that the electric power constructor has an ascending motion when a ratio of an area of the overlapping region to an area of the smallest bounding rectangle of the electric power constructor is greater than an overlapping threshold.

In one embodiment of the present application, the ascending motion detection module 1502 is further configured to obtain a first height of a minimum bounding rectangle of the electric power constructor, and determine a height threshold according to the first height; acquiring a second height from the bottom edge of the minimum circumscribed rectangle of the electric power constructor to the bottom edge of the minimum circumscribed rectangle of the ascending tool; and when the second height is greater than or equal to the height threshold value, determining that the electric power constructor has a climbing action.

In one embodiment of the present application, the ascending motion detection module 1502 is further configured to intercept a personnel area image from the construction image according to a minimum bounding rectangle of the power constructor; inputting the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the electric power constructor output by the two-dimensional attitude estimation model, wherein the two-dimensional joint coordinate set comprises the two-dimensional coordinates of each joint of the electric power constructor presented in the personnel area image; and determining whether the electric power constructor has a climbing action according to the two-dimensional joint coordinate set of the electric power constructor.

In one embodiment of the present application, the ascending motion detection module 1502 is further configured to obtain a forearm vector of the power constructor from the two-dimensional joint coordinate set of the power constructor, where the forearm vector includes a left forearm vector and/or a right forearm vector; determining an included angle between the forearm vector and the longitudinal axis vector according to the forearm vector; when the included angle is larger than the included angle threshold value, determining that the electric power constructor has a climbing action.

In one embodiment of the present application, the ascending motion detection module 1502 is further configured to intercept a personnel area image from the construction image according to a minimum bounding rectangle of the power constructor; inputting a two-dimensional joint coordinate set of the electric power constructor into the three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional attitude estimation model, wherein the three-dimensional joint coordinate set comprises three-dimensional coordinates of each joint of the electric power constructor presented in a personnel area image; and determining whether the electric power constructor has a climbing action according to the three-dimensional joint coordinate set of the electric power constructor.

In one embodiment of the present application, the ascending motion detection module 1502 is further configured to obtain a forearm vector of the power constructor from the three-dimensional joint coordinate set of the power constructor, where the forearm vector includes a left forearm vector and/or a right forearm vector; determining an included angle between the forearm vector and the ground normal vector according to the forearm vector; when the included angle is larger than the included angle threshold value, determining that the electric power constructor has a climbing action.

In one embodiment of the present application, the ascending motion detection module 1502 is further configured to determine, for each ascending tool, a plurality of ascending combinations according to the ascending tool and a plurality of electric power constructors, where the ascending combinations include the ascending tool and any electric power constructor; for each ascending combination, it is detected whether or not the electric power constructor in the ascending combination has an ascending action.

The specific limitation of the electric power safety construction protection device can be referred to the limitation of the electric power safety construction protection method hereinabove, and the description thereof is omitted herein. The above-mentioned various modules in the electric power safety construction protection device may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.

In one embodiment of the application, a computer device is provided, comprising a memory storing a computer program and a processor, the processor executing the computer program to perform the steps of:

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring a construction video of an electric power construction site; and acquiring a video frame from the construction video, and taking the acquired video frame as a construction image.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: when the power constructor has the action of ascending, the construction video is sent to the terminal and used for being displayed at the terminal, so that the construction safety officer can conduct safety supervision on the power construction site based on the displayed construction video.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring a minimum external rectangle of a climbing tool and a minimum external rectangle of an electric power constructor in a construction image; and determining whether the electric power constructor has the ascending action according to the relative position relation between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the electric power constructor.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring an overlapping area of the minimum circumscribed rectangle of the electric power constructor and the minimum circumscribed rectangle of the ascending tool; and determining whether the electric power constructor has a climbing action according to the area of the overlapping area.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: and when the ratio of the area of the overlapping area to the area of the minimum circumscribed rectangle of the power constructor is larger than the overlapping threshold value, determining that the power constructor has a climbing action.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring a first height of a minimum circumscribed rectangle of an electric power constructor, and determining a height threshold according to the first height; acquiring a second height from the bottom edge of the minimum circumscribed rectangle of the electric power constructor to the bottom edge of the minimum circumscribed rectangle of the ascending tool; and when the second height is greater than or equal to the height threshold value, determining that the electric power constructor has a climbing action.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: intercepting a personnel area image from a construction image according to the minimum circumscribed rectangle of the electric power constructor; inputting the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the electric power constructor output by the two-dimensional attitude estimation model, wherein the two-dimensional joint coordinate set comprises the two-dimensional coordinates of each joint of the electric power constructor presented in the personnel area image; and determining whether the electric power constructor has a climbing action according to the two-dimensional joint coordinate set of the electric power constructor.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring a forearm vector of the electric power constructor from a two-dimensional joint coordinate set of the electric power constructor, wherein the forearm vector comprises a left forearm vector and/or a right forearm vector; determining an included angle between the forearm vector and the longitudinal axis vector according to the forearm vector; when the included angle is larger than the included angle threshold value, determining that the electric power constructor has a climbing action.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: intercepting a personnel area image from a construction image according to the minimum circumscribed rectangle of the electric power constructor; inputting a two-dimensional joint coordinate set of the electric power constructor into the three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional attitude estimation model, wherein the three-dimensional joint coordinate set comprises three-dimensional coordinates of each joint of the electric power constructor presented in a personnel area image; and determining whether the electric power constructor has a climbing action according to the three-dimensional joint coordinate set of the electric power constructor.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring a forearm vector of the electric power constructor from a three-dimensional joint coordinate set of the electric power constructor, wherein the forearm vector comprises a left forearm vector and/or a right forearm vector; determining an included angle between the forearm vector and the ground normal vector according to the forearm vector; when the included angle is larger than the included angle threshold value, determining that the electric power constructor has a climbing action.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: for each ascending tool, determining a plurality of ascending combinations according to the ascending tool and a plurality of electric power constructors, wherein the ascending combinations comprise the ascending tool and any electric power constructor; for each ascending combination, it is detected whether or not the electric power constructor in the ascending combination has an ascending action.

The implementation principle and technical effects of the computer device provided by the embodiment of the present application are similar to those of the above method embodiment, and are not described herein.

In one embodiment of the present application, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of:

In one embodiment of the application, the computer program may further implement the following steps when executed by a processor: acquiring a construction video of an electric power construction site; and acquiring a video frame from the construction video, and taking the acquired video frame as a construction image.

In one embodiment of the application, the computer program may further implement the following steps when executed by a processor: when the power constructor has the action of ascending, the construction video is sent to the terminal and used for being displayed at the terminal, so that the construction safety officer can conduct safety supervision on the power construction site based on the displayed construction video.

In one embodiment of the application, the computer program may further implement the following steps when executed by a processor: acquiring a minimum external rectangle of a climbing tool and a minimum external rectangle of an electric power constructor in a construction image; and determining whether the electric power constructor has the ascending action according to the relative position relation between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the electric power constructor.

In one embodiment of the application, the computer program may further implement the following steps when executed by a processor: acquiring an overlapping area of the minimum circumscribed rectangle of the electric power constructor and the minimum circumscribed rectangle of the ascending tool; and determining whether the electric power constructor has a climbing action according to the area of the overlapping area.

In one embodiment of the application, the computer program may further implement the following steps when executed by a processor: and when the ratio of the area of the overlapping area to the area of the minimum circumscribed rectangle of the power constructor is larger than the overlapping threshold value, determining that the power constructor has a climbing action.

In one embodiment of the application, the computer program may further implement the following steps when executed by a processor: acquiring a first height of a minimum circumscribed rectangle of an electric power constructor, and determining a height threshold according to the first height; acquiring a second height from the bottom edge of the minimum circumscribed rectangle of the electric power constructor to the bottom edge of the minimum circumscribed rectangle of the ascending tool; and when the second height is greater than or equal to the height threshold value, determining that the electric power constructor has a climbing action.

In one embodiment of the application, the computer program may further implement the following steps when executed by a processor: intercepting a personnel area image from a construction image according to the minimum circumscribed rectangle of the electric power constructor; inputting the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the electric power constructor output by the two-dimensional attitude estimation model, wherein the two-dimensional joint coordinate set comprises the two-dimensional coordinates of each joint of the electric power constructor presented in the personnel area image; and determining whether the electric power constructor has a climbing action according to the two-dimensional joint coordinate set of the electric power constructor.

In one embodiment of the application, the computer program may further implement the following steps when executed by a processor: acquiring a forearm vector of the electric power constructor from a two-dimensional joint coordinate set of the electric power constructor, wherein the forearm vector comprises a left forearm vector and/or a right forearm vector; determining an included angle between the forearm vector and the longitudinal axis vector according to the forearm vector; when the included angle is larger than the included angle threshold value, determining that the electric power constructor has a climbing action.

In one embodiment of the application, the computer program may further implement the following steps when executed by a processor: intercepting a personnel area image from a construction image according to the minimum circumscribed rectangle of the electric power constructor; inputting a two-dimensional joint coordinate set of the electric power constructor into the three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional attitude estimation model, wherein the three-dimensional joint coordinate set comprises three-dimensional coordinates of each joint of the electric power constructor presented in a personnel area image; and determining whether the electric power constructor has a climbing action according to the three-dimensional joint coordinate set of the electric power constructor.

In one embodiment of the application, the computer program may further implement the following steps when executed by a processor: acquiring a forearm vector of the electric power constructor from a three-dimensional joint coordinate set of the electric power constructor, wherein the forearm vector comprises a left forearm vector and/or a right forearm vector; determining an included angle between the forearm vector and the ground normal vector according to the forearm vector; when the included angle is larger than the included angle threshold value, determining that the electric power constructor has a climbing action.

In one embodiment of the application, the computer program may further implement the following steps when executed by a processor: for each ascending tool, determining a plurality of ascending combinations according to the ascending tool and a plurality of electric power constructors, wherein the ascending combinations comprise the ascending tool and any electric power constructor; for each ascending combination, it is detected whether or not the electric power constructor in the ascending combination has an ascending action.

The computer readable storage medium provided in the embodiments of the present application has similar principles and technical effects to those of the above method embodiments, and will not be described herein.

Those skilled in the art will appreciate that implementing all or part of the above-described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.

The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The above examples illustrate only a few embodiments of the application, which are described in detail and are not to be construed as limiting the scope of the claims. It should be noted that variations and modifications can be made by those skilled in the art without departing from the spirit of the application, which falls within the scope of the application. Accordingly, the scope of protection of the present application is to be determined by the appended claims.

Claims

1. A method of protecting against electrical safety construction, the method comprising:

acquiring a construction image of an electric power construction site;

when a climbing tool and an electric power constructor appear in the construction image, acquiring a minimum circumscribed rectangle of the electric power constructor;

intercepting a personnel area image from the construction image according to the minimum circumscribed rectangle of the electric power constructor;

Inputting the personnel area image into a three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional attitude estimation model, wherein the three-dimensional joint coordinate set comprises three-dimensional coordinates of each joint of the electric power constructor presented in the personnel area image;

acquiring a forearm vector of the electric power constructor from a three-dimensional joint coordinate set of the electric power constructor, determining an included angle between the forearm vector and a ground normal vector according to the forearm vector, and determining that the electric power constructor has a climbing action when the included angle is larger than an included angle threshold;

when the electric power constructor has a climbing action, generating an alarm message; the alarm message carries the construction image;

and sending the alarm message to a terminal bound by a construction safety officer, wherein the alarm message is used for indicating the construction safety officer to carry out safety supervision on the safety protection measures of the electric power constructors and the safety performance of the ascending tool on the electric power construction site corresponding to the alarm message according to the construction image.

2. The method according to claim 1, wherein the method further comprises:

When the electric power constructor has a climbing action, acquiring a construction video of the electric power construction site, and sending the construction video to the terminal, wherein the construction video is used for being displayed at the terminal so as to enable the construction safety constructor to conduct safety supervision on the electric power construction site based on the displayed construction video.

3. The method of claim 1, wherein prior to said capturing a personnel area image from the construction image based on the minimum bounding rectangle of the power constructor, the method further comprises:

when the ascending tool and the electric power constructor appear in the construction image, acquiring a minimum circumscribed rectangle of the ascending tool in the construction image;

acquiring an overlapping area of the minimum circumscribed rectangle of the electric power constructor and the minimum circumscribed rectangle of the ascending tool;

and when the ratio of the area of the overlapping area to the area of the minimum circumscribed rectangle of the electric power constructor is larger than an overlapping threshold value, intercepting a personnel area image from the construction image according to the minimum circumscribed rectangle of the electric power constructor.

4. The method of claim 1, wherein prior to said capturing a personnel area image from the construction image based on the minimum bounding rectangle of the power constructor, the method further comprises:

acquiring a first height of a minimum circumscribed rectangle of the electric power constructor, and determining a height threshold according to the first height;

acquiring a second height from the bottom edge of the minimum circumscribed rectangle of the electric power constructor to the bottom edge of the minimum circumscribed rectangle of the ascending tool;

and when the second height is greater than or equal to the height threshold, intercepting a personnel area image from the construction image according to the minimum circumscribed rectangle of the electric power constructor.

5. The method of claim 1, wherein the inputting the person region image into a three-dimensional pose estimation model to obtain the three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional pose estimation model comprises:

inputting the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the electric power constructor output by the two-dimensional attitude estimation model, wherein the two-dimensional joint coordinate set comprises two-dimensional coordinates of each joint of the electric power constructor presented in the personnel area image;

And inputting the two-dimensional joint coordinate set into the three-dimensional attitude estimation model to obtain the three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional attitude estimation model.

6. The method of claim 1, wherein the construction image includes a plurality of climbing tools and a plurality of power constructors, and detecting whether the power constructors have a climbing action comprises:

for each ascending tool, determining a plurality of ascending combinations according to the ascending tool and the plurality of electric power constructors, wherein the ascending combinations comprise the ascending tool and any one of the electric power constructors;

and detecting whether the electric power constructors in the ascending combination have ascending actions for each ascending combination.

7. An electrical safety construction protection device, the device comprising:

the construction image acquisition module is used for acquiring a construction image of the electric power construction site;

the ascending motion detection module is used for acquiring the minimum circumscribed rectangle of the electric power constructor in the construction image when an ascending tool and the electric power constructor appear in the construction image; intercepting a personnel area image from the construction image according to the minimum circumscribed rectangle of the electric power constructor; inputting the personnel area image into a three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the electric power constructor output by the three-dimensional attitude estimation model, wherein the three-dimensional joint coordinate set comprises three-dimensional coordinates of each joint of the electric power constructor presented in the personnel area image; acquiring a forearm vector of the electric power constructor from a three-dimensional joint coordinate set of the electric power constructor, determining an included angle between the forearm vector and a ground normal vector according to the forearm vector, and determining that the electric power constructor has a climbing action when the included angle is larger than an included angle threshold;

The alarm message generation module is used for generating an alarm message when the electric power constructor has a climbing action; the alarm message carries the construction image;

the alarm message sending module is used for sending the alarm message to a terminal bound by a construction safety member, and the alarm message is used for indicating the construction safety member to carry out safety supervision on safety protection measures of electric power constructors and safety performance of the ascending tool on an electric power construction site corresponding to the alarm message according to the construction image.

8. The apparatus of claim 7, wherein the construction image acquisition module is further configured to acquire a construction video of the power construction site; and acquiring a video frame from the construction video, and taking the acquired video frame as the construction image.

9. The device according to claim 7, wherein the construction image comprises a plurality of ascending tools and a plurality of electric constructors, and the ascending action detection module is further configured to determine, for each of the ascending tools, a plurality of ascending combinations according to the ascending tools and the plurality of electric constructors, wherein the ascending combinations comprise the ascending tools and any one of the electric constructors; and detecting whether the electric power constructors in the ascending combination have ascending actions for each ascending combination.

10. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any of claims 1 to 6 when the computer program is executed.