Disclosure of Invention
The embodiment of the invention provides a method and a device for detecting tower toppling, which are used for accurately detecting whether a tower is in a toppling state or not on the basis of reducing cost.
The method for detecting the tower toppling provided by the embodiment of the invention comprises the following steps:
acquiring an unmanned aerial vehicle aerial image of a tower to be detected;
extracting a first group of power lines positioned on the first side of the tower to be detected and a second group of power lines positioned on the second side of the tower to be detected from the aerial image of the unmanned aerial vehicle;
and detecting whether the tower to be detected is in an toppling state or not according to the extraction results of the first group of power lines and the second group of power lines.
Preferably, detecting whether the tower to be detected is in an inclined state according to the extraction results of the first group of power lines and the second group of power lines includes:
and determining to extract at least one group of power lines in the first group of power lines and the second group of power lines according to the extraction results of the first group of power lines and the second group of power lines, and determining that the tower to be detected is in a non-toppling state if one group of power lines is straight, or determining that the tower to be detected is in a toppling state if not.
Preferably, when the following conditions are judged to exist according to the extraction results of the first group of power lines and the second group of power lines, the tower to be detected is determined to be in a non-toppling state:
if the first group of power lines and the second group of power lines are extracted and are both straight lines, determining that the tower to be detected is in a non-toppling state; or,
if the first group of power lines and the second group of power lines are extracted, one group of power lines are represented as straight lines, and the other group of power lines are not represented as straight lines, determining that the tower to be detected is in a non-toppling state; or,
and if only one group of power lines in the first group of power lines and the second group of power lines are extracted and the extracted group of power lines is straight, determining that the tower to be detected is in a non-toppling state.
Preferably, when the following conditions are judged to exist according to the extraction results of the first group of power lines and the second group of power lines, the tower to be detected is determined to be in the toppling state:
if the first group of power lines and the second group of power lines are extracted and neither the first group of power lines nor the second group of power lines are represented as straight lines, determining that the tower to be detected is in an toppling state; or,
if only one group of power lines in the first group of power lines and the second group of power lines are extracted and the extracted group of power lines do not represent a straight line, determining that the tower to be detected is in an toppling state; or,
and if the first group of power lines and the second group of power lines are not extracted, determining that the tower to be detected is in the toppling state.
Preferably, extracting, from the aerial image of the unmanned aerial vehicle, a first group of power lines located on a first side of the tower to be detected and a second group of power lines located on a second side of the tower to be detected, includes:
carrying out image preprocessing on the aerial image of the unmanned aerial vehicle;
based on the preprocessed unmanned aerial vehicle aerial image, adopting a Ratio operator to carry out edge detection;
detecting the linear information of the preprocessed unmanned aerial vehicle aerial image by a Hough transformation method;
and judging and screening the linear information detected by Hough transformation according to the characteristics of the power lines, and extracting a first group of power lines positioned on the first side of the tower to be detected and a second group of power lines positioned on the second side of the tower to be detected.
The embodiment of the invention provides a tower toppling detection device, which comprises:
the acquisition module is used for acquiring an unmanned aerial vehicle aerial image of the tower to be detected;
the extraction module is used for extracting a first group of power lines positioned on the first side of the tower to be detected and a second group of power lines positioned on the second side of the tower to be detected from the unmanned aerial vehicle aerial image;
and the detection module is used for detecting whether the tower to be detected is in an toppling state or not according to the extraction results of the first group of power lines and the second group of power lines.
Preferably, the detection module is specifically configured to:
and determining to extract at least one group of power lines in the first group of power lines and the second group of power lines according to the extraction results of the first group of power lines and the second group of power lines, and determining that the tower to be detected is in a non-toppling state if one group of power lines is straight, or determining that the tower to be detected is in a toppling state if not.
Preferably, the detection module is specifically configured to determine that the tower to be detected is in a non-toppling state when the following conditions are determined to exist according to the extraction results of the first group of power lines and the second group of power lines:
if the first group of power lines and the second group of power lines are extracted and are both straight lines, determining that the tower to be detected is in a non-toppling state; or,
if the first group of power lines and the second group of power lines are extracted, one group of power lines are represented as straight lines, and the other group of power lines are not represented as straight lines, determining that the tower to be detected is in a non-toppling state; or,
and if only one group of power lines in the first group of power lines and the second group of power lines are extracted and the extracted group of power lines is straight, determining that the tower to be detected is in a non-toppling state.
Preferably, the detection module is specifically configured to determine that the tower to be detected is in the toppling state when the following conditions are determined to exist according to the extraction results of the first group of power lines and the second group of power lines:
if the first group of power lines and the second group of power lines are extracted and neither the first group of power lines nor the second group of power lines are represented as straight lines, determining that the tower to be detected is in an toppling state; or,
if only one group of power lines in the first group of power lines and the second group of power lines are extracted and the extracted group of power lines do not represent a straight line, determining that the tower to be detected is in an toppling state; or,
and if the first group of power lines and the second group of power lines are not extracted, determining that the tower to be detected is in the toppling state.
Preferably, the extraction module is specifically configured to:
carrying out image preprocessing on the aerial image of the unmanned aerial vehicle;
based on the preprocessed unmanned aerial vehicle aerial image, adopting a Ratio operator to carry out edge detection;
detecting the linear information of the preprocessed unmanned aerial vehicle aerial image by a Hough transformation method;
and judging and screening the linear information detected by Hough transformation according to the characteristics of the power lines, and extracting a first group of power lines positioned on the first side of the tower to be detected and a second group of power lines positioned on the second side of the tower to be detected.
In the embodiment of the invention, firstly, an unmanned aerial vehicle aerial image of a tower to be detected is obtained, a first group of power lines located on a first side of the tower to be detected and a second group of power lines located on a second side of the tower to be detected are extracted from the unmanned aerial vehicle aerial image, and whether the tower to be detected is in a toppling state is detected according to extraction results of the first group of power lines and the second group of power lines; in the embodiment of the invention, whether the tower to be detected is in the toppling state is detected based on the aerial image of the unmanned aerial vehicle, and the aerial image of the unmanned aerial vehicle is relatively convenient to obtain, so that the aerial image of the unmanned aerial vehicle can quickly respond to sudden natural disasters, and the required labor cost and equipment cost are relatively low when the aerial image of the unmanned aerial vehicle is used for polling the tower in a certain area; moreover, the extraction result of the power line can directly reflect the toppling condition of the tower to be detected, so that the accuracy of detecting whether the tower to be detected is in the toppling state or not according to the extraction result of the power line is higher.
The terms "first," "second," and the like in the description and claims of the present invention and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Based on the importance of detecting the toppling condition of the power transmission line tower and the defects of the existing detection method, the inventor of the application researches the toppling condition of the tower and provides a method for detecting the toppling condition of the tower based on the extraction result of the power line in the aerial image of the unmanned aerial vehicle, so that a new thought and a new method are provided for detecting the toppling condition of the tower.
Fig. 1 is a schematic flow chart corresponding to a tower toppling detection method provided in an embodiment of the present invention, and as shown in fig. 1, the method includes:
101, acquiring an unmanned aerial vehicle aerial image of a tower to be detected;
102, extracting a first group of power lines positioned on a first side of the tower to be detected and a second group of power lines positioned on a second side of the tower to be detected from the aerial image of the unmanned aerial vehicle;
103, detecting whether the tower to be detected is in an inclined state or not according to the extraction results of the first group of power lines and the second group of power lines.
In the embodiment of the invention, whether the tower to be detected is in the toppling state is detected based on the aerial image of the unmanned aerial vehicle, and the aerial image of the unmanned aerial vehicle is relatively convenient to obtain, so that the aerial image of the unmanned aerial vehicle can quickly respond to sudden natural disasters, and the required labor cost and equipment cost are relatively low when the aerial image of the unmanned aerial vehicle is used for polling the tower in a certain area; moreover, the extraction result of the power line can directly reflect the toppling condition of the tower to be detected, so that the accuracy of detecting whether the tower to be detected is in the toppling state or not according to the extraction result of the power line is higher.
Specifically, in step 102, there may be multiple methods for extracting, from the aerial image of the unmanned aerial vehicle, a first group of power lines located on the first side of the tower to be detected and a second group of power lines located on the second side of the tower to be detected, and an extraction method provided in an embodiment of the present invention is: firstly, all line segments of the whole image are detected by using a straight line detection method, then the angle and position information of each line segment are compared and analyzed with the similarity (distance difference) and the colinearity (angle difference), and whether the line segments belong to the same wire or not is judged. If the power lines belong to the same wire, the power lines are combined to obtain a complete power line, and then the power lines which do not meet the semantic rule of the power lines are removed by combining the semantic knowledge (which can be the power line characteristics) of the power lines. The method may be implemented based on Ratio operators and Hough transforms.
As shown in fig. 2, a schematic flow chart corresponding to the method for extracting a power line provided in the embodiment of the present invention specifically includes:
step 201, image preprocessing is carried out on the aerial image of the unmanned aerial vehicle.
Particularly, because the content of the unmanned aerial vehicle aerial image is comparatively complicated, the accuracy of identification can be improved by preprocessing according to the characteristics of the image, wherein the preprocessing that can be carried out comprises filtering and binaryzation. The image can be denoised by median filtering, the median filtering can filter out high-frequency noise, loss of image edge details can be avoided, and the edge of the image is well protected. Then, binarization processing is performed on the image so as to highlight the edges of the image.
And step 202, based on the preprocessed unmanned aerial vehicle aerial image, adopting a Ratio operator to carry out edge detection.
Specifically, the Ratio operator mainly comprises three parameters, the first parameter is the size of the template, the size of the template is selected to be 5 × 5 through experiments in order to suppress noise and consider the size of a calculation quantity template, the second parameter is the number of detected straight line directions, the power transmission line is generally in an approximately horizontal state in the unmanned aerial vehicle line patrol process, the Ratio operator in the horizontal direction can be used for detecting linear edges all the time, and the third parameter is a threshold value, and the average value of the linear edge image can be selected to be 3 times in order to enable the threshold value to be adaptive to the image.
And step 203, detecting the linear information of the preprocessed unmanned aerial vehicle aerial image by adopting a Hough transformation method.
And 204, judging and screening the linear information detected by Hough transformation according to the characteristics of the power lines, and extracting a first group of power lines positioned on the first side of the tower to be detected and a second group of power lines positioned on the second side of the tower to be detected.
Specifically, after linear edges are detected, cumulative probability Hough transformation is carried out to obtain a series of line segments, then line segment connection is carried out, the line segments on the same straight line are connected to be the maximum length, then the line segments with the angles ranging from-PI/4 to PI/4 are selected, the longest line segment M is obtained, and all the line segments approximately parallel to M can be determined as power lines.
According to the practical situation, when the tower does not topple over, the power line in the aerial image of the unmanned aerial vehicle is represented as a straight line, as shown in fig. 3a and 3b, the power line is a schematic diagram of the power line under normal operation of the tower. If the tower falls, the power line falls off and relaxes, so that the power line cannot be represented as a straight line in an aerial image of the unmanned aerial vehicle, as shown in fig. 4, the power line is a schematic diagram of the power line with the tower in a falling state; or, the tower topples over and still can lead to the power line to bury in ground objects such as weeds woods, and can't draw out from unmanned aerial vehicle aerial image. Therefore, in step 103, detecting whether the tower to be detected is in an inclined state according to the extraction results of the first group of power lines and the second group of power lines may include: and determining to extract at least one group of power lines in the first group of power lines and the second group of power lines according to the extraction results of the first group of power lines and the second group of power lines, and determining that the tower to be detected is in a non-toppling state if one group of power lines is straight, or determining that the tower to be detected is in a toppling state if not.
Specifically, in the embodiment of the present invention, when it is determined that the following three conditions exist according to the extraction results of the first group of power lines and the second group of power lines, it may be determined that the tower to be detected is in a non-toppling state:
the first condition is as follows: and if the first group of power lines and the second group of power lines are extracted and both the first group of power lines and the second group of power lines are straight lines (as shown in fig. 3a and 3 b), determining that the tower to be detected is in a non-toppling state.
Case two: and if the first group of power lines and the second group of power lines are extracted, one group of power lines are represented as straight lines, and the other group of power lines are not represented as straight lines, determining that the tower to be detected is in a non-toppling state. For example, the first group of power lines is shown as a straight line, and the second group of power lines is shown as a curve, which is usually caused by that the adjacent tower located at the second side of the tower to be detected is in an inclined state or the power lines are broken, so that the second group of power lines is shown as a curve, and therefore, the tower to be detected can be preliminarily determined to be in a non-inclined state, and the adjacent tower located at the second side of the tower to be detected can be further detected, so that the accuracy of the result can be confirmed.
Case three: and if only one group of power lines in the first group of power lines and the second group of power lines are extracted and the extracted group of power lines is straight, determining that the tower to be detected is in a non-toppling state. For example, only the first group of power lines are extracted, the first group of power lines are straight lines, and the second group of power lines are not extracted, which is usually caused by that the adjacent tower located at the second side of the tower to be detected is in an inclined state or the power lines are broken, so that the second group of power lines are buried in ground objects such as a weed forest and cannot be extracted, and therefore, the tower to be detected can be preliminarily determined to be in a non-inclined state, and the adjacent tower located at the second side of the tower to be detected can be further detected, so that the accuracy of the result can be confirmed.
Specifically, in the embodiment of the present invention, when it is determined that the following three conditions exist according to the extraction results of the first group of power lines and the second group of power lines, it may be determined that the tower to be detected is in an inclined state:
the first condition is as follows: and if the first group of power lines and the second group of power lines are extracted and neither the first group of power lines nor the second group of power lines are represented as straight lines (as shown in fig. 4), determining that the tower to be detected is in an inclined state.
Case two: and if only one group of power lines in the first group of power lines and the second group of power lines are extracted and the extracted group of power lines do not represent a straight line, determining that the tower to be detected is in an inclined state.
Case three: and if the first group of power lines and the second group of power lines are not extracted, determining that the tower to be detected is in the toppling state.
In the embodiment of the invention, firstly, an unmanned aerial vehicle aerial image of a tower to be detected is obtained, a first group of power lines located on a first side of the tower to be detected and a second group of power lines located on a second side of the tower to be detected are extracted from the unmanned aerial vehicle aerial image, and whether the tower to be detected is in a toppling state is detected according to extraction results of the first group of power lines and the second group of power lines; in the embodiment of the invention, whether the tower to be detected is in the toppling state is detected based on the aerial image of the unmanned aerial vehicle, and the aerial image of the unmanned aerial vehicle is relatively convenient to obtain, so that the aerial image of the unmanned aerial vehicle can quickly respond to sudden natural disasters, and the required labor cost and equipment cost are relatively low when the aerial image of the unmanned aerial vehicle is used for polling the tower in a certain area; moreover, the extraction result of the power line can directly reflect the toppling condition of the tower to be detected, so that the accuracy of detecting whether the tower to be detected is in the toppling state or not according to the extraction result of the power line is higher.
Aiming at the method flow, the embodiment of the invention also provides a tower toppling detection device, and the specific content of the device can be implemented by referring to the method.
Fig. 5 is a schematic structural diagram of a tower toppling detection device according to an embodiment of the present invention, and as shown in fig. 5, the tower toppling detection device includes:
the acquiring module 501 is used for acquiring an unmanned aerial vehicle aerial image of a tower to be detected;
an extracting module 502, configured to extract, from the unmanned aerial vehicle aerial image, a first group of power lines located on a first side of the tower to be detected and a second group of power lines located on a second side of the tower to be detected;
the detection module 503 is configured to detect whether the tower to be detected is in an inclined state according to the extraction results of the first group of power lines and the second group of power lines.
Preferably, the detecting module 503 is specifically configured to:
and determining to extract at least one group of power lines in the first group of power lines and the second group of power lines according to the extraction results of the first group of power lines and the second group of power lines, and determining that the tower to be detected is in a non-toppling state if one group of power lines is straight, or determining that the tower to be detected is in a toppling state if not.
Preferably, the detection module 503 is specifically configured to determine that the tower to be detected is in a non-toppling state when the following conditions are determined to exist according to the extraction results of the first group of power lines and the second group of power lines:
if the first group of power lines and the second group of power lines are extracted and are both straight lines, determining that the tower to be detected is in a non-toppling state; or,
if the first group of power lines and the second group of power lines are extracted, one group of power lines are represented as straight lines, and the other group of power lines are not represented as straight lines, determining that the tower to be detected is in a non-toppling state; or,
and if only one group of power lines in the first group of power lines and the second group of power lines are extracted and the extracted group of power lines is straight, determining that the tower to be detected is in a non-toppling state.
Preferably, the detection module 503 is specifically configured to determine that the tower to be detected is in the toppling state when the following conditions are determined to exist according to the extraction results of the first group of power lines and the second group of power lines:
if the first group of power lines and the second group of power lines are extracted and neither the first group of power lines nor the second group of power lines are represented as straight lines, determining that the tower to be detected is in an toppling state; or,
if only one group of power lines in the first group of power lines and the second group of power lines are extracted and the extracted group of power lines do not represent a straight line, determining that the tower to be detected is in an toppling state; or,
and if the first group of power lines and the second group of power lines are not extracted, determining that the tower to be detected is in the toppling state.
Preferably, the extracting module 502 is specifically configured to:
carrying out image preprocessing on the aerial image of the unmanned aerial vehicle;
based on the preprocessed unmanned aerial vehicle aerial image, adopting a Ratio operator to carry out edge detection;
detecting the linear information of the preprocessed unmanned aerial vehicle aerial image by a Hough transformation method;
and judging and screening the linear information detected by Hough transformation according to the characteristics of the power lines, and extracting a first group of power lines positioned on the first side of the tower to be detected and a second group of power lines positioned on the second side of the tower to be detected.
From the above, it can be seen that: in the embodiment of the invention, firstly, an unmanned aerial vehicle aerial image of a tower to be detected is obtained, a first group of power lines located on a first side of the tower to be detected and a second group of power lines located on a second side of the tower to be detected are extracted from the unmanned aerial vehicle aerial image, and whether the tower to be detected is in a toppling state is detected according to extraction results of the first group of power lines and the second group of power lines; in the embodiment of the invention, whether the tower to be detected is in the toppling state is detected based on the aerial image of the unmanned aerial vehicle, and the aerial image of the unmanned aerial vehicle is relatively convenient to obtain, so that the aerial image of the unmanned aerial vehicle can quickly respond to sudden natural disasters, and the required labor cost and equipment cost are relatively low when the aerial image of the unmanned aerial vehicle is used for polling the tower in a certain area; moreover, the extraction result of the power line can directly reflect the toppling condition of the tower to be detected, so that the accuracy of detecting whether the tower to be detected is in the toppling state or not according to the extraction result of the power line is higher.
It should be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.