CN113743330A - Transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation - Google Patents

Transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation Download PDF

Info

Publication number
CN113743330A
CN113743330A CN202111049136.8A CN202111049136A CN113743330A CN 113743330 A CN113743330 A CN 113743330A CN 202111049136 A CN202111049136 A CN 202111049136A CN 113743330 A CN113743330 A CN 113743330A
Authority
CN
China
Prior art keywords
transformer substation
aerial vehicle
unmanned aerial
image
inspection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111049136.8A
Other languages
Chinese (zh)
Inventor
李宇恒
郑炅
董一博
冯中涵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xinjiang University
Original Assignee
Xinjiang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xinjiang University filed Critical Xinjiang University
Priority to CN202111049136.8A priority Critical patent/CN113743330A/en
Publication of CN113743330A publication Critical patent/CN113743330A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/06Energy or water supply

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Economics (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Water Supply & Treatment (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Public Health (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Image Analysis (AREA)

Abstract

The invention relates to a transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation. A transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation comprises the following steps: (1) acquiring an image of a manual inspection channel of the transformer substation, and segmenting the image of the transformer substation acquired by the unmanned aerial vehicle camera; (2) traversing and segmenting the image columns according to the segmentation result to obtain segmentation points; (3) fitting the division points to form a transformer substation manual inspection channel; (4) and establishing an autonomous safe flight track space of the unmanned aerial vehicle by converting the image coordinate system into a ground three-dimensional coordinate system. The transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation is beneficial to improving the intelligent level and efficiency of the transformer substation inspected by the unmanned aerial vehicle and promoting the application of artificial intelligence in intelligent inspection of power transmission and transformation equipment.

Description

Transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation
Technical Field
The invention particularly relates to a transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation.
Background
In recent years, the scale of a power grid is continuously enlarged, substations and equipment are rapidly increased, the situation of insufficient inspection personnel is increasingly severe, and the bearing capacity faces a great challenge. At present, the conventional substation inspection generally adopts an inspection mode of manual walking, and has the following four outstanding problems: (1) the manual station-by-station and equipment-by-equipment walking inspection consumes long time, consumes large manpower and has low efficiency; (2) the condition that the defects are not identified and the judgment is not in place easily occurs in a manual routing inspection mode of 'observing with naked eyes and judging by experience', the overall routing inspection quality is low, and more misjudgments are missed; (3) the inspection cycle is long, the defects are easy to develop and limited by manpower, the defects can be developed in the blank period of inspection and hidden dangers exist after the inspection is performed for one month at regular intervals; (4) the data processing mode of 'field acquisition and return entry' is easy to reduce the reliability of system data.
In view of the above, the invention provides a transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation.
Disclosure of Invention
The invention aims to provide a transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation, which is based on the characteristic that the color of a manual inspection channel is greatly different from the surrounding background (the transformer substation is provided with the manual inspection channel on the ground, and the transformer substation is generally provided with a yellow frame), can directly utilize the color information of an HSI color space to divide the inspection channel, and can plan the safe track space of automatic flight inspection of an unmanned aerial vehicle by converting an image coordinate system into a ground three-dimensional coordinate system.
In order to realize the purpose, the adopted technical scheme is as follows:
a transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation comprises the following steps:
(1) acquiring an image of a manual inspection channel of the transformer substation, and segmenting the image of the transformer substation acquired by the unmanned aerial vehicle camera;
(2) traversing the segmentation image rows to obtain segmentation points with obvious pixel differences for the segmentation result obtained in the step (1);
(3) fitting the division points to form a transformer substation manual inspection channel;
(4) and establishing an autonomous safe flight track space of the unmanned aerial vehicle through conversion from the image coordinate system to the ground three-dimensional coordinate system, thereby realizing intelligent routing inspection.
Further, in the step (1), the transformer substation manual patrol channel image is collected, an RCE neural network classification algorithm based on an HSI color space is constructed, and the transformer substation manual patrol channel is segmented, so that the transformer substation image collected by the unmanned aerial vehicle camera is segmented.
Further, in the step (3), the transformer substation manual patrol passage is fitted through a least square method.
Compared with the prior art, the invention has the beneficial effects that:
the invention provides a transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation, which utilizes the existing condition that the colors of all manual inspection channels (generally yellow frames) on the ground of a transformer substation are greatly different from the surrounding background to construct an RCE neural network classification algorithm based on an HSI color space, divides the manual inspection channels of the transformer substation, and further plans a safe track space for automatic flight inspection of an unmanned aerial vehicle, so that a coordinate sensor is prevented from being configured on the transformer substation or laser navigation is arranged for the unmanned aerial vehicle, and the implementation cost is effectively reduced. Thereby be favorable to promoting unmanned aerial vehicle to patrol and examine the intelligent level and the efficiency of transformer substation on the one hand, on the other hand helps promoting artificial intelligence again and patrols and examines the application in power transmission and transformation equipment intelligence.
Drawings
FIG. 1 is a flow chart of the work of the inspection method of the intelligent unmanned aerial vehicle of the transformer substation based on visual navigation;
fig. 2 is a schematic diagram of a transformer substation manual patrol channel segmentation.
Detailed Description
In order to further illustrate the transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation and achieve the intended purpose of the invention, the following detailed description is given to the specific implementation mode, structure, characteristics and efficacy of the transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation, which is provided by the invention, in combination with a preferred embodiment. In the following description, different "one embodiment" or "an embodiment" refers to not necessarily the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
The transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation is further described in detail with reference to specific embodiments:
firstly, constructing an RCE neural network classification algorithm based on an HSI color space to segment an artificial patrol channel of a transformer substation; secondly, fitting out a transformer substation manual inspection channel by using the obtained division points through a least square method; and finally, establishing an autonomous safe flight track space of the unmanned aerial vehicle through conversion from the image coordinate system to a ground three-dimensional coordinate system, and realizing intelligent inspection.
The technical scheme of the invention is as follows:
a transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation comprises the following steps:
(1) acquiring an image of a manual inspection channel of the transformer substation, and segmenting the image of the transformer substation acquired by the unmanned aerial vehicle camera;
(2) traversing the segmentation image rows to obtain segmentation points with obvious pixel differences for the segmentation result obtained in the step (1);
(3) fitting the division points to form a transformer substation manual inspection channel;
(4) and establishing an autonomous safe flight track space of the unmanned aerial vehicle through conversion from the image coordinate system to the ground three-dimensional coordinate system, thereby realizing intelligent routing inspection.
Preferably, in the step (1), the transformer substation manual patrol channel image is collected, an RCE neural network classification algorithm based on an HSI color space is constructed, and the transformer substation manual patrol channel is segmented from the RCE neural network classification algorithm, so that the transformer substation image collected by the unmanned aerial vehicle camera is segmented.
Preferably, in the step (3), the manual patrol passage of the substation is fitted by a least square method.
Example 1.
The work flow diagram is shown in fig. 1, and the specific operation steps are as follows:
s1: firstly, acquiring an image of an artificial patrol channel of the transformer substation, constructing an RCE neural network classification algorithm based on an HSI color space, and segmenting the artificial patrol channel of the transformer substation. Thereby cut apart the transformer substation's image of unmanned aerial vehicle camera collection. The transformer substation manual patrol channel division schematic diagram is shown in fig. 2.
S2: after the segmentation result is obtained, traversing the segmentation image column, and obtaining segmentation points with obvious difference between the segmentation pixel value and the surrounding pixels.
S3: and fitting the transformer substation manual patrol channel by using the obtained division points through a least square method.
S4: and finally, establishing an autonomous safe flight track space of the unmanned aerial vehicle through conversion from the image coordinate system to a ground three-dimensional coordinate system, and realizing intelligent inspection.
Firstly, constructing an RCE neural network classification algorithm based on an HSI color space to segment an artificial patrol channel of a transformer substation; secondly, fitting out a transformer substation manual inspection channel by using the obtained division points through a least square method; and finally, establishing an autonomous safe flight track space of the unmanned aerial vehicle through conversion from the image coordinate system to a ground three-dimensional coordinate system, and realizing intelligent inspection.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention in any way, and any simple modification, equivalent change and modification made to the above embodiments according to the technical spirit of the present invention are within the scope of the technical solution of the present invention.

Claims (3)

1. A transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation is characterized by comprising the following steps:
(1) acquiring an image of a manual inspection channel of the transformer substation, and segmenting the image of the transformer substation acquired by the unmanned aerial vehicle camera;
(2) traversing the segmentation image rows to obtain segmentation points with obvious pixel differences for the segmentation result obtained in the step (1);
(3) fitting the division points to form a transformer substation manual inspection channel;
(4) and establishing an autonomous safe flight track space of the unmanned aerial vehicle through conversion from the image coordinate system to the ground three-dimensional coordinate system, thereby realizing intelligent routing inspection.
2. The substation intelligent unmanned aerial vehicle inspection method according to claim 1,
in the step (1), the transformer substation manual patrol channel images are collected, an RCE neural network classification algorithm based on an HSI color space is constructed, and the transformer substation manual patrol channels are divided from the RCE neural network classification algorithm, so that the transformer substation images collected by the unmanned aerial vehicle camera are divided.
3. The substation intelligent unmanned aerial vehicle inspection method according to claim 1,
and (4) in the step (3), fitting the manual inspection channel of the transformer substation by a least square method.
CN202111049136.8A 2021-09-08 2021-09-08 Transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation Pending CN113743330A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111049136.8A CN113743330A (en) 2021-09-08 2021-09-08 Transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111049136.8A CN113743330A (en) 2021-09-08 2021-09-08 Transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation

Publications (1)

Publication Number Publication Date
CN113743330A true CN113743330A (en) 2021-12-03

Family

ID=78737044

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111049136.8A Pending CN113743330A (en) 2021-09-08 2021-09-08 Transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation

Country Status (1)

Country Link
CN (1) CN113743330A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104463191A (en) * 2014-10-30 2015-03-25 华南理工大学 Robot visual processing method based on attention mechanism
CN108132675A (en) * 2017-11-23 2018-06-08 东南大学 Unmanned plane is maked an inspection tour from main path cruise and intelligent barrier avoiding method by a kind of factory
CN110006435A (en) * 2019-04-23 2019-07-12 西南科技大学 A kind of Intelligent Mobile Robot vision navigation system method based on residual error network
CN110850889A (en) * 2019-11-18 2020-02-28 国网江苏省电力有限公司泰州供电分公司 Unmanned aerial vehicle autonomous inspection system based on RTK navigation
CN111260289A (en) * 2020-01-16 2020-06-09 四川中烟工业有限责任公司 Micro unmanned aerial vehicle warehouse checking system and method based on visual navigation
CN111968262A (en) * 2020-07-30 2020-11-20 国网智能科技股份有限公司 Semantic intelligent substation inspection operation robot navigation system and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104463191A (en) * 2014-10-30 2015-03-25 华南理工大学 Robot visual processing method based on attention mechanism
CN108132675A (en) * 2017-11-23 2018-06-08 东南大学 Unmanned plane is maked an inspection tour from main path cruise and intelligent barrier avoiding method by a kind of factory
CN110006435A (en) * 2019-04-23 2019-07-12 西南科技大学 A kind of Intelligent Mobile Robot vision navigation system method based on residual error network
CN110850889A (en) * 2019-11-18 2020-02-28 国网江苏省电力有限公司泰州供电分公司 Unmanned aerial vehicle autonomous inspection system based on RTK navigation
CN111260289A (en) * 2020-01-16 2020-06-09 四川中烟工业有限责任公司 Micro unmanned aerial vehicle warehouse checking system and method based on visual navigation
CN111968262A (en) * 2020-07-30 2020-11-20 国网智能科技股份有限公司 Semantic intelligent substation inspection operation robot navigation system and method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
XIAOMING YIN等: "Hand image segmentation using color and RCE neural network", 《ROBOTICS AND AUTONOMOUS SYSTEMS》, 31 December 2021 (2021-12-31), pages 235 - 250 *
猫叔REX: "自动驾驶入门之视觉定位坐标转换", 《HTTPS://CLOUD.TENCENT.COM/DEVELOPER/ARTICLE/1653075》, 30 June 2020 (2020-06-30), pages 1 - 6 *

Similar Documents

Publication Publication Date Title
CN109559310B (en) Power transmission and transformation inspection image quality evaluation method and system based on significance detection
CN102129564B (en) Contact network failure detection and diagnosis method based on unmanned aerial vehicle
CN113223035B (en) Intelligent inspection system for cage chickens
CN103078673B (en) A kind of dedicated unmanned Helicopter System being applicable to mountain area electrical network and patrolling and examining
CN112633535A (en) Photovoltaic power station intelligent inspection method and system based on unmanned aerial vehicle image
CN111814678B (en) Method and system for identifying coal flow in conveyor belt based on video monitoring
CN109300118B (en) High-voltage power line unmanned aerial vehicle inspection method based on RGB image
CN106203265A (en) A kind of Construction Fugitive Dust Pollution based on unmanned plane collection image is derived from dynamic monitoring and coverage prognoses system and method
CN112396635B (en) Multi-target detection method based on multiple devices in complex environment
CN111832398B (en) Unmanned aerial vehicle image distribution line pole tower ground wire broken strand image detection method
CN107179479A (en) Transmission pressure broken lot defect inspection method based on visible images
CN111507975B (en) Method for detecting abnormity of outdoor insulator of traction substation
CN112528979B (en) Transformer substation inspection robot obstacle distinguishing method and system
CN113947555A (en) Infrared and visible light fused visual system and method based on deep neural network
CN114089786A (en) Autonomous inspection system based on unmanned aerial vehicle vision and along mountain highway
CN115311740A (en) Method and system for recognizing abnormal human body behaviors in power grid infrastructure site
CN109359545B (en) Cooperative monitoring method and device under complex low-altitude environment
CN113743330A (en) Transformer substation intelligent unmanned aerial vehicle inspection method based on visual navigation
CN115984672B (en) Detection method and device for small target in high-definition image based on deep learning
CN112489018A (en) Intelligent power line inspection method and inspection line
CN116883999A (en) Safety distance monitoring method for large-scale construction machinery and working area of transformer substation
CN108830834B (en) Automatic extraction method for video defect information of cable climbing robot
CN115393900A (en) Intelligent construction site safety supervision method and system based on Internet of things
CN113034598B (en) Unmanned aerial vehicle power line inspection method based on deep learning
Awrangjeb et al. Classifier-free extraction of power line wires from point cloud data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination