CN112651421B - Infrared thermal imaging power transmission line anti-external-damage monitoring system and modeling method thereof - Google Patents

Infrared thermal imaging power transmission line anti-external-damage monitoring system and modeling method thereof Download PDF

Info

Publication number
CN112651421B
CN112651421B CN202010919200.2A CN202010919200A CN112651421B CN 112651421 B CN112651421 B CN 112651421B CN 202010919200 A CN202010919200 A CN 202010919200A CN 112651421 B CN112651421 B CN 112651421B
Authority
CN
China
Prior art keywords
module
neural network
infrared
transmission line
monitoring system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010919200.2A
Other languages
Chinese (zh)
Other versions
CN112651421A (en
Inventor
李学钧
生红莹
***
蒋勇
何成虎
王晓鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Haohan Information Technology Co ltd
Original Assignee
Jiangsu Haohan Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Haohan Information Technology Co ltd filed Critical Jiangsu Haohan Information Technology Co ltd
Priority to CN202010919200.2A priority Critical patent/CN112651421B/en
Publication of CN112651421A publication Critical patent/CN112651421A/en
Application granted granted Critical
Publication of CN112651421B publication Critical patent/CN112651421B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/25Fusion techniques
    • G06F18/253Fusion techniques of extracted features
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N25/00Investigating or analyzing materials by the use of thermal means
    • G01N25/72Investigating presence of flaws
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/044Recurrent networks, e.g. Hopfield networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/20Checking timed patrols, e.g. of watchman
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Radiation Pyrometers (AREA)

Abstract

The invention provides an infrared thermal imaging power transmission line anti-external damage monitoring system and a modeling method thereof, comprising the following steps: the convolution neural network module is used for extracting the characteristics of the infrared transmission line external broken and segmented image; the two-way circulation neural network module is provided with five modules and is positioned behind the convolution neural network module; the decoder module is used for gradually recovering the resolution of the feature map output by the bidirectional cyclic neural network module to the resolution of the input image; and the model training module is used for training the anti-external damage monitoring system. According to the infrared thermal imaging power transmission line external damage prevention monitoring system and the modeling method thereof, an external damage hidden danger segmentation network model based on the deep convolutional neural network and the bidirectional cyclic neural network is constructed, intelligent analysis can be carried out on an infrared image acquired by front-end inspection, the external damage hidden danger of the power transmission line is positioned, the monitoring effect is ensured, and the labor cost of personnel inspection is greatly reduced.

Description

Infrared thermal imaging power transmission line anti-external-damage monitoring system and modeling method thereof
Technical Field
The invention relates to the technical field of transmission line detection, in particular to an infrared thermal imaging transmission line external damage prevention monitoring system and a modeling method thereof.
Background
With the increase of national economy and living standard of China, the demand of electric power is increased increasingly, the power grid scale of an electric power system is enlarged, and the electric load is increased, so that the possibility of accidents such as equipment burning and the like caused by damage, faults and serious electric power equipment is increased. In order to avoid various electric power accidents as much as possible, it is imperative to reduce the major economic loss caused by the accidents, and the economic loss is imperative.
The inspection is time-consuming and labor-consuming in a manual mode, and the reliability is low. Real-time monitoring pictures or videos are transmitted to the background through a communication technology and a sensing technology, so that the inspection workload can be reduced, but background staff is still required to judge whether external hidden danger exists or not by naked eyes, the workload is large, omission is easy, and the monitoring intellectualization is not realized.
Disclosure of Invention
In order to solve the problems, the invention provides an infrared thermal imaging power transmission line external damage prevention monitoring system and a modeling method thereof, which construct an external damage hidden danger segmentation network model based on a deep convolutional neural network and a bidirectional cyclic neural network, can intelligently analyze an infrared image acquired by front-end inspection, locate the external damage hidden danger of the power transmission line, ensure the monitoring effect and greatly reduce the labor cost of personnel inspection.
In order to achieve the above purpose, the invention adopts a technical scheme that:
An infrared thermal imaging transmission line anti-outward-breakage monitoring system, comprising: the convolution neural network module is used for extracting the characteristics of the infrared transmission line external broken and segmented image and comprises two DWBlock modules and two residual modules, and the infrared image is sequentially output to the DWBlock module, the residual modules, the DWBlock module and the residual modules;
The two-way circulation neural network module is provided with five modules and is positioned behind the convolution neural network module; the decoder module is used for gradually recovering the resolution of the feature map output by the bidirectional cyclic neural network module to the resolution of the input image; and the decoder module outputs the model training module to the model training module, and the model training module is used for training the anti-external-damage monitoring system.
Further, the DWBlock module is sequentially composed of data filling, longitudinal convolution operation, batch normalization processing, convolution operation and batch normalization processing, wherein the number of input channels of the longitudinal convolution operation is the same as the number of convolution kernels.
Further, the data filling operation fuses the characteristic values; the method is characterized in that boundaries of the infrared image or the visible light image are expanded, and the batch normalization process for each input x i is as follows: x i=(xi-u)/(sqrt((xi-v)2) +e), where u is the mean of the inputs { x 1,x2,x3,…,xn }, v is the variance of the inputs { x 1,x2,x3,…,xn }, e is a small bias preventing the denominator from going to 0.
Further, scale plus shift operations, i.e., x i=scale*xi +shift, were performed on the batch normalized result x i, where scale and shift were learned.
Further, when the input is x, the residual module output is F (x) +x.
The invention also provides a modeling method of the infrared thermal imaging power transmission line anti-external damage monitoring system, which comprises the following steps: s10, acquiring infrared images through an infrared camera, and marking an infrared transmission line external broken and divided sample set; s20, constructing a convolutional neural network module, and inputting the infrared transmission line external broken and split sample set into the convolutional neural network module to obtain an infrared characteristic value; s30, constructing a bidirectional circulating neural network module, and inputting the infrared characteristic value into the bidirectional circulating neural network module for scanning according to columns and rows, wherein the specific formula is as follows:
wherein f represents a recurrent neural network RNN, the infrared eigenvalues are partitioned into i×j blocks, o is the result, z is the previous state, and p is the eigenvalues within the eigenvector blocks; s40, constructing a decoding module, inputting the fusion characteristic value into the decoding module, and outputting the decoding module to a softmax layer to complete modeling.
Compared with the prior art, the technical scheme of the invention has the following advantages:
According to the infrared thermal imaging power transmission line external damage prevention monitoring system and the modeling method thereof, an external damage hidden danger segmentation network model based on the deep convolutional neural network and the bidirectional cyclic neural network is constructed, intelligent analysis can be carried out on an infrared image acquired by front-end inspection, the external damage hidden danger of the power transmission line is positioned, the monitoring effect is ensured, and the labor cost of personnel inspection is greatly reduced.
Drawings
The technical solution of the present invention and its advantageous effects will be made apparent by the following detailed description of the specific embodiments of the present invention with reference to the accompanying drawings.
FIG. 1 is a block diagram of a deep convolutional neural network module according to one embodiment of the present invention;
FIG. 2 is a block diagram of a residual block according to an embodiment of the present invention;
fig. 3 is a flowchart of a modeling method of an infrared thermal imaging transmission line anti-external damage monitoring system according to an embodiment of the invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to fall within the scope of the invention.
The embodiment provides an infrared thermal imaging transmission line anti-external damage monitoring system, which comprises a convolutional neural network module, a bidirectional cyclic neural network module, a decoder module and a model training module which are sequentially connected.
As shown in fig. 1, the convolutional neural network module includes two DWBlock modules and two residual modules, the infrared images are sequentially output to the DWBlock module, the residual modules, the DWBlock module and the residual modules, and the convolutional neural network module is used for extracting the infrared transmission line external broken and segmented image features.
The DWBlock module is sequentially composed of data filling, longitudinal convolution operation, batch normalization processing, convolution operation and batch normalization processing, wherein the number of input channels of the longitudinal convolution operation is the same as the number of convolution kernels. The data filling operation fuses the characteristic values; the method is characterized in that boundaries of the infrared image or the visible light image are expanded, and the batch normalization process for each input x i is as follows: x i=(xi-u)/(sqrt((xi-v)2) +e), where u is the mean of the inputs { x 1,x2,x3,…,xn }, v is the variance of the inputs { x 1,x2,x3,…,xn }, e is a small bias preventing the denominator from going to 0. The batch normalized result x i was subjected to scale plus shift operation, i.e., x i=scale*xi +shift, where scale and shift were learned.
When the input is x, F (x) is a hidden layer operation, then the output of the general neural network is H (x) =f (x), and the output of the residual network is H (x) =f (x) +x, and the specific structure is as shown in fig. 2, and the residual block includes two parts: shortcut connection and residual part. F (x) is the residual, represented on the left side of the upper graph, wherein weightlayer represents the convolution operation, weightlayer is the 3*3 convolution layer, and the convolved feature map is added to x to obtain a new feature map.
The two-way cyclic neural network module is created after five two-way cyclic neural network modules are connected to the convolutional neural network module. The basic idea of the bi-directional recurrent neural network (BRNN) is to propose that each training sequence is two Recurrent Neural Networks (RNNs) forward and backward, respectively, and that both are connected to one output layer. This structure provides the output layer with complete past and future context information for each point in the input sequence.
The decoder module is an up-sampling layer formed by deconvolution of a plurality of layers and is used for gradually recovering the resolution of the feature map output by the bidirectional cyclic neural network module to the resolution of the input image.
The decoder module outputs to the model training module, whose main design objective is to obtain dense predictions that are the same as the original input resolution. By means of the decoder module, the resolution of the feature map gradually reverts to the resolution of the input image.
The decoder module outputs the model training module, and the model training module is used for training the anti-external-damage monitoring system.
The invention also provides a modeling method of the infrared thermal imaging power transmission line anti-external damage monitoring system, as shown in fig. 3, comprising the following steps: s10, acquiring infrared images through an infrared camera, and marking an infrared transmission line external broken and divided sample set. S20, constructing a convolutional neural network module, and inputting the infrared transmission line external broken and split sample set to the convolutional neural network module to obtain an infrared characteristic value. S30, constructing a bidirectional circulating neural network module, and inputting the infrared characteristic value into the bidirectional circulating neural network module for scanning according to columns and rows, wherein the specific formula is as follows:
Where f represents the recurrent neural network RNN, the infrared eigenvalues are partitioned into i x j blocks, o is the result, z is the previous state, and p is the eigenvalue within the eigenvector. And S40, constructing a decoding module, inputting the fusion characteristic value into the decoding module, and outputting the decoding module to a softmax layer to complete modeling. Where y i represents the softmax ith output value, i represents the category index, ctotal number of categories, v i represents the decoding module's ith output.
The foregoing description is only exemplary embodiments of the present invention and is not intended to limit the scope of the present invention, and all equivalent structures or equivalent processes using the descriptions and the drawings of the present invention or directly or indirectly applied to other related technical fields are included in the scope of the present invention.

Claims (5)

1. An infrared thermal imaging transmission line prevents broken monitoring system outward, which characterized in that includes: the convolution neural network module is used for extracting the characteristics of the infrared transmission line external broken and segmented image and comprises two DWBlock modules and two residual modules, and the infrared image is sequentially output to the DWBlock module, the residual modules, the DWBlock module and the residual modules; the two-way circulation neural network module is provided with five modules and is positioned behind the convolution neural network module; the decoder module is used for gradually recovering the resolution of the feature map output by the bidirectional cyclic neural network module to the resolution of the input image; the decoder module outputs the data to the model training module, and the model training module is used for training the anti-external damage monitoring system;
The DWBlock module is sequentially composed of data filling, longitudinal convolution operation, batch normalization processing, convolution operation and batch normalization processing, wherein the number of input channels of the longitudinal convolution operation is the same as the number of convolution kernels.
2. The infrared thermal imaging transmission line anti-outward-breakage monitoring system according to claim 1, wherein the data filling operation refers to expanding boundaries of infrared images or visible light images, and the batch normalization process for each input x i is as follows: x' i=(xi-u)/(sqrt((xi-v)2) +e), where u is the mean of the inputs { x 1,x2,x3,…,xn }, v is the variance of the inputs { x 1,x2,x3,…,xn }, e is a small bias preventing the denominator from going to 0.
3. The infrared thermal imaging transmission line anti-external damage monitoring system according to claim 2, wherein the batch normalization result x' i is subjected to scale plus shift operation, namely x "i=scale*x'i +shift, wherein scale and shift are obtained through learning.
4. The infrared thermal imaging transmission line anti-external damage monitoring system of claim 3, wherein when the input is x, the residual module output is F (x) +x.
5. The modeling method of an infrared thermal imaging transmission line anti-external damage monitoring system according to claim 4, comprising the steps of: s10, acquiring infrared images through an infrared camera, and marking an infrared transmission line external broken and divided sample set; s20, constructing a convolutional neural network module, and inputting the infrared transmission line external broken and split sample set into the convolutional neural network module to obtain an infrared characteristic value; s30, constructing a bidirectional circulating neural network module, and inputting the infrared characteristic value into the bidirectional circulating neural network module for scanning according to columns and rows, wherein the specific formula is as follows:
wherein f represents a recurrent neural network RNN, the infrared eigenvalues are partitioned into i×j blocks, o is the result, z is the previous state, and p is the eigenvalues within the eigenvector blocks; and S40, constructing a decoding module, inputting the fusion characteristic value into the decoding module, and outputting the decoding module to a softmax layer to complete modeling.
CN202010919200.2A 2020-09-04 2020-09-04 Infrared thermal imaging power transmission line anti-external-damage monitoring system and modeling method thereof Active CN112651421B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010919200.2A CN112651421B (en) 2020-09-04 2020-09-04 Infrared thermal imaging power transmission line anti-external-damage monitoring system and modeling method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010919200.2A CN112651421B (en) 2020-09-04 2020-09-04 Infrared thermal imaging power transmission line anti-external-damage monitoring system and modeling method thereof

Publications (2)

Publication Number Publication Date
CN112651421A CN112651421A (en) 2021-04-13
CN112651421B true CN112651421B (en) 2024-05-28

Family

ID=75346193

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010919200.2A Active CN112651421B (en) 2020-09-04 2020-09-04 Infrared thermal imaging power transmission line anti-external-damage monitoring system and modeling method thereof

Country Status (1)

Country Link
CN (1) CN112651421B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114862906B (en) * 2022-04-11 2024-05-07 中山大学 Visible light positioning and tracking method based on bidirectional cyclic convolutional neural network

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109993055A (en) * 2019-02-21 2019-07-09 北京以萨技术股份有限公司 A kind of continuous abnormal image detecting method neural network based
CN110335260A (en) * 2019-06-27 2019-10-15 华东送变电工程有限公司 Power cable damage detection method based on light convolution neural network
CN110418210A (en) * 2019-07-12 2019-11-05 东南大学 A kind of video presentation generation method exported based on bidirectional circulating neural network and depth
CN110852199A (en) * 2019-10-28 2020-02-28 中国石化销售股份有限公司华南分公司 Foreground extraction method based on double-frame coding and decoding model
CN111062395A (en) * 2019-11-27 2020-04-24 北京理工大学 Real-time video semantic segmentation method
CN111091130A (en) * 2019-12-13 2020-05-01 南京邮电大学 Real-time image semantic segmentation method and system based on lightweight convolutional neural network
AU2020101229A4 (en) * 2020-07-02 2020-08-06 South China University Of Technology A Text Line Recognition Method in Chinese Scenes Based on Residual Convolutional and Recurrent Neural Networks

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109993055A (en) * 2019-02-21 2019-07-09 北京以萨技术股份有限公司 A kind of continuous abnormal image detecting method neural network based
CN110335260A (en) * 2019-06-27 2019-10-15 华东送变电工程有限公司 Power cable damage detection method based on light convolution neural network
CN110418210A (en) * 2019-07-12 2019-11-05 东南大学 A kind of video presentation generation method exported based on bidirectional circulating neural network and depth
CN110852199A (en) * 2019-10-28 2020-02-28 中国石化销售股份有限公司华南分公司 Foreground extraction method based on double-frame coding and decoding model
CN111062395A (en) * 2019-11-27 2020-04-24 北京理工大学 Real-time video semantic segmentation method
CN111091130A (en) * 2019-12-13 2020-05-01 南京邮电大学 Real-time image semantic segmentation method and system based on lightweight convolutional neural network
AU2020101229A4 (en) * 2020-07-02 2020-08-06 South China University Of Technology A Text Line Recognition Method in Chinese Scenes Based on Residual Convolutional and Recurrent Neural Networks

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于双向循环神经网络的跌倒行为识别;佃松宜等;《计算机工程与设计》;第41卷(第07期);1-6 *

Also Published As

Publication number Publication date
CN112651421A (en) 2021-04-13

Similar Documents

Publication Publication Date Title
CN112884064B (en) Target detection and identification method based on neural network
CN111814661B (en) Human body behavior recognition method based on residual error-circulating neural network
CN108090472B (en) Pedestrian re-identification method and system based on multi-channel consistency characteristics
CN107247952B (en) Deep supervision-based visual saliency detection method for cyclic convolution neural network
Choi et al. Attention-based multimodal image feature fusion module for transmission line detection
CN112036249B (en) Method, system, medium and terminal for end-to-end pedestrian detection and attribute identification
CN111444924A (en) Method and system for detecting plant diseases and insect pests and analyzing disaster grades
CN114612937A (en) Single-mode enhancement-based infrared and visible light fusion pedestrian detection method
CN111666852A (en) Micro-expression double-flow network identification method based on convolutional neural network
CN113205507A (en) Visual question answering method, system and server
CN117197763A (en) Road crack detection method and system based on cross attention guide feature alignment network
CN113436184A (en) Power equipment image defect judging method and system based on improved twin network
CN112651421B (en) Infrared thermal imaging power transmission line anti-external-damage monitoring system and modeling method thereof
CN113989261A (en) Unmanned aerial vehicle visual angle infrared image photovoltaic panel boundary segmentation method based on Unet improvement
CN114359838A (en) Cross-modal pedestrian detection method based on Gaussian cross attention network
CN114241310B (en) Improved YOLO model-based intelligent identification method for piping dangerous case of dike
CN117351311A (en) Substation equipment detection method and system based on bimodal data fusion
CN116523875A (en) Insulator defect detection method based on FPGA pretreatment and improved YOLOv5
CN112785479A (en) Image invisible watermark universal detection method based on less-sample learning
CN106960188B (en) Weather image classification method and device
CN116485802B (en) Insulator flashover defect detection method, device, equipment and storage medium
CN111985625B (en) Infrared-visible light fused deep neural network and modeling method thereof
CN116740567A (en) Soil moisture content detection method and system for Paulownia seedling cultivation
CN117173595A (en) Unmanned aerial vehicle aerial image target detection method based on improved YOLOv7
CN116503354A (en) Method and device for detecting and evaluating hot spots of photovoltaic cells based on multi-mode fusion

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant