CN106802879A - A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis - Google Patents

A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis Download PDF

Info

Publication number
CN106802879A
CN106802879A CN201710024203.8A CN201710024203A CN106802879A CN 106802879 A CN106802879 A CN 106802879A CN 201710024203 A CN201710024203 A CN 201710024203A CN 106802879 A CN106802879 A CN 106802879A
Authority
CN
China
Prior art keywords
monitoring data
sigma
epsiv
eta
statistic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710024203.8A
Other languages
Chinese (zh)
Inventor
伊廷华
黄海宾
李宏男
马树伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dalian Bai Laili Information Technology Co Ltd
Dalian University of Technology
Original Assignee
Dalian Bai Laili Information Technology Co Ltd
Dalian University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dalian Bai Laili Information Technology Co Ltd, Dalian University of Technology filed Critical Dalian Bai Laili Information Technology Co Ltd
Priority to CN201710024203.8A priority Critical patent/CN106802879A/en
Publication of CN106802879A publication Critical patent/CN106802879A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10Complex mathematical operations
    • G06F17/18Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/08Construction

Abstract

The invention belongs to civil engineering works structure health monitoring field, there is provided a kind of structure monitoring data exception recognition methods based on multivariate statistical analysis.First, the normal Monitoring Data to structure sets up multivariate statistical analysis model;Secondly, the anomalous identification process of Monitoring Data is converted into assumed statistical inspection problem in the noise subspace of model;Then, the assumed statistical inspection problem is solved to derive a new statistic, for recognizing thundering observed data;Finally, the reasonable threshold value of the statistic is determined, when statistic is the presence of exception in can determine whether Monitoring Data more than threshold value.

Description

A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis
Technical field
The invention belongs to civil engineering works structure health monitoring field, it is proposed that a kind of structure based on multivariate statistical analysis Monitoring Data abnormality recognition method.
Background technology
Civil engineering structure under the collective effect of the factors such as long duration load, environmental attack and fatigue effect, its military service The degeneration of energy is inevitable.Structure monitoring data are analysed in depth, the abnormality of structure can be in time found and be provided accurate Safe early warning, the safe operation to ensuring civil engineering structure has important practical significance.At present, structure monitoring data is different General knowledge mainly by statistical method realization, is not generally divided into two major classes:1) single argument control figure, such as Shewhart control chart, accumulation With control figure etc., such method sets up control figure respectively to the Monitoring Data of each measuring point, to recognize the exception in Monitoring Data; 2) multivariate statistical analysis, such as principal component analysis, independent component analysis, such method is using between multi-measuring point Monitoring Data Correlation sets up statistical model, and defines corresponding statistic to recognize the exception in Monitoring Data.
Due to the continuity of malformation, the response data between structure adjacent measuring point also has certain correlation.Cause This, in practical engineering application, it can be considered that the multivariate statistical analysis method of this correlation has more superiority.Additionally, should Class method only needs 1~2 statistic of definition, you can differentiate whether Monitoring Data is abnormal, and this is for the knot comprising numerous sensors It is very convenient for structure health monitoring system.However, conventional multivariate statistical analysis method to structure monitoring data in it is micro- Small exception is sometimes not sensitive enough, if the problem can be solved effectively, multivariate statistical analysis is recognized in structure monitoring data exception In will more have practical value.
The content of the invention
The present invention is directed to propose a kind of structure monitoring data exception recognition methods, effectively to solve multivariate statistical analysis pair The insensitive problem of minor anomaly in structure monitoring data.Its technical scheme is:First, the normal Monitoring Data to structure is set up Multivariate statistical analysis model;Secondly, the anomalous identification process of Monitoring Data is converted into system in the noise subspace of model Meter Hypothesis Testing Problem;Then, the assumed statistical inspection problem is solved to derive a new statistic, for recognizing abnormal prison Survey data;Finally, determine the reasonable threshold value of the statistic, when statistic be more than threshold value exist in can determine whether Monitoring Data it is different Often.
A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis, step is as follows:
Step one:Monitoring Data is modeled
(1) the normal Monitoring Data to structure sets up multivariate statistical analysis model:
S=E { xxT}=V Ξ VT
In formula:X=[x1,x2,...,xm]TThe a certain normal Monitoring Data of structure is represented, altogether comprising m variable;S is represented Covariance matrix;Ξ=diag (ξ12,...,ξm) include all characteristic value ξi;V=[v1,v2,...,vm] include all features Vector vi, viAs i-th principal direction;
(2) set comprising r principal direction in noise subspace, then its expression formula is N=[vm-r+1,vm-r+2,...,vm]T, r presses Following condition determines:
And
Step 2:Anomalous identification process is converted into assumed statistical inspection problem
(3) normal Monitoring Data x is projected as n=Nx on noise subspace N;
(4) a certain thundering observed data for setting structure is expressed asδ represents abnormal amount, then it is empty in noise Between be projected as n=Nx+N δ on N;
(5) η=Nx and ε=N δ are made, then anomalous identification process can be exchanged into following assumed statistical inspection problem:
In formula:Η0Null hypothesis is represented, in the absence of abnormal under the conditions of being somebody's turn to do;Η1Alternative hvpothesis are represented, is existed under the conditions of being somebody's turn to do different Often;It is generally acknowledged that the Monitoring Data Gaussian distributed under normal or abnormality, then Η0Under the conditions of have n~G (0, Ση), and Η1Under the conditions of have n~G (ε, Ση), ΣηRepresent the covariance matrix of variable η;
Step 3:Assumed statistical inspection problem is solved, statistic is derived
(6) using the l Moving Window of Monitoring Data is included, the throwing of i-th sample on N is calculated respectively in the Moving Window Shadow ni, i=1,2 ..., l;When following condition is met, generalized likelihood-ratio test method judges Η1Set up, i.e., in the Moving Window Monitoring Data exist it is abnormal:
In formula:Represent the maximal possibility estimation of ε;P () represents the probability of certain variable;T represents statistic;τ represents threshold Value;
(7) further derive, the log-likelihood ratio in above formula is expressed as:
(8) included in above formulaItem be fixed value, move it to threshold portion, then discriminate further simplifies For:
(9) because the maximal possibility estimation of ε isThen discriminate is finally reduced to:
In formula:njRepresent the projection of j-th sample on N, j=1,2 ..., l in Moving Window;When statistic T exceedes threshold During value τ, show that the Monitoring Data in Moving Window is present abnormal;
Step 4:Determine the reasonable threshold value of statistic
(10) for the normal Monitoring Data of structure, after setting Moving Window length l, the corresponding system of each Moving Window is calculated MeteringUntil all of Monitoring Data has all been calculated;Then, the general of all statistics is estimated Rate Density Distribution, then determine rational threshold tau according to 99% confidence criterion (i.e. significance is 1%).
Beneficial effects of the present invention:The anomalous identification process of structure monitoring data is converted into assumed statistical inspection problem, And then a new statistic is derived, the statistic can effectively recognize thundering observed data.
Brief description of the drawings
Fig. 1 is Moving Window schematic diagram.
Fig. 2 is the recognition result of textural anomaly Monitoring Data.
Specific embodiment
Below in conjunction with accompanying drawing and technical scheme, specific embodiment of the invention is further illustrated.
Two across a highway bridge models are chosen, its length is 5.4864m, width is 1.8288m.Finite element mould is set up to it Type is responded with model configuration, and 12 responses of measuring point of collection are used as Monitoring Data.Symbiosis is into two datasets:Training dataset and Test data set;Wherein, training dataset is normal Monitoring Data collection, and the part that test data is concentrated is used to simulate abnormal prison Survey data;Two datasets continue 120s, and sample frequency is 256Hz.Specific embodiment is as follows:
(1) training dataset is modeled, is computed, the principal direction number included in noise subspace is r=2;Cause This, noise subspace is made up of most latter two principal direction, i.e. N=[v11,v12]T
(2) Moving Window length l is set, each corresponding statistic of Moving Window (see Fig. 1) that training data is concentrated is calculatedAfter the corresponding statistic of all Moving Windows has been calculated, the probability density point of statistic is estimated Cloth, then determine rational threshold tau according to 99% confidence criterion.
(3) Monitoring Data of simulation thundering observed data, i.e., No. 2 sensor collection is concentrated in 48~120s in test data Period occurs abnormal;No. 2 Monitoring Datas of sensor after the Monitoring Data and simulation exception of extremely preceding No. 2 sensors of comparative simulation Understand:The exception of Monitoring Data is difficult to discover.For the test data set after simulating exception, each of which Moving Window pair is calculated The statistic answeredAll abnormal datas are successfully identified out.

Claims (1)

1. a kind of structure monitoring data exception recognition methods based on multivariate statistical analysis, it is characterised in that step is as follows:
Step one:Monitoring Data is modeled
(1) the normal Monitoring Data to structure sets up multivariate statistical analysis model:
S=E { xxT}=V Ξ VT
In formula:X=[x1,x2,...,xm]TThe a certain normal Monitoring Data of structure is represented, altogether comprising m variable;S represents covariance Matrix;Ξ=diag (ξ12,...,ξm) include all characteristic value ξi;V=[v1,v2,...,vm] include all characteristic vector vi, viAs i-th principal direction;
(2) set comprising r principal direction in noise subspace, then its expression formula is N=[vm-r+1,vm-r+2,...,vm]T, r is by as follows Condition determines:
And
Step 2:Anomalous identification process is converted into assumed statistical inspection problem
(3) normal Monitoring Data x is projected as n=Nx on noise subspace N;
(4) a certain thundering observed data for setting structure is expressed asδ represents abnormal amount, then it is in noise subspace N On be projected as n=Nx+N δ;
(5) η=Nx and ε=N δ are made, then anomalous identification process can be exchanged into following assumed statistical inspection problem:
H 0 : n = η H 1 : n = ϵ + η
In formula:Η0Null hypothesis is represented, in the absence of abnormal under the conditions of being somebody's turn to do;Η1Alternative hvpothesis are represented, is existed under the conditions of being somebody's turn to do abnormal;One As think under normal or abnormality Monitoring Data Gaussian distributed, then Η0Under the conditions of have n~G (0, Ση), and Η1Bar There are n~G (ε, Σ under partη), ΣηRepresent the covariance matrix of variable η;
Step 3:Assumed statistical inspection problem is solved, statistic is derived
(6) using the l Moving Window of Monitoring Data is included, the projection n of i-th sample on N is calculated respectively in the Moving Windowi, I=1,2 ..., l;When following condition is met, generalized likelihood-ratio test method judges Η1Set up, i.e. prison in the Moving Window Survey data and there is exception:
T = Σ i = 1 l ln p ( n i ; ϵ ^ , H 1 ) p ( n i ; H 0 ) > τ
In formula:Represent the maximal possibility estimation of ε;P () represents the probability of certain variable;T represents statistic;τ represents threshold value;
(7) further derive, the log-likelihood ratio in above formula is expressed as:
ln p ( n i ; ϵ ^ , H 1 ) p ( n i ; H 0 ) = - 1 2 [ ( n i - ϵ ^ ) T Σ η - 1 ( n i - ϵ ^ ) T - n i T Σ η - 1 n i ] = - 1 2 [ n i T Σ η - 1 n i - 2 n i T Σ η - 1 ϵ ^ + ϵ ^ T Σ η - 1 ϵ ^ - n i T Σ η - 1 n i ] = n i T Σ η - 1 ϵ ^ - 1 2 ϵ ^ T Σ η - 1 ϵ ^
(8) included in above formulaItem be fixed value, move it to threshold portion, then discriminate is further simplified as:
T = Σ i = 1 l n i T Σ η - 1 ϵ ^ > τ
(9) because the maximal possibility estimation of ε isThen discriminate is finally reduced to:
T = 1 l Σ i = 1 l Σ j = 1 l n i T Σ η - 1 n j > τ
In formula:njRepresent the projection of j-th sample on N, j=1,2 ..., l in Moving Window;When statistic T exceedes threshold tau, Show that the Monitoring Data in Moving Window is present abnormal;
Step 4:Determine the reasonable threshold value of statistic
(10) for the normal Monitoring Data of structure, after setting Moving Window length l, the corresponding statistic of each Moving Window is calculatedUntil all of Monitoring Data has all been calculated;Then, estimate that the probability of all statistics is close Degree distribution, then determine rational threshold tau according to 99% confidence criterion (i.e. significance is 1%).
CN201710024203.8A 2017-01-13 2017-01-13 A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis Pending CN106802879A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710024203.8A CN106802879A (en) 2017-01-13 2017-01-13 A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710024203.8A CN106802879A (en) 2017-01-13 2017-01-13 A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis

Publications (1)

Publication Number Publication Date
CN106802879A true CN106802879A (en) 2017-06-06

Family

ID=58984345

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710024203.8A Pending CN106802879A (en) 2017-01-13 2017-01-13 A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis

Country Status (1)

Country Link
CN (1) CN106802879A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020072980A1 (en) * 2018-10-04 2020-04-09 Geomni, Inc. Computer vision systems and methods for identifying anomalies in building models

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101408940A (en) * 2008-11-25 2009-04-15 重庆大学 Method for identifying multi-sensor singular distortion data through space crossover
CN103714233A (en) * 2013-05-10 2014-04-09 上海阿趣生物科技有限公司 Univariable and multi-variable combined data analysis method
CN105556552A (en) * 2013-03-13 2016-05-04 加迪安分析有限公司 Fraud detection and analysis

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101408940A (en) * 2008-11-25 2009-04-15 重庆大学 Method for identifying multi-sensor singular distortion data through space crossover
CN105556552A (en) * 2013-03-13 2016-05-04 加迪安分析有限公司 Fraud detection and analysis
CN103714233A (en) * 2013-05-10 2014-04-09 上海阿趣生物科技有限公司 Univariable and multi-variable combined data analysis method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
HB HUANG等: "Sensor Fault Diagnosis for Structural Health Monitoring Based on Statistical Hypothesis Test and Missing Variable Approach", 《JOURNAL OF AEROSPACE ENGINEERING》 *
伊廷华等: "GPS异常监测数据的关联负选择分步识别算法", 《振动工程学报》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020072980A1 (en) * 2018-10-04 2020-04-09 Geomni, Inc. Computer vision systems and methods for identifying anomalies in building models
US11775700B2 (en) 2018-10-04 2023-10-03 Insurance Services Office, Inc. Computer vision systems and methods for identifying anomalies in building models

Similar Documents

Publication Publication Date Title
Wang et al. Improved lstm-based time-series anomaly detection in rail transit operation environments
CN103336243B (en) Based on the circuit breaker failure diagnostic method of divide-shut brake coil current signal
CN106872657B (en) A kind of multivariable water quality parameter time series data accident detection method
CN103336906B (en) The sampling Gaussian process regression model that in the image data stream of environmental sensor, continuous abnormal detects
Alippi et al. Model-free fault detection and isolation in large-scale cyber-physical systems
CN103473540B (en) The modeling of intelligent transportation system track of vehicle increment type and online method for detecting abnormality
CN106897509A (en) A kind of dynamic Non-Gaussian structures Monitoring Data abnormality recognition method
CN104915568A (en) Satellite telemetry data abnormity detection method based on DTW
CN103974311A (en) Condition monitoring data stream anomaly detection method based on improved gaussian process regression model
CN109491338A (en) A kind of relevant method for diagnosing faults of multimode procedure quality based on sparse GMM
CN110781266A (en) Urban perception data processing method based on time-space causal relationship
CN106845526A (en) A kind of relevant parameter Fault Classification based on the analysis of big data Fusion of Clustering
CN104777418A (en) Analog circuit fault diagnosis method based on depth Boltzman machine
Fu et al. A multivariate method for evaluating safety from conflict extremes in real time
CN112766301B (en) Oil extraction machine indicator diagram similarity judging method
CN106897505A (en) A kind of structure monitoring data exception recognition methods for considering temporal correlation
CN105094118A (en) Airplane engine air compressor stall detection method
CN110263944A (en) A kind of multivariable failure prediction method and device
CN109116319B (en) Fault detection method for radar system
Xia et al. Coupled attention networks for multivariate time series anomaly detection
Wang et al. A spatiotemporal feature learning-based RUL estimation method for predictive maintenance
CN106802879A (en) A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis
Li et al. Meteorological radar fault diagnosis based on deep learning
CN117056678A (en) Machine pump equipment operation fault diagnosis method and device based on small sample
CN109242008B (en) Compound fault identification method under incomplete sample class condition

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170606

WD01 Invention patent application deemed withdrawn after publication