CN106802879A - A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis - Google Patents
A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis Download PDFInfo
- Publication number
- CN106802879A CN106802879A CN201710024203.8A CN201710024203A CN106802879A CN 106802879 A CN106802879 A CN 106802879A CN 201710024203 A CN201710024203 A CN 201710024203A CN 106802879 A CN106802879 A CN 106802879A
- Authority
- CN
- China
- Prior art keywords
- monitoring data
- sigma
- epsiv
- eta
- statistic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/18—Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/08—Construction
Abstract
The invention belongs to civil engineering works structure health monitoring field, there is provided a kind of structure monitoring data exception recognition methods based on multivariate statistical analysis.First, the normal Monitoring Data to structure sets up multivariate statistical analysis model;Secondly, the anomalous identification process of Monitoring Data is converted into assumed statistical inspection problem in the noise subspace of model;Then, the assumed statistical inspection problem is solved to derive a new statistic, for recognizing thundering observed data;Finally, the reasonable threshold value of the statistic is determined, when statistic is the presence of exception in can determine whether Monitoring Data more than threshold value.
Description
Technical field
The invention belongs to civil engineering works structure health monitoring field, it is proposed that a kind of structure based on multivariate statistical analysis
Monitoring Data abnormality recognition method.
Background technology
Civil engineering structure under the collective effect of the factors such as long duration load, environmental attack and fatigue effect, its military service
The degeneration of energy is inevitable.Structure monitoring data are analysed in depth, the abnormality of structure can be in time found and be provided accurate
Safe early warning, the safe operation to ensuring civil engineering structure has important practical significance.At present, structure monitoring data is different
General knowledge mainly by statistical method realization, is not generally divided into two major classes:1) single argument control figure, such as Shewhart control chart, accumulation
With control figure etc., such method sets up control figure respectively to the Monitoring Data of each measuring point, to recognize the exception in Monitoring Data;
2) multivariate statistical analysis, such as principal component analysis, independent component analysis, such method is using between multi-measuring point Monitoring Data
Correlation sets up statistical model, and defines corresponding statistic to recognize the exception in Monitoring Data.
Due to the continuity of malformation, the response data between structure adjacent measuring point also has certain correlation.Cause
This, in practical engineering application, it can be considered that the multivariate statistical analysis method of this correlation has more superiority.Additionally, should
Class method only needs 1~2 statistic of definition, you can differentiate whether Monitoring Data is abnormal, and this is for the knot comprising numerous sensors
It is very convenient for structure health monitoring system.However, conventional multivariate statistical analysis method to structure monitoring data in it is micro-
Small exception is sometimes not sensitive enough, if the problem can be solved effectively, multivariate statistical analysis is recognized in structure monitoring data exception
In will more have practical value.
The content of the invention
The present invention is directed to propose a kind of structure monitoring data exception recognition methods, effectively to solve multivariate statistical analysis pair
The insensitive problem of minor anomaly in structure monitoring data.Its technical scheme is:First, the normal Monitoring Data to structure is set up
Multivariate statistical analysis model;Secondly, the anomalous identification process of Monitoring Data is converted into system in the noise subspace of model
Meter Hypothesis Testing Problem;Then, the assumed statistical inspection problem is solved to derive a new statistic, for recognizing abnormal prison
Survey data;Finally, determine the reasonable threshold value of the statistic, when statistic be more than threshold value exist in can determine whether Monitoring Data it is different
Often.
A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis, step is as follows:
Step one:Monitoring Data is modeled
(1) the normal Monitoring Data to structure sets up multivariate statistical analysis model:
S=E { xxT}=V Ξ VT
In formula:X=[x1,x2,...,xm]TThe a certain normal Monitoring Data of structure is represented, altogether comprising m variable;S is represented
Covariance matrix;Ξ=diag (ξ1,ξ2,...,ξm) include all characteristic value ξi;V=[v1,v2,...,vm] include all features
Vector vi, viAs i-th principal direction;
(2) set comprising r principal direction in noise subspace, then its expression formula is N=[vm-r+1,vm-r+2,...,vm]T, r presses
Following condition determines:
And
Step 2:Anomalous identification process is converted into assumed statistical inspection problem
(3) normal Monitoring Data x is projected as n=Nx on noise subspace N;
(4) a certain thundering observed data for setting structure is expressed asδ represents abnormal amount, then it is empty in noise
Between be projected as n=Nx+N δ on N;
(5) η=Nx and ε=N δ are made, then anomalous identification process can be exchanged into following assumed statistical inspection problem:
In formula:Η0Null hypothesis is represented, in the absence of abnormal under the conditions of being somebody's turn to do;Η1Alternative hvpothesis are represented, is existed under the conditions of being somebody's turn to do different
Often;It is generally acknowledged that the Monitoring Data Gaussian distributed under normal or abnormality, then Η0Under the conditions of have n~G (0, Ση), and
Η1Under the conditions of have n~G (ε, Ση), ΣηRepresent the covariance matrix of variable η;
Step 3:Assumed statistical inspection problem is solved, statistic is derived
(6) using the l Moving Window of Monitoring Data is included, the throwing of i-th sample on N is calculated respectively in the Moving Window
Shadow ni, i=1,2 ..., l;When following condition is met, generalized likelihood-ratio test method judges Η1Set up, i.e., in the Moving Window
Monitoring Data exist it is abnormal:
In formula:Represent the maximal possibility estimation of ε;P () represents the probability of certain variable;T represents statistic;τ represents threshold
Value;
(7) further derive, the log-likelihood ratio in above formula is expressed as:
(8) included in above formulaItem be fixed value, move it to threshold portion, then discriminate further simplifies
For:
(9) because the maximal possibility estimation of ε isThen discriminate is finally reduced to:
In formula:njRepresent the projection of j-th sample on N, j=1,2 ..., l in Moving Window;When statistic T exceedes threshold
During value τ, show that the Monitoring Data in Moving Window is present abnormal;
Step 4:Determine the reasonable threshold value of statistic
(10) for the normal Monitoring Data of structure, after setting Moving Window length l, the corresponding system of each Moving Window is calculated
MeteringUntil all of Monitoring Data has all been calculated;Then, the general of all statistics is estimated
Rate Density Distribution, then determine rational threshold tau according to 99% confidence criterion (i.e. significance is 1%).
Beneficial effects of the present invention:The anomalous identification process of structure monitoring data is converted into assumed statistical inspection problem,
And then a new statistic is derived, the statistic can effectively recognize thundering observed data.
Brief description of the drawings
Fig. 1 is Moving Window schematic diagram.
Fig. 2 is the recognition result of textural anomaly Monitoring Data.
Specific embodiment
Below in conjunction with accompanying drawing and technical scheme, specific embodiment of the invention is further illustrated.
Two across a highway bridge models are chosen, its length is 5.4864m, width is 1.8288m.Finite element mould is set up to it
Type is responded with model configuration, and 12 responses of measuring point of collection are used as Monitoring Data.Symbiosis is into two datasets:Training dataset and
Test data set;Wherein, training dataset is normal Monitoring Data collection, and the part that test data is concentrated is used to simulate abnormal prison
Survey data;Two datasets continue 120s, and sample frequency is 256Hz.Specific embodiment is as follows:
(1) training dataset is modeled, is computed, the principal direction number included in noise subspace is r=2;Cause
This, noise subspace is made up of most latter two principal direction, i.e. N=[v11,v12]T。
(2) Moving Window length l is set, each corresponding statistic of Moving Window (see Fig. 1) that training data is concentrated is calculatedAfter the corresponding statistic of all Moving Windows has been calculated, the probability density point of statistic is estimated
Cloth, then determine rational threshold tau according to 99% confidence criterion.
(3) Monitoring Data of simulation thundering observed data, i.e., No. 2 sensor collection is concentrated in 48~120s in test data
Period occurs abnormal;No. 2 Monitoring Datas of sensor after the Monitoring Data and simulation exception of extremely preceding No. 2 sensors of comparative simulation
Understand:The exception of Monitoring Data is difficult to discover.For the test data set after simulating exception, each of which Moving Window pair is calculated
The statistic answeredAll abnormal datas are successfully identified out.
Claims (1)
1. a kind of structure monitoring data exception recognition methods based on multivariate statistical analysis, it is characterised in that step is as follows:
Step one:Monitoring Data is modeled
(1) the normal Monitoring Data to structure sets up multivariate statistical analysis model:
S=E { xxT}=V Ξ VT
In formula:X=[x1,x2,...,xm]TThe a certain normal Monitoring Data of structure is represented, altogether comprising m variable;S represents covariance
Matrix;Ξ=diag (ξ1,ξ2,...,ξm) include all characteristic value ξi;V=[v1,v2,...,vm] include all characteristic vector vi,
viAs i-th principal direction;
(2) set comprising r principal direction in noise subspace, then its expression formula is N=[vm-r+1,vm-r+2,...,vm]T, r is by as follows
Condition determines:
And
Step 2:Anomalous identification process is converted into assumed statistical inspection problem
(3) normal Monitoring Data x is projected as n=Nx on noise subspace N;
(4) a certain thundering observed data for setting structure is expressed asδ represents abnormal amount, then it is in noise subspace N
On be projected as n=Nx+N δ;
(5) η=Nx and ε=N δ are made, then anomalous identification process can be exchanged into following assumed statistical inspection problem:
In formula:Η0Null hypothesis is represented, in the absence of abnormal under the conditions of being somebody's turn to do;Η1Alternative hvpothesis are represented, is existed under the conditions of being somebody's turn to do abnormal;One
As think under normal or abnormality Monitoring Data Gaussian distributed, then Η0Under the conditions of have n~G (0, Ση), and Η1Bar
There are n~G (ε, Σ under partη), ΣηRepresent the covariance matrix of variable η;
Step 3:Assumed statistical inspection problem is solved, statistic is derived
(6) using the l Moving Window of Monitoring Data is included, the projection n of i-th sample on N is calculated respectively in the Moving Windowi,
I=1,2 ..., l;When following condition is met, generalized likelihood-ratio test method judges Η1Set up, i.e. prison in the Moving Window
Survey data and there is exception:
In formula:Represent the maximal possibility estimation of ε;P () represents the probability of certain variable;T represents statistic;τ represents threshold value;
(7) further derive, the log-likelihood ratio in above formula is expressed as:
(8) included in above formulaItem be fixed value, move it to threshold portion, then discriminate is further simplified as:
(9) because the maximal possibility estimation of ε isThen discriminate is finally reduced to:
In formula:njRepresent the projection of j-th sample on N, j=1,2 ..., l in Moving Window;When statistic T exceedes threshold tau,
Show that the Monitoring Data in Moving Window is present abnormal;
Step 4:Determine the reasonable threshold value of statistic
(10) for the normal Monitoring Data of structure, after setting Moving Window length l, the corresponding statistic of each Moving Window is calculatedUntil all of Monitoring Data has all been calculated;Then, estimate that the probability of all statistics is close
Degree distribution, then determine rational threshold tau according to 99% confidence criterion (i.e. significance is 1%).
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710024203.8A CN106802879A (en) | 2017-01-13 | 2017-01-13 | A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710024203.8A CN106802879A (en) | 2017-01-13 | 2017-01-13 | A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106802879A true CN106802879A (en) | 2017-06-06 |
Family
ID=58984345
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710024203.8A Pending CN106802879A (en) | 2017-01-13 | 2017-01-13 | A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106802879A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020072980A1 (en) * | 2018-10-04 | 2020-04-09 | Geomni, Inc. | Computer vision systems and methods for identifying anomalies in building models |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101408940A (en) * | 2008-11-25 | 2009-04-15 | 重庆大学 | Method for identifying multi-sensor singular distortion data through space crossover |
CN103714233A (en) * | 2013-05-10 | 2014-04-09 | 上海阿趣生物科技有限公司 | Univariable and multi-variable combined data analysis method |
CN105556552A (en) * | 2013-03-13 | 2016-05-04 | 加迪安分析有限公司 | Fraud detection and analysis |
-
2017
- 2017-01-13 CN CN201710024203.8A patent/CN106802879A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101408940A (en) * | 2008-11-25 | 2009-04-15 | 重庆大学 | Method for identifying multi-sensor singular distortion data through space crossover |
CN105556552A (en) * | 2013-03-13 | 2016-05-04 | 加迪安分析有限公司 | Fraud detection and analysis |
CN103714233A (en) * | 2013-05-10 | 2014-04-09 | 上海阿趣生物科技有限公司 | Univariable and multi-variable combined data analysis method |
Non-Patent Citations (2)
Title |
---|
HB HUANG等: "Sensor Fault Diagnosis for Structural Health Monitoring Based on Statistical Hypothesis Test and Missing Variable Approach", 《JOURNAL OF AEROSPACE ENGINEERING》 * |
伊廷华等: "GPS异常监测数据的关联负选择分步识别算法", 《振动工程学报》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020072980A1 (en) * | 2018-10-04 | 2020-04-09 | Geomni, Inc. | Computer vision systems and methods for identifying anomalies in building models |
US11775700B2 (en) | 2018-10-04 | 2023-10-03 | Insurance Services Office, Inc. | Computer vision systems and methods for identifying anomalies in building models |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Wang et al. | Improved lstm-based time-series anomaly detection in rail transit operation environments | |
CN103336243B (en) | Based on the circuit breaker failure diagnostic method of divide-shut brake coil current signal | |
CN106872657B (en) | A kind of multivariable water quality parameter time series data accident detection method | |
CN103336906B (en) | The sampling Gaussian process regression model that in the image data stream of environmental sensor, continuous abnormal detects | |
Alippi et al. | Model-free fault detection and isolation in large-scale cyber-physical systems | |
CN103473540B (en) | The modeling of intelligent transportation system track of vehicle increment type and online method for detecting abnormality | |
CN106897509A (en) | A kind of dynamic Non-Gaussian structures Monitoring Data abnormality recognition method | |
CN104915568A (en) | Satellite telemetry data abnormity detection method based on DTW | |
CN103974311A (en) | Condition monitoring data stream anomaly detection method based on improved gaussian process regression model | |
CN109491338A (en) | A kind of relevant method for diagnosing faults of multimode procedure quality based on sparse GMM | |
CN110781266A (en) | Urban perception data processing method based on time-space causal relationship | |
CN106845526A (en) | A kind of relevant parameter Fault Classification based on the analysis of big data Fusion of Clustering | |
CN104777418A (en) | Analog circuit fault diagnosis method based on depth Boltzman machine | |
Fu et al. | A multivariate method for evaluating safety from conflict extremes in real time | |
CN112766301B (en) | Oil extraction machine indicator diagram similarity judging method | |
CN106897505A (en) | A kind of structure monitoring data exception recognition methods for considering temporal correlation | |
CN105094118A (en) | Airplane engine air compressor stall detection method | |
CN110263944A (en) | A kind of multivariable failure prediction method and device | |
CN109116319B (en) | Fault detection method for radar system | |
Xia et al. | Coupled attention networks for multivariate time series anomaly detection | |
Wang et al. | A spatiotemporal feature learning-based RUL estimation method for predictive maintenance | |
CN106802879A (en) | A kind of structure monitoring data exception recognition methods based on multivariate statistical analysis | |
Li et al. | Meteorological radar fault diagnosis based on deep learning | |
CN117056678A (en) | Machine pump equipment operation fault diagnosis method and device based on small sample | |
CN109242008B (en) | Compound fault identification method under incomplete sample class condition |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170606 |
|
WD01 | Invention patent application deemed withdrawn after publication |