CN103106331A - Photo-etching line width intelligence forecasting method based on dimension-reduction and quantity-increment-type extreme learning machine - Google Patents
Photo-etching line width intelligence forecasting method based on dimension-reduction and quantity-increment-type extreme learning machine Download PDFInfo
- Publication number
- CN103106331A CN103106331A CN2012105437716A CN201210543771A CN103106331A CN 103106331 A CN103106331 A CN 103106331A CN 2012105437716 A CN2012105437716 A CN 2012105437716A CN 201210543771 A CN201210543771 A CN 201210543771A CN 103106331 A CN103106331 A CN 103106331A
- Authority
- CN
- China
- Prior art keywords
- centerdot
- learning machine
- extreme learning
- line width
- test
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a photo-etching line width intelligence forecasting method based on a dimension-reduction and quantity-increment-type extreme learning machine, belongs to the field of automatic control, information technology and advanced manufacturing, and particularly relates to a method that special to the characteristic that training data are high in dimensionality and arrives in a batching mode in the modeling process of a photo-etching line width index, intelligent online forecasting of the photo-etching line width index is achieved by conducting matrix inversion and dimension reduction to a batching extreme learning machine based on minimizing of structural risks. The photo-etching line width intelligence forecasting method based on the dimension-reduction and quantity-increment-type extreme learning machine is characterized by comprising the following steps: matrix inversion in the batching extreme learning machine based on the minimizing of structural risks is conducted dimension reduction by adopting a matrix inversion dimension reduction formula to build the relations between model parameters of the extreme learning machine and new-arriving data, and online increment-quantity-type leaning and updating of output layer weights of the model parameters of the extreme learning machine are achieved. The index forecasting method which is used for the dimension-reduction and quantity-increment-type extreme learning machine and based on matrix inversion dimension reduction has good forecasting effect.
Description
Technical field
The invention belongs to automatic control, infotech and advanced manufacturing field, for in characteristics high to the existing data dimension of lithographic line width forecasting process and that training data arrives in batches, a kind of lithographic line width Intelligent Forecasting that obtains online increment type extreme learning machine based on the matrix inversion dimensionality reduction is proposed, it can realize the online adjustment to the index prediction model parameter, and the method has precision of prediction and efficient preferably.
Background technology
Lithographic line width is the critical process index that affects the microelectronic product yield, but its testing result exists than large time delay at present, be difficult to realize the on-line optimization adjustment on the relevant critical process operating parameter that affects this index, thereby affected the improvement of product yield, thereby needed the real-time estimate of realizing the lithographic line width index badly in the microelectronics production line.Have the advantages that for the data that obtain in the lithographic line width testing process dimension is high, data arrive in batches, propose a kind of lithographic line width prediction algorithm based on matrix inversion dimensionality reduction and increment type extreme learning machine.In recent years, the multiple neural net methods that can be used for the nonlinear system line modeling such as GAP-RBF, SAO-ELM, OS-ELM have been suggested, these class methods can be when new data arrive, structure or parameter to model are adjusted online, thereby avoid all sample datas are trained again, reduce calculated amount, improved counting yield.But carry out modeling because said method all is based on the empirical risk minimization criterion, have the defectives such as over-fitting, hidden node are difficult to determine, the modeling accuracy when having a strong impact on practical application.How improving precision and the efficient of modeling algorithm, satisfy simultaneously the characteristics that data arrive in batches, is the difficult point of setting up the lithographic line width forecast model.Index prediction method based on matrix inversion dimensionality reduction and increment type extreme learning machine proposed by the invention has prediction effect preferably to the lithographic line width index.
Summary of the invention
In order to solve above-mentioned difficult point, the present invention proposes a kind of lithographic line width Intelligent Forecasting based on the conversion of matrix inversion dimensionality reduction and increment type extreme learning machine, to adopt matrix inversion dimensionality reduction formula to carry out dimensionality reduction based on the matrix inversion in the batch processing extreme learning machine of structural risk minimization, to set up extreme learning machine model parameter and the new relation that arrives data, realize online incremental learning and output layer right value update to the extreme learning machine model parameter.
Lithographic line width Intelligent Forecasting based on dimensionality reduction and increment type extreme learning machine is characterized in that, described method is to realize according to the following steps successively on computers:
Step (1): Model Selection and parameter initialization
For a given N sample, its input is designated as
X wherein
iRepresent the vector that every i sample is comprised of 29 dimension data, this vector comprises following parameter: be in quality control value, wire width measuring value and the photoresist thickness of exposure dose corresponding to front 5 lot of identical processing level, same breed, focal length of photoetching machine, exposure dose with lot to be predicted; The quality control value of the exposure dose of current lot to be predicted, focal length of photoetching machine, exposure dose and photoresist thickness; N the corresponding output of sample input is designated as
y
iBe the lithographic line width measured value;
The number of hidden nodes L of given extreme learning machine based on structural risk minimization adopts radial basis function as the eigentransformation function, and functional form is
A wherein
i, b
iBe the parameter of radial basis function, a
iDimension is 29 dimensions, and it can be chosen from [1 1] at random, b
iBe 1 the dimension, value be from
Choose at random;
So the extreme learning machine Feature Mapping matrix H (X) of generation is:
Step (2): algorithm initialization
For moment t, the weighting parameter W of increment type extreme learning machine
tInitialization value is:
Wherein:
X
tThe sample that expression t has obtained constantly, sample size is N, so the extreme learning machine mapping matrix that produces is:
V adopts empirical value for the compromise coefficient, is taken as 2
-15
Step (3): on-line study process
For t+1 constantly, the quantity of supposing new arrival sample is k, newly arrives corresponding being input as of sample
Be output as
So the extreme learning machine mapping matrix that is formed by newly arrived sample data is:
T+1 is extreme learning machine weighting parameter W constantly
t+1Upgrade in the following manner:
W
t+1=K
tW
t+K
tA
t -1H(X
IC)
TY
IC
Wherein:
K
t=I-A
t -1H(X
IC)
T[H(X
IC)A
t -1H(X
IC)
T+I
k×k]
-1H(X
IC)
A
t+1 -1=K
tA
t -1
I
K * kIt is 1 unit matrix for diagonal line;
K
t, A
t -1Be the intermediate variable of introducing, upgrade rear weighting parameter W thereby simplify
t+1Expression-form;
Step (4): training process stops
After all training datas all participated in training, training process stopped, the extreme learning machine weighting parameter W after this moment, the output training was completed;
Step (5): the online application
Suppose that the test sample book quantity that need to carry out the lithographic line width prediction is N
Test, train the extreme learning machine model parameter W that obtains, carry out according to the following formula the intelligent predicting of lithographic line width:
X wherein
TestBe input corresponding to sample to be predicted,
Be the predicted value of photoetching district live width, H (X
Test) expression-form is as follows:
Description of drawings
Fig. 1: algorithm flow chart is each performing step of the lithographic line width prediction algorithm that proposes of the present invention;
Fig. 2: the measuring accuracy of lithographic line width data, after utilizing actual lithographic line width data to carry out modeling, utilize the model after training that live width is predicted the outcome;
Fig. 3: this algorithm is needed software and hardware composition diagram in enterprise's use procedure.
Embodiment
The present invention proposes the lithographic line width Intelligent Forecasting based on dimensionality reduction and increment type extreme learning machine, its main advantage is that precision of prediction is high, adopt simultaneously the on-line study method, the characteristics that in batches arrive to adapt to data, in actual application, if when having new data to arrive, just carry out at once model learning, and the model parameter that upgrades in time; If when arriving without new data, utilize the model of having trained to predict.On-line study method of the present invention depends on the hardware devices such as relevant data acquisition system (DAS), arithmetic server and subscription client, and is realized by the intelligent predicting software based on the lithographic line width Intelligent Forecasting of the conversion of matrix inversion dimensionality reduction and increment type extreme learning machine.
Step (1): gather the historical data information of litho machine, the correlation parameter information of processing lot:
The initialization information that gathers comprises processing menu, gluing thickness, exposure dose, gluing quality control value, the quality control value of exposure dose of photoetching machine, live width standard, historical measurements, the focal length of photoetching machine of lot, and initialization information is stored in database;
Step (2): Model Selection
To the method that the present invention proposes, Model Selection relates generally to the selection of the number of hidden nodes L.For the number of hidden nodes, according to the approximation theory of extreme learning machine algorithm, as long as the number of hidden nodes is enough large, algorithm can approach function arbitrarily with arbitrary accuracy, so in the present invention, the number of hidden nodes is chosen a relatively large value and got final product, and is taken as L=100.
Step (3): the model preset parameter arranges
The initialization of model is mainly that all parameters of model that relate in algorithm are determined value.In invention, the value of model parameter comprises the parameter a of radial basis function
i, b
i, initialization sample is counted N
0, penalty factor v selects.a
i, b
iBe the parameter of radial basis function, a
iDimension is 29 dimensions, and it can be chosen from [11] at random, b
iBe 1 the dimension, value be from
Choose at random; Initialization sample is counted N
0=L+200, L are given the number of hidden nodes, L=100.For the selection of penalty factor v, can be { 2
-24, 2
-23..., 2
24, 2
25Select in scope, the experience value is 2
-15
Step (4): algorithm initialization
For moment t, the weighting parameter W of increment type extreme learning machine
tInitialization value is:
Wherein:
X
tThe sample that expression t has obtained constantly, sample size is N, so the extreme learning machine mapping matrix that produces is:
Step (5): on-line study process
For t+1 constantly, the quantity of supposing new arrival sample is k, newly arrives corresponding being input as of sample
Be output as
So the extreme learning machine mapping matrix that is formed by newly arrived sample data is:
T+1 is extreme learning machine weighting parameter W constantly
t+1Upgrade in the following manner:
W
t+1=K
tW
t+K
tA
t -1H(X
IC)
TY
IC
Wherein:
K
t=I-A
t -1H(X
IC)
T[H(X
IC)A
t -1H(X
IC)
T+I
k×k]
-1H(X
IC)
A
t+1 -1=K
tA
t -1
I
K * kIt is 1 unit matrix for diagonal line;
K
t, A
t -1Be the intermediate variable of introducing, upgrade rear weighting parameter W thereby simplify
t+1Expression-form;
Step (6): training process stops
After all training datas all participated in training, training process stopped, the extreme learning machine weighting parameter W after this moment, the output training was completed;
Step (7): the online application
Suppose that the test sample book quantity that need to carry out the lithographic line width prediction is Nt
est, train the extreme learning machine model parameter W that obtains, carry out according to the following formula the intelligent predicting of lithographic line width:
X wherein
TestBe input corresponding to sample to be predicted,
Be the predicted value of photoetching district live width, H (X
Test) expression-form is as follows:
Put forward the methods process flow diagram of the present invention as shown in Figure 1.
Based on the above-mentioned line modeling method that proposes, the present invention has done a large amount of l-G simulation tests, because length is limit, only provides this invention here and is applied to actual effect in the lithographic line width forecasting process.Data inputs is comprised of 29 dimension data, is mainly the quality control value, wire width measuring value and the photoresist thickness that are in exposure dose corresponding to front 5 lot of identical processing level, same breed, focal length of photoetching machine, exposure dose with lot to be predicted; And quality control value and the photoresist thickness of the exposure dose of current lot to be predicted, focal length of photoetching machine, exposure dose.Data are taken from the industry spot data between 2012-2-9 to 2012-7-16, and totally 2250, arbitrarily choose wherein 1000 as test data, remaining 1250 as training data.
The correlation parameter value is as shown in the table.
Table 1 parameter value table
The present invention and on-line Algorithm OS-ELM preferably (online order limit learning machine) and Fixed-LSSVM (fixed size least square method supporting vector machine) compare, and comparative result is as shown in table 2
Table 2LS-IELM and OS-ELM, Fixed-LSSVM algorithm performance comparative result
As can be seen from the table, the on-line Algorithm that the present invention proposes is compared OS-ELM, Fixed-LSSVM and is had better measuring accuracy, therefore has better generalization ability.
Fig. 2 has provided the graph of errors between all test data predicted values and actual value, can see that all predicated errors all between [0.1,0.1], satisfy the regulating scope requirement of actual lithographic line width.
Claims (1)
1. based on the lithographic line width Intelligent Forecasting of dimensionality reduction and increment type extreme learning machine, it is characterized in that, described method is to realize according to the following steps successively on computers:
Step (1): Model Selection and parameter initialization
For a given N sample, its input is designated as
X wherein
iRepresent every i sample, by the vector that 29 dimension data form, this vector comprises following parameter: be in quality control value, wire width measuring value and the photoresist thickness of exposure dose corresponding to front 5 lot of identical processing level, same breed, focal length of photoetching machine, exposure dose with lot to be predicted; The quality control value of the exposure dose of current lot to be predicted, focal length of photoetching machine, exposure dose and photoresist thickness; N the corresponding output of sample input is designated as
y
iBe the lithographic line width measured value;
The number of hidden nodes L of given extreme learning machine based on structural risk minimization adopts radial basis function as the eigentransformation function, and functional form is
A wherein
i, b
iBe the parameter of radial basis function, a
iDimension is 29 dimensions, and it can be chosen from [1 1] at random, b
iBe 1 the dimension, value be from
Choose at random;
So the extreme learning machine Feature Mapping matrix H (X) of generation is:
Step (2): algorithm initialization
For moment t, the weighting parameter W of increment type extreme learning machine
tInitialization value is:
Wherein:
X
tThe sample that expression t has obtained constantly, sample size is N, so the extreme learning machine mapping matrix that produces is:
V adopts empirical value for the compromise coefficient, is taken as 2
-15
Step (3): on-line study process
For t+1 constantly, the quantity of supposing new arrival sample is k, newly arrives corresponding being input as of sample
Be output as
So the extreme learning machine mapping matrix that is formed by newly arrived sample data is:
T+1 is extreme learning machine weighting parameter W constantly
t+1Upgrade in the following manner:
W
t+1=K
tW
t+K
tA
t -1H(X
IC)
TY
IC
Wherein:
K
t=I-A
t -1H(X
IC)
T[H(X
IC)A
t -1H(X
IC)
T+I
k×k]
-1H(X
IC)
A
t+1 -1=K
tA
t -1
I
K * kIt is 1 unit matrix for diagonal line;
K
t, A
t -1Be the intermediate variable of introducing, upgrade rear weighting parameter W thereby simplify
t+1Expression-form;
Step (4): training process stops
After all training datas all participated in training, training process stopped, the extreme learning machine weighting parameter W after this moment, the output training was completed;
Step (5): the online application
Suppose that the test sample book quantity that need to carry out the lithographic line width prediction is N
Test, train the extreme learning machine model parameter W that obtains, carry out according to the following formula the intelligent predicting of lithographic line width:
X wherein
TestBe input corresponding to sample to be predicted,
Be the predicted value of photoetching district live width, H (X
Test) expression-form is as follows:
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210543771.6A CN103106331B (en) | 2012-12-17 | 2012-12-17 | Based on the lithographic line width Intelligent Forecasting of dimensionality reduction and increment type extreme learning machine |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210543771.6A CN103106331B (en) | 2012-12-17 | 2012-12-17 | Based on the lithographic line width Intelligent Forecasting of dimensionality reduction and increment type extreme learning machine |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103106331A true CN103106331A (en) | 2013-05-15 |
CN103106331B CN103106331B (en) | 2015-08-05 |
Family
ID=48314185
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201210543771.6A Expired - Fee Related CN103106331B (en) | 2012-12-17 | 2012-12-17 | Based on the lithographic line width Intelligent Forecasting of dimensionality reduction and increment type extreme learning machine |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103106331B (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104503420A (en) * | 2014-09-19 | 2015-04-08 | 北京化工大学 | Non-linear process industry fault prediction method based on novel FDE-ELM and EFSM |
CN104536412A (en) * | 2014-12-23 | 2015-04-22 | 清华大学 | Photoetching procedure dynamic scheduling method based on index forecasting and solution similarity analysis |
CN106845144A (en) * | 2017-03-17 | 2017-06-13 | 泉州装备制造研究所 | A kind of trend prediction method excavated based on industrial big data |
CN107346286A (en) * | 2017-07-03 | 2017-11-14 | 武汉大学 | A kind of Software Defects Predict Methods based on core principle component analysis and extreme learning machine |
CN107423547A (en) * | 2017-04-19 | 2017-12-01 | 江南大学 | Increment type location algorithm based on the semi-supervised learning machine that transfinites |
CN107563398A (en) * | 2016-06-30 | 2018-01-09 | 中国矿业大学 | A kind of scenery picture multiple labeling method and system based on the very fast learning machine of multilayer |
TWI757855B (en) * | 2019-09-06 | 2022-03-11 | 荷蘭商Asml荷蘭公司 | Method for increasing certainty in parameterized model predictions |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101807046A (en) * | 2010-03-08 | 2010-08-18 | 清华大学 | Online modeling method based on extreme learning machine with adjustable structure |
CN102708381A (en) * | 2012-05-09 | 2012-10-03 | 江南大学 | Improved extreme learning machine combining learning thought of least square vector machine |
-
2012
- 2012-12-17 CN CN201210543771.6A patent/CN103106331B/en not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101807046A (en) * | 2010-03-08 | 2010-08-18 | 清华大学 | Online modeling method based on extreme learning machine with adjustable structure |
CN102708381A (en) * | 2012-05-09 | 2012-10-03 | 江南大学 | Improved extreme learning machine combining learning thought of least square vector machine |
Non-Patent Citations (2)
Title |
---|
谭建辉: "径向基函数神经网络的再学习算法及其应用", 《微电子学与计算机》 * |
郝井华 等: "一种基于LLM的高维时间序列数据异常检测方法", 《控制工程》 * |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104503420A (en) * | 2014-09-19 | 2015-04-08 | 北京化工大学 | Non-linear process industry fault prediction method based on novel FDE-ELM and EFSM |
CN104503420B (en) * | 2014-09-19 | 2017-02-15 | 北京化工大学 | Non-linear process industry fault prediction method based on novel FDE-ELM and EFSM |
CN104536412A (en) * | 2014-12-23 | 2015-04-22 | 清华大学 | Photoetching procedure dynamic scheduling method based on index forecasting and solution similarity analysis |
CN107563398A (en) * | 2016-06-30 | 2018-01-09 | 中国矿业大学 | A kind of scenery picture multiple labeling method and system based on the very fast learning machine of multilayer |
CN106845144A (en) * | 2017-03-17 | 2017-06-13 | 泉州装备制造研究所 | A kind of trend prediction method excavated based on industrial big data |
CN107423547A (en) * | 2017-04-19 | 2017-12-01 | 江南大学 | Increment type location algorithm based on the semi-supervised learning machine that transfinites |
CN107346286A (en) * | 2017-07-03 | 2017-11-14 | 武汉大学 | A kind of Software Defects Predict Methods based on core principle component analysis and extreme learning machine |
CN107346286B (en) * | 2017-07-03 | 2020-05-12 | 武汉大学 | Software defect prediction method based on kernel principal component analysis and extreme learning machine |
TWI757855B (en) * | 2019-09-06 | 2022-03-11 | 荷蘭商Asml荷蘭公司 | Method for increasing certainty in parameterized model predictions |
Also Published As
Publication number | Publication date |
---|---|
CN103106331B (en) | 2015-08-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103106331B (en) | Based on the lithographic line width Intelligent Forecasting of dimensionality reduction and increment type extreme learning machine | |
CN106022521B (en) | Short-term load prediction method of distributed BP neural network based on Hadoop architecture | |
CN106874581A (en) | A kind of energy consumption of air conditioning system in buildings Forecasting Methodology based on BP neural network model | |
CN112288164B (en) | Wind power combined prediction method considering spatial correlation and correcting numerical weather forecast | |
CN104636985A (en) | Method for predicting radio disturbance of electric transmission line by using improved BP (back propagation) neural network | |
CN107274038A (en) | A kind of LSSVM Prediction of annual electricity consumption methods optimized based on ant lion | |
CN103942461A (en) | Water quality parameter prediction method based on online sequential extreme learning machine | |
CN108021773B (en) | DSS database-based distributed hydrological model multi-field secondary flood parameter calibration method | |
CN103793887B (en) | Short-term electric load on-line prediction method based on self-adaptive enhancement algorithm | |
CN109726503A (en) | Missing data complementing method and device | |
CN110059867B (en) | Wind speed prediction method combining SWLSTM and GPR | |
CN104217258B (en) | A kind of electric load sigma-t Forecasting Methodology | |
CN101825622A (en) | Water quality prediction method and device | |
CN102682345A (en) | Traffic flow prediction method based on quick learning neural network with double optimal learning rates | |
CN106933649A (en) | Virtual machine load predicting method and system based on rolling average and neutral net | |
CN103778482A (en) | Aquaculture dissolved oxygen short-term prediction method based on multi-scale analysis | |
CN107704962A (en) | A kind of smelter steam flow interval prediction method based on imperfect time series data collection | |
CN104037761B (en) | AGC power multi-target random optimization distribution method | |
CN109599866B (en) | Prediction-assisted power system state estimation method | |
CN109472105A (en) | Semiconductor product yield Upper bound analysis method | |
CN103268525A (en) | WD-RBF (wavelet denoising-radial basis function)-based analogue prediction method of hydrological time sequence | |
CN109325613B (en) | Method for online predicting static voltage stability margin by using parallel sequential extreme learning machine | |
CN107844658A (en) | The steering wheel trend prediction method that Method Using Relevance Vector Machine merges with autoregressive moving average | |
CN112686693A (en) | Method, system, equipment and storage medium for predicting marginal electricity price of electric power spot market | |
CN109376911A (en) | A kind of micro-capacitance sensor short-term load forecasting method based on EMD-KELMs-SDPSO |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150805 Termination date: 20181217 |