CN109189599A - A kind of method and apparatus improving SCADA system real time data dump stability - Google Patents

A kind of method and apparatus improving SCADA system real time data dump stability Download PDF

Info

Publication number
CN109189599A
CN109189599A CN201810898838.5A CN201810898838A CN109189599A CN 109189599 A CN109189599 A CN 109189599A CN 201810898838 A CN201810898838 A CN 201810898838A CN 109189599 A CN109189599 A CN 109189599A
Authority
CN
China
Prior art keywords
dump
data
task
real time
breakpoint
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810898838.5A
Other languages
Chinese (zh)
Other versions
CN109189599B (en
Inventor
杭小林
王学博
高松领
***
屈利康
缪博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xinzhi Energy System Control Co Ltd
Original Assignee
Xinzhi Energy System Control Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xinzhi Energy System Control Co Ltd filed Critical Xinzhi Energy System Control Co Ltd
Priority to CN201810898838.5A priority Critical patent/CN109189599B/en
Publication of CN109189599A publication Critical patent/CN109189599A/en
Application granted granted Critical
Publication of CN109189599B publication Critical patent/CN109189599B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0736—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in functional embedded systems, i.e. in a data processing system designed as a combination of hardware and software dedicated to performing a certain function
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0766—Error or fault reporting or storing
    • G06F11/0778—Dumping, i.e. gathering error/state information after a fault for later diagnosis

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The embodiment of the invention discloses a kind of raising SCADA system real time data dump stability approach and devices, this method comprises: establishing SCADA system real time data dump task queue, including the first dump task T1 and the second dump task T2；Real time data is acquired respectively by the first dump task T1 and the second dump task T2 is stored in corresponding buffered data file；It is weighed by the first dump task T1 application acquisition data dump and executes normal data dump；When the first dump task T1 breaks down during carrying out data dump, according to fault type, continuity or temporary breakpoint transmission are carried out according to the real time data stored in the second buffered data file by the second dump task T2, realize that automatic fault is restored.The example scheme solves data intermittent problem caused by fault in SCADA system real time data dump procedure, improves the stability of SCADA system real time data dump.

Description

A kind of method and apparatus improving SCADA system real time data dump stability
Technical field
The present embodiments relate to data dump technology, espespecially a kind of raising SCADA system real time data dump stability Method and apparatus.
Background technique
Field of industrial automation control, it is common to use SCADA (Supervisory Control And Data The acquisition of Acquisition data is controlled with monitoring) acquisition data and monitoring site running equipment, in-site installation have all kinds of instrument and Communication apparatus, SCADA system is acquired by communications protocol and obtains data, because of SCADA system itself data with existing store function, because This can be realized by SCADA system software module and the historical data trend of required monitoring data item checked and analyzed, and because Upper layer data analysis module need bottom data carry out calculate and analysis obtain the total amounts such as every continuous data, operating index According to needing to be accessed the data by the real-time dump basic data of SCADA system to relational database by upper application software and counted Business diagnosis is carried out after calculation.
SCADA system real time data dump running environment generally comprises: SCADA server run SCADA software systems and Real time data dump program(me), database server operation relevant database, application server run upper layer industrial application software Deng.
SCADA software systems acquire real time data from field device, and real time data dump program(me) is logical by interface or routine It interrogates protocol access real-time data base and obtains data, be supplied to the addressable relational database data of upper layer industrial application software.
Currently, the common data dump measure of SCADA system includes:
(1) ADO data processing script
SCADA timing script embeds ADO data processing script, and history library directly is written in real-time SCADA variable data.
ADO (ActiveX Data Objects): a kind of program object, for indicating the data structure in customer data base With the data for being included, table and inquiry, inspection database or access external data source are created or modified using ADO object.
(2) ODBC data dump component
The mode that ODBC data dump component obtains data is to access internal interface by SCADA producer SDK, will be counted in real time It is dumped in relational database according to according to certain format timing by ODBC mode.
ODBC (Open Database Connectivity Open Database Connection) is Microsoft's open services architecture A group in relation to database in (WOSA, Windows Open Services Architecture Windows Open service architecture) At part, it establishes one group of specification, and provides one group of standard API (application programming interface) to database access.
SDK (Software Development Kit Software Development Tools) is some to be used for by software engineer to be specific The creation application software such as software package, software frame, hardware platform, operating system developing instrument set, this patent uses It is the application programming interfaces API that SCADA software vendor provides, SCADA real-time data base is accessed by the interface.
(3) OPC data acquisition and storage software
OPC data acquisition and storage software is disposed, which obtains SCADA real time data by OPC mode, by the software Simultaneously relational database is written by ODBC mode in timing acquiring real time data.
OPC (the object connection and insertion of OLE for Process Control process control) is public based on Microsoft Take charge of COM/DCOM (Distributed Component Object Model) technology and DNA (Distributed internet Application distribution Formula internet application) framework, the specification designed to solve the communication standard between field management layer and process control station, It provides process management applications and live automatic control system and equipment carries out a kind of standard mechanism of data communication.
However, current SCADA system data dump has the disadvantage in that
(1) ADO data processing script
Because ADO script complexity and maintenance are inconvenient, and operational process will affect SCADA system software operation efficiency.
(2) using often there is loss of data in ODBC data dump component or OPC data acquisition and storage software process Phenomenon:
When ODBC component dump occurs abnormal, data can be interrupted temporarily；
Database access is abnormal, and interim interrupt occur in data；
Database maintenance or migration, data occur interrupted；There are abnormal (data in OPC acquisition and storage software storing data Failure, Network Abnormal etc. is written in library), data can be interrupted temporarily；
Because of database migration, SCADA system upgrading need to reconfigure or upgrade maintenance OPC data acquisition and storage software, It resets Configuration Data and item and restarts software and cause loss of data.Wherein, SCADA system upgrading may include SCADA system data Acquisition project adjustment upgrading, OPC data acquisition and storage software configuration item and software upgrading.
In view of the above-mentioned problems, solution common at present is as follows:
By monitoring process, whether abnormal, detection data stops dump, restarting and activation to Traditional solutions Software function, the pedestrian that goes forward side by side are maintenance and completion data (inquiry SCADA history library data record, artificial polishing).But current There are still following problems for these solutions:
(1) there is interrupted, polishing heavy workload for a long time in data；
(2) partial data is not complete, and there are deviations for the result for causing timing data to calculate；
(3) data maintenance is at high cost；
(4) it influences upper layer data and calculates and analyze processing application function；
(5) increase the work complexity of Data Migration.
Summary of the invention
In order to solve the above-mentioned technical problem, the embodiment of the invention provides a kind of acquisitions of raising data controls with monitoring The method and apparatus of SCADA system real time data dump stability, the number after capable of preventing data dump from breaking down in the process According to interrupted, the failure of the initiations such as program mal, upgrading and database migration is avoided not restore automatically, polishing historical data row To guarantee being sequentially written in for data dump, to improve the stability of SCADA system real time data dump.
In one embodiment of the present of invention, provide:
(1) it is a kind of improve SCADA system real time data dump stability method, may include:
Establish SCADA system real time data dump task queue；It is included at least in the real time data dump task queue: First dump task T1 and the second dump task T2；
Start the first dump task T1 and the second dump task T2, and passes through the first dump task respectively T1 and the second dump task T2 uninterrupted sampling real time data are stored in corresponding first buffered data file and the second buffering Data file；
Data dump power is obtained by the first dump task T1 application, and executes normal data dump, it will be described Real time data is written in preset relational database；
When the first dump task T1 breaks down during carrying out data dump, according to fault type, by institute It states the second dump task T2 and continuity or temporary disconnected is carried out according to the real time data that stores in the second buffered data file Point resumes, and realizes that automatic fault is restored.
In other numerous embodiments of the invention:
(2) method of the raising SCADA system real time data dump stability according to (1), wherein the foundation SCADA system real time data dump task queue may include:
Dump task allocation list is set；
The first dump task T1 and the second dump task T2 are configured in the dump task allocation list；
Wherein, the dump task allocation list includes: mission number and acquisition and dump configuration information；Described first turn The mission number of storage task T1 and the second dump task T2 are different, and the acquisition and dump configuration information are all the same.
(3) method of the raising SCADA system real time data dump stability according to (2), wherein it is described acquisition and Dump configuration information may include one or more of: task names, task type, data acquisition and dump program(me) path, Data acquisition and dump program(me) title, acquisition tasks number and dump purpose data table name.
The method can also include: the setting described first after establishing SCADA system real time data dump task queue The main and standby relation of dump task T1 and the second dump task T2；
Wherein, the first dump task T1 is main task, and the second dump task T2 is standby task.
(4) method of the raising SCADA system real time data dump stability according to (1), wherein the starting institute It states the first dump task T1 and the second dump task T2 may include:
Be respectively started the acquisition of corresponding with the first dump task T1 the first data and dump program(me) A1, and with institute State the corresponding second data acquisition of the second dump task T2 and dump program(me) A2；
Simultaneously by first data acquisition and dump program(me) A1 and second data acquisition and dump program(me) A2 access Operation information is recorded to preset tasks synchronization table Y1.
(5) method of the raising SCADA system real time data dump stability according to (4), wherein the task is same Step table Y1 may include: task encoding, task status, state change time, data dump time point；
Wherein, the task encoding includes: the second coding M2 for representing the first coding M1 of main task and representing standby task；
The task status includes: operating status X1, malfunction X2, application status X3, resumes state X4 and work shape State X5.
It is described that data dump power is obtained by the first dump task T1 application, and normal data dump is executed, it will The real time data is written in preset relational database
By first data acquisition and dump program(me) A1, first dump in the tasks synchronization table Y1 is set The task status of task T1 is application status X3, to apply for the data dump power；
After obtaining the data dump power, normal data is executed by first data acquisition and dump program(me) A1 and is turned Collected real time data is written in preset relationship library tables of data W1 storage task process；And by the tasks synchronization table Y1 In task status setting be in working condition X5, update the data dump time point and the state change time.
(6) method of the raising SCADA system real time data dump stability according to (5), wherein the failure classes Type includes any of the following or a variety of: failure caused by dump program(me) faults itself, program upgrade and database migration cause Failure.
(7) method of the raising SCADA system real time data dump stability according to (6), wherein when the failure It is described according to fault type when type is the dump program(me) faults itself, by the second dump task T2 according to described the The real time data stored in two buffered data files carries out continuity or temporary breakpoint transmission includes:
Judge that first dump is appointed by the task status of the tasks synchronization table Y1 by the second dump task T2 The failure of business T1 simultaneously applies obtaining data dump power；Data dump time point and state change time from the tasks synchronization table Y1 Obtain the first data breakpoint B1 of the first dump task T1；Extract from the second buffered data file includes described the The continuous data queue and execution of one data breakpoint B1 resumes process, to carry out breakpoint transmission；
When the second dump task T1 is without failure, continue to be continued by the second dump task T2 progress breakpoint It passes；Alternatively, applying for the number again by the first dump task T1 when the failure of the first dump task T1 has been excluded It is weighed according to dump, and obtains the second data breakpoint B2 of the second dump task T2, according in the first buffered data file The real time data of storage carries out breakpoint transmission.
(8) method of the raising SCADA system real time data dump stability according to (6), wherein when the failure It is described according to fault type when type is failure caused by program upgrades, by the second dump task T2 according to described second The real time data stored in buffered data file carries out continuity or temporary breakpoint transmission includes:
Judge that first dump is appointed by the task status of the tasks synchronization table Y1 by the second dump task T2 The failure of business T1 simultaneously applies obtaining data dump power；Data dump time point and state change time from the tasks synchronization table Y1 Obtain the third data breakpoint B3 of the first dump task T1；Extract from the second buffered data file includes described the The continuous data queue and execution of three data breakpoint B3 resumes process, to carry out breakpoint transmission；
When the first dump task T1 does not upgrade completion, continue to be continued by the second dump task T2 progress breakpoint It passes；When the first dump task T1 has upgraded completion, the data dump is applied for by the first dump task T1 again Power, and the 4th data breakpoint B4 of the second dump task T2 is obtained, according to what is stored in the first buffered data file Real time data carries out breakpoint transmission.
(9) method of the raising SCADA system real time data dump stability according to (6), wherein when the failure It is described according to fault type when type is failure caused by database migration, by the second dump task T2 according to described the The real time data stored in two buffered data files carries out continuity or temporary breakpoint transmission includes:
When the relational database migrates, the first dump task T1 carries out corresponding first configuration information more When newly, so that data dump process breaks down, by the second dump task T2 according to the migration and first dump The data breakpoint that task T1 is generated is stored in real time data collected into the first buffered data file incessantly, with reality Existing breakpoint transmission, automatic fault are restored；
When the first dump task T1 completes first configuration information update, the second dump task T2 is because described in When migration carries out corresponding second configuration information update, the first dump task T1 is generated according to the second dump task T2 Data breakpoint real time data collected is stored in the first buffered data file, and will first buffered data it is literary In relational database after the data write-in migration stored in part, to realize breakpoint transmission.
In another embodiment of the invention, provide:
(10) a kind of device for improving data acquisition with monitoring control SCADA system real time data dump stability, comprising: Processor and computer readable storage medium are stored with instruction in the computer readable storage medium, wherein work as described instruction When being executed by the processor, the method for realizing above-mentioned raising SCADA system real time data dump stability.
The embodiment of the present invention includes: establish SCADA system real time data dump task queue；The real time data dump is appointed It is included at least in business queue: the first dump task T1 and the second dump task T2；Start the first dump task T1 and described Second dump task T2, and it is real-time by the first dump task T1 and the second dump task T2 uninterrupted sampling respectively Data are stored in corresponding first buffered data file and the second buffered data file；It is obtained by the first dump task T1 application It takes data dump to weigh, and executes normal data dump, the real time data is written in the tables of data of preset relationship library；When When the first dump task T1 breaks down during carrying out data dump, according to fault type, by second dump Task T2 carries out continuity or temporary breakpoint transmission according to the real time data stored in the second buffered data file, realizes Automatic fault is restored.By the example scheme, data caused by fault in SCADA system real time data dump procedure are solved Intermittent problem, the data realized after breaking down during preventing data dump are interrupted, avoid program mal, upgrading sum number It can not restore automatically according to the failure of the initiations such as library migration, polishing historical data behavior, ensure that being sequentially written in for data dump, from And improve the stability of SCADA system real time data dump.
The other feature and advantage of the embodiment of the present invention will illustrate in the following description, also, partly from explanation It is become apparent in book, or understand through the implementation of the invention.The objectives and other advantages of the invention can be by illustrating Specifically noted structure is achieved and obtained in book, claims and attached drawing.
Detailed description of the invention
Attached drawing is used to provide one for further understanding technical solution of the embodiment of the present invention, and constituting specification Point, it is used to explain the present invention the technical solution of embodiment together with embodiments herein, does not constitute to the embodiment of the present invention The limitation of technical solution.
Fig. 1 is the acquisition of raising data and monitoring control SCADA system real time data dump stability of the embodiment of the present invention Method flow diagram；
Fig. 2 is the SCADA system real time data dump method structural schematic diagram of the embodiment of the present invention；
Fig. 3 is the method flow diagram of starting the first dump task T1 and the second dump task T2 of the embodiment of the present invention；
Fig. 4 is the embodiment of the present invention by the first dump task T1 application acquisition data dump power, and executes normal number According to the method flow diagram of dump；
Fig. 5 is the embodiment of the present invention when fault type is dump program(me) faults itself, according to fault type, by second Dump task T2 carries out the method flow diagram of continuity or temporary breakpoint transmission；
Fig. 6 is the embodiment of the present invention when fault type is dump program(me) faults itself, and the event of the first dump task T1 When barrier has excluded, the method flow diagram of breakpoint transmission is carried out by the first dump task T1；
Fig. 7 is the embodiment of the present invention when fault type is failure caused by program upgrades, according to fault type, by the Two dump task T2 carry out the method flow diagram of continuity or temporary breakpoint transmission；
When Fig. 8 is the failure caused by fault type is database migration of the embodiment of the present invention, according to fault type, by Second dump task T2 carries out the method flow diagram of continuity or temporary breakpoint transmission；
Fig. 9 is that the second dump task T2 of the embodiment of the present invention is generated according to database migration and the first dump task T1 Data breakpoint is stored in the method flow diagram before real time data into the first buffered data file；
Figure 10 is that the first dump task T1 of the embodiment of the present invention will according to the data breakpoint that the second dump task T2 is generated Real time data collected is stored in the first buffered data file, and the data stored in the first buffered data file write-in is moved Method flow diagram before in relationship library tables of data after shifting；
Figure 11 is the device composition block diagram of the raising SCADA system real time data dump stability of the embodiment of the present invention.
Specific embodiment
Understand in order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with attached drawing pair The embodiment of the present invention is described in detail.It should be noted that in the absence of conflict, embodiment and reality in the application The feature applied in example can mutual any combination.
Step shown in the flowchart of the accompanying drawings can be in a computer system such as a set of computer executable instructions It executes.Also, although logical order is shown in flow charts, and it in some cases, can be to be different from herein suitable Sequence executes shown or described step.
Embodiment one
A method of data acquisition and monitoring control SCADA system real time data dump stability being improved, as shown in Figure 1, Figure 2 It is shown, may include S101-S104:
S101, SCADA system real time data dump task queue is established；In the real time data dump task queue at least It include: the first dump task T1 and the second dump task T2；
S102, starting the first dump task T1 and the second dump task T2, and pass through described first turn respectively Storage task T1 and the second dump task T2 uninterrupted sampling real time data are stored in corresponding first buffered data file and the Two buffered data files；
S103, data dump power is obtained by the first dump task T1 application, and execute normal data dump, it will The real time data is written in preset relational database；
S104, when the first dump task T1 breaks down during carrying out data dump, according to fault type, By the second dump task T2 according to the real time data progress continuity stored in the second buffered data file or temporarily Property breakpoint transmission, realize automatic fault restore.
In embodiments of the present invention, it in order to solve the problems, such as proposed in background technique, establishes SCADA system and counts in real time According to dump task queue, multiple data acquisitions and dump program(me) are run parallel, software synchronization operating mechanism is established, online fortune is provided Failure logging and redundancy processing are realized in row backup functionality, data acquisition or when dump exception, being capable of larger raising SCADA system The stability of real time data dump.
Embodiment two
The embodiment on the basis of example 1, gives and establishes SCADA system real time data dump task queue A kind of specific embodiment.
In embodiments of the present invention, described to establish SCADA system real time data dump task queue and may include:
Dump task allocation list is set；
The first dump task T1 and the second dump task T2 are configured in the dump task allocation list；
Wherein, the dump task allocation list includes: mission number and acquisition and dump configuration information；Described first turn The mission number of storage task T1 and the second dump task T2 are different, and the acquisition and dump configuration information are all the same.
In embodiments of the present invention, dump task allocation list C2 can be set, configure two in dump task allocation list C2 A dump task is respectively the first dump task T1 and the second dump task T2.First dump task T1 and the second dump task T2 Mission number it is different, acquire identical with dump configuration information.
In embodiments of the present invention, the acquisition and dump configuration information may include one or more of: task name Title, task type, data acquisition and dump program(me) path, data acquisition and dump program(me) title, acquisition tasks are numbered and are turned Store up purpose data table name.
In embodiments of the present invention, dump task allocation list C2 may include mission number, task names, task type, Data acquisition and dump program(me) path, data acquisition and dump program(me) title, acquisition tasks number, dump purpose data table name etc. It is one or more in item of information.
In embodiments of the present invention, the method can also include: to establish SCADA system real time data dump task team After column, the main and standby relation of the first dump task T1 and the second dump task T2 are set；Wherein, first dump is appointed Business T1 is main task (M1), and the second dump task T2 is standby task (M2).
In embodiments of the present invention, in dump task allocation list C2, the task class of the first dump task T1 can be set Type is main task (M1), and the task type of the second dump task T2 of setting is standby task (M2).
In embodiments of the present invention, it before establishing SCADA system real time data dump task queue, can preset Acquisition data configuration table C1, to execute continual real-time data acquisition task according to acquisition data configuration table C1.
In embodiments of the present invention, acquiring may include in data configuration table C1 will obtain simultaneously dump from SCADA system Data item information specifically may include following any one or more information: acquisition tasks number, the input and output I O point of acquisition Title, data item title, frequency acquisition, value mode etc..
Embodiment three
The embodiment gives starting the first dump task T1 and institute on the basis of embodiment one or embodiment two State a kind of specific embodiment of the second dump task T2.
In embodiments of the present invention, as shown in figure 3, the starting the first dump task T1 and second dump are appointed Business T2 may include S201-S202:
S201, the first data acquisition corresponding with the first dump task T1 and dump program(me) A1 is respectively started, with And the second data corresponding with the second dump task T2 acquire and dump program(me) A2；
S202, it is visited by first data acquisition and dump program(me) A1 and second data acquisition and dump program(me) A2 It asks and records operation information to preset tasks synchronization table Y1.
In embodiments of the present invention, the first data acquisition corresponding with the first dump task T1 can be write in advance With dump program(me) A1, and the second data corresponding with the second dump task T2 acquisition and dump program(me) A2；Restart When the first dump task T1 and the second dump task T2, the acquisition of the first data and the number of dump program(me) A1 and second can be respectively started It is accessed according to acquisition and dump program(me) A2, program A1 and program A2 and records operation information to task synchronous meter Y1, and logger task Task status in synchronous meter Y1 is X1 (operation) state.
In embodiments of the present invention, the tasks synchronization table Y1 may include: task encoding, task status, state change Time, data dump time point；
Wherein, the task encoding includes: the second coding M2 for representing the first coding M1 of main task and representing standby task；
The task status includes: operating status X1, malfunction X2, application status X3, resumes state X4 and work shape State X5.
In embodiments of the present invention, task encoding (or task type coding) illustrates: M1 (master): main task；M2 (standby): Standby task.That is, referring to that corresponding dump task is main task when M1 is arranged in corresponding task encoding column；It is compiled in corresponding task When code column setting M2, refer to that corresponding dump task is standby task.
In embodiments of the present invention, which can include but is not limited to alphabetical M1 and M2, can also be using except M1 With any number other than M2, letter, character etc..
In embodiments of the present invention, task status illustrates:
X1 (operation): after software starting, the state is written in the task status item of task synchronous meter Y1；
X2 (failure): there is exception in software dump, and the state is written in the task status item of task synchronous meter Y1；
X3 (application): application executes data dump task, when task status is (non-to resume state and inoperative shape not in dump State) or renewal time failed (record of such as renewal time less than 60 seconds), then task status can be updated to application status；
X4 (is resumed): executing breakpoint transmission work；
X5 (work): real-time dump work is executed.
In embodiments of the present invention, the representation of the task status can include but is not limited to alphabetical X1-X5, can be with Using any number in addition to X1-X5, letter, character etc..
In embodiments of the present invention, the implementation of data acquisition and dump task program can choose OPC mode or connect Mouth method of calling.
Example IV
The embodiment gives respectively on the basis of above-mentioned any embodiment through the first dump task T1 and institute The second dump task T2 uninterrupted sampling real time data is stated, corresponding first buffered data file and the second buffered data text are stored in A kind of specific embodiment of part.
In embodiments of the present invention, it can be obtained according to pre-set acquisition data configuration table C1 information from SCADA system Real time data is taken, after data acquisition and dump program(me) starting, which can execute continual real-time data acquisition task.
In embodiments of the present invention, uninterrupted by the first dump task T1 and the second dump task T2 respectively Real time data is acquired, being stored in corresponding first buffered data file and the second buffered data file can specifically include: uninterrupted Execute the collection process K1_1 and write-in buffered data process K3_1 of the first dump task T1；And it uninterruptedly executes the second dump and appoints The collection process K1_2 and write-in buffered data process K3_2 of business T2.
In embodiments of the present invention, the collection process K1_1 and write-in buffered data of the first dump task T1 are uninterruptedly executed Process K3_1 may include: that the first data of the first dump task T1 are acquired with dump program(me) A1 according to acquisition data configuration table C1 List executes collection process K1_1, obtains real time data from SCADA real-time database；K3_1 process is executed, by real time data write-in the One buffered data file F1.
In embodiments of the present invention, the collection process K1_2 and write-in buffered data of the second dump task T2 are uninterruptedly executed Process K3_2 may include: that the second data of the second dump task T2 are acquired with dump program(me) A2 according to acquisition data configuration table C1 List executes collection process K1_2, obtains real time data from SCADA real-time database；K3_2 process is executed, by real time data write-in the Two buffered data file F2.
Embodiment five
The embodiment gives the first dump task T1 application and obtains data dump on the basis of above-mentioned any embodiment A kind of specific embodiment of power.
In embodiments of the present invention, as shown in figure 4, obtaining data dump power by the first dump task T1 application, and Normal data dump is executed, it may include S301-S302 that the real time data, which is written in preset relational database:
S301, described first be arranged in the tasks synchronization table Y1 by first data acquisition and dump program(me) A1 The task status of dump task T1 is application status X3, to apply for the data dump power；
S302, after obtaining data dump power, executed by first data acquisition and dump program(me) A1 normal Collected real time data is written in preset relationship library tables of data W1 data dump task process；And it is the task is same Task status setting in step table Y1 is in working condition X5, updates the data dump time point and the state change time.
In embodiments of the present invention, it can be acquired by the first data and dump program(me) A1 executes data dump power and applied Journey K2_1, so that the first dump task T1 application labeled as main task obtains data dump power.Specifically, can be passed through The corresponding task state that the first dump task T1 in tasks synchronization table Y1 is arranged in the acquisition of one data and dump program(me) A1 is the (Shen X3 Please) state, with request for data dump power.
In embodiments of the present invention, data dump power can also be executed by the acquisition of the second data and dump program(me) A2 first Application process K2_2, so that the second dump task T2 application labeled as secondary task obtains data dump power.It specifically can be with According to practical application scene self-defining, it is not particularly limited herein.
In embodiments of the present invention, after the first dump task T1 obtains data dump power, normal data dump is executed, it will be real When data relationship library tables of data is written, can specifically include: the acquisition of the first data of the first dump task T1 and dump program(me) A1 Normal data dump task process K5_1 is executed, collected real time data is written in tables of data W1, in tasks synchronization table Y1 The task status of first dump task T1 is set as X5 (work) state, updates data dump time point and state change time.The One dump task T1 continues uninterrupted executive dumping task process K5_1.
In embodiments of the present invention, can include but is not limited in tables of data W1 following any one or more: IO is (defeated Enter output) point code, data item title, value and acquisition time etc.
Embodiment six
The embodiment gives several possible generations during data dump on the basis of above-mentioned any embodiment Fault type embodiment.
In embodiments of the present invention, the failure during the data dump can include but is not limited to it is following any one It is or a variety of: failure caused by failure caused by dump program(me) faults itself, program upgrade and database migration.
In embodiments of the present invention, it will elaborate below to every kind of fault type:
(1) the reason of dump task failure scene (dump program(me) faults itself) may include: program exception, data dump Write-in is abnormal.Under the scene, the dump task of failure cannot continue to execute data dump, then can be by another just Normal dump task carries out breakpoint transmission, continues data dump.
(2) data acquisition and dump program(me) upgrading scene (program upgrade caused by failure) --- reason may include: the It is closed before the acquisition of one data and dump program(me) A1 upgrading；
(3) before database migration scene (failure caused by database migration) --- reason may include: database migration It closes.
Embodiment seven
The embodiment gives on the basis of embodiment six based on the first fault type (dump program(me) faults itself) Carry out a kind of specific embodiment of breakpoint transmission.
In embodiments of the present invention, as shown in figure 5, when the fault type is the dump program(me) faults itself, institute State according to fault type, by the second dump task T2 according to the real time data stored in the second buffered data file into Line Continuity or temporary breakpoint transmission may include S401-S402:
S401, described first turn is judged by the task status of the tasks synchronization table Y1 by the second dump task T2 The failure of storage task T1 simultaneously applies obtaining data dump power；From the data dump time point and state change of the tasks synchronization table Y1 Time obtains the first data breakpoint B1 of the first dump task T1；Extract from the second buffered data file includes institute It states the continuous data queue of the first data breakpoint B1 and executes and resume process, to carry out breakpoint transmission；
S402, when the second dump task T1 is without failure, continue broken by the second dump task T2 Point resumes；Alternatively, applying for institute again by the first dump task T1 when the failure of the first dump task T1 has been excluded Data dump power is stated, and obtains the second data breakpoint B2 of the second dump task T2, according to the first buffered data text The real time data stored in part carries out breakpoint transmission.
In embodiments of the present invention, the first data acquisition of the first dump task T1 and dump program(me) A1 execute data dump After task process K5_1 breaks down, the failure logging process K4_1 of the first data acquisition and dump program(me) A1 can be by failure Data time point is recorded in task failure table Y2, and the recovery status items in task failure table Y2 are labeled as not restoring, tasks synchronization The corresponding task status of the first dump task T1 is set as X2 (failure) state in table Y1, and updates the state change time.
In embodiments of the present invention, the first dump task T1 failure, the second dump task T2 execute breakpoint transmission and realize event Hinder recovery process, can specifically include: 1, the second dump task T2 judges the first dump task T1 failure and applies obtaining data Dump power；That is, the second dump task T2 access tasks synchronization table Y1 judges the first dump task T1 failure, the second dump task T2 Apply and obtain data dump power, the corresponding task status of the second dump task T2 is assigned to X3 (application) in tasks synchronization table Y1 State；2, the data breakpoint of the first dump task T1 is obtained from task status table Y1, is labeled as the first data breakpoint B1；3, right First data breakpoint B1 carries out breakpoint transmission, realizes fault recovery；Delay that is, the acquisition of the second data and dump program(me) A2 execute to extract Data procedures K3_2 is rushed, buffered data is extracted from the second buffered data file F2, obtains the company including the first data breakpoint B1 Continuous data queue and execution resume process K5_2, and (this resumes the normal data dump that process K5_2 is also the second dump task T2 and appoints Business process)；After completing breakpoint transmission, the recovery state for changing preset task failure table Y2 is to have restored, and update described appoint The data dump time point of business synchronous meter Y1 and state change time.
In embodiments of the present invention, the acquisition of the second data and dump program(me) A2 uninterruptedly execute data dump task process During K5_2, tables of data W1 is written into collected real time data, the task shape of the second dump task T2 in tasks synchronization table Y1 State is set as X5 (work) state.
In embodiments of the present invention, if executing the normal data dump task process K5_2 phase in the second dump task T2 Between, the failure of the first dump task T1 has excluded, and can continue to execute normal data dump task, then the first dump task T1 It can apply obtaining data dump power again；It is written in tables of data W1 with continuing through the first dump task T1 for real time data.
In embodiments of the present invention, the recovery state in above-mentioned task failure table Y2 can use different status indicators It indicates, which can include but is not limited to numerical value 01 and 02, wherein 01 can indicate not restore, and 02 can indicate Restore；It in other embodiments, can also be using any number in addition to 01 and 02, letter, character etc..
Embodiment eight
The embodiment gives the second dump task T2 and breaks down aftermentioned first turn on the basis of above-described embodiment seven A kind of specific embodiment of storage task T1 progress breakpoint transmission.
In embodiments of the present invention, as shown in fig. 6, it is described when the failure of the first dump task T1 has excluded, by The first dump task T1, which carries out breakpoint transmission according to the real time data stored in the first buffered data file, can wrap Include S501-S504:
S501, described second turn is judged by the task status of the tasks synchronization table Y1 by the first dump task T1 The failure of storage task T2 simultaneously applies obtaining data dump power；
S502, second dump times is obtained from the data dump time point of the tasks synchronization table Y1 and state change time The second data breakpoint B2 of business T2；
S503, the continuous data queue including the second data breakpoint B2 is extracted from the first buffered data file And execute and resume process, to carry out breakpoint transmission；
S504, the recovery state of preset task failure table Y2 is changed to have restored after completing the breakpoint transmission, and more The data dump time point of the new tasks synchronization table Y1 and state change time.
In embodiments of the present invention, the second data acquisition of the second dump task T2 and dump program(me) A2 execute normal number After breaking down according to dump task process K5_2, the failure logging process K4_2 of the second data acquisition and dump program(me) A2 can be with Fault data time point is recorded in task failure table Y2, the recovery status items in task failure table Y2 are labeled as not restoring, appoint The corresponding task status of the second dump task T2 is set as X2 (failure) state in business synchronous meter Y1, and when updating state change Between.
In embodiments of the present invention, the second dump task T2 failure, the first dump task T1 realize failover procedure, tool Body may include: that the 1, first dump task T1 judges the second dump task T2 failure and applies obtaining data dump power；That is, first Dump task T1 access tasks synchronization table Y1 judges the second dump task T2 failure, and the first dump task T1 application simultaneously obtains data Dump is weighed, and the corresponding task status of the first dump task T1 is assigned to X3 (application) state in tasks synchronization table Y1；2, from task The data breakpoint of the second dump task T2 is obtained in state table Y1, is labeled as the second data breakpoint B2；3, to the second data breakpoint B2 carries out breakpoint transmission, realizes fault recovery；That is, the acquisition of the first data and dump program(me) A1 are executed and are extracted buffered data process K3_1 extracts buffered data from the first buffered data file F1, obtains the continuous data queue including the second data breakpoint B2 And it executes and resumes process K5_1 (this resumes the normal data dump task process that process K5_1 is also the first dump task T1)；It is complete After breakpoint transmission, the recovery state of change task failure table Y2 is to have restored, when updating data dump time point and state change Between.
In embodiments of the present invention, the acquisition of the first data and dump program(me) A1 uninterruptedly execute data dump task process During K5_1, tables of data W1 is written into collected real time data, the task shape of the first dump task T1 in tasks synchronization table Y1 State is set as X5 (work) state.
Embodiment nine
The embodiment gives on the basis of embodiment six based on second of fault type (event caused by program upgrading Barrier) carry out breakpoint transmission a kind of specific embodiment.
In embodiments of the present invention, described as shown in fig. 7, when the fault type is failure caused by program upgrades According to fault type, carried out by the second dump task T2 according to the real time data stored in the second buffered data file Continuity or temporary breakpoint transmission may include S601-S602:
S601, described first turn is judged by the task status of the tasks synchronization table Y1 by the second dump task T2 The failure of storage task T1 simultaneously applies obtaining data dump power；From the data dump time point and state change of the tasks synchronization table Y1 Time obtains the third data breakpoint B3 of the first dump task T1；Extract from the second buffered data file includes institute It states the continuous data queue of third data breakpoint B3 and executes and resume process, to carry out breakpoint transmission；
S602, when the first dump task T1 does not upgrade completion, continue broken by the second dump task T2 Point resumes；When the first dump task T1 has upgraded completion, the data are applied for by the first dump task T1 again Dump power, and the 4th data breakpoint B4 of the second dump task T2 is obtained, it is deposited according in the first buffered data file The real time data of storage carries out breakpoint transmission.
In embodiments of the present invention, there may be because rising by the first data acquisition of the first dump task T1 and dump program(me) A1 Grade and caused by the first dump task T1 failure, the first data acquisition and dump program(me) A1 upgrading before, can close first number According to acquisition and dump program(me) A1, the first dump task T1 failure occurs, and forms third data breakpoint B3.
In embodiments of the present invention, the second dump task T2 carries out breakpoint transmission and realizes failover procedure, specifically can be with Include:
1, the second dump task T2 judges the first dump task T1 failure and applies obtaining data dump power；That is, second turn Storage task T2 access tasks synchronization table Y1 judges the first dump task T1 failure, and the second dump task T2 application simultaneously obtains data turn The corresponding task status of the second dump task T2 is assigned to X3 (application) state in Chu Quan, tasks synchronization table Y1；
2, the data breakpoint of the first dump task T1 is obtained from task status table Y1, is labeled as third data breakpoint B3；
3, breakpoint transmission is carried out to third data breakpoint B3, realizes fault recovery；That is, the acquisition of the second data and dump program(me) A2, which is executed, extracts buffered data process K3_2, and buffered data is extracted from the second buffered data file F2, and obtaining includes third number According to breakpoint B 3 continuous data queue and execute resume process K5_2 (this resume process K5_2 be also the second dump task T2 just Regular data dump task process)；After completing breakpoint transmission, the recovery state for changing preset task failure table Y2 is to have restored, And update data dump time point and the state change time of the tasks synchronization table Y1.
In embodiments of the present invention, during the second dump task T2 carries out breakpoint transmission, the first dump task T1's After the completion of the acquisition of first data and dump program(me) A1 upgrading, first data that can resume operation acquisition and dump program(me) A1, i.e., The first dump task T1 applies for the data dump power again, and the 4th data for obtaining the second dump task T2 are disconnected Point B4 executes data dump process K5_1, is based on the 4th number according to the real time data stored in the first buffered data file Breakpoint transmission is carried out according to breakpoint B 4；Tables of data W1 is written into collected real time data, the first dump is appointed in tasks synchronization table Y1 The task status of business T1 is set as X5 (work) state, and the first dump task T1 executes uninterrupted dump procedure K5_1.
In embodiments of the present invention, reason is same as above, the second data acquisition of the second dump task T2 and dump program(me) A2 There may be the second dump task T2 failures caused by due to upgrading, before the acquisition of the second data and dump program(me) A2 upgrading, The acquisition of the second data and dump program(me) A2 can be closed, the second dump task T2 failure occurs, and forms data breakpoint.At this point, restoring The normal first dump task T1 can apply for the data dump power again, and obtain the second dump task T2's Data breakpoint executes data dump process K5_1, and being based on according to the real time data stored in the first buffered data file should Data breakpoint carries out breakpoint transmission；Tables of data W1 is written into collected real time data, the first dump is appointed in tasks synchronization table Y1 The task status of business T1 is set as X5 (work) state, and the first dump task T1 executes uninterrupted dump procedure K5_1.
Embodiment ten
The embodiment gives based on the third fault type (caused by database migration on the basis of embodiment six Failure) carry out breakpoint transmission a kind of specific embodiment.
In embodiments of the present invention, as shown in figure 8, when the fault type be database migration caused by failure when, institute State according to fault type, by the second dump task T2 according to the real time data stored in the second buffered data file into Line Continuity or temporary breakpoint transmission may include S701-S702:
S701, it migrates when the relational database, the first dump task T1 carries out corresponding first and matches confidence Breath updates, when so that data dump process breaking down, by the second dump task T2 according to the migration and described first The data breakpoint that dump task T1 is generated is stored in real time data collected into the first buffered data file incessantly, To realize breakpoint transmission, automatic fault is restored；
S702, first configuration information update, the second dump task T2 are completed as the first dump task T1 When carrying out corresponding second configuration information update because of the migration, the first dump task T1 is according to the second dump task Real time data collected is stored in the first buffered data file by the data breakpoint that T2 is generated, and described first is buffered In relational database after the data write-in migration stored in data file, to realize breakpoint transmission.
In embodiments of the present invention, as shown in figure 9, by the second dump task T2 according to the migration and described the The data breakpoint that one dump task T1 is generated is stored in real-time number collected into the first buffered data file incessantly According to before, the method can also include S801-S802:
S801, described first turn is judged by the task status of the tasks synchronization table Y1 by the second dump task T2 The failure of storage task T1 simultaneously applies obtaining data dump power；
S802, the first data breakpoint B1 is obtained from the data dump time point of the tasks synchronization table Y1 and state change time With the second data breakpoint B2；Wherein, the first data breakpoint B1 is closing relational database before the relational database migration The data breakpoint formed is connected, the second data breakpoint B2 is first data after the completion of the relational database migration Acquisition and dump program(me) A1 carry out the data breakpoint formed when first configuration information update.
In embodiments of the present invention, described to be appointed by the second dump task T2 according to the migration and first dump The data breakpoint that business T1 is generated, which is stored in real time data collected into the first buffered data file incessantly, can wrap It includes:
The continuous real time data queue between the first data breakpoint B1 and the second data breakpoint B2 is obtained, and is deposited It stores up in the first buffered data file.
In embodiments of the present invention, during executing data dump task, there may be the phenomenon that database migration hair It is raw, before database migration, it will usually close database connection, form data breakpoint, i.e., the first above-mentioned data breakpoint B1.Number After completing migration according to library, database recovery is normal, at this point, upgrading and running the first data acquisition of the first dump task T1 and turn Program A1 is stored up, i.e., when the described first data acquisition and dump program(me) A1 update configuration information and restart the first dump task T1 Form new data breakpoint, i.e., the second above-mentioned data breakpoint B2.
In embodiments of the present invention, the first data acquisition of the first dump task T1 and dump program(me) A1 execute data dump After task process K5_1 breaks down, the failure logging process K4_1 of the first data acquisition and dump program(me) A1 can be by failure Data time point is recorded in task failure table Y2, and the recovery status items in task failure table Y2 are labeled as not restoring, tasks synchronization The corresponding task status of the first dump task T1 is set as X2 (failure) state in table Y1, and updates the state change time.
In embodiments of the present invention, the first dump task T1 breaks down because of database migration, and the second dump task T2 is held Failover procedure is realized in row breakpoint transmission, can specifically include: 1, the second dump task T2 judges the first dump task T1 event Hinder and applies obtaining data dump power；That is, the second dump task T2 access tasks synchronization table Y1 judges the first dump task T1 event Barrier, the second dump task T2 application simultaneously obtain data dump power, the second corresponding of dump task T2 in tasks synchronization table Y1 Business state is assigned to X3 (application) state；2, the first data breakpoint B1 and the second data breakpoint are obtained from task status table Y1 B2；3, it carries out realizing fault recovery from the first data breakpoint B1 to the breakpoint transmission of the second data breakpoint B2；That is, Second data acquire and dump program(me) A2 is executed and extracted buffered data process K3_2, obtain the first data breakpoint B1 described in Continuous real time data queue and execution between second data breakpoint B2 resume process K5_2, and (it is also second that this, which resumes process K5_2, The normal data dump task process of dump task T2), by the continuous real time data queue storage to the first buffered data file In F1；After completing breakpoint transmission, the recovery state for changing preset task failure table Y2 is to have restored, and it is same to update the task Walk data dump time point and the state change time of table Y1.
In embodiments of the present invention, as shown in Figure 10, it is produced in the first dump task T1 according to the second dump task T2 Real time data collected is stored in the first buffered data file by raw data breakpoint, and by first buffered data Before in relationship library tables of data after the data write-in migration stored in file, the method can also include S901-S902:
S901, described second turn is judged by the task status of the tasks synchronization table Y1 by the first dump task T1 The failure of storage task T2 simultaneously applies obtaining data dump power；
S902, third data breakpoint is obtained from the data dump time point of the tasks synchronization table Y1 and state change time B3；Wherein, the third data breakpoint B3 is that the second data acquisition and dump program(me) A2 carry out second configuration information The data breakpoint formed when update.
In embodiments of the present invention, the data that the first dump task T1 is generated according to the second dump task T2 are disconnected Real time data collected is stored in the first buffered data file by point, and will be stored in the first buffered data file Data write-in migration after relational database in may include:
The continuous real time data queue between the second data breakpoint B2 and the third data breakpoint B3 is obtained, is stored Into the first buffered data file, and by the first data breakpoint B1 stored in the first buffered data file and In the relational database after data write-in migration between the third data breakpoint B3.
In embodiments of the present invention, after database completes migration, database recovery is normal, can also upgrade at this time and run The second data acquisition of second dump task T2 and dump program(me) A2, i.e. second data acquisition and dump program(me) A2 can also be with It updates configuration information and restarts the second dump task T2, to form new data breakpoint, i.e., above-mentioned third data are disconnected Point B3.
In embodiments of the present invention, the second data acquisition of the second dump task T2 and dump program(me) A2 execute normal number After breaking down according to dump task process K5_2, the failure logging process K4_2 of the second data acquisition and dump program(me) A2 can be with Fault data time point is recorded in task failure table Y2, the recovery status items in task failure table Y2 are labeled as not restoring, appoint The corresponding task status of the second dump task T2 is set as X2 (failure) state in business synchronous meter Y1, and when updating state change Between.
In embodiments of the present invention, the recovery state in above-mentioned task failure table Y2 can use different status indicators It indicates, which can include but is not limited to numerical value 01 and 02, wherein 01 can indicate not restore, and 02 can indicate Restore；It in other embodiments, can also be using any number in addition to 01 and 02, letter, character etc..
In embodiments of the present invention, the second dump task T2 breaks down because of database migration, and the first dump task T1 is held Failover procedure is realized in row breakpoint transmission, can specifically include: 1, the first dump task T1 judges the second dump task T2 event Hinder and applies obtaining data dump power；That is, the first dump task T1 access tasks synchronization table Y1 judges the second dump task T2 event Barrier, the first dump task T1 application simultaneously obtain data dump power, the first corresponding of dump task T1 in tasks synchronization table Y1 Business state is assigned to X3 (application) state；2, the third data breakpoint B3 of the second dump task T2 is obtained from task status table Y1； 3, it carries out from the second data breakpoint B2 to the breakpoint transmission of the third data breakpoint B3, by the real-time data memory of acquisition Into the first buffered data file F1, fault recovery is realized；That is, the acquisition of the first data and dump program(me) A1 execute collection process K1_1 obtains the continuous real time data between the second data breakpoint B2 to the third data breakpoint B3, and executes data Buffering course K3_1, by the continuous real-time data memory into the first buffered data file F1.And execution resumes process K5_1 and (is somebody's turn to do The process K5_1 of resuming is also the normal data dump task process of the first dump task T1), from the first buffered data file F1 The continuous data queue between the first data breakpoint B1 to third data breakpoint B3 is extracted, is stored into relationship library tables of data W1, Realize breakpoint transmission；After completing breakpoint transmission, the recovery state for changing preset task failure table Y2 is to have restored, and update institute State data dump time point and the state change time of tasks synchronization table Y1.
In embodiments of the present invention, it should be noted that during the first dump task T1 is updated and restarts, second It, can also be by the real time data between the first data breakpoint B1 and the second data breakpoint B2 when dump task T2 carries out breakpoint transmission Continue storage into the second buffered data file F2, after the completion of the first dump task T1 updates and restarts, the second dump task During T2 is updated and restarts, the first dump task T1 can obtain the first data breakpoint from the second buffered data file F2 Real time data between B1 and the second data breakpoint is dumped in the tables of data W1 of relationship library, and obtain the second data breakpoint B2 and Real time data between third data breakpoint B3 is stored into the first buffered data file F1, and from the first buffered data file F1 is dumped in the tables of data W1 of relationship library, to realize the smooth migration of relational database in SCADA system.
Embodiment 11
A kind of raising SCADA system real time data dump apparatus 1 may include: as shown in figure 11 processor 11 and calculating Machine readable storage medium storing program for executing 12 is stored with instruction in the computer readable storage medium 12, when described instruction is by the processor 11 when executing, the method for realizing above-mentioned raising SCADA system real time data dump stability.
The embodiment of the present invention includes: establish SCADA system real time data dump task queue；The real time data dump is appointed It is included at least in business queue: the first dump task T1 and the second dump task T2；Start the first dump task T1 and described Second dump task T2, and it is real-time by the first dump task T1 and the second dump task T2 uninterrupted sampling respectively Data are stored in corresponding first buffered data file and the second buffered data file；It is obtained by the first dump task T1 application It takes data dump to weigh, and executes normal data dump, the real time data is written in the tables of data of preset relationship library；When When the first dump task T1 breaks down during carrying out data dump, according to fault type, by second dump Task T2 carries out continuity or temporary breakpoint transmission according to the real time data stored in the second buffered data file, realizes Automatic fault is restored.By the example scheme, solve to occur in SCADA system real time data dump procedure because of software fault Data intermittent problem caused by reason, it is interrupted to realize the data for preventing from occurring after data dumper exception, avoid failure, Upgrading and migration etc. initiations failure can not restore automatically, polishing historical data behavior, ensure that being sequentially written in for data dump, To improve the stability of SCADA system real time data dump.
The embodiment of the present invention is include at least the following beneficial effects:
1, the failure that SCADA system data dump system occurs in the embodiment of the present invention, can reduce the cost of manual maintenance, Guarantee the reasonability and correctness of upper layer application data；
The embodiment of the present invention can be realized break down after breakpoint data buffering and automatic dump function, for guarantee obtain The continuous real-time running data of SCADA system plays preferable Data safeguard function, improves the fault-resistant energy entirely applied Power is reduced the cost of manual maintenance by the self-healing function, can also guarantee the reasonability and correctness of upper layer application data.
2, the embodiment of the present invention is for SCADA system data business integration system, it is often necessary to changed data dump address With the SCADA system upper layer software (applications) of upgrading dump business function, upgrading service can be fast implemented, played stable going through fine The continuous dump function of history data；
Pass through SCADA system real time data dump task on-line redundance, SCADA system real time data dump breakpoint transmission etc. Business function, the present invention is able to solve the business datum breakpoint problem of data acquisition and dump program(me) upgrading, database migration, real Existing business datum restores processing automatically and upgrades effect without breakpoint.
3, by the example scheme, escalation process realizes that data lossless loses for data acquisition and dump program(me) upgrade job: Data dump task passes through the means of on-line redundance, when closing and upgrading a data acquisition and dump program(me) upgrading, system Breakpoint can be judged automatically, realizes breakpoint transmission automatically, realizes that data lossless loses.
4, database migration work realizes that data lossless loses migration: needing to rise after database migration by the example scheme Grade data dump task passes through the migration of sequence operating database, data acquisition and dump program(me) A1 upgrading, data acquisition and dump Program A2 upgrading, is automatically performed breakpoint transmission, guarantees data continuity and accuracy.
It will appreciated by the skilled person that whole or certain steps, system, dress in method disclosed hereinabove Functional module/unit in setting may be implemented as software, firmware, hardware and its combination appropriate.In hardware embodiment, Division between the functional module/unit referred in the above description not necessarily corresponds to the division of physical assemblies；For example, one Physical assemblies can have multiple functions or a function or step and can be executed by several physical assemblies cooperations.Certain groups Part or all components may be implemented as by processor, such as the software that digital signal processor or microprocessor execute, or by It is embodied as hardware, or is implemented as integrated circuit, such as specific integrated circuit.Such software can be distributed in computer-readable On medium, computer-readable medium may include computer storage medium (or non-transitory medium) and communication media (or temporarily Property medium).As known to a person of ordinary skill in the art, term computer storage medium is included in for storing information (such as Computer readable instructions, data structure, program module or other data) any method or technique in the volatibility implemented and non- Volatibility, removable and nonremovable medium.Computer storage medium include but is not limited to RAM, ROM, EEPROM, flash memory or its His memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storages, magnetic holder, tape, disk storage or other Magnetic memory apparatus or any other medium that can be used for storing desired information and can be accessed by a computer.This Outside, known to a person of ordinary skill in the art to be, communication media generally comprises computer readable instructions, data structure, program mould Other data in the modulated data signal of block or such as carrier wave or other transmission mechanisms etc, and may include any information Delivery media.

Claims (10)

1. a kind of method for improving data acquisition with monitoring control SCADA system real time data dump stability, comprising:
Establish SCADA system real time data dump task queue；It is included at least in the real time data dump task queue: first Dump task T1 and the second dump task T2；
Start the first dump task T1 and the second dump task T2, and respectively by the first dump task T1 and The second dump task T2 uninterrupted sampling real time data is stored in corresponding first buffered data file and the second buffered data File；
Data dump power is obtained by the first dump task T1 application, and executes normal data dump, it will be described real-time Data are written in preset relational database；
When the first dump task T1 breaks down during carrying out data dump, according to fault type, by described Two dump task T2 carry out continuity according to the real time data stored in the second buffered data file or temporary breakpoint is continuous It passes, realizes that automatic fault is restored.
2. the method according to claim 1 for improving SCADA system real time data dump stability, which is characterized in that institute It states and establishes SCADA system real time data dump task queue and include:
Dump task allocation list is set；
The first dump task T1 and the second dump task T2 are configured in the dump task allocation list；
Wherein, the dump task allocation list includes: mission number and acquisition and dump configuration information；First dump is appointed The mission number of business T1 and the second dump task T2 is different, and the acquisition and dump configuration information are all the same.
3. the method according to claim 2 for improving SCADA system real time data dump stability, which is characterized in that institute Stating acquisition and dump configuration information includes one or more of: task names, task type, data acquisition and dump program(me) road Diameter, data acquisition and dump program(me) title, acquisition tasks number and dump purpose data table name.
4. the method according to claim 1 for improving SCADA system real time data dump stability, which is characterized in that institute Stating starting the first dump task T1 and the second dump task T2 includes:
It is respectively started the acquisition of corresponding with the first dump task T1 the first data and dump program(me) A1, and with described the The corresponding second data acquisition of two dump task T2 and dump program(me) A2；
It accesses and records by first data acquisition and dump program(me) A1 and second data acquisition and dump program(me) A2 Operation information is to preset tasks synchronization table Y1.
5. the method according to claim 4 for improving SCADA system real time data dump stability, which is characterized in that institute Stating tasks synchronization table Y1 includes: task encoding, task status, state change time, data dump time point；Wherein, the task Coding includes: the second coding M2 for representing the first coding M1 of main task and representing standby task；The task status includes: operation State X1, malfunction X2, application status X3, state X4 and working condition X5 are resumed；
It is described that data dump power is obtained by the first dump task T1 application, and normal data dump is executed, it will be described Real time data is written in preset relational database
By first data acquisition and dump program(me) A1, the first dump task in the tasks synchronization table Y1 is set The task status of T1 is application status X3, to apply for the data dump power；
After obtaining the data dump power, normal data dump is executed by first data acquisition and dump program(me) A1 and is appointed Collected real time data is written in preset relationship library tables of data W1 business process；And it will be in the tasks synchronization table Y1 Task status setting is in working condition X5, updates the data dump time point and the state change time.
6. the method according to claim 5 for improving SCADA system real time data dump stability, which is characterized in that institute It states fault type to include any of the following or a variety of: failure and database caused by dump program(me) faults itself, program upgrade Failure caused by migrating.
7. the method according to claim 6 for improving SCADA system real time data dump stability, which is characterized in that when It is described according to fault type when the fault type is the dump program(me) faults itself, by the second dump task T2 root Continuity is carried out according to the real time data stored in the second buffered data file or temporary breakpoint transmission includes:
The first dump task T1 is judged by the task status of the tasks synchronization table Y1 by the second dump task T2 Failure and apply obtain data dump power；It is obtained from the data dump time point of the tasks synchronization table Y1 and state change time The first data breakpoint B1 of the first dump task T1；Extracting from the second buffered data file includes first number Process is resumed according to the continuous data queue and execution of breakpoint B 1, to carry out breakpoint transmission；
When the second dump task T1 is without failure, continue to carry out breakpoint transmission by the second dump task T2；Or Person applies for that the data turn by the first dump task T1 when the failure of the first dump task T1 has been excluded again Chu Quan, and the second data breakpoint B2 of the second dump task T2 is obtained, it is stored according in the first buffered data file Real time data carry out breakpoint transmission.
8. the method according to claim 6 for improving SCADA system real time data dump stability, which is characterized in that when It is described according to fault type when the fault type is failure caused by program upgrades, by the second dump task T2 according to The real time data stored in the second buffered data file carries out continuity or temporary breakpoint transmission includes:
The first dump task T1 is judged by the task status of the tasks synchronization table Y1 by the second dump task T2 Failure and apply obtain data dump power；It is obtained from the data dump time point of the tasks synchronization table Y1 and state change time The third data breakpoint B3 of the first dump task T1；Extract from the second buffered data file includes the third number Process is resumed according to the continuous data queue and execution of breakpoint B 3, to carry out breakpoint transmission；
When the first dump task T1 does not upgrade completion, continue to carry out breakpoint transmission by the second dump task T2；When When the first dump task T1 has upgraded completion, apply for that the data dump is weighed again by the first dump task T1, and The 4th data breakpoint B4 for obtaining the second dump task T2, according to the real-time number stored in the first buffered data file According to progress breakpoint transmission.
9. the method according to claim 6 for improving SCADA system real time data dump stability, which is characterized in that when It is described according to fault type when the fault type is failure caused by database migration, by the second dump task T2 root Continuity is carried out according to the real time data stored in the second buffered data file or temporary breakpoint transmission includes:
When the relational database migrates, the first dump task T1 carries out corresponding first configuration information update, makes When obtaining the failure of data dump procedure, by the second dump task T2 according to the migration and the first dump task T1 The data breakpoint of generation is stored in real time data collected into the first buffered data file incessantly, to realize breakpoint It resumes, automatic fault is restored；
When the first dump task T1 completes first configuration information update, the second dump task T2 is because of the migration When carrying out corresponding second configuration information update, number that the first dump task T1 is generated according to the second dump task T2 Real time data collected is stored in the first buffered data file according to breakpoint, and will be in the first buffered data file In relational database after the data write-in migration of storage, to realize breakpoint transmission.
10. a kind of device for improving data acquisition with monitoring control SCADA system real time data dump stability, comprising: processing Device and computer readable storage medium are stored with instruction in the computer readable storage medium, which is characterized in that when the finger When enabling by processor execution, raising SCADA system real time data dump as described in any one of claims 1-9 is realized The method of stability.
CN201810898838.5A 2018-08-08 2018-08-08 Method and device for improving real-time data dump stability of SCADA system Active CN109189599B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810898838.5A CN109189599B (en) 2018-08-08 2018-08-08 Method and device for improving real-time data dump stability of SCADA system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810898838.5A CN109189599B (en) 2018-08-08 2018-08-08 Method and device for improving real-time data dump stability of SCADA system

Publications (2)

Publication Number Publication Date
CN109189599A true CN109189599A (en) 2019-01-11
CN109189599B CN109189599B (en) 2021-11-05

Family

ID=64920729

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810898838.5A Active CN109189599B (en) 2018-08-08 2018-08-08 Method and device for improving real-time data dump stability of SCADA system

Country Status (1)

Country Link
CN (1) CN109189599B (en)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1138788A (en) * 1994-12-15 1996-12-25 Abb专利有限公司 Method of highly reliable and consistent message transmission
CN102023876A (en) * 2009-09-14 2011-04-20 漳州科能电器有限公司 Embedded system capable of upgrading software on line and online upgrading method
CN102197319A (en) * 2008-08-25 2011-09-21 沙特***石油公司 Data acquisition in an intelligent oil and gas field
CN102495906A (en) * 2011-12-23 2012-06-13 天津神舟通用数据技术有限公司 Incremental data migration method capable of realizing breakpoint transmission
CN102945195A (en) * 2012-11-26 2013-02-27 国电南瑞科技股份有限公司 Master-standby redundancy replication method based on SQLite databases
CN103559570A (en) * 2013-10-09 2014-02-05 东北电网有限公司 Fault recording master station information management system
US20150293801A1 (en) * 2014-04-15 2015-10-15 Lsis Co., Ltd. Apparatus, system and method for application log data processing
CN105007294A (en) * 2015-05-26 2015-10-28 华北电力大学（保定） System for quickly receiving and distributing power transmission and transformation equipment state monitoring big data
US20160239743A1 (en) * 2015-02-15 2016-08-18 Partdb Inc. Method and apparatus for managing failure modes for condition based maintenance in marine resource production equipment
CN107798062A (en) * 2017-09-20 2018-03-13 中国电力科学研究院 A kind of transformer station's historical data unifies storage method and system
CN108011699A (en) * 2017-12-20 2018-05-08 中国原子能科学研究院 reactor computer monitoring system network architecture method
US20180191867A1 (en) * 2015-01-23 2018-07-05 C3 loT, Inc. Systems, methods, and devices for an enterprise ai and internet-of-things platform

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1138788A (en) * 1994-12-15 1996-12-25 Abb专利有限公司 Method of highly reliable and consistent message transmission
CN102197319A (en) * 2008-08-25 2011-09-21 沙特***石油公司 Data acquisition in an intelligent oil and gas field
CN102023876A (en) * 2009-09-14 2011-04-20 漳州科能电器有限公司 Embedded system capable of upgrading software on line and online upgrading method
CN102495906A (en) * 2011-12-23 2012-06-13 天津神舟通用数据技术有限公司 Incremental data migration method capable of realizing breakpoint transmission
CN102945195A (en) * 2012-11-26 2013-02-27 国电南瑞科技股份有限公司 Master-standby redundancy replication method based on SQLite databases
CN103559570A (en) * 2013-10-09 2014-02-05 东北电网有限公司 Fault recording master station information management system
US20150293801A1 (en) * 2014-04-15 2015-10-15 Lsis Co., Ltd. Apparatus, system and method for application log data processing
CN105022774A (en) * 2014-04-15 2015-11-04 Ls产电株式会社 Apparatus, system and method for application log data processing
US20180191867A1 (en) * 2015-01-23 2018-07-05 C3 loT, Inc. Systems, methods, and devices for an enterprise ai and internet-of-things platform
US20160239743A1 (en) * 2015-02-15 2016-08-18 Partdb Inc. Method and apparatus for managing failure modes for condition based maintenance in marine resource production equipment
CN105007294A (en) * 2015-05-26 2015-10-28 华北电力大学（保定） System for quickly receiving and distributing power transmission and transformation equipment state monitoring big data
CN107798062A (en) * 2017-09-20 2018-03-13 中国电力科学研究院 A kind of transformer station's historical data unifies storage method and system
CN108011699A (en) * 2017-12-20 2018-05-08 中国原子能科学研究院 reactor computer monitoring system network architecture method

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
DAVID SELVAKUMAR ET AL.: "SCADA with fault tolerant CORBA on fault tolerant LANE ATM", 《19TH IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM》 *
吴海平: "分布式实时数据库在广域网SCADA中的应用", 《工业控制计算机》 *
王昊轶等: "面向串行通信的实时数据转储网关的设计与实现", 《计算机***应用》 *

Also Published As

Publication number Publication date
CN109189599B (en) 2021-11-05

Similar Documents

Publication Publication Date Title
Dang et al. Aiops: real-world challenges and research innovations
AU2019200046B2 (en) Utilizing artificial intelligence to test cloud applications
JP5120473B2 (en) Network system design support device
EP2946293B1 (en) Healing cloud services during upgrades
US8054763B2 (en) Migration of switch in a storage area network
WO2018133578A1 (en) Method and device for migrating virtual machine, computer storage medium, and electronic apparatus
CN104570831B (en) Process Control System and method
US20200409810A1 (en) Failure analysis system for a distributed storage system
EP3019975A1 (en) Online database migration
CN107209705A (en) Activity rollback for computing environment
CN104238493A (en) Process control apparatus and system and updating method therefor
TW201301027A (en) Deploying environments for testing by providing instantaneous availability of prebuilt environments
CN111324599B (en) Block chain experiment system and management method
CN104461693A (en) Virtual machine updating method and virtual machine updating system under desktop cloud computing environment
JP2014142678A (en) Virtual server transfer plan generation method and system
WO2019061364A1 (en) Failure analyzing method and related device
WO2016087979A1 (en) Performing closure merge operation
CN113312153A (en) Cluster deployment method and device, electronic equipment and storage medium
CN109299063A (en) A kind of platform database moving method and system
CN105354102B (en) A kind of method and apparatus of file system maintenance and reparation
CN105487971A (en) Method and system for recording and reproducing operation steps in software testing
CN109116818A (en) Real time data dump method and device when a kind of SCADA system upgrades
CN109150596A (en) A kind of SCADA system real time data dump method and device
WO2022226400A1 (en) Transition manager system
WO2024103902A1 (en) Database access method, apparatus and system, and device and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant