Data acquisition system and the method for the level and smooth expansion of a kind of capable of dynamic
Technical field
The present invention relates to data collecting field, relate in particular to data acquisition system and the method for the level and smooth expansion of a kind of capable of dynamic.
Background technology
Perfect along with the development of computer technology, technology of Internet of things and data communication infrastructure, society enters into the Internet of Things epoch by the computerized information epoch, in productive life, there is increasing on-site data gathering equipment, these equipment had both comprised traditional specialized data acquisition equipment that is applied to the industrial monitoring fields such as intelligent grid, automatic production line, also comprised the Portable intelligent equipment that possesses data acquisition function that is applicable to Smart Home, environmental monitoring, individual mobile application.The data acquisition system in traditional computerized information epoch was developed from the eighties in 20th century, the computer equipment, fieldbus and the data acquisition equipment that by installation data, are gathered Master Station Software form, and the design object of this type systematic is to realize industrial monitoring data acquisition by the specialized data acquisition equipment of industry spot.In the Internet of Things epoch, the data acquisition system of traditional mode, in the face of the transfer of data demand of the numerous Internet of Things collecting device of One's name is legion, kind, shows increasing limitation, is mainly reflected in:
1) in traditional data acquisition system, by writing in data acquisition Master Station Software, the mode of configuration specification expands collecting device.Be only applicable to that collection device type and number of devices are all fixed, to carry out operations specific industrial automation.
In traditional data acquisition system, carrying out new equipment expands while accessing, first in data acquisition Master Station Software for the type equipment is write collection stipulations, then in software systems for each equipment of the type carries out communication configuration, comprise routing iinformation, stipulations information, data point table information.This layoutprocedure must be undertaken by the professional that system is understood very much, otherwise the stability that may have influence on original system is changed in these configurations.The access of the each new equipment in production scene, all needs this process to carry out repetition.Fortunately, in industrial production environment, the kind of data acquisition equipment and quantity are all through strict design, although in the system debug stage, the configuration effort amount of this device extension can be very large, but when system completes debugging, drop into after stable operation, unless dilatation or maintenance, the demand of newly added equipment is less, in this application scenario, traditional data acquisition system meets instructions for use.
In the application scenarios that kind and the quantity of collecting device can frequently change, Smart Home common data collection service such as facing multiple users, environmental dynamic monitor in wide scope, electric automobile Mobile data collection etc., due to the diversity of monitoring target and the erratic behavior of operating condition, the type of data acquisition equipment and quantity meeting frequent variations, if adopt traditional data acquisition system, just need in the system of stable operation, configure frequently change, this both brought huge maintenance work to data acquisition system, to system stable operation, leave hidden danger again.
2) in traditional data acquisition system, the system maintenance of data acquisition Master Station Software centring system to the routing iinformation of all collected equipment, dominate in data acquisition, the transmission route of being responsible for foundation and collected equipment, being applicable to is had the data acquisition scene of fixed route information to collected equipment by data acquisition center system.
While the emphasis equipment of production process being carried out to data acquisition in industrial automation production process, need to set up proprietary data acquisition channel for this collected equipment, data acquisition Master Station Software system is set up route record information for this collected equipment and its proprietary data passage in system, when data acquisition center system brings into operation, the routing iinformation that data acquisition Master Station Software system is stored according to self is set up one by one with the route of all data acquisition equipments and is connected.This passage is proprietary and by the mode that data acquisition center system is responsible for Route establishment, to meet in industrial production volume of transmitted data large, the demand that the real-time of transfer of data and stability requirement are high.
In internet of things data acquisition field, the Internet of Things data equipment of One's name is legion presents discrete distribution character and the mobility of position in geographical space, in reality, do not possess the condition for proprietary, the fixing data communication channel of each equipment configuration, without fixed route information.In the situation that there is no fixed route, data acquisition center system also just cannot connect for collected equipment is set up route matching information table and initiate route in advance, also needs to take new method for routing foundation, in simultaneously traditional data acquisition system, due to passage, be specific to the attribute of collected equipment, acquisition system need to be according to the data route of the maximum quantity equivalent arrangements equal number of the collected equipment that may access, in traditional data acquisition system, be the few scene of collected number of devices, this mode is feasible, but in Internet of Things field, need to face millions of equipment, the online situation of collecting device can change frequently simultaneously, collecting device can frequently carry out the conversion of online and off-line along with gathering actual requirement or the restriction in place, in traditional data acquisition system, static routing resources employment methods cannot meet this frequent changeable demand, need new route management method and available route Dynamic Reconfiguration.
3) traditional data acquisition system is applied to industrial production environment more, its network environment is privately owned industry spot data acquisition network, this and Common transport channel physical isolation, the industrial on-site network that independently has network of one's own have reduced the risk that data acquisition system is subject to extraneous security attack, for guaranteeing the real-time of commercial Application, generally take data expressly to carry out message transmissions.Different in separate network environment from industry spot specialty collecting device, Internet of Things intelligent acquisition device distribution is in managing in scope significantly, data transmission network must be by means of common transmission network, system suffers the risk of security attack very large, and traditional data acquisition system and method are not suitable for the scene that this security risk is higher.
No. 200410021983.3 patent of invention of China, relate generally to a kind of method for designing that in industry spot data acquisition system, data are stored by setting threshold, the active balance of valid data amount and data reproducibility while being applicable to realize the storage of dynamic environment data bottom, fails to solve that the newly-increased data acquisition equipment configuration that this programme proposes is loaded down with trivial details, route dynamic management and the problem such as configuration, security fence as required.
No. 200810198817.9 patent of invention of China, a kind of management system of supporting different data collection service is proposed, this system adopts for different business and adopts different terminals, can support uniformly, manage different data collection services, in Dan Gai system nature, still belong to traditional data acquisition system, just by terminal, between concrete different business data acquisition system, isolate, solve the problem that stipulations expand.If be applied in Internet of Things, gather in scene, still exist equipment to expand loaded down with trivial details, routing management and security limitations, fail to solve that the newly-increased data acquisition equipment configuration that this programme proposes is loaded down with trivial details, the problem such as routing management and dynamic-configuration, security fence.
No. 200910111103.4 patent of invention of China, a kind of distributed data acquisition control platform system has been proposed, integrated by multiple communication modes of the data acquisition system of this invention based on traditional, realized the distributed capture of data, be traditional acquisition system of mentioning in this programme to be carried out to the category of protocol extension in essence, also fail to solve that the newly-increased data acquisition equipment configuration that this programme proposes is loaded down with trivial details, the problem such as route dynamic management and dynamic-configuration, security fence.
Summary of the invention
For above-mentioned deficiency, the invention provides data acquisition system and the method for the level and smooth expansion of a kind of capable of dynamic, realizing data acquisition center system does not need human configuration can realize intellectuality identification, access and the Data classification collection of newly added equipment, the automation distribution according to need of data acquisition route and dynamically adjustment, the safety certification of collecting device access and transfer of data, solves available data acquisition system and under new application requirements, expands that cost is high, extended capability is poor, the problem of poor stability.
To achieve these goals, the present invention adopts following technical scheme:
A data acquisition system for the level and smooth expansion of capable of dynamic, comprising: data acquisition center system and data collection station;
Described data acquisition center system is communicated by letter with described data collection station by communication network,
Described data acquisition center system is the core of data acquisition system, is responsible for data acquisition, management, safety certification, storage and log services;
Described data collection station by the transfer of data of collected equipment to data acquisition node, and by data acquisition application submission of sheet gateway routing node, the data acquisition node routing iinformation list returning according to gateway routing node, initiate business report piece transmission request with each data acquisition node respectively, carry out Data Encryption Transmission;
Described communication network is responsible for the physical link that data collection station is provided to data acquisition center system, and one or more in Ethernet, GPRS, 3G, 4G, industrial bus form; And, also can provide the wired or wireless physical link of transfer of data for other; For guaranteeing the versatility of routing iinformation customization, select ICP/IP protocol as transport layer protocol.
Described data acquisition center system comprises:
Gateway routing node, with data collection station, some data capture management nodes, safety certification node, monitor node and log management node communication, that data collection station enters data acquisition center system the first entrance by communication network, the routing iinformation of gateway routing node is fixed, be generally one, open to all data collection stations, be responsible for the terminal data collection application list that deal with data acquisition terminal is initiated to data acquisition center system; And, submit to safety certification node to carry out authentication the authentication information in terminal data collection application list, the identity authentication result that safety certification node is returned is sent to data collection station; And, after safety certification is passed through, business report piece summary information in terminal data collection application list is reorganized according to the type of service of business report piece, form one or more classify traffic report blocks collection application lists; By type of service, classify traffic report blocks collection application list is submitted to the data capture management node of processing this type of service, the data acquisition node route information table single transmit that each data capture management node is returned is to data collection station.
Described data acquisition center system also comprises:
Safety certification node, communicate by letter with gateway routing node, monitor node, safety certificate memory node, for carrying out the safety certification of data collection station, authentication information in the terminal data collection application list that reception gateway routing node forwards, by the authentication of comparing of the certificate in authentication information and safety certificate memory node, authentication result is sent to gateway routing node.And, according to the uniqueness identify label of data collection station, generating authentication information, authentication information can play dress to store in the cipher key module of data collection station.
Safety certificate memory node, with safety certification node communication, for storing the safety certificate of data collection station;
Monitor node, with gateway routing node, safety certification node and log management node communication, for monitoring and control the running status of gateway routing node, safety certification node, log management node, guarantees that each node works online.
Log management node, with gateway routing node, safety certification node, data acquisition node, data capture management node, log store node communication, the record, the maintenance and management work that for each node of system, produce log information;
Log store node, with log management node communication, is responsible for the storage of daily record;
Data capture management node, communicate by letter with gateway routing node, log management node, some data acquisition nodes, receive the classify traffic report blocks collection application list that gateway routing node sends, according to routing strategy, be that each business report piece entry in classify traffic report blocks collection application list is chosen data acquisition node, form data acquisition node routing iinformation list; And, data acquisition node route information table single transmit, to gateway routing node, is pushed to corresponding data acquisition node according to the match information in data acquisition node routing iinformation list by communication information list simultaneously;
Data acquisition node, with data capture management node, acquired data storage node, data collection station, log management node communication, be responsible for the data acquisition of data collection station, for the transmission request of data collection station, set up communication and connect, be responsible for data acquisition resolving;
Acquired data storage node, communicates by letter with data acquisition node, the data that gather for storing each data acquisition node, and data access function is provided;
Time synchronization node, is used to all nodes in system that time synchronized service is provided.
Described gateway routing node, data capture management node and data acquisition node are according to the tree-like logical relation tissue that carries out; Gateway routing node is the root node of this tree structure, is connected with one or more data capture management nodes under it; Below each data capture management node, there are one or more data acquisition nodes.
Gateway routing node, data capture management node, data acquisition node, safety certification node, acquired data storage node, monitor node, time synchronized service node, safety certificate memory node, log management node, log store node, all above-mentioned application nodes allow to operate on same computer server, also allow a plurality of application nodes to operate on same computer server; And above-mentioned node allows to operate on same or a plurality of different cloud computing service platforms.
Described terminal data collection application list comprises authentication information, transmission security key information, business report piece summary information.
Described data collection station comprises master control borad, described master control borad respectively with power module, CPU module, memory module, communication module, display module, cipher key module, stipulations modular converter, input and output module, to time module, Keysheet module two-way communication.
Between described data collection station and some collected equipment, allowing to carry out communication by RS232, RS485, CAN bus, Ethernet, wireless mode is connected.Described collected equipment comprises that Internet of Things smart machine, the especially intelligent meter in the fields such as the traditional industry field apparatuss such as transducer, operating terminal, controller, device communication module, PLC or Smart Home, intelligent building, Intelligent logistics take into account Internet of Things smart machine in the intelligent grids such as senior measurement, intelligent power, electric automobile and charging.
Between described data collection station and gateway routing node and data acquisition node, allowing to using ICP/IP protocol by fiber optic Ethernet, wireless mode carries out communication as transport layer protocol and is connected.
The configuration effort that has needed authentication, transmission security key, business report piece summary information before described data collection station access said system.
The collecting method that above-mentioned data acquisition system is used, comprises step:
Step (1): data collection station is to gateway routing node transmitting terminal data acquisition application list;
Step (2): gateway routing node is that terminal data collection application list generates handling process, each handling process is an Erlang process, gateway routing node to the authentication information in safety certification node transmitting terminal data acquisition application list, waits for that safety certification node returns to the security certification result of this data collection station in this Erlang process; Gateway routing node is waited for new collection application simultaneously;
Step (3): safety certification node carries out safety certification according to the authentication information in terminal data collection application list to data collection station, and authentication result is sent to gateway routing node;
Step (4): if authentification failure, gateway routing node returns to data collection station by authentication result, finishes this handling process finishes to be responsible for the Erlang process of this processing simultaneously;
Step (5): if authentication is passed through, gateway routing node reorganizes business report piece summary information in terminal data collection application list according to the type of service of business report piece, forms the service order form list of classify traffic report blocks; Further, gateway routing node is submitted to the service order form list of classify traffic report blocks respectively some data capture management nodes of processing this type of service;
Step (6): after some data capture management nodes receive service order form list, according to preference policy, it is each the business report entries match data acquisition node in service order form list, tissue forms data acquisition node routing iinformation list, and routing iinformation list is back to gateway routing node; Data capture management node generates communication information list according to the match information of the data acquisition node in routing iinformation list and business report entry simultaneously, and communication information list has been pushed to the data acquisition node of coupling;
Step (7): gateway routing node receives the routing iinformation list that data capture management node returns, now routing iinformation list forms by a plurality of concrete business report piece entries with the combination entry of the routing iinformation of this business report piece entries match, and gateway routing node is delivered to routing iinformation list the data collection station of submitting to this collections to apply for; Gateway routing node is waited for returning of oriented data capture management node submit applications result by the Erlang treatment progress that this collection application generates always, if overtime, to data collection station, sends time-out information;
Step (8): if data collection station receives time-out information, or the data acquisition node in the routing iinformation list receiving is empty data acquisition node, data collection station finishes this application, and postpones after a period of time, to gateway routing node, initiates new collection application;
Step (9): data collection station is after receiving all routing iinformation lists that return, to the fixed data acquisition node of each routing iinformation list middle finger, initiate business report piece transmission request, data acquisition node transmits request for each sets up transmission channel, each transmission channel is an Erlang process, according to transfer of data key information corresponding to business report piece and Data Analysis mode, complete deciphering, parsing, storage and framing, encryption and the transmission of message transmission;
Step (10): data acquisition node stores image data into acquired data storage node according to storage policy by data;
At described step (1)-step (10) daily record of work that log management node real-time storage gateway routing node, safety certification node, data capture management node, data acquisition node produce in the process of implementation; The running status of gateway routing node, safety certification node, data acquisition node is monitored, safeguarded to monitor node in real time, when gateway routing node, safety certification node or data acquisition node occur when abnormal, monitor node attempts abnormal nodes to carry out reboot operation, and system for prompting attendant carries out troubleshooting in time; The time of time synchronization node Timing Synchronization gateway routing node, safety certification node, safety certificate memory node, monitor node, log management node, log store node, data capture management node, data acquisition node, acquired data storage node.
Terminal data collection application list in described step (1), comprises authentication information, transmission security key information, business report piece summary information.
Described authentication information is that this acquisition terminal equipment is at initial phase, by safety certificate management node, according to the uniqueness identify label of this data collection station, generated, and lower dress stores the cipher key module of data collection station into, this lower process of assembling is not reproducible to carry out, and irreversible.
Described transmission security key information is produced by data collection station cipher key module, transmission security key information in each new data acquisition application list can be different, data acquisition node can apply in this transmission the data after cipher key module is encrypted that send in transaction cycles by resolution data acquisition terminal by this key, and allow to send to the order of data collection station to be encrypted with this key, guarantee that this order can be identified by data collection station.
Described business report piece summary information is the initialized collectable data items for information of this image data acquisition terminal, comprises the business report set of blocks divided according to type of service and attribute thereof, the report blocks entry of report blocks set-inclusion, the measuring point that report blocks entry comprises, data store strategy and other attributes of measuring point.
Safety certification in described step (3), only has the data collection station through legal authentication could automatically be linked into system for guaranteeing.Safety certification node is verified that the authentication information of data collection station mate with the safety certificate in safety certificate memory node, if be verified return authentication, passes through result, otherwise authentification failure, return authentication does not pass through information.
Described step (5) particular content is: gateway routing node is resolved terminal data collection application list, according to the type of service of report blocks set in business report piece self-described information in this terminal data collection application list, form one or more service order form lists of classifying according to type of service, each service order form list comprises data collection station sign, data collection station transmission security key information, business gathers applying type, the data acquisition node order of supporting and the collection report blocks set of this business, wherein gather the one or more business report piece of report blocks set-inclusion entry, the measuring point that each entry comprises this entry, data store strategy and other descriptors.Gateway routing node need to gather applying type according to business and service order form single transmit be arrived to the data capture management node of processing such business.
Preference policy in described step (6), the preference policy of selecting in the data acquisition node of data capture management node under a plurality of node administrations comprises following factor: the physical function parameter of the IO load of data acquisition node, cpu load, core original paper, data collection station are to the Qos of data acquisition node.
IO load judges with the par of Erlang process in data acquisition node 30 minutes;
Cpu load judges with the average occupancy of CPU in 30 minutes;
The physical function parameter of core original paper comprises cpu temperature, hard disk temperature, cpu fan rotating speed;
Specific data acquisition terminal to the Qos account form of specific data acquisition node is: the data collection station of selecting to be positioned at this data collection station identical and close communication topology location from all and specific data acquisition node are kept in communication the data collection station connecting, take these data collection stations to the mean value of the Qos of specific data acquisition node as this data collection station to the Qos of this specified node, if there is not the data collection station of identical or close network topology position, allow not adopt this strategic factor.
Data acquisition node selects principle concrete in dominant strategy to be: IO load is low, cpu load is low, the physical function parameter of core original paper is normal, Qos is low.
Routing iinformation list in described step (6), be by data capture management node according to being that each business report entries match data acquisition node in service order form list is organized and formed according to preference policy, comprise data collection station sign and corresponding communications protocol type, acquisition node IP address, the acquisition node port numbers of business report piece.Communication information list in described step (6), be that data capture management node generates according to the data acquisition node match information in routing iinformation list, comprise that data collection station sign, data collection station transmission security key information, business gather data acquisition node order and the corresponding business report piece items for information of applying type, support.
The step of described step (9) is: data capture management node is a routing iinformation list of each service order form list generation, in service order form list, each report blocks entry is to should route information table Dan Zhongyi bar data acquisition node routing iinformation, and routing iinformation comprises communications protocol type, data acquisition node IP address and port numbers; Data collection station is initiated connection request to each data acquisition node, and data acquisition node be take the mode of Erlang process provides data acquisition channel as data collection station; Data collection station is being set up communication while being connected first with data acquisition node, and data acquisition node is described information in detail to data collection station request measuring point, and data collection station is uploaded the corresponding report blocks bar of this data acquisition node measuring point information now; After this key that data collection station and data acquisition node provide with data collection station carries out Data Encryption Transmission, and the analysis mode of stipulating in the measuring point self-described information that data acquisition node provides according to data collection station completes Data Analysis and data deposit.
Data storage in described step (10), data acquisition node transfers data to acquired data storage node, acquired data storage node completes data buffer storage according to predefined data store strategy as buffer memory deviation, the time interval, real time data section access function is provided and data persistence is arrived to database, database provides perdurable data access function; The data store strategy of different business datum report blocks also allows to customize description in report blocks.
Beneficial effect of the present invention:
1, data collection station configures by carrying out authentication information, transmission security key information, data point and business report piece summary information when the initialization, makes data collection station possess self-description ability, has realized the self-description data access of various field equipment.Data acquisition center system is by accepting the collection application list of data collection station, the self-described information of data query acquisition terminal, according to data collection station self-described information, resolve these three automation steps of storage, just can realize the data acquisition that increases data collection station newly without data acquisition centring system configuration is changed in the situation that.
2, system gathers application form single-shot by gateway routing node by business and delivers to data capture management node, by data capture management node, according to preference policy dynamic assignment data acquisition node, form routing iinformation list, and finally by gateway routing node, routing iinformation is returned to acquisition terminal.Under the cooperation of gateway routing node, by data capture management node, data acquisition node by work organization and adopt the technical implementation way of the corresponding acquisition channel of Erlang process, the dynamic autoization configuration of routing iinformation and the level and smooth adjustment of access channel capacity of data acquisition system have been realized.
3, in the present invention, gateway routing node is to enter data acquisition system the first entrance, without the service request of safety certification or encryption, can only enter gateway routing node, by gateway routing node, is carried out the forwarding of business or is abandoned; Business to data acquisition node is the data through safety certification and encryption.The mode that gateway route is combined with safety certification, has reduced the data acquisition system integral body risk that system is attacked under variety of network environments; Gateway routing node is separated with data acquisition node, the technical scheme of shielding acquisition node, fail safe and the availability of data acquisition system integral body have been improved, even gateway routing node is under attack, only affect the access of new data collection terminal, do not affect the normal data collection of original acquisition terminal of access data.
4, monitor node monitors the normal operation of gateway routing node, safety certification node, log management node, guarantees the stable operation of these nodes; Monitor node itself moves in hot standby mode simultaneously, guarantees each other the normal operation of monitor node.Whole monitoring has ensured system run all right.
5, data capture management node is chosen the optimization of data acquisition node, has guaranteed the load balancing of each data acquisition node.Data acquisition node be take the mode of Erlang process as data collection station provides data acquisition channel, realizes acquisition channel smooth expansion; And data collection station provides the configuration mode of exempting from of Data Analysis mode and measuring point information to acquisition node, avoided human configuration to cause loaded down with trivial details and possibility that make mistakes; Between data acquisition node and data collection station, adopt secret key encryption mode to carry out data communication simultaneously, strengthened the fail safe of communication.
6, native system is in running, except the data collection station of new connecting system being carried out to initialization operation, other nodes of data center systems all do not need to be configured the artificial participation of change, the workload that has reduced O&M personnel in system use procedure, has more guaranteed the operation that system safety is stable.
Accompanying drawing explanation
Fig. 1 is structural representation of the present invention;
Fig. 2 is data acquisition node administrative structure structural representation of the present invention;
Fig. 3 is monitor node work structuring schematic diagram of the present invention;
Fig. 4 is data collection station structural representation of the present invention;
Fig. 5 is data collection station of the present invention and collected equipment connection schematic diagram;
Fig. 6 is data collection task reciprocal process schematic diagram of the present invention;
Fig. 7 is collection application process schematic diagram of the present invention;
Fig. 8 is data collection station initializes configuration information schematic diagram of the present invention;
Fig. 9 is collection application list schematic diagram of the present invention;
Figure 10 is service order form list schematic diagram of the present invention;
Figure 11 is routing iinformation list schematic diagram of the present invention;
Figure 12 is communication information list schematic diagram of the present invention;
Wherein, 1. data collection station, 2. gateway routing node, 3. safety certification node, 4. safety certificate memory node, 5. monitor node, 6. log management node, 7. log store node, 8. data capture management node, 9. data acquisition node, 10. acquired data storage node, 11. time synchronization nodes; 21. power module, 22.CPU module, 23. memory modules, 24. communication modules, 25. display modules, 26. cipher key module, 27. stipulations modular converters, 28. input and output modules, module in the time of 29. pairs, 30. Keysheet modules, 31. collected equipment, 40. master control borads.
Embodiment
Below in conjunction with accompanying drawing and embodiment, the invention will be further described:
As shown in Figure 1, a data acquisition system for the level and smooth expansion of capable of dynamic, comprises data collection station 1, gateway routing node 2, safety certification node 3, data capture management node 8, data acquisition node 9, acquired data storage node 10, monitor node 5, time synchronization node 11, log management node 6, safety certificate memory node 4, log store node 7; Described data collection station 1 respectively with described gateway routing node 2 and data acquisition node 9 two-way communications; Described gateway routing node 2 respectively with log management node 6, monitor node 5, safety certification node 3,8 two-way communications of data capture management node; Described log management node 6 respectively with log store node 7, data acquisition node 9, data capture management node 8, safety certification node 3 and monitor node 5 two-way communications; Described safety certification node 3 respectively with monitor node 5,4 two-way communications of safety certificate memory node; Described data acquisition node 9 respectively with acquired data storage node 10 and 8 two-way communications of data capture management node.
Gateway routing node, data capture management node, data acquisition node, safety certification node, acquired data storage node, monitor node, time synchronized service node, safety certificate memory node, log management node, log store node, all above-mentioned application nodes can operate on a computer server by each node, also can operate on same computer server by a plurality of nodes, between each computer server, with proprietary optical-fibre channel or proprietary radio channel, connect, on geographical position, can be fixedly mounted on same room with them, can be arranged on a plurality of different cities, also can be in mobile status at a high speed.Further, above-mentioned each node may operate on same or a plurality of different Cloud Servers.
Described gateway routing node 2 is that data collection station 1 enters data acquisition system the first entrance, the routing iinformation of gateway routing node 2 is fixed and is open to all data collection stations 1, be responsible for the terminal data collection application list that deal with data acquisition terminal 1 is initiated to data acquisition system, comprise authentication information, transmission security key information, business report piece summary information.
Further, described gateway routing node 2, submit to safety certification node 3 to carry out authentication the authentication information in terminal data collection application list, wait for 3 processing of safety certification node, the identity authentication result that safety certification node 3 is returned is sent to data collection station 1.
Further, described gateway routing node 2, when safety certification is passed through, business report piece summary information in terminal data collection application list is reorganized according to the type of service of business report piece, form one or more classify traffic report blocks collection application lists, by type classify traffic report blocks collection application list is submitted to the data capture management node 8 of processing corresponding type of service.Wait for 8 processing of data capture management node, the data acquisition node 9 route information table single transmit that each data capture management node 8 is returned are to data collection station 1.
Described safety certification node 3 carries out the safety certification of data collection station 1, authentication information in the terminal data collection application list that reception gateway routing node 2 forwards, certificate in authentication information and safety certificate memory node 4 is carried out to safety certification, security certification result is sent to gateway routing node 2.Further, described safety certificate memory node 4 can generate authentication information according to the uniqueness identify label of data collection station 1, and authentication information can play dress to store in the cipher key module of data collection station 1.
The data acquisition node 9 of the one or more processing same line of business data of described data capture management node 8 management, receive the classify traffic report blocks collection application list that gateway routing node 2 sends, data capture management node 8 is that each business report piece in classify traffic report blocks collection application list is chosen data acquisition node 9 according to routing strategy, forms data acquisition node 9 routing iinformation lists.Further, data acquisition node 9 route information table single transmit, to gateway routing node 2, are pushed to corresponding data acquisition node 9 according to the match information in data acquisition node 9 routing iinformation lists by communication information list simultaneously.
Described data acquisition node 9 provides data acquisition channel for data collection station 1, when receiving the business report piece transmission request of data collection station 1, for transmission channel is set up in each transmission request, each transmission channel is an Erlang process, according to transfer of data key information corresponding to business report piece and Data Analysis mode, complete deciphering, parsing, storage and framing, encryption and the transmission of message transmission.
Described time synchronized server node 11, one or more in gps signal, the Big Dipper, B code, CDMA, atomic clock standard clock source of take are clock source, for the data collection station 1 in system, gateway routing node 2, safety certification node 3, data capture management node 8, data acquisition node 9, acquired data storage node 10, monitor node 5, log management node 6, safety certificate management node 4, log store node 7 carry out time synchronized, the mode of time synchronizing signal can be: NTP/SNTP signal, pulse signal, IRIG-B signal, time message.
The data that described each data acquisition node 9 of acquired data storage node 10 storages gathers, and data access function is provided.
Described log management node 6 is responsible for record, the maintenance and management work that each node of system produces log information, and log store node 7 is responsible for the storage of daily record.
Described monitor node 8 monitors and controls the running status of gateway routing node 2, safety certification node 3, log management node 6, guarantees that each node works online, and can adopt the hot standby mode of binode to move or trunking mode operation.
Between described data collection station 1 and collected equipment, can carry out communication by RS232, RS485, CAN bus, Ethernet, wireless mode is connected.
Further, between described data collection station 1 and gateway routing node 2 and data acquisition node 9, can carry out communication by fiber optic Ethernet, wireless mode is connected.
Further, described data collection station 1 is after completing authentication, transmission security key, the configuration of business report piece summary information, by data acquisition application submission of sheet gateway routing node 2, the data acquisition node 9 routing iinformation lists that return according to gateway routing node 2, connect with each data acquisition node 9 respectively, carry out Data Encryption Transmission.
As shown in Figure 2, system can comprise one or more data capture management nodes 8, the data acquisition node 9 of the one or more processing same line of business data of data capture management node 8 management, receive the classify traffic report blocks collection application list that gateway routing node 2 sends, data capture management node 8 is that each business report piece in classify traffic report blocks collection application list is chosen data acquisition node 9 according to routing strategy, forms data acquisition node 9 routing iinformation lists.Further, data acquisition node 9 route information table single transmit, to gateway routing node 2, are pushed to corresponding data acquisition node 9 according to the match information in data acquisition node 9 routing iinformation lists by communication information list simultaneously.
As shown in Figure 3, monitor node 5 respectively with gateway routing node 2, safety certification node 3,6 two-way communications of log management node, between described monitor node 5 and other monitor node 5, be also two-way communication; Monitor node 5 is with the hot standby pattern of node or trunking mode operation, gateway routing node 2, safety certification node 3, log management node 6 are to monitor node 5 registrations, and maintenance logs in state, if certain node operation occurs abnormal, monitor node 5 attempts malfunctioning node to carry out reboot operation, and system for prompting attendant carries out troubleshooting in time.
As shown in Figure 4, data collection station 1 comprises master control borad 40, described master control borad respectively with power module 21, CPU module 22, memory module 23, communication module 24, display module 25, cipher key module 26, stipulations modular converter 27, input and output module 28, to time module 29, Keysheet module 30 two-way communications.
As shown in Figure 5, data collection station 1 allows with different communication modes, to carry out data interaction from several collected equipment 31, and adoptable communication modes comprises RS232, RS485, CAN bus, Ethernet, wireless mode.
As shown in Figure 6, data collection task process schematic diagram:
S1. data collection station is to gateway routing node transmitting terminal data acquisition application list, to obtain data acquisition node routing iinformation;
S2. data collection station safety certification request: gateway routing node, to the authentication information in safety certification node transmitting terminal data acquisition application list, carries out the safety certification of data collection station;
S3. safety certification node carries out the safety certification of data collection station, and authentication result is back to gateway routing node.If authentification failure, carries out S6, and finishes this handling process, wait for new collection application; If authentication is passed through, carry out S4;
S4. gateway routing node reorganizes business report piece summary information in terminal data collection application list according to the type of service of business report piece, form classify traffic report blocks collection application list, and classify traffic report blocks collection application list is submitted to respectively to the data capture management node of processing this type of service, to obtain data acquisition node routing iinformation;
S5. data capture management node is chosen data acquisition node according to preference policy for applying for each the business report entry in list, tissue forms data acquisition node routing iinformation list, routing iinformation list is back to gateway routing node, and according to the match information in data acquisition node routing iinformation list, communication information list is pushed to corresponding data acquisition node;
S6. gateway routing node will receive data acquisition node routing iinformation list and deliver to data collection station;
S7. data collection station is initiated business report piece transmission request to the fixed data acquisition node of each routing iinformation list middle finger, data acquisition node be take Erlang process mode and is set up transmission channel as each transmission request, according to transfer of data key information corresponding to business report piece and Data Analysis mode, carry out deciphering, parsing, storage and framing, encryption and the transmission of message transmission;
S8. data storage.Data acquisition node stores image data into acquired data storage node according to storage policy by data.
As shown in Figure 7, gather application process schematic diagram:
S01. data collection station configuration, forms data collection station configuration documentation.
S02. data collection station sends and gathers application list to safe routing node.
S03. gateway routing node carries out data collection station authentication to safety certification node.
S04. safety certification node is to gateway routing node return authentication result.If authentification failure is carried out S05, successful execution S06.
S05. gateway routing node returns to application result to data collection station: authentification failure.
S06. gateway routing node forms service order form list, sends to data capture management node.
S07. gateway routing node is applied for overtime judgement, overtimely to data collection station, returns to application result: apply for overtime.
S08. data capture management node is to gateway routing node return data acquisition node routing iinformation list, and pushes communication information list to data acquisition node.
S09. gateway routing node sends data acquisition node routing iinformation list to data collection station.
S10. data collection station receives after all routing iinformation lists, gathers and applies for successfully.
As shown in Figure 8, the configuration documentation of data collection station, comprises file header, business report block message, measuring point information.File header is the essential information of data collection station, comprise data collection station title, data collection station uniqueness sign, data collection station model, manufacturer, founder and creation-time, safety certification node is according to the authentication information of data collection station uniqueness sign generated data acquisition terminal; Business report block message provides foundation for data capture management node selection data acquisition node, each equipment can configure a plurality of report blocks set according to type of service, report blocks aggregate attribute comprises data acquisition node order and the Data Analysis mode of type of service, support, each report blocks set can configure one or more report blocks entries according to measuring point quantity or other factors, the report blocks bar ID that configuration data memory attribute comprises measuring point as memory gap, storage deviation and this entry now; Measuring point information configuration ID and the specifying information of each measuring point, as measuring point title, measuring point type, measuring point are controlled type and other information needed.
As shown in Figure 9, data acquisition application list, comprises authentication information, transmission security key information, business report piece summary information.Authentication information is at equipment configuration phase, generated, and lower dress stores the cipher key module of data collection station into by safety certificate management node according to the uniqueness identify label of this data collection station; Transmission security key information is produced by data collection station cipher key module; Business report piece summary information is business report block message in data collection station configuration documentation, comprises the business report piece collection divided according to type of service and attribute thereof, the report blocks entry of report blocks set-inclusion, measuring point, data store strategy and other attributes that report blocks entry comprises.
As shown in figure 10, service order form list, to be generated according to the type of service that gathers report blocks set in application list business report piece summary information by gateway routing node, each service order form list comprises that data collection station sign, data collection station transmission security key information, business gather data acquisition node order and the business collection report collection of applying type, support, wherein business collection report collection comprises one or more business report piece entries, the measuring point that each entry comprises this entry, data store strategy and other descriptors.
As shown in figure 11, routing iinformation list, data capture management node is that each service order form list generates a routing iinformation list, in service order form list, each report blocks entry is to should route information table Dan Zhongyi bar data acquisition node routing iinformation, and routing iinformation comprises communications protocol type, data acquisition node IP address and port numbers.
As shown in figure 12, communication information list, data capture management node generates according to the data acquisition node match information in routing iinformation list, comprises that data collection station sign, data collection station transmission security key information, business gather data acquisition node order and the corresponding business report piece items for information of applying type, support.
Although above-mentioned, by reference to the accompanying drawings the specific embodiment of the present invention is described; but be not limiting the scope of the invention; one of ordinary skill in the art should be understood that; on the basis of technical scheme of the present invention, those skilled in the art do not need to pay various modifications that creative work can make or distortion still in protection scope of the present invention.