CN103532975A - Dynamically and smoothly expandable data acquisition system and method - Google Patents

Dynamically and smoothly expandable data acquisition system and method Download PDF

Info

Publication number
CN103532975A
CN103532975A CN201310516800.4A CN201310516800A CN103532975A CN 103532975 A CN103532975 A CN 103532975A CN 201310516800 A CN201310516800 A CN 201310516800A CN 103532975 A CN103532975 A CN 103532975A
Authority
CN
China
Prior art keywords
node
data
data acquisition
collection station
data collection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310516800.4A
Other languages
Chinese (zh)
Other versions
CN103532975B (en
Inventor
李建祥
刘海波
韩元凯
袁弘
张秉良
魏巍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
State Grid Intelligent Technology Co Ltd
Original Assignee
State Grid Corp of China SGCC
Electric Power Research Institute of State Grid Shandong Electric Power Co Ltd
Shandong Luneng Intelligence Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by State Grid Corp of China SGCC, Electric Power Research Institute of State Grid Shandong Electric Power Co Ltd, Shandong Luneng Intelligence Technology Co Ltd filed Critical State Grid Corp of China SGCC
Priority to CN201310516800.4A priority Critical patent/CN103532975B/en
Publication of CN103532975A publication Critical patent/CN103532975A/en
Application granted granted Critical
Publication of CN103532975B publication Critical patent/CN103532975B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention discloses a dynamically and smoothly expandable data acquisition system and method. The dynamically and smoothly expandable data acquisition system comprises a central data acquisition system and a data acquisition terminal, wherein the central data acquisition system comprises a gateway routing node, a data acquisition man aging node, data acquisition nodes, a security authenticating node, an acquired data storing node, a monitoring node, a time synchronizing service node, a security certificate storing node, a log managing node and a log storing node; the central data acquisition system communicates with the data acquisition terminal through a communication network; the data acquisition terminal transmits acquired device data to the data acquisition node, submits a data acquisition application form to the gateway routing node, acquires a node routing information form according to data fed back by the gateway routing node, and initiates a business report block transmission request to each data acquisition node for encrypted transmission of the data. According to the invention, the problems that the existing data acquisition system is high in expansion cost, poor in expansion capability and high in security risk under new application requirements are solved.

Description

Data acquisition system and the method for the level and smooth expansion of a kind of capable of dynamic
Technical field
The present invention relates to data collecting field, relate in particular to data acquisition system and the method for the level and smooth expansion of a kind of capable of dynamic.
Background technology
Perfect along with the development of computer technology, technology of Internet of things and data communication infrastructure, society enters into the Internet of Things epoch by the computerized information epoch, in productive life, there is increasing on-site data gathering equipment, these equipment had both comprised traditional specialized data acquisition equipment that is applied to the industrial monitoring fields such as intelligent grid, automatic production line, also comprised the Portable intelligent equipment that possesses data acquisition function that is applicable to Smart Home, environmental monitoring, individual mobile application.The data acquisition system in traditional computerized information epoch was developed from the eighties in 20th century, the computer equipment, fieldbus and the data acquisition equipment that by installation data, are gathered Master Station Software form, and the design object of this type systematic is to realize industrial monitoring data acquisition by the specialized data acquisition equipment of industry spot.In the Internet of Things epoch, the data acquisition system of traditional mode, in the face of the transfer of data demand of the numerous Internet of Things collecting device of One's name is legion, kind, shows increasing limitation, is mainly reflected in:
1) in traditional data acquisition system, by writing in data acquisition Master Station Software, the mode of configuration specification expands collecting device.Be only applicable to that collection device type and number of devices are all fixed, to carry out operations specific industrial automation.
In traditional data acquisition system, carrying out new equipment expands while accessing, first in data acquisition Master Station Software for the type equipment is write collection stipulations, then in software systems for each equipment of the type carries out communication configuration, comprise routing iinformation, stipulations information, data point table information.This layoutprocedure must be undertaken by the professional that system is understood very much, otherwise the stability that may have influence on original system is changed in these configurations.The access of the each new equipment in production scene, all needs this process to carry out repetition.Fortunately, in industrial production environment, the kind of data acquisition equipment and quantity are all through strict design, although in the system debug stage, the configuration effort amount of this device extension can be very large, but when system completes debugging, drop into after stable operation, unless dilatation or maintenance, the demand of newly added equipment is less, in this application scenario, traditional data acquisition system meets instructions for use.
In the application scenarios that kind and the quantity of collecting device can frequently change, Smart Home common data collection service such as facing multiple users, environmental dynamic monitor in wide scope, electric automobile Mobile data collection etc., due to the diversity of monitoring target and the erratic behavior of operating condition, the type of data acquisition equipment and quantity meeting frequent variations, if adopt traditional data acquisition system, just need in the system of stable operation, configure frequently change, this both brought huge maintenance work to data acquisition system, to system stable operation, leave hidden danger again.
2) in traditional data acquisition system, the system maintenance of data acquisition Master Station Software centring system to the routing iinformation of all collected equipment, dominate in data acquisition, the transmission route of being responsible for foundation and collected equipment, being applicable to is had the data acquisition scene of fixed route information to collected equipment by data acquisition center system.
While the emphasis equipment of production process being carried out to data acquisition in industrial automation production process, need to set up proprietary data acquisition channel for this collected equipment, data acquisition Master Station Software system is set up route record information for this collected equipment and its proprietary data passage in system, when data acquisition center system brings into operation, the routing iinformation that data acquisition Master Station Software system is stored according to self is set up one by one with the route of all data acquisition equipments and is connected.This passage is proprietary and by the mode that data acquisition center system is responsible for Route establishment, to meet in industrial production volume of transmitted data large, the demand that the real-time of transfer of data and stability requirement are high.
In internet of things data acquisition field, the Internet of Things data equipment of One's name is legion presents discrete distribution character and the mobility of position in geographical space, in reality, do not possess the condition for proprietary, the fixing data communication channel of each equipment configuration, without fixed route information.In the situation that there is no fixed route, data acquisition center system also just cannot connect for collected equipment is set up route matching information table and initiate route in advance, also needs to take new method for routing foundation, in simultaneously traditional data acquisition system, due to passage, be specific to the attribute of collected equipment, acquisition system need to be according to the data route of the maximum quantity equivalent arrangements equal number of the collected equipment that may access, in traditional data acquisition system, be the few scene of collected number of devices, this mode is feasible, but in Internet of Things field, need to face millions of equipment, the online situation of collecting device can change frequently simultaneously, collecting device can frequently carry out the conversion of online and off-line along with gathering actual requirement or the restriction in place, in traditional data acquisition system, static routing resources employment methods cannot meet this frequent changeable demand, need new route management method and available route Dynamic Reconfiguration.
3) traditional data acquisition system is applied to industrial production environment more, its network environment is privately owned industry spot data acquisition network, this and Common transport channel physical isolation, the industrial on-site network that independently has network of one's own have reduced the risk that data acquisition system is subject to extraneous security attack, for guaranteeing the real-time of commercial Application, generally take data expressly to carry out message transmissions.Different in separate network environment from industry spot specialty collecting device, Internet of Things intelligent acquisition device distribution is in managing in scope significantly, data transmission network must be by means of common transmission network, system suffers the risk of security attack very large, and traditional data acquisition system and method are not suitable for the scene that this security risk is higher.
No. 200410021983.3 patent of invention of China, relate generally to a kind of method for designing that in industry spot data acquisition system, data are stored by setting threshold, the active balance of valid data amount and data reproducibility while being applicable to realize the storage of dynamic environment data bottom, fails to solve that the newly-increased data acquisition equipment configuration that this programme proposes is loaded down with trivial details, route dynamic management and the problem such as configuration, security fence as required.
No. 200810198817.9 patent of invention of China, a kind of management system of supporting different data collection service is proposed, this system adopts for different business and adopts different terminals, can support uniformly, manage different data collection services, in Dan Gai system nature, still belong to traditional data acquisition system, just by terminal, between concrete different business data acquisition system, isolate, solve the problem that stipulations expand.If be applied in Internet of Things, gather in scene, still exist equipment to expand loaded down with trivial details, routing management and security limitations, fail to solve that the newly-increased data acquisition equipment configuration that this programme proposes is loaded down with trivial details, the problem such as routing management and dynamic-configuration, security fence.
No. 200910111103.4 patent of invention of China, a kind of distributed data acquisition control platform system has been proposed, integrated by multiple communication modes of the data acquisition system of this invention based on traditional, realized the distributed capture of data, be traditional acquisition system of mentioning in this programme to be carried out to the category of protocol extension in essence, also fail to solve that the newly-increased data acquisition equipment configuration that this programme proposes is loaded down with trivial details, the problem such as route dynamic management and dynamic-configuration, security fence.
Summary of the invention
For above-mentioned deficiency, the invention provides data acquisition system and the method for the level and smooth expansion of a kind of capable of dynamic, realizing data acquisition center system does not need human configuration can realize intellectuality identification, access and the Data classification collection of newly added equipment, the automation distribution according to need of data acquisition route and dynamically adjustment, the safety certification of collecting device access and transfer of data, solves available data acquisition system and under new application requirements, expands that cost is high, extended capability is poor, the problem of poor stability.
To achieve these goals, the present invention adopts following technical scheme:
A data acquisition system for the level and smooth expansion of capable of dynamic, comprising: data acquisition center system and data collection station;
Described data acquisition center system is communicated by letter with described data collection station by communication network,
Described data acquisition center system is the core of data acquisition system, is responsible for data acquisition, management, safety certification, storage and log services;
Described data collection station by the transfer of data of collected equipment to data acquisition node, and by data acquisition application submission of sheet gateway routing node, the data acquisition node routing iinformation list returning according to gateway routing node, initiate business report piece transmission request with each data acquisition node respectively, carry out Data Encryption Transmission;
Described communication network is responsible for the physical link that data collection station is provided to data acquisition center system, and one or more in Ethernet, GPRS, 3G, 4G, industrial bus form; And, also can provide the wired or wireless physical link of transfer of data for other; For guaranteeing the versatility of routing iinformation customization, select ICP/IP protocol as transport layer protocol.
Described data acquisition center system comprises:
Gateway routing node, with data collection station, some data capture management nodes, safety certification node, monitor node and log management node communication, that data collection station enters data acquisition center system the first entrance by communication network, the routing iinformation of gateway routing node is fixed, be generally one, open to all data collection stations, be responsible for the terminal data collection application list that deal with data acquisition terminal is initiated to data acquisition center system; And, submit to safety certification node to carry out authentication the authentication information in terminal data collection application list, the identity authentication result that safety certification node is returned is sent to data collection station; And, after safety certification is passed through, business report piece summary information in terminal data collection application list is reorganized according to the type of service of business report piece, form one or more classify traffic report blocks collection application lists; By type of service, classify traffic report blocks collection application list is submitted to the data capture management node of processing this type of service, the data acquisition node route information table single transmit that each data capture management node is returned is to data collection station.
Described data acquisition center system also comprises:
Safety certification node, communicate by letter with gateway routing node, monitor node, safety certificate memory node, for carrying out the safety certification of data collection station, authentication information in the terminal data collection application list that reception gateway routing node forwards, by the authentication of comparing of the certificate in authentication information and safety certificate memory node, authentication result is sent to gateway routing node.And, according to the uniqueness identify label of data collection station, generating authentication information, authentication information can play dress to store in the cipher key module of data collection station.
Safety certificate memory node, with safety certification node communication, for storing the safety certificate of data collection station;
Monitor node, with gateway routing node, safety certification node and log management node communication, for monitoring and control the running status of gateway routing node, safety certification node, log management node, guarantees that each node works online.
Log management node, with gateway routing node, safety certification node, data acquisition node, data capture management node, log store node communication, the record, the maintenance and management work that for each node of system, produce log information;
Log store node, with log management node communication, is responsible for the storage of daily record;
Data capture management node, communicate by letter with gateway routing node, log management node, some data acquisition nodes, receive the classify traffic report blocks collection application list that gateway routing node sends, according to routing strategy, be that each business report piece entry in classify traffic report blocks collection application list is chosen data acquisition node, form data acquisition node routing iinformation list; And, data acquisition node route information table single transmit, to gateway routing node, is pushed to corresponding data acquisition node according to the match information in data acquisition node routing iinformation list by communication information list simultaneously;
Data acquisition node, with data capture management node, acquired data storage node, data collection station, log management node communication, be responsible for the data acquisition of data collection station, for the transmission request of data collection station, set up communication and connect, be responsible for data acquisition resolving;
Acquired data storage node, communicates by letter with data acquisition node, the data that gather for storing each data acquisition node, and data access function is provided;
Time synchronization node, is used to all nodes in system that time synchronized service is provided.
Described gateway routing node, data capture management node and data acquisition node are according to the tree-like logical relation tissue that carries out; Gateway routing node is the root node of this tree structure, is connected with one or more data capture management nodes under it; Below each data capture management node, there are one or more data acquisition nodes.
Gateway routing node, data capture management node, data acquisition node, safety certification node, acquired data storage node, monitor node, time synchronized service node, safety certificate memory node, log management node, log store node, all above-mentioned application nodes allow to operate on same computer server, also allow a plurality of application nodes to operate on same computer server; And above-mentioned node allows to operate on same or a plurality of different cloud computing service platforms.
Described terminal data collection application list comprises authentication information, transmission security key information, business report piece summary information.
Described data collection station comprises master control borad, described master control borad respectively with power module, CPU module, memory module, communication module, display module, cipher key module, stipulations modular converter, input and output module, to time module, Keysheet module two-way communication.
Between described data collection station and some collected equipment, allowing to carry out communication by RS232, RS485, CAN bus, Ethernet, wireless mode is connected.Described collected equipment comprises that Internet of Things smart machine, the especially intelligent meter in the fields such as the traditional industry field apparatuss such as transducer, operating terminal, controller, device communication module, PLC or Smart Home, intelligent building, Intelligent logistics take into account Internet of Things smart machine in the intelligent grids such as senior measurement, intelligent power, electric automobile and charging.
Between described data collection station and gateway routing node and data acquisition node, allowing to using ICP/IP protocol by fiber optic Ethernet, wireless mode carries out communication as transport layer protocol and is connected.
The configuration effort that has needed authentication, transmission security key, business report piece summary information before described data collection station access said system.
The collecting method that above-mentioned data acquisition system is used, comprises step:
Step (1): data collection station is to gateway routing node transmitting terminal data acquisition application list;
Step (2): gateway routing node is that terminal data collection application list generates handling process, each handling process is an Erlang process, gateway routing node to the authentication information in safety certification node transmitting terminal data acquisition application list, waits for that safety certification node returns to the security certification result of this data collection station in this Erlang process; Gateway routing node is waited for new collection application simultaneously;
Step (3): safety certification node carries out safety certification according to the authentication information in terminal data collection application list to data collection station, and authentication result is sent to gateway routing node;
Step (4): if authentification failure, gateway routing node returns to data collection station by authentication result, finishes this handling process finishes to be responsible for the Erlang process of this processing simultaneously;
Step (5): if authentication is passed through, gateway routing node reorganizes business report piece summary information in terminal data collection application list according to the type of service of business report piece, forms the service order form list of classify traffic report blocks; Further, gateway routing node is submitted to the service order form list of classify traffic report blocks respectively some data capture management nodes of processing this type of service;
Step (6): after some data capture management nodes receive service order form list, according to preference policy, it is each the business report entries match data acquisition node in service order form list, tissue forms data acquisition node routing iinformation list, and routing iinformation list is back to gateway routing node; Data capture management node generates communication information list according to the match information of the data acquisition node in routing iinformation list and business report entry simultaneously, and communication information list has been pushed to the data acquisition node of coupling;
Step (7): gateway routing node receives the routing iinformation list that data capture management node returns, now routing iinformation list forms by a plurality of concrete business report piece entries with the combination entry of the routing iinformation of this business report piece entries match, and gateway routing node is delivered to routing iinformation list the data collection station of submitting to this collections to apply for; Gateway routing node is waited for returning of oriented data capture management node submit applications result by the Erlang treatment progress that this collection application generates always, if overtime, to data collection station, sends time-out information;
Step (8): if data collection station receives time-out information, or the data acquisition node in the routing iinformation list receiving is empty data acquisition node, data collection station finishes this application, and postpones after a period of time, to gateway routing node, initiates new collection application;
Step (9): data collection station is after receiving all routing iinformation lists that return, to the fixed data acquisition node of each routing iinformation list middle finger, initiate business report piece transmission request, data acquisition node transmits request for each sets up transmission channel, each transmission channel is an Erlang process, according to transfer of data key information corresponding to business report piece and Data Analysis mode, complete deciphering, parsing, storage and framing, encryption and the transmission of message transmission;
Step (10): data acquisition node stores image data into acquired data storage node according to storage policy by data;
At described step (1)-step (10) daily record of work that log management node real-time storage gateway routing node, safety certification node, data capture management node, data acquisition node produce in the process of implementation; The running status of gateway routing node, safety certification node, data acquisition node is monitored, safeguarded to monitor node in real time, when gateway routing node, safety certification node or data acquisition node occur when abnormal, monitor node attempts abnormal nodes to carry out reboot operation, and system for prompting attendant carries out troubleshooting in time; The time of time synchronization node Timing Synchronization gateway routing node, safety certification node, safety certificate memory node, monitor node, log management node, log store node, data capture management node, data acquisition node, acquired data storage node.
Terminal data collection application list in described step (1), comprises authentication information, transmission security key information, business report piece summary information.
Described authentication information is that this acquisition terminal equipment is at initial phase, by safety certificate management node, according to the uniqueness identify label of this data collection station, generated, and lower dress stores the cipher key module of data collection station into, this lower process of assembling is not reproducible to carry out, and irreversible.
Described transmission security key information is produced by data collection station cipher key module, transmission security key information in each new data acquisition application list can be different, data acquisition node can apply in this transmission the data after cipher key module is encrypted that send in transaction cycles by resolution data acquisition terminal by this key, and allow to send to the order of data collection station to be encrypted with this key, guarantee that this order can be identified by data collection station.
Described business report piece summary information is the initialized collectable data items for information of this image data acquisition terminal, comprises the business report set of blocks divided according to type of service and attribute thereof, the report blocks entry of report blocks set-inclusion, the measuring point that report blocks entry comprises, data store strategy and other attributes of measuring point.
Safety certification in described step (3), only has the data collection station through legal authentication could automatically be linked into system for guaranteeing.Safety certification node is verified that the authentication information of data collection station mate with the safety certificate in safety certificate memory node, if be verified return authentication, passes through result, otherwise authentification failure, return authentication does not pass through information.
Described step (5) particular content is: gateway routing node is resolved terminal data collection application list, according to the type of service of report blocks set in business report piece self-described information in this terminal data collection application list, form one or more service order form lists of classifying according to type of service, each service order form list comprises data collection station sign, data collection station transmission security key information, business gathers applying type, the data acquisition node order of supporting and the collection report blocks set of this business, wherein gather the one or more business report piece of report blocks set-inclusion entry, the measuring point that each entry comprises this entry, data store strategy and other descriptors.Gateway routing node need to gather applying type according to business and service order form single transmit be arrived to the data capture management node of processing such business.
Preference policy in described step (6), the preference policy of selecting in the data acquisition node of data capture management node under a plurality of node administrations comprises following factor: the physical function parameter of the IO load of data acquisition node, cpu load, core original paper, data collection station are to the Qos of data acquisition node.
IO load judges with the par of Erlang process in data acquisition node 30 minutes;
Cpu load judges with the average occupancy of CPU in 30 minutes;
The physical function parameter of core original paper comprises cpu temperature, hard disk temperature, cpu fan rotating speed;
Specific data acquisition terminal to the Qos account form of specific data acquisition node is: the data collection station of selecting to be positioned at this data collection station identical and close communication topology location from all and specific data acquisition node are kept in communication the data collection station connecting, take these data collection stations to the mean value of the Qos of specific data acquisition node as this data collection station to the Qos of this specified node, if there is not the data collection station of identical or close network topology position, allow not adopt this strategic factor.
Data acquisition node selects principle concrete in dominant strategy to be: IO load is low, cpu load is low, the physical function parameter of core original paper is normal, Qos is low.
Routing iinformation list in described step (6), be by data capture management node according to being that each business report entries match data acquisition node in service order form list is organized and formed according to preference policy, comprise data collection station sign and corresponding communications protocol type, acquisition node IP address, the acquisition node port numbers of business report piece.Communication information list in described step (6), be that data capture management node generates according to the data acquisition node match information in routing iinformation list, comprise that data collection station sign, data collection station transmission security key information, business gather data acquisition node order and the corresponding business report piece items for information of applying type, support.
The step of described step (9) is: data capture management node is a routing iinformation list of each service order form list generation, in service order form list, each report blocks entry is to should route information table Dan Zhongyi bar data acquisition node routing iinformation, and routing iinformation comprises communications protocol type, data acquisition node IP address and port numbers; Data collection station is initiated connection request to each data acquisition node, and data acquisition node be take the mode of Erlang process provides data acquisition channel as data collection station; Data collection station is being set up communication while being connected first with data acquisition node, and data acquisition node is described information in detail to data collection station request measuring point, and data collection station is uploaded the corresponding report blocks bar of this data acquisition node measuring point information now; After this key that data collection station and data acquisition node provide with data collection station carries out Data Encryption Transmission, and the analysis mode of stipulating in the measuring point self-described information that data acquisition node provides according to data collection station completes Data Analysis and data deposit.
Data storage in described step (10), data acquisition node transfers data to acquired data storage node, acquired data storage node completes data buffer storage according to predefined data store strategy as buffer memory deviation, the time interval, real time data section access function is provided and data persistence is arrived to database, database provides perdurable data access function; The data store strategy of different business datum report blocks also allows to customize description in report blocks.
Beneficial effect of the present invention:
1, data collection station configures by carrying out authentication information, transmission security key information, data point and business report piece summary information when the initialization, makes data collection station possess self-description ability, has realized the self-description data access of various field equipment.Data acquisition center system is by accepting the collection application list of data collection station, the self-described information of data query acquisition terminal, according to data collection station self-described information, resolve these three automation steps of storage, just can realize the data acquisition that increases data collection station newly without data acquisition centring system configuration is changed in the situation that.
2, system gathers application form single-shot by gateway routing node by business and delivers to data capture management node, by data capture management node, according to preference policy dynamic assignment data acquisition node, form routing iinformation list, and finally by gateway routing node, routing iinformation is returned to acquisition terminal.Under the cooperation of gateway routing node, by data capture management node, data acquisition node by work organization and adopt the technical implementation way of the corresponding acquisition channel of Erlang process, the dynamic autoization configuration of routing iinformation and the level and smooth adjustment of access channel capacity of data acquisition system have been realized.
3, in the present invention, gateway routing node is to enter data acquisition system the first entrance, without the service request of safety certification or encryption, can only enter gateway routing node, by gateway routing node, is carried out the forwarding of business or is abandoned; Business to data acquisition node is the data through safety certification and encryption.The mode that gateway route is combined with safety certification, has reduced the data acquisition system integral body risk that system is attacked under variety of network environments; Gateway routing node is separated with data acquisition node, the technical scheme of shielding acquisition node, fail safe and the availability of data acquisition system integral body have been improved, even gateway routing node is under attack, only affect the access of new data collection terminal, do not affect the normal data collection of original acquisition terminal of access data.
4, monitor node monitors the normal operation of gateway routing node, safety certification node, log management node, guarantees the stable operation of these nodes; Monitor node itself moves in hot standby mode simultaneously, guarantees each other the normal operation of monitor node.Whole monitoring has ensured system run all right.
5, data capture management node is chosen the optimization of data acquisition node, has guaranteed the load balancing of each data acquisition node.Data acquisition node be take the mode of Erlang process as data collection station provides data acquisition channel, realizes acquisition channel smooth expansion; And data collection station provides the configuration mode of exempting from of Data Analysis mode and measuring point information to acquisition node, avoided human configuration to cause loaded down with trivial details and possibility that make mistakes; Between data acquisition node and data collection station, adopt secret key encryption mode to carry out data communication simultaneously, strengthened the fail safe of communication.
6, native system is in running, except the data collection station of new connecting system being carried out to initialization operation, other nodes of data center systems all do not need to be configured the artificial participation of change, the workload that has reduced O&M personnel in system use procedure, has more guaranteed the operation that system safety is stable.
Accompanying drawing explanation
Fig. 1 is structural representation of the present invention;
Fig. 2 is data acquisition node administrative structure structural representation of the present invention;
Fig. 3 is monitor node work structuring schematic diagram of the present invention;
Fig. 4 is data collection station structural representation of the present invention;
Fig. 5 is data collection station of the present invention and collected equipment connection schematic diagram;
Fig. 6 is data collection task reciprocal process schematic diagram of the present invention;
Fig. 7 is collection application process schematic diagram of the present invention;
Fig. 8 is data collection station initializes configuration information schematic diagram of the present invention;
Fig. 9 is collection application list schematic diagram of the present invention;
Figure 10 is service order form list schematic diagram of the present invention;
Figure 11 is routing iinformation list schematic diagram of the present invention;
Figure 12 is communication information list schematic diagram of the present invention;
Wherein, 1. data collection station, 2. gateway routing node, 3. safety certification node, 4. safety certificate memory node, 5. monitor node, 6. log management node, 7. log store node, 8. data capture management node, 9. data acquisition node, 10. acquired data storage node, 11. time synchronization nodes; 21. power module, 22.CPU module, 23. memory modules, 24. communication modules, 25. display modules, 26. cipher key module, 27. stipulations modular converters, 28. input and output modules, module in the time of 29. pairs, 30. Keysheet modules, 31. collected equipment, 40. master control borads.
Embodiment
Below in conjunction with accompanying drawing and embodiment, the invention will be further described:
As shown in Figure 1, a data acquisition system for the level and smooth expansion of capable of dynamic, comprises data collection station 1, gateway routing node 2, safety certification node 3, data capture management node 8, data acquisition node 9, acquired data storage node 10, monitor node 5, time synchronization node 11, log management node 6, safety certificate memory node 4, log store node 7; Described data collection station 1 respectively with described gateway routing node 2 and data acquisition node 9 two-way communications; Described gateway routing node 2 respectively with log management node 6, monitor node 5, safety certification node 3,8 two-way communications of data capture management node; Described log management node 6 respectively with log store node 7, data acquisition node 9, data capture management node 8, safety certification node 3 and monitor node 5 two-way communications; Described safety certification node 3 respectively with monitor node 5,4 two-way communications of safety certificate memory node; Described data acquisition node 9 respectively with acquired data storage node 10 and 8 two-way communications of data capture management node.
Gateway routing node, data capture management node, data acquisition node, safety certification node, acquired data storage node, monitor node, time synchronized service node, safety certificate memory node, log management node, log store node, all above-mentioned application nodes can operate on a computer server by each node, also can operate on same computer server by a plurality of nodes, between each computer server, with proprietary optical-fibre channel or proprietary radio channel, connect, on geographical position, can be fixedly mounted on same room with them, can be arranged on a plurality of different cities, also can be in mobile status at a high speed.Further, above-mentioned each node may operate on same or a plurality of different Cloud Servers.
Described gateway routing node 2 is that data collection station 1 enters data acquisition system the first entrance, the routing iinformation of gateway routing node 2 is fixed and is open to all data collection stations 1, be responsible for the terminal data collection application list that deal with data acquisition terminal 1 is initiated to data acquisition system, comprise authentication information, transmission security key information, business report piece summary information.
Further, described gateway routing node 2, submit to safety certification node 3 to carry out authentication the authentication information in terminal data collection application list, wait for 3 processing of safety certification node, the identity authentication result that safety certification node 3 is returned is sent to data collection station 1.
Further, described gateway routing node 2, when safety certification is passed through, business report piece summary information in terminal data collection application list is reorganized according to the type of service of business report piece, form one or more classify traffic report blocks collection application lists, by type classify traffic report blocks collection application list is submitted to the data capture management node 8 of processing corresponding type of service.Wait for 8 processing of data capture management node, the data acquisition node 9 route information table single transmit that each data capture management node 8 is returned are to data collection station 1.
Described safety certification node 3 carries out the safety certification of data collection station 1, authentication information in the terminal data collection application list that reception gateway routing node 2 forwards, certificate in authentication information and safety certificate memory node 4 is carried out to safety certification, security certification result is sent to gateway routing node 2.Further, described safety certificate memory node 4 can generate authentication information according to the uniqueness identify label of data collection station 1, and authentication information can play dress to store in the cipher key module of data collection station 1.
The data acquisition node 9 of the one or more processing same line of business data of described data capture management node 8 management, receive the classify traffic report blocks collection application list that gateway routing node 2 sends, data capture management node 8 is that each business report piece in classify traffic report blocks collection application list is chosen data acquisition node 9 according to routing strategy, forms data acquisition node 9 routing iinformation lists.Further, data acquisition node 9 route information table single transmit, to gateway routing node 2, are pushed to corresponding data acquisition node 9 according to the match information in data acquisition node 9 routing iinformation lists by communication information list simultaneously.
Described data acquisition node 9 provides data acquisition channel for data collection station 1, when receiving the business report piece transmission request of data collection station 1, for transmission channel is set up in each transmission request, each transmission channel is an Erlang process, according to transfer of data key information corresponding to business report piece and Data Analysis mode, complete deciphering, parsing, storage and framing, encryption and the transmission of message transmission.
Described time synchronized server node 11, one or more in gps signal, the Big Dipper, B code, CDMA, atomic clock standard clock source of take are clock source, for the data collection station 1 in system, gateway routing node 2, safety certification node 3, data capture management node 8, data acquisition node 9, acquired data storage node 10, monitor node 5, log management node 6, safety certificate management node 4, log store node 7 carry out time synchronized, the mode of time synchronizing signal can be: NTP/SNTP signal, pulse signal, IRIG-B signal, time message.
The data that described each data acquisition node 9 of acquired data storage node 10 storages gathers, and data access function is provided.
Described log management node 6 is responsible for record, the maintenance and management work that each node of system produces log information, and log store node 7 is responsible for the storage of daily record.
Described monitor node 8 monitors and controls the running status of gateway routing node 2, safety certification node 3, log management node 6, guarantees that each node works online, and can adopt the hot standby mode of binode to move or trunking mode operation.
Between described data collection station 1 and collected equipment, can carry out communication by RS232, RS485, CAN bus, Ethernet, wireless mode is connected.
Further, between described data collection station 1 and gateway routing node 2 and data acquisition node 9, can carry out communication by fiber optic Ethernet, wireless mode is connected.
Further, described data collection station 1 is after completing authentication, transmission security key, the configuration of business report piece summary information, by data acquisition application submission of sheet gateway routing node 2, the data acquisition node 9 routing iinformation lists that return according to gateway routing node 2, connect with each data acquisition node 9 respectively, carry out Data Encryption Transmission.
As shown in Figure 2, system can comprise one or more data capture management nodes 8, the data acquisition node 9 of the one or more processing same line of business data of data capture management node 8 management, receive the classify traffic report blocks collection application list that gateway routing node 2 sends, data capture management node 8 is that each business report piece in classify traffic report blocks collection application list is chosen data acquisition node 9 according to routing strategy, forms data acquisition node 9 routing iinformation lists.Further, data acquisition node 9 route information table single transmit, to gateway routing node 2, are pushed to corresponding data acquisition node 9 according to the match information in data acquisition node 9 routing iinformation lists by communication information list simultaneously.
As shown in Figure 3, monitor node 5 respectively with gateway routing node 2, safety certification node 3,6 two-way communications of log management node, between described monitor node 5 and other monitor node 5, be also two-way communication; Monitor node 5 is with the hot standby pattern of node or trunking mode operation, gateway routing node 2, safety certification node 3, log management node 6 are to monitor node 5 registrations, and maintenance logs in state, if certain node operation occurs abnormal, monitor node 5 attempts malfunctioning node to carry out reboot operation, and system for prompting attendant carries out troubleshooting in time.
As shown in Figure 4, data collection station 1 comprises master control borad 40, described master control borad respectively with power module 21, CPU module 22, memory module 23, communication module 24, display module 25, cipher key module 26, stipulations modular converter 27, input and output module 28, to time module 29, Keysheet module 30 two-way communications.
As shown in Figure 5, data collection station 1 allows with different communication modes, to carry out data interaction from several collected equipment 31, and adoptable communication modes comprises RS232, RS485, CAN bus, Ethernet, wireless mode.
As shown in Figure 6, data collection task process schematic diagram:
S1. data collection station is to gateway routing node transmitting terminal data acquisition application list, to obtain data acquisition node routing iinformation;
S2. data collection station safety certification request: gateway routing node, to the authentication information in safety certification node transmitting terminal data acquisition application list, carries out the safety certification of data collection station;
S3. safety certification node carries out the safety certification of data collection station, and authentication result is back to gateway routing node.If authentification failure, carries out S6, and finishes this handling process, wait for new collection application; If authentication is passed through, carry out S4;
S4. gateway routing node reorganizes business report piece summary information in terminal data collection application list according to the type of service of business report piece, form classify traffic report blocks collection application list, and classify traffic report blocks collection application list is submitted to respectively to the data capture management node of processing this type of service, to obtain data acquisition node routing iinformation;
S5. data capture management node is chosen data acquisition node according to preference policy for applying for each the business report entry in list, tissue forms data acquisition node routing iinformation list, routing iinformation list is back to gateway routing node, and according to the match information in data acquisition node routing iinformation list, communication information list is pushed to corresponding data acquisition node;
S6. gateway routing node will receive data acquisition node routing iinformation list and deliver to data collection station;
S7. data collection station is initiated business report piece transmission request to the fixed data acquisition node of each routing iinformation list middle finger, data acquisition node be take Erlang process mode and is set up transmission channel as each transmission request, according to transfer of data key information corresponding to business report piece and Data Analysis mode, carry out deciphering, parsing, storage and framing, encryption and the transmission of message transmission;
S8. data storage.Data acquisition node stores image data into acquired data storage node according to storage policy by data.
As shown in Figure 7, gather application process schematic diagram:
S01. data collection station configuration, forms data collection station configuration documentation.
S02. data collection station sends and gathers application list to safe routing node.
S03. gateway routing node carries out data collection station authentication to safety certification node.
S04. safety certification node is to gateway routing node return authentication result.If authentification failure is carried out S05, successful execution S06.
S05. gateway routing node returns to application result to data collection station: authentification failure.
S06. gateway routing node forms service order form list, sends to data capture management node.
S07. gateway routing node is applied for overtime judgement, overtimely to data collection station, returns to application result: apply for overtime.
S08. data capture management node is to gateway routing node return data acquisition node routing iinformation list, and pushes communication information list to data acquisition node.
S09. gateway routing node sends data acquisition node routing iinformation list to data collection station.
S10. data collection station receives after all routing iinformation lists, gathers and applies for successfully.
As shown in Figure 8, the configuration documentation of data collection station, comprises file header, business report block message, measuring point information.File header is the essential information of data collection station, comprise data collection station title, data collection station uniqueness sign, data collection station model, manufacturer, founder and creation-time, safety certification node is according to the authentication information of data collection station uniqueness sign generated data acquisition terminal; Business report block message provides foundation for data capture management node selection data acquisition node, each equipment can configure a plurality of report blocks set according to type of service, report blocks aggregate attribute comprises data acquisition node order and the Data Analysis mode of type of service, support, each report blocks set can configure one or more report blocks entries according to measuring point quantity or other factors, the report blocks bar ID that configuration data memory attribute comprises measuring point as memory gap, storage deviation and this entry now; Measuring point information configuration ID and the specifying information of each measuring point, as measuring point title, measuring point type, measuring point are controlled type and other information needed.
As shown in Figure 9, data acquisition application list, comprises authentication information, transmission security key information, business report piece summary information.Authentication information is at equipment configuration phase, generated, and lower dress stores the cipher key module of data collection station into by safety certificate management node according to the uniqueness identify label of this data collection station; Transmission security key information is produced by data collection station cipher key module; Business report piece summary information is business report block message in data collection station configuration documentation, comprises the business report piece collection divided according to type of service and attribute thereof, the report blocks entry of report blocks set-inclusion, measuring point, data store strategy and other attributes that report blocks entry comprises.
As shown in figure 10, service order form list, to be generated according to the type of service that gathers report blocks set in application list business report piece summary information by gateway routing node, each service order form list comprises that data collection station sign, data collection station transmission security key information, business gather data acquisition node order and the business collection report collection of applying type, support, wherein business collection report collection comprises one or more business report piece entries, the measuring point that each entry comprises this entry, data store strategy and other descriptors.
As shown in figure 11, routing iinformation list, data capture management node is that each service order form list generates a routing iinformation list, in service order form list, each report blocks entry is to should route information table Dan Zhongyi bar data acquisition node routing iinformation, and routing iinformation comprises communications protocol type, data acquisition node IP address and port numbers.
As shown in figure 12, communication information list, data capture management node generates according to the data acquisition node match information in routing iinformation list, comprises that data collection station sign, data collection station transmission security key information, business gather data acquisition node order and the corresponding business report piece items for information of applying type, support.
Although above-mentioned, by reference to the accompanying drawings the specific embodiment of the present invention is described; but be not limiting the scope of the invention; one of ordinary skill in the art should be understood that; on the basis of technical scheme of the present invention, those skilled in the art do not need to pay various modifications that creative work can make or distortion still in protection scope of the present invention.

Claims (10)

1. a data acquisition system for the level and smooth expansion of capable of dynamic, is characterized in that, comprising: data acquisition center system and data collection station;
Described data acquisition center system is communicated by letter with described data collection station by communication network,
Described data acquisition center system is the core of data acquisition system, is responsible for data acquisition, management, safety certification, storage and log services;
Described data collection station by the transfer of data of collected equipment to data acquisition node, and by data acquisition application submission of sheet gateway routing node, the data acquisition node routing iinformation list returning according to gateway routing node, initiate business report piece transmission request with each data acquisition node respectively, carry out Data Encryption Transmission;
Described communication network is responsible for the physical link that data collection station is provided to data acquisition center system;
Described data acquisition center system comprises:
Gateway routing node, with data collection station, some data capture management nodes, safety certification node, monitor node and log management node communication, that data collection station enters data acquisition center system the first entrance by communication network, the routing iinformation of gateway routing node is fixed, open to all data collection stations, be responsible for the terminal data collection application list that deal with data acquisition terminal is initiated to data acquisition center system; And, submit to safety certification node to carry out authentication the authentication information in terminal data collection application list, the identity authentication result that safety certification node is returned is sent to data collection station; And, after safety certification is passed through, business report piece summary information in terminal data collection application list is reorganized according to the type of service of business report piece, form one or more classify traffic report blocks collection application lists; By type of service, classify traffic report blocks collection application list is submitted to the data capture management node of processing this type of service, the data acquisition node route information table single transmit that each data capture management node is returned is to data collection station.
2. the data acquisition system of the level and smooth expansion of a kind of capable of dynamic as claimed in claim 1, is characterized in that,
Described data acquisition center system also comprises:
Safety certification node, communicate by letter with gateway routing node, monitor node, safety certificate memory node, for carrying out the safety certification of data collection station, authentication information in the terminal data collection application list that reception gateway routing node forwards, by the authentication of comparing of the certificate in authentication information and safety certificate memory node, authentication result is sent to gateway routing node; And, according to the uniqueness identify label of data collection station, generating authentication information, authentication information allows lower dress to store in the cipher key module of data collection station;
Safety certificate memory node, with safety certification node communication, for storing the safety certificate of data collection station;
Monitor node, with gateway routing node, safety certification node and log management node communication, for monitoring and control the running status of gateway routing node, safety certification node, log management node, guarantees that each node works online;
Log management node, with gateway routing node, safety certification node, data acquisition node, data capture management node, log store node communication, the record, the maintenance and management work that for each node of system, produce log information;
Log store node, with log management node communication, is responsible for the storage of daily record;
Data capture management node, communicate by letter with gateway routing node, log management node, some data acquisition nodes, receive the classify traffic report blocks collection application list that gateway routing node sends, according to routing strategy, be that each business report piece entry in classify traffic report blocks collection application list is chosen data acquisition node, form data acquisition node routing iinformation list; And, data acquisition node route information table single transmit, to gateway routing node, is pushed to corresponding data acquisition node according to the match information in data acquisition node routing iinformation list by communication information list simultaneously;
Data acquisition node, with data capture management node, acquired data storage node, data collection station, log management node communication, be responsible for the data acquisition of data collection station, for the transmission request of data collection station, set up communication and connect, be responsible for data acquisition resolving;
Acquired data storage node, communicates by letter with data acquisition node, the data that gather for storing each data acquisition node, and data access function is provided;
Time synchronization node, is used to all nodes in system that time synchronized service is provided.
3. the collecting method that the data acquisition system of the level and smooth expansion of a kind of capable of dynamic as described in above-mentioned arbitrary claim is used, is characterized in that, comprises step:
Step (1): data collection station is to gateway routing node transmitting terminal data acquisition application list;
Step (2): gateway routing node is that terminal data collection application list generates handling process, each handling process is an Erlang process, gateway routing node to the authentication information in safety certification node transmitting terminal data acquisition application list, waits for that safety certification node returns to the security certification result of this data collection station in this Erlang process; Gateway routing node is waited for new collection application simultaneously;
Step (3): safety certification node carries out safety certification according to the authentication information in terminal data collection application list to data collection station, and authentication result is sent to gateway routing node;
Step (4): if authentification failure, gateway routing node returns to data collection station by authentication result, finishes this handling process finishes to be responsible for the Erlang process of this processing simultaneously;
Step (5): if authentication is passed through, gateway routing node reorganizes business report piece summary information in terminal data collection application list according to the type of service of business report piece, forms the service order form list of classify traffic report blocks; Further, gateway routing node is submitted to the service order form list of classify traffic report blocks respectively some data capture management nodes of processing this type of service;
Step (6): after some data capture management nodes receive service order form list, according to preference policy, it is each the business report entries match data acquisition node in service order form list, tissue forms data acquisition node routing iinformation list, and routing iinformation list is back to gateway routing node; Data capture management node generates communication information list according to the match information of the data acquisition node in routing iinformation list and business report entry simultaneously, and communication information list has been pushed to the data acquisition node of coupling;
Step (7): gateway routing node receives the routing iinformation list that data capture management node returns, now routing iinformation list forms by a plurality of concrete business report piece entries with the combination entry of the routing iinformation of this business report piece entries match, and gateway routing node is delivered to routing iinformation list the data collection station of submitting to this collections to apply for; Gateway routing node is waited for returning of oriented data capture management node submit applications result by the Erlang treatment progress that this collection application generates always, if overtime, to data collection station, sends time-out information;
Step (8): if data collection station receives time-out information, or the data acquisition node in the routing iinformation list receiving is empty data acquisition node, data collection station finishes this application, and postpones after a period of time, to gateway routing node, initiates new collection application;
Step (9): data collection station is after receiving all routing iinformation lists that return, to the fixed data acquisition node of each routing iinformation list middle finger, initiate business report piece transmission request, data acquisition node transmits request for each sets up transmission channel, each transmission channel is an Erlang process, according to transfer of data key information corresponding to business report piece and Data Analysis mode, complete deciphering, parsing, storage and framing, encryption and the transmission of message transmission;
Step (10): data acquisition node stores image data into acquired data storage node according to storage policy by data; The daily record of work that log management node real-time storage gateway routing node, safety certification node, data capture management node, data acquisition node produce in described step (1)-step (10) implementation; The running status of gateway routing node, safety certification node, data acquisition node is monitored, safeguarded to monitor node in real time, when gateway routing node, safety certification node or data acquisition node occur when abnormal, monitor node attempts abnormal nodes to carry out reboot operation, and system for prompting attendant carries out troubleshooting in time; The time of time synchronization node Timing Synchronization gateway routing node, safety certification node, safety certificate memory node, monitor node, log management node, log store node, data capture management node, data acquisition node, acquired data storage node.
4. method as claimed in claim 3, is characterized in that, the terminal data collection application list in described step (1), comprises authentication information, transmission security key information, business report piece summary information;
Described authentication information is that this acquisition terminal equipment is at initial phase, by safety certificate management node, according to the uniqueness identify label of this data collection station, generated, and lower dress stores the cipher key module of data collection station into, this lower process of assembling does not allow to repeat, and irreversible;
Described transmission security key information is produced by data collection station cipher key module, transmission security key information in each new data acquisition application list can be different, data acquisition node can apply in this transmission the data after cipher key module is encrypted that send in transaction cycles by resolution data acquisition terminal by this key, and allow to send to the order of data collection station to be encrypted with this key, guarantee that this order can be identified by data collection station;
Described business report piece summary information is the data items for information that the initialized permission of this image data acquisition terminal gathers, and comprises the business report set of blocks divided according to type of service and attribute thereof, the report blocks entry of report blocks set-inclusion, the measuring point that report blocks entry comprises, data store strategy and other attributes of measuring point.
5. method as claimed in claim 3, is characterized in that, the safety certification in described step (3) only has the data collection station through legal authentication could automatically be linked into system for guaranteeing; Safety certification node is verified that the authentication information of data collection station mate with the safety certificate in safety certificate memory node, if be verified return authentication, passes through result, otherwise authentification failure, return authentication does not pass through information.
6. method as claimed in claim 3, it is characterized in that, described step (5) particular content is: gateway routing node is resolved terminal data collection application list, according to the type of service of report blocks set in business report piece self-described information in this terminal data collection application list, form one or more service order form lists of classifying according to type of service, each service order form list comprises data collection station sign, data collection station transmission security key information, business gathers applying type, the data acquisition node order of supporting and the collection report blocks set of this business, wherein gather the one or more business report piece of report blocks set-inclusion entry, the measuring point that each entry comprises this entry, data store strategy and other descriptors, gateway routing node need to gather applying type according to business and service order form single transmit be arrived to the data capture management node of processing such business.
7. method as claimed in claim 3, it is characterized in that, preference policy in described step (6), the preference policy of selecting in the data acquisition node of data capture management node under a plurality of node administrations comprises following factor: the physical function parameter of the IO load of data acquisition node, cpu load, core original paper, data collection station are to the Qos of data acquisition node;
IO load judges with the par of Erlang process in data acquisition node 30 minutes;
Cpu load judges with the average occupancy of CPU in 30 minutes;
The physical function parameter of core original paper comprises cpu temperature, hard disk temperature, cpu fan rotating speed;
Specific data acquisition terminal to the Qos account form of specific data acquisition node is: the data collection station of selecting to be positioned at this data collection station identical and close communication topology location from all and specific data acquisition node are kept in communication the data collection station connecting, take these data collection stations to the mean value of the Qos of specific data acquisition node as this data acquisition data collection station to the Qos of this specified node, if there is not the data collection station of identical or close network topology position, allow not adopt this strategic factor;
Data acquisition node selects principle concrete in dominant strategy to be: IO load is low, cpu load is low, the physical function parameter of core original paper is normal, Qos is low.
8. method as claimed in claim 3, it is characterized in that, routing iinformation list in described step (6), be by data capture management node according to being that each business report entries match data acquisition node in service order form list is organized and formed according to preference policy, comprise data collection station sign and corresponding communications protocol type, acquisition node IP address, the acquisition node port numbers of business report piece;
Communication information list in described step (6), be that data capture management node generates according to the data acquisition node match information in routing iinformation list, comprise that data collection station sign, data collection station transmission security key information, business gather data acquisition node order and the corresponding business report piece items for information of applying type, support.
9. method as claimed in claim 3, it is characterized in that, the step of described step (9) is: data capture management node is a routing iinformation list of each service order form list generation, in service order form list, each report blocks entry is to should route information table Dan Zhongyi bar data acquisition node routing iinformation, and routing iinformation comprises communications protocol type, data acquisition node IP address and port numbers; Data collection station is initiated connection request to each data acquisition node, and data acquisition node be take the mode of Erlang process provides data acquisition channel as data collection station; Data collection station is being set up communication while being connected first with data acquisition node, and data acquisition node is described information in detail to data collection station request measuring point, and data collection station is uploaded the corresponding report blocks bar of this data acquisition node measuring point information now; After this key that data collection station and data acquisition node provide with data collection station carries out Data Encryption Transmission, and the analysis mode of stipulating in the measuring point self-described information that data acquisition node provides according to data collection station completes Data Analysis and data deposit.
10. method as claimed in claim 3, it is characterized in that, data storage in described step (10), data acquisition node transfers data to acquired data storage node, acquired data storage node completes data buffer storage according to predefined data store strategy as buffer memory deviation, the time interval, real time data section access function is provided and data persistence is arrived to database, database provides perdurable data access function; The data store strategy of different business datum report blocks also allows to customize description in report blocks.
CN201310516800.4A 2013-10-28 2013-10-28 A kind of can dynamic smoothing extension data collecting system and method Active CN103532975B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310516800.4A CN103532975B (en) 2013-10-28 2013-10-28 A kind of can dynamic smoothing extension data collecting system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310516800.4A CN103532975B (en) 2013-10-28 2013-10-28 A kind of can dynamic smoothing extension data collecting system and method

Publications (2)

Publication Number Publication Date
CN103532975A true CN103532975A (en) 2014-01-22
CN103532975B CN103532975B (en) 2016-08-17

Family

ID=49934654

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310516800.4A Active CN103532975B (en) 2013-10-28 2013-10-28 A kind of can dynamic smoothing extension data collecting system and method

Country Status (1)

Country Link
CN (1) CN103532975B (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104869567A (en) * 2015-04-01 2015-08-26 成都艺辰德迅科技有限公司 Information processing method based on intelligent terminals of internet of things
CN106125678A (en) * 2016-06-14 2016-11-16 国电南瑞科技股份有限公司 A kind of method in the self adaptation many control source for centralized intelligence gateway
CN107094155A (en) * 2017-06-14 2017-08-25 广东工业大学 A kind of secure storage method of data and device based on alliance's block chain
WO2018137202A1 (en) * 2017-01-25 2018-08-02 华为技术有限公司 Method, apparatus, and system for transmitting data
CN109074403A (en) * 2016-05-13 2018-12-21 株式会社日立制作所 Operation management device, operation management method and operation management system
CN109067932A (en) * 2018-07-24 2018-12-21 广州贯行电能技术有限公司 A kind of data collection station data transmission method and data service end without fixed IP
CN109587142A (en) * 2018-12-10 2019-04-05 北京华虹集成电路设计有限责任公司 A kind of the data safety AM access module and equipment of service-oriented stream
CN109587138A (en) * 2018-12-06 2019-04-05 中电工业互联网有限公司 A kind of fault-tolerant dynamic dispatching method of Internet of things system service node and server
CN109714334A (en) * 2018-12-26 2019-05-03 珠海格力电器股份有限公司 Method, device, processor, circuit and storage medium for transmitting air conditioner data
CN110716986A (en) * 2019-10-17 2020-01-21 华普通用技术研究(广州)有限公司 Big data analysis system and application method thereof
CN110809025A (en) * 2019-09-29 2020-02-18 四川中曼电气工程技术有限公司 Data acquisition and monitoring method based on data routing gateway
CN111465014A (en) * 2015-08-24 2020-07-28 华为技术有限公司 Security authentication method, configuration method and related equipment
CN111787286A (en) * 2020-07-22 2020-10-16 杭州当虹科技股份有限公司 Method for realizing multichannel synchronous recording system
CN111817935A (en) * 2020-07-24 2020-10-23 广州云智通讯科技有限公司 Internet intelligent home data processing method and system
CN111885164A (en) * 2020-07-23 2020-11-03 广东电网有限责任公司 Data management system
CN111935090A (en) * 2020-07-07 2020-11-13 上海微亿智造科技有限公司 Big data transmission and persistence method and system for industrial intelligent Internet of things
US10906425B2 (en) * 2018-04-05 2021-02-02 Ford Global Technologies, Llc Systems and methods to generate charging warnings
CN112583781A (en) * 2019-09-30 2021-03-30 中兴通讯股份有限公司 Media code stream acquisition method, equipment, media gateway and storage medium
CN112968908A (en) * 2021-03-26 2021-06-15 中国电子科技集团公司第三十研究所 Internet of things security gateway with data aggregation and one-way transmission and implementation method
CN115988038A (en) * 2023-03-20 2023-04-18 睿至科技集团有限公司 Data management method and system based on Internet of things platform
CN116319088A (en) * 2023-05-17 2023-06-23 深圳前海翼联科技有限公司 Method for monitoring route node state and collecting information of Internet of things
CN116367157A (en) * 2023-06-01 2023-06-30 深圳市北测检测技术有限公司 Security authentication method and device based on 5G communication network
CN117950591A (en) * 2024-01-18 2024-04-30 北京微控工业网关技术有限公司 Gateway storage management method and device, electronic equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070155394A1 (en) * 2005-12-30 2007-07-05 Enfotrust Networks, Inc. System and method for facilitating the transfer of information relating to quality of an organization
CN101032427A (en) * 2007-04-27 2007-09-12 周钷 Digital-signal intelligent monitoring method and application system thereof
US20080215743A1 (en) * 2007-03-02 2008-09-04 Mark Frederick Wahl System and method for validation of middleware failover behavior
US20080219532A1 (en) * 2007-03-06 2008-09-11 General Electric Company Geometry-dependent filtering in CT method and apparatus
CN101360011A (en) * 2008-09-26 2009-02-04 广州市聚晖电子科技有限公司 Management system supporting different data collection service
CN101399780A (en) * 2008-11-12 2009-04-01 清华大学 Quasi minimum state flow control method for Internet
CN101488206A (en) * 2008-01-16 2009-07-22 张道光 Electronic transaction method and electronic transaction platform system
US8510830B2 (en) * 2011-06-03 2013-08-13 Fluke Corporation Method and apparatus for efficient netflow data analysis

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070155394A1 (en) * 2005-12-30 2007-07-05 Enfotrust Networks, Inc. System and method for facilitating the transfer of information relating to quality of an organization
US20080215743A1 (en) * 2007-03-02 2008-09-04 Mark Frederick Wahl System and method for validation of middleware failover behavior
US20080219532A1 (en) * 2007-03-06 2008-09-11 General Electric Company Geometry-dependent filtering in CT method and apparatus
CN101032427A (en) * 2007-04-27 2007-09-12 周钷 Digital-signal intelligent monitoring method and application system thereof
CN101488206A (en) * 2008-01-16 2009-07-22 张道光 Electronic transaction method and electronic transaction platform system
CN101360011A (en) * 2008-09-26 2009-02-04 广州市聚晖电子科技有限公司 Management system supporting different data collection service
CN101399780A (en) * 2008-11-12 2009-04-01 清华大学 Quasi minimum state flow control method for Internet
US8510830B2 (en) * 2011-06-03 2013-08-13 Fluke Corporation Method and apparatus for efficient netflow data analysis

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104869567A (en) * 2015-04-01 2015-08-26 成都艺辰德迅科技有限公司 Information processing method based on intelligent terminals of internet of things
CN104869567B (en) * 2015-04-01 2018-04-27 青岛中物云传智能科技有限公司 A kind of information processing method based on Intelligent terminal for Internet of things
US11343104B2 (en) 2015-08-24 2022-05-24 Huawei Technologies Co., Ltd. Method for establishing secured connection, and related device
CN111465014A (en) * 2015-08-24 2020-07-28 华为技术有限公司 Security authentication method, configuration method and related equipment
CN109074403A (en) * 2016-05-13 2018-12-21 株式会社日立制作所 Operation management device, operation management method and operation management system
CN106125678A (en) * 2016-06-14 2016-11-16 国电南瑞科技股份有限公司 A kind of method in the self adaptation many control source for centralized intelligence gateway
WO2018137202A1 (en) * 2017-01-25 2018-08-02 华为技术有限公司 Method, apparatus, and system for transmitting data
CN107094155A (en) * 2017-06-14 2017-08-25 广东工业大学 A kind of secure storage method of data and device based on alliance's block chain
CN107094155B (en) * 2017-06-14 2020-03-10 广东工业大学 Data security storage method and device based on alliance block chain
US10906425B2 (en) * 2018-04-05 2021-02-02 Ford Global Technologies, Llc Systems and methods to generate charging warnings
CN109067932A (en) * 2018-07-24 2018-12-21 广州贯行电能技术有限公司 A kind of data collection station data transmission method and data service end without fixed IP
CN109587138A (en) * 2018-12-06 2019-04-05 中电工业互联网有限公司 A kind of fault-tolerant dynamic dispatching method of Internet of things system service node and server
CN109587142B (en) * 2018-12-10 2022-08-16 北京华虹集成电路设计有限责任公司 Data security access module and equipment for service flow
CN109587142A (en) * 2018-12-10 2019-04-05 北京华虹集成电路设计有限责任公司 A kind of the data safety AM access module and equipment of service-oriented stream
CN109714334A (en) * 2018-12-26 2019-05-03 珠海格力电器股份有限公司 Method, device, processor, circuit and storage medium for transmitting air conditioner data
CN110809025A (en) * 2019-09-29 2020-02-18 四川中曼电气工程技术有限公司 Data acquisition and monitoring method based on data routing gateway
CN112583781A (en) * 2019-09-30 2021-03-30 中兴通讯股份有限公司 Media code stream acquisition method, equipment, media gateway and storage medium
CN112583781B (en) * 2019-09-30 2024-04-12 中兴通讯股份有限公司 Media code stream acquisition method, device, media gateway and storage medium
CN110716986A (en) * 2019-10-17 2020-01-21 华普通用技术研究(广州)有限公司 Big data analysis system and application method thereof
CN111935090B (en) * 2020-07-07 2021-04-06 上海微亿智造科技有限公司 Big data transmission and persistence method and system for industrial intelligent Internet of things
CN111935090A (en) * 2020-07-07 2020-11-13 上海微亿智造科技有限公司 Big data transmission and persistence method and system for industrial intelligent Internet of things
CN111787286B (en) * 2020-07-22 2022-04-15 杭州当虹科技股份有限公司 Method for realizing multichannel synchronous recording system
CN111787286A (en) * 2020-07-22 2020-10-16 杭州当虹科技股份有限公司 Method for realizing multichannel synchronous recording system
CN111885164B (en) * 2020-07-23 2023-08-25 广东电网有限责任公司 Data management system
CN111885164A (en) * 2020-07-23 2020-11-03 广东电网有限责任公司 Data management system
CN111817935B (en) * 2020-07-24 2021-12-24 浙江超人科技股份有限公司 Internet intelligent home data processing method and system
CN111817935A (en) * 2020-07-24 2020-10-23 广州云智通讯科技有限公司 Internet intelligent home data processing method and system
CN112968908B (en) * 2021-03-26 2022-02-08 中国电子科技集团公司第三十研究所 Internet of things security gateway with data aggregation and one-way transmission and implementation method
CN112968908A (en) * 2021-03-26 2021-06-15 中国电子科技集团公司第三十研究所 Internet of things security gateway with data aggregation and one-way transmission and implementation method
CN115988038A (en) * 2023-03-20 2023-04-18 睿至科技集团有限公司 Data management method and system based on Internet of things platform
CN115988038B (en) * 2023-03-20 2023-08-01 睿至科技集团有限公司 Data management method and system based on Internet of things platform
CN116319088A (en) * 2023-05-17 2023-06-23 深圳前海翼联科技有限公司 Method for monitoring route node state and collecting information of Internet of things
CN116319088B (en) * 2023-05-17 2023-08-29 深圳前海翼联科技有限公司 Method for monitoring route node state and collecting information of Internet of things
CN116367157A (en) * 2023-06-01 2023-06-30 深圳市北测检测技术有限公司 Security authentication method and device based on 5G communication network
CN116367157B (en) * 2023-06-01 2023-08-01 深圳市北测检测技术有限公司 Security authentication method and device based on 5G communication network
CN117950591A (en) * 2024-01-18 2024-04-30 北京微控工业网关技术有限公司 Gateway storage management method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN103532975B (en) 2016-08-17

Similar Documents

Publication Publication Date Title
CN103532975A (en) Dynamically and smoothly expandable data acquisition system and method
CN106850611B (en) Cross-system Internet of things secure communication technology service platform method
US10992494B2 (en) Gateway round-robin system
RU2546065C2 (en) Communication method, device and system
CN104601665A (en) System and method for real-time cloud simulation on Internet of things sensing device
CN101873343A (en) Internet of things networking method and system thereof
CN106162639B (en) SDN wireless network management platform and authentication method based on Floodlight
CN110851278A (en) Distribution network automation master station mobile application service management method and system based on micro-service architecture
CN108616506B (en) Intelligent building real-time data distributed integrated control method
CN102006309A (en) Method for performing real-time communication between manufacturing execution system (MES) and process control system (PCS) and middleware
CN105450654A (en) Smart home development platform based on middleware technology and business development method thereof
CN102932431A (en) Message-routing-based state monitoring data interface configuration method
CN106027287A (en) Unified management and control platform for power distribution communication networks
CN107786671A (en) A kind of power equipment remote test system
CN106301916A (en) A kind of multiple network equipment unifies collocation method
Ferrari et al. Evaluation of communication delay in IoT applications based on OPC UA
CN103051502A (en) System and method of self-organized networking and flexible accessing of intelligent power equipment in electricity utilization community
CN207117673U (en) A kind of Internet of things system based on mixed cloud
Gopalakrishnan et al. Applications of emerging communication trends in automation
CN111953771A (en) Power distribution Internet of things management system
CN104270432A (en) Real-time data service system and data interaction method based on drilling industry
CN105847428A (en) Mobile cloud platform
CN114760318B (en) Edge computing management method and system
CN113824801B (en) Intelligent integration terminal unified access management component system
CN103118105B (en) A kind of querying method of the data query system based on wireless sensor network

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CP03 Change of name, title or address

Address after: 100031 Xicheng District West Chang'an Avenue, No. 86, Beijing

Co-patentee after: Electric Power Research Institute of State Grid Shandong Electric Power Company

Patentee after: State Grid Corporation of China

Co-patentee after: National Network Intelligent Technology Co., Ltd.

Address before: 250002, No. 1, South Second Ring Road, Shizhong District, Shandong, Ji'nan

Co-patentee before: Electric Power Research Institute of State Grid Shandong Electric Power Company

Patentee before: State Grid Corporation of China

Co-patentee before: Shandong Luneng Intelligent Technology Co., Ltd.

CP03 Change of name, title or address
TR01 Transfer of patent right

Effective date of registration: 20201029

Address after: 250101 Electric Power Intelligent Robot Production Project 101 in Jinan City, Shandong Province, South of Feiyue Avenue and East of No. 26 Road (ICT Industrial Park)

Patentee after: National Network Intelligent Technology Co.,Ltd.

Address before: 100031 Xicheng District West Chang'an Avenue, No. 86, Beijing

Patentee before: STATE GRID CORPORATION OF CHINA

Patentee before: ELECTRIC POWER RESEARCH INSTITUTE OF STATE GRID SHANDONG ELECTRIC POWER Co.

Patentee before: National Network Intelligent Technology Co.,Ltd.

TR01 Transfer of patent right