CN108833490A - A kind of distributed data acquisition system and its method - Google Patents
A kind of distributed data acquisition system and its method Download PDFInfo
- Publication number
- CN108833490A CN108833490A CN201810507072.3A CN201810507072A CN108833490A CN 108833490 A CN108833490 A CN 108833490A CN 201810507072 A CN201810507072 A CN 201810507072A CN 108833490 A CN108833490 A CN 108833490A
- Authority
- CN
- China
- Prior art keywords
- data
- acquisition
- collector
- sent
- transmitter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0823—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
- H04L41/0836—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability to enhance reliability, e.g. reduce downtime
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of distributed data acquisition system and its methods, including multiple acquisition nodes；Each acquisition node includes collector, reorganizer, transmitter and configuration file；Collector with data source for docking, and the data for obtaining data source are sent to reorganizer；Reorganizer is used to carry out unified data preparation to the data that collector is sent according to default arrangement rule, obtains arrangement result and is sent to transmitter；Transmitter is sent in Preset Transfer object for that will arrange result；The type of the data source acquired in configuration file comprising collector, default arrangement rule and Preset Transfer object, Preset Transfer object include the database of big data platform.The repertoire that data acquire is integrated in an acquisition node by the present invention, simplify the architecture design of distributed data acquisition system, and distributed data acquisition system is enabled only to be made of a kind of this acquisition node, reduce influence of the node failure to system, the high reliablity of system.
Description
Technical field
The present invention relates to big data acquisition technique fields, more particularly to a kind of distributed data acquisition system and its side
Method.
Background technique
Nowadays big data is increasingly taken seriously, and data acquisition is the essential function of all big data platforms.Nowadays it passes
The data collection system of system generallys use distributed structure/architecture, and node is divided by function, and system node is divided into agent node, is received
Collect node and host node.Agent node is responsible for collecting data from data source, and collector node is responsible for polymerizeing the number of each agent node
According to the database for being sent to big data platform, host node is responsible for the whole activity for managing agent node and collector node.
Such framework can satisfy high performance data acquisition session, but since the division of labor of different nodes is different, improve
The complexity of system architecture arrangement, and under this framework, it is likely to influence whole system if a node breaks down
Work normally, such as if host node failure, if not including other host nodes in system, so when whole system can lose management
The function of agent node and collector node.It can be seen that the reliability of system is low under this framework.
Therefore, the distributed data acquisition system and its method for how providing a kind of high reliablity are those skilled in the art
Problem to be solved at present.
Summary of the invention
The object of the present invention is to provide a kind of distributed data acquisition system and its method, the repertoire that data are acquired
It is integrated in an acquisition node, simplifies the architecture design of distributed data acquisition system, and enable distributed data acquisition system
It is only made of acquisition node, reduces influence of the node failure to system, improve the reliability of system.
In order to solve the above technical problems, the present invention provides a kind of distributed data acquisition systems, including：Multiple acquisition sections
Point；Each acquisition node includes collector, reorganizer, transmitter and configuration file；
The data that the collector is used to dock with data source, and obtain the data source are sent to the reorganizer；
The reorganizer is used to carry out unified data to the data that the collector is sent according to default arrangement rule whole
Reason obtains arrangement result and is sent to the transmitter；
The transmitter is for the arrangement result to be sent in Preset Transfer object；
Type, the default arrangement rule and the institute of data source comprising collector acquisition in the configuration file
Preset Transfer object is stated, the Preset Transfer object includes the database of big data platform.
Preferably, the data source includes database and/or log.
Preferably, the data source further includes the transmission of acquisition node that the configuration file limits, in addition to itself
Device；
Correspondingly, the Preset Transfer object further includes acquisition node that the configuration file limits, in addition to itself
Collector.
Preferably, the reorganizer specifically includes：
Useful data extraction module, for being extracted out of the collector is sent data according to the default arrangement rule
Useful data；
Format converting module, for the useful data to be converted to the data lattice set in the default arrangement rule
Formula；
File storage module, for obtaining acquisition data file as institute in the data deposit file after converting format
It states arrangement result and is sent to the transmitter.
It preferably, further include first timer in the collector；
The first timer is used for after the collector is docked with the data source, sets acquisition time section, timing
It controls the collector and obtains data in the data source in the acquisition time section.
It preferably, further include second timer in the transmitter；
The second timer is used for after receiving the arrangement result, is set the triggered time, is transmitted described in clocked flip
Device is sent in the arrangement result to the Preset Transfer object.
Preferably, the configuration file further includes dormant state, and the dormant state includes suspend mode and non-suspend mode two
State, the acquisition node in dormant state do not work, the acquisition node work in non-dormant state.
In order to solve the above technical problems, being based on any of the above the present invention also provides a kind of distribution type data collection method
System described in；The method includes：
Collector in each acquisition node is docked with data source, and the data for obtaining the data source are sent to same acquisition
Reorganizer in node；
The reorganizer carries out unified data preparation to the data that the collector is sent according to default arrangement rule, obtains
The transmitter in same acquisition node is sent to result is arranged；
The arrangement result is sent in Preset Transfer object by the transmitter；The Preset Transfer object includes big number
According to the database of platform.
The present invention provides a kind of distributed data acquisition systems, include multiple acquisition nodes, and each acquisition node wraps
Include collector, reorganizer, transmitter and configuration file.I.e. data collection, arrangement, transmission, management are integrated in one by the present invention
In acquisition node, make each acquisition node and include the repertoire of data acquisition, entire distributed data acquisition system by
A kind of this acquisition node composition, so that the framework simple and flexible of whole system, convenient for arrangement；And since each acquisition node is equal
It can work independently, even if there is the case where some acquisition node failure, other acquisition nodes also being capable of data acquisition work
Make, reduces influence of the node failure to whole system, ensure that the normal work of whole system as far as possible, improve system
Reliability.The present invention also provides the distribution type data collection methods based on above system, it may have above-mentioned advantage, herein no longer
It repeats.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to institute in the prior art and embodiment
Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the invention
Example, for those of ordinary skill in the art, without creative efforts, can also obtain according to these attached drawings
Obtain other attached drawings.
Fig. 1 is a kind of structural schematic diagram of distributed data acquisition system provided by the invention；
Fig. 2 is a kind of flow chart of the process of distribution type data collection method provided by the invention.
Specific embodiment
Core of the invention is to provide a kind of distributed data acquisition system and its method, the repertoire that data are acquired
It is integrated in an acquisition node, simplifies the architecture design of distributed data acquisition system, and enable distributed data acquisition system
It is only made of acquisition node, reduces influence of the node failure to system, improve the reliability of system.
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Shown in Figure 1 the present invention provides a kind of distributed data acquisition system, Fig. 1 is one kind provided by the invention
The structural schematic diagram of distributed data acquisition system；Wherein, Node1, Node2 and Node3 are data source.
The system includes：Multiple acquisition nodes 1；Each acquisition node 1 includes collector, reorganizer, transmitter and matches
Set file；
Collector with data source for docking, and the data for obtaining data source are sent to reorganizer；
Reorganizer is used to carry out unified data preparation to the data that collector is sent according to default arrangement rule, obtains whole
Reason result is sent to transmitter；
Transmitter is sent in Preset Transfer object for that will arrange result；
Type, default arrangement rule and the Preset Transfer object of data source comprising collector acquisition in configuration file,
Preset Transfer object includes the database 2 of big data platform.
It is understood that the function that a whole set of data acquire is integrated in an acquisition node 1 by the present invention, i.e., each adopt
Collection node 1 can independently realize the functions such as data acquisition, arrangement, transmission and management, and each acquisition node 1 can replace tradition
A set of agent node, collector node and host node in distributed data acquisition system, therefore, if only wanting to realize data acquisition
One acquisition node 1 is only set if function, in whole system, however, to ensure that the high availability of system and reliable
Property, it needs at least to be arranged two acquisition nodes 1 as redundancy, avoids what whole system when 1 failure of acquisition node can not work from asking
Topic.Certainly, if the data volume if desired acquired is more, the increase that the number of acquisition node 1 can also be adapted, acquisition node 1
Setting number can be depending on self-demand, this is not limited by the present invention.
Specifically, the purpose of collector is the data for collecting different target, it is equivalent to the acquisition of traditional distributed data
Agent node in system, the collection target of different acquisition nodes 1 may be the same or different in system.For example, some
The data collection object of system is more, in order to improve data collection efficiency, different acquisition nodes 1 can be made to acquire difference respectively
The data of data source realize parallel acquisition, accelerate the speed of data acquisition.And the data collection object of some systems is less and every
The data volume that a data source needs to collect is big, then acquisition target (the data acquired of each acquisition node 1 in these systems
Source) can be set to it is identical, each acquisition node 1 to identical data collection object carry out data collection, at this point, in order to
Each 1 repeated acquisition data of acquisition node are avoided, each acquisition node can be limited when collector acquires the data of data source
The data of collector collect range in 1, and as different acquisition nodes 1 distributes different data collection zone domains, and realization is adopted parallel
Collection improves data acquisition efficiency；Certainly, when the acquisition target that each acquisition node 1 limits is identical, to avoid repeated acquisition,
Different acquisition times can also be limited for each acquisition node 1, at times serial acquisition.In other embodiments, if acquisition section
, can also be by the above serial acquisition and parallel acquisition combination processing when point 1 is more, each period setting unit acquisition node 1, simultaneously
The acquisition node 1 of section acquires the data in different data region respectively.
Certainly the above is only several preferred embodiments, the present invention do not limit the type of the collectable data source of each collector with
And specific acquisition target, in addition, the present invention does not limit data collection zone domain and the acquisition time of each collector yet, acquisition
The acquisition target and acquisition mode of device can sets itself according to the actual situation, this is not limited by the present invention.It is understood that
It is that there are multiple types for data source, such as data source may include database and/or log, and collector is obtained from different data sources
Generally structure and format are different the data obtained, if these data are sent directly to the database 2 of big data platform
Words, can make the data in big data platform very chaotic, it is difficult to arrange, therefore, need first will by reorganizer to solve this problem
After the data of collector acquisition carry out unified data preparation, retransmits to big data platform, make the data in big data platform
It is consistent, facilitates subsequent information processing.
In an advantageous embodiment, reorganizer specifically includes：
Useful data extraction module, for extracting useful number out of collector is sent data according to default arrangement rule
According to；
Format converting module, for useful data to be converted to the data format set in default arrangement rule；
File storage module, for obtaining acquisition data file as whole in the data deposit file after converting format
Reason result is sent to transmitter.
It is understood that collector can not carry out careful screening to data, but can be complete by the data in data source
Portion extracts (or can all extract the data in limited area), and in some situations, there are one for data acquisition
Fixed purpose only needs to meet the data of specified conditions in big data platform, in this case, if the data by acquisition are complete
If portion is sent to big data platform, big data platform can be made to receive a large amount of hash, occupy the number of big data platform
According to the space in library 2, and the use for influencing acquisition data will be useful therefore, it is necessary to extract to the data that collector acquires
Data extract, and reduce total amount of data.It is subsequent for convenience also, since the data format of different data sources is typically different
The arrangement and use of data, need by collector acquire data format, be converted to unified format retransmit to
Big data platform.Here unified format can be JSON format, and certainly, this is not limited by the present invention.
And in the data deposit file after converting format, it is the big number in order to which the data after converting to format are integrated
Can carry out data receiver as unit of file according to platform, be transmitted compared to scattered data, in a manner of file transmission change zero be
It is whole, reduce the risk of loss of data.Wherein, file format here can also be able to be certainly other types for compressed file
File, this is not limited by the present invention.
In a preferred embodiment, data source further includes the transmission of acquisition node 1 that configuration file limits, in addition to itself
Device；
Correspondingly, Preset Transfer object further includes the acquisition of acquisition node 1 that configuration file limits, in addition to itself
Device.
It is understood that since each acquisition node 1 all has the data acquisition of complete set, each
Acquisition node 1 can send data to the database 2 of big data platform, still, such that big data platform needs connect
The data for receiving each acquisition node 1, occupy a large amount of process；It can be with and by the scheme of this implementation, between different acquisition node 1
Carry out data transmission, in this case, part acquisition node 1 can be enabled to communicate with big data platform, and other acquisition nodes 1 then will
The data of itself acquisition are sent in this part acquisition node 1, to reduce the number of processes that big data platform receives data.Separately
Outside, since the type of data source is different, the data type that different acquisition node 1 acquires is also variant, therefore in different acquisition node 1
The default arrangement rule of reorganizer may be different, therefore, for some data for needing specially treated, can first acquire at one
It arranges in node 1 and then is sent to another acquisition node 1 and further arranged, arrange purpose to reach final,
The default arrangement rule that can be avoided in same reorganizer simultaneously is excessively complicated.The mode of this 1 intercommunication of acquisition node,
So that can cooperate between different acquisition node 1, the flexibility of system application is improved.
Certainly, the acquisition target of each acquisition node 1 can be only the transmitter of other acquisition nodes 1, may also be only
The data sources such as database, log, or also may include the object of both the above type, specifically how to be arranged, it can be according to itself
Depending on demand, the present invention is not especially limited.In addition, due to including many acquisition nodes 1 in system, each acquisition node 1
Collector can be docked with the transmitter of other acquisition nodes 1 of part, and the transmitter for being specifically chosen which docking can be according to reality
Demand is set, and the present invention does not make specific restriction.
It in an advantageous embodiment, further include first timer in collector；
First timer is used for after collector is docked with data source, sets acquisition time section, and timing controlled collector exists
Acquisition time section obtains the data in data source.
It is understood that when multiple acquisition nodes 1 carry out data acquisition to the same data source, in order to avoid each
The data that a acquisition node 1 acquires repeat, and different acquisition time sections can be set by first timer, is made each
Section is interior to data source progress data acquisition in different times respectively for acquisition node 1.In addition, acquisition node 1 is in acquisition data
When the data in source, real-time acquisition can be, but in some cases, may not need acquisition node 1 and obtain data in real time, but
It only needs to obtain data in partial time period, therefore acquisition time section can be limited by first timer, to reduce
The working time of collector reduces energy consumption.
It in another preferred embodiment, further include second timer in transmitter；
Second timer is used for after receiving arrangement result, sets the triggered time, and clocked flip transmitter, which is sent, arranges knot
In fruit to Preset Transfer object.
It is understood that when transmitter sends data to Preset Transfer object, according to demand, it may be desirable to real
When transmit, but in some circumstances, if real-time Transmission may occupy the more process of Preset Transfer object, influence default biography
Therefore the speed of service of defeated object only can will arrange result again after the triggered time reaches and send by setting the triggered time
To Preset Transfer object, the use of transmission process is reduced.
Preferably, configuration file further includes dormant state, and dormant state includes two states of suspend mode and non-suspend mode,
Acquisition node 1 in dormant state does not work, and the acquisition node 1 in non-dormant state works.
It is understood that since system may include more acquisition node 1, but in specific application, it is to be collected
The quantity of data source may be less, so when do not need whole acquisition nodes 1 and work, therefore, at this time can be by portion
The dormant state in the configuration file of acquisition node 1 is divided to be adjusted to dormant state, only remainder acquisition node 1 works, and mentions
The service efficiency of high acquisition node 1
The present invention provides a kind of distributed data acquisition systems, include multiple acquisition nodes, and each acquisition node wraps
Include collector, reorganizer, transmitter and configuration file.I.e. data collection, arrangement, transmission, management are integrated in one by the present invention
In acquisition node, make each acquisition node and include the repertoire of data acquisition, entire distributed data acquisition system by
A kind of this acquisition node composition, so that the framework simple and flexible of whole system, convenient for arrangement；And since each acquisition node is equal
It can work independently, even if there is the case where some acquisition node failure, other acquisition nodes also being capable of data acquisition work
Make, reduces influence of the node failure to whole system, ensure that the normal work of whole system as far as possible, improve system
Reliability.
The present invention also provides a kind of distribution type data collection method, the system based on any of the above item；Institute referring to fig. 2
Show, Fig. 2 is a kind of flow chart of the process of distribution type data collection method provided by the invention.This method includes：
Step s1：Collector in each acquisition node is docked with data source, obtain data source data be sent to it is same
Reorganizer in acquisition node；
Step s2：Reorganizer carries out unified data preparation to the data that collector is sent according to default arrangement rule, obtains
The transmitter in same acquisition node is sent to result is arranged；
Step s3：Transmitter is sent to result is arranged in Preset Transfer object；Preset Transfer object includes that big data is flat
The database of platform.
Above several specific embodiments are only the preferred embodiment of the present invention, and above several specific embodiments can be with
Any combination, the embodiment obtained after combination is also within protection scope of the present invention.It should be pointed out that for the art
For those of ordinary skill, relevant speciality technical staff deduced out in the case where not departing from spirit of that invention and concept thereof other change
Into and variation, should all be included in the protection scope of the present invention.
Each embodiment in this specification is described in a progressive manner, the highlights of each of the examples are with other
The difference of embodiment, the same or similar parts in each embodiment may refer to each other.For device disclosed in embodiment
For, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is said referring to method part
It is bright.
It should also be noted that, in the present specification, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that the process, method, article or equipment for including a series of elements not only includes that
A little elements, but also including other elements that are not explicitly listed, or further include for this process, method, article or
The intrinsic element of equipment.In the absence of more restrictions, the element limited by sentence "including a ...", is not arranged
Except there is also other identical elements in the process, method, article or apparatus that includes the element.
The foregoing description of the disclosed embodiments enables those skilled in the art to implement or use the present invention.
Various modifications to these embodiments will be readily apparent to those skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the present invention.Therefore, of the invention
It is not intended to be limited to the embodiments shown herein, and is to fit to and the principles and novel features disclosed herein phase one
The widest scope of cause.
Claims (8)
1. a kind of distributed data acquisition system, which is characterized in that including：Multiple acquisition nodes；Each acquisition node packet
Include collector, reorganizer, transmitter and configuration file；
The data that the collector is used to dock with data source, and obtain the data source are sent to the reorganizer；
The reorganizer is used to carry out unified data preparation to the data that the collector is sent according to default arrangement rule, obtains
The transmitter is sent to result is arranged；
The transmitter is for the arrangement result to be sent in Preset Transfer object；
The type of data source comprising collector acquisition in the configuration file, the default arrangement rule and described pre-
If connection object, the Preset Transfer object includes the database of big data platform.
2. system according to claim 1, which is characterized in that the data source includes database and/or log.
3. system according to claim 1 or 2, which is characterized in that the data source further includes that the configuration file limits
, the transmitter of acquisition node in addition to itself；
Correspondingly, the Preset Transfer object further includes that the configuration file limits, acquisition node in addition to itself adopts
Storage.
4. system according to claim 1, which is characterized in that the reorganizer specifically includes：
Useful data extraction module, it is useful for being extracted out of the collector is sent data according to the default arrangement rule
Data；
Format converting module, for the useful data to be converted to the data format set in the default arrangement rule；
File storage module, for obtaining acquisition data file as described whole in the data deposit file after converting format
Reason result is sent to the transmitter.
5. system according to claim 1, which is characterized in that further include first timer in the collector；
The first timer is used for after the collector is docked with the data source, sets acquisition time section, timing controlled
The collector obtains the data in the data source in the acquisition time section.
6. system according to claim 1, which is characterized in that further include second timer in the transmitter；
The second timer is used for after receiving the arrangement result, sets triggered time, the hair of transmitter described in clocked flip
It send in the arrangement result to the Preset Transfer object.
7. system according to claim 1, which is characterized in that the configuration file further includes dormant state, the suspend mode
State includes two states of suspend mode and non-suspend mode, and the acquisition node in dormant state does not work, and is in non-dormant state
Acquisition node work.
8. a kind of distribution type data collection method, which is characterized in that based on such as the described in any item systems of claim 1-7；Institute
The method of stating includes：
Collector in each acquisition node is docked with data source, and the data for obtaining the data source are sent to same acquisition node
Interior reorganizer；
The reorganizer carries out unified data preparation to the data that the collector is sent according to default arrangement rule, obtains whole
Reason result is sent to the transmitter in same acquisition node；
The arrangement result is sent in Preset Transfer object by the transmitter；The Preset Transfer object includes that big data is flat
The database of platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810507072.3A CN108833490A (en) | 2018-05-24 | 2018-05-24 | A kind of distributed data acquisition system and its method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810507072.3A CN108833490A (en) | 2018-05-24 | 2018-05-24 | A kind of distributed data acquisition system and its method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108833490A true CN108833490A (en) | 2018-11-16 |
Family
ID=64147277
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810507072.3A Pending CN108833490A (en) | 2018-05-24 | 2018-05-24 | A kind of distributed data acquisition system and its method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108833490A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109688106A (en) * | 2018-11-19 | 2019-04-26 | 中国科学院信息工程研究所 | A kind of data collaborative acquisition method and system |
| CN111061807A (en) * | 2019-11-23 | 2020-04-24 | 方正株式(武汉)科技开发有限公司 | Distributed data acquisition and analysis system and method, server and medium |
| CN112203247A (en) * | 2020-09-24 | 2021-01-08 | 南方电网科学研究院有限责任公司 | Safe storage method and system for electric energy data |
| CN113419451A (en) * | 2021-06-29 | 2021-09-21 | 浙江邮电职业技术学院 | Distributed data acquisition method and system for communication network |
| CN114415953A (en) * | 2022-01-04 | 2022-04-29 | 武汉烽火技术服务有限公司 | Method and device for data acquisition of data source |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751018A (en) * | 2008-12-12 | 2010-06-23 | 深圳职业技术学院 | Distributing data monitoring and prealarming system under test environment |
| CN103795803A (en) * | 2014-02-14 | 2014-05-14 | 浪潮通信信息***有限公司 | Cross-network-environment remote deployment distributed data collecting node method |
| CN105119750A (en) * | 2015-09-08 | 2015-12-02 | 南京联成科技发展有限公司 | Distributed information security operation and maintenance management platform based on massive data |
| US20160150563A1 (en) * | 2012-08-02 | 2016-05-26 | Sony Mobile Communications Ab | Non-real-time traffic aggregation in relay nodes for increased network capacity |
| CN105809606A (en) * | 2016-03-08 | 2016-07-27 | 贵州省邮电规划设计院有限公司 | Big data application platform system |
| CN106055608A (en) * | 2016-05-25 | 2016-10-26 | 北京百度网讯科技有限公司 | Method and apparatus for automatically collecting and analyzing switch logs |
| US20170085347A1 (en) * | 2015-09-17 | 2017-03-23 | WI-LAN Labs Inc. | Root non-orthogonal frequency division multiplexing (rnofdm) |
| CN106790528A (en) * | 2016-12-20 | 2017-05-31 | 中国船舶重工集团公司第七〇五研究所 | The data synchronous system and method for a kind of distributed network |
| CN107203872A (en) * | 2017-05-26 | 2017-09-26 | 山东省科学院情报研究所 | Region demand for talent based on big data quantifies analysis method |
| CN107508869A (en) * | 2017-08-11 | 2017-12-22 | 上海中信信息发展股份有限公司 | Trace back data acquisition method and client |
-
2018
- 2018-05-24 CN CN201810507072.3A patent/CN108833490A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751018A (en) * | 2008-12-12 | 2010-06-23 | 深圳职业技术学院 | Distributing data monitoring and prealarming system under test environment |
| US20160150563A1 (en) * | 2012-08-02 | 2016-05-26 | Sony Mobile Communications Ab | Non-real-time traffic aggregation in relay nodes for increased network capacity |
| CN103795803A (en) * | 2014-02-14 | 2014-05-14 | 浪潮通信信息***有限公司 | Cross-network-environment remote deployment distributed data collecting node method |
| CN105119750A (en) * | 2015-09-08 | 2015-12-02 | 南京联成科技发展有限公司 | Distributed information security operation and maintenance management platform based on massive data |
| US20170085347A1 (en) * | 2015-09-17 | 2017-03-23 | WI-LAN Labs Inc. | Root non-orthogonal frequency division multiplexing (rnofdm) |
| CN105809606A (en) * | 2016-03-08 | 2016-07-27 | 贵州省邮电规划设计院有限公司 | Big data application platform system |
| CN106055608A (en) * | 2016-05-25 | 2016-10-26 | 北京百度网讯科技有限公司 | Method and apparatus for automatically collecting and analyzing switch logs |
| CN106790528A (en) * | 2016-12-20 | 2017-05-31 | 中国船舶重工集团公司第七〇五研究所 | The data synchronous system and method for a kind of distributed network |
| CN107203872A (en) * | 2017-05-26 | 2017-09-26 | 山东省科学院情报研究所 | Region demand for talent based on big data quantifies analysis method |
| CN107508869A (en) * | 2017-08-11 | 2017-12-22 | 上海中信信息发展股份有限公司 | Trace back data acquisition method and client |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109688106A (en) * | 2018-11-19 | 2019-04-26 | 中国科学院信息工程研究所 | A kind of data collaborative acquisition method and system |
| CN111061807A (en) * | 2019-11-23 | 2020-04-24 | 方正株式(武汉)科技开发有限公司 | Distributed data acquisition and analysis system and method, server and medium |
| CN112203247A (en) * | 2020-09-24 | 2021-01-08 | 南方电网科学研究院有限责任公司 | Safe storage method and system for electric energy data |
| CN112203247B (en) * | 2020-09-24 | 2023-10-20 | 南方电网科学研究院有限责任公司 | Safe storage method and system for electric energy data |
| CN113419451A (en) * | 2021-06-29 | 2021-09-21 | 浙江邮电职业技术学院 | Distributed data acquisition method and system for communication network |
| CN113419451B (en) * | 2021-06-29 | 2022-08-16 | 浙江邮电职业技术学院 | Distributed data acquisition method and system for communication network |
| CN114415953A (en) * | 2022-01-04 | 2022-04-29 | 武汉烽火技术服务有限公司 | Method and device for data acquisition of data source |
| CN114415953B (en) * | 2022-01-04 | 2024-01-30 | 武汉烽火技术服务有限公司 | Method and device for data acquisition of data source |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108833490A (en) | A kind of distributed data acquisition system and its method | |
| CN103236949B (en) | Monitoring method, device and the system of a kind of server cluster | |
| US20170366620A1 (en) | Long connection method between a plurality of smart devices and a server, and smart device thereof | |
| CN105577430B (en) | A kind of node administration method of high-end fault-tolerant server | |
| CN101127623A (en) | Data processing method, device and system | |
| CN104618466A (en) | System for balancing load and controlling overload based on message transfer and control method of system | |
| CN102282787A (en) | Method for synchronizing local clocks in a distributed computer network | |
| CN208940010U (en) | A kind of intranet and extranet synchronization system | |
| CN106502856B (en) | A kind of information processing method and device | |
| CN105871991A (en) | Cloud access system and method based on wireless communication module | |
| CN104954462A (en) | High-concurrency extensible smart home communication method and high-concurrency extensible smart home communication system | |
| CN201044449Y (en) | Optical transmitter-receiver and network management system of optical transmitter-receiver | |
| CN106416133B (en) | The determination method, apparatus and equipment of optimal heart beat cycle | |
| CN109471746A (en) | A kind of collection method and system of cluster log | |
| CN104022515B (en) | Reactive compensation cabinet and the control method of reactive compensation unit | |
| CN109274763A (en) | A kind of information synchronization method and two-node cluster hot backup equipment | |
| CN106993068B (en) | A kind of auto-allocation method of blade server managing intranet IP | |
| CN104270255A (en) | A module and method for communication between nodes based on LINX progress | |
| CN109819277A (en) | A kind of 4K video broadcasting method and device | |
| CN109632842A (en) | A kind of the CT detector and its application method of module serial structure | |
| CN101877714A (en) | Integrated server | |
| CN104639384B (en) | Test command sending method, apparatus and system | |
| CN103825966A (en) | Internet of things demonstration control system and control method | |
| CN104735097A (en) | Information collecting method and system | |
| CN105119994B (en) | A kind of document transmission method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181116 |
|
| RJ01 | Rejection of invention patent application after publication |