CN109739921A - A kind of big data acquisition system and method - Google Patents
A kind of big data acquisition system and method Download PDFInfo
- Publication number
- CN109739921A CN109739921A CN201910013743.5A CN201910013743A CN109739921A CN 109739921 A CN109739921 A CN 109739921A CN 201910013743 A CN201910013743 A CN 201910013743A CN 109739921 A CN109739921 A CN 109739921A
- Authority
- CN
- China
- Prior art keywords
- data
- acquisition
- module
- unit
- reception module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The present invention relates to a kind of big data acquisition system and method, the big data acquisition system includes: data acquisition module, data aggregation module and data reception module；The data acquisition module includes one or more agent unit；The agent unit is deployed on the data equipment to be acquired, and the agent unit sends the data to data aggregation module and polymerize and pre-processed for acquiring operation data；The data reception module processing data that convergence module uploads for receiving data, and the data are processed, and data are stored and shown by treated；System of the invention is pre-processed by data of the data aggregation module to acquisition, can reduce volume of transmitted data and transmission frequency, convenient for data it is more stable send data reception module to；By the way that storage unit is arranged on data acquisition module, it can reduce the probability of leaking data and loss, be conducive to the safety for improving acquisition system.
Description
Technical field
The present invention relates to data acquisition technology fields, and in particular to a kind of big data acquisition system and method.
Background technique
With the continuous progress of science and technology, the especially rapid development of the technologies such as mobile Internet, Internet of Things, global metadata amount
There is explosive growth.It is increasing to be not only data volume, data type is more, and processing real-time will be met the requirements, this
Very big challenge all is brought to the acquisition process of big data a bit.It is long-range that the acquisition of big data mainly uses Internet technology to realize
Data acquisition, is acquired and is transmitted in internet by acquisition software, and by repeatedly convergence forwarding, is ultimately sent to big
Data source of the data platform as analysis and application.
The main problem that the acquisition of existing big data faces is: the data volume that data source generates in real time is huge, and data pass
Defeated frequency is high, very big to the pressure of acquisition server and transmission network, in the case where transmission network is unstable, data acquisition
The problems such as transmission process easily occurs leaking data, loses, the safety of data is poor.
Summary of the invention
In view of this, it is an object of the invention to overcome the deficiencies of the prior art and provide a kind of big data acquisition system and
Method.
In order to achieve the above object, the present invention adopts the following technical scheme: a kind of big data acquisition system, comprising:
Data acquisition module, data aggregation module and data reception module；
Wherein, the data acquisition module includes: one or more agent units；
The agent unit is deployed on the data equipment to be acquired, each application software on the data equipment
Corresponding with an agent unit, the agent unit is used to acquire the operation number of application software corresponding thereto
According to and the acquisition data being sent to the data aggregation module and carry out data aggregate and pretreatment, and by pretreated number
According to being sent to the data reception module；
Data reception module, data after the processing for receiving the data aggregation module upload, adds the data
Work processing, and data are stored and are shown by treated.
Optionally, the data acquisition module further include: storage unit；
When transmission network connects time-out or data transmission fails, the storage unit is used to save the data information,
And data re-transmission is carried out at regular intervals, when accumulative number of retransmissions is more than to retransmit upper limit number, stop re-transmission, and by the number
According to being stored in the storage unit；
Wherein, the time interval that Xiang Tongyi data retransmits is incremental；
When the storage unit is filled with data, data discarding is carried out according to the successive time sequencing of the storage of data.
Optionally, the data aggregation module pre-processes acquisition data, comprising:
Compression processing is carried out to the acquisition data, to reduce the size of data of the acquisition data；
Corresponding, the data reception module unzips it processing to received each other.
Optionally, the data collection system further include:
Configuration module；
The configuration module includes: heartbeat server, configuration interface and configuration information database；
Wherein, the heartbeat server, for obtaining the from the configuration information database by the configuration interface
One configuration information, and first configuration information is handed down to the agent unit；
The configuration information database, for storing the configuration information of the data collection system.
Optionally, the data collection system further include:
Monitor alarm module；
The monitoring alarm module includes: data monitoring unit and Alarm Unit；
The data monitoring unit is connect with the heartbeat server, second issued for receiving the heartbeat server
Configuration information；
The data monitoring unit is also connect with the data reception module, is sent for receiving the data reception module
Acquisition data, and the second configuration information that the acquisition data are analyzed, and issued in conjunction with the heartbeat server, judgement
Whether current acquisition data are legal；
The Alarm Unit is connect with the data monitoring unit, for currently adopting out when the data monitoring unit judges
When collection data are illegal, triggering alarm.
Optionally, described when current acquisition data are illegal out for the data monitoring unit judges, triggering alarm, comprising:
The Alarm Unit generates warning information, and alarm is issued in a manner of sending alarm email.
Optionally, the big data acquisition system further include:
Opentsdb database；
The Opentsdb database is connect with the data reception module, is sent for receiving the data reception module
Acquisition data, and the acquisition data are stored.
Optionally, the big data acquisition system further include:
Data display module；
The data display module is connect with the Opentsdb database, for reading from the Opentsdb database
Access evidence is simultaneously shown.
Optionally, the operation data of the application software of the agent unit acquisition corresponding thereto, comprising:
The data of agent unit active acquisition applications software in a manner of adding plug-in unit, and/or,
Directly receive the operation data for the application software that the push of other processes comes.
Optionally, the data acquisition module, the data reception module, the configuration module and the monitoring alert mould
Block is equipped with respective log storage unit, and log rank can be configured.
The present invention also provides a kind of big data acquisition methods, comprising:
Data acquisition module is acquired corresponding thereto by being deployed in one or more agent unit on data equipment
The operation data of application software；
Data aggregation module polymerize the acquisition data that the data acquisition module uploads, line number of going forward side by side Data preprocess；
The pretreated data that the data acquisition module uploads are received, and the data are processed, and will
Data that treated are stored and are shown.
Optionally, the acquisition method further include:
When transmission network connects time-out or data transmission fails, the data information is saved on data acquisition module,
And data re-transmission is carried out at regular intervals, when accumulative number of retransmissions is more than to retransmit upper limit number, stop retransmitting；
Wherein, the time interval that Xiang Tongyi data retransmits is incremental；
When the memory space on data acquisition module is filled with data, counted according to the successive time sequencing of the storage of data
According to discarding.
The invention adopts the above technical scheme, the big data acquisition system, comprising: data acquisition module, data convergence
Module and data reception module；Wherein, the data acquisition module includes: one or more agent units；The agent is mono-
Member is deployed on the data equipment to be acquired, each application software on the data equipment and an agent unit
Corresponding, the agent unit is used to acquire the operation data of application software corresponding thereto, and the acquisition data are sent
Data aggregate and pretreatment are carried out to the data aggregation module, and pretreated data are sent to the data reception
Block；Data reception module, data after the processing for receiving the data aggregation module upload, carries out at processing the data
Reason, and data are stored and are shown by treated；Big data acquisition system of the present invention passes through one or more portion
Administration's agent unit on the data equipment to be acquired, improves the efficiency of data acquisition；By data aggregation module to acquisition
Data are pre-processed, and can reduce volume of transmitted data, reduce the transmission frequency of data, convenient for data it is more stable send institute to
State data reception module；By the way that storage unit is arranged on data acquisition module, the probability of leaking data and loss can reduce,
To be conducive to improve the safety of acquisition system.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the structural schematic diagram that big data acquisition system embodiment one of the present invention provides；
Fig. 2 is the structural schematic diagram that big data acquisition system embodiment two of the present invention provides；
Fig. 3 is the flow diagram that big data acquisition method embodiment one of the present invention provides.
In figure: 1, data acquisition module；11, agent unit；12, storage unit；2, data reception module；3, mould is configured
Block；31, heartbeat server；32, interface is configured；33, configuration information database；4, alarm module is monitored；41, data monitoring list
Member；42, Alarm Unit；5, Opentsdb database；6, data display module；7, application software；8, data aggregation module.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, technical solution of the present invention will be carried out below
Detailed description.Obviously, described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Base
Embodiment in the present invention, those of ordinary skill in the art are obtained all without making creative work
Other embodiment belongs to the range that the present invention is protected.
Fig. 1 is the structural schematic diagram that big data acquisition system embodiment one of the present invention provides.
As shown in Figure 1, big data acquisition system described in the present embodiment includes:
Data acquisition module 1, data aggregation module 8 and data reception module 2；
Wherein, the data acquisition module 1 includes: one or more agent units 11；
The agent unit 11 is deployed on the data equipment to be acquired, each on the data equipment is using soft
Part is corresponding with an agent unit 11, and the agent unit 11 is used to acquire the fortune of application software corresponding thereto
Row data, and the acquisition data are sent to the data aggregation module 8 and carry out data aggregate and pretreatment, and will be after pretreatment
Data be sent to the data reception module 2；
Data reception module 2, data after the processing for receiving the upload of data aggregation module 8, carries out the data
Working process, and data are stored and are shown by treated.
Further, the data acquisition module 1 further include: storage unit 12；
When transmission network connects time-out or data transmission fails, the storage unit 12 is for saving data letter
Breath, and data re-transmission is carried out at regular intervals, when accumulative number of retransmissions is more than to retransmit upper limit number, stop retransmitting, and will
The data are stored in the storage unit 12；
Wherein, the time interval that Xiang Tongyi data retransmits is incremental；
When the storage unit 12 is filled with data, data discarding is carried out according to the successive time sequencing of the storage of data.
Further, 8 pairs of acquisition data of the data aggregation module pre-process, comprising:
Compression processing is carried out to the acquisition data, to reduce the size of data of the acquisition data；
Corresponding, the data reception module 2 unzips it processing to received each other.
Further, the big data acquisition system can also include:
Configuration module 3；
The configuration module 3 includes: heartbeat server 31, configuration interface 32 and configuration information database 33；
Wherein, the heartbeat server 31, for passing through the configuration interface 32 from the configuration information database 33
The first configuration information is obtained, and first configuration information is handed down to the agent unit 11；
The configuration information database 33, for storing the configuration information of the data collection system.
Further, the big data acquisition system can also include:
Monitor alarm module 4；
The monitoring alarm module 4 includes: data monitoring unit 41 and Alarm Unit 42；
The data monitoring unit 41 is connect with the heartbeat server 31, is issued for receiving the heartbeat server 31
The second configuration information；
The data monitoring unit 41 is also connect with the data reception module 2, for receiving the data reception module 2
The acquisition data of transmission, and second for analyzing the acquisition data, and issuing in conjunction with the heartbeat server 31 matches confidence
Breath judges whether current acquisition data are legal；
The Alarm Unit 42 is connect with the data monitoring unit 41, for judging when the data monitoring unit 41
When currently acquisition data are illegal, triggering alarm.
Further, it is described when the data monitoring unit 41 judge currently to acquire data it is illegal when, triggering alarm, packet
It includes:
The Alarm Unit 42 generates warning information, and alarm is issued in a manner of sending alarm email.
Further, the data collection system can be with further include:
Opentsdb database 5；
The Opentsdb database 5 is connect with the data reception module 2, for receiving the data reception module 2
The acquisition data of transmission, and the acquisition data are stored.
Further, the big data acquisition system can also include:
Data display module 6；
The data display module 6 is connect with the Opentsdb database 5, is used for from the Opentsdb database 5
Middle reading data are simultaneously shown.
Further, the operation data of the application software 7 of the acquisition of agent unit 11 corresponding thereto, comprising:
The data of the agent unit 11 active acquisition applications software 7 in a manner of adding plug-in unit, and/or,
Directly receive the operation data for the application software 7 that the push of other processes comes.
Further, the data acquisition module 1, the data reception module 2, the configuration module 3 and the monitoring
Alarm module 4 is equipped with respective log storage unit, and log rank can be configured.
As shown in Fig. 2, big data acquisition system described in embodiment one is in actual use, can be as shown in Figure 2
Structure.
Wherein, the one or more application software 7APP in system pushes particular bin to corresponding agent unit 11
The acquisition data of formula, the equipment that the agent unit 11 is deployed in the data to be acquired (can be, smart phone, tablet computer
One or more of with PC) on, and acquire the data in corresponding application software 7；Wherein, the agent unit 11 is to add
The data of the mode active acquisition applications software 7 of plug-in unit or the operation for directly receiving the application software 7 that the push of other processes comes
Data；The data of acquisition are uploaded to the data reception module 2 by the agent unit 11, and the data reception module 2 receives
The acquisition data that the agent unit 11 uploads, and these data are given to the data monitoring unit in a manner of transfer
41 (judge) and the Opentsdb database 5 push portion respectively；
The configuration module 3 includes: heartbeat server 31 (heartbeat server), portal configuration interface 32 and matches
Set information database 33 (mysql database)；The configuration information of the data collection system is stored in the mysql database,
The heartbeat server 31 is used to configure interface 32 by the portal obtains the first configuration information from mysql database,
And first configuration information is handed down to the agent unit 11, be also used to by the portal configure interface 32 from
The second configuration information is obtained in mysql database, and second configuration information is handed down to the monitoring alarm module 4；
Specifically, the configuration information includes:
Agent configuration:
Plugin:
Enabled: whether plug-in unit is used；
Dir: specific plug-in catalogue；
Hearbeat:
Enabled: heartbeat server whether is opened；
Addr: the address of specified heartbeat server；
Interval: the time interval of information is reported to heartbeat server；
Transfer configuration:
Rpc: the address and port to be monitored, the i.e. address transfer configured in agent are specified；
Judge: specified judge component address and other relevant configurations；
Tsdb: specified opentsdb component address and other relevant configurations；
The configuration of Judge component:
The address judge configured in Rpc:transfer；
Hbs: the address of specified heartbeat server；
The warning information that Alarm:judge is generated can be first stored in this middleware of redis, then monitor alarm module 4
It is taken inside this middleware of redis；
The configuration of Heartbeat server:
Database: the access method of specified mysql database, heartbeat server can be directly from mysql data
Configuration is read in library；
Listen: the address and port that specified heartbeat server is monitored.
It should be noted that all the above module has a http interface, can be sentenced by accessing the interface
The survival condition for each module of breaking.
The present embodiment is deployed in agent unit on the data equipment to be acquired in actual use, by one or more
11 acquire different types of application software 7 or the different types of data of the same application software 7, and send the data to number
According to convergence module 8, after the data aggregation module 8 carries out data aggregate and pretreatment, pretreated data are sent to institute
Data reception module 2 is stated, after the data reception module 2 is handled (such as decompression) to the data, by these data
Portion is pushed respectively to the data monitoring unit 41 (judge) and the Opentsdb database 5.The data monitoring unit
41 receive the acquisition data that the data reception module 2 is sent, and analyze the acquisition data, and take in conjunction with the heartbeat
The second configuration information that business device 31 issues judges whether current acquisition data are legal, when the data monitoring unit 41 is judged
When currently acquisition data are illegal, alarm is issued in a manner of sending alarm email.
Big data acquisition system described in the present embodiment is deployed on the data equipment to be acquired by one or more
Agent unit 11 can be realized the acquisition to different types of data, improve the efficiency of data acquisition；It is converged by the data
The data of 8 pairs of poly- module acquisitions pre-process, and can reduce volume of transmitted data, reduce the transmission frequency of data, are convenient for data
More stable sends the data reception module 2 to, reduces the probability of leaking data and loss, to be conducive to improve acquisition system
The safety of system.
Fig. 3 is the flow diagram that big data acquisition method embodiment one of the present invention provides.
As shown in figure 3, big data acquisition method described in the present embodiment, comprising:
S31: data acquisition module is by being deployed in one or more agent unit on data equipment, and acquisition is corresponding thereto
The operation data for the application software answered；
S32: data aggregation module polymerize the acquisition data that the data acquisition module uploads, line number of going forward side by side Data preprocess；
S33: receiving the pretreated data that the data acquisition module uploads, and be processed to the data,
And data are stored and are shown by treated.
Further, the big data acquisition method further include:
When transmission network connects time-out or data transmission fails, the data information is saved on data acquisition module,
And data re-transmission is carried out at regular intervals, when accumulative number of retransmissions is more than to retransmit upper limit number, stop retransmitting；
Wherein, the time interval that Xiang Tongyi data retransmits is incremental；
When the memory space on data acquisition module is filled with data, counted according to the successive time sequencing of the storage of data
According to discarding.
Further, the big data acquisition method further include:
The acquisition data uploaded to data acquisition module are analyzed, and combine configuration information, judge current acquisition data
It is whether legal；
When judge currently to acquire data it is illegal when, triggering alarm.
The working principle phase of the working principle of big data acquisition method described in the present embodiment and big data acquisition system above
Together, details are not described herein.
Big data acquisition method described in the present embodiment is deployed on the data equipment to be acquired by one or more
Agent unit improves the efficiency of data acquisition；It is pre-processed, can be dropped by data of the data aggregation module to acquisition
Low amount of transmitting data reduces the transmission frequency of data, more stable convenient for data, quickly send the data reception module to,
By the way that storage unit is arranged on data acquisition module, the probability of leaking data and loss can be lowered, to be conducive to improve
The safety of acquisition system.
It is understood that same or similar part can mutually refer in the various embodiments described above, in some embodiments
Unspecified content may refer to the same or similar content in other embodiments.
It should be noted that in the description of the present invention, term " first ", " second " etc. are used for description purposes only, without
It can be interpreted as indication or suggestion relative importance.In addition, in the description of the present invention, unless otherwise indicated, the meaning of " multiple "
Refer at least two.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
It should be appreciated that each section of the invention can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware
Any one of column technology or their combination are realized: having a logic gates for realizing logic function to data-signal
Discrete logic, with suitable combinational logic gate circuit specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, each functional unit in each embodiment of the present invention can integrate in a processing module
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is included at least one embodiment or example of the invention.In the present specification, schematic expression of the above terms are not
Centainly refer to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be any
One or more embodiment or examples in can be combined in any suitable manner.
Although the embodiments of the present invention has been shown and described above, it is to be understood that above-described embodiment is example
Property, it is not considered as limiting the invention, those skilled in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, modifies, replacement and variant.
Claims (10)
1. a kind of big data acquisition system characterized by comprising
Data acquisition module, data aggregation module and data reception module；
Wherein, the data acquisition module includes: one or more agent units；
The agent unit is deployed on the data equipment to be acquired, each application software and one on the data equipment
A agent unit is corresponding, and the agent unit is used to acquire the operation data of application software corresponding thereto, and
The acquisition data are sent to the data aggregation module and carry out data aggregate and pretreatment, and pretreated data are sent
To the data reception module；
Data reception module, data after the processing for receiving the data aggregation module upload, carries out at processing the data
Reason, and data are stored and are shown by treated.
2. acquisition system according to claim 1, which is characterized in that the data acquisition module further include: storage unit；
When transmission network connects time-out or data transmission fails, the storage unit is used to save the data information, and every
Data re-transmission is carried out every a period of time, when accumulative number of retransmissions is more than to retransmit upper limit number, stops retransmitting, and the data are protected
There are in the storage unit；
Wherein, the time interval that Xiang Tongyi data retransmits is incremental；
When the storage unit is filled with data, data discarding is carried out according to the successive time sequencing of the storage of data.
3. acquisition system according to claim 1, which is characterized in that the data aggregation module carries out acquisition data pre-
Processing, comprising:
Compression processing is carried out to the acquisition data, to reduce the size of data of the acquisition data；
Corresponding, the data reception module unzips it processing to received each other.
4. acquisition system according to claim 1, which is characterized in that further include:
Configuration module；
The configuration module includes: heartbeat server, configuration interface and configuration information database；
Wherein, the heartbeat server is matched for obtaining first from the configuration information database by the configuration interface
Confidence breath, and first configuration information is handed down to the agent unit；
The configuration information database, for storing the configuration information of the data collection system.
5. acquisition system according to claim 4, which is characterized in that further include:
Monitor alarm module；
The monitoring alarm module includes: data monitoring unit and Alarm Unit；
The data monitoring unit is connect with the heartbeat server, the second configuration issued for receiving the heartbeat server
Information；
The data monitoring unit is also connect with the data reception module, for receiving adopting for the data reception module transmission
Collect data, and the second configuration information that the acquisition data are analyzed, and issued in conjunction with the heartbeat server, judgement is current
Whether legal acquire data；
The Alarm Unit is connect with the data monitoring unit, for going out current acquisition number when the data monitoring unit judges
According to it is illegal when, triggering alarm.
6. acquisition system according to any one of claims 1 to 5, which is characterized in that further include:
Opentsdb database；
The Opentsdb database is connect with the data reception module, for receiving adopting for the data reception module transmission
Collect data, and the acquisition data are stored.
7. acquisition system according to claim 6, which is characterized in that further include:
Data display module；
The data display module is connect with the Opentsdb database, for reading number from the Opentsdb database
According to and be shown.
8. according to claim 1 to 5,7 described in any item acquisition systems, which is characterized in that the agent unit acquires and it
The operation data of corresponding application software, comprising:
The data of agent unit active acquisition applications software in a manner of adding plug-in unit, and/or,
Directly receive the operation data for the application software that the push of other processes comes.
9. a kind of big data acquisition method characterized by comprising
Data acquisition module acquires application corresponding thereto by being deployed in one or more agent unit on data equipment
The operation data of software；
Data aggregation module polymerize the acquisition data that the data acquisition module uploads, line number of going forward side by side Data preprocess；
The pretreated data that the data acquisition module uploads are received, and the data are processed, and will processing
Data afterwards are stored and are shown.
10. acquisition method according to claim 9, which is characterized in that further include:
When transmission network connects time-out or data transmission fails, the data information is saved on data acquisition module, and every
Data re-transmission is carried out every a period of time, when accumulative number of retransmissions is more than to retransmit upper limit number, stops retransmitting；
Wherein, the time interval that Xiang Tongyi data retransmits is incremental；
When the memory space on data acquisition module is filled with data, data are carried out according to the successive time sequencing of the storage of data and are lost
It abandons.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910013743.5A CN109739921A (en) | 2019-01-07 | 2019-01-07 | A kind of big data acquisition system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910013743.5A CN109739921A (en) | 2019-01-07 | 2019-01-07 | A kind of big data acquisition system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109739921A true CN109739921A (en) | 2019-05-10 |
Family
ID=66363735
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910013743.5A Pending CN109739921A (en) | 2019-01-07 | 2019-01-07 | A kind of big data acquisition system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109739921A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111104233A (en) * | 2019-11-21 | 2020-05-05 | 深圳前海环融联易信息科技服务有限公司 | Data acquisition method and device, computer equipment and computer readable storage medium |
| CN112486972A (en) * | 2020-12-10 | 2021-03-12 | 四川瀚库智数科技有限公司 | College big data acquisition system and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201840467U (en) * | 2010-09-28 | 2011-05-25 | 深圳市倍泰健康测量分析技术有限公司 | Body health acquisition analysis equipment |
| CN103198636A (en) * | 2013-02-25 | 2013-07-10 | 中南大学 | High speed wireless data acquisition method and apparatus for pulsation pressure of high speed train |
| CN104111996A (en) * | 2014-07-07 | 2014-10-22 | 山大地纬软件股份有限公司 | Health insurance outpatient clinic big data extraction system and method based on hadoop platform |
| CN105353644A (en) * | 2015-09-29 | 2016-02-24 | 中国人民解放军63892部队 | Radar target track derivative system on the basis of information mining of real-equipment data and method thereof |
| CN107612664A (en) * | 2017-10-25 | 2018-01-19 | 京信通信***（中国）有限公司 | A kind of wireless chain control layer RLC data repeating methods, device and storage medium |
| CN108737503A (en) * | 2018-04-25 | 2018-11-02 | 江苏鸣鹤云科技有限公司 | A kind of efficient big data distributed transmission system and method |
-
2019
- 2019-01-07 CN CN201910013743.5A patent/CN109739921A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201840467U (en) * | 2010-09-28 | 2011-05-25 | 深圳市倍泰健康测量分析技术有限公司 | Body health acquisition analysis equipment |
| CN103198636A (en) * | 2013-02-25 | 2013-07-10 | 中南大学 | High speed wireless data acquisition method and apparatus for pulsation pressure of high speed train |
| CN104111996A (en) * | 2014-07-07 | 2014-10-22 | 山大地纬软件股份有限公司 | Health insurance outpatient clinic big data extraction system and method based on hadoop platform |
| CN105353644A (en) * | 2015-09-29 | 2016-02-24 | 中国人民解放军63892部队 | Radar target track derivative system on the basis of information mining of real-equipment data and method thereof |
| CN107612664A (en) * | 2017-10-25 | 2018-01-19 | 京信通信***（中国）有限公司 | A kind of wireless chain control layer RLC data repeating methods, device and storage medium |
| CN108737503A (en) * | 2018-04-25 | 2018-11-02 | 江苏鸣鹤云科技有限公司 | A kind of efficient big data distributed transmission system and method |
Non-Patent Citations (1)
| Title |
|---|
| 周发武 等: "《环境自动监控*** 技术与管理》", 31 October 2007, 中国环境科学出版社 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111104233A (en) * | 2019-11-21 | 2020-05-05 | 深圳前海环融联易信息科技服务有限公司 | Data acquisition method and device, computer equipment and computer readable storage medium |
| CN111104233B (en) * | 2019-11-21 | 2023-09-26 | 深圳前海环融联易信息科技服务有限公司 | Data acquisition method, device, computer equipment and computer readable storage medium |
| CN112486972A (en) * | 2020-12-10 | 2021-03-12 | 四川瀚库智数科技有限公司 | College big data acquisition system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108667870B (en) | IoT data reporting method, device and system | |
| CN110035055A (en) | Industrial equipment remote data acquisition and processing method and transmission method | |
| CN102655481B (en) | A kind of instant messaging chat content inspection method based on webpage and system | |
| CN104699598B (en) | Automated testing method, device, equipment and system | |
| CN105553740B (en) | Data-interface monitoring method and device | |
| CN109739921A (en) | A kind of big data acquisition system and method | |
| WO2020207371A1 (en) | Data processing system and method, apparatus, and electronic device | |
| US20130307972A1 (en) | System and method for providing a sensor and video protocol for a real time security data acquisition and integration system | |
| US20130307989A1 (en) | System and method for real-time data capture and packet transmission using a layer 2 wireless mesh network | |
| CN103607476B (en) | System and method for distributed multi-stage persistence of huge number of messages | |
| US20130307980A1 (en) | System and method for real time security data acquisition and integration from mobile platforms | |
| CN107992822B (en) | Image processing method and apparatus, computer device, computer-readable storage medium | |
| US20240048518A1 (en) | Systems and methods for automated message delivery feedback | |
| CN104683744A (en) | Network video monitoring system based on cloud platform | |
| CN103442361A (en) | Method for detecting safety of mobile application, and mobile terminal | |
| CN104539449B (en) | A kind of failure information processing method and relevant apparatus | |
| CN103455569A (en) | Method and system for recording external communication data of instant messaging | |
| CN108337399A (en) | Remote sensing image processing method and device | |
| CN101924815A (en) | 3G MOA phone middleware embedded system | |
| CN105721179A (en) | Log collection system and data transmission method and local server therein | |
| CN105515943A (en) | Instant messaging implementation method | |
| CN111984432A (en) | NETTY framework-based multi-type file analysis reporting system | |
| KR101986630B1 (en) | SHIP’S IoT DATA TRANSMISSION MANAGEMENT SYSTEM USING SATELLITE COMMUNICATION | |
| CN114666776A (en) | Data transmission method, device, equipment and readable storage medium | |
| CN103067375A (en) | Method and device of connection session among network nodes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190510 |
|
| RJ01 | Rejection of invention patent application after publication |