CN103763150A - Data acquisition system - Google Patents
Data acquisition system Download PDFInfo
- Publication number
- CN103763150A CN103763150A CN201410001462.5A CN201410001462A CN103763150A CN 103763150 A CN103763150 A CN 103763150A CN 201410001462 A CN201410001462 A CN 201410001462A CN 103763150 A CN103763150 A CN 103763150A
- Authority
- CN
- China
- Prior art keywords
- data
- acquisition
- acquisition plan
- filter condition
- plan
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a data acquisition system. The data acquisition system comprises an acquisition plan configuring module, an acquisition plan analyzing module and a data packet acquisition module, wherein the acquisition plan configuring module is used for providing an acquisition plan entry and management interface and establishing, revising, deleting and storing an acquisition plan, and the acquisition plan comprises the steps of acquiring related identification information of a sending source and a sending target; the acquisition plan analyzing module is used for analyzing the acquisition plan to obtain a filter condition corresponding to the acquisition plan, and the filter condition comprise IP addresses of the sending source and the sending target; the data packet capturing module is used for capturing acquired data of the business system according to the filter condition. The data acquisition system is concise in structure and easy to achieve.
Description
Technical field
The present invention relates to computer realm, relate in particular to a kind of data acquisition system.
Background technology
Along with the development of modern science and technology, Real-time Data Acquisition Technology has been penetrated into numerous technical fields such as the development, observing and controlling of geological prospecting, medicine equipment, radar, guided missile.At field of scientific study, by checking that the mass data of Real-time Collection storage finds new connecting each other of being significant, for scientific research provides data foundation; Aspect production management, can pass through Real-time Monitoring Data, find in time the problem that exists, avoid dangerous generation, simultaneously also for the later stage deals with problems data foundation is provided, and current data acquisition system structure is comparatively complicated, is difficult for realizing.
Summary of the invention
(1) technical problem that will solve
The technical problem to be solved in the present invention is to provide a kind of data acquisition system that is easy to realization.
(2) technical scheme
For solving the problems of the technologies described above, technical scheme of the present invention provides a kind of data acquisition system, comprising:
Acquisition plan configuration module, for typing and the management interface of acquisition plan are provided, comprise acquisition plan newly-built, revise, delete and preserve, described acquisition plan comprises the transmission source of image data and sends the relevant identity information of target;
Acquisition plan parsing module, for described acquisition plan is resolved, obtains filter condition corresponding to described acquisition plan, and described filter condition comprises described transmission source and sends the IP address of target;
Packet capture module, for catching the data of collected operation system according to described filter condition.
Further, described acquisition plan is preserved with XML form.
Further, described packet capture module is caught the data of the application layer of collected operation system according to described filter condition.
Further, described packet capture module is caught the data of the transport layer of collected operation system according to described filter condition.
Further, described packet capture module is caught the data of the network layer of collected operation system according to described filter condition.
(3) beneficial effect
Data acquisition system provided by the invention comprises acquisition plan configuration module, acquisition plan parsing module and packet capture module, wherein, this acquisition plan configuration module is for providing typing and the management interface of acquisition plan, this acquisition plan parsing module is for resolving acquisition plan, obtain filter condition corresponding to acquisition plan, then by packet capture module, according to filter condition, the data of collected operation system are caught, its framework is succinct, is easy to realize.
Accompanying drawing explanation
Fig. 1 is the schematic diagram of a kind of data acquisition system of providing of embodiment of the present invention.
Embodiment
Below in conjunction with drawings and Examples, the specific embodiment of the present invention is described in further detail.Following examples are used for illustrating the present invention, but are not used for limiting the scope of the invention.
Fig. 1 is the schematic diagram of a kind of data acquisition system of providing of embodiment of the present invention, comprising:
Acquisition plan configuration module 1, for typing and the management interface of acquisition plan are provided, comprise acquisition plan newly-built, revise, delete and preserve, described acquisition plan comprises the transmission source of image data and sends the relevant identity information of target;
Acquisition plan parsing module 2, for described acquisition plan is resolved, obtains filter condition corresponding to described acquisition plan, and described filter condition comprises described transmission source and sends the IP(Internet Protocol of target, Internet protocol) address;
Wherein, described acquisition plan can XML(Extensible Markup Language, extend markup language) form preserves.
Wherein, described packet capture module is caught the data of the application layer of collected operation system according to described filter condition.
Wherein, described packet capture module is caught the data of the transport layer of collected operation system according to described filter condition.
Wherein, described packet capture module is caught the data of the network layer of collected operation system according to described filter condition.
In embodiment of the present invention, acquisition plan configuration client is used for providing acquisition plan typing and management interface, comprise acquisition plan newly-built, revise, delete and preserve.Acquisition plan can comprise the transmission source of image data and send the relevant identity information of target, can also comprise the object of collection, information such as the class of business of collection, information types, and acquisition plan can be preserved with XML form.Acquisition plan parsing module is mainly used in acquisition plan to resolve, and obtains the information such as filter condition of packet capture module, and carries out corresponding configuration.The filter condition of packet capture module mainly comprises the transmission source of image data and sends the IP address of target, can also comprise port numbers and network protocol type etc.
In embodiment of the present invention, the mode of packet capture module capture-data can have three kinds, first kind of way is for each business software is when carrying out exchange message, can make a copy for according to the requirement setting in advance a to packet capture module simultaneously, or itself can provide the access interface of transceiving data the application layer of operation system, by datagram trapping module, call the data that this interface obtains transmitting-receiving.The second way is that each business software carries out information transmission by the transmission of short data message transmission service, the transmission of long data message transmission service and the transmission of real time information transmission service, can carry out packet capture in the transport layer of operation system.The third mode is for can carry out packet capture in network layer by network Sniffer Technique, preferably, the mode of packet capture module capture-data can be for adopt above-mentioned three kinds of modes simultaneously, particularly, the preferential first kind of way of using, if first kind of way can not be coordinated, can adopt the second way, wherein, the second way need to be carried out coding-decoding operation to dissimilar message, for example, its type of message can have hundreds of kind, encoding and decoding workload is larger, therefore, can be using the second way as first kind of way supplement, if certain class business can not realize data and make a copy for, by the second way, catch the data of such business transmitting-receiving.
The data acquisition system that embodiment of the present invention provides comprises acquisition plan configuration module, acquisition plan parsing module and packet capture module, wherein, this acquisition plan configuration module is for providing typing and the management interface of acquisition plan, this acquisition plan parsing module is for resolving acquisition plan, obtain filter condition corresponding to acquisition plan, then by packet capture module, according to filter condition, the data of collected operation system are caught, its framework is succinct, is easy to realize.
Above execution mode is only for illustrating the present invention; and be not limitation of the present invention; the those of ordinary skill in relevant technologies field; without departing from the spirit and scope of the present invention; can also make a variety of changes and modification; therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.
Claims (5)
1. a data acquisition system, is characterized in that, comprising:
Acquisition plan configuration module, for typing and the management interface of acquisition plan are provided, comprise acquisition plan newly-built, revise, delete and preserve, described acquisition plan comprises the transmission source of image data and sends the relevant identity information of target;
Acquisition plan parsing module, for described acquisition plan is resolved, obtains filter condition corresponding to described acquisition plan, and described filter condition comprises described transmission source and sends the IP address of target;
Packet capture module, for catching the data of collected operation system according to described filter condition.
2. data acquisition system according to claim 1, is characterized in that, described acquisition plan is preserved with XML form.
3. data acquisition system according to claim 1, is characterized in that, described packet capture module is caught the data of the application layer of collected operation system according to described filter condition.
4. data acquisition system according to claim 1, is characterized in that, described packet capture module is caught the data of the transport layer of collected operation system according to described filter condition.
5. data acquisition system according to claim 1, is characterized in that, described packet capture module is caught the data of the network layer of collected operation system according to described filter condition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410001462.5A CN103763150B (en) | 2014-01-02 | 2014-01-02 | Data collecting system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410001462.5A CN103763150B (en) | 2014-01-02 | 2014-01-02 | Data collecting system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103763150A true CN103763150A (en) | 2014-04-30 |
| CN103763150B CN103763150B (en) | 2017-09-22 |
Family
ID=50530313
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410001462.5A Active CN103763150B (en) | 2014-01-02 | 2014-01-02 | Data collecting system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103763150B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106953774A (en) * | 2016-01-07 | 2017-07-14 | 无锡聚云科技有限公司 | One kind is based on user-defined network packet snapping system |
| CN107167839A (en) * | 2017-06-05 | 2017-09-15 | 王伟巍 | A kind of IMF OBS multi-channel data acquisition application systems |
| CN110351259A (en) * | 2019-06-28 | 2019-10-18 | 深圳数位传媒科技有限公司 | A kind of method and device obtaining APP authentication information based on network packet capturing |
| CN112034802A (en) * | 2020-09-02 | 2020-12-04 | 江苏工程职业技术学院 | Data acquisition system applied to cloud data computing |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101068229A (en) * | 2007-06-08 | 2007-11-07 | 北京工业大学 | Content filtering gateway realizing method based on network filter |
| CN101594182A (en) * | 2009-06-15 | 2009-12-02 | 中兴通讯股份有限公司 | In ASON, realize the method and system of signaling tracing |
| CN101808017A (en) * | 2010-03-26 | 2010-08-18 | 中国科学院计算技术研究所 | Method and system for quantificationally calculating network abnormity index |
| CN101902365A (en) * | 2009-05-26 | 2010-12-01 | 北京启明星辰信息技术股份有限公司 | Method for monitoring P2P traffic of wide area network and system thereof |
-
2014
- 2014-01-02 CN CN201410001462.5A patent/CN103763150B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101068229A (en) * | 2007-06-08 | 2007-11-07 | 北京工业大学 | Content filtering gateway realizing method based on network filter |
| CN101902365A (en) * | 2009-05-26 | 2010-12-01 | 北京启明星辰信息技术股份有限公司 | Method for monitoring P2P traffic of wide area network and system thereof |
| CN101594182A (en) * | 2009-06-15 | 2009-12-02 | 中兴通讯股份有限公司 | In ASON, realize the method and system of signaling tracing |
| CN101808017A (en) * | 2010-03-26 | 2010-08-18 | 中国科学院计算技术研究所 | Method and system for quantificationally calculating network abnormity index |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106953774A (en) * | 2016-01-07 | 2017-07-14 | 无锡聚云科技有限公司 | One kind is based on user-defined network packet snapping system |
| CN107167839A (en) * | 2017-06-05 | 2017-09-15 | 王伟巍 | A kind of IMF OBS multi-channel data acquisition application systems |
| CN110351259A (en) * | 2019-06-28 | 2019-10-18 | 深圳数位传媒科技有限公司 | A kind of method and device obtaining APP authentication information based on network packet capturing |
| CN112034802A (en) * | 2020-09-02 | 2020-12-04 | 江苏工程职业技术学院 | Data acquisition system applied to cloud data computing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103763150B (en) | 2017-09-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210240719A1 (en) | Data stream analytics at service layer | |
| CN104301393B (en) | Laboratory data gathers and management system | |
| CN104036000B (en) | A kind of database audit method, Apparatus and system | |
| CN103152352A (en) | Perfect information security and forensics monitoring method and system based on cloud computing environment | |
| US20200382360A1 (en) | Cloud service transaction capsulation | |
| CN103763150A (en) | Data acquisition system | |
| CN103106368A (en) | Vulnerability scanning method for grade protection | |
| CN206686205U (en) | The multiple-protection network architecture | |
| CN104113553A (en) | Port state recognition method, device and system | |
| CN102624878B (en) | Method and system for identifying P2P (peer-to-peer) protocol on basis of DNS (domain name server) protocol | |
| CN104618142B (en) | News subscribing method, treatment node device and bus apparatus | |
| CN108347698A (en) | A kind of on-line off-line event trace analysis method, apparatus and system | |
| CN105450997A (en) | Cloud storage based video monitoring system | |
| Costin et al. | A Real-Time Streaming System for Customized Network Traffic Capture | |
| CN105991353A (en) | Fault location method and device | |
| CN103957119A (en) | Method for managing network equipment by using MIB file and browser | |
| CN104702469A (en) | Method for monitoring network data, entity machine virtual device and network system | |
| CN104022917B (en) | Cloud bridge monitoring method | |
| CN204256779U (en) | A kind of collaborative campaign lab of handling a case | |
| US11966476B2 (en) | Deep application discovery and forensics for automated threat modeling | |
| CN102053808A (en) | Method, device for printing software information as well as equipment with network interface | |
| CN105681317A (en) | Novel business and database auditing engine | |
| CN112671949B (en) | Method and system for associating NAT front-back session according to syslog log | |
| CN109617866A (en) | Industrial control system host session data filtering method and device | |
| CN115514670B (en) | Data capturing method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |