CN107402869A - Collecting method, device and system - Google Patents
Collecting method, device and system Download PDFInfo
- Publication number
- CN107402869A CN107402869A CN201710566404.0A CN201710566404A CN107402869A CN 107402869 A CN107402869 A CN 107402869A CN 201710566404 A CN201710566404 A CN 201710566404A CN 107402869 A CN107402869 A CN 107402869A
- Authority
- CN
- China
- Prior art keywords
- data
- monitoring data
- monitoring
- acquisition unit
- application program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
- G06F11/3086—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves the use of self describing data formats, i.e. metadata, markup languages, human readable formats
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Library & Information Science (AREA)
- Mathematical Physics (AREA)
- Stored Programmes (AREA)
- Debugging And Monitoring (AREA)
Abstract
The present invention proposes a kind of collecting method, device and system, wherein, method includes：When getting access request, the monitoring data of acquisition applications program；Access request be in user's access application, application program generation；After application program terminates response to access request, stop the collection of monitoring data；The programming language used according to monitoring data, linguistic labelses corresponding with programming language are added for monitoring data, to obtain propelling data；Linguistic labelses are used to, by the data format of monitoring data, be indicated to data acquisition unit, so that data acquisition unit carries out Data Format Transform according to linguistic labelses；Propelling data is pushed to data acquisition unit；Wherein, data acquisition unit is independently of application program.Solve it is existing wait data acquisition unit acquisition monitoring data to be stored, it is necessary to take local resource to data due to passive, the problem of causing to take excessive application program local resource.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of collecting method, device and system.
Background technology
When application program is run, for the ease of being monitored, probe often is added for application program, so as to be obtained by probe
Take the monitoring data of application program.
But in the prior art, on the one hand, probe needs to wait data acquisition unit gathered data, and therefore, probe can take
Application program local resource stores to data, is unfavorable for the operation of application program；On the other hand, due to different language probe
The data format of the data collected is different, and probe also needs to locally carry out corresponding Data Format Transform in application program.Can
See, in the prior art, the expense of probe is larger, occupies excessive application program local resource.
The content of the invention
It is contemplated that at least solves one of technical problem in correlation technique to a certain extent.
Therefore, first purpose of the present invention is to propose a kind of collecting method, by being used according to monitoring data
Programming language, add corresponding with programming language linguistic labelses for monitoring data, and will addition linguistic labelses monitoring number
According to data acquisition unit is pushed to, realize and monitoring data is actively pushed into data acquisition unit, it is existing due to passive etc. to solve
Pending data collector acquisition monitoring data store, it is necessary to take local resource to data, cause to take excessive application journey
The problem of sequence local resource.
Second object of the present invention is to propose a kind of collecting method.
Third object of the present invention is to propose a kind of data collecting system.
Fourth object of the present invention is to propose a kind of data acquisition device.
The 5th purpose of the present invention is to propose a kind of data acquisition device.
The 6th purpose of the present invention is to propose a kind of computer equipment.
The 7th purpose of the present invention is to propose a kind of non-transitorycomputer readable storage medium.
The 8th purpose of the present invention is to propose a kind of computer program product.
For the above-mentioned purpose, first aspect present invention embodiment proposes a kind of collecting method, including：Get access
During request, the monitoring data of acquisition applications program；Access request be in user's access application, application program generation；
After application program terminates response to access request, stop the collection of monitoring data；The programming language used according to monitoring data,
Linguistic labelses corresponding with programming language are added for monitoring data, to obtain propelling data；Linguistic labelses are used for monitoring data
Data format, be indicated to data acquisition unit so that data acquisition unit according to linguistic labelses carry out Data Format Transform；To data
Collector pushes propelling data；Wherein, data acquisition unit is independently of application program.
The collecting method of the embodiment of the present invention, by when getting access request, the monitoring of acquisition applications program
Data, when application program terminates response to access request, stop the collection of monitoring data, used according to the monitoring data of collection
Programming language, corresponding with programming language linguistic labelses are added for monitoring data, to obtain propelling data, and by propelling data
Push to data acquisition unit.Hereby it is achieved that monitoring data actively is pushed into data acquisition unit, solve existing due to quilt
It is dynamic to wait data acquisition unit acquisition monitoring data to be stored, it is necessary to take local resource to data, cause to take excessive answer
The problem of with program local resource.
In addition, the collecting method that the embodiment of the present invention proposes, also following additional technical feature：
In one embodiment of the invention, after the collection for stopping monitoring data, in addition to：According to the number of monitoring data
According to type, the suffix corresponding to addition in the index name of monitoring data；Suffix, required use during for by supervising data storage
Data type, it is indicated to data acquisition unit.
In one embodiment of the invention, after the collection for stopping monitoring data, in addition to：According to the number of monitoring data
According to classification, category label corresponding with data category is added for monitoring data；Category label, for will be carried out needed for monitoring data
Handling process, be indicated to data acquisition unit.
In one embodiment of the invention, propelling data is pushed to data acquisition unit, including：Assisted using Preset Transfer
View, protocol processes are carried out to propelling data；Using default transmission means, the propelling data after protocol processes is pushed into data
Collector.
For the above-mentioned purpose, second aspect of the present invention embodiment proposes a kind of collecting method, including：Receive probe institute
The propelling data of push；Propelling data includes the monitoring data of application program, and the linguistic labelses of monitoring data；Wherein, visit
Pin is arranged in application program；According to the linguistic labelses of monitoring data, data format corresponding to query language label；According to inquiry
To data format, monitoring data is converted into object format.
The collecting method of the embodiment of the present invention, the propelling data pushed by receiving probe, according to monitoring data
Linguistic labelses, data format corresponding to query language label, according to data format is inquired, monitoring data is converted into target
Form.Hereby it is achieved that monitoring data to be converted to unified data format according to linguistic labelses, solve in the prior art by
It is different in the monitoring data form of different language probe collection to turn, it is necessary to locally carry out corresponding data format in application program
Change, cause the big technical problem of probe expense.
In addition, the collecting method that the embodiment of the present invention proposes, also following additional technical feature：
In one embodiment of the invention, propelling data also includes the category label of monitoring data, receives probe and is pushed away
After the propelling data sent, in addition to：Read the category label of monitoring data；According to category label, using corresponding processing stream
Journey is handled monitoring data.
In one embodiment of the invention, category label is included in achievement data, Transaction Information and abnormal information data
It is at least one；Handling process includes corresponding to achievement data：Monitoring data is cached；To the prison cached in preset period of time
Control data are counted, to obtain statistical value, wherein, statistical value includes average value and/or variance；Handled corresponding to Transaction Information
Flow includes：Timestamp is extended and/or added to monitoring data；Handling process corresponding to abnormal information data includes：It is right
Timestamp is cleaned, compressed and/or added to monitoring data.
In one embodiment of the invention, after monitoring data being converted into object format, in addition to：Read monitoring number
According to index name suffix；According to suffix, query configuration file, the data class of required use during determining supervising data storage
Type；According to the data type determined, data type conversion is carried out to monitoring data.
For the above-mentioned purpose, third aspect present invention embodiment proposes a kind of data collecting system, including：Probe, it is used for
Perform the collecting method as described in first aspect embodiment；Data acquisition unit, for performing such as second aspect embodiment institute
The collecting method stated.
The data collecting system that the embodiment of the present invention proposes, please in the access for getting application program by probe collection
Ask, terminate the monitoring data in response time section to access request to application program, the programming language used according to monitoring data,
Linguistic labelses corresponding with programming language are added for monitoring data, to obtain propelling data, and propelling data are pushed into data
Collector, after data acquisition unit receives propelling data, according to the linguistic labelses of monitoring data in propelling data, query language mark
Data format corresponding to label, and monitoring data is converted into object format.Hereby it is achieved that according to linguistic labelses by monitoring data
Unified data format is converted to, and monitoring data is actively pushed into data acquisition unit, is solved existing due to different languages
Say that the monitoring data form of probe collection is different, it is necessary to locally carry out corresponding Data Format Transform, Yi Jiyou in application program
In passively waiting data acquisition unit acquisition monitoring data to be stored, it is necessary to take local resource to data, probe expense is caused
Greatly, the problem of taking excessive application program local resource.
In addition, the data collecting system that the embodiment of the present invention proposes, also following additional technical feature：
In one embodiment of the invention, data collecting system also includes：Data storage, for data acquisition unit
Monitoring data after processing is stored；Data-analyzing machine, for carrying out data point to the monitoring data of data memory storage
Analysis；Display device, it is shown for carrying out the data results that data analysis obtains to data-analyzing machine.
For the above-mentioned purpose, fourth aspect present invention embodiment proposes a kind of data acquisition device, including：Gather mould
Block, during for getting access request, the monitoring data of acquisition applications program；Access request is in user's access application
When, application program generation；After application program terminates response to the access request, stop the collection of institute's monitoring data；Patch
Module is marked, for the programming language used according to monitoring data, linguistic labelses corresponding with programming language are added for monitoring data,
To obtain propelling data；Linguistic labelses are used to, by the data format of monitoring data, data acquisition unit is indicated to, so that data acquisition
Device carries out Data Format Transform according to linguistic labelses；Pushing module, for pushing propelling data to data acquisition unit；Wherein, number
According to collector independently of application program.
The data acquisition device that the embodiment of the present invention proposes, by when getting access request, acquisition applications program
Monitoring data, when application program terminates response to access request, stop the collection of monitoring data, according to the monitoring data of collection
The programming language of use, linguistic labelses corresponding with programming language are added for monitoring data, to obtain propelling data, and will push
Data-pushing is to data acquisition unit.Hereby it is achieved that monitoring data actively is pushed into data acquisition unit, solve it is existing by
In passively waiting data acquisition unit acquisition monitoring data to store data, it is necessary to take local resource, cause to take excessively
Application program local resource the problem of.
For the above-mentioned purpose, fifth aspect present invention embodiment proposes a kind of data acquisition device, including：Receiving module,
The propelling data pushed for receiving probe；Propelling data includes the monitoring data of application program, and the language of monitoring data
Say label；Wherein, probe is arranged in the application program；Enquiry module, for the linguistic labelses according to monitoring data, inquiry
Data format corresponding to linguistic labelses；Modular converter, for according to data format is inquired, monitoring data to be converted into target lattice
Formula.
The data acquisition device that the embodiment of the present invention proposes, the propelling data pushed by receiving probe, according to monitoring
The linguistic labelses of data, data format corresponding to query language label, according to data format is inquired, monitoring data is converted to
Object format.Hereby it is achieved that monitoring data to be converted to unified data format according to linguistic labelses, solves prior art
In due to the monitoring data form of different language probe collection it is different, it is necessary to locally carry out corresponding data format in application program
Conversion, causes the big technical problem of probe expense.
For the above-mentioned purpose, sixth aspect present invention embodiment proposes a kind of computer equipment, including memory, processor
And storage is on a memory and the computer program that can run on a processor, during computing device program, such as first party is realized
Collecting method described in the embodiment of face, or, the collecting method as described in second aspect embodiment.
For the above-mentioned purpose, seventh aspect present invention embodiment proposes a kind of non-transitorycomputer readable storage medium,
Computer program is stored thereon with, the data acquisition side as described in first aspect embodiment is realized when the program is executed by processor
Method, or, the collecting method as described in second aspect embodiment.
For the above-mentioned purpose, eighth aspect present invention embodiment proposes a kind of computer program product, works as computer program
When instruction in product is by computing device, the collecting method as described in first aspect embodiment is performed, or, such as second
Collecting method described in aspect embodiment.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
Of the invention above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Substantially and it is readily appreciated that, wherein：
A kind of schematic flow sheet for collecting method that Fig. 1 is provided by the embodiment of the present invention；
A kind of schematic flow sheet that propelling data is pushed to data acquisition unit that Fig. 2 is provided by the embodiment of the present invention；
The schematic flow sheet for another collecting method that Fig. 3 is provided by the embodiment of the present invention；
The schematic diagram for the data type that a kind of dynamic field matching process that Fig. 4 is provided by the embodiment of the present invention is commonly used；
A kind of schematic flow sheet for specific collecting method that Fig. 5 is provided by the embodiment of the present invention；
The schematic flow sheet for another collecting method that Fig. 6 is provided by the embodiment of the present invention；
A kind of data acquisition unit that Fig. 7 is provided by the embodiment of the present invention receives the schematic flow sheet of propelling data；
The schematic flow sheet for another collecting method that Fig. 8 is provided by the embodiment of the present invention；
A kind of mistake that data type conversion is carried out using dynamic field matched rule that Fig. 9 is provided by the embodiment of the present invention
The schematic diagram of journey；
A kind of application scenarios using Dynamic Matching rule-conversion data type that Figure 10 is provided by the embodiment of the present invention
Schematic diagram；
A kind of data type conversion method contrast schematic diagram that Figure 11 is provided by the embodiment of the present invention；
A kind of schematic flow sheet for specific collecting method that Figure 12 is provided by the embodiment of the present invention；
A kind of structural representation for data collecting system that Figure 13 is provided by the embodiment of the present invention；
The structural representation for another data collecting system that Figure 14 is provided by the embodiment of the present invention；
A kind of functional schematic for data collecting system that Figure 15 is provided by the embodiment of the present invention；
Figure 16 implements a kind of structural representation for data acquisition device that institute's example provides for the present invention；
Figure 17 implements the structural representation for another data acquisition device that institute's example provides for the present invention.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end
Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and is not considered as limiting the invention.
Below with reference to the accompanying drawings collecting method, the device and system of the embodiment of the present invention are described.
When application program is run, for the ease of being monitored, probe often is added for application program, so as to be obtained by probe
Take the monitoring data of application program.
But in the prior art, on the one hand, probe needs to wait data acquisition unit gathered data, and therefore, probe can take
Application program local resource stores to data, is unfavorable for the operation of application program；On the other hand, due to different language probe
The data format of the monitoring data of collection is different, and probe also needs to locally carry out corresponding Data Format Transform in application program.
It can be seen that in the prior art, the expense of probe is larger, excessive application program local resource is occupied.
For this problem, the embodiment of the present invention proposes a kind of collecting method, passes through what is used according to monitoring data
Programming language, linguistic labelses corresponding with programming language, and the monitoring data that linguistic labelses will be added are added for monitoring data
Data acquisition unit is pushed to, realizes and monitoring data is actively pushed into data acquisition unit, it is existing due to passive wait to solve
Data acquisition unit acquisition monitoring data store, it is necessary to take local resource to data, cause to take excessive application program
The problem of local resource.
A kind of schematic flow sheet for collecting method that Fig. 1 is provided by the embodiment of the present invention.With reference to Fig. 1 from spy
Pin side describes the collecting method of proposition of the embodiment of the present invention.
As shown in figure 1, the collecting method comprises the following steps：
S101, when getting access request, the monitoring data of acquisition applications program.
Wherein, access request is in user's access application, by application program generation.For example, when user opens
During Alipay, Alipay will generate user and access the access request of Alipay, and be responded according to access request.
In an embodiment of the present invention, probe can be set in the application in advance, to pass through probe collection application program
Monitoring data.Wherein, different types of probe can be set according to the difference of programming language, as Java probes, PHP probes,
.Net probe etc..
Specifically, when user opens some application program, access request corresponding to application program generation.Probe is obtaining
When getting access request, start the monitoring data of acquisition applications program, such as weigh achievement data, the number of transactions of application program capacity
According to etc..
S102, after application program terminates response to access request, stop the collection of monitoring data.
In an embodiment of the present invention, probe collection is from getting access request, to application program to access request
Terminate the monitoring data in the period of response.
S103, the programming language used according to monitoring data, language mark corresponding with programming language is added for monitoring data
Label, to obtain propelling data.
Wherein, linguistic labelses are used to, by the data format of monitoring data, data acquisition unit is indicated to, so that data acquisition unit
Data Format Transform is carried out according to linguistic labelses.
Because different programming languages has different syntax rules, therefore, using the monitoring data of different programming languages,
Its data format also differs.For the data format of unified monitoring data, it is easy to be stored with identical data format, this
Inventive embodiments propose to be to add linguistic labelses using the monitoring data of different programming languages.
Specifically, after acquisition monitoring data are stopped, according to the programming language of the monitoring data of collection use, for monitoring
Data add corresponding with programming language linguistic labelses, so as to the linguistic labelses that obtain including monitoring data and monitoring data
Propelling data.
If for example, in the monitoring data of collection, achievement data is using Java language, and Transaction Information is using C
Language, then it is achievement data and Transaction Information, linguistic labelses corresponding with Java language and C language is added respectively, in order to number
According to collector according to linguistic labelses search monitoring data use programming language, and will data format corresponding with programming language,
Be converted to unified data format.
S104, propelling data is pushed to data acquisition unit.
Wherein, data acquisition unit is independently of application program.That is, set from probe different in the application
It is that the function of data acquisition unit is realized independent of application program.
For using the monitoring data of different programming languages, after adding linguistic labelses corresponding with programming language, probe leads to
Data transmission interface is crossed by propelling data, pushes to data acquisition unit.
Specifically, the host-host protocol of propelling data use, and default transmission means are pre-set.When probe generation pushes away
When sending data, using default host-host protocol, protocol processes are carried out to propelling data.Then, using default transmission means, lead to
Data transmission interface is crossed by the propelling data after protocol processes, pushes to data acquisition unit.
As a kind of example, the flow of active push propelling data, as shown in Figure 2.Data transfer mode is created first, such as
It is transmitted using block type I/O；Data Transport Protocol is created afterwards, and uses binary coded format compressed data, to carry
Rise data transmission efficiency；Finally, data sending terminal is created based on transmission means and host-host protocol, after sending compression by transmitting terminal
Propelling data, to data acquisition unit.
In the embodiment of the present invention, propelling data is actively pushed to data acquisition unit by probe, and in the prior art due to visiting
Pin needs passively to wait data acquisition unit gathered data, and probe can take application program local resource and carry out storage phase to data
Than, it is not necessary to take excessive application program local resource.
Alternatively, as shown in figure 3, after the collection of monitoring data is stopped, the collecting method may also include step
S105。
S105, according to the data type of monitoring data, the suffix corresponding to addition in the index name of monitoring data.
Wherein, index name refers to the title of application program capacity index, such as the entitled http_ of the index of http conditional codes
code.Suffix, the data type of required use, is indicated to data acquisition unit during for by supervising data storage.
Because the data type between different programming languages has differences, the different probe of programming language classification and data
It is possible that problem when carrying out data transmission between collector.Such as Javascript (abbreviation JS), PHP belong to weak type language
Say (data type can be ignored), specified data type is not needed when defining index name；And JAVA, C language belong to strongly-typed
Language (all necessary Define before of all variables), needs specified data type when defining index name.
In addition, when probe is to data acquisition unit propelling data, due to the programming language of the monitoring data use of probe collection
The difference for the programming language that data acquisition unit of making peace uses, what the data type for causing data acquisition unit to receive was not intended to
Data type, at this moment need to carry out data type conversion.For example, the programming language that the monitoring data of JS probe collections uses is JS
Language, and at this moment data acquisition unit needs to carry out data type conversion using SCALA language.
For the transfer standard of unified different programming language data types, the embodiment of the present invention proposes defining monitoring data
Index name when, by adding suffix in index name, make suffix of the data acquisition unit according to index name, carry out data type
Conversion, is made monitoring data and is finally stored with the data type after conversion.
In a kind of possible way of realization of the present invention, it can be added using dynamic field matched rule in index name
Suffix, data type during supervising data storage is directly specified by suffix.As shown in figure 4, suffix _ is can be used, monitoring is represented
The data type of data corresponds to int arrays；With suffix _ dt, represent that the data type of monitoring data corresponds to date date etc.
Deng.
In the embodiment of the present invention, by the data type according to monitoring data, after being added in the index name of monitoring data
Sew, specify the final storage class of monitoring data, realize when defining index name, the data for specifying monitoring data finally to store
Type, the transfer standard of data type is unified, the data that can effectively avoid different programming language data type differences from bringing
Problem.
Alternatively, as shown in figure 3, after the collection of monitoring data is stopped, the collecting method may also include step
S106。
S106, according to the data category of monitoring data, category label corresponding with data category is added for monitoring data.
Wherein, category label, for the handling process that will be carried out needed for monitoring data, it is indicated to data acquisition unit.
During being run in application program, the data category of the monitoring data of collection includes but is not limited to index number
According to, Transaction Information, abnormal information data etc..Also, for the monitoring data of different pieces of information classification, the handling process needed for it
Also differ.
Therefore, in order to distinguish the monitoring data of different pieces of information classification, in the embodiment of the present invention, according to the data of monitoring data
Classification, corresponding with data category category label is added for monitoring data, so that data acquisition unit is according to category label, to monitoring
Data carry out corresponding handling process.
It should be noted that the embodiment of the present invention is not construed as limiting for the execution sequence of step S103,105,106.
Below by a specific embodiment, the collecting method that the embodiment of the present invention proposes is described in detail.
As shown in figure 5, the collecting method includes：
S501, sample frequency is set.
When sample frequency is set, progress can be set fully sampled, fractional-sample can also be carried out.For example, apply journey at certain
During sort run, share 10 monitoring datas, can set it is fully sampled, i.e., probe obtain 10 monitoring datas.
In actual applications, whole monitoring datas need not be typically obtained, is answered as long as obtaining a part and can be obtained by
With the variation tendency of program feature, at this moment, can be sampled with setting unit.10 monitoring datas are such as shared, probe can be set and obtain
Wherein 2 monitoring datas.
By setting fully sampled or fractional-sample, with corresponding different concurrent demands, probe can be reduced to application program
Influence.
S502, probe registration.
In embodiments of the present invention, can be in the application program for needing to monitor, a variety of programming language types are registered in addition
Probe, such as JAVA probes, PHP probes .NET probes, realize the monitoring data for supporting to gather a variety of programming languages.
S503, generate access request.
When user opens application program, application program generation access request.For example, transferred accounts when opening Alipay
When, application program generates access request of transferring accounts.
S504, acquisition monitoring data.
When getting the access request of application program generation, probe is transported according to the sample frequency of setting to application program
Monitoring data during row is acquired, untill application program terminates response to access request.Wherein, the monitoring of collection
Data can be application program from getting access request, to beginning to respond to time that access request undergone etc..
For the transfer standard of unified different programming language data types, the embodiment of the present invention proposes defining index name
When, suffix is added in index name by dynamic field matched rule, data acquisition unit is entered line number according to the suffix of index name
According to the conversion of type, make monitoring data and finally stored with the data type after conversion.
S505, interpolation data category label.
In order to distinguish the monitoring data of different pieces of information classification, according to the data category of monitoring data, added for monitoring data
Category label corresponding with data category, so that data acquisition unit is handled monitoring data accordingly according to category label
Flow.
S506, add programming language label.
After for monitoring data interpolation data category label, according to the programming language of the monitoring data of collection use, for prison
Control data and add linguistic labelses corresponding with programming language, so as to obtain including the linguistic labelses of monitoring data and monitoring data
Propelling data.
If for example, in the monitoring data of collection, achievement data is using Java language, and Transaction Information is using C
Language, then it is achievement data and Transaction Information, linguistic labelses corresponding with Java language and C language is added respectively, in order to number
According to collector according to linguistic labelses know monitoring data use programming language, and will data format corresponding with programming language,
Be converted to unified data format.
S507, propelling data.
After linguistic labelses corresponding with programming language are with the addition of for monitoring data, by default host-host protocol to push
Data carry out protocol processes, to meet the needs of host-host protocol.Afterwards, using default host-host protocol, after protocol processes
Propelling data pushes to data acquisition unit.
After propelling data is pushed into data acquisition unit, new access request can be continued waiting for, is getting new visit
After asking request, step S504-S507 operation is performed.
The collecting method of the embodiment of the present invention, by when getting access request, the monitoring of acquisition applications program
Data, when application program terminates response to access request, stop the collection of monitoring data, used according to the monitoring data of collection
Programming language, corresponding with programming language linguistic labelses are added for monitoring data, to obtain propelling data, and by propelling data
Push to data acquisition unit.Hereby it is achieved that monitoring data actively is pushed into data acquisition unit, solve existing due to quilt
It is dynamic to wait data acquisition unit acquisition monitoring data to be stored, it is necessary to take local resource to data, cause to take excessive answer
The problem of with program local resource.
For an embodiment in clear explanation, a kind of collecting method is present embodiments provided.Fig. 6 is implemented for the present invention
The schematic flow sheet for another collecting method that example is provided.
With reference to Fig. 6, the collecting method of proposition of the embodiment of the present invention is described from data acquisition unit side.
As shown in fig. 6, the collecting method may comprise steps of：
S601, receive the propelling data that probe is pushed；Propelling data includes the monitoring data of application program, and monitoring
The linguistic labelses of data.
Wherein, probe is set in the application, and the probe of a variety of programming languages can be set, to gather a variety of programmings
The monitoring data of preamble.
One example of propelling data pushed as data acquisition unit reception probe, as shown in Figure 7.Data acquisition first
Device creates data-processing interface；Then, data processing object is created based on data-processing interface；Afterwards, transmission side data is created
Formula and Data Transport Protocol, it should be noted that both are consistent with number sound end；Finally, based on data processing object, number
According to transmission means and Data Transport Protocol, create and log-on data is received and serviced, in this example, selection is hindered using multithreading standard
Plug I/O modes, receive propelling data.
S602, according to the linguistic labelses of monitoring data, data format corresponding to query language label.
Data acquisition unit obtains linguistic labelses corresponding to monitoring data after propelling data is received from propelling data,
With the linguistic labelses according to monitoring data, data format corresponding to the linguistic labelses is inquired about.
If for example, in the propelling data that data acquisition unit receives, including 3 monitoring data, wherein 2 monitoring datas pair
The linguistic labelses answered are JAVA language label, then according to the label, inquire about data format corresponding to JAVA language.
S603, according to data format is inquired, monitoring data is converted into object format.
Data acquisition unit is converted to monitoring data pre-defined object format according to data format is inquired, so as to
Make the monitoring data of different programming languages, be converted into unified object format.
Further, after monitoring data being converted into unified object format, as shown in figure 8, the collecting method is also
It may include：
S604, read the suffix of the index name of monitoring data.
In order to by the data type of monitoring data, be converted to the data type of definition, it is necessary to read the index of monitoring data
The suffix of name.
S605, according to suffix, query configuration file, the data type of required use during determining supervising data storage.
In an embodiment of the present invention, regular expression can be advanced with and define dynamic field Matching Model, generation configuration
File.After the suffix of index name of monitoring data is read, query configuration file, index suffix is entered according to canonical matched rule
Row matching, the data type of required use during determining supervising data storage.
S606, according to the data type determined, data type conversion is carried out to monitoring data.
Specifically, using dynamic field matched rule, the process of data type conversion is carried out, as shown in Figure 9.First, it is sharp
Dynamic field Matching Model is defined with using regular expression, generates configuration file.After propelling data is received, configuration is read
File, and using regular expression in configuration file, the suffix with monitoring data index name suffix match is searched, to determine to supervise
Control data need the data type be converted to, common data conversion type, if as shown in figure 4, after monitoring data index name
Sew is that " * _ dt ", then corresponding data type is date, i.e. the data type of monitoring data needs to be converted to date types.
Below by with reference to Figure 10, illustrate the scene that data type conversion is carried out using dynamic field matched rule.
When the probe of different programming languages sends data, the data type of identical achievement data can have differences.Such as figure
Shown in 10, HTTP conditional codes defined in JS, integer type may be assigned in assignment, HTTP can be directly defined in JAVA
The type of conditional code, and it is desirable that be probably character string type, at this moment need to carry out data type conversion.
In Figure 10, it is respectively JS probes, JAVA probes to have two kinds of probes, and data acquisition unit is using SCALA programming languages
Speech.If it is desired to http conditional codes are stored in the form of character string, then for the http conditional codes that programming language is JS, the number of script
It is integer type according to type, when defining index name, suffix _ s is added in index name using dynamic field matched rule, by index
Name is defined as http_code_s.
Similarly, for the http conditional codes that programming language is JAVA, because JAVA is strong speech like sound, index name is being defined
When, can in index name suffix addition _ s, specify its data type.After data acquisition unit receives monitoring data, using just
Then expression formula matched rule, finding dynamic field matching, " * _ s ", its corresponding data type are character string String types.Afterwards,
Two kinds of monitoring data is converted to String types by data acquisition unit.Finally, http conditional codes are stored with String types.
For data type difference problem, generally use is that dictionary pattern matching method is changed, as shown in figure 11, definition
One file for including all index name and corresponding data type, when receiving data and needing type to change, traversal
Whole file searches index name and corresponding data type.But this data type conversion method efficiency is low, also,
When increasing index name, it is also necessary to update the matching corresponding relation of dictionary file.
As shown in figure 11, the dynamic field matching process that the embodiment of the present invention proposes, it is only necessary to which probe is in monitoring data
Designated suffix (if data type conversion need not be carried out, not having to addition suffix) is added in index name, is connect in data acquisition unit
After receiving monitoring data, in the configuration file of dynamic field is defined using regular expression, the field and correspondingly of matching is searched
Data type, and monitoring data is converted to the data type specified, realizes type that data acquisition unit finally exports to refer to
Fixed data type.
In addition, this method not only increases the conversion efficiency of data type, and frequent updating configuration file is not needed, just
When can efficiently solve the monitoring data for receiving different programming languages, the problem of factor data type difference causes.
In summary, by the suffix and dynamic field matched rule of monitoring data index name, monitoring data can be turned
It is changed to used data type during storage.
Further, the propelling data that data acquisition unit receives may also include the category label of monitoring data, according to class
Do not mark, different handling processes is carried out to monitoring data.With reference to Figure 12, the data acquisition proposed to the embodiment of the present invention
Method is described in detail.
First, data acquisition unit starts the service for receiving monitoring data, to receive the monitoring of different programming language types
Data.Then, the classification of monitoring data is judged by calling interface.
If monitoring data is achievement data, monitoring data is cached, and counts monitoring data in preset time period, with
To statistical value, such as average value, variance, standard deviation, then linguistic labelses in monitoring data, by the number of monitoring data
Unified data format is converted to according to form, monitoring data is converted to the data specified using dynamic field matched rule afterwards
Type, stored finally by data transmission interface.
If monitoring data is Transaction Information, monitoring data is extended, geographical position is such as carried out according to IP address
Information expansion, and timestamp is added, then the linguistic labelses in monitoring data, by the Data Format Transform of monitoring data
For unified data format, monitoring data is converted to the data type specified using dynamic field matched rule afterwards, finally
Stored by data transmission interface.
If monitoring data is abnormal information data, monitoring data is cleaned, removes unwanted information, then
It is compressed, and adds timestamp, then the linguistic labelses in monitoring data, is by the Data Format Transform of monitoring data
Unified object format, monitoring data is converted to the data type specified using dynamic field matched rule afterwards, finally led to
Data transmission interface is crossed to be stored.Abnormal information data are cleaned, compressed, can reduce abnormal information data size,
Save memory space.
If monitoring data is not above-mentioned three kinds of data, it is considered as abnormal data.Handling process to abnormal data is, right
Abnormal data is counted, stored, and so as to the state as reference record probe, is reached to probe managerial role, and according to
Abnormal data generates warning message, and is transmitted by Data expansion interface.In addition, can also be right by Data expansion interface
Data carry out segment crawl analysis, abnormal data statistics, probe state record analysis etc..
The collecting method of the embodiment of the present invention, the propelling data pushed by receiving probe, according to monitoring data
Linguistic labelses, data format corresponding to query language label, according to data format is inquired, monitoring data is converted into target
Form.Hereby it is achieved that monitoring data to be converted to unified data format according to linguistic labelses, solve in the prior art by
It is different in the monitoring data form of different language probe collection to turn, it is necessary to locally carry out corresponding data format in application program
Change, cause the big technical problem of probe expense.
In order to realize above-described embodiment, the present invention also proposes a kind of data collecting system.
As shown in figure 13, the data collecting system includes：Probe 1310, data acquisition unit 1320.
Probe 1310, for performing the collecting method of the probe side as described in above-mentioned embodiment.
Data acquisition unit 1320, for performing the collecting method of the data acquisition unit side as described in above-mentioned embodiment.
Further, as shown in figure 14, the data collecting system also includes：Data storage 1330, data-analyzing machine
1340th, display device 1350.
Wherein, data storage 1330 is used to store the monitoring data after data collector for processing.
Data-analyzing machine 1340 is used to carry out data analysis to the monitoring data of data memory storage.
Display device 1350 is used to be shown the data results that data-analyzing machine progress data analysis obtains.
For clear explanation above-described embodiment, with reference to Figure 15, it is real that the present invention is described in detail by a specific embodiment
Apply the data collecting system of example proposition.
The probe in data collecting system shown in Figure 15, it can gather using JAVA language, PHP language, JS language .NET
The monitoring data of four kinds of language of language, and the monitoring data of collection is pushed to data acquisition unit.Data acquisition unit passes through data
Receiving interface, data aggregation service is carried out, receive the monitoring data of different programming language types.Data acquisition is entered to monitoring data
Row processing, such as data statistics or extension, data format unification, data type conversion, as described in above-mentioned embodiment, herein not
Repeat again.
After data acquisition unit is handled monitoring data completion, by data transmission interface, the monitoring data after processing is sent out
Data storage is delivered to be stored.After data storage receives the monitoring data after processing, it is stored.Afterwards,
Data-analyzing machine carries out data analysis to the monitoring data of data memory storage, and analysis result is sent into display device.Most
Afterwards, display device display data analysis result, such as by UI displaying interface analysis results, family can be used easily to know to application
The monitored results of program.
It can thus be seen that corresponded to unlike a data acquisition unit from the probe of existing different programming languages,
In the data collecting system that the embodiment of the present invention proposes, the probe of different programming languages can correspond to a data acquisition unit, and
Data acquisition unit extends some other functions, such as the matching of Data expansion, dynamic field, and open growth data interface, with
Realize the functions such as data grabber, abnormal data statistics, probe state analysis.
The data collecting system that the embodiment of the present invention proposes, please in the access for getting application program by probe collection
Ask, terminate the monitoring data in response time section to access request to application program, the programming language used according to monitoring data,
Linguistic labelses corresponding with programming language are added for monitoring data, to obtain propelling data, and propelling data are pushed into data
Collector, after data acquisition unit receives propelling data, according to the linguistic labelses of monitoring data in propelling data, query language mark
Data format corresponding to label, and monitoring data is converted into object format.Hereby it is achieved that according to linguistic labelses by monitoring data
Unified data format is converted to, and monitoring data is actively pushed into data acquisition unit, is solved existing due to different languages
Say that the monitoring data form of probe collection is different, it is necessary to locally carry out corresponding Data Format Transform, Yi Jiyou in application program
In passively waiting data acquisition unit acquisition monitoring data to be stored, it is necessary to take local resource to data, probe expense is caused
Greatly, the problem of taking excessive local resource.
In order to realize above-described embodiment, the present invention also proposes a kind of data acquisition device.
Figure 16 implements a kind of structural representation for data acquisition device that institute's example provides for the present invention.
As shown in figure 16, the device includes：Acquisition module 1610, labeling module 1620, pushing module 1630.
Wherein, acquisition module 1610, during for getting access request, the monitoring data of acquisition applications program；Accessing please
Seeking Truth in user's access application, application program generation；After application program terminates response to access request, stop prison
Control the collection of data.
Labeling module 1620, for the programming language used according to monitoring data, for monitoring data addition and programming language
Corresponding linguistic labelses, to obtain propelling data；Linguistic labelses are used to, by the data format of monitoring data, be indicated to data acquisition
Device, so that data acquisition unit carries out Data Format Transform according to linguistic labelses.
Pushing module 1630, for pushing propelling data to data acquisition unit；Wherein, data acquisition unit is independently of using journey
Sequence.
It should be noted that the foregoing explanation to probe side collecting method embodiment is also applied for the embodiment
Data acquisition device, here is omitted.
The data acquisition device that the embodiment of the present invention proposes, by when getting access request, acquisition applications program
Monitoring data, when application program terminates response to access request, stop the collection of monitoring data, according to the monitoring data of collection
The programming language of use, linguistic labelses corresponding with programming language are added for monitoring data, to obtain propelling data, and will push
Data-pushing is to data acquisition unit.Hereby it is achieved that monitoring data actively is pushed into data acquisition unit, solve it is existing by
In passively waiting data acquisition unit acquisition monitoring data to store data, it is necessary to take local resource, cause to take excessively
Application program local resource the problem of.
In order to realize above-described embodiment, the present invention also proposes another data acquisition device.
As shown in figure 17, the data acquisition device includes：Receiving module 1710, enquiry module 1720, modular converter 1730.
Wherein, receiving module 1710 is used to receive the propelling data that probe is pushed；Propelling data includes application program
Monitoring data, and the linguistic labelses of monitoring data；Wherein, probe is arranged in the application program.
Enquiry module 1720 is used for the linguistic labelses according to monitoring data, data format corresponding to query language label.
Modular converter 1730 is used to, according to data format is inquired, monitoring data is converted into object format.
It should be noted that the foregoing explanation to data acquisition unit side data acquisition method embodiment is also applied for this
The data acquisition device of embodiment, here is omitted
The data acquisition device that the embodiment of the present invention proposes, the propelling data pushed by receiving probe, according to monitoring
The linguistic labelses of data, data format corresponding to query language label, according to data format is inquired, monitoring data is converted to
Object format.Hereby it is achieved that monitoring data to be converted to unified data format according to linguistic labelses, solves prior art
In due to the monitoring data form of different language probe collection it is different, it is necessary to locally carry out corresponding data format in application program
Conversion, causes the big technical problem of probe expense.
In order to realize above-described embodiment, the embodiment of the present invention proposes a kind of computer equipment, including memory, processor and
Storage on a memory and the computer program that can run on a processor, during computing device program, realizes that a kind of data are adopted
Diversity method, methods described include：When getting access request, the monitoring data of acquisition applications program；Access request is in user
During access application, application program generation；After application program terminates response to access request, stop adopting for monitoring data
Collection；The programming language used according to monitoring data, linguistic labelses corresponding with programming language are added for monitoring data, to be pushed away
Send data；Linguistic labelses are used to, by the data format of monitoring data, data acquisition unit is indicated to, so that data acquisition unit is according to language
Say that label carries out Data Format Transform；Propelling data is pushed to data acquisition unit；Wherein, data acquisition unit is independently of the application
Program.
In order to realize above-described embodiment, the present invention also proposes a kind of non-transitorycomputer readable storage medium, deposited thereon
Computer program is contained, the program realizes a kind of collecting method when being executed by processor, methods described includes：Obtain visiting
When asking request, the monitoring data of acquisition applications program；Access request is the application program generation in user's access application
's；After application program terminates response to access request, stop the collection of monitoring data；The programming language used according to monitoring data
Speech, linguistic labelses corresponding with programming language are added for monitoring data, to obtain propelling data；Linguistic labelses are used to that number will to be monitored
According to data format, be indicated to data acquisition unit so that data acquisition unit according to linguistic labelses carry out Data Format Transform；To number
Propelling data is pushed according to collector；Wherein, data acquisition unit is independently of the application program.
In order to realize above-described embodiment, the present invention also proposes a kind of computer program product, when in computer program product
Instruction processing unit perform when, perform a kind of collecting method, methods described includes：When getting access request, collection should
With the monitoring data of program；Access request be in user's access application, application program generation；In application program to visiting
After asking that request terminates response, stop the collection of monitoring data；The programming language used according to monitoring data, added for monitoring data
Linguistic labelses corresponding with programming language, to obtain propelling data；Linguistic labelses are used for the data format of monitoring data, instruction
To data acquisition unit, so that data acquisition unit carries out Data Format Transform according to linguistic labelses；Pushed to data acquisition unit
Data；Wherein, data acquisition unit is independently of the application program.
In order to realize above-described embodiment, the embodiment of the present invention proposes a kind of computer equipment, including memory, processor and
Storage on a memory and the computer program that can run on a processor, during computing device program, realizes that a kind of data are adopted
Diversity method, methods described include：Receive the propelling data that probe is pushed；Propelling data includes the monitoring data of application program,
And the linguistic labelses of monitoring data；Wherein, probe is arranged in application program；According to the linguistic labelses of monitoring data, inquiry
Data format corresponding to linguistic labelses；According to data format is inquired, monitoring data is converted into object format.
In order to realize above-described embodiment, the present invention also proposes a kind of non-transitorycomputer readable storage medium, deposited thereon
Computer program is contained, the program realizes a kind of collecting method when being executed by processor, methods described includes：Receive probe
The propelling data pushed；Propelling data includes the monitoring data of application program, and the linguistic labelses of monitoring data；Wherein,
Probe is arranged in application program；According to the linguistic labelses of monitoring data, data format corresponding to query language label；According to looking into
Data format is ask, monitoring data is converted into object format.
In order to realize above-described embodiment, the present invention also proposes a kind of computer program product, when in computer program product
Instruction processing unit perform when, perform a kind of collecting method, methods described includes：Receive the push number that probe is pushed
According to；Propelling data includes the monitoring data of application program, and the linguistic labelses of monitoring data；Wherein, probe is arranged at application
In program；According to the linguistic labelses of monitoring data, data format corresponding to query language label；According to inquiring data format,
Monitoring data is converted into object format.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description
Point is contained at least one embodiment or example of the present invention.In this manual, to the schematic representation of above-mentioned term not
Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office
Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area
Art personnel can be tied the different embodiments or example and the feature of different embodiments or example described in this specification
Close and combine.
In addition, term " first ", " second " are only used for describing purpose, and it is not intended that instruction or hint relative importance
Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the invention, " multiple " are meant that at least two, such as two, three
It is individual etc., unless otherwise specifically defined.
Any process or method described otherwise above description in flow chart or herein is construed as, and represents to include
Module, fragment or the portion of the code of the executable instruction of one or more the step of being used to realize custom logic function or process
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following：Electricity with one or more wiring
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium, which can even is that, to print the paper of described program thereon or other are suitable
Medium, because can then enter edlin, interpretation or if necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, software that multiple steps or method can be performed in memory and by suitable instruction execution system with storage
Or firmware is realized.Such as, if realized with hardware with another embodiment, following skill well known in the art can be used
Any one of art or their combination are realized：With the logic gates for realizing logic function to data-signal from
Logic circuit is dissipated, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile
Journey gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method carries
Suddenly it is that by program the hardware of correlation can be instructed to complete, described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, can also
That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and as independent production marketing or in use, can also be stored in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..Although have been shown and retouch above
Embodiments of the invention are stated, it is to be understood that above-described embodiment is exemplary, it is impossible to be interpreted as the limit to the present invention
System, one of ordinary skill in the art can be changed to above-described embodiment, change, replace and become within the scope of the invention
Type.
Claims (10)
1. a kind of collecting method, it is characterised in that comprise the following steps：
When getting access request, the monitoring data of acquisition applications program；The access request is in user's access application
When, the application program generation；
After the application program terminates response to the access request, stop the collection of the monitoring data；
The programming language used according to the monitoring data, language corresponding with the programming language is added for the monitoring data
Label, to obtain propelling data；The linguistic labelses are used to, by the data format of the monitoring data, be indicated to data acquisition
Device, so that the data acquisition unit carries out Data Format Transform according to the linguistic labelses；
The propelling data is pushed to the data acquisition unit；Wherein, the data acquisition unit is independently of the application program.
2. collecting method according to claim 1, it is characterised in that the collection for stopping the monitoring data it
Afterwards, in addition to：
According to the data type of the monitoring data, the suffix corresponding to addition in the index name of the monitoring data；After described
Sew, the data type of required use, is indicated to the data acquisition unit during for by the supervising data storage.
3. collecting method according to claim 1, it is characterised in that the collection for stopping the monitoring data it
Afterwards, in addition to：
According to the data category of the monitoring data, classification mark corresponding with the data category is added for the monitoring data
Note；The category label, for the handling process that will be carried out needed for the monitoring data, it is indicated to the data acquisition unit.
4. according to the collecting method described in claim any one of 1-3, it is characterised in that described to the data acquisition unit
The propelling data is pushed, including：
Using Preset Transfer agreement, protocol processes are carried out to the propelling data；
Using default transmission means, the propelling data after protocol processes is pushed into the data acquisition unit.
5. a kind of collecting method, it is characterised in that comprise the following steps：
Receive the propelling data that probe is pushed；The propelling data includes the monitoring data of application program, and the monitoring
The linguistic labelses of data；Wherein, the probe is arranged in the application program；
According to the linguistic labelses of the monitoring data, data format corresponding to the linguistic labelses is inquired about；
According to data format is inquired, the monitoring data is converted into object format.
6. collecting method according to claim 5, it is characterised in that the propelling data also includes the monitoring number
According to category label, it is described receive the propelling data that is pushed of probe after, in addition to：
Read the category label of the monitoring data；
According to the category label, the monitoring data is handled using corresponding handling process.
7. collecting method according to claim 6, it is characterised in that the category label includes achievement data, thing
It is at least one in data of being engaged in and abnormal information data；
Handling process corresponding to the achievement data includes：The monitoring data is cached；To what is cached in preset period of time
Monitoring data is counted, to obtain statistical value, wherein, the statistical value includes average value and/or variance；
Handling process corresponding to the Transaction Information includes：The monitoring data is extended and/or added timestamp；
Handling process corresponding to the abnormal information data includes：When the monitoring data is cleaned, compressed and/or added
Between stab.
A kind of 8. data collecting system, it is characterised in that the system, including：
Probe, for performing the collecting method as described in claim any one of 1-4；
Data acquisition unit, for performing the collecting method as described in claim any one of 5-7.
A kind of 9. data acquisition device, it is characterised in that including：
Acquisition module, during for getting access request, the monitoring data of acquisition applications program；The access request is in user
During access application, the application program generation；After the application program terminates response to the access request, stop
The collection of the monitoring data；
Labeling module, for the programming language used according to the monitoring data, for monitoring data addition and the programming
Linguistic labelses corresponding to language, to obtain propelling data；The linguistic labelses are used to, by the data format of the monitoring data, refer to
Show to data acquisition unit, so that the data acquisition unit carries out Data Format Transform according to the linguistic labelses；
Pushing module, for pushing the propelling data to the data acquisition unit；Wherein, the data acquisition unit is independently of institute
State application program.
A kind of 10. data acquisition device, it is characterised in that including：
Receiving module, the propelling data pushed for receiving probe；The propelling data includes the monitoring data of application program,
And the linguistic labelses of the monitoring data；Wherein, the probe is arranged in the application program；
Enquiry module, for the linguistic labelses according to the monitoring data, inquire about data format corresponding to the linguistic labelses；
Modular converter, for according to data format is inquired, the monitoring data to be converted into object format.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710566404.0A CN107402869B (en) | 2017-07-12 | 2017-07-12 | Data acquisition method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710566404.0A CN107402869B (en) | 2017-07-12 | 2017-07-12 | Data acquisition method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107402869A true CN107402869A (en) | 2017-11-28 |
| CN107402869B CN107402869B (en) | 2021-01-01 |
Family
ID=60404629
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710566404.0A Active CN107402869B (en) | 2017-07-12 | 2017-07-12 | Data acquisition method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107402869B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109766242A (en) * | 2018-12-29 | 2019-05-17 | 云智慧（北京）科技有限公司 | Monitoring method, device and system based on mobile user side and storage medium |
| CN109902119A (en) * | 2019-03-11 | 2019-06-18 | 深圳众享互联科技有限公司 | Block chain and database hybrid system Data Identification method and its methods of exhibiting |
| CN110909228A (en) * | 2019-11-21 | 2020-03-24 | 上海建工集团股份有限公司 | Data extraction method based on web crawler mechanism |
| CN112261139A (en) * | 2020-10-22 | 2021-01-22 | 北京指掌易科技有限公司 | Service data acquisition method and device and electronic equipment |
| CN113076296A (en) * | 2021-03-30 | 2021-07-06 | 咪咕文化科技有限公司 | Log generation method and device, electronic equipment and storage medium |
| CN113407417A (en) * | 2021-07-14 | 2021-09-17 | 广州博冠信息科技有限公司 | Method, apparatus, medium, and device for capturing and receiving abnormality |
| CN113688109A (en) * | 2021-08-20 | 2021-11-23 | 招商银行股份有限公司 | IT system monitoring index compression and query method, device and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050107985A1 (en) * | 2003-11-14 | 2005-05-19 | International Business Machines Corporation | Method and apparatus to estimate client perceived response time |
| US20060149575A1 (en) * | 2005-01-04 | 2006-07-06 | Srinivas Varadarajan | Software engineering process monitoring |
| CN101483545A (en) * | 2008-12-31 | 2009-07-15 | 中国建设银行股份有限公司 | Financial service monitoring method and system |
| US20100125657A1 (en) * | 2008-11-14 | 2010-05-20 | Interpret, Llc | System for Collecting Computer Application Usage Data from a Plurality of Client Devices |
| CN101751382A (en) * | 2008-11-28 | 2010-06-23 | 方正国际软件(北京)有限公司 | Data acquisition method based on labels and system thereof |
| CN106776248A (en) * | 2016-11-11 | 2017-05-31 | 乐视控股（北京）有限公司 | A kind of method and apparatus of data processing |
-
2017
- 2017-07-12 CN CN201710566404.0A patent/CN107402869B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050107985A1 (en) * | 2003-11-14 | 2005-05-19 | International Business Machines Corporation | Method and apparatus to estimate client perceived response time |
| US20060149575A1 (en) * | 2005-01-04 | 2006-07-06 | Srinivas Varadarajan | Software engineering process monitoring |
| US20100125657A1 (en) * | 2008-11-14 | 2010-05-20 | Interpret, Llc | System for Collecting Computer Application Usage Data from a Plurality of Client Devices |
| CN101751382A (en) * | 2008-11-28 | 2010-06-23 | 方正国际软件(北京)有限公司 | Data acquisition method based on labels and system thereof |
| CN101483545A (en) * | 2008-12-31 | 2009-07-15 | 中国建设银行股份有限公司 | Financial service monitoring method and system |
| CN106776248A (en) * | 2016-11-11 | 2017-05-31 | 乐视控股（北京）有限公司 | A kind of method and apparatus of data processing |
Non-Patent Citations (1)
| Title |
|---|
| 姜银方，陈建希，李路娜: "基于COM的Delphi和Matlab接口编程研究", 《计算机应用与软件》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109766242A (en) * | 2018-12-29 | 2019-05-17 | 云智慧（北京）科技有限公司 | Monitoring method, device and system based on mobile user side and storage medium |
| CN109902119A (en) * | 2019-03-11 | 2019-06-18 | 深圳众享互联科技有限公司 | Block chain and database hybrid system Data Identification method and its methods of exhibiting |
| CN110909228A (en) * | 2019-11-21 | 2020-03-24 | 上海建工集团股份有限公司 | Data extraction method based on web crawler mechanism |
| CN112261139A (en) * | 2020-10-22 | 2021-01-22 | 北京指掌易科技有限公司 | Service data acquisition method and device and electronic equipment |
| CN112261139B (en) * | 2020-10-22 | 2024-01-26 | 北京指掌易科技有限公司 | Service data acquisition method and device and electronic equipment |
| CN113076296A (en) * | 2021-03-30 | 2021-07-06 | 咪咕文化科技有限公司 | Log generation method and device, electronic equipment and storage medium |
| CN113076296B (en) * | 2021-03-30 | 2024-06-07 | 咪咕文化科技有限公司 | Log generation method and device, electronic equipment and storage medium |
| CN113407417A (en) * | 2021-07-14 | 2021-09-17 | 广州博冠信息科技有限公司 | Method, apparatus, medium, and device for capturing and receiving abnormality |
| CN113688109A (en) * | 2021-08-20 | 2021-11-23 | 招商银行股份有限公司 | IT system monitoring index compression and query method, device and storage medium |
| CN113688109B (en) * | 2021-08-20 | 2024-05-03 | 招商银行股份有限公司 | IT system monitoring index compression and query method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107402869B (en) | 2021-01-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107402869A (en) | Collecting method, device and system | |
| CN107193271B (en) | Preposition service adapter and trouble-shooter for industrial information physical system | |
| CN107250932B (en) | Programmable logic controller and semantic contextualization method therein | |
| CN103631596B (en) | Business object data typing and the configuration device and collocation method for updating rule | |
| CN108667725A (en) | A kind of industrial AnyRouter and implementation method based on a variety of accesses and edge calculations | |
| CN110134671B (en) | Traceability application-oriented block chain database data management system and method | |
| WO2019099558A1 (en) | Cardinality of time series | |
| CN105589349A (en) | Crawler for discovering control system data in an industrial automation environment | |
| CN103235820B (en) | Date storage method and device in a kind of group system | |
| US20100125476A1 (en) | System having business aware framework for supporting situation awareness | |
| CN100395987C (en) | Method and system for realizing telecommunication network universal performance management | |
| CN107003651A (en) | The control device of automated system | |
| CN101651707A (en) | Method for automatically acquiring user behavior log of network | |
| CN108197251A (en) | A kind of big data operation and maintenance analysis method, device and server | |
| CN103034483A (en) | Web page script management method and system | |
| Tomic et al. | Experiences with creating a precision dairy farming ontology (DFO) and a knowledge graph for the data integration platform in agriOpenLink | |
| CN112148343B (en) | Rule issuing method and device and terminal equipment | |
| US10901811B2 (en) | Creating alerts associated with a data storage system based on natural language requests | |
| CN107850893A (en) | Using contextual information event is generated on Intelligent programmable logic controller | |
| CN107688520A (en) | distributed service tracking system and method | |
| Serena et al. | Semantic discovery in the web of things | |
| CN110334119A (en) | A kind of data correlation processing method, device, equipment and medium | |
| CN113641742B (en) | Data extraction method, device, equipment and storage medium | |
| CN111159590A (en) | Serial connection method and device based on front-end and back-end service call links | |
| CN109783330A (en) | Log processing method, display methods and relevant apparatus, system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |