CN113468234A - Monitoring data processing method, device and system and storage medium - Google Patents
Monitoring data processing method, device and system and storage medium Download PDFInfo
- Publication number
- CN113468234A CN113468234A CN202110598758.XA CN202110598758A CN113468234A CN 113468234 A CN113468234 A CN 113468234A CN 202110598758 A CN202110598758 A CN 202110598758A CN 113468234 A CN113468234 A CN 113468234A
- Authority
- CN
- China
- Prior art keywords
- sampling
- time
- data
- sampling data
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 40
- 238000003672 processing method Methods 0.000 title claims abstract description 25
- 238000005070 sampling Methods 0.000 claims abstract description 185
- 238000000034 method Methods 0.000 claims abstract description 73
- 238000004364 calculation method Methods 0.000 claims description 33
- 238000004590 computer program Methods 0.000 claims description 12
- 230000008569 process Effects 0.000 claims description 12
- 238000010586 diagram Methods 0.000 description 7
- 230000009286 beneficial effect Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 230000035508 accumulation Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000010355 oscillation Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2474—Sequence data queries, e.g. querying versioned data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Probability & Statistics with Applications (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Quality & Reliability (AREA)
- Debugging And Monitoring (AREA)
- Testing And Monitoring For Control Systems (AREA)
Abstract
The invention discloses a monitoring data processing method, a device, a system and a computer readable storage medium, wherein the method comprises the following steps: receiving an initial sampling data value acquired for the first time, and storing the initial sampling data value and the corresponding sampling time into a database; receiving incremental data of the current time relative to the previous time; obtaining a sampling data value corresponding to the current moment according to the incremental data and the sampling data value corresponding to the previous moment; storing the sampling data value corresponding to the current moment and the corresponding sampling time into a database; the incremental data is accepted at other moments, so that the data volume is small, the resource is saved, the performance is improved, and the real-time performance of the data is improved in a mode of improving the acquisition frequency.
Description
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to a monitoring data processing method, a monitoring data processing device, a monitoring data processing system and a computer readable storage medium.
Background
In the cloud computing big data era, real application scenes have higher and higher requirements on real-time performance and reliability of data. However, most real-time data of the current real situation is actually data of a certain time period, and the data cannot reflect the real value of the current time, so that the real-time performance and the accuracy are difficult to meet the requirements. For example: when port performance real-time data of a switch is displayed, the displayed real value of the port data is acquired before a certain time period, and the real value of the so-called real-time data is instantaneous data before the certain time period due to the restrictions of acquisition efficiency and acquisition frequency. In the prior art, the bottom layer uploads all collected data to the upper software layer every time, but as the data volume of ports of monitored equipment such as a switch and the like is increased along with the accumulation of time, the uploaded data volume is increased, so that more and more resources of the upper software layer are occupied, the resource waste is caused, the system performance is influenced, and the real-time performance of the data is difficult to improve in a mode of improving the collection frequency.
In view of the above, how to provide a monitoring data processing method, device, system and computer readable storage medium for solving the above technical problems becomes a problem to be solved by those skilled in the art.
Disclosure of Invention
The embodiment of the invention aims to provide a monitoring data processing method, a monitoring data processing device, a monitoring data processing system and a computer readable storage medium, which are beneficial to saving resources and improving performance in the using process and are beneficial to improving the real-time performance of data in a mode of improving acquisition frequency.
In order to solve the above technical problem, an embodiment of the present invention provides a monitoring data processing method, including:
receiving an initial sampling data value acquired for the first time, and storing the initial sampling data value and corresponding sampling time to a database;
receiving incremental data of the current time relative to the previous time;
obtaining a sampling data value corresponding to the current moment according to the incremental data and the sampling data value corresponding to the previous moment;
and storing the sampling data value corresponding to the current moment and the corresponding sampling time into the database.
Optionally, the method further includes:
analyzing the sampling data values stored in the database to determine sampling data to be displayed which accord with real-time display conditions;
and displaying the to-be-displayed sampling data and the corresponding sampling time.
Optionally, the real-time display condition includes a real-time display frequency;
the process of analyzing the sampling data values stored in the database and determining the sampling data to be displayed which meet the real-time display condition comprises the following steps:
judging whether the actual acquisition frequency is greater than or equal to the real-time display frequency, if so, determining a target sampling data value which accords with the real-time display frequency from the database as sampling data to be displayed; if not, calculating the to-be-displayed sampling data which accords with the real-time display frequency according to the sampling data values in the database and the real-time display frequency.
Optionally, the process of calculating the to-be-displayed sampling data according to the sampling data values in the database and the real-time display frequency includes:
calculating missing sampling time missing between two adjacent actual sampling times according to the actual sampling frequency and the real-time display frequency;
determining a target calculation method according to the number of the missing sampling time and the corresponding relation between the number established in advance and the calculation method;
and calculating missing sampling data corresponding to the missing sampling time by adopting the target calculation method, and taking the missing sampling data as sampling data to be displayed.
Optionally, the correspondence between the pre-established quantity and the calculation method includes:
the number is 1, and the calculation method is one of a linear interpolation method, a quadratic interpolation method, a multinomial interpolation method or a Newton interpolation method;
the number is 2, and the calculation method is one of a quadratic interpolation method, a multinomial interpolation method or a Newton interpolation method;
the number is more than 2 and less than a preset value, and the calculation method is one of a plurality of interpolation methods or Newton interpolation methods.
Optionally, the preset value is 4.
Optionally, the receiving of the initial sampling data value acquired for the first time is:
and establishing connection with the equipment to be monitored, and receiving an initial sampling data value acquired for the first time.
An embodiment of the present invention further provides a monitoring data processing apparatus, including:
the first receiving module is used for receiving an initial sampling data value acquired for the first time and storing the initial sampling data value and corresponding sampling time into a database;
the second receiving module is used for receiving incremental data of the current time relative to the previous time;
the calculation module is used for obtaining a sampling data value corresponding to the current moment according to the incremental data and the sampling data value corresponding to the previous moment;
and the storage module is used for storing the sampling data value corresponding to the current moment and the corresponding sampling time into the database.
An embodiment of the present invention further provides a system for processing monitoring data, including:
a memory for storing a computer program;
a processor for implementing the steps of the monitoring data processing method as described above when executing the computer program.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the monitoring data processing method are implemented as described above.
The embodiment of the invention provides a monitoring data processing method, a device and a system and a computer readable storage medium, wherein the method comprises the following steps: receiving an initial sampling data value acquired for the first time, and storing the initial sampling data value and the corresponding sampling time into a database; receiving incremental data of the current time relative to the previous time; obtaining a sampling data value corresponding to the current moment according to the incremental data and the sampling data value corresponding to the previous moment; and storing the sampling data value corresponding to the current moment and the corresponding sampling time into a database. Therefore, the initial sampling data value corresponding to the data acquired for the first time is received, the incremental data of the current time relative to the previous time is received for the data acquired at other times, the sampling data value corresponding to the current time is obtained according to the incremental data and the sampling data value corresponding to the previous time, and the initial sampling data value and the sampling data values at other sampling times are stored in the database with corresponding sampling time.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed in the prior art and the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic flowchart of a monitoring data processing method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of discrete sampled data according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a curve obtained by performing linear interpolation on data according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a curve obtained by performing a secondary interpolation process on data according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a curve obtained by performing a multi-term difference processing on data according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating a curve of data after Newton's difference processing according to an embodiment of the present invention;
FIG. 7 is a diagram illustrating a distortion curve according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a monitoring data processing apparatus according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a monitoring data processing method, a monitoring data processing device, a monitoring data processing system and a computer readable storage medium, which are beneficial to saving resources and improving performance in the using process and are beneficial to improving the real-time performance of data in a mode of improving acquisition frequency.
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating a monitoring data processing method according to an embodiment of the present invention. The method comprises the following steps:
s110: receiving an initial sampling data value acquired for the first time, and storing the initial sampling data value and the corresponding sampling time into a database;
it should be noted that in the embodiment of the present invention, monitoring data is acquired through the bottom layer, and when the monitoring data is acquired for the first time, the bottom layer uploads all the acquired sampling data (that is, the initial sampling data value) to the upper software layer, and after the upper software layer receives the initial sampling data value uploaded by the bottom layer, the upper software layer stores the initial sampling data value and the corresponding sampling time into the database.
Specifically, the initial sampling data value acquired for the first time may be received after the connection is established between the upper layer and the device to be monitored.
S120: receiving incremental data of the current time relative to the previous time;
it should be noted that, for data acquired at other sampling times in the embodiment of the present invention, the bottom layer compares the data acquired this time with the data acquired at the previous time to obtain incremental data of the current time relative to the previous time, and then uploads the incremental data to the upper layer, that is, the data acquired at the first time is variable data of the current time relative to the previous time, which is received by the upper layer at other sampling times except for all the data received at the first time.
S130: obtaining a sampling data value corresponding to the current moment according to the incremental data and the sampling data value corresponding to the previous moment;
specifically, after receiving the variable data at the current time each time, the upper layer obtains the sampling data value at the current time according to the incremental data and the sampling data value at the previous time, for example, the incremental data received for the second time can obtain the sampling data value corresponding to the second acquisition time according to the initial sampling value received for the first time, and so on, to obtain the real sampling data value at each time.
S140: and storing the sampling data value corresponding to the current moment and the corresponding sampling time into a database.
Specifically, after the sampling data value at the current moment is obtained each time, the sampling data value and the corresponding sampling time are stored in the database, and are specifically stored in the database according to the time sequence. It can be understood that, for other sampling moments except for the first sampling, because the upper software layer in the present invention receives incremental data, the amount of data is small, and the resources of the upper layer are occupied, and when the same resources are used for processing monitoring data, the embodiment of the present invention can improve the real-time performance of the monitoring data by increasing the sampling frequency.
Further, the method may further include:
analyzing the sampling data values stored in the database, and determining the sampling data to be displayed which accord with the real-time display condition;
and displaying the to-be-displayed sampling data and the corresponding sampling time.
Specifically, in the embodiment of the present invention, the sampled data values stored in the database may be analyzed according to a real-time display condition and an actual sampling frequency, where the real-time display condition is, for example, the real-time display frequency, and then the sampled data to be displayed corresponding to the displayed sampling time is obtained and displayed.
Further, the real-time display condition in the embodiment of the present invention includes a real-time display frequency;
the process of analyzing the sampled data values stored in the database to determine the sampled data to be displayed that meet the real-time display condition may specifically be:
judging whether the actual acquisition frequency is greater than or equal to the real-time display frequency, if so, determining a target sampling data value which accords with the real-time display frequency from the database as sampling data to be displayed; if not, calculating the to-be-displayed sampling data which accords with the real-time display frequency according to the sampling data values in the database and the real-time display frequency.
It should be noted that, the actual sampling data is discrete data points, as shown in fig. 2. When the actual sampling frequency is greater than or equal to the real-time display frequency, it is indicated that the to-be-displayed sampling data corresponding to each display moment has real sampling data corresponding to the to-be-displayed sampling data, for example, the actual sampling frequency acquires one sampling data every 5 seconds, the real-time display frequency requires that one sampling data is displayed every 10 seconds, and only the sampling data acquired in the 10 th second and the sampling data acquired in the 20 th second and the like in the database need to be displayed. When the actual sampling frequency is smaller than the real-time display frequency, it is indicated that a part of data corresponding to the real-time display time is not collected, and the sampling data to be displayed conforming to the real-time display frequency needs to be calculated.
Further, the process of calculating the to-be-displayed sampling data according with the real-time display frequency according to the sampling data values in the database and the real-time display frequency comprises the following steps:
calculating missing sampling time missing between two adjacent actual sampling times according to the actual sampling frequency and the real-time display frequency;
determining a target calculation method according to the number of the missing sampling time and the corresponding relation between the number established in advance and the calculation method;
and calculating missing sampling data corresponding to the missing sampling time by adopting a target calculation method, and taking the missing sampling data as sampling data to be displayed.
It should be noted that, when the actual sampling frequency is lower than the real-time display frequency, a missing sampling time may exist between two adjacent actual sampling times, so that the missing sampling time between every two adjacent actual sampling times may be calculated first, a correspondence between the number of the missing sampling times and the calculation method is established in advance, then a corresponding target calculation method is determined according to the actual number of the missing sampling times, and then missing sampling data corresponding to the missing sampling time is calculated according to the target calculation method, where the missing sampling data is to-be-displayed sampling data.
Further, the correspondence between the pre-established quantity and the calculation method includes:
the number is 1, and the calculation method is one of a linear interpolation method, a quadratic interpolation method, a multinomial interpolation method or a Newton interpolation method;
the number is 2, and the calculation method is one of a quadratic interpolation method, a multinomial interpolation method or a Newton interpolation method;
the number is more than 2 and less than the preset value, and the calculation method is one of a plurality of interpolation methods or Newton interpolation methods.
Optionally, the preset value is 4.
Specifically, the linear interpolation method is as follows:
linear interpolation is based on a series of discrete points connected together, as shown in fig. 3, with the height of the point within each line segment as the interpolated height value. With (X)i，Yi) The previous point of a certain line segment i is represented by (X)i+1，Yi+1) The latter point representing the line segment i, which are the two true data points actually acquired, i.e. the true sampled data values, is then for the value at [ Xi，Xi+1) The abscissa x in the range is the sampling time interval, and the corresponding sampled data value Y is:
The linear interpolation method is characterized by simple and convenient calculation and low calculation power, but has the obvious disadvantages that the smoothness is poor, the error is large, and if the time interval is too long, namely the distance between two discrete points is too far, the error is amplified, and the method is characterized in that: the linear interpolation method is suitable for meeting the real-time property or approaching the real-time property, namely when the number of missing sampling time is 1, the data smoothness is met through the linear interpolation, the error is small, and the calculation force is saved.
The second order difference method is:
on the basis of the linear difference method, a data point is added additionally to obtain secondary interpolation, and the missing sampling data Y is as follows:
fig. 4 shows an image of linear interpolation optimized by the quadratic difference method.
Compared with the first linear interpolation method, there is a smoother data presentation, but when there is more data, a "sharp" data point still appears, and it should be noted that: when the number of missing sampling time is 2, a quadratic interpolation method can be sampled, and a smoother curve can be obtained compared with a linear interpolation method, but the smoothness degree is still limited, and the calculation amount is larger than that of the linear interpolation method.
The polynomial difference method is:
it can be seen from the above formula that n appears in the parameter, where n is the number of missing sampling times, and continuous multiplication and continuous addition appear, the calculated amount is obviously enlarged by n times on the basis of linear interpolation, and of course, the smoothness is also improved greatly, as shown in fig. 5.
Compared with the linear interpolation method and the quadratic interpolation method, the multinomial interpolation method can meet the smoothness requirement on certain conditions on data, and the following points are required to be pointed out: this algorithm is suitable for situations where the calculation power is sufficient, the smoothness requirement is high, the real-time requirement is high, and the data points are sufficient, but at the same time if n in the real situation is too large for the purpose of pursuing smoothness, the data error will increase instead, forming a data oscillation, so n is usually a value not greater than 4, and fig. 5 is for the case where n is 4.
For example, if n is 3:
wherein li(X) is as follows:
by analogy in turn, we obtain l0(X)、l1(X)、l2(X)、l3(X), substituting into the first formula to obtain Y, Y in the formula0、Y1、Y2、Y3Are real values (i.e. real sampled data) of the acquired real discrete points, that is, as long as there are real points, interpolation can be performed according to X in the plane, for example, i define X as X0、X1、X2、X3Any position in the middle can calculate Y corresponding to the defined X position according to the collected real data:
i.e. to obtain the true value of Y.
The newton difference method is:
specifically, a function f (x) is defined first, and a function f (x) is defined in xiHas a 0 th order difference quotient of f (x)i)
f (x) at point xiAnd xjHas a first order difference quotient of
f (x) at point xi、xj、xkA second order difference quotient of
Then f (x) at point x0、x1…xnA second order difference quotient of
The newton interpolation method corresponds to fig. 6, and compared with the multi-term interpolation method and the newton interpolation method, the image smoothness and the similarity are very high, but the newton interpolation method can save more calculation power than the multi-term difference method, and meanwhile, the newton interpolation method and the multi-term interpolation method have the same problem that when n is higher, data can also generate strong oscillation to cause data distortion and error increase. Generally, n in the embodiment of the present invention is a value not greater than 4, and thus, an excessively large value of n causes a distortion phenomenon as shown in fig. 7.
For example, if n is 3:
f (x) here0) The corresponding value is y0I.e. x0This sample time corresponds to the true sample data value. And the difference quotient part in the above formula is according to
And then substituting the calculation in sequence, and the embodiment of the invention is not described herein again.
The final p (x) is the corresponding real values, which are still the discrete points of the plurality of real samples, and the missing sample data y corresponding to the missing sample time x can be calculated according to the discrete points.
Therefore, the initial sampling data value corresponding to the data acquired for the first time is received, the incremental data of the current time relative to the previous time is received for the data acquired at other times, the sampling data value corresponding to the current time is obtained according to the incremental data and the sampling data value corresponding to the previous time, and the initial sampling data value and the sampling data values at other sampling times are stored in the database with corresponding sampling time.
On the basis of the foregoing embodiments, an embodiment of the present invention further provides a monitoring data processing apparatus, which is specifically shown in fig. 2. The device includes:
the first receiving module 21 is configured to receive an initial sampling data value acquired for the first time, and store the initial sampling data value and a corresponding sampling time in a database;
a second receiving module 22, configured to receive incremental data of a current time relative to a previous time;
the calculating module 23 is configured to obtain a sampling data value corresponding to the current time according to the incremental data and the sampling data value corresponding to the previous time;
and the storage module 24 is configured to store the sampling data value corresponding to the current time and the corresponding sampling time in the database.
It should be noted that the monitoring data processing apparatus provided in the embodiment of the present invention has the same beneficial effects as the monitoring data processing method provided in the foregoing embodiment, and for the specific description of the monitoring data processing method related in the embodiment of the present invention, reference is made to the foregoing embodiment, and the embodiment of the present invention is not described herein again.
On the basis of the above embodiment, an embodiment of the present invention further provides a monitoring data processing system, including:
a memory for storing a computer program;
a processor for implementing the steps of the monitoring data processing method when executing the computer program.
For example, a processor in the implementation of the present invention is configured to receive an initial sampling data value acquired for the first time, and store the initial sampling data value and a corresponding sampling time in a database; receiving incremental data of the current time relative to the previous time; obtaining a sampling data value corresponding to the current moment according to the incremental data and the sampling data value corresponding to the previous moment; and storing the sampling data value corresponding to the current moment and the corresponding sampling time into a database.
On the basis of the foregoing embodiments, the embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the monitoring data processing method as described above.
The computer-readable storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method for processing monitored data, comprising:
receiving an initial sampling data value acquired for the first time, and storing the initial sampling data value and corresponding sampling time to a database;
receiving incremental data of the current time relative to the previous time;
obtaining a sampling data value corresponding to the current moment according to the incremental data and the sampling data value corresponding to the previous moment;
and storing the sampling data value corresponding to the current moment and the corresponding sampling time into the database.
2. The monitoring data processing method according to claim 1, further comprising:
analyzing the sampling data values stored in the database to determine sampling data to be displayed which accord with real-time display conditions;
and displaying the to-be-displayed sampling data and the corresponding sampling time.
3. The monitoring data processing method according to claim 2, wherein the real-time exhibition condition includes a real-time exhibition frequency;
the process of analyzing the sampling data values stored in the database and determining the sampling data to be displayed which meet the real-time display condition comprises the following steps:
judging whether the actual acquisition frequency is greater than or equal to the real-time display frequency, if so, determining a target sampling data value which accords with the real-time display frequency from the database as sampling data to be displayed; if not, calculating the to-be-displayed sampling data which accords with the real-time display frequency according to the sampling data values in the database and the real-time display frequency.
4. The monitoring data processing method according to claim 3, wherein the process of calculating the to-be-displayed sampled data conforming to the real-time display frequency according to the sampled data values in the database and the real-time display frequency is:
calculating missing sampling time missing between two adjacent actual sampling times according to the actual sampling frequency and the real-time display frequency;
determining a target calculation method according to the number of the missing sampling time and the corresponding relation between the number established in advance and the calculation method;
and calculating missing sampling data corresponding to the missing sampling time by adopting the target calculation method, and taking the missing sampling data as sampling data to be displayed.
5. The monitoring data processing method of claim 4, wherein the correspondence between the pre-established quantities and the calculation method comprises:
the number is 1, and the calculation method is one of a linear interpolation method, a quadratic interpolation method, a multinomial interpolation method or a Newton interpolation method;
the number is 2, and the calculation method is one of a quadratic interpolation method, a multinomial interpolation method or a Newton interpolation method;
the number is more than 2 and less than a preset value, and the calculation method is one of a plurality of interpolation methods or Newton interpolation methods.
6. The monitored data processing method according to claim 5, wherein the preset value is 4.
7. The monitored data processing method according to claim 1, wherein the receiving of the first acquired initial sample data value is:
and establishing connection with the equipment to be monitored, and receiving an initial sampling data value acquired for the first time.
8. A monitoring data processing apparatus, characterized by comprising:
the first receiving module is used for receiving an initial sampling data value acquired for the first time and storing the initial sampling data value and corresponding sampling time into a database;
the second receiving module is used for receiving incremental data of the current time relative to the previous time;
the calculation module is used for obtaining a sampling data value corresponding to the current moment according to the incremental data and the sampling data value corresponding to the previous moment;
and the storage module is used for storing the sampling data value corresponding to the current moment and the corresponding sampling time into the database.
9. A monitored data processing system, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the monitoring data processing method according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the monitoring data processing method according to one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110598758.XA CN113468234B (en) | 2021-05-31 | 2021-05-31 | Monitoring data processing method, device, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110598758.XA CN113468234B (en) | 2021-05-31 | 2021-05-31 | Monitoring data processing method, device, system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113468234A true CN113468234A (en) | 2021-10-01 |
| CN113468234B CN113468234B (en) | 2023-12-22 |
Family
ID=77871720
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110598758.XA Active CN113468234B (en) | 2021-05-31 | 2021-05-31 | Monitoring data processing method, device, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113468234B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101557321A (en) * | 2009-05-21 | 2009-10-14 | 中兴通讯股份有限公司 | Method for monitoring bandwidth of interface in distributed system and device |
| CN105243140A (en) * | 2015-10-10 | 2016-01-13 | 中国科学院软件研究所 | High-speed train real-time monitoring oriented mass data management method |
| CN106407360A (en) * | 2016-09-07 | 2017-02-15 | 广州视源电子科技股份有限公司 | Data processing method and device |
| WO2018121335A1 (en) * | 2016-12-30 | 2018-07-05 | 阿里巴巴集团控股有限公司 | Real-time data processing method and device |
| CN109815102A (en) * | 2019-01-21 | 2019-05-28 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of test data statistical method, device and storage medium |
| CN111881185A (en) * | 2020-07-30 | 2020-11-03 | 苏州浪潮智能科技有限公司 | Data monitoring method, device, equipment and storage medium |
| CN112131078A (en) * | 2020-09-21 | 2020-12-25 | 上海上讯信息技术股份有限公司 | Method and equipment for monitoring disk capacity |
| CN112291809A (en) * | 2020-10-21 | 2021-01-29 | 青岛恒天翼信息科技有限公司 | Method for realizing frequency monitoring system |
| CN112819608A (en) * | 2021-02-05 | 2021-05-18 | 建信金融科技有限责任公司 | Regional credit prediction method and system based on multiple regression and time series |
-
2021
- 2021-05-31 CN CN202110598758.XA patent/CN113468234B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101557321A (en) * | 2009-05-21 | 2009-10-14 | 中兴通讯股份有限公司 | Method for monitoring bandwidth of interface in distributed system and device |
| CN105243140A (en) * | 2015-10-10 | 2016-01-13 | 中国科学院软件研究所 | High-speed train real-time monitoring oriented mass data management method |
| CN106407360A (en) * | 2016-09-07 | 2017-02-15 | 广州视源电子科技股份有限公司 | Data processing method and device |
| WO2018121335A1 (en) * | 2016-12-30 | 2018-07-05 | 阿里巴巴集团控股有限公司 | Real-time data processing method and device |
| CN109815102A (en) * | 2019-01-21 | 2019-05-28 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of test data statistical method, device and storage medium |
| CN111881185A (en) * | 2020-07-30 | 2020-11-03 | 苏州浪潮智能科技有限公司 | Data monitoring method, device, equipment and storage medium |
| CN112131078A (en) * | 2020-09-21 | 2020-12-25 | 上海上讯信息技术股份有限公司 | Method and equipment for monitoring disk capacity |
| CN112291809A (en) * | 2020-10-21 | 2021-01-29 | 青岛恒天翼信息科技有限公司 | Method for realizing frequency monitoring system |
| CN112819608A (en) * | 2021-02-05 | 2021-05-18 | 建信金融科技有限责任公司 | Regional credit prediction method and system based on multiple regression and time series |
Non-Patent Citations (2)
| Title |
|---|
| 曹子建;容晓峰;: "实时数据库异步增量数据处理方法与性能分析", 西安工业大学学报, no. 07 * |
| 段斌: "单片机电力监控***交流采样的实现及抗干扰措施", 电子与自动化, no. 03 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113468234B (en) | 2023-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6675126B2 (en) | Method, computer program, and storage medium for estimating randomness of function of representative value of random variable by the use of gradient of same function | |
| EP4280088A1 (en) | Time series data trend feature extraction method based on dynamic grid division | |
| CN111026965B (en) | Hot topic tracing method and device based on knowledge graph | |
| JP2015176175A (en) | Information processing apparatus, information processing method and program | |
| CN113032157B (en) | Automatic intelligent server capacity expansion and reduction method and system | |
| CN113268403B (en) | Time series analysis and prediction method, device, equipment and storage medium | |
| CN111738319A (en) | Clustering result evaluation method and device based on large-scale samples | |
| CN114022051A (en) | Index fluctuation analysis method, storage medium and electronic equipment | |
| Jiang et al. | Multifractal temporally weighted detrended cross-correlation analysis of multivariate time series | |
| CN113468234A (en) | Monitoring data processing method, device and system and storage medium | |
| CN110929198B (en) | Hot event display method and device | |
| CN111046281B (en) | Hot topic construction method and device | |
| CN116486259B (en) | Method and device for extracting point target in remote sensing image | |
| CN110956675B (en) | Method and device for automatically generating technology maturity curve | |
| CN114549768B (en) | Three-dimensional reconstruction effect detection method, device, equipment and storage medium | |
| JPH11160454A (en) | Estimating apparatus for one-dimensional quantity | |
| CN115131315A (en) | Image change detection method, device, equipment and storage medium | |
| CN112149833B (en) | Prediction method, device, equipment and storage medium based on machine learning | |
| CN113435464B (en) | Abnormal data detection method and device, electronic equipment and computer storage medium | |
| McCarley | Comparing measures of sensitivity for vigilance tasks: Bayesian-estimated and log-linear corrected measures outperform A! | |
| Franca et al. | Estimating attractor dimension on the nonlinear pendulum time series | |
| CN111191126A (en) | Keyword-based scientific and technological achievement accurate pushing method and device | |
| CN114968747B (en) | Automatic extreme pressure test performance test method and device, electronic equipment and storage medium | |
| CN115529475B (en) | Method and system for detecting and wind controlling video flow content | |
| CN118052863B (en) | Geographic information display method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |