CN115951824A - Sampling data processing method, device and nonvolatile storage medium - Google Patents
Sampling data processing method, device and nonvolatile storage medium Download PDFInfo
- Publication number
- CN115951824A CN115951824A CN202211510758.0A CN202211510758A CN115951824A CN 115951824 A CN115951824 A CN 115951824A CN 202211510758 A CN202211510758 A CN 202211510758A CN 115951824 A CN115951824 A CN 115951824A
- Authority
- CN
- China
- Prior art keywords
- signals
- frequency
- sampling
- signal waveform
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Memory System Of A Hierarchy Structure (AREA)
Abstract
The invention discloses a method and a device for processing sampling data and a nonvolatile storage medium. Wherein, the method comprises the following steps: acquiring a plurality of high-frequency signals in a preset cache duration by adopting a preset sampling frequency; carrying out caching processing on the high-frequency signals to obtain a plurality of caching signals; and under the condition that the signal values respectively corresponding to the plurality of buffer signals are within a preset threshold range, sampling the plurality of buffer signals by adopting a preset first sampling mode to obtain a low-frequency signal waveform. The invention solves the technical problems of high processing limitation, high limitation on sampling frequency and non-ideal abnormal signal detection rate caused by high requirements on storage capacity and transmission bandwidth during ultrahigh frequency sampling in the related technology.
Description
Technical Field
The present invention relates to the field of data processing, and in particular, to a method and an apparatus for processing sample data, and a non-volatile storage medium.
Background
At present, along with the more and more high attention degree to the electric energy quality, the limitation begins to show in the sampled data processing of electric energy quality to the relevant equipment or the device that carries out on-line monitoring to the electric energy quality, often can't set up too high sampling rate and carry out signal acquisition in order to reduce the occupation to memory space and transmission bandwidth among the correlation technique, causes to miss the unusual signal that appears in the extremely short time, and then leads to some aperiodic electric energy quality incident to catch and analyze comparatively difficultly. And the sampling frequency of the ultra high frequency results in a great amount of data. Because the sampled data is processed in the related art, the power quality monitoring result is generally obtained through sampling, caching, transmitting and analyzing modes, the higher sampling rate of the power quality data means that the higher storage capacity and the corresponding data transmission capacity are needed for supporting, and further, the great demand is provided for the storage capacity of the data, and the occupation demand on the transmission bandwidth is large, so that the problems of high limitation of the sampled data processing and non-ideal coverage rate on the abnormal detection are caused.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides a method and a device for processing sampled data and a nonvolatile storage medium, which are used for at least solving the technical problems of high processing limitation, high limitation on sampling frequency and non-ideal abnormal signal detection rate caused by high requirements on storage capacity and transmission bandwidth during ultrahigh frequency sampling in the related technology.
According to an aspect of an embodiment of the present invention, there is provided a sample data processing method, including: acquiring a plurality of high-frequency signals in a preset cache duration by adopting a preset sampling frequency; carrying out caching processing on the high-frequency signals to obtain a plurality of caching signals; and under the condition that the signal values respectively corresponding to the plurality of cache signals are within a preset threshold range, sampling the plurality of cache signals by adopting a preset first sampling mode to obtain a low-frequency signal waveform.
Optionally, the method further comprises: under the condition that a buffer signal with a signal value exceeding the preset threshold range exists in the buffer signals, determining an initial abnormal signal with the signal value exceeding the preset threshold range in the buffer signals and a subsequent abnormal signal behind the initial abnormal signal; and obtaining a high-frequency signal waveform based on the initial abnormal signal and the subsequent abnormal signal.
Optionally, after obtaining a high-frequency signal waveform based on the initial abnormal signal and the subsequent abnormal signal, the method further includes: determining abnormal prompt information corresponding to the high-frequency signal waveform; and sending the abnormal prompt information to a data monitoring platform.
Optionally, the method further comprises: and storing the low-frequency signal waveform in a first data storage device, and storing the high-frequency signal waveform in a second data storage device, wherein the storage capacity of the first data storage device is smaller than that of the second data storage device, and the processing speed of the first data storage device is higher than that of the second data storage device.
Optionally, the method further comprises: determining a normal signal earlier in time than the initial exception signal among the plurality of buffered signals; and under the condition that the number of the normal signals is multiple, sampling the multiple normal signals by adopting a preset second sampling mode to obtain a first signal waveform.
Optionally, after obtaining a high-frequency signal waveform based on the initial abnormal signal and the subsequent abnormal signal, the method further includes: determining a first time tag corresponding to the first signal waveform and a second time tag corresponding to the high-frequency signal waveform; performing first association processing on the first time tag and the first signal waveform to obtain a first target signal waveform carrying the first time tag; and performing second association processing on the second time tag and the high-frequency signal waveform to obtain a target high-frequency signal waveform carrying the second time tag.
Optionally, under the condition that the signal values respectively corresponding to the plurality of buffered signals are all within a predetermined threshold range, a preset first sampling manner is adopted to sample the plurality of buffered signals, so as to obtain a low-frequency signal waveform, and the method further includes: compressing the low-frequency signal waveform to obtain a compressed waveform; determining a third time stamp for the compressed waveform; and performing third correlation processing on the third time tag and the compressed waveform to obtain a target compressed waveform carrying the third time tag.
According to another aspect of the embodiments of the present invention, there is provided a sample data processing apparatus including: the sampling module is used for acquiring a plurality of high-frequency signals in a preset cache duration by adopting a preset sampling frequency; the cache module is used for caching the high-frequency signals to obtain a plurality of cache signals; and the sampling module is used for sampling the plurality of cache signals by adopting a preset first sampling mode under the condition that the signal values respectively corresponding to the plurality of cache signals are in a preset threshold range to obtain a low-frequency signal waveform.
According to another aspect of the embodiments of the present invention, there is provided a non-volatile storage medium storing a plurality of instructions adapted to be loaded by a processor and to execute any one of the sample data processing methods.
According to another aspect of the embodiments of the present invention, there is provided an electronic device including: one or more processors and memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement any of the sample data processing methods.
In the embodiment of the invention, a sampling processing mode is adopted, and a plurality of high-frequency signals in a preset cache duration are obtained by adopting a preset sampling frequency; carrying out caching processing on the high-frequency signals to obtain a plurality of caching signals; and under the condition that the signal values respectively corresponding to the plurality of cache signals are within a preset threshold range, sampling the plurality of cache signals by adopting a preset first sampling mode to obtain a low-frequency signal waveform. The purposes of flexibly setting sampling frequency, reducing the requirement on storage space and reducing the occupied transmission bandwidth are achieved, the technical effects of improving the flexibility of sampling data processing and improving the monitoring coverage rate are achieved, and the technical problems of high processing limitation, high limitation on sampling frequency and unsatisfactory abnormal signal detection rate caused by high requirements on storage capacity and transmission bandwidth during ultrahigh frequency sampling in the related technology are solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention and do not constitute a limitation of the invention. In the drawings:
FIG. 1 is a flow chart of an alternative sample data processing method provided in accordance with an embodiment of the present invention;
FIG. 2 is a schematic diagram illustrating an application of an alternative sample data processing method according to an embodiment of the present invention;
FIG. 3 is a process diagram of an alternative sample data processing method according to an embodiment of the present invention;
fig. 4 is a schematic diagram of an alternative sampling data processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The method for monitoring and processing data of the power system in the related art has some disadvantages, which are specifically described as follows: firstly, the measurement method is single, and the method for measuring and calculating the steady-state power quality index is specified in the related national standard or IEC 61000-4 series standard, so that a fixed algorithm is often adopted for the public power grid, the fixed sampling frequency is monitored, and the shortest acquisition interval is 200 milliseconds (namely the sampling frequency is 50 Hz at most). For different characteristic loads, particularly for the conditions of rapid change, severe fluctuation and the like in a power grid, the data measured by using the method fixed in the standard is difficult to truly reflect the actual conditions, and the abnormal detection rate is insufficient due to the overlow sampling frequency, so that certain problems are covered.
Secondly, the event detection function is not enough, and the related technology mainly has the capability of detecting and recording voltage transient events, and generally has the functions of switching value starting, impulse current starting and wave recording, and the like, but the adopted effective value detection algorithm is used for the voltage waveform abnormal conditions except for the transient events, such as: waveform gaps, waveform nibbles, short-term disturbances and the like cannot be detected, and rapid harmonic impact cannot be detected. That is, the sampling frequency is too low and the storage space is insufficient due to the related art. In practical applications, a significant event that causes a loss to the user due to the voltage waveform abnormality may be missed. And at present, the monitoring equipment of the power grid has the requirements of portability and miniaturization, high-frequency sampling cannot be carried out under the condition of high hardware space limitation, the processing capacity is insufficient, and sufficient storage space is difficult to have. The portable monitoring equipment has poor monitoring effect on partial short-term special tests, because the portable monitoring equipment has poor monitoring capability on random abnormity with small occurrence probability due to the limitation of storage space.
Thirdly, as the sampled data in the related art is processed by means of sampling, buffering, transmitting and analyzing, the sampled data with a higher sampling rate means that a larger storage capacity and a corresponding data transmission capability are required for supporting. However, it is difficult to process the sampled data at a high sampling rate due to the limited hardware storage capacity and the bandwidth for data transmission between the relevant devices and the back-end analysis device.
In view of the above, it should be noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer-executable instructions, and that while a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than here.
Fig. 1 is a flowchart of a sample data processing method according to an embodiment of the present invention, as shown in fig. 1, the method including the steps of:
step S102, a plurality of high-frequency signals in a preset cache duration are obtained by adopting a preset sampling frequency.
It can be understood that the preset sampling frequency is adopted for signal acquisition, and a plurality of high-frequency signals within the preset cache duration are acquired. Through the processing, the signals collected in the preset cache duration are used as a plurality of high-frequency signals.
It should be noted that the buffering duration is not a fixed time point, but is continuously obtained along with signal acquisition, and for convenience of understanding, specific examples are provided, for example: the preset sampling frequency is adopted to acquire signals, and the signals within the first 5 seconds of the current time point are used as a plurality of high-frequency signals, and the cache duration is 5 seconds in this example.
Optionally, the preset sampling frequency may be multiple, and may be flexibly configured according to the needs of the actual application scenario, for example, a sampling frequency of 1000 hz is adopted to perform high-frequency sampling.
Step S104, performing a buffering process on the plurality of high frequency signals to obtain a plurality of buffered signals.
It can be understood that, since the signal needs to be buffered before being processed, the above-mentioned multiple high-frequency signals are buffered.
And step S106, under the condition that the signal values respectively corresponding to the plurality of cache signals are in the range of the preset threshold value, sampling the plurality of cache signals by adopting a preset first sampling mode to obtain a low-frequency signal waveform.
It can be understood that it is considered that there is no abnormality if the signal values corresponding to the plurality of buffer signals are within the predetermined threshold range, and for the buffer signal without abnormality, a preset first sampling mode is adopted to sample the plurality of buffer signals, so as to obtain a low-frequency signal waveform. Through the processing, for a plurality of cache signals which are judged to be abnormal, excessive storage resources do not need to be occupied, the requirement on the precision of the stored signal waveforms is not high, due to the fact that the preset acquisition frequency is adopted, under the condition that the acquisition frequency is very high, the first sampling mode is adopted to continue processing, the low-frequency signal waveforms are obtained, the redundant signals acquired in the conventional running state can be effectively reduced, and the occupation of the storage space is reduced.
In an optional embodiment, in a case that signal values corresponding to the plurality of buffered signals are all within a predetermined threshold range, a preset first sampling manner is adopted to sample the plurality of buffered signals, so as to obtain a low-frequency signal waveform, and the method further includes: compressing the low-frequency signal waveform to obtain a compressed waveform; determining a third time stamp for the compressed waveform; and performing third association processing on the third time tag and the compressed waveform to obtain a target compressed waveform carrying the third time tag.
It is understood that, in order to further reduce the storage pressure in the non-abnormal case, the low-frequency signal waveform is compressed to obtain a compressed waveform. In order to facilitate decompression of the compressed waveform in other analysis devices and arrange the compressed waveform according to the original sequence, a third time tag of the compressed waveform needs to be determined, and third correlation processing is performed on the third time tag and the compressed waveform to obtain a target compressed waveform carrying the third time tag.
In an optional embodiment, the method further comprises: determining a starting abnormal signal of the plurality of buffer signals, the signal value of which exceeds the predetermined threshold range, and a subsequent abnormal signal of which the time is later than the starting abnormal signal, under the condition that the buffer signals of which the signal values exceed the predetermined threshold range exist in the plurality of buffer signals; and obtaining a high-frequency signal waveform based on the initial abnormal signal and the subsequent abnormal signal.
It can be understood that, regarding that a buffered signal with a signal value exceeding the predetermined threshold range exists in the plurality of buffered signals as an abnormal condition, it is necessary to determine a starting abnormal signal with a signal value exceeding the predetermined threshold range in the plurality of buffered signals, and a subsequent abnormal signal later than the starting abnormal signal. And obtaining a high-frequency signal waveform based on the initial abnormal signal and the subsequent abnormal signal. As can be seen from the above processing, the high-frequency signal waveform is obtained when an abnormality occurs, and is directly stored at the sampling frequency in order to maintain a highly accurate waveform, thereby maximally ensuring the recording of the abnormal condition.
Optionally, the following abnormal signal may be of various types, for example: the subsequent abnormal signal is a signal acquired within a preset abnormal recording time length. For a power quality event, such as a condition of fluctuation, a transient process is usually short, for example, the average time of a general transient process is regarded as 1 second, a preset abnormal recording time is set to be 3 seconds, a redundant recording time is reserved, and the recording integrity of subsequent abnormal signals is ensured under the condition that excessive data acquisition quantity is not increased. In the above example, if the abnormal recording duration of 3 seconds fails to record the abnormal condition completely, that is, the abnormal condition still exists, a new abnormal recording process is triggered, and recording is continued until the abnormal condition is ended.
In an optional embodiment, after obtaining the high-frequency signal waveform based on the initial abnormal signal and the subsequent abnormal signal, the method further includes: determining abnormal prompt information corresponding to the high-frequency signal waveform; and sending the abnormal prompt information to a data monitoring platform.
It can be understood that after the high-frequency signal waveform is obtained, the abnormal condition is regarded as being monitored, the abnormal prompt signal corresponding to the high-frequency signal waveform is determined, and the abnormal prompt information is sent to the data monitoring platform, so that the method is beneficial to prompting relevant workers to process and analyze in time.
Optionally, the abnormality prompt information may be in various forms, for example: and determining the hazard level of the high-frequency signal waveform corresponding to the abnormal condition, and determining the abnormal prompting signal corresponding to the high-frequency signal waveform based on the hazard level. The abnormality prompt signal may be an acoustic and/or optical prompt signal.
In an optional embodiment, the method further includes: and storing the low-frequency signal waveform in a first data storage device, and storing the high-frequency signal waveform in a second data storage device, wherein the storage capacity of the first data storage device is smaller than that of the second data storage device, and the processing speed of the first data storage device is greater than that of the second data storage device.
It is understood that the low frequency signal waveform and the high frequency signal waveform are stored separately and in different storage (hardware) devices. The low-frequency signal waveform is stored in the first data storage device, and the high-frequency signal waveform is stored in the second data storage device, because the data volume of the high-frequency signal waveform is large and dense, and subsequent abnormal analysis needs to be carried out, the storage characteristics required to be possessed by the second data storage device corresponding to the high-frequency signal waveform are quick response, the low-frequency signal waveform is only used for storing conventional operation data, the requirement of long-term operation recording possibly exists, and the storage characteristics required to be possessed by the first data storage device corresponding to the low-frequency signal waveform are large capacity. Therefore, the first data storage device has a smaller storage capacity than the second data storage device, and the first data storage device has a processing speed greater than that of the second data storage device.
In an optional embodiment, the method further includes: determining a normal signal earlier than the initial abnormal signal among the plurality of buffered signals; and under the condition that the number of the normal signals is multiple, sampling the multiple normal signals by adopting a preset second sampling mode to obtain a first signal waveform.
It can be understood that for a normal signal earlier in time than the above-mentioned initial abnormal signal among the plurality of buffered signals, a complete storage with high accuracy is not required. And under the condition that the number of the normal signals is multiple, sampling the multiple normal signals by adopting a second sampling mode, reducing the data quantity and obtaining a first signal waveform.
In an optional embodiment, after obtaining the high-frequency signal waveform based on the initial abnormal signal and the subsequent abnormal signal, the method further includes: determining a first time tag corresponding to the first signal waveform and a second time tag corresponding to the high-frequency signal waveform; performing first association processing on the first time tag and the first signal waveform to obtain a first target signal waveform carrying the first time tag; and performing second association processing on the second time tag and the high-frequency signal waveform to obtain a target high-frequency signal waveform carrying the second time tag.
It can be understood that, because the segmented storage method is adopted, when an abnormality occurs, the positions of normal data storage and abnormal data storage are different, and the data cannot be analyzed and used in order to avoid time confusion. First, a first time stamp corresponding to the first signal waveform and a second time stamp corresponding to the high-frequency signal waveform are determined. And performing first correlation processing on the first time tag and the first signal waveform to obtain a first target signal waveform carrying the first time tag. And performing second association processing on the second time tag and the high-frequency signal waveform to obtain a target high-frequency signal waveform carrying the second time tag. Through the processing, the first target signal waveform and the target high-frequency signal waveform are obtained, and the waveform recovery and recombination processing is conveniently carried out during abnormal signal analysis.
Through the steps, the purposes of flexibly setting the sampling frequency, reducing the requirement on the storage space and reducing the occupied transmission bandwidth can be achieved, the technical effects of improving the flexibility of sampling data processing and improving the monitoring coverage rate are achieved, and the technical problems that in the related technology, due to the fact that ultrahigh frequency sampling is high in requirements on storage capacity and transmission bandwidth, processing limitation is high, the limitation on the sampling frequency is high, and the abnormal signal detection rate is not ideal are solved.
Based on the above embodiments and alternative embodiments, the present invention provides an alternative implementation, specifically comprising the following steps:
fig. 2 is an application schematic diagram of an alternative sampling data processing method provided in an embodiment of the present invention, which may be applied to a power quality sampling apparatus, as shown in fig. 2, where the hardware of the apparatus includes: the device comprises an analog quantity input terminal, a voltage current transformer, a sampling device, a storage device and a communication device. The sampling device can remotely configure or change the configuration parameters of the sampling device, such as sampling frequency, cache duration and the like, in a remote setting mode.
The sampling device adopts a preset sampling frequency to obtain a high-frequency acquisition signal with a range of 5V, obtains a plurality of high-frequency signals within 5 seconds of the cache duration, and performs cache processing to obtain a plurality of cache signals.
The sampling device regards that signal values corresponding to the plurality of buffer signals are in a preset threshold range as the condition of no abnormity, and samples the plurality of buffer signals by adopting a preset first sampling mode for the buffer signals without abnormity to obtain low-frequency signal waveforms. And sending the low-frequency signal waveform to a large-capacity storage unit in the storage device.
The sampling device regards that a buffered signal with a signal value exceeding a preset threshold range exists in the plurality of buffered signals as an abnormal condition, and needs to determine an initial abnormal signal with the signal value exceeding the preset threshold range and a subsequent abnormal signal which is later than the initial abnormal signal. And obtaining a high-frequency signal waveform based on the initial abnormal signal and the subsequent abnormal signal. The high frequency signal waveform is sent to a fast memory cell in a memory device.
The storage capacity of the fast storage unit is smaller than that of the large-capacity storage unit, and the processing speed of the fast storage unit is greater than that of the large-capacity storage unit. The low-frequency signal waveform and the high-frequency signal waveform are respectively stored and stored in different storage units, because the data volume of the high-frequency signal waveform is large and dense, and subsequent anomaly analysis needs to be performed, the storage characteristics required to be possessed by the large-capacity storage unit corresponding to the high-frequency signal waveform are quick response, the low-frequency signal waveform is only used for storing conventional operation data, the requirement of long-term operation recording possibly exists, and the storage characteristics required to be possessed by the quick storage unit corresponding to the low-frequency signal waveform are large capacity.
The communication equipment is used for sending the abnormal prompt information corresponding to the high-frequency signal waveform to the data monitoring platform, prompting related workers to process, calling the waveform data in the storage equipment according to specific requirements, and sending the waveform data to the data monitoring platform.
Fig. 3 is a schematic processing diagram of an optional sampled data processing method according to an embodiment of the present invention, and as shown in fig. 3, by performing real-time processing on a plurality of buffer signals, it is considered that there is no abnormality when signal values respectively corresponding to the plurality of buffer signals are within a predetermined threshold range, and for the buffer signals without abnormality, a preset first sampling manner is adopted to perform sampling processing on the plurality of buffer signals, so as to obtain a low-frequency signal waveform. For a plurality of cache signals which are judged to be free of abnormity, excessive storage resources do not need to be occupied, the requirement on the precision of the stored signal waveforms is not high, due to the fact that the preset acquisition frequency is adopted, under the condition that the acquisition frequency is very high, the first sampling mode is adopted to continue processing, the low-frequency signal waveforms are obtained, redundant signals acquired in the conventional running state can be effectively reduced, and the occupation of storage space is reduced. In order to further reduce the storage pressure under the non-abnormal condition, the low-frequency signal waveform is compressed to obtain a compressed waveform. And then, in order to conveniently decompress the compressed waveforms in other analysis equipment and arrange the compressed waveforms according to the original sequence, a third time tag of the compressed waveforms needs to be determined, and the third time tag and the compressed waveforms are subjected to third association processing to obtain target compressed waveforms carrying the third time tag. And storing the target compressed waveform in a large-capacity storage unit by adopting a preset first storage format.
The buffer signals with signal values exceeding the predetermined threshold range in the plurality of buffer signals are regarded as abnormal conditions, and an initial abnormal signal with the signal values exceeding the predetermined threshold range in the plurality of buffer signals and a subsequent abnormal signal with the time later than the initial abnormal signal need to be determined. The subsequent abnormal signal is a signal acquired within a preset abnormal recording time length. And triggering abnormal recording processing by the initial abnormal signal, and continuing lossless recording of the initial abnormal signal and the subsequent abnormal signal, namely recording at a preset sampling frequency to obtain a high-frequency signal waveform. The high-frequency signal waveform is obtained under the condition of abnormal condition, in order to keep the waveform with high precision, the high-frequency signal waveform is directly stored at a sampling frequency, and the recording of the abnormal condition is ensured to the maximum extent. And for the normal signals of the plurality of buffer signals, the time of which is earlier than the initial abnormal signals, high-precision complete storage is not required. And under the condition that the number of the normal signals is multiple, sampling the multiple normal signals by adopting a second sampling mode, reducing the data quantity and obtaining a first signal waveform.
When an abnormality occurs, the data cannot be analyzed and used in order to avoid temporal confusion. First, a first time stamp corresponding to the first signal waveform and a second time stamp corresponding to the high-frequency signal waveform are determined. And performing first correlation processing on the first time tag and the first signal waveform to obtain a first target signal waveform carrying the first time tag. And performing second association processing on the second time tag and the high-frequency signal waveform to obtain a target high-frequency signal waveform carrying the second time tag. The first target signal waveform and the target high-frequency signal waveform are obtained, and waveform recovery and recombination processing are convenient to perform during abnormal signal analysis. And then storing the target high-frequency signal waveform in a fast storage unit by adopting a preset second storage format, and storing the first target signal waveform summarized from the mountain range in a large-capacity storage unit by adopting a preset first storage format.
At least the following effects are achieved by the above alternative embodiments: through setting up high frequency sampling frequency, promote the collection integrality of electric energy quality data. And the normal signals in normal operation are processed to reduce the data volume, so that signals with high and low frequencies are obtained, and meanwhile, the requirements for high-precision and high-frequency storage of abnormal signals are met, and the requirements for reducing the occupied storage space and the data transmission volume of the normal data in normal operation are met. The problem that the sampling rate cannot be increased due to the limitation of the storage capacity and the data transmission bandwidth is solved, and therefore under the condition of the same storage capacity and the same data transmission bandwidth, the increase space of the sampling rate is increased, and the method and the device are suitable for various monitoring scenes.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than here.
In this embodiment, a sampling data processing apparatus is further provided, and the apparatus is used to implement the foregoing embodiments and preferred embodiments, and details of which have been already described are not described again. As used hereinafter, the terms "module" and "apparatus" may refer to a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
According to an embodiment of the present invention, there is further provided an embodiment of an apparatus for implementing a method for processing sample data, and fig. 4 is a schematic diagram of a sample data processing apparatus according to an embodiment of the present invention, as shown in fig. 4, the sample data processing apparatus includes: a sampling module 402, a buffer module 404, and a sampling module 406, which are described below.
A sampling module 402, configured to acquire, by using a preset sampling frequency, a plurality of high-frequency signals within a preset cache duration;
a buffer module 404, connected to the sampling module 402, configured to perform buffer processing on the multiple high-frequency signals to obtain multiple buffer signals;
the sampling module 406 is connected to the buffer module 404, and configured to sample the plurality of buffer signals in a preset first sampling manner to obtain a low-frequency signal waveform when the signal values corresponding to the plurality of buffer signals are within a predetermined threshold range.
In the device for processing sampled data according to the embodiment of the present invention, the sampling module 402 is configured to obtain a plurality of high-frequency signals within a preset cache duration by using a preset sampling frequency; a buffer module 404, connected to the sampling module 402, configured to perform buffer processing on the multiple high-frequency signals to obtain multiple buffer signals; the sampling module 406 is connected to the buffer module 404, and configured to sample the plurality of buffer signals in a preset first sampling manner to obtain a low-frequency signal waveform when the signal values corresponding to the plurality of buffer signals are within a predetermined threshold range. The method and the device achieve the purposes of flexibly setting sampling frequency, reducing the requirement on storage space and reducing the occupied transmission bandwidth, improve the flexibility of sampling data processing and improve the technical effect of monitoring coverage rate, and further solve the technical problems of high processing limitation, high limitation on sampling frequency and unsatisfactory abnormal signal detection rate caused by high requirements on storage capacity and transmission bandwidth during ultrahigh frequency sampling in the related technology.
It should be noted that the above modules may be implemented by software or hardware, for example, for the latter, the following may be implemented: the modules can be located in the same processor; alternatively, the modules may be located in different processors in any combination.
It should be noted here that the sampling module 402, the buffer module 404, and the sampling module 406 correspond to steps S102 to S106 in the embodiment, and the modules are the same as the examples and application scenarios implemented by the corresponding steps, but are not limited to the disclosure in the embodiment. It should be noted that the modules described above may be implemented in a computer terminal as part of an apparatus.
It should be noted that, for alternative or preferred embodiments of the present embodiment, reference may be made to the relevant description in the embodiments, and details are not described herein again.
The sampling data processing device may further include a processor and a memory, wherein the sampling module 402, the buffer module 404, the sampling module 406, and the like are stored in the memory as program units, and the processor executes the program units stored in the memory to implement corresponding functions.
The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. One or more cores may be provided. The memory may include volatile memory in a computer readable medium, random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
An embodiment of the present invention provides a nonvolatile storage medium on which a program is stored, the program implementing a sample data processing method when executed by a processor.
The embodiment of the invention provides electronic equipment, which comprises a processor, a memory and a program which is stored on the memory and can run on the processor, wherein the processor executes the program and realizes the following steps: acquiring a plurality of high-frequency signals in a preset cache duration by adopting a preset sampling frequency; carrying out cache processing on the high-frequency signals to obtain a plurality of cache signals; and under the condition that the signal values corresponding to the plurality of buffer signals are within a preset threshold range, sampling the plurality of buffer signals by adopting a preset first sampling mode to obtain a low-frequency signal waveform. The device herein may be a server, a PC, etc.
The invention also provides a computer program product adapted to perform a program for initializing the following method steps when executed on a data processing device: acquiring a plurality of high-frequency signals in a preset cache duration by adopting a preset sampling frequency; carrying out cache processing on the high-frequency signals to obtain a plurality of cache signals; and under the condition that the signal values respectively corresponding to the plurality of buffer signals are within a preset threshold range, sampling the plurality of buffer signals by adopting a preset first sampling mode to obtain a low-frequency signal waveform.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present invention, and are not intended to limit the present invention. Various modifications and alterations to this invention will become apparent to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.
Claims (10)
1. A method for processing sampled data, comprising:
acquiring a plurality of high-frequency signals in a preset cache duration by adopting a preset sampling frequency;
performing cache processing on the high-frequency signals to obtain a plurality of cache signals;
and under the condition that the signal values respectively corresponding to the plurality of cache signals are within a preset threshold range, sampling the plurality of cache signals by adopting a preset first sampling mode to obtain a low-frequency signal waveform.
2. The method of claim 1, further comprising:
under the condition that a buffer signal with a signal value exceeding the preset threshold range exists in the plurality of buffer signals, determining a starting abnormal signal with a signal value exceeding the preset threshold range in the plurality of buffer signals and a subsequent abnormal signal behind the starting abnormal signal;
and obtaining a high-frequency signal waveform based on the initial abnormal signal and the subsequent abnormal signal.
3. The method of claim 2, wherein after deriving a high frequency signal waveform based on the initial anomaly signal and the subsequent anomaly signal, the method further comprises:
determining abnormal prompt information corresponding to the high-frequency signal waveform;
and sending the abnormal prompt information to a data monitoring platform.
4. The method of claim 2, further comprising:
and storing the low-frequency signal waveform in a first data storage device, and storing the high-frequency signal waveform in a second data storage device, wherein the storage capacity of the first data storage device is smaller than that of the second data storage device, and the processing speed of the first data storage device is greater than that of the second data storage device.
5. The method of claim 2, further comprising:
determining a normal signal earlier in time than the initial abnormal signal among the plurality of buffered signals;
and under the condition that the number of the normal signals is multiple, sampling the multiple normal signals by adopting a preset second sampling mode to obtain a first signal waveform.
6. The method of claim 5, wherein after said deriving a high frequency signal waveform based on said initial exception signal and said subsequent exception signal, said method further comprises:
determining a first time tag corresponding to the first signal waveform and a second time tag corresponding to the high-frequency signal waveform;
performing first association processing on the first time tag and the first signal waveform to obtain a first target signal waveform carrying the first time tag;
and performing second association processing on the second time tag and the high-frequency signal waveform to obtain a target high-frequency signal waveform carrying the second time tag.
7. The method according to any one of claims 1 to 6, wherein when the signal values corresponding to the plurality of buffered signals are all within a predetermined threshold range, the plurality of buffered signals are sampled in a preset first sampling manner, and after obtaining a low-frequency signal waveform, the method further comprises:
compressing the low-frequency signal waveform to obtain a compressed waveform;
determining a third time stamp for the compressed waveform;
and performing third correlation processing on the third time tag and the compressed waveform to obtain a target compressed waveform carrying the third time tag.
8. A sampled data processing apparatus, comprising:
the sampling module is used for acquiring a plurality of high-frequency signals in a preset cache duration by adopting a preset sampling frequency;
the cache module is used for caching the high-frequency signals to obtain a plurality of cache signals;
and the sampling module is used for sampling the plurality of cache signals by adopting a preset first sampling mode under the condition that the signal values respectively corresponding to the plurality of cache signals are in a preset threshold range to obtain a low-frequency signal waveform.
9. A non-volatile storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the method of processing sample data according to any one of claims 1 to 7.
10. An electronic device, comprising: one or more processors and memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the sample data processing method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211510758.0A CN115951824A (en) | 2022-11-29 | 2022-11-29 | Sampling data processing method, device and nonvolatile storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211510758.0A CN115951824A (en) | 2022-11-29 | 2022-11-29 | Sampling data processing method, device and nonvolatile storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115951824A true CN115951824A (en) | 2023-04-11 |
Family
ID=87286599
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211510758.0A Pending CN115951824A (en) | 2022-11-29 | 2022-11-29 | Sampling data processing method, device and nonvolatile storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115951824A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116501235A (en) * | 2023-06-29 | 2023-07-28 | 珠海妙存科技有限公司 | Sampling point determining method, system, device and storage medium |
-
2022
- 2022-11-29 CN CN202211510758.0A patent/CN115951824A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116501235A (en) * | 2023-06-29 | 2023-07-28 | 珠海妙存科技有限公司 | Sampling point determining method, system, device and storage medium |
| CN116501235B (en) * | 2023-06-29 | 2024-02-23 | 珠海妙存科技有限公司 | Sampling point determining method, system, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105376335B (en) | Collected data uploading method and device | |
| US7281112B1 (en) | Method for storing long-term performance data in a computer system with finite storage space | |
| JP5705395B2 (en) | Signal analyzer | |
| CN115951824A (en) | Sampling data processing method, device and nonvolatile storage medium | |
| CN112379655B (en) | Satellite on-orbit autonomous management method based on satellite-borne log system | |
| CN112014737B (en) | Method, device, equipment and storage medium for detecting health state of battery cell | |
| CN106771453B (en) | Testing method and device for oscilloscope | |
| CN116896064B (en) | Power utilization characteristic analysis system and method for power utilization load | |
| CN110471015A (en) | Determination method and device, storage medium and the processor of sensor detection threshold | |
| CN107782994B (en) | Method and device for monitoring transient event of power quality | |
| CN113177029A (en) | Dynamic generation method, system, equipment and storage medium of power grid wave recording file | |
| CN112131078A (en) | Method and equipment for monitoring disk capacity | |
| CN112328563B (en) | Transient recording data compression method and device, electronic equipment and storage medium | |
| CN105738737A (en) | Fault recording method | |
| US20170160714A1 (en) | Acquisition of high frequency data in transient detection | |
| CN107102195B (en) | Electric quantity processing and network transmission method of intelligent transformer terminal | |
| CN111131249B (en) | Data processing method and device | |
| CN112713897A (en) | Oscilloscope and signal display method and device thereof | |
| CN115103289A (en) | Earphone aging monitoring method and device, computer equipment and storage medium | |
| CN114285989A (en) | Self-adaptive adjustment method and device for emergency video trigger threshold | |
| CN112860469A (en) | Method, device, equipment and storage medium for collecting information of katon log | |
| CN104954201A (en) | Sampling method and sampling device for heath data of network and servers of IDC (Internet Data Center) | |
| CN217931886U (en) | Detecting and positioning device | |
| CN113676377B (en) | Online user number evaluation method, device, equipment and medium based on big data | |
| US10805150B2 (en) | Regenerative telemetry method for resource reduction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |