CN103488564A - Multichannel test data compressing and merging method for distributed real-time test system - Google Patents
Multichannel test data compressing and merging method for distributed real-time test system Download PDFInfo
- Publication number
- CN103488564A CN103488564A CN201310418563.8A CN201310418563A CN103488564A CN 103488564 A CN103488564 A CN 103488564A CN 201310418563 A CN201310418563 A CN 201310418563A CN 103488564 A CN103488564 A CN 103488564A
- Authority
- CN
- China
- Prior art keywords
- data
- test
- file
- time
- variable
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Test And Diagnosis Of Digital Computers (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
A multichannel test data compressing and merging method for a distributed real-time test system comprises nine steps of (1) formulating a collecting strategy according to variate features; (2) inquiring newest frame data in a cache, and storing a time label and variate ID (identification) if the ID is the same with a variate value; (3) storing data transmitted from real-time simulated nodes in files by using a master control node; (4) merging and processing information and storing the information in a data structure; (5) traversing data files, and acquiring the variate value from a former frame data to supplement local frame data if only the time label and the variate ID exist; (6) acquiring first frame data of all files, and comparing the first frame data to obtain the frame data with the smallest time label; (7) judging whether the obtained time label is the same with that of the former frame data or not, and writing a line of data to an output file if the obtained time label is different from that of the former frame data; (8) updating the acquired frame data to an id_value_map, and updating changed information so as to bring convenience to next comparison; and (9) repeatedly carrying out the step (6), the step (7) and the step (8) until all files are read, and writing the last line in the output file.
Description
[technical field]
The invention provides the data compression of a kind of distributed real-time testing system multi-channel test and merging method, it relates to the test data of the real-time testing system based on distributed structure/architecture collects, and belongs to the embedded software test technical field.
[background technology]
Along with the application surface of embedded system in fields such as Aero-Space constantly enlarges, also day by day urgent for the testing requirement of embedded software.On the one hand, the test assignment that completes for success, the mass data that test macro produces in must the collecting test process, the test macro for fields such as Aero-Space often requires very high real-time simultaneously, must on official hour point, complete accurately predetermined task; On the other hand, along with the complicacy of embedded system itself is more and more stronger, test macro is held to the also more and more higher requirement of corresponding proposition of ability of load, adopt the test macro of distributed structure/architecture not only load average can be assigned to the non-interfering operation of each node, also can provide more carrier for different hardware interface board work, growing for multiple bus interface to meet in embedded testing, the requirement that multiple kinds is worked simultaneously, and can reduce the power consumption of each node computer, improve the reliability of system.
Distributed real-time testing system adopts main controlled node to add the structure of real-time simulation node, and wherein, main controlled node is responsible for the task that requirement of real-time is not high, as man-machine interaction, control test process, analyzing test data etc.; The real-time simulation node is responsible for the assembly of emulation and measured piece communication and is completed data interaction by bus interface and measured piece, and for meeting the high real-time test request, the real-time simulation node must be in the scheduling of finishing the work of official hour point.
The data that produce in distributed real-time testing system test process have two outstanding characteristics, the one, activity time property is strong, require within certain moment and/or regular hour from external environment condition collect data, by contact each other access with the data that obtain and process the data of collecting, again make in time corresponding; But to process " of short duration " data, this data are only effective, out-of-date meaningless in the regular hour scope.This just requires distributed real-time testing system to have each variation collected ability all of test data constantly, this means that the data volume of need collecting is very huge, it compress to processing before by Internet Transmission can save a large amount of transmission times.Because the test data source is a plurality of real-time simulation nodes, the data volume that test macro need to be collected on the one hand further increases, and after test finishes, needs the multi-channel test data are carried out to the merger processing on the other hand in addition.
Therefore, need a kind of method, can be in the situation that do not take a large amount of system resource and compress to test data processings operation time, and the data of compressing can be reduced after Internet Transmission, do not cause loss of data; Simultaneously, the multi-channel test aggregation of data that this method also will be collected a plurality of real-time simulation nodes be the test data that arrange chronologically on a road.
[summary of the invention]
1. purpose: the object of the present invention is to provide the data compression of a kind of distributed real-time testing system multi-channel test and merging method, this method can be in the situation that do not take a large amount of system resource and compress processing to test data operation time, and can, by the reduction of the data of compression, not cause loss of data after Internet Transmission; Simultaneously, the multi-channel test aggregation of data that this method also will be collected a plurality of real-time simulation nodes be the test data that arrange chronologically on a road.
2. technical scheme: for solving the problems of the technologies described above, the invention provides the data compression of a kind of distributed real-time testing system multi-channel test and merging method, it comprises the following steps:
Step 1: the collection frequence that reduces test data; The mode that test macro is collected data has two kinds, and a kind of is the data that need to collect according to certain time interval, such as the cycle according to 5ms gathers analog quantity or whether the level inquired about on certain interface every 1ms becomes high level; Another kind of mode is not need to collect on one's own initiative data, such as the data on serial ports only need detect on bus new data to be arranged and trigger at board, interrupts just collecting data; This method is needed by different collection strategys is distinguished and established to these two kinds of data, greatly reducing in test process the test data transmitted, and this is that the ground floor compression that test data is carried out is processed.
Step 2: in collecting the process of data, each frame test data comprises following information: variable ID, collect the time tag of the moment correspondence of data, the numerical value of variable.Variable ID is for each different variable of distinguishing tests process, and time tag is for being distinguished the current data of collecting and historical data.In the design of this method, each frame data in being stored in level cache before, former frame data in buffer memory are compared, if variable ID is identical with variate-value, only in buffer memory, add a frame time label and variable ID, do not need to regather the variate-value of repetition.Due to the index that does not need mobile caching, do not need to carry out the pointer operation operation, this relatively consume very little, yet can remove a lot of redundant informations in the situation that collect certain variate-value with high-frequency very.When test completes the post analysis data, as long as obtain the value of variable from last frame data, be reducible all test datas.
Step 3: the test data that in test process, main controlled node transmits the real-time simulation node is saved in different files according to node.In test process, the real-time simulation node sends to main controlled node by test data, main controlled node is saved in test data in disk file, the corresponding file of each real-time simulation node, the process that sends data due to the real-time simulation node has timing therefore the data in file sort according to time tag.
Test stops rear test data reduce and merger processing, and idiographic flow is as mistake! Do not find Reference source.
Step 4: the data merger is processed and prepared; Obtain aggregation of data and process the information needed and information is saved in data structure, specifically comprise the following aspects: need to carry out each file of merger, its index is saved in a data structure.Along with the method in the present invention is applied in different systems, the file index of preservation and data structure used may be different, can directly preserve file path, also can preserve and open file the ifstream object corresponding or CFile object etc.; The data structure adopted can adopt array, chained list, vector etc., and the realization of method itself be there is no to impact; In addition, which variable is the test data of this processing belong to is also necessary information, the value of each variable is used a character string to preserve, the corresponding character string of the ID of each variable partners, it is preserved in map, this map is for being kept at the value of all variablees in a time tag, by its called after id_value_map.Which variable defines a vector constantly is worth variation has occurred for recording in each time tag in other words each; in the method for the invention; all test datas of a time tag of each line item of the data file after merger; which variable is the character string of cutting apart with branch at end of line change to show, and for example: the one or two column data is 1 in this end of line character string that constantly changes; 2, the information in data handling procedure, whether variable changed is kept in vecModifiedCols.
Step 5: in order all data files are processed, all data in the traversal file if find that a certain frame data only time label and ID do not preserve variate-value, are obtained these frame data of variate-value polishing from last frame data.
Step 6: travel through all files, obtain the first frame data in file, because the data in All Files are all that each real-time simulation node is collected according to sequential relationship, so the first frame data of file are a frame of time tag minimum in presents certainly, that is to say generation time frame data the earliest.Relatively the first frame data of each file obtain wherein frame data of time tag minimum.If obtain a certain file the first frame data failure, illustrate that the data in this document all are acquired, from the data structure of preserving file index, by its deletion, next traversal needn't be opened this file again.
Step 7: whether the time tag in these frame data that judgement obtains equates with the time tag of the previous frame data that record, if unequal, illustrate that this is the test data of the time tag that belongs to new, therefore it is complete that all test datas of previous time tag have all been obtained, the test data of a upper time label all should be outputed in the output file after merger.If equate, illustrate that this data line has not also spliced, do not need to write data in output file, proceed step 8 and get final product; These data should be present in same a line in output file.At first to write time label in file, then from id_value_map, obtain the value of variable, output in order same a line, finally vecModifiedCols is combined into to a character string of cutting apart with branch and outputs to end of line.Can space in the middle of every row or tab cut apart, as long as this decollator can by each row separately, be realized not affecting on the method in the present invention.After the output data line, vecModifiedCols is emptied in order to preserve the variable change information of next line data.If the first frame data that is to say that the time tag of previous frame data is 0 and does not need to write data in output file.
Step 8: the time tag of current this frame test data of obtaining is updated in last_lable, in order to compare after obtaining test data next time; Simultaneously according to the variable ID in this frame test data, obtain the position of variable in the described id_value_map of step 4, be inserted in mapModifiedCols by the gained positional information and by position corresponding in the described id_value_map of value write step four of variable.
Step 9: circulation execution step six is to step 8, until that All Files has all read is complete, now preserve the data structure of file index for empty, have the data of last column in id_value_map, it is write in output file and completes the operation of multi-channel test aggregation of data.
3. advantage and effect: the data compression of distributed real-time testing system multi-channel test and merging method are by formulating different collection strategys according to the characteristics of different variablees collecting the test data stage, and remove the redundancy testing data that repeat, realized in the situation that do not take a large amount of system resource and operation time the compression of test data is processed, and can, by the reduction of the data of compression, not cause loss of data after Internet Transmission; Simultaneously, the multi-channel test aggregation of data that the method described in the present invention can be collected a plurality of real-time simulation nodes is the test data that arrange chronologically on a road.
[accompanying drawing explanation]
The schematic flow sheet that Fig. 1 is the data compression of distributed real-time testing system multi-channel test and merging method
The realization flow schematic diagram that Fig. 2 is distributed real-time testing system multi-channel test aggregation of data method
[embodiment]
For making the technical problem to be solved in the present invention, technical scheme and advantage clearer, be described in detail below in conjunction with the accompanying drawings and the specific embodiments.
The object of the present invention is to provide the data compression of a kind of distributed real-time testing system multi-channel test and merging method, this method can be in the situation that do not take a large amount of system resource and compress processing to test data operation time, and can, by the reduction of the data of compression, not cause loss of data after Internet Transmission; Simultaneously, the multi-channel test aggregation of data that this method also will be collected a plurality of real-time simulation nodes be the test data that arrange chronologically on a road.
Introduce the application of this method in specific embodiment for clearer, at first to embodiment for the structure of system do simple introduction:
Node in system is divided into main controlled node and two kinds of nodes of real-time simulation node;
● main controlled node is responsible for the task that requirement of real-time is not high, as man-machine interaction, test case are write, test data analysis etc.Issue steering order and control test process to the real-time simulation node by main controlled node.
● the real-time simulation node is responsible for the task that requirement of real-time is high, for example task timing, the message exchange of bus interface, collection of test data etc., and its minimum clock granularity can reach 25us;
● the data that in test process, each real-time simulation node produces send to main controlled node by network and are processed.
See accompanying drawing 1, the implementation step of the present invention in specific embodiment is as follows:
Step 1: the collection frequence that reduces test data, the mode that test macro is collected data has two kinds, a kind of is the data that need to collect according to certain in time interval, such as the cycle according to 5ms gathers analog quantity or whether the level inquired about on certain interface every 1ms becomes high level; Another kind of mode is not need to collect on one's own initiative data, such as the data on serial ports only need detect on bus new data to be arranged and trigger at board, interrupts just collecting data; This method is needed by different collection strategys is distinguished and established to these two kinds of data, greatly reducing in test process the test data transmitted, and this is that the ground floor compression that test data is carried out is processed.
Step 2: in collecting the process of data, each frame test data comprises following information: variable ID, collect the time tag of the moment correspondence of data, the numerical value of variable.Variable ID is for each different variable of distinguishing tests process, and time tag is for being distinguished the current data of collecting and historical data.In the design of this method, each frame data in being stored in level cache before, former frame data in buffer memory are compared, if variable ID is identical with variate-value, only in buffer memory, add a frame time label and variable ID, do not need to regather the variate-value of repetition.Due to the index that does not need mobile caching, do not need to carry out the pointer operation operation, this relatively consume very little, yet can remove a lot of redundant informations in the situation that collect certain variate-value with high-frequency very.When test completes the post analysis data, as long as obtain the value of variable from last frame data, be reducible all test datas.
Step 3: the test data that in test process, main controlled node transmits the real-time simulation node is saved in different files according to node.In test process, the real-time simulation node sends to main controlled node by test data, main controlled node is saved in test data in disk file, the corresponding file of each real-time simulation node, the process that sends data due to the real-time simulation node has timing therefore the data in file sort according to time tag.Method in the present invention requires main controlled node must be able to judge which simulation node is the data that receive belong to, in concrete implementation process, can take various means to transmit this information, for example send the relevant information that test data first sends test data before, perhaps in the information frame of test data, add association attributes about the detecting information source etc., take in the present embodiment front a kind of mode, the real-time simulation node sends the test data of first notifying main controlled node to send before test data and belongs to which node.
Test stops rear test data reduce and merger processing, and idiographic flow is shown in accompanying drawing 2
Step 4: the data merger is processed and prepared, obtain aggregation of data and process the information needed and information is saved in data structure, specifically comprise the following aspects: need to carry out each file of merger, its index is saved in a data structure.Along with the method in the present invention is applied in different systems, the file index of preservation and data structure used may be different, can directly preserve file path, also can preserve and open file the ifstream object corresponding or CFile object etc.; The data structure adopted can adopt array, chained list, vector etc., and the realization of method itself be there is no to impact; In the present embodiment, the aggregation of data related algorithm is used C++ to realize, therefore adopt the data structure of vector as the save data file index, uses ifstream data file is opened and its pointer is added in vector.In addition, which variable is the test data of this processing belong to is also necessary information, the value of each variable is used a character string to preserve, the corresponding character string of the ID of each variable partners, it is preserved in map, this map is for being kept at the value of all variablees in a time tag, by its called after id_value_map.Which variable defines a vector constantly is worth variation has occurred for recording in each time tag in other words each; in the method for the invention; all test datas of a time tag of each line item of the data file after merger; which variable is the character string of cutting apart with branch at end of line change to show, and for example: the one or two column data is 1 in this end of line character string that constantly changes; 2, the information in data handling procedure, whether variable changed is kept in vecModifiedCols.
Step 5: in order all data files are processed, all data in the traversal file if find that a certain frame data only time label and ID do not preserve variate-value, are obtained these frame data of variate-value polishing from last frame data.
Step 6: travel through all files, obtain the first frame data in file, because the data in All Files are all that each real-time simulation node is collected according to sequential relationship, so the first frame data of file are a frame of time tag minimum in presents certainly, that is to say generation time frame data the earliest.Relatively the first frame data of each file obtain wherein frame data of time tag minimum.From the multiframe data, one frame of acquisition time label minimum has several different methods to realize, obtains after can recycle ratio more also can adopting the variety of way sequence, just has the difference on efficiency between several different methods, and the realization of function is not had to difference.In the present embodiment, adopt the min_element algorithm in the C++ java standard library to realize.If obtain a certain file the first frame data failure, illustrate that the data in this document all are acquired, from the data structure of preserving file index, by its deletion, next traversal needn't be opened this file again.
Step 7: whether the time tag in these frame data that judgement obtains equates with the time tag of the previous frame data that record, if unequal, illustrate that this is the test data of the time tag that belongs to new, therefore it is complete that all test datas of previous time tag have all been obtained, the test data of a upper time label all should be outputed in the output file after merger.If equate illustrate that this data line has not also spliced, do not need to write data in output file, proceed step 8 and get final product; These data should be present in same a line in output file.At first to write time label in file, then from id_value_map, obtain the value of variable, output in order same a line, finally vecModifiedCols is combined into to a character string of cutting apart with branch and outputs to end of line.Can space in the middle of every row or tab cut apart, as long as this decollator can by each row separately, be realized not affecting on the method in the present invention.In the present embodiment, adopt tab to be cut apart.After the output data line, vecModifiedCols is emptied in order to preserve the variable change information of next line data.If the first frame data that is to say that the time tag of previous frame data is 0 and does not need to write data in output file.
Step 8: the time tag of current this frame test data of obtaining is updated in last_lable, in order to compare after obtaining test data next time; Simultaneously according to the variable ID in this frame test data, obtain the position of variable in the described id_value_map of step 4, be inserted in mapModifiedCols by the gained positional information and by position corresponding in the described id_value_map of value write step four of variable.Obtain variable position information and can adopt many algorithms from id_value_map, methods such as using iterator traversal map comparison variable ID or use that the find function of map is searched can, the realization of the method in the present invention itself is not affected.The find_if algorithm called in the present embodiment in the C++ canonical algorithm is realized this function.
Step 9: circulation execution step six is to step 8, until that All Files has all read is complete, now preserve the data structure of file index for empty, have the test data of last column in id_value_map, it is write in output file and completes the operation of multi-channel test aggregation of data.
Non-elaborated part of the present invention belongs to techniques well known.
The above; be only part embodiment of the present invention, but protection scope of the present invention is not limited to this, in the technical scope that any those skilled in the art disclose in the present invention; the variation that can expect easily or replacement, within all should being encompassed in protection scope of the present invention.
Claims (1)
1. distributed real-time testing system multi-channel test data compression and merging method, it is characterized in that: it comprises the following steps:
Step 1: the collection frequence that reduces test data; The mode that test macro is collected data has two kinds, and a kind of is the data that need to collect according to certain time interval, such as the cycle according to 5ms gathers analog quantity or whether the level inquired about on certain interface every 1ms becomes high level; Another kind of mode is not need to collect on one's own initiative data, such as the data on serial ports only need detect on bus new data to be arranged and trigger at board, interrupts just collecting data; By different collection strategys is distinguished and established to these two kinds of data, reduce in test process and need the test data transmitted, this is that the ground floor compression that test data is carried out is processed;
Step 2: in collecting the process of data, each frame test data comprises following information: variable ID, collect the time tag of the moment correspondence of data, the numerical value of variable; Variable ID is for each different variable of distinguishing tests process, and time tag is for being distinguished the current data of collecting and historical data; In design, each frame data in being stored in level cache before, former frame data in buffer memory are compared, if variable ID is identical with variate-value, only in buffer memory, add a frame time label and variable ID, do not need to regather the variate-value of repetition; Due to the index that does not need mobile caching, do not need to carry out the pointer operation operation, this relatively consume very little, yet can remove a lot of redundant informations in the situation that collect certain variate-value with high-frequency very; When test completes the post analysis data, as long as obtain the value of variable from last frame data, be reducible all test datas;
Step 3: the test data that in test process, main controlled node transmits the real-time simulation node is saved in different files according to node; In test process, the real-time simulation node sends to main controlled node by test data, main controlled node is saved in test data in disk file, the corresponding file of each real-time simulation node, the process that sends data due to the real-time simulation node has timing, therefore the data in file sort according to time tag, test stops rear test data reduce and merger processing;
Step 4: the data merger is processed and prepared; Obtain aggregation of data and process the information needed and information is saved in data structure, specifically comprise the following aspects: need to carry out each file of merger, its index is saved in a data structure; In different systems, the file index of preservation and data structure used may be different, can directly preserve file path, also can preserve ifstream object or the CFile object that opens file corresponding; The data structure adopted adopts array, chained list, vector, and the realization of method itself be there is no to impact; In addition, which variable is the test data of this processing belong to is also necessary information, the value of each variable is used a character string to preserve, the corresponding character string of the ID of each variable partners, it is preserved in map, this map is for being kept at the value of all variablees in a time tag, by its called after id_value_map; Which variable defines a vector constantly is worth variation has occurred for recording in each time tag in other words each; all test datas of a time tag of each line item of the data file after merger; which variable is the character string of cutting apart with branch at end of line change to show, and for example: the one or two column data is 1 in this end of line character string that constantly changes; 2, the information in data handling procedure, whether variable changed is kept in vecModifiedCols;
Step 5: in order all data files are processed, all data in the traversal file if find that a certain frame data only time label and ID do not preserve variate-value, are obtained these frame data of variate-value polishing from last frame data;
Step 6: travel through all files, obtain the first frame data in file, because the data in All Files are all that each real-time simulation node is collected according to sequential relationship, so the first frame data of file are a frame of time tag minimum in presents certainly, that is to say generation time frame data the earliest; Relatively the first frame data of each file obtain wherein frame data of time tag minimum, if obtain a certain file the first frame data failure, illustrate that the data in this document all are acquired, from the data structure of preserving file index, by its deletion, next traversal needn't be opened this file again;
Step 7: whether the time tag in these frame data that judgement obtains equates with the time tag of the previous frame data that record, if unequal, illustrate that this is the test data of the time tag that belongs to new, therefore it is complete that all test datas of previous time tag have all been obtained, the test data of a upper time label all should be outputed in the output file after merger; If equate, illustrate that this data line has not also spliced, do not need to write data in output file, proceed step 8 and get final product; These data should be present in same a line in output file, at first to write time label in file, then obtain the value of variable from id_value_map, output in order same a line, finally vecModifiedCols is combined into to a character string of cutting apart with branch and outputs to end of line; Can space in the middle of every row or tab cut apart, as long as this decollator can be by each row separately; The first frame data after the output data line, vecModifiedCols emptied in order to preserve the variable change information of next line data, if that is to say that the time tag of previous frame data is 0 and does not need to write data in output file;
Step 8: the time tag of current this frame test data of obtaining is updated in last_lable, in order to compare after obtaining test data next time; Simultaneously according to the variable ID in this frame test data, obtain the position of variable in the described id_value_map of step 4, be inserted in mapModifiedCols by the gained positional information and by position corresponding in the described id_value_map of value write step four of variable;
Step 9: circulation execution step six is to step 8, until that All Files has all read is complete, now preserve the data structure of file index for empty, have the data of last column in id_value_map, it is write in output file and completes the operation of multi-channel test aggregation of data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310418563.8A CN103488564B (en) | 2013-09-13 | 2013-09-13 | A kind of distributed real-time testing system multi-channel test data compression and merging method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310418563.8A CN103488564B (en) | 2013-09-13 | 2013-09-13 | A kind of distributed real-time testing system multi-channel test data compression and merging method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103488564A true CN103488564A (en) | 2014-01-01 |
| CN103488564B CN103488564B (en) | 2016-08-31 |
Family
ID=49828816
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310418563.8A Active CN103488564B (en) | 2013-09-13 | 2013-09-13 | A kind of distributed real-time testing system multi-channel test data compression and merging method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103488564B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106060074A (en) * | 2016-07-08 | 2016-10-26 | 江苏耐维思通科技股份有限公司 | Data breakpoint continual transfer technical method |
| CN107193821A (en) * | 2016-03-14 | 2017-09-22 | 阿里巴巴集团控股有限公司 | Monitoring method and system |
| CN108021505A (en) * | 2017-12-05 | 2018-05-11 | 百度在线网络技术（北京）有限公司 | Data loading method, device and computer equipment |
| CN108399118A (en) * | 2018-03-20 | 2018-08-14 | 广东欧珀移动通信有限公司 | file system test data processing method, device, storage medium and terminal |
| CN109064582A (en) * | 2018-07-04 | 2018-12-21 | 北京车和家信息技术有限公司 | CAN date storage method, device, server and vehicle |
| CN109684198A (en) * | 2018-11-13 | 2019-04-26 | 平安科技（深圳）有限公司 | Data capture method to be tested, device, medium, electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6556998B1 (en) * | 2000-05-04 | 2003-04-29 | Matsushita Electric Industrial Co., Ltd. | Real-time distributed file system |
| CN1786939A (en) * | 2005-11-10 | 2006-06-14 | 浙江中控技术有限公司 | Real-time data compression method |
| CN102142032A (en) * | 2011-03-28 | 2011-08-03 | 中国人民解放军国防科学技术大学 | Method and system for reading and writing data of distributed file system |
| CN103207894A (en) * | 2013-03-14 | 2013-07-17 | 深圳市知正科技有限公司 | Multipath real-time video data storage system and cache control method thereof |
-
2013
- 2013-09-13 CN CN201310418563.8A patent/CN103488564B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6556998B1 (en) * | 2000-05-04 | 2003-04-29 | Matsushita Electric Industrial Co., Ltd. | Real-time distributed file system |
| CN1786939A (en) * | 2005-11-10 | 2006-06-14 | 浙江中控技术有限公司 | Real-time data compression method |
| CN102142032A (en) * | 2011-03-28 | 2011-08-03 | 中国人民解放军国防科学技术大学 | Method and system for reading and writing data of distributed file system |
| CN103207894A (en) * | 2013-03-14 | 2013-07-17 | 深圳市知正科技有限公司 | Multipath real-time video data storage system and cache control method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 徐应诗等: "嵌入式软件仿真测试平台实时数据处理研究", 《测控技术》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107193821A (en) * | 2016-03-14 | 2017-09-22 | 阿里巴巴集团控股有限公司 | Monitoring method and system |
| CN106060074A (en) * | 2016-07-08 | 2016-10-26 | 江苏耐维思通科技股份有限公司 | Data breakpoint continual transfer technical method |
| CN108021505A (en) * | 2017-12-05 | 2018-05-11 | 百度在线网络技术（北京）有限公司 | Data loading method, device and computer equipment |
| CN108021505B (en) * | 2017-12-05 | 2021-05-28 | 百度在线网络技术（北京）有限公司 | Data online method and device and computer equipment |
| CN108399118A (en) * | 2018-03-20 | 2018-08-14 | 广东欧珀移动通信有限公司 | file system test data processing method, device, storage medium and terminal |
| CN108399118B (en) * | 2018-03-20 | 2021-11-26 | Oppo广东移动通信有限公司 | File system test data processing method and device, storage medium and terminal |
| CN109064582A (en) * | 2018-07-04 | 2018-12-21 | 北京车和家信息技术有限公司 | CAN date storage method, device, server and vehicle |
| CN109684198A (en) * | 2018-11-13 | 2019-04-26 | 平安科技（深圳）有限公司 | Data capture method to be tested, device, medium, electronic equipment |
| CN109684198B (en) * | 2018-11-13 | 2024-03-29 | 平安科技（深圳）有限公司 | Method, device, medium and electronic equipment for acquiring data to be tested |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103488564B (en) | 2016-08-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103488564A (en) | Multichannel test data compressing and merging method for distributed real-time test system | |
| EP3299972B1 (en) | Efficient query processing using histograms in a columnar database | |
| CN111177178B (en) | Data processing method and related equipment | |
| CN110019267A (en) | A kind of metadata updates method, apparatus, system, electronic equipment and storage medium | |
| CN106126601A (en) | A kind of social security distributed preprocess method of big data and system | |
| CN104036029B (en) | Large data consistency control methods and system | |
| CN104112026A (en) | Short message text classifying method and system | |
| CN104090889A (en) | Method and system for data processing | |
| CN109508355A (en) | A kind of data pick-up method, system and terminal device | |
| CN101739292A (en) | Application characteristic-based isomeric group operation self-adapting dispatching method and system | |
| CN106780149A (en) | A kind of equipment real-time monitoring system based on timed task scheduling | |
| CN102222071A (en) | Method, device and system for data synchronous processing | |
| CN105787058B (en) | A kind of user tag system and the data delivery system based on user tag system | |
| CN104866619A (en) | Data monitoring method and system for data warehouse | |
| CN103605606B (en) | A kind of embedded software test use-case batch execution method that can automatically change | |
| CN103729252A (en) | Virtual machine scheduling method and scheduling monitor | |
| CN108768790A (en) | Distributed search cluster monitoring method and device, computing device, storage medium | |
| CN104615684A (en) | Mass data communication concurrent processing method and system | |
| CN104809246A (en) | Method and device for processing charging data | |
| US10241716B2 (en) | Global occupancy aggregator for global garbage collection scheduling | |
| CN105069029A (en) | Real-time ETL (extraction-transformation-loading) system and method | |
| CN110175206A (en) | Intellectual analysis operational approach, system and medium for multiple database separation | |
| CN104123104B (en) | Daily record control system and method | |
| CN112650739A (en) | Data storage processing method and device for coal mine data middling station | |
| CN104731716A (en) | Data storage method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |