CN116775490B - Test data cloud system and method - Google Patents
Test data cloud system and method Download PDFInfo
- Publication number
- CN116775490B CN116775490B CN202310762377.XA CN202310762377A CN116775490B CN 116775490 B CN116775490 B CN 116775490B CN 202310762377 A CN202310762377 A CN 202310762377A CN 116775490 B CN116775490 B CN 116775490B
- Authority
- CN
- China
- Prior art keywords
- module
- file
- data
- sub
- analysis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 82
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000004458 analytical method Methods 0.000 claims abstract description 61
- 238000012545 processing Methods 0.000 claims abstract description 40
- 238000005259 measurement Methods 0.000 claims abstract description 11
- 238000007726 management method Methods 0.000 claims description 37
- 238000004364 calculation method Methods 0.000 claims description 10
- 238000010219 correlation analysis Methods 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 7
- 238000010183 spectrum analysis Methods 0.000 claims description 7
- 238000009499 grossing Methods 0.000 claims description 6
- 230000002452 interceptive effect Effects 0.000 claims description 5
- 230000000007 visual effect Effects 0.000 claims description 5
- 230000001932 seasonal effect Effects 0.000 claims description 3
- 238000004806 packaging method and process Methods 0.000 claims description 2
- 238000013461 design Methods 0.000 abstract description 5
- 238000007405 data analysis Methods 0.000 abstract description 3
- 238000004422 calculation algorithm Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 4
- 230000008676 import Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 238000012550 audit Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000013079 data visualisation Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a test data cloud system and a method, wherein the test data cloud system comprises the following components: the data source module comprises a file management sub-module and a standardized file processing sub-module which are sequentially connected; the tool table module is used for carrying out centralized analysis on various measurement and control data; the member management module is used for managing users of the test data cloud system; the task management module comprises at least one micro-application module and a task member management module, wherein the micro-application module is connected with the data source module and the tool table module, and the task member management module is connected with the member management module. The method can define standard formats for different types of test files, designs corresponding analysis programs for original data generated by various devices, converts the analysis programs into the standard formats, and performs read-write editing and data analysis processing on the files in the standard formats through a unified platform, so that workers can conveniently call the test files and analyze the files.
Description
Technical Field
The invention belongs to the technical field of testing, and particularly relates to a testing data cloud system and a testing data cloud method.
Background
In the field of testing, various test files exist, common test files comprise data files, waveform files and the like, file formats generated by different test devices are quite different, workers need to acquire different test files among different devices, different test files are interpreted by using different interpreters or software, and when the number of the test devices and the number of the test files are quite various, centralized management of data is inconvenient.
Disclosure of Invention
The invention provides a test data cloud system, which aims to at least solve one of the technical problems in the prior art. The test data cloud system provided by the invention can define standard formats for different types of test files, designs corresponding analysis programs for original data generated by various devices, converts the analysis programs into the standard formats, performs read-write editing on the files in the standard formats through a unified platform, and performs centralized analysis processing in the system, so that a worker can conveniently call the test files and analyze the files.
The technical scheme of the invention relates to a test data cloud system, which comprises the following steps:
The data source module comprises a file management sub-module and a standardized file processing sub-module which are sequentially connected, and the standardized file processing sub-module is used for processing a data file into a standardized data file;
The tool table module is used for carrying out centralized analysis on various measurement and control data and is connected with the data source module;
The member management module is used for managing users of the test data cloud system;
The task management module is used for creating and managing tasks and comprises at least one micro-application module and a task member management module, wherein the micro-application module is connected with the data source module and the tool table module, and the task member management module is connected with the member management module.
Further, the tool table module comprises at least one of a waveform analysis module, an audio chart module, a correlation analysis module, an acoustic analysis module, an audio frequency spectrum analysis module, an enthalpy difference calculation module, a liquid-carried cold method calculation module and a seasonal energy efficiency module.
Further, the waveform analysis module comprises a waveform display module and a waveform processing module, wherein the waveform processing module comprises a high-pass filtering sub-module, a low-pass filtering sub-module, a band-stop filtering sub-module, a mobile smoothing sub-module and an SG smoothing sub-module.
Further, the correlation analysis module comprises a single file analysis sub-module and a multi-file analysis sub-module.
Further, the audio frequency spectrum analysis module comprises an audio waveform display module and an audio processing module, wherein the audio processing module comprises a tone curve interpolation sub-module, an addition operator module, a multiplication operator module and a GRR analysis sub-module.
Further, the enthalpy difference calculation module comprises an enthalpy difference waveform display module and an enthalpy difference processing module.
Further, the member management module comprises a member authentication sub-module and an invitation sub-module.
Further, the micro-application module comprises a micro-application data source module, a micro-application processing module and an analysis result module which are sequentially connected, wherein the micro-application data source module is connected with the data source module, and the micro-application processing module is connected with the tool table module. The analysis result module comprises a user-defined parameter sub-module, a user operation record sub-module and an interactive visual chart sub-module.
Further, the system also comprises a personal center module, wherein the personal center module comprises a user information module and a recycle bin module.
The invention further provides a measurement and control method applied to the test data cloud system, which is characterized by comprising the following steps:
S100, acquiring a data file or a standardized data file from a test data cloud system or test equipment, wherein the standardized data file is formed by compressing a main file, a description file and at least one data file;
S200, creating a task through a task management module, inviting task members from the member management module, calling a testing tool from the tool table module based on a micro application module for testing, and obtaining a testing result;
S300, calling a testing tool from the tool table module based on the micro application module to analyze the testing result to obtain an analysis result;
S400, sending the test result and the analysis result to the task member.
According to some embodiments of the invention, the beneficial effects of the invention are as follows:
The invention provides a test data cloud system, which can define standard formats for different types of test files, designs corresponding analysis programs for original data generated by various devices, converts the analysis programs into the standard formats, and performs read-write editing and data analysis processing on the files in the standard formats through a unified platform, so that a worker can conveniently call the test files and analyze the files.
Further, additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
Fig. 1 is a schematic diagram of a test data cloud system according to the present invention.
Fig. 2 is a schematic diagram of a waveform view of a test data cloud system according to the present invention.
Fig. 3 is a schematic diagram of correlation analysis results of a test data cloud system according to the present invention.
Fig. 4 is a schematic diagram of audio analysis results of a test data cloud system according to the present invention.
FIG. 5 is a schematic diagram of an audio analysis GRR result of a test data cloud system according to the invention.
Fig. 6 is a schematic diagram of the enthalpy difference analysis result of the test data cloud system according to the present invention.
FIG. 7 is a flow chart of a method of measurement and control of a test data cloud system according to the present invention.
Fig. 8 is a flowchart of a standardized data file generation method according to the present invention.
Fig. 9 is a schematic diagram of a standardized data file structure in accordance with the present invention.
FIG. 10 is a schematic diagram of a master file according to one embodiment of the invention.
FIG. 11 is a schematic illustration of a description file according to one embodiment of the invention.
Fig. 12 is a flowchart of a standardized data file generation method according to one embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The conception, specific structure, and technical effects produced by the present invention will be clearly and completely described below with reference to the embodiments and the drawings to fully understand the objects, aspects, and effects of the present invention.
It should be noted that, unless otherwise specified, when a feature is referred to as being "fixed" or "connected" to another feature, it may be directly or indirectly fixed or connected to the other feature. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Furthermore, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in the description presented herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and/or" as used herein includes any combination of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element of the same type from another. For example, a first element could also be termed a second element, and, similarly, a second element could also be termed a first element, without departing from the scope of the present disclosure. The use of any and all examples, or exemplary language (e.g., "such as") provided herein, is intended merely to better illuminate embodiments of the invention and does not pose a limitation on the scope of the invention unless otherwise claimed. Further, as used herein, the industry term "pose" refers to the position and pose of an element relative to a spatial coordinate system.
Referring to fig. 1 to 6, the technical solution of the present invention relates to a test data cloud system, including:
The data source module comprises a file management sub-module and a standardized file processing sub-module which are sequentially connected, and the standardized file processing sub-module is used for processing a data file into a standardized data file;
The tool table module is used for carrying out centralized analysis on various measurement and control data and is connected with the data source module;
The member management module is used for managing users of the test data cloud system;
The task management module is used for creating and managing tasks and comprises at least one micro-application module and a task member management module, wherein the micro-application module is connected with the data source module and the tool table module, and the task member management module is connected with the member management module.
In some embodiments, the task management module further includes a task message annotation module, where the task message annotation module is configured to enable a user to annotate a message for other users on a task, so that the other users can quickly obtain information to be focused.
According to some embodiments of the invention, the beneficial effects of the invention are as follows:
The invention provides a test data cloud system, which can define standard formats for different types of test files, designs corresponding analysis programs for original data generated by various devices, converts the analysis programs into the standard formats, and performs read-write editing and data analysis processing on the files in the standard formats through a unified platform, so that a worker can conveniently call the test files and analyze the files.
The test data cloud system is a professional measurement and control data cooperation and visualization basic platform, and helps teams to efficiently complete front-end and back-end work of the production line deployment test. Its main functional points are: embedding tool solutions in a plurality of measurement and control equipment fields; the method is compatible with various data; supporting a multi-person collaboration project; unified interactable data file cloud format; providing a more intelligent, efficient and safer solution for data management, data collaboration and data visualization for production testing.
The data source module comprises a file management sub-module and a standardized file processing sub-module which are sequentially connected, wherein the file management sub-module is used for storing data files and standardized data files, the data files are derived from data files actively transmitted by a user and also comprise test data files remotely transmitted through test equipment, the standardized data files are formed by a main file, a description file and at least one data file in a compression mode, and the standardized file processing sub-module is used for converting the data files into the standardized data files.
Specifically, the tool table module comprises a tool for analyzing test data, the task management module can establish one or more micro application modules, and the micro application modules analyze and process the data files and the standardized data files by calling a specific data processing tool of the tool table module.
The user can add micro-applications in various measurement and control fields. In a specific embodiment, the user clicks on the micro-application module, opens an application page, and generates an interactable standardized data file through the standardized file processing sub-module. The micro-application module comprises a data source and an analysis result. Data source: the data file can be imported through task import, local import and dragging, the user-defined parameters can be analyzed, and the data file can be previewed, downloaded and stored. Analysis results: the interactive visual chart can record user operations, including endorsements and comments, and can perform the following operations on the file: preserving, exporting, sharing and collecting. The micro-application module also includes my data: including the most recent page and the favorites page. The most recent page: displaying the recently opened files in reverse order according to time, the following operations can be performed on the files: preview, open mode, download, copy to, share, collect, remove from list. Collection page: all the collection files are displayed according to the time flashback by default, folders can be newly built, the collection positions of the files are moved, and the following operations can be carried out on the files: preview, open mode, download, copy to, share, collection.
Specifically, the member management module includes authentication of a user entering the test data cloud system, and further includes member management of tasks built in the test data cloud system through the task member management module.
Specifically, the task management module comprises a task page, a task data page, a task description page, a task message page, a task member page and an invitation page.
The task page can be used for creating a collaboration task, creating a group, and switching tiling and list display tasks. Clicking the new collaboration task to form a new task popup window, inputting a task name, inputting a description, and clicking to confirm to obtain the new collaboration task.
The task data page common data file and the standardized data file can be subjected to the following operations: previewing, opening, downloading, copying, sharing, collecting, canceling collection, renaming, deleting, remarking and viewing file information. The standardized data file can be generated, edited, saved and downloaded on line, and is a compressed file integrating the data file, the description file and the main file, thereby facilitating file management, accelerating the opening speed and reducing the learning cost.
Task description page: the task name can be changed, the task state can be selected, the description can be modified, the tag can be newly built/deleted, the accessory can be uploaded, and the operations of previewing, downloading and deleting the accessory can be performed.
Task message page: and notifying others, publishing photos, replying to the messages of others, deleting the messages sent by the others, and deleting the messages of the other people by a creator/manager.
Task member page: member page: the mouse is placed on the head portrait to check the member name card, and the member is added to the address book. Four rights are shared by the members: creator (owning all rights), administrator (owning task file management and adding and deleting member rights), member (owning task file management rights), visitor (only reading rights). The creator can dismiss the task and can resume the task to the recycle bin. An administrator, member, guest may exit the task.
Inviting page: clicking agrees to select the applicant as a member type. Click rejection, applicant has to re-submit the join task application. The manner in which the members are added: 1) Inviting link addition: clicking a copy link button, copying the link, and sending to the invitee, waiting for the audit to become a task member. 2) And (3) address book addition: clicking to select a contact to add a member. 3) Cell phone number/mailbox search add: multiple members are separated by spaces or commas, and the member types may be selected.
Further referring to fig. 1 to 6, the tool table module includes at least one of a waveform analysis module, an audio chart module, a correlation analysis module, an acoustic analysis module, an audio spectrum analysis module, an enthalpy difference calculation module, a liquid-borne cold calculation module, and a seasonal energy efficiency module.
Further, referring to fig. 2, the waveform analysis module includes a waveform display module and a waveform processing module, where the waveform processing module includes a high-pass filtering sub-module, a low-pass filtering sub-module, a band-stop filtering sub-module, a movement smoothing sub-module, and an SG smoothing sub-module.
Specifically selecting a data source: clicking waveform view, entering a data source page, and uploading files to the data source through task importing, local importing, custom data and dragging files. The uploading file type can be automatically analyzed, and the file channel, the sampling rate, the length, the unit, the starting time, the scaling factor and the deviation value are displayed after the analysis is successful. If the automatic parsing fails, the corresponding audio file type may be manually selected for parsing. And supporting online viewing of original data formats generated by more than one hundred kinds of testing equipment.
Annotating waveforms: clicking the annotation can annotate the waveform with rectangle, circle, arrow, text and picture, adjust the format and delete the annotation.
Adding a thumbtack to the waveform: clicking the thumbtack can inform others, can send the snapshot, can send the picture. Wherein clicking on the snapshot automatically restores the waveform to the snapshot-taking state. The thumbtack can be switched up and down.
Further, referring to fig. 3, the correlation analysis module includes a single file analysis sub-module and a multi-file analysis sub-module.
Click Correlation analysis coreaction, entering a data source page, and uploading files to the data source through task importing, local importing and dragging files. The data is imported in a multi-file analysis and a single-file analysis mode. After the template is imported, the file is automatically analyzed, and the file data items are displayed. The analysis data can be imported into the template/newly built template, the imported template can be edited again, after the template is imported, the file is automatically analyzed, the analysis is successful, the file projects are displayed, the single-multi-file analysis is compared according to the file name/station name of the template, the single-file analysis is compared according to the number of the template samples, and if the analysis fails, the file can be deleted/edited again according to the prompt.
The correlation analysis result display comprises a toolbar including coordinate modification, drag movement, selection zoom-in, zoom-out and zoom-in. The mouse is placed on the graph to display the add Limit (including the maximum Limit Upper Limit and the minimum Lower Limit) and the zoom-in/zoom-out button. The chart may be displayed/hidden by clicking on the lower legend.
Further referring to fig. 4 and 5, the audio spectrum analysis module includes an audio waveform display module and an audio processing module including a log interpolation sub-module, an addition operator module, a multiplication operator module, and a GRR analysis sub-module.
The audio frequency spectrum analysis result comprises a toolbar, a Log X Axis, a graph editing, a dragging and moving, a zooming-in and a zooming-out. The mouse is placed on the chart to display the add limit and zoom in/out buttons. Wherein editing a chart may modify chart names, unit settings, coordinate settings, and apply to other charts; the limit is added, so that task import, limit customization and local import can be realized.
Data details: clicking a screening button to screen the Serial Number curve; clicking a reset button to reset all colors; clicking the color to change the color popup window, and modifying the color of all the curves of the single/corresponding Serial Number; clicking the edit button to enter the edit data table (or double clicking curve entry) and can cancel, redo, copy, paste curve interpolation, addition operation and multiplication operation on the data of the curve.
GRR analysis is carried out on Audio frequency spectrum Audio Graph: all data can be clicked directly by GRR analysis of Audio frequency spectrum Audio Graph; GRR analysis can also be performed by screening, and check box checked data.
Further, referring to fig. 6, the enthalpy difference calculation module includes an enthalpy difference waveform display module and an enthalpy difference processing module.
The enthalpy difference calculation module supports the opening of a standardized data file directly exported by the local test software, and supports the functions of graphics, text annotation and comments on the basis of the original software functions. Interactive viewing of raw waveform data (scroll zoom, frame zoom, movement, control of display range and specific data displayed. Support viewing and export of generated reports, covering the needs of project manager.
Further, referring to fig. 1, the member management module includes a member authentication sub-module and an invitation sub-module.
Further, referring to fig. 1, the micro-application module includes a micro-application data source module, a micro-application processing module, and an analysis result module that are sequentially connected, where the micro-application data source module is connected to the data source module, and the micro-application processing module is connected to the tool table module. The analysis result module comprises a user-defined parameter sub-module, a user operation record sub-module and an interactive visual chart sub-module.
Further, referring to fig. 1, a personal center module is further included, which includes a subscriber information module and a recycle bin module.
Further, referring to fig. 7, the invention also provides a measurement and control method, which is applied to the test data cloud system,
Characterized in that the method comprises the steps of:
S100, acquiring a data file or a standardized data file from a test data cloud system or test equipment, wherein the standardized data file is formed by compressing a main file, a description file and at least one data file;
S200, creating a task through a task management module, inviting task members from the member management module, calling a testing tool from the tool table module based on a micro application module for testing, and obtaining a testing result;
S300, calling a testing tool from the tool table module based on the micro application module to analyze the testing result to obtain an analysis result;
S400, sending the test result and the analysis result to the task member.
In addition, referring to fig. 8 to 12, if only one or more data files are available from the test device, in order to integrate the one or more data files into a standardized data file, an embodiment of the present invention further provides a standardized data file generating method, referring to fig. 8, including the steps of:
s100, acquiring at least one data file, respectively extracting file information of each data file, and distributing identifiers of each data file;
s200, establishing a description file, and writing an interpretation mode, an interrelation and an application program state of the data file into the description file based on a data structure predefined by an application program desiring to open the data file;
s300, establishing a main file, wherein the main file comprises a data file information section and a description file information section;
S400, establishing a standardized data file, writing an application program type expected to be opened into an application program type information section of the main file, and packaging and writing the main file, the description file and the data file into the standardized data file;
S500, compressing the standardized data file to obtain a compressed file, and modifying the extension of the compressed file.
Specifically, for step S100, acquiring at least one data file includes acquiring the data file from the test device, or acquiring the file by means of a specific file system, or downloading in a file server.
According to some embodiments of the invention, the beneficial effects of the invention are as follows:
The standardized data file generating method, the standardized data file generating device and the storage medium can define standard formats for different types of test files, design corresponding analysis programs for original data generated by various devices and then convert the analysis programs into the standard formats.
Further, referring to fig. 8 to 11, the file information of the data file includes a file name and a file type.
Further, referring to fig. 8 to 11, the format of the data file is csv format, and the format of the description file includes json format or xml format or yml format.
Further, referring to fig. 8 to 11, the step S200 further includes encrypting the data file and the description file by a symmetric encryption algorithm. In some embodiments, the data file and the description file are encrypted by a symmetric encryption algorithm, and then information such as a file name, a file type, a decryption type, a key and the like of the description file is written into the master file.
Further, referring to fig. 8 to 11, the step S300 further includes writing file information, identifiers, and data file encryption information of all the data files into the data file information section of the master file, and writing file names, types, and description file encryption information of the description file into the description file information section.
Further, referring to fig. 8 to 11, if the master file contains key information, the master file is encrypted by an asymmetric encryption algorithm based on a public key. In some embodiments, when a master file contains key information, then the master file is encrypted using a public key.
8-11, The normalized data file is compressed based on a zip algorithm. In some embodiments, all data files, description files, and master files are compressed into one file by zip, and the extension of the compressed file is mdf.
In some embodiments, to ensure file security, files within the standardized data file (mdf file) are optionally encrypted, with the encryption and decryption processes being as follows:
(1) And encrypting the rest files except the main file by using a symmetrical encryption algorithm, and writing a secret key and an encryption type into the main file.
(2) The master document is encrypted using a public key issued by the system, where only the system can decrypt the master document with the private key.
(3) When a standardized data file (mdf file) is uploaded into the system, after the system extracts all files by using zip, the system uses a private key to decrypt the main file, reads the encryption type and key information of the rest files from the main file, and uses the information to decrypt the rest files.
In addition, the symmetric encryption algorithm runs very fast, and the asymmetric encryption algorithm runs slower, but has the advantages that a public key can be provided for a user, and the combination of the two can provide very flexible security.
Further, referring to fig. 8 to 11, the step S600 further includes: modifying the extension of the compressed file to mdf.
Specifically, in a specific embodiment, the method for generating a standardized data file, when the generated standardized data file MDF is unencrypted, the specific method includes the following steps:
(1) 3 data files, namely A.csv, B.csv and C.csv, are collected, and identifiers are respectively distributed to the data files and are A, B, C.
(2) 1 Description file is newly built, the description file is named Desc, the analysis modes and the interrelationships of the A, B, C three files are written into the description file (Desc file) according to a data structure predefined by an application program.
(3) Writing name=a.csv, id= A, type =csv to the data file information segment in the master file;
writing name=b.csv, id= B, type =csv to the data file information segment in the master file;
the name=c.csv, id= C, type =csv is written to the data file information segment in the master file.
(4) Name=desc, type=json is written to the description file information piece in the main file.
(5) The application TYPE type=type_ ENTHALPY _ DIFFERENCE _lab is written to the information piece of the application TYPE in the main file.
(6) And compressing all the files through zip to obtain a compressed file, and setting the extension name of the compressed file as mdf.
Specifically, in a specific embodiment, the method for generating a standardized data file, when the generated standardized data file MDF is encrypted, the specific method comprises the following steps:
(1) 3 data files, namely A.csv, B.csv and C.csv, are acquired, and identifiers are respectively distributed for the data files and are A, B, C.
(2) 1 Description file is newly built, the description file is named Desc, the analysis modes and the interrelationships of the A, B, C three files are written into the description file (Desc file) according to a data structure predefined by an application program.
(3) 3 Data files and 1 description file are encrypted using a symmetric encryption algorithm, custom keys.
(4) Writing name=a.csv, id= A, type =csv, crypt=aes 256, and passwd= "key string" to the data file information piece in the master file;
Writing name=b.csv, id= B, type =csv, crypt=aes 256, and passwd= "key string" to the data file information piece in the master file;
the name=c.csv, id= C, type =csv, crypt=aes 256, and passwd= "key string" are written to the data file information piece in the master file.
(5) The name=desc, type=json, crypt=aes 256, and passwd= "key string" are written to the description file information piece in the master file.
(6) The application TYPE type=type_ ENTHALPY _ DIFFERENCE _lab is written into the information piece of the application TYPE in the lead main file.
(7) The master file is asymmetrically encrypted using the issued public key.
(8) And compressing all the files through zip to obtain a compressed file, and setting the extension name of the compressed file as mdf.
In some embodiments, referring to fig. 9, the standardized data file (mdf file) includes a main file, a description file, and at least one data file (data file 1, data file 2 … … data file n), wherein,
The master document includes: version number, application type,
A file name, a type, an encryption type, and a key describing the file,
File name, type, identifier, encryption type and key of data file 1,
File name, type, identifier, encryption type and key of data file 2,
……
File name, type, identifier, encryption type and key of data file n;
The description file includes: the interrelationship of data file 1, data file 2 … …, data file n, and the call-in-call data of interpretation mode, application state;
The standardized data file (mdf file) further comprises at least one data file: data file 1, data file 2 … …, data file n.
Specifically, the standardized data file (mdf file) is a file format of a secure and controllable multi-file combination, and is a file in which a plurality of files are compressed into one file using zip, and a file extension is defined as mdf. The standardized data file (mdf file) consists of 3 files, a data file, a description file, and a master file, respectively.
Wherein the data files are obtained by collecting or deriving data from the test equipment, the data files are respectively named as different names, different character strings are allocated to each data file as unique identifiers, the unique identifiers uniquely identify one data file in the description file, and the content of the data file can be encrypted by a symmetrical encryption algorithm.
The description file has no predefined file name, the name needs to be customized, and the naming of the rest files is not repeated; the description file records contents according to a data structure of a predefined application program, including: recording the interrelation of each data file, recording the mode of analyzing each data file and recording the state of a standardized data file (mdf file) application program; the descriptive file content may optionally be encrypted by a symmetric encryption algorithm.
The file name of the main file is uniformly defined as 'app', and the main file has no file name extension; the master file records content according to a predefined master file data structure, including: the application type of the standardized data file (mdf file) is recorded, the name, type, encryption information of the description file is recorded, the name, type, identifier, encryption information of all data files are recorded, and if the main file content contains key information, the main file is encrypted using a public key with an asymmetric algorithm.
In particular, the standardized data file (mdf file) is composed to further include a fault tolerant method and other encryption methods in addition to the zip encryption method.
The standardized data file (mdf file) further includes setting a compression password when zip compression is used.
In some embodiments, the master file may be expanded to record more information including, but not limited to:
(1) Metadata of a standardized data file (mdf file) is used to quickly obtain Metadata of the standardized data file (mdf file).
(2) The application adds annotation data to the standardized data file (mdf file) when previewing or editing the file, the system may serialize the data into a new data file, the master file recording the information of the data file, and the standardized data file (mdf file) is enabled to support saving the annotation.
(3) Under the condition of encrypting the main file, the hash value of other files can be recorded in the content of the main file, so that the verification of the file is increased, and the file is prevented from being tampered.
(4) Similarly, other types of data file information are recorded in the master file, whereby other different functions can be extended.
The invention also provides a standardized data file generating device for realizing the standardized data file generating method, which comprises the following steps:
the file acquisition device is used for acquiring data files and extracting file information of the data files;
file processing means for generating a description file, a master file and a standardized data file.
The present invention also proposes a computer-readable storage medium having stored thereon program instructions that, when executed by a processor, implement a standardized data file generation method.
In a specific embodiment, referring to fig. 12, the standardized data file generating method based on the measurement and control application includes the following specific flow steps:
step S10, determining that a standardized data file is generated from the test apparatus?
If step S10 selects yes, then:
Step S11: acquiring a data file from test equipment;
Step S12: determining a data file name, a file type and an identifier;
step S13: writing the interrelationship, interpretation mode and application program state of the data file into the description file;
step S14, judging whether encryption is needed or not;
if step S14 selects yes, then:
step S15: encrypting all the data files and the description files by using a symmetric encryption algorithm;
if step S10 selects NO, then:
step S16: downloading a standardized data file MDF from a system;
Step S17: the system reads the application program type, the description file, the file name, the type and the identifier of each data file from the database;
step S18: the system pulls all data files from the file server;
Step S19: writing the interrelationship, interpretation mode and application program state of the data file into the description file;
after step S19 is completed, the process proceeds to step S15: encrypting all the data files and the description files by using a symmetric encryption algorithm;
step S15 is completed and then step S20 is performed, and meanwhile, if step S14 is not selected, step S20 is performed;
step S20: writing the data file name, the file type, the identifier, the encryption type and the secret key into the main file;
Step S21: writing the description file name, type, encryption type and key into the main file;
Step S22: writing the application type into the main file;
Step S23: the main file contains key information and then encrypts the main file by using a public key;
Step S24: all data files, description files and main files are compressed into a single file through zip, and the extension is mdf.
It should be appreciated that the method steps in embodiments of the present invention may be implemented or carried out by computer hardware, a combination of hardware and software, or by computer instructions stored in non-transitory computer-readable memory. The method may use standard programming techniques. Each program may be implemented in a high level procedural or object oriented programming language to communicate with a computer system. However, the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.
Furthermore, the operations of the processes described herein may be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The processes (or variations and/or combinations thereof) described herein may be performed under control of one or more computer systems configured with executable instructions, and may be implemented as code (e.g., executable instructions, one or more computer programs, or one or more applications), by hardware, or combinations thereof, collectively executing on one or more processors. The computer program includes a plurality of instructions executable by one or more processors.
Further, the method may be implemented in any type of computing platform operatively connected to a suitable computing platform, including, but not limited to, a personal computer, mini-computer, mainframe, workstation, network or distributed computing environment, separate or integrated computer platform, or in communication with a charged particle tool or other imaging device, and so forth. Aspects of the invention may be implemented in machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, optical read and/or write storage medium, RAM, ROM, etc., such that it is readable by a programmable computer, which when read by a computer, is operable to configure and operate the computer to perform the processes described herein. Further, the machine readable code, or portions thereof, may be transmitted over a wired or wireless network. When such media includes instructions or programs that, in conjunction with a microprocessor or other data processor, implement the steps described above, the invention described herein includes these and other different types of non-transitory computer-readable storage media. The invention may also include the computer itself when programmed according to the methods and techniques of the present invention.
The computer program can be applied to the input data to perform the functions described herein, thereby converting the input data to generate output data that is stored to the non-volatile memory. The output information may also be applied to one or more output devices such as a display. In a preferred embodiment of the invention, the transformed data represents physical and tangible objects, including specific visual depictions of physical and tangible objects produced on a display.
The present invention is not limited to the above embodiments, but can be modified, equivalent, improved, etc. by the same means to achieve the technical effects of the present invention, which are included in the spirit and principle of the present invention. Various modifications and variations are possible in the technical solution and/or in the embodiments within the scope of the invention.
Claims (9)
1. Test data cloud system, characterized in that includes:
The data source module comprises a file management sub-module and a standardized file processing sub-module which are sequentially connected, and the standardized file processing sub-module is used for processing a data file into a standardized data file;
The standardized file processing submodule processes the data file into a standardized data file through a standardized data file generating method, and the standardized data file generating method comprises the following steps:
s100, acquiring at least one data file, respectively extracting file information of each data file, and distributing identifiers of each data file;
s200, establishing a description file, and writing an interpretation mode, an interrelation and an application program state of the data file into the description file based on a data structure predefined by an application program desiring to open the data file;
s300, establishing a main file, wherein the main file comprises a data file information section and a description file information section;
S400, establishing a standardized data file, writing an application program type expected to be opened into an application program type information section of the main file, and packaging and writing the main file, the description file and the data file into the standardized data file;
S500, compressing the standardized data file to obtain a compressed file, and modifying the extension of the compressed file;
The tool table module is used for carrying out centralized analysis on various measurement and control data and is connected with the data source module;
The member management module is used for managing users of the test data cloud system;
The task management module is used for creating and managing tasks and comprises at least one micro-application module and a task member management module, wherein the micro-application module is connected with the data source module and the tool table module, and the task member management module is connected with the member management module.
2. The test data cloud system of claim 1, wherein said tool table module comprises at least one of a waveform analysis module, an audio chart module, a correlation analysis module, an acoustic analysis module, an audio spectrum analysis module, an enthalpy difference calculation module, a liquid-borne cold calculation module, and a seasonal energy efficiency module.
3. The test data cloud system of claim 2, wherein,
The waveform analysis module comprises a waveform display module and a waveform processing module, wherein the waveform processing module comprises a high-pass filtering sub-module, a low-pass filtering sub-module, a band-stop filtering sub-module, a mobile smoothing sub-module and an SG smoothing sub-module.
4. The test data cloud system of claim 2, wherein,
The correlation analysis module comprises a single file analysis sub-module and a multi-file analysis sub-module.
5. The test data cloud system of claim 2, wherein,
The audio frequency spectrum analysis module comprises an audio frequency waveform display module and an audio frequency processing module, wherein the audio frequency processing module comprises a tone curve interpolation sub-module, an addition operator module, a multiplication operator module and a GRR analysis sub-module.
6. The test data cloud system of claim 2, wherein,
The enthalpy difference calculation module comprises an enthalpy difference waveform display module and an enthalpy difference processing module.
7. The test data cloud system of claim 1, wherein,
The member management module comprises a member authentication sub-module and an invitation sub-module.
8. The test data cloud system of claim 1, wherein,
The micro-application module comprises a micro-application data source module, a micro-application processing module and an analysis result module which are connected in sequence, wherein the micro-application data source module is connected with the data source module, the micro-application processing module is connected with the tool table module,
The analysis result module comprises a user-defined parameter sub-module, a user operation record sub-module and an interactive visual chart sub-module.
9. The test data cloud system of claim 1, wherein,
The system also comprises a personal center module, wherein the personal center module comprises a user information module and a recycle bin module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310762377.XA CN116775490B (en) | 2023-06-26 | 2023-06-26 | Test data cloud system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310762377.XA CN116775490B (en) | 2023-06-26 | 2023-06-26 | Test data cloud system and method |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410462268.0A Division CN118349451A (en) | 2023-06-26 | Data cloud measurement and control method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116775490A CN116775490A (en) | 2023-09-19 |
| CN116775490B true CN116775490B (en) | 2024-06-11 |
Family
ID=88009610
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310762377.XA Active CN116775490B (en) | 2023-06-26 | 2023-06-26 | Test data cloud system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116775490B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4853850A (en) * | 1985-09-10 | 1989-08-01 | Krass Jr James E | Vehicle computer diagnostic interface apparatus |
| CN106294122A (en) * | 2016-07-20 | 2017-01-04 | 苏州博众精工科技有限公司 | The software test platform of a kind of standard and method of testing thereof |
| CN108491323A (en) * | 2018-03-07 | 2018-09-04 | 深圳市飞音科技有限公司 | A kind of embedded software automatization test system and method based on Lua scripts |
| CN108537008A (en) * | 2018-03-20 | 2018-09-14 | 常州大学 | High-throughput gene sequencing big data analysis cloud platform system |
| CN115470123A (en) * | 2022-09-01 | 2022-12-13 | 珠海一微半导体股份有限公司 | Data self-adaptive analysis method based on data structure type |
| CN115794624A (en) * | 2022-11-17 | 2023-03-14 | 国网山东省电力公司电力科学研究院 | Closed-loop testing method and system for single automation device of intelligent substation |
| CN115952520A (en) * | 2022-12-29 | 2023-04-11 | 四川新网银行股份有限公司 | Big data platform data standardization processing system and method applied to data files |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100150318A1 (en) * | 2008-12-12 | 2010-06-17 | Embarq Holdings Company, Llc | System and method for standardizing communications lines test sets |
| US10572367B2 (en) * | 2017-11-21 | 2020-02-25 | Accenture Global Solutions Limited | Intelligent code quality monitoring |
-
2023
- 2023-06-26 CN CN202310762377.XA patent/CN116775490B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4853850A (en) * | 1985-09-10 | 1989-08-01 | Krass Jr James E | Vehicle computer diagnostic interface apparatus |
| CN106294122A (en) * | 2016-07-20 | 2017-01-04 | 苏州博众精工科技有限公司 | The software test platform of a kind of standard and method of testing thereof |
| CN108491323A (en) * | 2018-03-07 | 2018-09-04 | 深圳市飞音科技有限公司 | A kind of embedded software automatization test system and method based on Lua scripts |
| CN108537008A (en) * | 2018-03-20 | 2018-09-14 | 常州大学 | High-throughput gene sequencing big data analysis cloud platform system |
| CN115470123A (en) * | 2022-09-01 | 2022-12-13 | 珠海一微半导体股份有限公司 | Data self-adaptive analysis method based on data structure type |
| CN115794624A (en) * | 2022-11-17 | 2023-03-14 | 国网山东省电力公司电力科学研究院 | Closed-loop testing method and system for single automation device of intelligent substation |
| CN115952520A (en) * | 2022-12-29 | 2023-04-11 | 四川新网银行股份有限公司 | Big data platform data standardization processing system and method applied to data files |
Non-Patent Citations (2)
| Title |
|---|
| 基于自动测试***的测试数据格式标准化研究;韩东等;《电子测量技术》;20170615;第40卷(第06期);第47-52页 * |
| 软件自动化测试技术的应用探索研究;张欢等;《电子产品可靠性与环境试验》;20180818;第36卷(第4期);第82-86页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116775490A (en) | 2023-09-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11928315B2 (en) | Digital processing systems and methods for tagging extraction engine for generating new documents in collaborative work systems | |
| EP3608857A1 (en) | Systems and methods for capture and generation of process workflow | |
| CN102915237B (en) | The method and system of rewrite data quality rule is required according to user application | |
| CN105608066A (en) | Method and device for generating evidence report | |
| CN110263498B (en) | Intelligent and efficient online decoration design and construction management method and system | |
| JP5984215B2 (en) | Dynamic manual creation device and method, and computer program | |
| CN112015412A (en) | Device and method for generating business model based on form engine | |
| KR101887095B1 (en) | Method for providing safty inspection service for real estate with handheld based device | |
| CN112134785A (en) | Information processing method, client and system in network security level protection | |
| US8612440B2 (en) | Computer based method and system for generating custom dynamic templates | |
| CN104471595A (en) | Workflow management device and workflow management method | |
| CN112653584A (en) | 5G message arranging method and arranging tool box based on component capability | |
| CN111738673A (en) | Experimental data acquisition management system and method | |
| CN115437608A (en) | Intelligent research and development assisting method and device | |
| CN116775490B (en) | Test data cloud system and method | |
| CN110956029A (en) | Technical document processing method and system | |
| CN108279901B (en) | UI file editing method and device, electronic equipment and storage medium | |
| CN118349451A (en) | Data cloud measurement and control method | |
| CN112232760A (en) | Infrastructure management system and method | |
| CN114817754B (en) | VR learning system | |
| CN104978623A (en) | Personnel information management service system | |
| CN108733281A (en) | A kind of image interception method, system and terminal device | |
| CN114201709A (en) | On-line investigation system aiming at scientific research needs | |
| CN116795793B (en) | Data interaction method and device based on standardized file and storage medium | |
| JP5179822B2 (en) | Mobile phone, mobile phone script development and execution system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |