CN109710677B - Experiment data processing method and device, computer equipment and storage medium - Google Patents
Experiment data processing method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN109710677B CN109710677B CN201811610344.9A CN201811610344A CN109710677B CN 109710677 B CN109710677 B CN 109710677B CN 201811610344 A CN201811610344 A CN 201811610344A CN 109710677 B CN109710677 B CN 109710677B
- Authority
- CN
- China
- Prior art keywords
- data
- data structure
- mapping
- mapping relation
- experimental
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application relates to an experimental data processing method, an experimental data processing device, computer equipment and a storage medium. The method comprises the following steps: the method comprises the steps of obtaining to-be-processed experimental data of a third party, analyzing the to-be-processed experimental data to obtain a data structure form corresponding to the to-be-processed experimental data, matching the to-be-processed experimental data in a preset mapping database according to the data structure form to obtain a mapping relation table corresponding to the data structure form, and generating a standard data form according to the mapping relation table and the data structure form. By adopting the method, the processing efficiency of experimental data can be improved, and the development resources of informatization software are saved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to an experimental data processing method, an experimental data processing apparatus, a computer device, and a storage medium.
Background
With the development of computer technology, software platform technology has also been greatly developed. When the experiment is carried out by means of the instrument workstation, the experiment result output by the instrument workstation can be identified and processed through the software platform, so that an experiment analysis report can be conveniently formed. Taking biological detection as an example, clinical institutions, scientific Research institutions, CRO (Contract Research Organization) and various pharmaceutical enterprises use software platforms to perform data acquisition and analysis of biological experiments, and when the software platforms are used to perform biological experiments, SOP (Standard Operating Procedure) needs to be defined first, so that the software platforms output SOP-based experimental results. However, the inconsistency of the instrumentation workstations used by the units or the difference in SOP definition may result in different formats and field names of the output experimental results, thereby requiring different software platforms to be customized based on different instrumentation workstations and SOPs.
However, the current software platform cannot identify experimental results of inconsistent instrument workstations and SOP changes, so that the experimental result processing efficiency is low, and resource waste is caused by adaptive design of the software platform.
Disclosure of Invention
Therefore, it is necessary to provide an experimental data processing method, an experimental data processing apparatus, a computer device, and a storage medium, which can solve the problem that a software platform cannot identify different experimental data templates.
A method of experimental data processing, the method comprising:
acquiring to-be-processed experimental data of a third party;
analyzing the to-be-processed experimental data to obtain a data structure form corresponding to the to-be-processed experimental data;
according to the data structure form, matching in a preset mapping database to obtain a mapping relation table corresponding to the data structure form;
and generating a standard data form according to the mapping relation table and the data structure form.
In one embodiment, the method further comprises the following steps: extracting each experimental result in the experimental data to be processed; acquiring a field name corresponding to the experimental result; according to the field name, inquiring a preset structure database to obtain a data structure table corresponding to the experimental data to be processed; and filling the experimental result into the data structure table to generate a data structure table.
In one embodiment, the method further comprises the following steps: matching in a preset mapping database according to the field name of the data structure form to obtain a mapping relation table corresponding to the data structure form; the mapping relation table comprises the mapping relation between the field names and the standard field names.
In one embodiment, the method further comprises the following steps: reading an experimental result in each field name in the data structure form according to the mapping relation in the mapping relation table; converting the experimental result into standard data according to a preset conversion algorithm; and filling the standard data into a standard data table corresponding to the data structure table to generate a standard data form.
In one embodiment, the method further comprises the following steps: receiving an access request of a user; verifying the identity of the user according to the access request; and when the identity of the user passes the verification, receiving mapping data sent by the user, and storing the mapping data into a database to obtain a mapping database.
An experimental data processing apparatus, the apparatus comprising:
the data acquisition module is used for acquiring to-be-processed experimental data of a third party;
the data analysis module is used for analyzing the experimental data to be processed to obtain a data structure form corresponding to the experimental data to be processed;
the mapping relation obtaining module is used for matching in a preset mapping database according to the data structure form to obtain a mapping relation table corresponding to the data structure form;
and the processing module is used for generating a standard data form according to the mapping relation table and the data structure form.
A middleware-based experimental data processing platform, the platform comprising: the system comprises an access interface, a database module and a middleware module;
the access interface receives to-be-processed experimental data of a first workstation platform;
the middleware module analyzes the experimental data to be processed to obtain a data structure form corresponding to the experimental data to be processed; calling a mapping database in the database module according to the data structure form, and matching in the mapping database to obtain a mapping relation table corresponding to the data structure form; generating a standard data form according to the mapping relation table and the data structure form;
and the middleware module sends the standard data form to a second workstation platform through the access interface.
In one embodiment, the method further comprises the following steps: a login module; the login module receives an access request of a user and verifies the identity of the user according to the access request; and when the identity of the user passes the authentication, the database module receives the mapping data sent by the user and stores the mapping data into the mapping database.
A computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
acquiring to-be-processed experimental data of a third party;
analyzing the to-be-processed experimental data to obtain a data structure form corresponding to the to-be-processed experimental data;
according to the data structure form, matching in a preset mapping database to obtain a mapping relation table corresponding to the data structure form;
and generating a standard data form according to the mapping relation table and the data structure form.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
acquiring to-be-processed experimental data of a third party;
analyzing the to-be-processed experimental data to obtain a data structure form corresponding to the to-be-processed experimental data;
according to the data structure form, matching in a preset mapping database to obtain a mapping relation table corresponding to the data structure form;
and generating a standard data form according to the mapping relation table and the data structure form.
According to the experimental data processing method, the experimental data processing device, the computer equipment and the storage medium, when the to-be-processed experimental data are received, the to-be-processed experimental data are analyzed to obtain the data structure form corresponding to the to-be-processed experimental data, so that the analysis of the experimental data structure is completed, then the mapping relation form is used for mapping according to the data structure form to generate the standard data form, and therefore the to-be-processed experimental data of different platforms can be converted into the standard data which can be recognized by different platforms. The embodiment can improve the processing efficiency of experimental data and save the development resources of the platform.
Drawings
FIG. 1 is a diagram of an example of an application scenario of the experimental data processing method;
FIG. 2 is a schematic flow chart of a method for processing experimental data according to an embodiment;
FIG. 3 is a flow diagram that illustrates the steps of generating a data structure form, under an embodiment;
FIG. 4 is a flowchart illustrating the step of generating a standard data form in another embodiment;
FIG. 5 is a block diagram showing the configuration of an experimental data processing apparatus according to an embodiment;
FIG. 6 is a block diagram of a middleware based experimental data processing platform in one embodiment;
FIG. 7 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The experimental data processing method provided by the application can be applied to the application environment shown in fig. 1. The first terminal 102 communicates with the second terminal 104 via a network, and the server 106 provides data processing services for the first terminal 102 via middleware technology. The first terminal 102 and the second terminal may be, but are not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the server 106 may be implemented by an independent server or a server cluster composed of a plurality of servers.
Different informationized software is deployed in the first terminal 102 and the second terminal 104, the informationized software is used for automatically identifying experimental data produced by the instrument workstation, and the different informationized software correspondingly identifies experimental data in different formats.
After the second terminal 104 generates the corresponding to-be-processed experimental data of the third party, the first terminal 102 has a demand for the to-be-processed experimental data, the to-be-processed experimental data of the third party generated by the second terminal 104 is analyzed through a middleware technology through the data processing service provided by the server 106, the experimental data is converted into a data structure form with a form structure, and then the data structure form is matched in a mapping database to obtain a mapping relation table corresponding to the data structure form, wherein the mapping relation table records the mapping relation between the data with the standard format and the experimental data generated by the second terminal 104, so that the data structure form can be converted into the standard data form according to the mapping relation table.
On the other hand, after the first terminal 102 passes through the data processing service provided by the server 106, the standard data form can be identified, so that the identification of the experimental data in the third-party information software can be realized only by connecting with the service provided by the server 106 without additionally developing the information software in the first terminal 102.
In one embodiment, as shown in fig. 2, an experimental data processing method is provided, which is described by taking the application of the method to the server in fig. 1 as an example, and includes the following steps:
The third party refers to a platform different from the information software that the server provides services, and the difference may be that the adopted data acquisition Standard is customized differently, or the adopted SOP (Standard Operating Procedure) is different when performing experiments.
The to-be-processed experimental data refers to experimental data output by a third-party instrument workstation according to an SOP program, can be automatically identified through third-party information software, but different SOPs are acquired according to different data acquisition standards, and cannot be identified by other information software.
The acquiring of the to-be-processed experimental data may be receiving the to-be-processed experimental data sent by the third party through an interface provided by the server.
And 204, analyzing the to-be-processed experimental data to obtain a data structure form corresponding to the to-be-processed experimental data.
The data structure form refers to a form which orders fields in the form through a rule specified by a server so as to achieve the purpose of ordered identification.
After receiving the experimental data to be processed, the server can identify the structure of the experimental data to be processed through the middleware, so that the experimental data to be processed is converted into a data structure form.
And step 206, matching the data structure form in a preset mapping database to obtain a mapping relation table corresponding to the data structure form.
The mapping relation table records the corresponding relation between the output result of the instrument workbench and the standard data and the mapping relation between the field name of the data structure form and the field name of the standard data form, so that the mapping database can contain a large number of mapping relation tables based on the number of the informationized software providing server service, and the identification of the output result of the instrument workbench can be completed when the data processing service is provided.
When the server obtains the data structure form, matching can be performed in the mapping data according to the data structure form, and matching can be performed in a matching mode of keywords, fields and the like, so that a mapping relation table corresponding to the data structure form is obtained.
And step 208, generating a standard data form according to the mapping relation table and the data structure form.
The standard data form is a final result of experimental data processing, the standard data form may be a database form, and the standard data form may be output for use by setting an SQL statement, or an Excel form, a Word form, or the like.
And after the server acquires the mapping relation table, filling the mapping relation table and the data structure form into the middleware, and generating a standard data form by the middleware.
According to the experimental data processing method, when the to-be-processed experimental data are received, the to-be-processed experimental data are analyzed to obtain the data structure form corresponding to the to-be-processed experimental data, so that the analysis of the experimental data structure is completed, then the mapping relation form is used for mapping according to the data structure form to generate the standard data form, and therefore the to-be-processed experimental data of different platforms can be converted into the standard data which can be recognized by different platforms. The embodiment can improve the processing efficiency of experimental data and save the development resources of information software.
In one embodiment, as shown in fig. 3, an illustrative flowchart of the steps of generating a data structure form is provided, which includes the following specific steps:
The experimental data to be processed is an experimental report result output by the third-party instrument workstation, and the experimental report result consists of fields and contents corresponding to the fields, so that each experimental result corresponding to each field can be extracted according to the fields in the experimental report result.
And step 304, acquiring the field name corresponding to the experimental result.
The field name corresponding to the experimental report result can be obtained by obtaining the field in the experimental report result.
And step 306, inquiring a data structure table corresponding to the experimental data to be processed in a preset structure database according to the field name.
The structure database comprises a predefined data structure template, and the same structure database is used when the server provides services for different informationized software, so that the data structure is unified, and the identification accuracy of different informationized software is improved. The data structure table is obtained according to the data structure template.
And 308, filling the experimental result into a data structure table to generate a data structure table.
The data structure table is generated according to a standard structure template, and the data structure table with the same structure is output for different instrument workstations through filling of experimental results.
In the embodiment of the invention, because the formats of the experimental reports output by different instrument workstations are different, the experimental reports of different formats are converted into the form of the standard format by the server, which causes the difficulty of identification of different software platforms. Therefore, the processing efficiency of the server is improved, and the accuracy of experimental data identification of different information platforms is also improved.
For step 302, in an embodiment, a keyword defined by each instrument workstation for each experimental result is preset in the server, so that each experimental result in the experimental data to be processed can be identified through the keyword.
For step 306, in an embodiment, the data structure library includes a standard structure template, and each field in the standard structure template is arranged in order, so that when the data structure table is matched, each field in the standard structure template is matched by each field name, and a new data structure table is generated according to the sequence of the matched fields. According to the embodiment of the invention, a standard data structure table can be output for different experimental data to be processed, so that the processing efficiency is improved during data processing.
According to the scheme, the to-be-processed experimental data of different third parties can be converted into the data structure form with the standard data structure, so that the adaptability of the server for providing the experimental data processing service is improved.
In one embodiment, when querying the mapping relationship table, the following steps may be performed: matching in a preset mapping database according to the field name of the data structure form to obtain a mapping relation table corresponding to the data structure form; the mapping relation table comprises a mapping relation between the field names and the standard field names. In this embodiment, because the mapping relation tables stored in the mapping database include the corresponding relation between the field names and the standard field names, the corresponding mapping relation tables can be obtained by matching the field names obtained through the analysis.
Specifically, the to-be-processed experimental data can be analyzed to obtain a plurality of field names, and due to differences and similarities in the experimental report results output by different instrument workstations, the matching rule is set to determine that the mapping relation table is the mapping relation table corresponding to the to-be-processed data when the field names are completely consistent with the field names in the mapping relation table. In this embodiment, a specific matching rule is set, so that a result of misprocessing caused by similar instrument workbenches is avoided.
In specific implementation, the corresponding SQL statement may be set through the field name and the matching rule, so that the SQL statement is executed in the mapping database, and a specific mapping relationship table is screened out.
In one embodiment, as shown in fig. 4, an illustrative flowchart of the steps for generating a standard dataform is provided, which includes the following specific steps:
step 402, reading the experimental result in each field name in the data structure form according to the mapping relationship in the mapping relationship table.
And after obtaining the data structure form and the mapping form, the server stores the data structure form and the mapping form and completes the data generation task through the middleware.
And the middleware determines the field names corresponding to the mapping fields according to the mapping relation of the mapping relation table, and generates a standard data table corresponding to the data structure table according to the mapping relation. Through the mapping relation, the experimental result corresponding to the field name can be read.
And step 404, converting the experimental result into standard data according to a preset conversion algorithm.
After the mapping relation is determined, the conversion of the experimental result to standard data can be completed according to a preset conversion algorithm, wherein the conversion algorithm is set according to the SOP of the instrument workstation.
And 406, filling the standard data into a standard data table corresponding to the data structure table to generate a standard data form.
The server can complete the filling of the standard data table through the generated standard data and the mapping fields, so as to obtain the standard data form.
In the embodiment of the invention, the conversion of the data structure form to the standard data is completed through the mapping relation and the conversion algorithm. The conversion algorithm is set according to different instrument workstations, so that the conversion algorithm can adapt to different instrument workstations, and the adaptability of the server for providing experimental data processing service is improved.
In addition, in an embodiment, the mapping database is a database corresponding to a server, and when the server provides experimental data processing service for the information software, the mapping database can also receive an access request sent by a user corresponding to the information software, verify the identity of the user according to the access request, receive mapping data sent by the user after the identity verification is passed, store the mapping data in the database to obtain the mapping database,
specifically, before providing the experimental data processing service, a user corresponding to the information software needs to configure the server, the information software receives the mapping field provided by the server, so that mapping data is generated according to the corresponding instrument workstation and fed back to the server, the server stores the mapping data in the database, a large amount of mapping data can be obtained through the service of a large amount of information software, and the mapping database can be established according to the mapping data.
The technical scheme of the invention is further illustrated by a specific example as follows:
when the experimental data processing method is applied to the field of biological experiment analysis, a server is formed by adopting middleware and database technologies, the server provides experimental data processing solutions for various information software platforms, the information software platforms are integrated with the middleware and logically decoupled with the middleware, and then the experimental data processing function provided by the server can be obtained, and when the experimental data processing function is realized, the experimental data processing method specifically comprises the following steps:
1. the information software platform is integrated with the middleware of the server.
When an information software platform is developed, other logic frameworks do not need to be constructed, and only the logic frameworks are integrated with the middleware to perform logic decoupling.
2. The server provides a set of standard data structures in the biological field, so that the standardized analysis of the experimental report structure is realized.
The standard data structure may be implemented by SDMS software output. When the experiment report result of the third party is input, standard structure conversion is carried out on the experiment report result through SDMS software, and then the output result is stored in a database of the server.
Specifically, the standard structure table is shown in table 1.
TABLE 1
3. The middleware recognizes various fields in table 1, including Set Name, Item Name, Sample Type, Sample Position, Injection Volume, and Component Name. And then matching each field in a mapping database to obtain a mapping relation table.
Specifically, the mapping relationship table may be specifically as shown in table 2.
| Description of field | Middleware standard field | Workstation settings field |
| Sample introductionTable name | Table Name | Set Name |
| Sample numbering | Sample NO | Item Name |
| Type of sample | Sample Type | Sample Type |
| Sample introduction position | Sample Position | Sample Position |
| Sample volume | Injection Volume | Injection Volume |
| Analyte | Analyte | Component Name |
And 24, pushing the standard structure form and the mapping relation table to the middleware, and processing by the middleware to obtain a standard data form.
The standard dataform can be as shown in table 3.
TABLE 3
In the standard data sheet, the server converts the experimental result into the standard result by defining a uniform standard, and then adopting a conversion algorithm, for example, converting M-V1.1-04 into A0001.
Specifically, when the information software platform integrates the middleware, a user needs to register an account in the server, and the server stores the account in an account information form in the server. Therefore, when the information software platform configures the server, the registered account needs to be input in the login interface, the server verifies the registered account, and determines the authority of the corresponding user of the information software, and if the information software platform has the authority of configuring the database, the user can establish a mapping relation table in the database according to the rule of the corresponding instrument workbench and the SOP and the standard defined by the server, so that the capacity expansion of the data in the mapping database is completed. The mapping database may also scale to large amounts of data as the number of server users grows.
In addition, a user of the information software can check whether the mapping logic is correct when the experimental data is used for processing for the first time, and if the mapping logic is correct, the mapping relation table in the mapping database can be modified, so that the accuracy of experimental data processing is ensured.
It should be understood that although the various steps in the flow charts of fig. 2-4 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-4 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 5, there is provided an experimental data processing apparatus including: a data obtaining module 502, a data analyzing module 504, a mapping relation obtaining module 506 and a processing module 508, wherein:
the data obtaining module 502 is configured to obtain to-be-processed experimental data of a third party.
And the data analysis module 504 is configured to analyze the to-be-processed experimental data to obtain a data structure form corresponding to the to-be-processed experimental data.
And the mapping relation obtaining module 506 is configured to match the preset mapping database with the data structure form to obtain a mapping relation table corresponding to the data structure form.
And the processing module 508 is configured to generate a standard data form according to the mapping relationship table and the data structure form.
In one embodiment, the data parsing module 504 is further configured to extract experimental results in the experimental data to be processed; acquiring a field name corresponding to an experimental result; according to the field name, inquiring a preset structure database to obtain a data structure table corresponding to the experimental data to be processed; and filling the experimental result into a data structure table to generate a data structure table.
In one embodiment, the mapping relationship obtaining module 506 is further configured to perform matching in a preset mapping database according to the field name of the data structure form to obtain a mapping relationship table corresponding to the data structure form; the mapping relation table comprises a mapping relation between the field names and the standard field names.
In one embodiment, the conversion processing module 508 is further configured to read an experimental result in each field name in the data structure form according to the mapping relationship in the mapping relationship table; converting the experimental result into standard data according to a preset conversion algorithm; and filling the standard data into a standard data table corresponding to the data structure table to generate a standard data form.
In one embodiment, the system further comprises a database establishing module for receiving an access request of a user; verifying the identity of the user according to the access request; and when the identity of the user passes the verification, receiving mapping data sent by the user, and storing the mapping data into a database to obtain a mapping database.
For the specific definition of the experimental data processing device, the above definition of the experimental data processing method can be referred to, and is not repeated herein. The modules in the experimental data processing device can be wholly or partially realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, as shown in fig. 6, there is provided a middleware-based experimental data processing platform, the platform comprising: access interface 602, database module 604, and middleware module 606.
The access interface 602 receives the experimental data to be processed of the first workstation platform.
The middleware module 606 parses the to-be-processed experimental data to obtain a data structure form corresponding to the to-be-processed experimental data, calls the mapping database in the database module 604 according to the data structure form, matches the mapping database to obtain a mapping relation table corresponding to the data structure form, and converts the data structure form into a standard data form according to the mapping relation table.
The middleware module 606 sends the standard dataform to the second workstation platform through the access interface 602.
In this embodiment, the experiment data processing platform provides data processing services for the second workstation platform, the first workstation platform belongs to the third party platform, and the structures of the experiment report data generated by the first workstation platform and the second workstation platform are different. The experiment data processing platform is constructed through the middleware, and the platform can serve each workstation platform, so that the problem that experiment data are different and mutually identified among different workstation platforms is solved, and the cost of experiment data identification is reduced.
In one embodiment, when the middleware module 606 parses the to-be-processed experimental data to obtain a data structure form corresponding to the to-be-processed experimental data, the specific steps may be: extracting each experimental result in the experimental data to be processed; acquiring a field name corresponding to an experimental result; according to the field name, inquiring a preset structure database to obtain a data structure table corresponding to the experimental data to be processed; and filling the experimental result into a data structure table to generate a data structure table.
In one embodiment, the middleware module 606 calls the mapping database in the database module 604 according to the data structure form, and when the mapping database is matched to obtain the mapping relationship table corresponding to the data structure form, specifically, the mapping relationship table may be: matching in a preset mapping database according to the field name of the data structure form to obtain a mapping relation table corresponding to the data structure form; the mapping relation table comprises a mapping relation between the field names and the standard field names.
In one embodiment, when the middleware module 606 converts the data structure form into the standard data form according to the mapping relationship table, specifically, the following steps may be performed: reading an experimental result in each field name in the data structure form according to the mapping relation in the mapping relation table; converting the experimental result into standard data according to a preset conversion algorithm; and filling the standard data into a standard data table corresponding to the data structure table to generate a standard data form.
In one embodiment, the system further comprises a login module, the login module receives an access request of a user, the identity of the user is verified according to the access request, and when the identity of the user passes verification, the database module receives mapping data sent by the user and stores the mapping data into the mapping database.
In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 7. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing mapping relation table data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement an experimental data processing method.
Those skilled in the art will appreciate that the architecture shown in fig. 7 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, there is provided a computer device comprising a memory storing a computer program and a processor implementing the following steps when the processor executes the computer program:
acquiring to-be-processed experimental data of a third party;
analyzing the experimental data to be processed to obtain a data structure form corresponding to the experimental data to be processed;
according to the data structure form, matching in a preset mapping database to obtain a mapping relation table corresponding to the data structure form;
and generating a standard data form according to the mapping relation table and the data structure form.
In one embodiment, the processor, when executing the computer program, further performs the steps of: extracting each experimental result in the experimental data to be processed; acquiring a field name corresponding to an experimental result; according to the field name, inquiring a preset structure database to obtain a data structure table corresponding to the experimental data to be processed; and filling the experimental result into a data structure table to generate a data structure table.
In one embodiment, the processor, when executing the computer program, further performs the steps of: matching in a preset mapping database according to the field name of the data structure form to obtain a mapping relation table corresponding to the data structure form; the mapping relation table comprises a mapping relation between the field names and the standard field names.
In one embodiment, the processor, when executing the computer program, further performs the steps of: reading an experimental result in each field name in the data structure form according to the mapping relation in the mapping relation table; converting the experimental result into standard data according to a preset conversion algorithm; and filling the standard data into a standard data table corresponding to the data structure table to generate a standard data form.
In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving an access request of a user; verifying the identity of the user according to the access request; and when the identity of the user passes the verification, receiving mapping data sent by the user, and storing the mapping data into a database to obtain a mapping database.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
acquiring to-be-processed experimental data of a third party;
analyzing the experimental data to be processed to obtain a data structure form corresponding to the experimental data to be processed;
according to the data structure form, matching in a preset mapping database to obtain a mapping relation table corresponding to the data structure form;
and generating a standard data form according to the mapping relation table and the data structure form.
In one embodiment, the computer program when executed by the processor further performs the steps of: extracting each experimental result in the experimental data to be processed; acquiring a field name corresponding to an experimental result; according to the field name, inquiring a preset structure database to obtain a data structure table corresponding to the experimental data to be processed; and filling the experimental result into a data structure table to generate a data structure table.
In one embodiment, the computer program when executed by the processor further performs the steps of: matching in a preset mapping database according to the field name of the data structure form to obtain a mapping relation table corresponding to the data structure form; the mapping relation table comprises a mapping relation between the field names and the standard field names.
In one embodiment, the computer program when executed by the processor further performs the steps of: reading an experimental result in each field name in the data structure form according to the mapping relation in the mapping relation table; converting the experimental result into standard data according to a preset conversion algorithm; and filling the standard data into a standard data table corresponding to the data structure table to generate a standard data form.
In one embodiment, the computer program when executed by the processor further performs the steps of: receiving an access request of a user; verifying the identity of the user according to the access request; and when the identity of the user passes the verification, receiving mapping data sent by the user, and storing the mapping data into a database to obtain a mapping database.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. An experimental data processing method, applied to a server formed according to middleware and database technologies, the method comprising:
acquiring to-be-processed experimental data of a third party;
analyzing the to-be-processed experimental data to obtain a data structure form corresponding to the to-be-processed experimental data;
according to the data structure form, matching in a preset mapping database to obtain a mapping relation table corresponding to the data structure form; the mapping relation table records the corresponding relation between the output result of the instrument workbench and the standard data and the mapping relation between the field name of the data structure form and the field name of the standard data form;
generating a standard data form according to the mapping relation table and the data structure form;
generating a standard data form according to the mapping relation table and the data structure form, wherein the generating of the standard data form comprises:
filling the mapping relation table and the data structure form into the middleware, and generating a standard data form by the middleware; and the middleware determines the field names corresponding to the mapping fields according to the mapping relation of the mapping relation table, and generates a standard data table corresponding to the data structure table according to the mapping relation.
2. The method of claim 1, wherein analyzing the experimental data to be processed to obtain a data structure form corresponding to the experimental data to be processed comprises:
extracting each experimental result in the experimental data to be processed;
acquiring a field name corresponding to the experimental result;
according to the field name, inquiring a preset structure database to obtain a data structure table corresponding to the experimental data to be processed;
and filling the experimental result into the data structure table to generate a data structure table.
3. The method according to claim 2, wherein matching the mapping relationship table corresponding to the data structure form in a preset mapping database according to the data structure form comprises:
matching in a preset mapping database according to the field name of the data structure form to obtain a mapping relation table corresponding to the data structure form; the mapping relation table comprises the mapping relation between the field names and the standard field names.
4. The method of claim 3, wherein generating a standard data form from the mapping relationship table and the data structure form comprises:
reading an experimental result in each field name in the data structure form according to the mapping relation in the mapping relation table;
converting the experimental result into standard data according to a preset conversion algorithm;
and filling the standard data into a standard data table corresponding to the data structure table to generate a standard data form.
5. The method of any one of claims 1 to 4, wherein the manner of establishing the mapping database comprises:
receiving an access request of a user;
verifying the identity of the user according to the access request;
and when the identity of the user passes the verification, receiving mapping data sent by the user, and storing the mapping data into a database to obtain a mapping database.
6. An experimental data processing apparatus, characterized in that the apparatus comprises:
the data acquisition module is used for acquiring to-be-processed experimental data of a third party;
the data analysis module is used for analyzing the experimental data to be processed to obtain a data structure form corresponding to the experimental data to be processed;
the mapping relation obtaining module is used for matching in a preset mapping database according to the data structure form to obtain a mapping relation table corresponding to the data structure form; the mapping relation table records the corresponding relation between the output result of the instrument workbench and the standard data and the mapping relation between the field name of the data structure form and the field name of the standard data form;
the processing module is used for generating a standard data form according to the mapping relation table and the data structure form;
the processing module is also used for filling the mapping relation table and the data structure form into a middleware, and the middleware generates a standard data form; and the middleware determines the field names corresponding to the mapping fields according to the mapping relation of the mapping relation table, and generates a standard data table corresponding to the data structure table according to the mapping relation.
7. A middleware-based experimental data processing platform, said platform comprising: the system comprises an access interface, a database module and a middleware module;
the access interface receives to-be-processed experimental data of a first workstation platform;
the middleware module analyzes the experimental data to be processed to obtain a data structure form corresponding to the experimental data to be processed; calling a mapping database in the database module according to the data structure form, and matching in the mapping database to obtain a mapping relation table corresponding to the data structure form; converting the data structure form into a standard data form according to the mapping relation table; the mapping relation table records the corresponding relation between the output result of the instrument workbench and the standard data and the mapping relation between the field name of the data structure form and the field name of the standard data form;
the converting the data structure form into a standard data form according to the mapping relation table includes: filling the mapping relation table and the data structure form into the middleware, and generating a standard data form by the middleware; the middleware determines the field names corresponding to the mapping fields according to the mapping relation of the mapping relation table, and generates a standard data table corresponding to the data structure table according to the mapping relation;
and the middleware module sends the standard data form to a second workstation platform through the access interface.
8. The middleware-based experimental data processing platform of claim 7 further comprising: a login module;
the login module receives an access request of a user and verifies the identity of the user according to the access request;
and when the identity of the user passes the authentication, the database module receives the mapping data sent by the user and stores the mapping data into the mapping database.
9. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method of any of claims 1 to 6.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811610344.9A CN109710677B (en) | 2018-12-27 | 2018-12-27 | Experiment data processing method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811610344.9A CN109710677B (en) | 2018-12-27 | 2018-12-27 | Experiment data processing method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109710677A CN109710677A (en) | 2019-05-03 |
| CN109710677B true CN109710677B (en) | 2021-03-05 |
Family
ID=66258748
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811610344.9A Active CN109710677B (en) | 2018-12-27 | 2018-12-27 | Experiment data processing method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109710677B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110704632A (en) * | 2019-08-26 | 2020-01-17 | 南京医渡云医学技术有限公司 | Method and device for processing clinical data, readable medium and electronic equipment |
| CN110768952B (en) * | 2019-09-09 | 2021-07-27 | 中国科学院上海微***与信息技术研究所 | Data verification method, device and system and storage medium |
| CN111126018B (en) * | 2019-11-25 | 2023-08-08 | 泰康保险集团股份有限公司 | Form generation method and device, storage medium and electronic equipment |
| CN110895533B (en) * | 2019-11-29 | 2023-01-17 | 北京锐安科技有限公司 | Form mapping method and device, computer equipment and storage medium |
| CN111026757B (en) * | 2019-12-10 | 2023-10-10 | 首都医科大学附属北京友谊医院 | Method, device, equipment and storage medium for generating standard statistical format data |
| CN111274484A (en) * | 2020-01-20 | 2020-06-12 | 上海风秩科技有限公司 | Method and device for managing interactive data |
| CN112182084A (en) * | 2020-09-27 | 2021-01-05 | 上海亚新建设工程有限公司 | Data format-based data automatic processing method and equipment |
| CN112258015A (en) * | 2020-10-19 | 2021-01-22 | 上海飞域实验室设备有限公司 | Laboratory management early warning system based on cloud data analysis and early warning method thereof |
| CN112988868B (en) * | 2021-03-17 | 2022-12-13 | 首钢京唐钢铁联合有限责任公司 | Steel laboratory data processing method and system |
| CN113111047B (en) * | 2021-03-18 | 2023-09-01 | 宜员(上海)信息科技有限公司 | Data processing method and device and electronic equipment |
| CN113761858A (en) * | 2021-09-07 | 2021-12-07 | 平安国际智慧城市科技股份有限公司 | Form data processing method and device, computer equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101452503A (en) * | 2008-11-28 | 2009-06-10 | 上海生物信息技术研究中心 | Isomerization clinical medical information shared system and method |
| CN101901220A (en) * | 2009-05-27 | 2010-12-01 | 北京启明星辰信息技术股份有限公司 | General data display method and equipment |
| CN102999610A (en) * | 2012-11-22 | 2013-03-27 | 用友软件股份有限公司 | Data access system and data access method |
| CN104978307A (en) * | 2015-06-25 | 2015-10-14 | 中铁四局集团有限公司 | List processing method and apparatus |
| CN108416043A (en) * | 2018-03-14 | 2018-08-17 | 中煤科工集团重庆研究院有限公司 | Multi-platform spatial data fusion and synchronous method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9984107B2 (en) * | 2014-12-18 | 2018-05-29 | International Business Machines Corporation | Database joins using uncertain criteria |
-
2018
- 2018-12-27 CN CN201811610344.9A patent/CN109710677B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101452503A (en) * | 2008-11-28 | 2009-06-10 | 上海生物信息技术研究中心 | Isomerization clinical medical information shared system and method |
| CN101901220A (en) * | 2009-05-27 | 2010-12-01 | 北京启明星辰信息技术股份有限公司 | General data display method and equipment |
| CN102999610A (en) * | 2012-11-22 | 2013-03-27 | 用友软件股份有限公司 | Data access system and data access method |
| CN104978307A (en) * | 2015-06-25 | 2015-10-14 | 中铁四局集团有限公司 | List processing method and apparatus |
| CN108416043A (en) * | 2018-03-14 | 2018-08-17 | 中煤科工集团重庆研究院有限公司 | Multi-platform spatial data fusion and synchronous method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109710677A (en) | 2019-05-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109710677B (en) | Experiment data processing method and device, computer equipment and storage medium | |
| CN109474578B (en) | Message checking method, device, computer equipment and storage medium | |
| WO2020186786A1 (en) | File processing method and apparatus, computer device and storage medium | |
| CN109446068B (en) | Interface test method, device, computer equipment and storage medium | |
| CN109189367B (en) | Data processing method, device, server and storage medium | |
| CN110290212B (en) | Service call recording method, device, computer equipment and storage medium | |
| WO2020258655A1 (en) | Data verification method and apparatus, and computer device and storage medium | |
| CN110941546A (en) | Automatic test method, device, equipment and storage medium for WEB page case | |
| CN110990400A (en) | Database query method and device, computer equipment and storage medium | |
| CN109783785B (en) | Method and device for generating experiment detection report and computer equipment | |
| CN109189799B (en) | Service data query method, device, computer equipment and storage medium | |
| CN110751550B (en) | Account checking method and device, computer equipment and storage medium | |
| CN111310427A (en) | Service data configuration processing method and device, computer equipment and storage medium | |
| CN110990390B (en) | Data cooperative processing method, device, computer equipment and storage medium | |
| CN110659298B (en) | Financial data processing method and device, computer equipment and storage medium | |
| CN109726134B (en) | Interface test method and system | |
| CN109389299B (en) | Workflow process deployment method, workflow process deployment device, computer equipment and storage medium | |
| CN112000903B (en) | Data query method and device, computer equipment and storage medium | |
| CN109685668B (en) | Order batch processing method, device, computer equipment and storage medium | |
| CN109325058B (en) | Rule batch comparison method, device, computer equipment and storage medium | |
| CN112328631A (en) | Production fault analysis method and device, electronic equipment and storage medium | |
| CN109800965B (en) | Process business processing method and device, computer equipment and storage medium | |
| CN111209061A (en) | Method and device for filling in user information, computer equipment and storage medium | |
| CN112559526A (en) | Data table export method and device, computer equipment and storage medium | |
| CN110533381B (en) | Case jurisdiction auditing method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |