CN113886355A - Nuclear power structural material process data integration system and method - Google Patents
Nuclear power structural material process data integration system and method Download PDFInfo
- Publication number
- CN113886355A CN113886355A CN202111082417.3A CN202111082417A CN113886355A CN 113886355 A CN113886355 A CN 113886355A CN 202111082417 A CN202111082417 A CN 202111082417A CN 113886355 A CN113886355 A CN 113886355A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- nuclear power
- structural material
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 104
- 230000010354 integration Effects 0.000 title claims abstract description 19
- 238000013499 data model Methods 0.000 claims abstract description 25
- 238000004458 analytical method Methods 0.000 claims abstract description 20
- 238000013507 mapping Methods 0.000 claims abstract description 18
- 238000013524 data verification Methods 0.000 claims abstract description 10
- 238000003860 storage Methods 0.000 claims abstract description 10
- 238000012795 verification Methods 0.000 claims description 10
- 238000003723 Smelting Methods 0.000 claims description 6
- 238000013506 data mapping Methods 0.000 claims description 6
- 238000010438 heat treatment Methods 0.000 claims description 6
- 238000004806 packaging method and process Methods 0.000 claims description 6
- 238000013496 data integrity verification Methods 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16C—COMPUTATIONAL CHEMISTRY; CHEMOINFORMATICS; COMPUTATIONAL MATERIALS SCIENCE
- G16C60/00—Computational materials science, i.e. ICT specially adapted for investigating the physical or chemical properties of materials or phenomena associated with their design, synthesis, processing, characterisation or utilisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/907—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Library & Information Science (AREA)
- Monitoring And Testing Of Nuclear Reactors (AREA)
Abstract
The invention discloses a nuclear power structural material process data integration system and a method, which comprises an uploading module, an analysis module, a mapping module and a checking module; an uploading module: uploading the data file to an analysis module; an analysis module: analyzing and judging the uploaded data files, and extracting the data files capable of being analyzed into unstructured data item by item according to the types of the data sources; the mapping module: mapping unstructured data into a predefined process data model, mapping information of the unstructured data into a material meta-process data model, and obtaining meta-data; a checking module: and carrying out data verification on the metadata, and associating the verified metadata with the unique identifier. Through the characteristic process data file of the nuclear power structural material, data of different files can be uniformly and efficiently analyzed, a process metadata model is completely mapped, and uniform association storage is realized. The flexibility, completeness, tightness and efficiency of data integration are improved.
Description
Technical Field
The invention belongs to the technical field of nuclear power material data processing, and particularly relates to a nuclear power structural material process data integration system and method.
Background
After fukushima accidents, the worldwide nuclear power safety is put forward higher requirements, the third generation technology is accelerated by the united states, the law and the russia, and the third generation nuclear power, namely Hualong first large heap and ACP100 small heap, is autonomously researched and developed in China for competing for the nuclear power markets at home and abroad. At present, the autonomous three-generation nuclear power technology in China faces comprehensive competition of other three-generation nuclear power technologies at home and abroad, and further optimization of economy and safety is urgently needed.
A typical reactor structural material production process database includes numerous parameter data. Because of the safety requirements and other specificities of nuclear power structural materials, the requirements on the production process are higher than those of common materials. The storage of these complex process data places very high demands on accuracy, integrity and stability. The manner in which process data is stored varies due to factors such as the nature of the individual materials, the stage of the life cycle of the materials, and other economic and human factors. In order to facilitate data management, the relevant data needs to be continuously perfected on the basis of the existing data of a typical reactor structural material performance database and a typical reactor structural material production process database so as to establish a small-pile structural material multi-scale simulation integrated process database.
However, in the process of nuclear power materials, because the input and output types of various types of software are different, the process data are difficult to form connection, and the process data, the process data and the performance data are difficult to form connection.
Disclosure of Invention
Aiming at the defects of the prior art, the invention aims to provide a nuclear power structural material process data integration system and a method, which solve the technical problems in the prior art.
The purpose of the invention can be realized by the following technical scheme:
a nuclear power structural material process data integration system comprises an uploading module, an analyzing module, a mapping module and a checking module;
the uploading module: uploading the data file to an analysis module;
the analysis module is used for: analyzing and judging the uploaded data files, performing data verification judgment on the data files which cannot be analyzed, and extracting the data files which can be analyzed one by one into unstructured data according to the types of data sources;
the mapping module: mapping unstructured data into a predefined process data model, and mapping information of the unstructured data into a material meta-process data model according to the performance characteristics of the predefined process data model to obtain meta-data;
the checking module: and carrying out data verification on the metadata, associating the verified metadata with the unique identifier, and packaging the metadata into complete nuclear power structural material process data.
Furthermore, the format of the data file in the uploading module comprises one or a combined format file in Txt, Excel, Csv, Word and XML formats.
Further, the predefined process data model comprises performance characteristics of a process flow, a smelting process, a forming process and a heat treatment process.
Further, in the mapping module, when the information of the unstructured data is mapped to the material meta-process data model, the information includes name, type and position information in the unstructured data.
Further, the data types in the checking module include whether to match, data upper and lower limit verification, data format verification, and data integrity verification.
Furthermore, in the verification module, the metadata which is verified is finally stored in the database for storage.
The method of the nuclear power structural material process data integration system comprises the following steps:
s1, uploading the data file to an analysis module by an operator;
s2, judging whether the data file is a readable file, if so, executing analysis operation, otherwise, further judging whether the data file is valid, storing the valid file, and filtering the invalid file;
s3, analyzing the readable data file through an analysis module, dividing the readable data file into a process flow, a smelting process, a forming process and a heat treatment process according to the type of a data source, and extracting the readable data file into unstructured data one by one;
s4, mapping the unstructured data into a defined process data model, and mapping the name, type and position information of the unstructured data into a material meta-process data model according to the characteristics of the defined process data model to obtain metadata;
and S5, performing data verification on the metadata, associating the verified process metadata with the unique identifier, packaging the process metadata into complete process data of the nuclear power structural material, and finally storing the complete process data of the nuclear power structural material in a database.
The invention has the beneficial effects that:
1. according to the invention, through the characteristic process data file of the nuclear power structural material, data of different files can be uniformly and efficiently analyzed, a process metadata model is completely mapped, and uniform association storage is realized, so that an integrated data chain for material science multi-mode data acquisition, transmission, storage and sharing visualization is realized; and (4) the exchange, fusion, storage and use of the full life cycle data of the communication material from design to service application data.
2. The invention is suitable for heterogeneous data sources generated by nuclear power structural materials in different life cycles, integrates nuclear power structural material performance data with increasing complexity and data quantity completely and quickly, and improves the flexibility, integrity, tightness and efficiency of data integration.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
FIG. 1 is a schematic diagram of a system architecture of an embodiment of the present invention;
FIG. 2 is a block diagram of the overall architecture of an embodiment of the present invention;
FIG. 3 is a schematic flow chart of a method according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1 and 2, an embodiment of the invention provides a nuclear power structural material process data integration system, which includes an uploading module, an analysis module, a mapping module, and a verification module.
An uploading module: uploading the data file to an analysis module; the format of the data file comprises one of Txt, Excel, Csv, Word and XML format or a combined format file.
An analysis module: analyzing and judging the uploaded data files, performing data verification judgment on the data files which cannot be analyzed, and extracting the data files which can be analyzed one by one into unstructured data according to the types of data sources;
a mapping module: mapping the unstructured data into a predefined process data model, and mapping the name, type and position information of the unstructured data into a material meta-process data model according to the performance characteristics of the predefined process data model to obtain metadata; the predefined process data model comprises the performance characteristics of a process flow, a smelting process, a forming process and a heat treatment process.
A checking module: and carrying out data verification on the metadata, associating the verified metadata with the unique identifier, and packaging the unique identifier into complete nuclear power structural material process data, wherein the data types in the verification module comprise whether the metadata is matched, data upper and lower limit verification, data format verification and data integrity verification.
And finally storing the verified metadata in a database for storage.
As shown in fig. 3, the method of the nuclear power structural material process data integration system includes the following steps:
s1, uploading the data file to an analysis module by an operator; including common file formats such as Txt, Excel, Csv, Word, XML, and the like.
And S2, judging whether the data file is a readable file, if so, executing analysis operation, otherwise, further judging whether the data file is valid (whether the data is complete or not and whether the data meets the specification or not are required to be judged), storing the valid file, and filtering the invalid file.
And S3, analyzing the readable data file through an analysis module, dividing the readable data file into a process flow, a smelting process, a forming process and a heat treatment process according to the type of the data source, and extracting the readable data file into unstructured data one by one.
And S4, mapping the unstructured data into a defined process data model, and mapping the name, type and position information of the unstructured data into a material meta-process data model according to the characteristics of the defined process data model to obtain metadata.
And S5, performing data verification on the metadata, associating the verified process metadata with the unique identifier, packaging the process metadata into complete process data of the nuclear power structural material, and finally storing the complete process data of the nuclear power structural material in a database.
And then ends.
In summary, the invention can uniformly and efficiently analyze the data of different files, completely map the process metadata model and uniformly associate and store the process metadata model through the characteristic process data file of the nuclear power structural material. The flexibility, completeness, tightness and efficiency of data integration are improved. The method is suitable for heterogeneous data sources generated by nuclear power structural materials in different life cycles, and can be used for completely and quickly integrating nuclear power structural material performance data with increasing complexity and data volume. An integrated data chain for realizing material science multi-modal data acquisition, transmission, storage and sharing visualization is realized; and (4) the exchange, fusion, storage and use of the full life cycle data of the communication material from design to service application data.
In the description herein, references to the description of "one embodiment," "an example," "a specific example" or the like are intended to mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The foregoing shows and describes the general principles, essential features, and advantages of the invention. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are described in the specification and illustrated only to illustrate the principle of the present invention, but that various changes and modifications may be made therein without departing from the spirit and scope of the present invention, which fall within the scope of the invention as claimed.
Claims (7)
1. A nuclear power structural material process data integration system is characterized by comprising an uploading module, an analysis module, a mapping module and a checking module;
the uploading module: uploading the data file to an analysis module;
the analysis module is used for: analyzing and judging the uploaded data files, performing data verification judgment on the data files which cannot be analyzed, and extracting the data files which can be analyzed one by one into unstructured data according to the types of data sources;
the mapping module: mapping unstructured data into a predefined process data model, and mapping information of the unstructured data into a material meta-process data model according to the performance characteristics of the predefined process data model to obtain meta-data;
the checking module: and carrying out data verification on the metadata, associating the verified metadata with the unique identifier, and packaging the metadata into complete nuclear power structural material process data.
2. The nuclear power structural material process data integration system of claim 1, wherein the format of the data file in the upload module comprises one or a combination format file of Txt, Excel, Csv, Word, XML format.
3. The nuclear power structural material process data integration system of claim 1, wherein the predefined process data model includes performance characteristics of a process flow, a smelting process, a forming process, and a heat treatment process.
4. The nuclear power structural material process data integration system of claim 1, wherein in the mapping module, the information of the unstructured data includes name, type, and location information in the unstructured data when mapped to the material meta-process data model.
5. The nuclear power structural material process data integration system of claim 1, wherein the data types in the check module include whether matching is performed, data upper and lower limit verification, data format verification, and data integrity verification.
6. The nuclear power structural material process data integration system of claim 1, wherein in the verification module, the metadata that is verified is finally saved to a database for storage.
7. The method of a nuclear power structural material process data integration system of any of claims 1-6, comprising the steps of:
s1, uploading the data file to an analysis module by an operator;
s2, judging whether the data file is a readable file, if so, executing analysis operation, otherwise, further judging whether the data file is valid, storing the valid file, and filtering the invalid file;
s3, analyzing the readable data file through an analysis module, dividing the readable data file into a process flow, a smelting process, a forming process and a heat treatment process according to the type of a data source, and extracting the readable data file into unstructured data one by one;
s4, mapping the unstructured data into a defined process data model, and mapping the name, type and position information of the unstructured data into a material meta-process data model according to the characteristics of the defined process data model to obtain metadata;
and S5, performing data verification on the metadata, associating the verified process metadata with the unique identifier, packaging the process metadata into complete process data of the nuclear power structural material, and finally storing the complete process data of the nuclear power structural material in a database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111082417.3A CN113886355A (en) | 2021-09-15 | 2021-09-15 | Nuclear power structural material process data integration system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111082417.3A CN113886355A (en) | 2021-09-15 | 2021-09-15 | Nuclear power structural material process data integration system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113886355A true CN113886355A (en) | 2022-01-04 |
Family
ID=79009516
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111082417.3A Pending CN113886355A (en) | 2021-09-15 | 2021-09-15 | Nuclear power structural material process data integration system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113886355A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114862364A (en) * | 2022-05-24 | 2022-08-05 | 成都材智科技有限公司 | Multi-source and multi-dimensional nuclear power material data-based intersection system and method |
| CN116861042A (en) * | 2023-09-05 | 2023-10-10 | 国家超级计算天津中心 | Information verification method, device, equipment and medium based on material database |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7210137B1 (en) * | 2003-05-13 | 2007-04-24 | Microsoft Corporation | Memory mapping and parsing application data |
| US7668849B1 (en) * | 2005-12-09 | 2010-02-23 | BMMSoft, Inc. | Method and system for processing structured data and unstructured data |
| US20140324857A1 (en) * | 2013-04-29 | 2014-10-30 | International Business Machines Corporation | Dynamic assignment of business logic based on schema mapping metadata |
| CN105574667A (en) * | 2015-12-15 | 2016-05-11 | 中广核工程有限公司 | Nuclear power design data integration method and system |
| EP3139328A1 (en) * | 2015-09-04 | 2017-03-08 | Palantir Technologies Inc. | Systems and methods for structuring data from unstructured electronic data files |
| US20170352041A1 (en) * | 2016-06-06 | 2017-12-07 | Epiance Software Pvt. Ltd. | Intelligent, interactive, and self-learning robotic process automation system |
| CN108874944A (en) * | 2018-06-04 | 2018-11-23 | 刘洋 | A kind of isomeric data mapped system and method based on XSL language conversion |
| CN109739867A (en) * | 2018-12-29 | 2019-05-10 | 北京航天数据股份有限公司 | A kind of industry metadata management method and system |
| CN112667722A (en) * | 2020-12-31 | 2021-04-16 | 中国广核电力股份有限公司 | Nuclear power station program file conversion method and equipment |
-
2021
- 2021-09-15 CN CN202111082417.3A patent/CN113886355A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7210137B1 (en) * | 2003-05-13 | 2007-04-24 | Microsoft Corporation | Memory mapping and parsing application data |
| US7668849B1 (en) * | 2005-12-09 | 2010-02-23 | BMMSoft, Inc. | Method and system for processing structured data and unstructured data |
| US20140324857A1 (en) * | 2013-04-29 | 2014-10-30 | International Business Machines Corporation | Dynamic assignment of business logic based on schema mapping metadata |
| EP3139328A1 (en) * | 2015-09-04 | 2017-03-08 | Palantir Technologies Inc. | Systems and methods for structuring data from unstructured electronic data files |
| CN105574667A (en) * | 2015-12-15 | 2016-05-11 | 中广核工程有限公司 | Nuclear power design data integration method and system |
| US20170352041A1 (en) * | 2016-06-06 | 2017-12-07 | Epiance Software Pvt. Ltd. | Intelligent, interactive, and self-learning robotic process automation system |
| CN108874944A (en) * | 2018-06-04 | 2018-11-23 | 刘洋 | A kind of isomeric data mapped system and method based on XSL language conversion |
| CN109739867A (en) * | 2018-12-29 | 2019-05-10 | 北京航天数据股份有限公司 | A kind of industry metadata management method and system |
| CN112667722A (en) * | 2020-12-31 | 2021-04-16 | 中国广核电力股份有限公司 | Nuclear power station program file conversion method and equipment |
Non-Patent Citations (2)
| Title |
|---|
| 戴树唯等: "基于公共信息模型的数据映射工具", 通信与信息技术, no. 2, 31 March 2016 (2016-03-31), pages 75 - 78 * |
| 汪心宣等: "核电工程材料数据库的设计", 核动力工程, vol. 17, no. 6, 31 December 1996 (1996-12-31), pages 523 - 527 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114862364A (en) * | 2022-05-24 | 2022-08-05 | 成都材智科技有限公司 | Multi-source and multi-dimensional nuclear power material data-based intersection system and method |
| CN116861042A (en) * | 2023-09-05 | 2023-10-10 | 国家超级计算天津中心 | Information verification method, device, equipment and medium based on material database |
| CN116861042B (en) * | 2023-09-05 | 2023-12-05 | 国家超级计算天津中心 | Information verification method, device, equipment and medium based on material database |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105808734B (en) | Semantic-net-based method for acquiring implicit relation between knowledge in steel manufacturing process | |
| CN113886355A (en) | Nuclear power structural material process data integration system and method | |
| US10102039B2 (en) | Converting a hybrid flow | |
| CN105786912B (en) | Data collecting conversion method and device | |
| CN106777101A (en) | Data processing engine | |
| CN110851499A (en) | Knowledge-based assembly process design method, system and medium | |
| CN104424018A (en) | Distributed calculating transaction processing method and device | |
| CN102684223A (en) | Optimized evaluating method for wind power output under multi-constraint condition for reducing transmission loss | |
| CN104317864A (en) | Automatic identification method of information model based on IEC61850 logical nodes | |
| CN106126789B (en) | Monitoring data based on Revit and Matlab update the integrated system and method with processing | |
| CN104199667A (en) | Method and system for newly establishing MTK project and submitting codes | |
| CN105373636A (en) | Enterprise Windchill system based ProE standard part library construction method | |
| CN114153885A (en) | Nuclear power structural material performance data integration system and method | |
| CN115965327A (en) | Processing and analyzing system and method based on nuclear power high-throughput computing data | |
| CN112988710A (en) | Big data processing method and system | |
| CN111798311A (en) | Bank risk analysis library platform based on big data, building method and readable medium | |
| CN204790999U (en) | Big data acquisition of industry and processing system | |
| CN115238099A (en) | Industrial Internet data middle platform construction method for energy industry equipment | |
| CN111858647B (en) | Method for verifying conversion field type between data sources | |
| CN107844654A (en) | A kind of blower fan hydraulic variable propeller system load processing platform | |
| CN106709009A (en) | System for processing big data of electric vehicles on basis of cloud platform | |
| CN110955521A (en) | Power distribution network wide area distributed type sinking calculation system and method based on big data | |
| CN102279733B (en) | A kind of Open Source Platform and realize the method for data processing | |
| CN114862364A (en) | Multi-source and multi-dimensional nuclear power material data-based intersection system and method | |
| CN109558252A (en) | Data interactive method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |