CN104699721A - Massive industrial data organization implementation method - Google Patents
Massive industrial data organization implementation method Download PDFInfo
- Publication number
- CN104699721A CN104699721A CN201310670073.7A CN201310670073A CN104699721A CN 104699721 A CN104699721 A CN 104699721A CN 201310670073 A CN201310670073 A CN 201310670073A CN 104699721 A CN104699721 A CN 104699721A
- Authority
- CN
- China
- Prior art keywords
- parameter
- data
- index
- enormous quantities
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a massive industrial data organization implementation method which comprises the following steps: 1) setting a logical structure of data; 2) setting a physical structure of the data, 3) initializing a system data set before a system runs officially, and 4) allowing the system to adopt extraction or protection and backup or update operation on the data, wherein the physical structure comprises an information index table, an information storage table and a parameter data sheet. The massive industrial data organization implementation method achieves massive data extraction, update, backup and protection.
Description
Technical field
The invention belongs to the system software technical field being applied to auto industry etc. and relating to data in enormous quantities use, particularly relate to a kind of industrial data organizing and implementing method in enormous quantities.
Background technology
Power control mode replaced, and the advantage of electronic control mode is to control accurately, be easy to upgrading, amendment and perfect.But the development of electron controls technology also causes the sharply expansion of software data scale simultaneously.The technological parameter that some vehicle electronic control unit run duration uses reaches up to ten thousand and even goes up 100,000, so huge data volume exchange can cause the upgrade maintenance of control software design to cause many obstacles, but the most direct disastrous effect is the operational efficiency having a strong impact on control software design.
Traditional Method of Data Organization is that parameter is defined as global variable, and this mode makes supplemental characteristic maintenance upgrade difficulty, and cannot guarantee the consistance that data are read and write when each module concurrent running of system.These problems are difficult to evade in its framework simultaneously or solve.
Summary of the invention
In order to solve technical matters existing in background technology, the present invention proposes a kind of industrial data organizing and implementing method in enormous quantities, achieving the extraction of data in enormous quantities, renewal, backup and protection.
Technical solution of the present invention is: a kind of industrial data organizing and implementing method in enormous quantities, is characterized in that: said method comprising the steps of:
1) logical organization of setting data;
2) physical arrangement of setting data; Described physical arrangement comprises information index table, message store table and parametric data table;
3), before system commencement of commercial operation, initialization is carried out to system data set;
4) system is taked to extract or protection to data; Backup or renewal rewards theory.
Above-mentioned steps 1) in the logical organization of data comprise the parameter ID of data, parameter name, data type, logical offset, span, functional description; Design logic structure has two objects, and one is explain Meaning of Information in physical arrangement, and two is designs of specification physical arrangement, if be put in building, logical organization is equivalent to design drawing, and physical arrangement is equivalent to actual building structure; All summary of parameters.An are formed a parameter logistics information table.
Above-mentioned steps 2) in information index table be an integer array, its array element saves as message store table index; Array index computing formula is: information index table subscript=parameter ID% information index table length;
Above-mentioned steps 2) in message store table be a structural array table; Each element comprises three content: parameter ID, parameter length, parameter physical address.Parameter physical address points to the address of parameter value in DSB data store block; Locate each element and refer to a parameter in structural array table, each parameter comprises some attributes, equally for building, if there are 24 floor in a building, every layer is only had a cover house, and this building only has so unit, if so this building is compared to a structural array table, so this table has 24 elements, each element representation one overlaps house (parameter), and so there are some attributes in these houses, such as number (parameter ID), size (parameter length), house type etc.
Above-mentioned steps 2) in parametric data table be a slice continuous print storage block, what wherein store is the numerical value of parameter, and comprise software code and other data values, the logical offset according to parameter stores successively in order.
Above-mentioned steps 3) in system data set carry out initialized concrete steps and be:
3.1) data acquisition: the initial value determining each data, initialization values is friction torque coefficient: height idling setting value, vehicle speed sensor type set value etc.;
3.2) the logically order data acquisition set value pad parameter tables of data of parameter in information table;
3.3) parameter to be initiated is arranged from small to large according to ID, successively fill message concordance list and message store table.
Above-mentioned steps 3.3) concrete steps of fill message concordance list and message store table are:
3.3.1) parameter is taken out;
3.3.2) index value is obtained according to index value=parameter ID% parameter sum;
3.3.3) determining step 3.3.2) in index value whether fill in the corresponding position of concordance list, if so, then carry out step 3.3.4); If not, then the index value of corresponding position is filled in;
3.3.4) index value adds 1;
3.3.5) parameter storage list correspondence position is positioned to according to index value;
3.3.6) judge that the whether existing parameter of correspondence position is inserted, if so, then return step 3.3.4); The then corresponding position of pad parameter storage list if not.
3.3.7) after all parameters have been filled, step 3.3.1 has been returned).
The present invention devises a kind of industrial data organizing and implementing method in enormous quantities, and the method is defined as basis with the logic of novelty and physical arrangement, achieves the extraction of data in enormous quantities, renewal, backup and protection.By facts have proved, the method in the application of industrial circle with common Method of Data Organization ratio, more effectively and be easy to safeguard.
1) devise a kind of Organization of Data of system, operation and maintenance method, the method based on the logic of novelty and physical design, and by supporting data extraction method, achieves the extraction of data in enormous quantities, renewal, backup and protection.
2) on the basis of traditional data Logic Structure Design, data and code unified definition are parameter item by the present invention, manage by unified mode.
3) a kind of physical storage structure based on Hash table is devised, to realize Separate Storage and the use of data message and numerical value.
4) realize based on above-mentioned logic, physical arrangement, devise a kind of relevant data extraction method, the method has higher efficiency and ease for use.
5) under above design is supported, devise a kind of simple and easy and be easy to realize Data Update, backup and guard method.
This method achieves complete industrial mass parameter tissue, maintenance and an operation method.Adopt this method can to store data with lower cost, safeguard, upgrade and back up, and avoid data to a certain extent by the content conflicts of the concurrent use of multimode.
Accompanying drawing explanation
Fig. 1 is method flow diagram of the present invention;
Fig. 2 is physical storage structure schematic diagram of the present invention;
Fig. 3 is parameter information initialization flowchart of the present invention;
Fig. 4 is that data of the present invention extract process flow diagram;
Embodiment
See Fig. 1, the present invention proposes a kind of industrial data organizing and implementing method in enormous quantities, method comprises the following steps:
1) logical organization of setting data; For different industries, there is different data sets, according to this method, first by tradition intrasystem all data are classified and be organized into some parameter items, each parameter item comprises as properties: parameter ID: the numeral of unique id parameter item in system, in same product line life cycle, ID immobilizes; Parameter name: with string name identification parameter item, be convenient to software developer and use; Data type: characterising parameter data type; Logical offset: the relative position of this parameter in parameter logistics information table; Other attributes: comprise span, functional description etc., design reference in use for related personnel.
Software program code is also regarded as a class parameter by the inventive method, and its type is appointed as CODE, so just program originally and data acquisition can be stored by unified mode and use, and all summary of parameters.An are formed a parameter logistics information table.
2) physical arrangement of setting data; Described physical arrangement comprises information index table, message store table and parametric data table;
Information index table is an integer array, and its array element saves as message store table index; Array index computing formula is: information index table subscript=parameter ID% information index table length;
Message store table is a structural array table; Each element comprises three content: parameter ID, parameter length, parameter physical address.Parameter physical address points to the address of parameter value in DSB data store block, is the address of corresponding Flash unit in fig. 2.Locate each element and refer to a parameter in structural array table, each parameter comprises some attributes, equally for building, if there are 24 floor in a building, every layer is only had a cover house, and this building only has so unit, if so this building is compared to a structural array table, so this table has 24 elements, each element representation one overlaps house (parameter), and so there are some attributes in these houses, such as number (parameter ID), size (parameter length), house type etc.
Information index table and message store table achieve a Hash list structure, to realize directly getting directly depositing of parameter information structure according to parameter ID.
Parametric data table is a slice continuous print storage block, and what wherein store is the numerical value of parameter, and comprise software code and other data values, the logical offset according to parameter stores successively in order.This table is the basis that follow-up data upgrades and backs up.After related data structures has designed, for realizing data maintenance of the present invention and operation function, before system commencement of commercial operation, needing to carry out initialization to system data set, specifically comprising the work of two aspects:
3), before system commencement of commercial operation, initialization is carried out to system data set; Concrete steps are:
3.1) data acquisition: in this step, commercial manufacturer belonging to system rule of thumb determines the initial value of each data with concrete operating mode, initialization values is friction torque coefficient, i.e. low idling setting value, vehicle speed sensor type set value etc.;
3.2) the logically order data acquisition set value pad parameter tables of data of parameter in information table;
3.3) parameter to be initiated is arranged from small to large according to ID, successively fill message concordance list and message store table; The concrete steps of fill message concordance list and message store table are:
3.3.1) parameter is taken out;
3.3.2) index value is obtained according to index value=parameter ID% parameter sum;
3.3.3) determining step 3.3.2) in index value whether fill in the corresponding position of concordance list, if so, then carry out step 3.3.4); If not, then the index value of corresponding position is filled in;
3.3.4) index value adds 1;
3.3.5) parameter storage list correspondence position is positioned to according to index value;
3.3.6) judge that the whether existing parameter of correspondence position is inserted, if so, then return step 3.3.4); The then corresponding position of pad parameter storage list if not.
3.3.7) after all parameters have been filled, step 3.3.1 has been returned).
Data structure initialization:
This step comprises the initialization to parameter reference table, message store table and parametric data table, realizes as follows:
1) the logically order data acquisition set value pad parameter tables of data of parameter in information table;
2) parameter to be initiated is arranged from small to large according to ID, according to flow process shown in Fig. 3 successively fill message concordance list and message store table.
The daily servicing of data is run: system initialization completes, and just can carry out normal daily servicing operation, mainly comprise following content:
Data extract/protection:
Because data storage method is that numerical value and information separated store, the special extracting method that therefore data must use the present invention to design during system cloud gray model extracts data value, and the method as shown in Figure 4.
Concrete data are extracted/are protected and are described as follows:
1) extract the parameter that need use when module periodic duty starts, its value is copied in temporary variable;
2) in this periodic duty, these temporary variables are used as corresponding parameter copy;
3) end of operation, if necessary, is undertaken copying back raw parameter by copy variable after amendment.
Protection to parameter when the design that this extraction-> uses-> to write back can realize multimode concurrence performance to a certain extent, prevents multimode to the access conflict of same parameters.And cost is only Hash table and reads Value Operations.
Data backup/renewal:
Following steps can be used to realize backup and the upgrading of software by the present invention:
1) parametric data table is backed up: only parametric data table need be copied among corresponding backup file;
2) software upgrading: no matter code or data modification, only needs extraction backup file, and revise corresponding code and data value according to the logical offset in logical message table, generates upgrade file, writes back and covers parametric data table.
No matter visible employing the present invention upgrades or back up only need operate parametric data table region, and adopts the mode of upgrading/backup file to be extremely applicable to typical products in mass production upgrading and backup.
Specific embodiments of the invention 1: certain model Europe 3 standard diesel oil automobile ECU controller software
1) structural design/initialization:
After nascent structure design/initialization completes, analyze its operation parameter 9144, totally 4151, information index table, shows long 17KB, and message store table totally 9144, shows long 74KB, and parametric data table is 1.54MB altogether.
2) data are extracted:
During parameter extraction, hypothetical target parameter ID is 18036, and the corresponding address obtaining 18036 according to above-mentioned steps inquiry is 0x40018711, and it is 0xFFFE that query argument tables of data obtains this parameter value.By analysis, sampling process carries out modulo operation once altogether, comparison operation 1 time, interior access value 4 times.
3) data backup/renewal:
Demarcating (backup) file size is 2.2MB, common write parameters 9144, the write time totally 1 point 47 seconds.
Embodiment 2: certain model Europe 4 standard diesel oil automobile ECU controller software
1) structural design/initialization:
After nascent structure design/initialization completes, analyze its operation parameter 12486, totally 4547, information index table, shows long 19KB, and message store table totally 12486, shows long 100KB, and parametric data table is 3MB altogether.
2) data are extracted:
During parameter extraction, hypothetical target parameter ID is 39278, and it is 0x3FFF that query argument tables of data obtains this parameter value.By analysis, sampling process carries out modulo operation once altogether, comparison operation 2 times, interior access value 5 times.
3) data backup/renewal:
Demarcating (backup) file size is 3.2MB, common write parameters 12486, the write time totally 2 points 56 seconds.
Claims (7)
1. an industrial data organizing and implementing method in enormous quantities, is characterized in that: said method comprising the steps of:
1) logical organization of setting data;
2) physical arrangement of setting data; Described physical arrangement comprises information index table, message store table and parametric data table;
3), before system commencement of commercial operation, initialization is carried out to system data set;
4) system is taked to extract or protection to data; Backup or renewal rewards theory.
2. industrial data organizing and implementing method in enormous quantities according to claim 1, is characterized in that: in described step 1), the logical organization of data comprises the parameter ID of data, parameter name, data type, logical offset, span, functional description; All summary of parameters.An are formed a parameter logistics information table.
3. industrial data organizing and implementing method in enormous quantities according to claim 2, is characterized in that: described step 2) in information index table be an integer array, its array element saves as message store table index; Array index computing formula is: information index table subscript=parameter ID% information index table length.
4. industrial data organizing and implementing method in enormous quantities according to claim 2, is characterized in that: described step 2) in message store table be a structural array table; Each element comprises three content: parameter ID, parameter length, parameter physical address.Parameter physical address points to the address of parameter value in DSB data store block.
5. industrial data organizing and implementing method in enormous quantities according to claim 2, it is characterized in that: described step 2) in parametric data table be a slice continuous print storage block, what wherein store is the numerical value of parameter, comprise software code and other data values, the logical offset according to parameter stores successively in order.
6. according to the arbitrary described industrial data organizing and implementing method in enormous quantities of claim 2-5, it is characterized in that: in described step 3), system data set is carried out initialized concrete steps and is:
3.1) data acquisition: the initial value determining each data, initialization values is friction torque coefficient;
3.2) the logically order data acquisition set value pad parameter tables of data of parameter in information table;
3.3) parameter to be initiated is arranged from small to large according to ID, successively fill message concordance list and message store table.
7. industrial data organizing and implementing method in enormous quantities according to claim 6, is characterized in that: described step 3.3) concrete steps of fill message concordance list and message store table are:
3.3.1) parameter is taken out;
3.3.2) index value is obtained according to index value=parameter ID% parameter sum;
3.3.3) determining step 3.3.2) in index value whether fill in the corresponding position of concordance list, if so, then carry out step 3.3.4); If not, then the index value of corresponding position is filled in;
3.3.4) index value adds 1;
3.3.5) parameter storage list correspondence position is positioned to according to index value;
3.3.6) judge that the whether existing parameter of correspondence position is inserted, if so, then return step 3.3.4); The then corresponding position of pad parameter storage list if not.
3.3.7) after all parameters have been filled, step 3.3.1 has been returned).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310670073.7A CN104699721B (en) | 2013-12-10 | 2013-12-10 | A kind of high-volume industrial data organizes and implements method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310670073.7A CN104699721B (en) | 2013-12-10 | 2013-12-10 | A kind of high-volume industrial data organizes and implements method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104699721A true CN104699721A (en) | 2015-06-10 |
| CN104699721B CN104699721B (en) | 2018-07-03 |
Family
ID=53346853
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310670073.7A Active CN104699721B (en) | 2013-12-10 | 2013-12-10 | A kind of high-volume industrial data organizes and implements method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104699721B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111158796A (en) * | 2019-12-25 | 2020-05-15 | 中国航空工业集团公司西安飞机设计研究所 | Data processing method of hydraulic control software |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5742809A (en) * | 1990-08-31 | 1998-04-21 | Fujitsu Limited | Database generic composite structure processing system |
| CN1665237A (en) * | 2004-03-05 | 2005-09-07 | 华为技术有限公司 | A method for implementing intelligent network service |
| CN101212689A (en) * | 2006-12-25 | 2008-07-02 | 青岛海信电器股份有限公司 | Method for software upgrade for digital TV signal receiver |
| CN102609282A (en) * | 2012-01-19 | 2012-07-25 | 苏州希图视鼎微电子有限公司 | Execution method for NAND flash curing codes |
| CN102623066A (en) * | 2012-01-19 | 2012-08-01 | 苏州希图视鼎微电子有限公司 | Saving and acquisition method for solidification code parameter table |
-
2013
- 2013-12-10 CN CN201310670073.7A patent/CN104699721B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5742809A (en) * | 1990-08-31 | 1998-04-21 | Fujitsu Limited | Database generic composite structure processing system |
| CN1665237A (en) * | 2004-03-05 | 2005-09-07 | 华为技术有限公司 | A method for implementing intelligent network service |
| CN101212689A (en) * | 2006-12-25 | 2008-07-02 | 青岛海信电器股份有限公司 | Method for software upgrade for digital TV signal receiver |
| CN102609282A (en) * | 2012-01-19 | 2012-07-25 | 苏州希图视鼎微电子有限公司 | Execution method for NAND flash curing codes |
| CN102623066A (en) * | 2012-01-19 | 2012-08-01 | 苏州希图视鼎微电子有限公司 | Saving and acquisition method for solidification code parameter table |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111158796A (en) * | 2019-12-25 | 2020-05-15 | 中国航空工业集团公司西安飞机设计研究所 | Data processing method of hydraulic control software |
| CN111158796B (en) * | 2019-12-25 | 2023-05-23 | 中国航空工业集团公司西安飞机设计研究所 | Data processing method of hydraulic control software |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104699721B (en) | 2018-07-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11150891B2 (en) | Method and device for updating software executed from non-volatile memory | |
| CN109219813B (en) | Method, electronic device and computer readable medium for conversion of CAD descriptions | |
| CN103777969A (en) | Server parameter deploying method and device with no need for restarting | |
| WO2013085511A1 (en) | Techniques to prelink software to improve memory de-duplication in a virtual system | |
| CN102043719A (en) | Method for testing IEC61850 configuration description file | |
| CN104423894A (en) | Data storage device and flash memory control method thereof | |
| CN103530427A (en) | Dynamic switching method and device based on multiple databases | |
| US20190086908A1 (en) | Devices, methods, and systems for a distributed rule based automated fault detection | |
| CN105354071A (en) | Method for realizing compatibility between embedded software and hardware | |
| CN103645888B (en) | System and method for automatically building operation system | |
| CN105335792A (en) | Sparse matrix operation emission source model-based emission source list processing tool | |
| CN102999349A (en) | Software upgrading method | |
| CN105573913B (en) | Program debugging method and system in a kind of ONU systems | |
| CN104699721A (en) | Massive industrial data organization implementation method | |
| CN102841894A (en) | Data storage method of file allocation table | |
| CN1258140C (en) | Device and method for updating flash memory contents | |
| JP2023531701A (en) | Efficient controller data generation and extraction | |
| CN102945343A (en) | Method and device for enumerating system process | |
| CN102981868A (en) | Method of achieving virtual machine batch deployment by utilizing cloud computing | |
| Schmidgall | Automotive embedded systems software reprogramming | |
| CN103809915A (en) | Read-write method and device of magnetic disk files | |
| CN103176990A (en) | Spatial data storage and spatial data storage reading method and spatial data storage reading system | |
| CN104133726A (en) | Process context mandatory access control method | |
| CN103729233A (en) | Multiple virtual machines management method and device | |
| CN104035791A (en) | Methods for starting and stopping application program and intelligent terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |