CN111966868A - Data management method based on identification analysis and related equipment - Google Patents
Data management method based on identification analysis and related equipment Download PDFInfo
- Publication number
- CN111966868A CN111966868A CN202010926403.4A CN202010926403A CN111966868A CN 111966868 A CN111966868 A CN 111966868A CN 202010926403 A CN202010926403 A CN 202010926403A CN 111966868 A CN111966868 A CN 111966868A
- Authority
- CN
- China
- Prior art keywords
- identification
- data
- template
- identifier
- registration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/103—Formatting, i.e. changing of presentation of documents
- G06F40/117—Tagging; Marking up; Designating a block; Setting of attributes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/177—Editing, e.g. inserting or deleting of tables; using ruled lines
- G06F40/18—Editing, e.g. inserting or deleting of tables; using ruled lines of spreadsheets
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the technical field of data processing, and discloses a data management method based on identification analysis and related equipment, wherein the method comprises the steps of screening data collected from various service systems, storing the data on a middle platform, extracting an industry identification of data to be managed, calling a corresponding data identification template from an identification analysis platform based on the industry identification, carrying out identification conversion on the data to be managed based on the template to obtain identification structure data, and finally uniformly storing the identification structure data in the identification analysis platform, wherein different service systems can acquire the structural data to be used by distinguishing and acquiring different types of data by registering the data identification template on the identification analysis platform when acquiring the data, thereby realizing the acquisition and management of large-scale industrial large data and making up that the industrial large data can only acquire internal information system data at present, the problem that industrial data cannot be acquired is solved, and data acquisition spanning different systems is realized.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a data management method based on identification analysis and related equipment.
Background
With the development of intelligence science, big data analysis becomes a demand, and information and knowledge hidden in mass data are mined out through big data analysis, so that the operation efficiency of each field is improved, and the intensification degree of the whole social economy is greatly improved.
In the existing industrial big data analysis scheme, the data is mainly acquired through a sensor, such as the running state and the environmental index of machine equipment, data in software inside an enterprise and information related to the enterprise on the internet, which are captured by software, and then the acquired data is cleaned, formatted, filtered and dirty data and the like. In the process of data acquisition, only acquisition can be carried out from the enterprise or a local business system, and for a cross-domain system, certain non-business type data related to the enterprise can be crawled on the internet in a crawler mode.
Disclosure of Invention
The invention mainly aims to solve the technical problem that the existing big data acquisition and analysis is difficult to realize acquisition across different systems.
The invention provides a data management method based on identification analysis in a first aspect, which comprises the following steps:
acquiring data on each service system, screening each data, eliminating unreasonable data in the data to obtain data to be treated, and sending the data to a preset middle station for storage;
analyzing the industry identification corresponding to each data to be treated;
inquiring a corresponding data identification template from an identification analysis platform according to the industry identification, wherein the data identification template is used for carrying out identification registration on each service system on the identification analysis platform based on the industry identification where the service system is located to obtain a data storage template;
and extracting the content in the data to be treated based on the field information set in the data identification template, storing the extracted content in the data identification template to obtain identification structure data, and storing the identification structure data in the identification analysis platform.
Optionally, in a first implementation manner of the first aspect of the present invention, before querying, according to the industry identifier, a corresponding data identification template from an identifier parsing platform, the method further includes:
acquiring identity information of the service system, and identifying whether a registration identifier exists in the identity information, wherein the registration identifier is an identity mark issued by the service system after successful identifier registration in the identifier analysis platform;
if the registration identification exists in the identity information, performing identification processing and storage on the data to be treated;
and if the registration identification exists in the identity information, selecting a corresponding data template from the identification analysis platform according to the industry identification, inputting identification data based on the data template, and performing identification registration on the service system.
Optionally, in a second implementation manner of the first aspect of the present invention, the selecting a corresponding data template from the identifier parsing platform according to the industry identifier, entering identifier data based on the data template, and performing identifier registration on the service system includes:
according to the industry identification, a data template of a similar identification is inquired from the identification analysis platform;
calling an identification registration form and extracting a main body sub-table in the registration form;
analyzing the parameter requirement of each identification field in the main body sub-table, extracting corresponding information from the identification data based on the parameter requirement, and filling the information into the main body sub-table one by one, wherein the identification data at least comprises an identification name, relevant information of a service system, an identification attribute, a reserved index, an identification attribute index, identification attribute content, an identification attribute content format, an identification attribute content value and an identification attribute type;
generating an identification registration execution example by combining the header file of the identification registration form according to the filled main body sub-form;
and operating the identifier registration execution example, adding the service system corresponding to the industry identifier into the identifier analysis platform, generating a corresponding data storage template, and issuing the data storage template.
Optionally, in a third implementation manner of the first aspect of the present invention, the querying, according to the industry identifier, a corresponding data identification template from an identifier parsing platform includes:
generating a request parameter of a query template according to the industry identification and the identity mark of the service system;
and calling a GET request function, and inquiring a corresponding data identification template in the identification analysis platform by taking the request parameter as an inquiry parameter.
Optionally, in a fourth implementation manner of the first aspect of the present invention, the generating a request parameter of a query template according to the industry identifier and the identity of the business system includes:
acquiring an identity mark of the service system, and constructing a header of a request based on the identity mark, wherein the header is a character string formed by sequentially connecting a Bearer, a blank character and the identity mark in series;
determining a corresponding registration identifier based on the industry identifier;
and generating request parameters based on the registration identification and the header.
Optionally, in a fifth implementation manner of the first aspect of the present invention, after the extracting content from the data to be managed based on the field information set in the data identification template, storing the extracted content in the data identification template to obtain identification structure data, and storing the identification structure data in the identification analysis platform, the method further includes:
detecting whether an identification updating request exists;
if the identifier exists, establishing an updating parameter according to the identifier updating request, and calling an identifier registration form to enter identifier updating data;
and querying a data identification template which is updated by the identification updating request in the identification analysis platform by using a PUT function, and updating the data identification template by using the updating parameters and the identification registration table in which the identification updating data is input as response data.
Optionally, in a sixth implementation manner of the first aspect of the present invention, the data governance method based on identifier resolution further includes:
acquiring the last called time of each data identification template in the identification analysis platform;
calculating the time interval between the called time and the current time;
and if the time is larger than a preset threshold value, calling a deletion function to delete the data identification template from the identification analysis platform.
The second aspect of the present invention provides a data management device based on identifier resolution, where the data management device based on identifier resolution includes:
the screening module is used for acquiring data on each service system, screening each data, eliminating unreasonable data in the data to obtain data to be treated, and sending the data to a preset middle station for storage;
the analysis module is used for analyzing the industry identification corresponding to each data to be treated;
the query module is used for querying a corresponding data identification template from the identification analysis platform according to the industry identification, wherein the data identification template is used for carrying out identification registration on each business system on the identification analysis platform based on the industry identification where the business system is located to obtain a data storage template;
and the conversion module is used for extracting the content in the data to be treated based on the field information set in the data identification template, storing the extracted content in the data identification template to obtain identification structure data and storing the identification structure data in the identification analysis platform.
Optionally, in a first implementation manner of the second aspect of the present invention, the data governance device based on identifier resolution further includes a registration module, which is specifically configured to:
acquiring identity information of the service system, and identifying whether a registration identifier exists in the identity information, wherein the registration identifier is an identity mark issued by the service system after successful identifier registration in the identifier analysis platform;
if the registration identification exists in the identity information, performing identification processing and storage on the data to be treated;
and if the registration identification exists in the identity information, selecting a corresponding data template from the identification analysis platform according to the industry identification, inputting identification data based on the data template, and performing identification registration on the service system.
Optionally, in a second implementation manner of the second aspect of the present invention, the registration module is specifically configured to:
according to the industry identification, a data template of a similar identification is inquired from the identification analysis platform;
calling an identification registration form and extracting a main body sub-table in the registration form;
analyzing the parameter requirement of each identification field in the main body sub-table, extracting corresponding information from the identification data based on the parameter requirement, and filling the information into the main body sub-table one by one, wherein the identification data at least comprises an identification name, relevant information of a service system, an identification attribute, a reserved index, an identification attribute index, identification attribute content, an identification attribute content format, an identification attribute content value and an identification attribute type;
generating an identification registration execution example by combining the header file of the identification registration form according to the filled main body sub-form;
and operating the identifier registration execution example, adding the service system corresponding to the industry identifier into the identifier analysis platform, generating a corresponding data storage template, and issuing the data storage template.
Optionally, in a third implementation manner of the second aspect of the present invention, the query module includes:
the parameter generating unit is used for generating a request parameter of the query template according to the industry identification and the identity mark of the service system;
and the query unit is used for calling a GET request function, taking the request parameter as a query parameter and querying the corresponding data identification template in the identification analysis platform.
Optionally, in a fourth implementation manner of the second aspect of the present invention, the parameter generating unit is specifically configured to:
acquiring an identity mark of the service system, and constructing a header of a request based on the identity mark, wherein the header is a character string formed by sequentially connecting a Bearer, a blank character and the identity mark in series;
determining a corresponding registration identifier based on the industry identifier;
and generating request parameters based on the registration identification and the header.
Optionally, in a fifth implementation manner of the second aspect of the present invention, the data governance device based on identifier resolution further includes an update module, which is specifically configured to:
detecting whether an identification updating request exists;
if the identifier exists, establishing an updating parameter according to the identifier updating request, and calling an identifier registration form to enter identifier updating data;
and querying a data identification template which is updated by the identification updating request in the identification analysis platform by using a PUT function, and updating the data identification template by using the updating parameters and the identification registration table in which the identification updating data is input as response data.
Optionally, in a sixth implementation manner of the second aspect of the present invention, the data governance device based on identifier resolution further includes a deletion module, which is specifically configured to:
acquiring the last called time of each data identification template in the identification analysis platform;
calculating the time interval between the called time and the current time;
and if the time is larger than a preset threshold value, calling a deletion function to delete the data identification template from the identification analysis platform.
The third aspect of the present invention provides a data governance device based on identifier resolution, including: a memory having instructions stored therein and at least one processor, the memory and the at least one processor interconnected by a line; the at least one processor invokes the instructions in the memory to cause the identity resolution based data governance device to perform the identity resolution based data governance method described above.
A fourth aspect of the present invention provides a computer-readable storage medium, which stores instructions that, when executed on a computer, cause the computer to execute the above-mentioned data governance method based on identity resolution.
In the technical scheme provided by the invention, data acquired from each service system are screened and then stored on a middle platform, then the corresponding data identification template is called from an identification analysis platform based on the industry identification from the industry identification for extracting the data to be managed, the data to be managed is subjected to identification conversion based on the template to obtain identification structure data, and finally the identification structure data are uniformly stored in the identification analysis platform. In the embodiment of the invention, because different business systems register the data identification templates on the identification analysis platform, the structured data required to be used can be obtained by distinguishing and obtaining different types of data when the data is obtained, thereby realizing the acquisition and management of large-scale industrial data, solving the problems that the industrial data can only obtain the data of an internal information system, cannot obtain the industrial data and cannot accurately predict at present, and realizing the data acquisition spanning different systems.
Drawings
FIG. 1 is a flow chart of an embodiment of a data governance method based on identity resolution in an embodiment of the present invention;
FIG. 2 is a flowchart of a data governance method based on identity resolution according to a second embodiment of the present invention;
FIG. 3 is a flowchart of a data governance method based on identity resolution according to a third embodiment of the present invention;
FIG. 4 is a flowchart illustrating the invocation of a data identification template according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of an embodiment of a data governance device based on identity resolution in an embodiment of the present invention;
FIG. 6 is a schematic diagram of another embodiment of a data governance device based on identity resolution in an embodiment of the present invention;
FIG. 7 is a schematic diagram of an embodiment of a data governance device based on identity resolution in an embodiment of the present invention;
fig. 8 is a schematic diagram of another embodiment of a communication system based on an identity resolution platform in the embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a data management method, a device, equipment and a storage medium based on identification analysis, wherein a data storage template is provided through an identification analysis platform, so that unified structural processing of data of different service systems is realized, data among different domains are stored on the same platform, and the data can be directly read from the platform when large data analysis is subsequently performed, so that the problem that the data cannot be acquired across the system in the prior art is solved, the data storage format is unified, the data screening and cleaning operation is greatly simplified through an identification conversion mode of the template, and the data processing efficiency is improved.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," or "having," and any variations thereof, are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For convenience of understanding, a specific flow of the embodiment of the present invention is described below, and referring to fig. 1, an embodiment of the data governance method based on identifier resolution in the embodiment of the present invention includes:
101. acquiring data on each service system, screening each data, eliminating unreasonable data in the data to obtain data to be treated, and sending the data to a preset middle station for storage;
it is to be understood that the execution subject of the present invention may be a data governance device based on identifier resolution, and may also be a terminal or a server, which is not limited herein. The embodiment of the present invention is described by taking a server as an execution subject.
In the step, the data acquisition is specifically realized by independently setting and acquiring data with a sensor on a business system, or by acquiring software, specifically acquiring equipment running state information and environmental indexes on the system, and business data in an enterprise, and further acquiring related data of the enterprise on the internet.
In practical application, the data can be acquired through a data acquisition interface on the identification analysis platform, specifically, the platform interface is connected with business systems of enterprises in different regions through the internet, the data on the business systems are regularly crawled based on a crawler tool, and the crawled data are screened, wherein the screening can be understood as the cleaning processing of the data.
In this embodiment, data washing is performed on data acquired from a sensor, for example, for a vibration signal acquisition sensor, the sensor can acquire the vibration amplitude of the equipment in an operating state, and the acquired data is cut into segments every 5 seconds. And comparing the obtained value with the past average value, temporarily storing the data if the deviation of the value is too large to exceed fifty percent, and uniformly identifying the temporarily stored data when the vibration amplitude is increased continuously and the time exceeds 1 minute. Otherwise, the temporarily stored data is discarded.
102. Analyzing the industry identification corresponding to each data to be treated;
in this embodiment, data generated by different business systems may have specific symbolic information, the symbolic information of the data is extracted as an industry identifier of the data, in practical application, the industry identifier of each data to be managed is determined based on a corresponding relationship between the data structure and the industry identifier by analyzing the data structure of the data, and a corresponding data identification template is selected from an identifier parsing platform based on the industry identifier.
103. Inquiring a corresponding data identification template from an identification analysis platform according to the industry identification;
the data identification template is used for carrying out identification registration on each service system on the identification analysis platform based on the industry identification of each service system to obtain a data storage template;
in the step, request parameters of a query template are generated specifically according to the industry identification and the identity mark of the business system; and calling a GET request function, and inquiring a corresponding data identification template in the identification analysis platform by taking the request parameter as an inquiry parameter.
In this embodiment, the data identification template is obtained by registering a user or an enterprise on the platform in advance, after the registration is completed, a corresponding relationship table of the industry identifier and the data identification template is established on the platform, and based on the corresponding relationship table, when data storage is required, the corresponding template can be directly queried according to the industry identifier to perform identification conversion on the data.
In practical application, the query process further includes obtaining an identity mark of a corresponding service system, if the identity mark is obtained, querying whether a corresponding industry mark exists in the mark analysis platform, if the industry mark exists, querying a corresponding data identification template according to the industry mark, and if the industry mark does not exist, registering the industry mark.
In this embodiment, when registering the identifier, the registration of the user name and the account is also included, the registration is mainly based on the interface, and the registration of the enterprise on the identifier analysis platform is realized through the registration of the interface, and the registration of the identifier is also realized at the same time.
104. And extracting the content in the data to be treated based on the field information set in the data identification template, storing the extracted content in the data identification template to obtain identification structure data, and storing the identification structure data in an identification analysis platform.
In this embodiment, after the data identification template is determined, field information including an identification name, an identification type, an identification attribute, an attribute of identification content, and the like is set in the template. Based on the field information, extracting corresponding data from the data to be treated by using a big data screening algorithm, and then filling the data into a template, thereby realizing the identification conversion of the data to be treated and obtaining the identification structure data.
In practical application, when the identification structure data is stored in the identification analysis platform, the identification data is uploaded in a manner of calling a RESTful interface. Further, in the subsequent data analysis process, when a data reading request is received, the service system or the central station transfers the identification parameters by calling the RESTful interface to obtain the corresponding data from the identification analysis platform.
In the embodiment of the invention, after the data to be managed collected from each service system is screened and processed, the data to be managed is stored through a middle station, then the industry identification of the data to be managed is extracted, the corresponding template is called from the identification analysis platform which is pre-registered with the data identification templates of different service systems based on the industry identification for data identification conversion, and the identification structure data with a uniform storage format is obtained.
Referring to fig. 2, another embodiment of the data governance method based on identifier resolution in the embodiment of the present invention includes:
201. acquiring data on each service system, screening each data, eliminating unreasonable data in the data to obtain data to be treated, and sending the data to a preset middle station for storage;
202. analyzing the industry identification corresponding to each data to be treated;
203. acquiring identity information of a service system, and identifying whether a registration identifier exists in the identity information;
in this step, the registration mark is an identity mark issued by the service system after successful mark registration in the mark resolution platform;
in this embodiment, the identity information is specifically an account and a password used by a user or an enterprise when logging in an interface of an identifier resolution platform, and whether a business system corresponding to the current data to be managed is a registered account of the identifier resolution platform is determined based on verification of the account and the password, if yes, it is determined that a registered identifier exists in the identity information, and a corresponding registered identifier is extracted from the identity information; in practical applications, the registration identifier may be specifically represented by a password of an account.
204. If the registration identification exists in the identity information, inquiring a corresponding data identification template from the identification analysis platform according to the industry identification;
in the step, the information is simultaneously inquired in the identification analysis platform based on the registration identification and the industry identification
205. Extracting contents in data to be treated based on field information set in a data identification template, storing the extracted contents in the data identification template to obtain identification structure data, and storing the identification structure data in an identification analysis platform;
in this step, when extracting field information, specifically, the field information in the template is extracted by a flag identification extraction method, for example, a word recognition technology is used to traverse a "fill-necessary" flag in the data identification template, and based on the flag, the table content is traced forward to extract the corresponding field information, optionally, the field name and the attribute value corresponding to the field in the field information are extracted.
206. And if the registration identification exists in the identity information, selecting a corresponding data template from the identification analysis platform according to the industry identification, inputting identification data based on the data template, and performing identification registration on the service system.
In this embodiment, when registering an identifier according to an industry identifier, the following is specifically implemented:
according to the industry identification, a data template of a similar identification is inquired from the identification analysis platform;
calling an identification registration form and extracting a main body sub-table in the registration form;
analyzing the parameter requirement of each identification field in the main body sub-table, extracting corresponding information from the identification data based on the parameter requirement, and filling the information into the main body sub-table one by one, wherein the identification data at least comprises an identification name, relevant information of a service system, an identification attribute, a reserved index, an identification attribute index, identification attribute content, an identification attribute content format, an identification attribute content value and an identification attribute type;
generating an identification registration execution example by combining the header file of the identification registration form according to the filled main body sub-form;
and operating the identifier registration execution example, adding the service system corresponding to the industry identifier into the identifier analysis platform, generating a corresponding data storage template, and issuing the data storage template.
In practical application, the registration process may be specifically implemented by sending a request:
firstly, determining a request mode, wherein optionally, a POST mode in an HTTP communication protocol is selected to construct a request for registering an identifier;
then, according to a connection interface between the service system and the identification analysis platform, obtaining a request path, such as/identityv 2/data, based on the ID of the connection interface;
further, parameters of the registration request are set according to the industry identifier, and specifically when the parameters of the registration request are set, the parameters include a header and registration main body information, wherein the header includes a character string in which Bearer, a blank character and an identity mark are sequentially connected in series, and the specific table is as follows:
| type of parameter | Parameter name | Description of the parameters | Remarks for note |
| String | Authorization | Bearer + space + token | Must fill in |
| String | Content-Type | application/json | Must fill in |
And determining a corresponding operator according to the account number and the password information, generating corresponding field contents according to the field information in the following table based on the operator and the password information, filling the field contents in the field contents, and converting the field contents into an execution example.
For the main content that the registration main body information should be understood as the time identification, the setting of the main body information is mainly specified and generated through a main body sub-table in the registration table, and at least the following fields are set in the main body sub-table: the field configuration of the main body sub-table is specifically as shown in the following table:
the registration executions are generated by configuring the fields in the table and then combining the headers as described above.
And operating the execution example, and registering the service system corresponding to the industry identifier on the identifier analysis platform.
In practical applications, when setting fields in the body sub-table, the identification attribute index, i.e., value [ i ]. index, should be set to a reserved index field value that cannot be 1001.
The identify attribute content format, value [ i ] format, temporarily supports only string.
The interface will restrict the registration data according to the metadata template defined by the templateVersion acquisition.
In this embodiment, the registration process of the identifier specifically includes registration of a single identifier and registration of multiple identifiers, where registration of a single identifier may be implemented according to the above-mentioned process, and in the process of implementing registration of multiple identifiers, in addition to completing filling of the registration form of each identifier in the above-mentioned manner, it is also necessary to convert each filled registration form into an execution instance and store it in a corresponding position in a request path, then all execution instances are executed in series through a batch request response parameter, after each execution of one execution instance, it is necessary to determine whether each executed registration is successful, if successful, it jumps to the next execution instance to continue registration, if unsuccessful, re-execute the corresponding execution instance or re-execute a corresponding execution instance with a re-execution flag, after all execution instances are completed, the execution example of the returned scheduling flag is re-executed, and the response parameter setting is specifically shown in the following table:
| message | String | status code description |
| data | Boolean | Whether the operation is successful or not |
| status | Int | Status code |
| message | String | Status code description |
| data | Array | Whether the operation is successful or not |
| data[i].msg | String | |
| data[i].handle | String |
In the embodiment of the invention, the data is identified by acquiring the data identification template from the identification analysis platform through each service system, and the data is registered to the identification analysis platform of the industrial Internet. Communication between applications is carried out in a mode of acquiring owner data from the identification analysis platform, so that data acquisition of cross-system pieces is realized, customized development of software merchants is avoided, and the coupling degree of the system is reduced; the identification analysis platform is uniformly registered and uniformly provides a data storage template, so that data cleaning is uniformly operated, the complexity of data processing is simplified, and the identification analysis platform is high in available cluster to ensure high availability.
Referring to fig. 3, another embodiment of the data governance method based on identifier resolution in the embodiment of the present invention includes:
301. acquiring data on each service system, screening each data, eliminating unreasonable data in the data to obtain data to be treated, and sending the data to a preset middle station for storage;
302. analyzing the industry identification corresponding to each data to be treated;
303. acquiring an identity mark of a service system, and constructing a header of a request based on the identity mark;
wherein, the header is a character string formed by sequentially connecting Bearer, blank characters and identity marks in series;
304. determining a corresponding registration identifier based on the industry identifier;
305. generating a request parameter based on the registration identifier and the header;
306. calling a GET request function, using the request parameter as a query parameter, and querying a corresponding data identification template in an identification analysis platform;
307. and extracting the content in the data to be treated based on the field information set in the data identification template, storing the extracted content in the data identification template to obtain identification structure data, and storing the identification structure data in an identification analysis platform.
In this embodiment, querying a corresponding template from the identifier parsing platform according to the industry identifier, performing identifier transformation on data based on the template, and querying the identifier may specifically be implemented by sending a request:
firstly, determining a request mode, and optionally selecting a GET mode in an HTTP (hyper text transport protocol) communication protocol to construct a query request for registering an identifier;
then, according to a connection interface between the service system and the identification analysis platform, obtaining a request path such as/identityv 2/data/detail based on the ID of the connection interface;
further, parameters of the query request are set according to the industry identifier, and specifically when the parameters of the request are set, the parameters include a header and specific parameters, wherein the header includes a character string in which Bearer, a blank character and an identity mark are sequentially connected in series, and the specific table is as follows:
| type of parameter | Parameter name | Description of the parameters | Remarks for note |
| String | Authorization | Bearer + space + token | Must fill in |
| String | Content-Type | application/json | Must fill in |
And determining a corresponding operator according to the account number and the password information, generating corresponding field contents according to the field information in the following table based on the operator and the password information, filling the field contents in the field contents, and converting the field contents into an execution example.
When setting specific parameters, the query name of the identifier and the identifier field of the query are mainly set, which is specifically shown in the following table:
| type of parameter | Parameter name | Description of the parameters | Remarks for note |
| String | handle | Identification to be queried | Must fill in |
Generating a response table based on the main body sub-table and the response parameter configuration, and generating an execution example based on the response table, wherein the response table is as follows:
in this embodiment, the identifier may be registered based on the above steps, and in addition, when the registered identifier needs to be updated or deleted, the identifier needs to be updated or deleted by requesting an update or delete function, specifically:
detecting whether an identification updating request exists;
if the identifier exists, establishing an updating parameter according to the identifier updating request, and calling an identifier registration form to enter identifier updating data;
and querying a data identification template which is updated by the identification updating request in the identification analysis platform by using a PUT function, and updating the data identification template by using the updating parameters and the identification registration table in which the identification updating data is input as response data.
Further, in the method, when the template in the identifier resolution platform is updated or called each time, real-time calling time is recorded, and it is determined based on the calling time that deletion or update is required, specifically:
acquiring the last called time of each data identification template in the identification analysis platform;
calculating the time interval between the called time and the current time;
and if the time is larger than a preset threshold value, calling a deletion function to delete the data identification template from the identification analysis platform.
Through the implementation of the method, different business systems register the data identification templates on the identification analysis platform, and the structured data to be used can be obtained by distinguishing and obtaining different types of data when the data are obtained, so that the large-scale industrial data acquisition and management are realized, the problems that the industrial data can only obtain the data of an internal information system at present, the industrial data cannot be obtained, and the accurate prediction cannot be carried out are solved, and the data acquisition spanning different systems is realized.
The method provided by the present application is described in detail from a specific application point of view, as shown in fig. 4, it is described with a communication system based on a plurality of service systems and an identifier resolution platform, as shown in fig. 8, each service system in the communication system registers contents such as service master data and material master data to an identifier resolution service platform. And other applications acquire contents such as service main data, material main data and the like according to the identification from the identification analysis platform.
The applications in the enterprise are carried out in an identification mode, for example, material and product inventory data and warehouse entry and exit records of the WMS system need to be written into the ERP system. The WMS system registers material data, inventory data and in-out-of-inventory record identifiers to the identifier analysis platform. The ERP system acquires data content registered by the WMS system from the identification analysis platform, updates data in the ERP system, and calls a data identification template according to the following steps:
401. acquiring a data storage request of a service system;
in this step, the data storage request includes a service request and an account and a password token of the enterprise connected to the identifier resolution platform through the service system.
402. Judging whether a token exists in the request;
403. if yes, inquiring whether a corresponding industry identifier exists in the identifier analysis platform;
404. if the corresponding industry identification exists, inquiring a corresponding data identification template;
in this step, the query includes a direct query and an indirect query, where the direct query is that the current business system of the enterprise has registered on the identifier resolution platform, and the identifier is extracted from the data to query a corresponding template from the identifier resolution platform, and perform identifier conversion of the data based on the template.
And indirect query means that no template corresponding to the identifier of the data exists on the identifier resolution platform, but a similar template exists, and the data can be subjected to identifier conversion by creating the template through a template registration process.
405. Converting the data according to the data identification template according to the data storage request to obtain structured data, and storing the structured data in an identification analysis platform;
in this embodiment, before the conversion, the method further includes updating and saving the data template, that is, determining whether an update instruction exists in the request, and if so, selecting corresponding update content according to the update instruction, where the update content includes an identifier update and a template update.
406. If the token does not exist, acquiring the identification data of the service system;
in this step, the identification data is specifically that a rule of a content storage field of data is analyzed from the data to be treated, an identification field is generated based on the rule, and the identification field is used as a registration identification.
407. Selecting a template from the identification analysis platform according to the identification data, and inputting the identification data;
408. verifying the template after the identification data is input;
409. and if the verification is passed, storing the identifier into an identifier analysis platform.
In this embodiment, when registering the identifier, the method further includes acquiring related data of the service corresponding to the service system, filling the related data in the main body sub-table, and registering the identifier based on the main body sub-table.
In summary, after the data to be managed collected from each business system is screened and processed, the data to be managed is stored through the middle desk, then the industry identification of the data to be managed is extracted, the corresponding template is called from the identification analysis platform in which the data identification templates of different business systems are registered in advance based on the industry identification for data identification conversion, and the identification structure data with a unified storage format is obtained.
In the above description of the data governance method based on identifier resolution in the embodiment of the present invention, the following description of the data governance device based on identifier resolution in the embodiment of the present invention refers to fig. 5, and an embodiment of the data governance device based on identifier resolution in the embodiment of the present invention includes:
the screening module 501 is configured to acquire data on each service system, screen each data, remove unreasonable data therein, obtain data to be managed, and send the data to a preset middle station for storage;
an analyzing module 502, configured to analyze an industry identifier corresponding to each piece of data to be treated;
the query module 503 is configured to query a corresponding data identification template from the identification analysis platform according to the industry identifier, where the data identification template is used for performing identification registration on the identification analysis platform based on the industry identifier of each business system, so as to obtain a data storage template;
a conversion module 504, configured to extract content in the data to be treated based on field information set in the data identification template, store the extracted content in the data identification template, obtain identification structure data, and store the identification structure data in the identification analysis platform.
In the embodiment of the invention, data collected from each service system are screened and then stored on a middle platform, then the industry identification of the data to be treated is extracted, a corresponding data identification template is called from an identification analysis platform based on the industry identification, identification conversion is carried out on the data to be treated based on the template to obtain identification structure data, and finally the identification structure data are uniformly stored in the identification analysis platform. In the embodiment of the invention, because different business systems register the data identification templates on the identification analysis platform, the structured data required to be used can be obtained by distinguishing and obtaining different types of data when the data is obtained, thereby realizing the acquisition and management of large-scale industrial data, solving the problems that the industrial data can only obtain the data of an internal information system, cannot obtain the industrial data and cannot accurately predict at present, and realizing the data acquisition spanning different systems.
Referring to fig. 6, another embodiment of the data governance device based on identifier resolution in the embodiment of the present invention includes:
the screening module 501 is configured to acquire data on each service system, screen each data, remove unreasonable data therein, obtain data to be managed, and send the data to a preset middle station for storage;
an analyzing module 502, configured to analyze an industry identifier corresponding to each piece of data to be treated;
the query module 503 is configured to query a corresponding data identification template from the identification analysis platform according to the industry identifier, where the data identification template is used for performing identification registration on the identification analysis platform based on the industry identifier of each business system, so as to obtain a data storage template;
a conversion module 504, configured to extract content in the data to be treated based on field information set in the data identification template, store the extracted content in the data identification template, obtain identification structure data, and store the identification structure data in the identification analysis platform.
In this embodiment, the data governance device based on identifier parsing further includes a registration module 505, which is specifically configured to:
acquiring identity information of the service system, and identifying whether a registration identifier exists in the identity information, wherein the registration identifier is an identity mark issued by the service system after successful identifier registration in the identifier analysis platform;
if the registration identification exists in the identity information, performing identification processing and storage on the data to be treated;
and if the registration identification exists in the identity information, selecting a corresponding data template from the identification analysis platform according to the industry identification, inputting identification data based on the data template, and performing identification registration on the service system.
Optionally, the registration module 505 is specifically configured to:
according to the industry identification, a data template of a similar identification is inquired from the identification analysis platform;
calling an identification registration form and extracting a main body sub-table in the registration form;
analyzing the parameter requirement of each identification field in the main body sub-table, extracting corresponding information from the identification data based on the parameter requirement, and filling the information into the main body sub-table one by one, wherein the identification data at least comprises an identification name, relevant information of a service system, an identification attribute, a reserved index, an identification attribute index, identification attribute content, an identification attribute content format, an identification attribute content value and an identification attribute type;
generating an identification registration execution example by combining the header file of the identification registration form according to the filled main body sub-form;
and operating the identifier registration execution example, adding the service system corresponding to the industry identifier into the identifier analysis platform, generating a corresponding data storage template, and issuing the data storage template.
In this embodiment, the query module 503 includes:
a parameter generating unit 5031, configured to generate a request parameter of the query template according to the industry identifier and the identity of the service system;
a query unit 5032, configured to invoke a GET request function, and query the corresponding data identification template in the identification resolution platform by using the request parameter as a query parameter.
Optionally, the parameter generating unit 5031 is specifically configured to:
acquiring an identity mark of the service system, and constructing a header of a request based on the identity mark, wherein the header is a character string formed by sequentially connecting a Bearer, a blank character and the identity mark in series;
determining a corresponding registration identifier based on the industry identifier;
and generating request parameters based on the registration identification and the header.
In this embodiment, the data governance device based on identifier parsing further includes an update module 506, which is specifically configured to:
detecting whether an identification updating request exists;
if the identifier exists, establishing an updating parameter according to the identifier updating request, and calling an identifier registration form to enter identifier updating data;
and querying a data identification template which is updated by the identification updating request in the identification analysis platform by using a PUT function, and updating the data identification template by using the updating parameters and the identification registration table in which the identification updating data is input as response data.
In this embodiment, the data governance device based on identifier parsing further includes a deleting module 507, which is specifically configured to:
acquiring the last called time of each data identification template in the identification analysis platform;
calculating the time interval between the called time and the current time;
and if the time is larger than a preset threshold value, calling a deletion function to delete the data identification template from the identification analysis platform.
In the embodiment of the invention, the data is identified by acquiring the data identification template from the identification analysis platform through each service system, and the data is registered to the identification analysis platform of the industrial Internet. Communication between applications is carried out in a mode of acquiring owner data from the identification analysis platform, so that data acquisition of cross-system pieces is realized, customized development of software merchants is avoided, and the coupling degree of the system is reduced; the identification analysis platform is uniformly registered and uniformly provides a data storage template, so that data cleaning is uniformly operated, the complexity of data processing is simplified, and the identification analysis platform is high in available cluster to ensure high availability.
Fig. 5 and fig. 6 describe the data governance device based on identifier resolution in the embodiment of the present invention in detail from the perspective of the modular functional entity, and the data governance device based on identifier resolution in the embodiment of the present invention is described in detail from the perspective of hardware processing.
FIG. 7 is a schematic diagram of a data governance device based on identity resolution according to an embodiment of the present invention, where the data governance device 700 based on identity resolution may have a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 710 (e.g., one or more processors) and a memory 720, one or more storage media 730 (e.g., one or more mass storage devices) for storing applications 733 or data 732. Memory 720 and storage media 530 may be, among other things, transient or persistent storage. The program stored on storage medium 730 may include one or more modules (not shown), each of which may include a series of instructions operating on data governance device 700 based on identification resolution. Still further, processor 710 may be configured to communicate with storage medium 730 to perform a series of instructional operations on data governance device 700 based on the identity resolution in storage medium 730.
The invention also provides data governance equipment based on identification analysis, which comprises a memory and a processor, wherein computer readable instructions are stored in the memory, and when being executed by the processor, the computer readable instructions cause the processor to execute the steps of the data governance method based on identification analysis in the embodiments.
The invention also provides a computer readable storage medium, which may be a non-volatile computer readable storage medium, or a volatile computer readable storage medium, and the computer readable storage medium has stored therein instructions, which when run on a computer, cause the computer to execute the steps of the data governance method based on identity resolution.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A data governance method based on identification analysis is characterized by comprising the following steps:
acquiring data on each service system, screening each data, eliminating unreasonable data in the data to obtain data to be treated, and sending the data to a preset middle station for storage;
analyzing the industry identification corresponding to each data to be treated;
inquiring a corresponding data identification template from an identification analysis platform according to the industry identification, wherein the data identification template is used for carrying out identification registration on each service system on the identification analysis platform based on the industry identification where the service system is located to obtain a data storage template;
and extracting the content in the data to be treated based on the field information set in the data identification template, storing the extracted content in the data identification template to obtain identification structure data, and storing the identification structure data in the identification analysis platform.
2. The identification resolution-based data governance method according to claim 1, wherein before querying a corresponding data identification template from an identification resolution platform according to the industry identification, further comprising:
acquiring identity information of the service system, and identifying whether a registration identifier exists in the identity information, wherein the registration identifier is an identity mark issued by the service system after successful identifier registration in the identifier analysis platform;
if the registration identification exists in the identity information, performing identification processing and storage on the data to be treated;
and if the registration identification exists in the identity information, selecting a corresponding data template from the identification analysis platform according to the industry identification, inputting identification data based on the data template, and performing identification registration on the service system.
3. The identification resolution-based data governance method according to claim 2, wherein the selecting a corresponding data template from the identification resolution platform according to the industry identification, entering identification data based on the data template, and performing identification registration on the business system comprises:
according to the industry identification, a data template of a similar identification is inquired from the identification analysis platform;
calling an identification registration form and extracting a main body sub-table in the registration form;
analyzing the parameter requirement of each identification field in the main body sub-table, extracting corresponding information from the identification data based on the parameter requirement, and filling the information into the main body sub-table one by one, wherein the identification data at least comprises an identification name, relevant information of a service system, an identification attribute, a reserved index, an identification attribute index, identification attribute content, an identification attribute content format, an identification attribute content value and an identification attribute type;
generating an identification registration execution example by combining the header file of the identification registration form according to the filled main body sub-form;
and operating the identifier registration execution example, adding the service system corresponding to the industry identifier into the identifier analysis platform, generating a corresponding data storage template, and issuing the data storage template.
4. The identification resolution-based data governance method according to any one of claims 1-3, wherein said querying a corresponding data identification template from an identification resolution platform according to the industry identification comprises:
generating a request parameter of a query template according to the industry identification and the identity mark of the service system;
and calling a GET request function, and inquiring a corresponding data identification template in the identification analysis platform by taking the request parameter as an inquiry parameter.
5. The identification resolution-based data governance method according to claim 4, wherein the generating a request parameter for a query template according to the industry identification and the identity of the business system comprises:
acquiring an identity mark of the service system, and constructing a header of a request based on the identity mark, wherein the header is a character string formed by sequentially connecting a Bearer, a blank character and the identity mark in series;
determining a corresponding registration identifier based on the industry identifier;
and generating request parameters based on the registration identification and the header.
6. The data governance method based on identity resolution according to claim 4, wherein after extracting the content in the data to be governed based on the field information set in the data identification template, storing the extracted content in the data identification template to obtain the identification structure data, and storing the identification structure data in the identification resolution platform, the method further comprises:
detecting whether an identification updating request exists;
if the identifier exists, establishing an updating parameter according to the identifier updating request, and calling an identifier registration form to enter identifier updating data;
and querying a data identification template which is updated by the identification updating request in the identification analysis platform by using a PUT function, and updating the data identification template by using the updating parameters and the identification registration table in which the identification updating data is input as response data.
7. The identity resolution-based data governance method according to claim 6, wherein the identity resolution-based data governance method further comprises:
acquiring the last called time of each data identification template in the identification analysis platform;
calculating the time interval between the called time and the current time;
and if the time is larger than a preset threshold value, calling a deletion function to delete the data identification template from the identification analysis platform.
8. The utility model provides a data governance device based on sign is analytic, its characterized in that, data governance device based on sign is analytic includes:
the screening module is used for acquiring data on each service system, screening each data, eliminating unreasonable data in the data to obtain data to be treated, and sending the data to a preset middle station for storage;
the analysis module is used for analyzing the industry identification corresponding to each data to be treated;
the query module is used for querying a corresponding data identification template from the identification analysis platform according to the industry identification, wherein the data identification template is used for carrying out identification registration on each business system on the identification analysis platform based on the industry identification where the business system is located to obtain a data storage template;
and the conversion module is used for extracting the content in the data to be treated based on the field information set in the data identification template, storing the extracted content in the data identification template to obtain identification structure data and storing the identification structure data in the identification analysis platform.
9. A data governance device based on identity resolution, the data governance device based on identity resolution comprising: a memory having instructions stored therein and at least one processor, the memory and the at least one processor interconnected by a line;
the at least one processor invoking the instructions in the memory to cause the identity resolution based data governance device to perform the identity resolution based data governance method of any one of claims 1-7.
10. A computer readable storage medium having instructions stored thereon, wherein the instructions, when executed by a processor, implement the data governance method based on identity resolution of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010926403.4A CN111966868B (en) | 2020-09-07 | 2020-09-07 | Data management method based on identification analysis and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010926403.4A CN111966868B (en) | 2020-09-07 | 2020-09-07 | Data management method based on identification analysis and related equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111966868A true CN111966868A (en) | 2020-11-20 |
| CN111966868B CN111966868B (en) | 2021-04-06 |
Family
ID=73392297
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010926403.4A Active CN111966868B (en) | 2020-09-07 | 2020-09-07 | Data management method based on identification analysis and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111966868B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112801136A (en) * | 2020-12-31 | 2021-05-14 | 广州技象科技有限公司 | Internet of things gateway data processing method and device with feature identification |
| CN112817956A (en) * | 2021-02-04 | 2021-05-18 | 北京易车互联信息技术有限公司 | Data management system |
| CN112860914A (en) * | 2021-03-02 | 2021-05-28 | 中国电子信息产业集团有限公司第六研究所 | Network data analysis system and method of multi-element identification |
| CN113572844A (en) * | 2021-07-27 | 2021-10-29 | 中国电子技术标准化研究院 | Industrial internet identification analysis method |
| CN113791586A (en) * | 2021-07-27 | 2021-12-14 | 贵州元数通科技有限公司 | Novel industrial APP and identification registration analysis integration method |
| CN114020796A (en) * | 2021-10-19 | 2022-02-08 | 山东浪潮工业互联网产业股份有限公司 | Electronic specification implementation method based on industrial internet identification analysis system |
| CN115329156A (en) * | 2022-10-14 | 2022-11-11 | 北京云成金融信息服务有限公司 | Data management method and system based on historical data |
Citations (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060288353A1 (en) * | 2005-06-20 | 2006-12-21 | Microsoft Corporation | Unique identifier resolution interfaces for lightweight runtime identity |
| US20130346448A1 (en) * | 2010-05-26 | 2013-12-26 | General Electric Company | Methods and apparatus to enhance queries in an affinity domain |
| CN103685484A (en) * | 2013-11-29 | 2014-03-26 | 中国物品编码中心 | Analyzing method and analyzing device for internet-of-things uniform identification codes |
| CN105205071A (en) * | 2014-06-24 | 2015-12-30 | 阿里巴巴集团控股有限公司 | Method and system for showing data table |
| US20170060574A1 (en) * | 2015-08-27 | 2017-03-02 | FogHorn Systems, Inc. | Edge Intelligence Platform, and Internet of Things Sensor Streams System |
| CN106506661A (en) * | 2016-11-18 | 2017-03-15 | 浪潮软件集团有限公司 | Method, server and system for dynamically returning data |
| CN106528672A (en) * | 2016-10-31 | 2017-03-22 | 用友网络科技股份有限公司 | Master data management system and method based on duplicate mechanism |
| CN107979783A (en) * | 2016-10-25 | 2018-05-01 | 杭州海康威视数字技术股份有限公司 | A kind of stream data analytic method, device and electronic equipment |
| CN108011862A (en) * | 2016-10-31 | 2018-05-08 | 中兴通讯股份有限公司 | The mandate of mirror image warehouse, access, management method and server and client side |
| CN108200190A (en) * | 2018-01-26 | 2018-06-22 | 青岛国信发展（集团）有限责任公司 | Internet of Things data service system and method based on cloud computing |
| CN108388208A (en) * | 2017-12-30 | 2018-08-10 | 北京航天智造科技发展有限公司 | A kind of equipment management system based on industry internet |
| CN108880867A (en) * | 2018-05-31 | 2018-11-23 | 腾讯科技（深圳）有限公司 | A kind of network equipment collecting method and system |
| CN109524065A (en) * | 2018-11-07 | 2019-03-26 | 平安医疗健康管理股份有限公司 | Medical data querying method, medical data platform and relevant apparatus |
| CN109561482A (en) * | 2018-12-13 | 2019-04-02 | 佛山单常科技有限公司 | A kind of data capture method, data acquisition facility and intelligent terminal |
| CN110119423A (en) * | 2019-05-17 | 2019-08-13 | 厦门商集网络科技有限责任公司 | A kind of data analysis method and computer readable storage medium of configurableization |
| US20190266347A1 (en) * | 2018-02-28 | 2019-08-29 | Ohio State Innovation Foundation | Context-based access control and revocation for data governance and loss mitigation |
| CN110187936A (en) * | 2019-05-31 | 2019-08-30 | 口碑(上海)信息技术有限公司 | Data backflow platform, system and method |
| CN110955725A (en) * | 2019-11-25 | 2020-04-03 | 北京工业大学 | Industrial internet identification analysis root node data synchronization method |
| CN111178005A (en) * | 2019-12-11 | 2020-05-19 | 中国建设银行股份有限公司 | Data processing system, method and storage medium |
| US20200174671A1 (en) * | 2018-04-25 | 2020-06-04 | Pure Storage, Inc. | Bucket views |
| CN111291024A (en) * | 2020-02-19 | 2020-06-16 | 京东方科技集团股份有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN111506559A (en) * | 2020-04-21 | 2020-08-07 | 北京同邦卓益科技有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN111565218A (en) * | 2020-04-08 | 2020-08-21 | 深圳数联天下智能科技有限公司 | Data processing method and electronic equipment |
-
2020
- 2020-09-07 CN CN202010926403.4A patent/CN111966868B/en active Active
Patent Citations (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060288353A1 (en) * | 2005-06-20 | 2006-12-21 | Microsoft Corporation | Unique identifier resolution interfaces for lightweight runtime identity |
| US20130346448A1 (en) * | 2010-05-26 | 2013-12-26 | General Electric Company | Methods and apparatus to enhance queries in an affinity domain |
| CN103685484A (en) * | 2013-11-29 | 2014-03-26 | 中国物品编码中心 | Analyzing method and analyzing device for internet-of-things uniform identification codes |
| CN105205071A (en) * | 2014-06-24 | 2015-12-30 | 阿里巴巴集团控股有限公司 | Method and system for showing data table |
| US20170060574A1 (en) * | 2015-08-27 | 2017-03-02 | FogHorn Systems, Inc. | Edge Intelligence Platform, and Internet of Things Sensor Streams System |
| CN107979783A (en) * | 2016-10-25 | 2018-05-01 | 杭州海康威视数字技术股份有限公司 | A kind of stream data analytic method, device and electronic equipment |
| CN106528672A (en) * | 2016-10-31 | 2017-03-22 | 用友网络科技股份有限公司 | Master data management system and method based on duplicate mechanism |
| CN108011862A (en) * | 2016-10-31 | 2018-05-08 | 中兴通讯股份有限公司 | The mandate of mirror image warehouse, access, management method and server and client side |
| CN106506661A (en) * | 2016-11-18 | 2017-03-15 | 浪潮软件集团有限公司 | Method, server and system for dynamically returning data |
| CN108388208A (en) * | 2017-12-30 | 2018-08-10 | 北京航天智造科技发展有限公司 | A kind of equipment management system based on industry internet |
| CN108200190A (en) * | 2018-01-26 | 2018-06-22 | 青岛国信发展（集团）有限责任公司 | Internet of Things data service system and method based on cloud computing |
| US20190266347A1 (en) * | 2018-02-28 | 2019-08-29 | Ohio State Innovation Foundation | Context-based access control and revocation for data governance and loss mitigation |
| US20200174671A1 (en) * | 2018-04-25 | 2020-06-04 | Pure Storage, Inc. | Bucket views |
| CN108880867A (en) * | 2018-05-31 | 2018-11-23 | 腾讯科技（深圳）有限公司 | A kind of network equipment collecting method and system |
| CN109524065A (en) * | 2018-11-07 | 2019-03-26 | 平安医疗健康管理股份有限公司 | Medical data querying method, medical data platform and relevant apparatus |
| CN109561482A (en) * | 2018-12-13 | 2019-04-02 | 佛山单常科技有限公司 | A kind of data capture method, data acquisition facility and intelligent terminal |
| CN110119423A (en) * | 2019-05-17 | 2019-08-13 | 厦门商集网络科技有限责任公司 | A kind of data analysis method and computer readable storage medium of configurableization |
| CN110187936A (en) * | 2019-05-31 | 2019-08-30 | 口碑(上海)信息技术有限公司 | Data backflow platform, system and method |
| CN110955725A (en) * | 2019-11-25 | 2020-04-03 | 北京工业大学 | Industrial internet identification analysis root node data synchronization method |
| CN111178005A (en) * | 2019-12-11 | 2020-05-19 | 中国建设银行股份有限公司 | Data processing system, method and storage medium |
| CN111291024A (en) * | 2020-02-19 | 2020-06-16 | 京东方科技集团股份有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN111565218A (en) * | 2020-04-08 | 2020-08-21 | 深圳数联天下智能科技有限公司 | Data processing method and electronic equipment |
| CN111506559A (en) * | 2020-04-21 | 2020-08-07 | 北京同邦卓益科技有限公司 | Data storage method and device, electronic equipment and storage medium |
Non-Patent Citations (4)
| Title |
|---|
| RENAN SOUZA等: "Efficient Runtime Capture of Multiworkflow Data Using Provenance", 《2019 15TH INTERNATIONAL CONFERENCE ON ESCIENCE (ESCIENCE)》 * |
| 吴江龙等: "基于Handle的工程机械供应链标识解析技术设计与应用", 《中国工业和信息化》 * |
| 李禹生等: "泛在电力物联网技术标准体系及其智能管理构建分析", 《中国标准化》 * |
| 韦杰: "基于Web Service的电子政务数据交换技术研究", 《中国优秀硕士学位论文全文数据库社会科学Ⅰ辑》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112801136A (en) * | 2020-12-31 | 2021-05-14 | 广州技象科技有限公司 | Internet of things gateway data processing method and device with feature identification |
| CN112801136B (en) * | 2020-12-31 | 2024-04-26 | 广州技象科技有限公司 | Internet of things gateway data processing method and device with characteristic identification |
| CN112817956A (en) * | 2021-02-04 | 2021-05-18 | 北京易车互联信息技术有限公司 | Data management system |
| CN112860914A (en) * | 2021-03-02 | 2021-05-28 | 中国电子信息产业集团有限公司第六研究所 | Network data analysis system and method of multi-element identification |
| CN113572844A (en) * | 2021-07-27 | 2021-10-29 | 中国电子技术标准化研究院 | Industrial internet identification analysis method |
| CN113791586A (en) * | 2021-07-27 | 2021-12-14 | 贵州元数通科技有限公司 | Novel industrial APP and identification registration analysis integration method |
| CN114020796A (en) * | 2021-10-19 | 2022-02-08 | 山东浪潮工业互联网产业股份有限公司 | Electronic specification implementation method based on industrial internet identification analysis system |
| CN115329156A (en) * | 2022-10-14 | 2022-11-11 | 北京云成金融信息服务有限公司 | Data management method and system based on historical data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111966868B (en) | 2021-04-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111966868B (en) | Data management method based on identification analysis and related equipment | |
| CN102135938B (en) | Software product testing method and system | |
| CN109669976B (en) | ETL-based data service method and device | |
| WO2008121862A1 (en) | Data merging in distributed computing | |
| CN109840298B (en) | Multi-information-source acquisition method and system for large-scale network data | |
| CN102521316A (en) | Pattern matching framework for log analysis | |
| CN103942220A (en) | Method used for intelligently linking work orders with knowledge of knowledge base and suitable for IT operation and maintenance system | |
| CN202339542U (en) | Software product test system | |
| CN106599001A (en) | Webpage content acquisition method and system | |
| CN101441629A (en) | Automatic acquiring method of non-structured web page information | |
| CN111859076B (en) | Data crawling method, device, computer equipment and computer readable storage medium | |
| CN111552728A (en) | Data processing method, system, terminal and storage medium of block chain | |
| CN115237857A (en) | Log processing method and device, computer equipment and storage medium | |
| CN113157978B (en) | Data label establishing method and device | |
| CN114049089A (en) | Method and system for constructing government affair big data platform | |
| CN113159118A (en) | Logistics data index processing method, device, equipment and storage medium | |
| CN109600428B (en) | Method and device for automatically uploading attachment and matching association | |
| CN111429110A (en) | Store standardization auditing method, device, equipment and storage medium | |
| JP2002007020A (en) | Method for automating routine processing based on operation monitoring | |
| CN115905371A (en) | Data trend analysis method, device and equipment and computer readable storage medium | |
| CN109815297A (en) | A kind of tree access arithmetic system not depending on relational database | |
| CN114968725A (en) | Task dependency relationship correction method and device, computer equipment and storage medium | |
| CN112667469A (en) | Method, system and readable medium for automatically generating diversified big data statistical report | |
| CN101807206A (en) | Method for vertical search and mining processing of network information | |
| CN112650796A (en) | Automatic application data collection and storage management system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |