CN112416978A - Data quality inspection scheme transmission method, device and system - Google Patents
Data quality inspection scheme transmission method, device and system Download PDFInfo
- Publication number
- CN112416978A CN112416978A CN202011322473.5A CN202011322473A CN112416978A CN 112416978 A CN112416978 A CN 112416978A CN 202011322473 A CN202011322473 A CN 202011322473A CN 112416978 A CN112416978 A CN 112416978A
- Authority
- CN
- China
- Prior art keywords
- quality inspection
- rule
- scheme
- target
- quality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007689 inspection Methods 0.000 title claims abstract description 509
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000005540 biological transmission Effects 0.000 title claims abstract description 42
- 238000012795 verification Methods 0.000 claims abstract description 46
- 238000004891 communication Methods 0.000 claims abstract description 14
- 238000003908 quality control method Methods 0.000 claims description 50
- 238000004806 packaging method and process Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000013075 data extraction Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24564—Applying rules; Deductive queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Maintenance And Management Of Digital Transmission (AREA)
Abstract
The invention discloses a data quality inspection scheme transmission method, a device and a system, which relate to a quality inspection rule editor and a plurality of quality inspection rule executors which are in communication connection, and the method comprises the following steps: receiving a quality inspection rule configuration file sent by any quality inspection rule executor; generating a target quality inspection scheme based on a plurality of quality inspection rules carried by a quality inspection rule configuration file; returning the target quality inspection scheme to a quality inspection rule executor corresponding to the quality inspection rule configuration file; and the quality inspection rule executor judges whether the target quality inspection scheme passes the verification, and if so, executes the target quality inspection scheme based on the received user check instruction. Therefore, the technical problem that the existing data quality inspection scheme is usually customized only for specific software and lacks of use flexibility is solved.
Description
Technical Field
The invention relates to the technical field of data quality inspection, in particular to a data quality inspection scheme transmission method, device and system.
Background
Generally, in the process of establishing a database, due to a large number of data sources, data may be lost or invalid after technical personnel perform data extraction, cleaning and conversion on the data, so that the data analyzable utilization rate is not high. Therefore, before data is put in storage, further inspection is required to be performed on the data to ensure that the data meets the storage standard and the correctness of the data is ensured, and meanwhile, the data can be screened as required and further processed as required to urge the improvement of the data quality.
The traditional result data quality inspection scheme is a quality inspection scheme with a specified format customized for specific software, for example, data is stored in one place (in a file system or a database), and then a corresponding quality inspection scheme is written according to quality inspection requirements to perform data quality inspection. However, due to the adoption of the solution, the quality inspection scheme has higher customized requirements, cannot be suitable for various scenes in which a plurality of quality inspection software are respectively introduced into the quality inspection scheme, and is poor in use flexibility.
Disclosure of Invention
The invention provides a data quality inspection scheme transmission method, a device and a system, and solves the technical problem that the existing data quality inspection scheme is usually customized only aiming at specific software and is lack of use flexibility.
The invention provides a data quality inspection scheme transmission method, which is applied to a quality inspection rule editor, wherein the quality inspection rule editor is in communication connection with a plurality of quality inspection rule executors, and the method comprises the following steps:
receiving a quality inspection rule configuration file sent by any one quality inspection rule executor;
generating a target quality inspection scheme based on a plurality of quality inspection rules carried by the quality inspection rule configuration file;
returning the target quality inspection scheme to a quality inspection rule executor corresponding to the quality inspection rule configuration file;
the quality inspection rule executor is used for judging whether the target quality inspection scheme passes the verification, and if so, executing the target quality inspection scheme based on the received user check instruction.
Optionally, before the step of receiving a plurality of quality control rule configuration files and generating an editing interface including a plurality of quality control rules, the method further includes:
respectively deriving quality inspection rule algorithm configuration from a plurality of quality inspection rule actuators according to a preset data format;
and packaging the quality inspection rule algorithm configurations into quality inspection rule configuration files with the same format respectively.
Optionally, the step of generating a target quality inspection scheme based on a plurality of quality inspection rules carried by the quality inspection rule configuration file includes:
generating a rule editing interface based on a plurality of quality inspection rules carried by the quality inspection rule configuration file;
and responding to the received user selection instruction, selecting at least one target quality inspection rule from the plurality of quality inspection rules, and generating a target quality inspection scheme.
The invention also provides a data quality inspection scheme transmission method, which is applied to a quality inspection rule executor, wherein the quality inspection rule executor is in communication connection with a quality inspection rule editor, and the method comprises the following steps:
receiving a target quality inspection scheme returned by the quality inspection rule editor;
judging whether the target quality inspection scheme passes verification;
if yes, executing the target quality inspection scheme based on the received user checking instruction;
the target quality inspection scheme is generated by the quality inspection rule editor based on a plurality of quality inspection rules carried by a quality inspection rule configuration file sent by the quality inspection rule executor.
Optionally, the quality control rule executor is provided with a first identifier, the target quality control scheme carries a second identifier, and the step of determining whether the target quality control scheme passes the verification includes:
comparing whether the first identification and the second identification are the same;
and if the target quality inspection schemes are the same, judging that the target quality inspection schemes pass the verification.
Optionally, the method further comprises:
if the target quality inspection scheme is different from the verification scheme, judging that the target quality inspection scheme does not pass the verification, and outputting an alarm signal.
Optionally, the target quality inspection scheme includes a plurality of quality inspection rules, and if yes, the step of executing the target quality inspection scheme based on the received user checking instruction includes:
if the target quality inspection scheme passes the verification, displaying a plurality of quality inspection rules in the target quality inspection scheme;
responding to a user checking instruction, and selecting at least one rule to be executed from the multiple quality inspection rules;
and when data to be quality-checked is received, executing the at least one rule to be executed so as to perform quality check operation on the data to be quality-checked.
The invention also provides a data quality inspection scheme transmission device, which is applied to a quality inspection rule editor, wherein the quality inspection rule editor is in communication connection with a plurality of quality inspection rule executors, and the device comprises:
the quality inspection rule configuration file receiving module is used for receiving a quality inspection rule configuration file sent by any one of the quality inspection rule executors;
the target quality inspection scheme generation module is used for generating a target quality inspection scheme based on a plurality of quality inspection rules carried by the quality inspection rule configuration file;
the quality inspection scheme returning module is used for returning the target quality inspection scheme to a quality inspection rule executor corresponding to the quality inspection rule configuration file;
the quality inspection rule executor is used for judging whether the target quality inspection scheme passes the verification, and if so, executing the target quality inspection scheme based on the received user check instruction.
The invention also provides a data quality inspection scheme transmission device, which is applied to a quality inspection rule executor, wherein the quality inspection rule executor is in communication connection with a quality inspection rule editor, and the device comprises:
the target quality inspection scheme receiving module is used for receiving the target quality inspection scheme returned by the quality inspection rule editor;
the verification module is used for judging whether the target quality inspection scheme passes verification;
the quality inspection scheme execution module is used for executing the target quality inspection scheme based on the received user checking instruction if the target quality inspection scheme is judged to be correct;
the target quality inspection scheme is generated by the quality inspection rule editor based on a plurality of quality inspection rules carried by a quality inspection rule configuration file sent by the quality inspection rule executor.
The invention also provides a data quality inspection scheme transmission system, which comprises a quality inspection rule editor and a plurality of quality inspection rule executors;
the quality control rule editor is used for executing the steps of the data quality control scheme transmission method applied to the quality control rule editor;
the quality control rule executor is used for executing the steps of the data quality control scheme transmission method applied to the quality control rule executor.
According to the technical scheme, the invention has the following advantages:
when a quality inspection rule editor receives a quality inspection rule configuration file sent by any quality inspection rule executor, a target quality inspection scheme is generated according to a plurality of quality inspection rules carried by the quality inspection rule configuration file and returned to the target quality inspection executor which sends the quality inspection rule configuration file; and after the target quality inspection executor receives the target quality inspection scheme, whether the target quality inspection scheme can pass the verification is further verified, if so, the target quality inspection scheme can be executed based on a user checking instruction, and the data is subjected to quality inspection, so that whether the data meets the specification is verified, and the technical problem that the conventional data quality inspection scheme is usually customized only for specific software and lacks use flexibility is solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a flowchart illustrating steps of a data quality inspection scheme transmission method according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating steps of a data quality inspection scheme transmission method according to a second embodiment of the present invention;
fig. 3 is a flowchart illustrating steps of a data quality inspection scheme transmission method according to a third embodiment of the present invention;
fig. 4 is a flowchart of a data quality inspection scheme transmission method according to a fourth embodiment of the present invention;
fig. 5 is a block diagram of a data quality inspection scheme transmission apparatus according to a fifth embodiment of the present invention;
fig. 6 is a block diagram of a data quality inspection scheme transmission apparatus according to a sixth embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a data quality inspection scheme transmission method, a device and a system, which are used for solving the technical problem that the existing data quality inspection scheme is usually customized only for specific software and is lack of use flexibility.
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the embodiments described below are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart illustrating a data quality inspection scheme transmission method applied to a quality inspection rule editor according to an embodiment of the present invention.
The invention provides a data quality inspection scheme transmission method, which is applied to a quality inspection rule editor, wherein the quality inspection rule editor is in communication connection with a plurality of quality inspection rule executors, and the method comprises the following steps:
in a specific implementation, the quality inspection rule executor may be quality inspection software, and before performing data quality inspection operation, a corresponding quality inspection rule needs to be set according to data to construct a corresponding quality inspection scheme, and since the existing quality inspection software usually adopts a quality inspection scheme of a specific format and a specific rule that have been programmed in advance, in order to increase the use flexibility of the quality inspection scheme, a quality inspection rule configuration file sent by the quality inspection rule executor may be received first when data quality inspection is required.
102, generating a target quality inspection scheme based on a plurality of quality inspection rules carried by the quality inspection rule configuration file;
after receiving the quality inspection rule configuration file sent by the quality inspection rule executor, the corresponding target quality inspection scheme can be configured for the quality inspection rule executor according to the multiple quality inspection rules carried by the quality inspection rule configuration file.
103, returning the target quality inspection scheme to a quality inspection rule executor corresponding to the quality inspection rule configuration file;
the quality inspection rule executor is used for judging whether the target quality inspection scheme passes the verification, and if so, executing the target quality inspection scheme based on the received user check instruction.
In an example of the present invention, after the target quality inspection scheme is generated, the target quality inspection scheme is returned to the quality inspection rule executor corresponding to the quality inspection rule configuration file, so that the quality inspection rule executor further determines whether the target quality inspection scheme can pass the verification of the executor, and if so, the target quality inspection scheme is executed to perform quality inspection on the data according to the received user checking instruction, thereby determining whether the data meets the quality inspection requirement.
In the embodiment of the invention, when a quality inspection rule editor receives a quality inspection rule configuration file sent by any quality inspection rule executor, a target quality inspection scheme is generated according to a plurality of quality inspection rules carried by the quality inspection rule configuration file and returned to the target quality inspection executor which sends the quality inspection rule configuration file; and after the target quality inspection executor receives the target quality inspection scheme, whether the target quality inspection scheme can pass the verification is further verified, if so, the target quality inspection scheme can be executed based on a user checking instruction, and the data is subjected to quality inspection, so that whether the data meets the specification is verified, and the technical problem that the conventional data quality inspection scheme is usually customized only for specific software and lacks use flexibility is solved.
Referring to fig. 2, fig. 2 is a flowchart illustrating a step of applying a data quality inspection scheme transmission method to a quality inspection rule executor according to a second embodiment of the present invention.
The data quality inspection scheme transmission method provided by the embodiment of the invention is applied to a quality inspection rule executor, wherein the quality inspection rule executor is in communication connection with a quality inspection rule editor, and the method comprises the following steps:
the target quality inspection scheme is generated by the quality inspection rule editor based on a plurality of quality inspection rules carried by a quality inspection rule configuration file sent by the quality inspection rule executor.
In the embodiment of the invention, the quality inspection rule editor can configure the quality inspection rule according to the requirement of the user on data quality inspection by the quality inspection rule editor based on a plurality of quality inspection rules in the quality inspection rule configuration file sent by the quality inspection rule executor, so that a target quality inspection scheme is constructed and returned to the quality inspection rule executor, and the subsequent execution of the target quality inspection scheme is facilitated.
in the embodiment of the invention, after the quality inspection rule executor receives the target quality inspection scheme returned by the quality inspection rule editor, because the data quality inspection may have different requirements and specifications, before the target quality inspection scheme is executed, whether the target quality inspection scheme can pass the verification can be judged, so as to ensure that the target quality inspection scheme is the quality inspection scheme required by the quality inspection rule executor.
Optionally, the verification process may be based on further analysis of the target quality inspection scheme, for example, rule comparison, identification of the target quality inspection scheme, and the like, which is not limited in this embodiment of the present invention.
when the target quality inspection scheme passes the verification, each sub-quality inspection scheme may further include a plurality of specific quality inspection rules, since one target quality inspection scheme may include a plurality of sub-quality inspection schemes. In order to increase the flexibility of data quality inspection, a user checking instruction can be received so as to select part or all of the quality inspection rules for data quality inspection, and after the quality inspection rules are selected, the quality inspection rule executor executes the target quality inspection scheme, so that the data is subjected to quality inspection to determine whether the data meets the industrial specifications.
It should be noted that the data may be processed result data, such as longitude and latitude, angle, or other result data, and the embodiment of the present invention is not limited thereto.
In the embodiment of the invention, when a quality inspection rule editor receives a quality inspection rule configuration file sent by any quality inspection rule executor, a target quality inspection scheme is generated according to a plurality of quality inspection rules carried by the quality inspection rule configuration file and returned to the target quality inspection executor which sends the quality inspection rule configuration file; and after the target quality inspection executor receives the target quality inspection scheme, whether the target quality inspection scheme can pass the verification is further verified, if so, the target quality inspection scheme can be executed based on a user checking instruction, and the data is subjected to quality inspection, so that whether the data meets the specification is verified, and the technical problem that the conventional data quality inspection scheme is usually customized only for specific software and lacks use flexibility is solved.
Referring to fig. 3, fig. 3 is a flowchart illustrating steps of a data quality inspection scheme transmission method according to a third embodiment of the present invention.
The invention provides a data quality inspection scheme transmission method, which relates to a quality inspection rule editor and a plurality of quality inspection rule executors which are in communication connection, and comprises the following steps:
before step 301, the method further comprises the following steps S1-S2:
respectively deriving quality inspection rule algorithm configuration from a plurality of quality inspection rule actuators according to a preset data format;
and packaging the quality inspection rule algorithm configurations into quality inspection rule configuration files with the same format respectively.
In the embodiment of the invention, because the different quality inspection execution software has different rule algorithm implementations, before receiving the quality inspection rule configuration file, in order to improve the editing efficiency of the quality inspection scheme, the quality inspection rule algorithm configurations can be respectively exported from a plurality of quality inspection rule executors according to a preset data format, and for the convenience of importing and applying the quality inspection rule editor, the quality inspection rule algorithm configurations exported by different executors can be packaged into the quality inspection configuration file with the same format.
The predetermined data format may be a data format of a general scheme, such as xml and json, or may be other agreed data formats, which is not limited in this embodiment of the present invention.
302, generating a target quality inspection scheme based on a plurality of quality inspection rules carried by the quality inspection rule configuration file;
in an embodiment of the present invention, the step 302 may include the following sub-steps:
generating a rule editing interface based on a plurality of quality inspection rules carried by the quality inspection rule configuration file;
responding to a received user selection instruction, selecting at least one target quality inspection rule from the plurality of quality inspection rules, and generating a target quality inspection scheme;
in an example of the present invention, the quality control rule configuration file is loaded by the quality control rule editor to generate a rule configuration interface, where the rule configuration interface includes a plurality of quality control rules carried by the quality control rule configuration file, and when a user needs to edit a target quality control scheme, the user can select the rule configuration interface, that is, send a user selection instruction to select at least one target quality control rule from the plurality of quality control rules, and drag the selected target quality control rule to the rule editing interface to edit and generate the target quality control scheme.
Optionally, the target quality inspection scheme may include a plurality of sub-quality inspection schemes or a plurality of target quality inspection rules, and each sub-quality inspection scheme may include a plurality of specific target quality inspection rules.
in a specific implementation, one quality inspection rule editor can correspond to a plurality of quality inspection rule executors, when the quality inspection rule editor receives a quality inspection rule configuration file sent by a certain quality inspection rule executor, the quality inspection rule configuration file is loaded to generate a corresponding rule editing interface, and when the quality inspection scheme is edited, the quality inspection rule editor returns to the corresponding quality inspection rule executor; if another quality inspection rule configuration file sent by another quality inspection rule executor is received, the corresponding rule editing interface is regenerated to generate another quality inspection scheme and return the scheme to another quality inspection rule executor.
optionally, the quality control rule executor is provided with a first identifier, the target quality control scheme carries a second identifier, and step 304 may include the following substeps:
comparing whether the first identification and the second identification are the same;
and if the first identifier is the same as the second identifier, judging that the target quality inspection scheme passes the verification.
And if the first identifier is different from the second identifier, judging that the target quality inspection scheme does not pass the verification, and outputting an alarm signal.
In another example of the present invention, after the quality inspection rule executor receives the target quality inspection scheme returned by the quality inspection rule editor, in order to ensure the feasibility of the target quality inspection scheme, the quality inspection rule executor may compare the first identifier of the quality inspection rule executor with the second identifier carried by the target quality inspection scheme, if the identifiers are the same, it is determined that the target quality inspection scheme passes the verification, which indicates that the target quality inspection scheme is the quality inspection scheme that the quality inspection rule executor can recognize, and the next step may be directly performed; if the marks are different, the target quality inspection scheme is judged not to pass the verification, at the moment, an alarm signal can be output to inform a user that the target quality inspection scheme is not the quality inspection scheme which can be identified by the quality inspection rule executor, and the execution is finished.
It should be noted that, when configuring and packaging a plurality of quality control rule algorithms derived from the quality control rule executor into a quality control rule configuration file with the same format, a second identifier may be added thereto, so that a subsequent quality control rule editor adds the second identifier to the target quality control scheme.
And 305, if yes, executing the target quality inspection scheme based on the received user checking instruction.
Further, the target quality inspection scheme comprises a plurality of quality inspection rules, and the step 305 may comprise the following sub-steps:
if the target quality inspection scheme passes the verification, displaying a plurality of quality inspection rules in the target quality inspection scheme;
responding to a user checking instruction, and selecting at least one rule to be executed from the multiple quality inspection rules;
and when data to be quality-checked is received, executing the at least one rule to be executed so as to perform quality check operation on the data to be quality-checked.
In specific implementation, when the target quality inspection scheme passes the verification, a plurality of quality inspection rules in the target quality inspection scheme can be displayed on a quality inspection rule executor, and then at least one rule to be executed is selected from the plurality of quality inspection rules based on a user check instruction, so that the diversified and flexible execution of the quality inspection process is facilitated; after the rule to be executed is obtained, if the data to be quality-checked is received, the rule to be executed is executed through the quality-check rule executor, so that the quality check of the data is realized, and whether the data meet the industrial specification or not is effectively verified.
Referring to fig. 4, fig. 4 is a flowchart illustrating a data quality inspection scheme transmission method according to a fourth embodiment of the present invention.
1. Exporting quality inspection rule configuration files, wherein each quality inspection rule configuration file carries different software marks;
2. importing a quality inspection rule configuration file through a quality inspection rule editor to generate a rule interface;
3. generating a target quality inspection scheme;
4. leading in a target quality inspection scheme through a quality inspection rule actuator;
5. detecting whether the software mark is the same as that set by the essence inspection rule executor or not;
6. if the target quality inspection scheme is the same as the quality inspection scheme, displaying a quality inspection rule in the target quality inspection scheme; if not, the process is finished directly.
7. Receiving a user checking instruction, and checking a quality inspection rule to be executed;
8. executing the checked quality inspection rule;
9. and (6) ending.
In the embodiment of the invention, when a quality inspection rule editor receives a quality inspection rule configuration file sent by any quality inspection rule executor, a target quality inspection scheme is generated according to a plurality of quality inspection rules carried by the quality inspection rule configuration file and returned to the target quality inspection executor which sends the quality inspection rule configuration file; and after the target quality inspection executor receives the target quality inspection scheme, whether the target quality inspection scheme can pass the verification is further verified, if so, the target quality inspection scheme can be executed based on a user checking instruction, and the data is subjected to quality inspection, so that whether the data meets the specification is verified, and the technical problem that the conventional data quality inspection scheme is usually customized only for specific software and lacks use flexibility is solved.
Referring to fig. 5, fig. 5 is a block diagram of a data quality inspection scheme transmission apparatus according to a fifth embodiment of the present invention.
The invention also provides a data quality inspection scheme transmission device, which is applied to a quality inspection rule editor, wherein the quality inspection rule editor is in communication connection with a plurality of quality inspection rule executors, and the device comprises:
a quality inspection rule configuration file receiving module 501, configured to receive a quality inspection rule configuration file sent by any one of the quality inspection rule executors;
a target quality inspection scheme generation module 502, configured to generate a target quality inspection scheme based on the multiple quality inspection rules carried by the quality inspection rule configuration file;
a quality inspection scheme returning module 503, configured to return the target quality inspection scheme to a quality inspection rule executor corresponding to the quality inspection rule configuration file;
the quality inspection rule executor is used for judging whether the target quality inspection scheme passes the verification, and if so, executing the target quality inspection scheme based on the received user check instruction.
Optionally, the apparatus further comprises:
the algorithm derivation module is used for respectively deriving the quality inspection rule algorithm configuration from the quality inspection rule executors according to a preset data format;
and the configuration file packaging module is used for respectively packaging the quality inspection rule algorithm configurations into quality inspection rule configuration files with the same format.
Optionally, the target quality inspection scheme generating module 502 includes:
the editing interface generating submodule is used for generating a rule editing interface based on a plurality of quality inspection rules carried by the quality inspection rule configuration file;
and the target quality inspection scheme generation sub-module is used for responding to a received user selection instruction, selecting at least one target quality inspection rule from the plurality of quality inspection rules and generating a target quality inspection scheme.
Referring to fig. 6, fig. 6 is a block diagram of a data quality inspection scheme transmission apparatus according to a sixth embodiment of the present invention.
The invention also provides a data quality inspection scheme transmission device, which is applied to a quality inspection rule executor, wherein the quality inspection rule executor is in communication connection with a quality inspection rule editor, and the device comprises:
a target quality inspection scheme receiving module 601, configured to receive a target quality inspection scheme returned by the quality inspection rule editor;
a verification module 602, configured to determine whether the target quality inspection scheme passes verification;
a quality inspection scheme executing module 603, configured to, if yes, execute the target quality inspection scheme based on the received user checking instruction;
the target quality inspection scheme is generated by the quality inspection rule editor based on a plurality of quality inspection rules carried by a quality inspection rule configuration file sent by the quality inspection rule executor.
Optionally, the quality control rule executor is provided with a first identifier, and the verification module 602 includes:
the comparison submodule is used for comparing whether the first identification and the second identification are the same or not;
and the first judgment submodule is used for judging that the target quality inspection scheme passes the verification if the target quality inspection scheme is the same as the target quality inspection scheme.
Optionally, the verification module 602 further includes:
and the second judging submodule is used for judging that the target quality inspection scheme does not pass the verification and outputting an alarm signal if the target quality inspection scheme is different from the verification.
Optionally, the target quality inspection scheme includes a plurality of quality inspection rules, and the quality inspection scheme executing module 603 includes:
the quality inspection rule display sub-module is used for displaying a plurality of quality inspection rules in the target quality inspection scheme if the target quality inspection scheme passes the verification;
the to-be-executed rule selection submodule is used for responding to a user checking instruction and selecting at least one to-be-executed rule from the multiple quality inspection rules;
and the quality inspection operation execution submodule is used for executing the at least one rule to be executed when the data to be inspected is received so as to carry out quality inspection operation on the data to be inspected.
The invention also provides a data quality inspection scheme transmission system, which comprises a quality inspection rule editor and a plurality of quality inspection rule executors;
the quality control rule editor is used for executing the steps of the data quality control scheme transmission method applied to the quality control rule editor;
the quality control rule executor is used for executing the steps of the data quality control scheme transmission method applied to the quality control rule executor.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A data quality inspection scheme transmission method is applied to a quality inspection rule editor, and the quality inspection rule editor is in communication connection with a plurality of quality inspection rule executors, and the method comprises the following steps:
receiving a quality inspection rule configuration file sent by any one quality inspection rule executor;
generating a target quality inspection scheme based on a plurality of quality inspection rules carried by the quality inspection rule configuration file;
returning the target quality inspection scheme to a quality inspection rule executor corresponding to the quality inspection rule configuration file;
the quality inspection rule executor is used for judging whether the target quality inspection scheme passes the verification, and if so, executing the target quality inspection scheme based on the received user check instruction.
2. The method of claim 1, wherein prior to the step of receiving a quality control rule profile sent by any one of the quality control rule executors, the method further comprises:
respectively deriving quality inspection rule algorithm configuration from a plurality of quality inspection rule actuators according to a preset data format;
and packaging the quality inspection rule algorithm configurations into quality inspection rule configuration files with the same format respectively.
3. The method according to claim 1, wherein the step of generating a target quality inspection scheme based on the plurality of quality inspection rules carried by the quality inspection rule configuration file comprises:
generating a rule editing interface based on a plurality of quality inspection rules carried by the quality inspection rule configuration file;
and responding to the received user selection instruction, selecting at least one target quality inspection rule from the plurality of quality inspection rules, and generating a target quality inspection scheme.
4. A data quality inspection scheme transmission method is applied to a quality inspection rule executor which is in communication connection with a quality inspection rule editor, and the method comprises the following steps:
receiving a target quality inspection scheme returned by the quality inspection rule editor;
judging whether the target quality inspection scheme passes verification;
if yes, executing the target quality inspection scheme based on the received user checking instruction;
the target quality inspection scheme is generated by the quality inspection rule editor based on a plurality of quality inspection rules carried by a quality inspection rule configuration file sent by the quality inspection rule executor.
5. The data quality inspection scheme transmission method according to claim 4, wherein the quality inspection rule executor is provided with a first identifier, the target quality inspection scheme carries a second identifier, and the step of determining whether the target quality inspection scheme passes the verification includes:
comparing whether the first identification and the second identification are the same;
and if the target quality inspection schemes are the same, judging that the target quality inspection schemes pass the verification.
6. The data quality inspection scheme transmission method of claim 5, further comprising:
and if the first identifier is different from the second identifier, judging that the target quality inspection scheme does not pass the verification, and outputting an alarm signal.
7. The method according to claim 4, wherein the target quality inspection scheme comprises a plurality of quality inspection rules, and if yes, the step of executing the target quality inspection scheme based on the received user checking instruction comprises:
if the target quality inspection scheme passes the verification, displaying a plurality of quality inspection rules in the target quality inspection scheme;
responding to a user checking instruction, and selecting at least one rule to be executed from the multiple quality inspection rules;
and when data to be quality-checked is received, executing the at least one rule to be executed so as to perform quality check operation on the data to be quality-checked.
8. A data quality control scheme transmission apparatus, for use in a quality control rule editor communicatively coupled to a plurality of quality control rule actuators, the apparatus comprising:
the quality inspection rule configuration file receiving module is used for receiving a quality inspection rule configuration file sent by any one of the quality inspection rule executors;
the target quality inspection scheme generation module is used for generating a target quality inspection scheme based on a plurality of quality inspection rules carried by the quality inspection rule configuration file;
the quality inspection scheme returning module is used for returning the target quality inspection scheme to a quality inspection rule executor corresponding to the quality inspection rule configuration file;
the quality inspection rule executor is used for judging whether the target quality inspection scheme passes the verification, and if so, executing the target quality inspection scheme based on the received user check instruction.
9. A data quality control scheme transmission apparatus, for use in a quality control rule executor communicatively coupled to a quality control rule editor, the apparatus comprising:
the target quality inspection scheme receiving module is used for receiving the target quality inspection scheme returned by the quality inspection rule editor;
the verification module is used for judging whether the target quality inspection scheme passes verification;
the quality inspection scheme execution module is used for executing the target quality inspection scheme based on the received user checking instruction if the target quality inspection scheme is judged to be correct;
the target quality inspection scheme is generated by the quality inspection rule editor based on a plurality of quality inspection rules carried by a quality inspection rule configuration file sent by the quality inspection rule executor.
10. A data quality inspection scheme transmission system is characterized by comprising a quality inspection rule editor and a plurality of quality inspection rule executors;
the quality control rule editor is used for executing the steps of the data quality control scheme transmission method according to any one of claims 1 to 4;
the quality control rule executor is configured to perform the steps of the data quality control scheme transmission method according to any one of claims 5 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011322473.5A CN112416978A (en) | 2020-11-23 | 2020-11-23 | Data quality inspection scheme transmission method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011322473.5A CN112416978A (en) | 2020-11-23 | 2020-11-23 | Data quality inspection scheme transmission method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112416978A true CN112416978A (en) | 2021-02-26 |
Family
ID=74777425
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011322473.5A Pending CN112416978A (en) | 2020-11-23 | 2020-11-23 | Data quality inspection scheme transmission method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112416978A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101477548A (en) * | 2009-01-20 | 2009-07-08 | 中国测绘科学研究院 | Regulation based universal space data quality checking technique |
| US20130006992A1 (en) * | 2011-06-30 | 2013-01-03 | International Business Machines Corporation | Adapting Data Quality Rules Based Upon User Application Requirements |
| KR101226161B1 (en) * | 2012-07-30 | 2013-01-24 | 한국과학기술정보연구원 | Method for generating distribution rule and apparatus for query analysis |
| CN107122483A (en) * | 2017-05-05 | 2017-09-01 | 国家测绘地理信息局四川测绘产品质量监督检验站 | Fundamental Geographic Information Data quality detecting method, apparatus and system |
| CN110580172A (en) * | 2019-09-11 | 2019-12-17 | 北京明略软件***有限公司 | Configuration rule verification method and device, storage medium and electronic device |
| CN111161815A (en) * | 2019-12-27 | 2020-05-15 | 深圳中兴网信科技有限公司 | Medical data detection method, device, terminal and computer-readable storage medium |
| KR102125461B1 (en) * | 2019-08-12 | 2020-06-23 | 지니언스(주) | Apparatus and method for processing data for identification and classification of terminals |
-
2020
- 2020-11-23 CN CN202011322473.5A patent/CN112416978A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101477548A (en) * | 2009-01-20 | 2009-07-08 | 中国测绘科学研究院 | Regulation based universal space data quality checking technique |
| US20130006992A1 (en) * | 2011-06-30 | 2013-01-03 | International Business Machines Corporation | Adapting Data Quality Rules Based Upon User Application Requirements |
| KR101226161B1 (en) * | 2012-07-30 | 2013-01-24 | 한국과학기술정보연구원 | Method for generating distribution rule and apparatus for query analysis |
| CN107122483A (en) * | 2017-05-05 | 2017-09-01 | 国家测绘地理信息局四川测绘产品质量监督检验站 | Fundamental Geographic Information Data quality detecting method, apparatus and system |
| KR102125461B1 (en) * | 2019-08-12 | 2020-06-23 | 지니언스(주) | Apparatus and method for processing data for identification and classification of terminals |
| CN110580172A (en) * | 2019-09-11 | 2019-12-17 | 北京明略软件***有限公司 | Configuration rule verification method and device, storage medium and electronic device |
| CN111161815A (en) * | 2019-12-27 | 2020-05-15 | 深圳中兴网信科技有限公司 | Medical data detection method, device, terminal and computer-readable storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 伍素贞 等: "基于规则驱动的土地变更调查数据库质检软件开发与应用", 测绘与空间地理信息, vol. 40, no. 6, 30 June 2017 (2017-06-30), pages 97 - 102 * |
| 章力博 等: "多类测绘产品的质检软件平台框架设计与应用", 测绘科学, vol. 45, no. 6, 30 June 2020 (2020-06-30), pages 187 - 191 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106095376B (en) | A kind of implementation method of quick configuration monitoring picture | |
| CN110275992B (en) | Emergency processing method, device, server and computer readable storage medium | |
| CN111723646B (en) | Method and device for remotely assisting in maintaining equipment | |
| CN105786695A (en) | Data test method and system | |
| US11409928B2 (en) | Configurable digital twin | |
| US20210336852A1 (en) | Network-configuration-information generation method and communication device | |
| CN109408361A (en) | Monkey tests restored method, device, electronic equipment and computer readable storage medium | |
| CN107247827B (en) | Virtual terminal model modeling and automatic wiring method based on machine learning | |
| CN110910193B (en) | Order information input method and device based on RPA technology | |
| CN114201346A (en) | HIL (hardware-in-the-loop) testing method and device of CAN (controller area network) communication interface and electronic equipment | |
| CN114003451A (en) | Interface test method, device, system and medium | |
| CN111967137B (en) | Modeling method and device for semiconductor equipment | |
| CN112416978A (en) | Data quality inspection scheme transmission method, device and system | |
| CN112699648A (en) | Data processing method and device | |
| CN110940874A (en) | Calibration method, server and medium for nuclear power station transformer protection device | |
| CN114584475B (en) | Communication test method and device | |
| CN116185387A (en) | Method and device for generating SOC chip pin multiplexing code | |
| CN115987821A (en) | Gateway routing test method and device | |
| KR101940675B1 (en) | Method and Engine for tracing common cause failure in an integrated drawing | |
| CN114090445A (en) | Test code generation method, device and equipment | |
| CN115589407B (en) | File transmission verification method based on PLM-DNC integrated system | |
| CN116300749B (en) | Process flow editing method and device, control system terminal and storage medium | |
| CN114487758B (en) | Test method and test system for semiconductor equipment | |
| CN108255660A (en) | A kind of error analysis methodology and device of complex software system | |
| CN117236020A (en) | Knowledge graph-based assembly simulation planning method, system, medium and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |