CN113486020B - Source cutting method of basic data platform, related device and computer storage medium - Google Patents
Source cutting method of basic data platform, related device and computer storage medium Download PDFInfo
- Publication number
- CN113486020B CN113486020B CN202110850015.7A CN202110850015A CN113486020B CN 113486020 B CN113486020 B CN 113486020B CN 202110850015 A CN202110850015 A CN 202110850015A CN 113486020 B CN113486020 B CN 113486020B
- Authority
- CN
- China
- Prior art keywords
- source
- layer data
- cutting
- intermediate layer
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 238000013499 data model Methods 0.000 claims abstract description 43
- 238000012545 processing Methods 0.000 claims abstract description 41
- 238000012795 verification Methods 0.000 claims description 52
- 230000003213 activating effect Effects 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 7
- 238000012937 correction Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 5
- 238000013506 data mapping Methods 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application provides a source cutting method of a basic data platform, a related device and a computer storage medium, wherein the method comprises the following steps: firstly, acquiring base layer data of a base data platform; then, processing the basic layer data of the basic data platform into an intermediate layer data model of a target system according to a preset storage mode to obtain intermediate layer data after source cutting; judging whether the intermediate layer data after source cutting has a difference with the intermediate layer data before source cutting; if the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting, determining the reason for the difference; correcting the intermediate layer data after source cutting according to the solution corresponding to the reason to obtain corrected intermediate layer data; and finally, processing the corrected middle layer data into an application layer data model to obtain a first source-cutting report. Thus, the aim of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a source cutting method for a basic data platform, a related device, and a computer storage medium.
Background
The tangential source refers to receiving data from the original system and instead receiving data to another system.
In order to unify the data sources of the main data marts, the cleaned and integrated data needs to be acquired from the basic data platform uniformly, so that the work target of the output homology is realized.
At present, a method specially aiming at the source cutting is not available, so that the existing source cutting workflow is complex.
Disclosure of Invention
In view of the foregoing, the present application provides a source-cutting method, a related apparatus and a computer storage medium for a basic data platform.
The first aspect of the present application provides a method for helping each data mart to quickly and effectively complete a data source cutting work source of a basic data platform, including:
acquiring base layer data of a base data platform;
processing the basic layer data of the basic data platform into an intermediate layer data model of a target system according to a preset storage mode to obtain intermediate layer data after source cutting;
judging whether the intermediate layer data after source cutting has a difference with the intermediate layer data before source cutting;
if the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting, determining the reason for the difference;
correcting the intermediate layer data after source cutting according to the solution corresponding to the reason to obtain corrected intermediate layer data;
and processing the corrected middle layer data into an application layer data model to obtain a first source-cutting report.
Optionally, the source cutting method of the basic data platform further includes:
and if the intermediate layer data after source cutting is judged to have no difference with the intermediate layer data before source cutting, processing the intermediate layer data after source cutting into an application layer data model to obtain a second source cutting report.
Optionally, in another embodiment of the present application, after processing the corrected intermediate layer data into the application layer data model to obtain the first source report, the method further includes:
receiving a first verification result; the first verification result indicates whether the data in the first all-source report form is wrong or not;
if the first verification result shows that the data in the first cut-source report is wrong, returning to the step of executing the judgment whether the difference exists between the middle layer data after cutting the source and the middle layer data before cutting the source;
and if the first verification result shows that the data in the first cut source report is correct, ending the current cut source.
Optionally, in another embodiment of the present application, if it is determined that there is no difference between the intermediate layer data after source cutting and the intermediate layer data before source cutting, processing the intermediate layer data after source cutting into an application layer data model, and after obtaining a second source cutting report, further includes:
receiving a second verification result; the second verification result indicates whether the data in the second cut-source report form is wrong or not;
if the second verification result shows that the data in the second cut source report is wrong, returning to the step of executing the judgment whether the intermediate layer data after cutting the source and the intermediate layer data before cutting the source have difference or not;
and if the second verification result shows that the data in the second cut source report is correct, ending the current cut source.
A second aspect of the present application provides a source-cutting device of a base data platform, including:
the acquisition unit is used for acquiring the base layer data of the base data platform;
the first processing unit is used for processing the basic layer data of the basic data platform into an intermediate layer data model of a target system according to a preset storage mode to obtain intermediate layer data after source cutting;
the judging unit is used for judging whether the intermediate layer data after source cutting and the intermediate layer data before source cutting have differences or not;
the determining unit is used for determining the reason for the difference if the judging unit judges that the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting;
the correction unit is used for correcting the intermediate layer data after source cutting according to the solution corresponding to the reason to obtain corrected intermediate layer data;
and the second processing unit is used for processing the corrected middle layer data into the application layer data model to obtain the first source cutting report.
Optionally, the source cutting device of the basic data platform further includes:
and the second processing unit is further configured to process the intermediate layer data after source cutting into an application layer data model to obtain a second source cutting report if the judging unit judges that the intermediate layer data after source cutting has no difference from the intermediate layer data before source cutting.
Optionally, the source cutting device of the basic data platform further includes:
the first receiving unit is used for receiving a first verification result; the first verification result indicates whether the data in the first all-source report form is wrong or not;
the first activating unit activates the judging unit to judge whether the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting or not if the first verification result shows that the data in the first source cutting report is wrong;
and the first ending unit is used for ending the current cut source if the first verification result shows that the data in the first cut source report is correct.
Optionally, the source cutting device of the basic data platform further includes:
a second receiving unit, configured to receive a second verification result; the second verification result indicates whether the data in the second cut-source report form is wrong or not;
the second activating unit is used for activating the judging unit to judge whether the intermediate layer data after source cutting and the intermediate layer data before source cutting are different or not if the second verification result shows that the data in the second source cutting report is wrong;
and the second ending unit is used for ending the current cut source if the second verification result shows that the data in the second cut source report is correct.
A third aspect of the present application provides an electronic device, comprising:
one or more processors;
a storage device having one or more programs stored thereon;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of source-cutting of a base data platform as claimed in any one of the first aspects.
A fourth aspect of the present application provides a computer storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements a method of source cutting of a basic data platform according to any of the first aspects.
According to the scheme, in the source cutting method, the related device and the computer storage medium of the basic data platform, the source cutting method of the basic data platform comprises the following steps: firstly, acquiring base layer data of a base data platform; then, processing the basic layer data of the basic data platform into an intermediate layer data model of a target system according to a preset storage mode to obtain intermediate layer data after source cutting; judging whether the intermediate layer data after source cutting has a difference with the intermediate layer data before source cutting; if the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting, determining the reason for the difference; correcting the intermediate layer data after source cutting according to the solution corresponding to the reason to obtain corrected intermediate layer data; and finally, processing the corrected middle layer data into an application layer data model to obtain a first source-cutting report. Thus, the aim of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present invention, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
FIG. 1 is a specific flowchart of a source-cutting method of a basic data platform according to an embodiment of the present application;
FIG. 2 is a flowchart of a source-cutting method of a basic data platform according to another embodiment of the present application;
FIG. 3 is a schematic diagram of a source-cutting device of a basic data platform according to another embodiment of the present application;
FIG. 4 is a schematic diagram of a source-cutting device of a basic data platform according to another embodiment of the present application;
fig. 5 is a schematic diagram of an electronic device for implementing a source-cutting method of a base data platform according to another embodiment of the present application.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that the terms "first," "second," and the like in this application are used merely to distinguish between different devices, modules, or units and are not intended to limit the order or interdependence of functions performed by such devices, modules, or units, but the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but also other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The embodiment of the application provides a source cutting method of a basic data platform, as shown in fig. 1, specifically comprising the following steps:
s101, acquiring base layer data of a base data platform.
Specifically, but not limited to, the base layer data of the base data platform may be acquired by subscribing in the base data platform, which is not limited herein.
S102, processing the base layer data of the source cutting report basic data platform into an intermediate layer data model of the target system according to a preset storage mode to obtain intermediate layer data after source cutting.
Wherein, the middle layer data model stores the latest full data. The preset storage mode is a storage process when the base layer data is processed, and is used for updating the data accumulation into the middle layer data model.
S103, judging whether the intermediate layer data after source cutting of the source cutting report is different from the intermediate layer data before source cutting.
Specifically, if it is determined that the intermediate layer data after the source cutting of the source cutting report has a difference from the intermediate layer data before the source cutting, step S104 is executed. If it is determined that the intermediate layer data after the source cutting of the source cutting report has no difference from the intermediate layer data before the source cutting, step S107 is executed.
S104, determining the reason for the occurrence of the source cutting report difference.
Specifically, according to the current difference, whether the basic layer data of the basic data platform of the cut-source report is processed into the middle layer data model of the target system according to a preset storage mode or the data mapping problem in the basic data platform is determined.
S105, correcting the intermediate layer data of the cut source report according to the solution corresponding to the cut source report cause, and obtaining corrected intermediate layer data.
If the basic layer data of the source cutting report basic data platform is processed into an intermediate layer data model of the target system according to a preset storage mode, the problem of rewriting is solved, and the program logic problem after source cutting is corrected; if the data mapping problem in the basic data platform is solved, the upstream correction of the data quality problem is assisted.
S106, processing the corrected middle layer data into an application layer data model to obtain a first source-cutting report.
The application layer data model, also called a fact table, is a model for reporting.
And S107, processing the intermediate layer data of the cut-source report after the cut-source is processed into the application layer data model to obtain a second cut-source report.
According to the scheme, the source cutting method of the basic data platform is provided: firstly, acquiring base layer data of a base data platform; then, processing the basic layer data of the source cutting report basic data platform into an intermediate layer data model of a target system according to a preset storage mode to obtain intermediate layer data after source cutting; judging whether the intermediate layer data after source cutting of the source cutting report is different from the intermediate layer data before source cutting; if the difference exists between the intermediate layer data after the source cutting of the source cutting report and the intermediate layer data before the source cutting is judged, determining the reason for the occurrence of the difference of the source cutting report; correcting the intermediate layer data after cutting the source of the cut source report according to the solution corresponding to the source cutting report reason to obtain corrected intermediate layer data; finally, processing the corrected intermediate layer data into an application layer data model to obtain a first source cutting report; if the difference between the intermediate layer data after source cutting of the source cutting report and the intermediate layer data before source cutting is judged, the intermediate layer data after source cutting of the source cutting report is directly processed into an application layer data model, and a second source cutting report is obtained. Thus, the aim of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
Optionally, in another embodiment of the present application, an implementation of a source-cutting method of the base data platform, as shown in fig. 2, includes:
s201, acquiring base layer data of a base data platform.
It should be noted that the specific implementation procedure of step S201 is the same as that of step S101 described above, and reference may be made to each other.
S202, processing the base layer data of the source cutting report basic data platform into an intermediate layer data model of a target system according to a preset storage mode to obtain intermediate layer data after source cutting.
It should be noted that the specific implementation procedure of step S202 is the same as that of step S102 described above, and reference may be made to each other.
S203, judging whether the intermediate layer data after the source cutting of the source cutting report is different from the intermediate layer data before the source cutting.
Specifically, if it is determined that the intermediate layer data after the source cutting of the source cutting report has a difference from the intermediate layer data before the source cutting, step S204 is performed. If it is determined that the intermediate layer data after the source cutting of the source cutting report has no difference from the intermediate layer data before the source cutting, step S207 is performed.
Note that, the specific implementation procedure of step S203 is the same as the specific implementation procedure of step S103 described above, and reference may be made to each other.
S204, determining the reason for the occurrence of the source cutting report difference.
It should be noted that the implementation procedure of step S204 is the same as that of step S104, and can be seen from each other.
S205, correcting the intermediate layer data of the cut source report according to the solution corresponding to the cut source report cause, and obtaining corrected intermediate layer data.
Note that, the specific implementation procedure of step S205 is the same as that of step S105 described above, and reference may be made to each other.
S206, processing the corrected middle layer data into an application layer data model to obtain a first source-cutting report.
It should be noted that the specific implementation procedure of step S206 is the same as that of step S106 described above, and reference may be made to each other.
S208, receiving a first verification result.
The first verification result of the cut source report indicates whether the data in the first cut source report of the cut source report is wrong or not.
Specifically, if the first verification result of the cut-source report indicates that the data in the first cut-source report of the cut-source report is wrong, returning to execute the step S203; if the first verification result of the cut-source report indicates that the data in the first cut-source report of the cut-source report is correct, step S210 is executed.
S210, ending the current source cutting.
S207, processing the intermediate layer data of the cut source report after the cut source is cut into an application layer data model to obtain a second cut source report.
It should be noted that the implementation procedure of step S207 is the same as the implementation procedure of step S107 described above, and reference may be made to each other.
S209, receiving a second verification result.
The second verification result of the cut source report indicates whether the data in the second cut source report of the cut source report is wrong or not.
Specifically, if the second verification result of the cut source report indicates that the data in the second cut source report of the cut source report is wrong, returning to execute the step S203; if the second verification result of the cut source report indicates that the data in the second cut source report of the cut source report is correct, step S210 is executed.
According to the scheme, the source cutting method of the basic data platform is provided: after the first cut-source report or the second cut-source report is obtained, the first cut-source report or the second cut-source report is corrected and perfected through a first verification result or a second verification result fed back by a business end or a business department. Thus, the aim of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
The embodiment of the application provides a source cutting device of a basic data platform, as shown in fig. 3, specifically including:
an obtaining unit 301 is configured to obtain base layer data of a base data platform.
And the first processing unit 302 is configured to process the base layer data of the source-cut report base data platform into an intermediate layer data model of the target system according to a preset storage mode, so as to obtain intermediate layer data after source cutting.
And the judging unit 303 is used for judging whether the intermediate layer data after the source cutting of the source cutting report and the intermediate layer data before the source cutting exist difference or not.
And the determining unit 304 is configured to determine a cause of the difference of the cut source report if the cut source report determining unit 303 determines that the difference exists between the intermediate layer data after the cut source report is cut from the intermediate layer data before the cut source is cut.
And the correcting unit 305 is configured to correct the intermediate layer data after the source cutting of the source cutting report according to the solution corresponding to the source cutting report reason, so as to obtain corrected intermediate layer data.
And the second processing unit 306 is configured to process the modified intermediate layer data into the application layer data model, and obtain a first source-cutting report.
The specific working process of the unit disclosed in the foregoing embodiments of the present application may refer to the content of the corresponding method embodiment, as shown in fig. 1, which is not repeated herein.
Optionally, in another embodiment of the present application, an implementation manner of the source cutting device of the base data platform further includes:
and the second processing unit is further configured to process the intermediate layer data after source cutting of the source cutting report to the application layer data model to obtain a second source cutting report if the source cutting report judging unit 303 judges that the intermediate layer data after source cutting of the source cutting report has no difference from the intermediate layer data before source cutting.
The specific working process of the unit disclosed in the foregoing embodiments of the present application may refer to the content of the corresponding method embodiment, as shown in fig. 1, which is not repeated herein.
According to the scheme, the source cutting device of the basic data platform provided by the application is as follows: first, the acquisition unit 301 acquires base layer data of a base data platform; then, the first processing unit 302 processes the base layer data of the source cutting report base data platform into an intermediate layer data model of the target system according to a preset storage mode to obtain intermediate layer data after source cutting; the judging unit 303 judges whether there is a difference between the intermediate layer data after the source cutting report is cut and the intermediate layer data before the source is not cut; if the judging unit 303 judges that the intermediate layer data after source cutting of the source cutting report has a difference with the intermediate layer data before source cutting, the determining unit 304 determines the reason for the difference of the source cutting report; the correction unit 305 corrects the intermediate layer data after the source cutting of the source cutting report according to the solution corresponding to the source cutting report reason to obtain corrected intermediate layer data; the second processing unit 306 processes the corrected intermediate layer data into an application layer data model to obtain a first source cutting report; if the judging unit 303 judges that the intermediate layer data after source cutting of the source cutting report has no difference with the intermediate layer data before source cutting, the second processing unit 306 directly processes the intermediate layer data after source cutting of the source cutting report into the application layer data model to obtain a second source cutting report. Thus, the aim of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
Optionally, in another embodiment of the present application, an implementation of the source-cutting device of the base data platform, as shown in fig. 4, includes:
an obtaining unit 401 is configured to obtain base layer data of a base data platform.
And the first processing unit 402 is configured to process the base layer data of the cut-source report base data platform into an intermediate layer data model of the target system according to a preset storage mode, so as to obtain intermediate layer data after cutting the source.
And the judging unit 403 is configured to judge whether there is a difference between the intermediate layer data after the source is cut and the intermediate layer data before the source is not cut.
And a determining unit 404, configured to determine a cause of the difference of the cut source report if the cut source report judging unit 403 judges that the difference exists between the intermediate layer data after the cut source report cuts the source and the intermediate layer data before the cut source.
And the correcting unit 405 is configured to correct the intermediate layer data after the source cutting of the source cutting report according to the solution corresponding to the source cutting report cause, so as to obtain corrected intermediate layer data.
And the second processing unit 406 is configured to process the modified intermediate layer data into the application layer data model, and obtain a first source-cutting report.
The first receiving unit 407 is configured to receive a first verification result.
The first verification result of the cut source report indicates whether the data in the first cut source report of the cut source report is wrong or not.
The first activating unit 408, if the first verification result of the cut source report indicates that the data in the first cut source report of the cut source report is wrong, activates the cut source report judging unit 403 to judge whether the intermediate layer data after the cut source report is cut source and the intermediate layer data before the cut source are different;
the first ending unit 409 is configured to end the current cut source if the first verification result of the cut source report indicates that the data in the first cut source report of the cut source report is correct.
The specific working process of the unit disclosed in the foregoing embodiments of the present application may refer to the content of the corresponding method embodiment, as shown in fig. 2, which is not described herein again.
Optionally, in another embodiment of the present application, an implementation of the source-cutting device of the base data platform includes:
the second processing unit 406 is further configured to process the intermediate layer data after source cutting of the source cutting report to the application layer data model to obtain a second source cutting report if the source cutting report judging unit 403 judges that the intermediate layer data after source cutting of the source cutting report has no difference from the intermediate layer data before source cutting.
The specific working process of the unit disclosed in the foregoing embodiments of the present application may refer to the content of the corresponding method embodiment, as shown in fig. 2, which is not described herein again.
Optionally, in another embodiment of the present application, an implementation of the source-cutting device of the base data platform includes:
and the second receiving unit is used for receiving a second verification result.
The second verification result of the cut source report indicates whether the data in the second cut source report of the cut source report is wrong or not.
And the second activating unit is configured to activate the cut source report judging unit 403 to judge whether the intermediate layer data after the cut source report cuts the source and the intermediate layer data before the cut source exist in the cut source report if the second verification result of the cut source report indicates that the data in the second cut source report of the cut source report is wrong.
And the second ending unit is used for ending the current cut source if the second verification result of the cut source report indicates that the data in the second cut source report of the cut source report is correct.
The specific working process of the unit disclosed in the foregoing embodiments of the present application may refer to the content of the corresponding method embodiment, as shown in fig. 2, which is not described herein again.
According to the scheme, the source cutting device of the basic data platform provided by the application is as follows: after the first cut-source report or the second cut-source report is obtained, the first cut-source report or the second cut-source report is corrected and perfected through a first verification result or a second verification result fed back by a business end or a business department. Thus, the aim of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
Another embodiment of the present application provides an electronic device, as shown in fig. 5, including:
one or more processors 501.
A storage device 502 on which one or more programs are stored.
The one or more programs, when executed by the one or more processors 501, cause the one or more processors 501 to implement the method of source-cutting of a base data platform as in any of the embodiments described above.
Another embodiment of the present application provides a computer storage medium having a computer program stored thereon, wherein the computer program when executed by a processor implements a method for slicing a base data platform as in any of the above embodiments.
In the above embodiments of the disclosure, it should be understood that the disclosed apparatus and method may be implemented in other manners. The apparatus and method embodiments described above are merely illustrative, for example, flow diagrams and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in various embodiments of the present disclosure may be integrated together to form a single portion, or each module may exist alone, or two or more modules may be integrated to form a single portion. The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present disclosure may be embodied in essence or a part contributing to the prior art or a part of the technical solution, or in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a live device, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present disclosure. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Those skilled in the art can make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method for cutting a source of a base data platform, comprising:
acquiring base layer data of a base data platform;
processing the basic layer data of the basic data platform into an intermediate layer data model of a target system according to a preset storage mode to obtain intermediate layer data after source cutting;
judging whether the intermediate layer data after source cutting has a difference with the intermediate layer data before source cutting;
if the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting, determining the reason for the difference;
correcting the intermediate layer data after source cutting according to the solution corresponding to the reason to obtain corrected intermediate layer data;
and processing the corrected middle layer data into an application layer data model to obtain a first source-cutting report.
2. The method of source cutting according to claim 1, further comprising:
and if the intermediate layer data after source cutting is judged to have no difference with the intermediate layer data before source cutting, processing the intermediate layer data after source cutting into an application layer data model to obtain a second source cutting report.
3. The method for source cutting according to claim 1, wherein after processing the corrected intermediate layer data into the application layer data model to obtain the first source cutting report, further comprising:
receiving a first verification result; the first verification result indicates whether the data in the first all-source report form is wrong or not;
if the first verification result shows that the data in the first cut-source report is wrong, returning to the step of executing the judgment whether the difference exists between the middle layer data after cutting the source and the middle layer data before cutting the source;
and if the first verification result shows that the data in the first cut source report is correct, ending the current cut source.
4. The method for slicing the source according to claim 2, wherein if it is determined that there is no difference between the intermediate layer data after slicing the source and the intermediate layer data before slicing the source, processing the intermediate layer data after slicing the source into an application layer data model to obtain a second sliced source report, further comprising:
receiving a second verification result; the second verification result indicates whether the data in the second cut-source report form is wrong or not;
if the second verification result shows that the data in the second cut source report is wrong, returning to the step of executing the judgment whether the intermediate layer data after cutting the source and the intermediate layer data before cutting the source have difference or not;
and if the second verification result shows that the data in the second cut source report is correct, ending the current cut source.
5. A source cutting device for a base data platform, comprising:
the acquisition unit is used for acquiring the base layer data of the base data platform;
the first processing unit is used for processing the basic layer data of the basic data platform into an intermediate layer data model of a target system according to a preset storage mode to obtain intermediate layer data after source cutting;
the judging unit is used for judging whether the intermediate layer data after source cutting and the intermediate layer data before source cutting have differences or not;
the determining unit is used for determining the reason for the difference if the judging unit judges that the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting;
the correction unit is used for correcting the intermediate layer data after source cutting according to the solution corresponding to the reason to obtain corrected intermediate layer data;
and the second processing unit is used for processing the corrected middle layer data into the application layer data model to obtain the first source cutting report.
6. The source cutting device of claim 5, further comprising:
and the second processing unit is further configured to process the intermediate layer data after source cutting into an application layer data model to obtain a second source cutting report if the judging unit judges that the intermediate layer data after source cutting has no difference from the intermediate layer data before source cutting.
7. The source cutting device of claim 5, further comprising:
the first receiving unit is used for receiving a first verification result; the first verification result indicates whether the data in the first all-source report form is wrong or not;
the first activating unit activates the judging unit to judge whether the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting or not if the first verification result shows that the data in the first source cutting report is wrong;
and the first ending unit is used for ending the current cut source if the first verification result shows that the data in the first cut source report is correct.
8. The source cutting device of claim 6, further comprising:
a second receiving unit, configured to receive a second verification result; the second verification result indicates whether the data in the second cut-source report form is wrong or not;
the second activating unit is used for activating the judging unit to judge whether the intermediate layer data after source cutting and the intermediate layer data before source cutting are different or not if the second verification result shows that the data in the second source cutting report is wrong;
and the second ending unit is used for ending the current cut source if the second verification result shows that the data in the second cut source report is correct.
9. An electronic device, comprising:
one or more processors;
a storage device having one or more programs stored thereon;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of source-cutting of a base data platform as claimed in any one of claims 1 to 4.
10. A computer storage medium, having stored thereon a computer program, wherein the computer program when executed by a processor implements the method of source cutting of a basic data platform according to any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110850015.7A CN113486020B (en) | 2021-07-27 | 2021-07-27 | Source cutting method of basic data platform, related device and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110850015.7A CN113486020B (en) | 2021-07-27 | 2021-07-27 | Source cutting method of basic data platform, related device and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113486020A CN113486020A (en) | 2021-10-08 |
| CN113486020B true CN113486020B (en) | 2024-02-23 |
Family
ID=77944001
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110850015.7A Active CN113486020B (en) | 2021-07-27 | 2021-07-27 | Source cutting method of basic data platform, related device and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113486020B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105631004A (en) * | 2015-12-28 | 2016-06-01 | 华夏银行股份有限公司 | Data processing method and system |
| CN107197174A (en) * | 2017-05-12 | 2017-09-22 | 西安诺瓦电子科技有限公司 | Video controller and video control method |
| CN108702660A (en) * | 2016-05-11 | 2018-10-23 | Oppo广东移动通信有限公司 | Communication means, terminal device and the network equipment |
| CN110489406A (en) * | 2019-07-29 | 2019-11-22 | 天闻数媒科技（湖南）有限公司 | A kind of basic data cleaning and synchronous method, apparatus and storage medium |
| CN111782251A (en) * | 2020-08-18 | 2020-10-16 | 广联达科技股份有限公司 | Software function module updating method and device and computer equipment |
-
2021
- 2021-07-27 CN CN202110850015.7A patent/CN113486020B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105631004A (en) * | 2015-12-28 | 2016-06-01 | 华夏银行股份有限公司 | Data processing method and system |
| CN108702660A (en) * | 2016-05-11 | 2018-10-23 | Oppo广东移动通信有限公司 | Communication means, terminal device and the network equipment |
| CN107197174A (en) * | 2017-05-12 | 2017-09-22 | 西安诺瓦电子科技有限公司 | Video controller and video control method |
| CN110489406A (en) * | 2019-07-29 | 2019-11-22 | 天闻数媒科技（湖南）有限公司 | A kind of basic data cleaning and synchronous method, apparatus and storage medium |
| CN111782251A (en) * | 2020-08-18 | 2020-10-16 | 广联达科技股份有限公司 | Software function module updating method and device and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113486020A (en) | 2021-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105159657B (en) | Handle the method and system of message | |
| CN105095384B (en) | The method and apparatus that data are carried down | |
| CN113486020B (en) | Source cutting method of basic data platform, related device and computer storage medium | |
| CN111309506A (en) | Method, equipment, server and readable storage medium for positioning compiling errors | |
| CN110602165A (en) | Government affair data synchronization method, device, system, computer equipment and storage medium | |
| CN113704577A (en) | Data query method and device based on multithreading concurrent processing | |
| US9094425B2 (en) | Electronic messaging backup catalog | |
| CN111078677B (en) | Data entry method and device | |
| CN114626683A (en) | Product update message notification method and device based on RPA and AI and electronic equipment | |
| CN110968548A (en) | Data correction method, device, storage medium and processor | |
| CN110941623A (en) | Data synchronization method and device | |
| GB0224357D0 (en) | Image processing | |
| CN113900842A (en) | Message consumption method and device, electronic equipment and computer storage medium | |
| CN110647463B (en) | Method and device for restoring test breakpoint and electronic equipment | |
| CN108959657B (en) | Data change processing method and device | |
| CN112579556A (en) | Daily cutting data unloading method, device, equipment and medium | |
| CN110517010B (en) | Data processing method, system and storage medium | |
| CN115391360A (en) | Data management method, system and electronic equipment | |
| CN112115175B (en) | Cloud service product processing method and device, electronic equipment and storage medium | |
| CN110069539B (en) | Data association method and system | |
| CN111143311B (en) | Inter-application association determination and log association search methods, devices, media and equipment | |
| CN111427720A (en) | Database repair method and device, computer equipment and storage medium | |
| CN108494978B (en) | Agent task management method and device, computer equipment and storage medium | |
| CN112367302A (en) | Identity authentication method and system suitable for chrome browser | |
| CN111176576A (en) | Metadata modification method, device, equipment and storage medium of storage volume |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |