CN107798120B - Data conversion method and device - Google Patents

Data conversion method and device Download PDF

Info

Publication number
CN107798120B
CN107798120B CN201711103217.5A CN201711103217A CN107798120B CN 107798120 B CN107798120 B CN 107798120B CN 201711103217 A CN201711103217 A CN 201711103217A CN 107798120 B CN107798120 B CN 107798120B
Authority
CN
China
Prior art keywords
job flow
change configuration
generating
parameter
configuration parameters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711103217.5A
Other languages
Chinese (zh)
Other versions
CN107798120A (en
Inventor
孙百仪
陈亚坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bank of China Ltd
Original Assignee
Bank of China Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bank of China Ltd filed Critical Bank of China Ltd
Priority to CN201711103217.5A priority Critical patent/CN107798120B/en
Publication of CN107798120A publication Critical patent/CN107798120A/en
Application granted granted Critical
Publication of CN107798120B publication Critical patent/CN107798120B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/258Data format conversion from or to a database

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Stored Programmes (AREA)

Abstract

The invention provides a data conversion method and device, and relates to the technical field of data processing of bank systems. The method comprises the following steps: acquiring a table change configuration parameter input by a user, and generating a parameter file according to the table change configuration parameter; the parameter file comprises the table change configuration parameters which comprise all items to be changed; generating a to-be-executed operation flow sequence of each to-be-changed item according to the parameter file; and calling up the to-be-executed job flow sequence according to a preset sequence, and changing the data in the database table into target data corresponding to the table change configuration parameters. Therefore, during data conversion, only the operation and maintenance personnel need to input the table to change the configuration parameters, then the data conversion is automatically completed, a set of new operation flow is not required to be re-developed every time of data conversion, the problems that the operation and maintenance personnel establish a large number of operation flows, the operation and maintenance personnel need to manually submit the operation in each flow, the process is complicated, and mistakes are easily made are avoided.

Description

Data conversion method and device
Technical Field
The invention relates to the technical field of data processing of bank systems, in particular to a data conversion method and device.
Background
In the technical field of data processing of bank systems, data conversion refers to a data processing method for adapting stock data to new business requirements by changing the form or content of the stock data when the system changes the existing table structure or stock data content in order to meet the business requirements. The data conversion is mainly to realize the business and technical requirements of the bank system. Firstly, on a service level, data conversion mainly relates to the change of service data values and the new increase of service types. The data value change mainly changes the data range, for example, after the number of the clients in the harbor and australia station is increased gradually, the value range of the original client certificate type is expanded, and the commuting permit of the harbor and australia residents and the commuting permit of the taiwan residents are increased on the basis of the original identity card of the residents so as to carry out subsequent maintenance and statistics. The new increase of the service type is mainly to add columns to the original data table, for example, to add associated card information fields to the client master table, and to add columns to the client master table to store associated card information when the reserved fields of the original data table are insufficient. In terms of technical requirements, the capacity of the table partitions is expanded to realize optimization of data storage space and performance.
Currently, the data conversion method in the prior art is mainly implemented by writing a job flow, that is, the method includes the following steps: firstly, storing the data of the old data table into a file; processing the file data according to the requirement; deleting the old data table and establishing a new data table; fourthly, storing the processed file data into a new data table. Since the data table has different traffic data volume and partition number, a new set of job flow needs to be re-developed every data conversion. Because the data volume of the data table in the bank system is huge, operation and maintenance personnel are required to establish a large number of operation flows, and each flow requires the operation and maintenance personnel to manually submit the operation, the process is complicated, and mistakes are easily made.
Disclosure of Invention
The embodiment of the invention provides a data conversion method and a data conversion device, and aims to solve the problems that the data size of a data table in a current bank system is huge, operation and maintenance personnel are required to establish a large number of operation flows, each flow requires the operation and maintenance personnel to manually submit the operation, the process is complicated, and errors are easy to occur.
In order to achieve the purpose, the invention adopts the following technical scheme:
a method of data conversion, comprising:
acquiring a table change configuration parameter input by a user, and generating a parameter file according to the table change configuration parameter; the parameter file comprises the table change configuration parameters which comprise all items to be changed;
generating a to-be-executed operation flow sequence of each to-be-changed item according to the parameter file;
and calling up the to-be-executed job flow sequence according to a preset sequence, and changing the data in the database table into target data corresponding to the table change configuration parameters.
Specifically, each item to be changed in the table change configuration parameter includes: database table name, whether table structure changes items, table building statement file name, whether partition items, partition mode, whether parallel items exist, parallel mode configuration file name, parallelism, whether program processing items are needed and program name.
Further, after obtaining the table change configuration parameters input by the user and generating the parameter file according to the table change configuration parameters, the method further includes:
determining the accuracy of the table change configuration parameters in the parameter file according to a preset parameter verification strategy;
and generating an error indication message when the table change configuration parameters are inaccurate.
Specifically, the generating a to-be-executed job flow sequence of each to-be-changed item according to the parameter file includes:
and generating an UNLOAD job flow, a file processing job flow, a SPUFI job flow and a LOAD job flow for processing the item to be changed according to the parameter file.
Specifically, the invoking the to-be-executed job flow sequence according to the preset sequence and changing the data in the database table into the target data corresponding to the table change configuration parameter includes:
and sequentially calling and executing the UNLOAD job flow file processing job flow, the SPUFI job flow and the LOAD job flow so as to change the data in the database table into target data corresponding to the table change configuration parameters.
A data conversion apparatus comprising:
the parameter file generating unit is used for acquiring the table change configuration parameters input by a user and generating a parameter file according to the table change configuration parameters; the parameter file comprises the table change configuration parameters which comprise all items to be changed;
a to-be-executed job flow sequence generating unit, configured to generate a to-be-executed job flow sequence of each to-be-changed item according to the parameter file;
and the data conversion unit is used for calling the to-be-executed job flow sequence according to a preset sequence and changing the data in the database table into target data corresponding to the table change configuration parameters.
Specifically, each item to be changed in the table change configuration parameter in the parameter file generating unit includes: database table name, whether table structure changes items, table building statement file name, whether partition items, partition mode, whether parallel items exist, parallel mode configuration file name, parallelism, whether program processing items are needed and program name.
In addition, the apparatus further comprises a parameter checking unit configured to:
determining the accuracy of the table change configuration parameters in the parameter file according to a preset parameter verification strategy;
and generating an error indication message when the table change configuration parameters are inaccurate.
In addition, the to-be-executed job flow sequence generating unit is specifically configured to:
and generating an UNLOAD job flow, a file processing job flow, a SPUFI job flow and a LOAD job flow for processing the item to be changed according to the parameter file.
In addition, the data conversion unit is specifically configured to:
and sequentially calling and executing the UNLOAD job flow file processing job flow, the SPUFI job flow and the LOAD job flow so as to change the data in the database table into target data corresponding to the table change configuration parameters.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
acquiring a table change configuration parameter input by a user, and generating a parameter file according to the table change configuration parameter; the parameter file comprises the table change configuration parameters which comprise all items to be changed;
generating a to-be-executed operation flow sequence of each to-be-changed item according to the parameter file;
and calling up the to-be-executed job flow sequence according to a preset sequence, and changing the data in the database table into target data corresponding to the table change configuration parameters.
A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps when executing the program of:
acquiring a table change configuration parameter input by a user, and generating a parameter file according to the table change configuration parameter; the parameter file comprises the table change configuration parameters which comprise all items to be changed;
generating a to-be-executed operation flow sequence of each to-be-changed item according to the parameter file;
and calling up the to-be-executed job flow sequence according to a preset sequence, and changing the data in the database table into target data corresponding to the table change configuration parameters.
The embodiment of the invention provides a data conversion method and a data conversion device, firstly, table change configuration parameters input by a user are obtained, and a parameter file is generated according to the table change configuration parameters; the parameter file comprises the table change configuration parameters which comprise all items to be changed; then, generating a to-be-executed job flow sequence of each to-be-changed item according to the parameter file; and calling up the to-be-executed job flow sequence according to a preset sequence, and changing the data in the database table into target data corresponding to the table change configuration parameters. Therefore, during data conversion, only operation and maintenance personnel (namely users) are required to input the table to change configuration parameters, so that the data conversion can be automatically completed, a set of new workflow is not required to be re-developed every time of data conversion, the problems that the operation and maintenance personnel are required to establish a large number of workflows due to the huge data volume of the data table in the current bank system, the operation and maintenance personnel are required to manually submit the operation in each flow, and the process is complicated and is easy to make mistakes are solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a first flowchart of a data conversion method according to an embodiment of the present invention;
fig. 2 is a second flowchart of a data conversion method according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a data conversion apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a data conversion method, including:
step 101, obtaining a table change configuration parameter input by a user, and generating a parameter file according to the table change configuration parameter.
The parameter file comprises the table change configuration parameters, and the table change configuration parameters comprise items to be changed.
And 102, generating a to-be-executed job flow sequence of each to-be-changed item according to the parameter file.
103, calling the to-be-executed job flow sequence according to a preset sequence, and changing the data in the database table into target data corresponding to the table change configuration parameters.
The embodiment of the invention provides a data conversion method, which comprises the steps of firstly obtaining table change configuration parameters input by a user, and generating a parameter file according to the table change configuration parameters; the parameter file comprises the table change configuration parameters which comprise all items to be changed; then, generating a to-be-executed job flow sequence of each to-be-changed item according to the parameter file; and calling up the to-be-executed job flow sequence according to a preset sequence, and changing the data in the database table into target data corresponding to the table change configuration parameters. Therefore, during data conversion, only operation and maintenance personnel (namely users) are required to input the table to change configuration parameters, so that the data conversion can be automatically completed, a set of new workflow is not required to be re-developed every time of data conversion, the problems that the operation and maintenance personnel are required to establish a large number of workflows due to the huge data volume of the data table in the current bank system, the operation and maintenance personnel are required to manually submit the operation in each flow, and the process is complicated and is easy to make mistakes are solved.
In order to make the present invention better understood by those skilled in the art, a more detailed embodiment is listed below, and as shown in fig. 2, an embodiment of the present invention provides a data conversion method, including:
step 201, obtaining a table change configuration parameter input by a user, and generating a parameter file according to the table change configuration parameter.
The parameter file comprises the table change configuration parameters, and the table change configuration parameters comprise items to be changed.
Specifically, each item to be changed in the table change configuration parameter may include: database table name, whether table structure changes items, table building statement file name, whether partition items, partition mode, whether parallel items exist, parallel mode configuration file name, parallelism, whether program processing items are needed and program name.
Here, the user may refer to a bank system operation and maintenance person in the data conversion process, and the user may perform the input of the form change configuration parameters through the system interface, for example, the form change configuration parameters in the system interface may be as shown in table 1 below:
table 1:
Figure GDA0003426308200000051
Figure GDA0003426308200000061
in the parallel configuration file, the start and stop number segments are separated by "|", and the total number is 50, as follows:
SYSTEM.SJZH.CONFIG.PRM(CARD001)
0000000000000000000|0000000000030000000
0000000000030000001|0000000000060000000
0000000000060000001|0000000000090000000
……
0000000001200000001|0000000001500000000
in addition, before step 201, the operation and maintenance personnel may need to prepare the DDL statement (i.e. definition statement of data table) of the new data base table that needs data conversion, and the stock data file handler and various job templates, but not limited thereto. If the data table structure is not changed, no new table DDL statement needs to be prepared.
Step 202, determining the accuracy of the table change configuration parameters in the parameter file according to a preset parameter verification strategy, and generating an error indication message when the table change configuration parameters are not accurate.
Here, the following method can be adopted to determine the accuracy of the table change configuration parameters in the parameter file, taking the contents shown in table 1 as an example:
firstly, reading the parameter file, judging whether the database table exists or not, if not, reporting an error, and if not, prompting the error if the table name field is not input. The data conversion is based on the existence of the old table, so the table name in the parameter needs to exist in the system.
And judging whether system, ddl, prm (CARD) and system, sjzhh, src (zhcad 01) exist (namely, the file name and program name of the table building statement in the interface), and if not, reporting an error.
And thirdly, judging whether the system, SJZH, CONFIG, PRM (CARD001) exists (file names are configured in a parallel mode in the interface), if not, reporting an error, if so, judging whether the number of records is equal to 50 (the number of records should be consistent with the parallelism), and if not, reporting an error.
Judging that each number segment in the SYSTEM.SJZH.CONFIG.PRM (CARD001) has no cross and complete coverage record, otherwise, reporting an error.
For example, if the segment number 1 is 0000000000000000000-.
For another example, if the number segment 1 is 0000000000000000000-.
Step 203, after determining that the table in the parameter file changes the configuration parameters accurately, generating an UNLOAD job flow, a file processing job flow, a SPUPI job flow and a LOAD job flow for processing the item to be changed according to the parameter file.
The UNLOAD refers to a process of storing database inventory data into a file in a mode of calling a job. And LOAD refers to a process of storing data in the processed stock data file into a database table in a job calling manner. While SPUFII (SQL Processing Using File Input) is a database access tool provided by IBM corporation that can execute SQL statements.
For the content shown in table 1 above, this step 203 can be implemented as follows:
first, taking the database table CARD in table 1 as an example, a UNLOAD job flow with a parallelism of 50 is generated from an UNLOAD job template and a parameter file, and the table name in the template is replaced with CARD.
Generating a file processing job flow, wherein the parallelism is 50, and the template replacing content is a program name ZBCARD01 and a parallel mode configuration file start and stop number segment.
The first job uses the number segment to be 0000000000000000000 and 0000000000030000000;
the second operation uses the number segment as 0000000000030000001 and 0000000000060000000;
by analogy, the last operation number section is 0000000001200000001 and 0000000001500000000.
Invoking the SPUFI tool to execute SQL statement deletion in SYSTEM, DDL, PRM (CARD) to build new table and index.
And fourthly, replacing the table name in the LOAD job template and generating the LOAD job flow with the parallelism of 50.
And step 204, sequentially calling and executing the UNLOAD job flow file processing job flow, the SPUFI job flow and the LOAD job flow so as to change the data in the database table into the target data corresponding to the table change configuration parameters.
In step 204, the UNLOAD job flow, the file processing job flow, the SPUFI work job, and the LOAD job flow determined in step 203 above may be sequentially performed, thereby completing data conversion.
According to the embodiment of the invention, when data conversion is carried out, only operation and maintenance personnel (namely users) are required to input the table to change the configuration parameters, so that the data conversion can be automatically completed, a new set of workflow is not required to be developed again for each data conversion, and the problems that the data quantity of the data table in the current bank system is huge, the operation and maintenance personnel are required to establish a large number of workflows, the operation and maintenance personnel are required to manually submit the operation in each flow, the process is complicated and errors are easy to occur are solved.
Therefore, it can be seen through the foregoing embodiments of the present invention that, as business development and customer experience requirements are improved, data change requirements are continuously met, and how to improve efficiency and implement automation and multiplexing are targets that need to be focused on in order to solve the practical problems of reduced host resources, large development workload, and the like at present, the embodiments of the present invention have the following advantages based on the target concept:
the method is easy to implement, operation and maintenance personnel only need to complete differentiated program operation of data conversion processing to provide DDL statements, and other processes are automatically completed by the embodiment of the invention.
The development cost can be saved, the development period is shortened, the differentiated processing procedures and operations are eliminated, the template operation is automatically generated in a customized mode (customization means that parameters in the template are customized, individual processing differentiation is achieved), and the development workload is reduced.
And thirdly, multiplexing is realized, differential processing of data conversion is realized through parameter configuration, and the data conversion is changed into multiplexing once, so that the resource occupation and the management cost are reduced.
And fourthly, the customization error risk is reduced, and the embodiment of the invention realizes template operation customization through parameters, and is more efficient and accurate than manual customization.
Corresponding to the method embodiments described in fig. 1 and fig. 2, as shown in fig. 3, an embodiment of the present invention further provides a data conversion apparatus, including:
a parameter file generating unit 31, configured to acquire a table change configuration parameter input by a user, and generate a parameter file according to the table change configuration parameter; the parameter file comprises the table change configuration parameters, and the table change configuration parameters comprise the items to be changed.
And a to-be-executed job flow sequence generating unit 32, configured to generate a to-be-executed job flow sequence of each item to be changed according to the parameter file.
And the data conversion unit 33 is configured to invoke the to-be-executed job flow sequence according to a preset sequence, and change the data in the database table into the target data corresponding to the table change configuration parameter.
Specifically, each item to be changed in the table change configuration parameters in the parameter file generating unit 31 includes: database table name, whether table structure changes items, table building statement file name, whether partition items, partition mode, whether parallel items exist, parallel mode configuration file name, parallelism, whether program processing items are needed and program name.
Furthermore, as shown in fig. 3, the apparatus further comprises a parameter checking unit 34 for:
and determining the accuracy of the table change configuration parameters in the parameter file according to a preset parameter verification strategy.
And generating an error indication message when the table change configuration parameters are inaccurate.
In addition, the to-be-executed job flow sequence generating unit 32 is specifically configured to:
and generating an UNLOAD job flow, a file processing job flow, a SPUFI job flow and a LOAD job flow for processing the item to be changed according to the parameter file.
In addition, the data conversion unit 33 is specifically configured to:
and sequentially calling and executing the UNLOAD job flow file processing job flow, the SPUFI job flow and the LOAD job flow so as to change the data in the database table into target data corresponding to the table change configuration parameters.
According to the embodiment of the invention, when data conversion is carried out, only operation and maintenance personnel (namely users) are required to input the table to change the configuration parameters, so that the data conversion can be automatically completed, a new set of workflow is not required to be developed again for each data conversion, and the problems that the data quantity of the data table in the current bank system is huge, the operation and maintenance personnel are required to establish a large number of workflows, the operation and maintenance personnel are required to manually submit the operation in each flow, the process is complicated and errors are easy to occur are solved.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the following steps:
acquiring a table change configuration parameter input by a user, and generating a parameter file according to the table change configuration parameter; the parameter file comprises the table change configuration parameters, and the table change configuration parameters comprise the items to be changed.
And generating a to-be-executed operation flow sequence of each to-be-changed item according to the parameter file.
And calling up the to-be-executed job flow sequence according to a preset sequence, and changing the data in the database table into target data corresponding to the table change configuration parameters.
In addition, an embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the following steps when executing the program:
acquiring a table change configuration parameter input by a user, and generating a parameter file according to the table change configuration parameter; the parameter file comprises the table change configuration parameters, and the table change configuration parameters comprise the items to be changed.
And generating a to-be-executed operation flow sequence of each to-be-changed item according to the parameter file.
And calling up the to-be-executed job flow sequence according to a preset sequence, and changing the data in the database table into target data corresponding to the table change configuration parameters.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principle and the implementation mode of the invention are explained by applying specific embodiments in the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (8)

1. A method of data conversion, comprising:
acquiring a table change configuration parameter input by a user, and generating a parameter file according to the table change configuration parameter; the parameter file comprises the table change configuration parameters which comprise all items to be changed;
generating a plurality of to-be-executed job flow sequences for processing each to-be-changed project according to the parameter file;
calling up the to-be-executed job flow sequence according to a preset sequence, and changing data in a database table into target data corresponding to table change configuration parameters;
generating a plurality of to-be-executed job flow sequences for processing each to-be-changed project according to the parameter file, wherein the generating comprises the following steps of: generating an UNLOAD job flow, a file processing job flow, SPUFI work operation and a LOAD job flow for processing the item to be changed according to the parameter file;
each item to be changed in the table change configuration parameters comprises: database table name, whether table structure changes items, table building statement file name, whether partition items, partition mode, whether parallel items exist, parallel mode configuration file name, parallelism, whether program processing items are needed and program name.
2. The data conversion method according to claim 1, wherein after acquiring the table change configuration parameters input by the user and generating the parameter file according to the table change configuration parameters, the method further comprises:
determining the accuracy of the table change configuration parameters in the parameter file according to a preset parameter verification strategy;
and generating an error indication message when the table change configuration parameters are inaccurate.
3. The data conversion method according to claim 2, wherein the invoking the to-be-executed job flow sequence according to a preset sequence, and changing data in a database table into target data corresponding to a table change configuration parameter comprises:
and sequentially calling and executing the UNLOAD job flow file processing job flow, the SPUFI job flow and the LOAD job flow so as to change the data in the database table into target data corresponding to the table change configuration parameters.
4. A data conversion apparatus, comprising:
the parameter file generating unit is used for acquiring the table change configuration parameters input by a user and generating a parameter file according to the table change configuration parameters; the parameter file comprises the table change configuration parameters which comprise all items to be changed;
a to-be-executed job flow sequence generating unit, configured to generate, according to the parameter file, a plurality of to-be-executed job flow sequences for processing each to-be-changed project;
the data conversion unit is used for calling the job flow sequence to be executed according to a preset sequence and changing data in the database table into target data corresponding to the table change configuration parameters;
generating a plurality of to-be-executed job flow sequences for processing each to-be-changed project according to the parameter file, wherein the generating comprises the following steps of: generating an UNLOAD job flow, a file processing job flow, SPUFI work operation and a LOAD job flow for processing the item to be changed according to the parameter file;
each item to be changed in the table change configuration parameters in the parameter file generation unit comprises: database table name, whether table structure changes items, table building statement file name, whether partition items, partition mode, whether parallel items exist, parallel mode configuration file name, parallelism, whether program processing items are needed and program name.
5. The data conversion device of claim 4, further comprising a parameter checking unit configured to:
determining the accuracy of the table change configuration parameters in the parameter file according to a preset parameter verification strategy;
and generating an error indication message when the table change configuration parameters are inaccurate.
6. The data conversion apparatus according to claim 5, wherein the data conversion unit is specifically configured to:
and sequentially calling and executing the UNLOAD job flow file processing job flow, the SPUFI job flow and the LOAD job flow so as to change the data in the database table into target data corresponding to the table change configuration parameters.
7. A computer-readable storage medium, on which a computer program is stored, which program, when executed by a processor, carries out the steps of:
acquiring a table change configuration parameter input by a user, and generating a parameter file according to the table change configuration parameter; the parameter file comprises the table change configuration parameters which comprise all items to be changed;
generating a plurality of to-be-executed job flow sequences for processing each to-be-changed project according to the parameter file;
calling up the to-be-executed job flow sequence according to a preset sequence, and changing data in a database table into target data corresponding to table change configuration parameters;
generating a plurality of to-be-executed job flow sequences for processing each to-be-changed project according to the parameter file, wherein the generating comprises the following steps of: and generating an UNLOAD job flow, a file processing job flow, a SPUFI job flow and a LOAD job flow for processing the item to be changed according to the parameter file.
8. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program performs the steps of:
acquiring a table change configuration parameter input by a user, and generating a parameter file according to the table change configuration parameter; the parameter file comprises the table change configuration parameters which comprise all items to be changed;
generating a plurality of to-be-executed job flow sequences for processing each to-be-changed project according to the parameter file;
calling up the to-be-executed job flow sequence according to a preset sequence, and changing data in a database table into target data corresponding to table change configuration parameters;
generating a plurality of to-be-executed job flow sequences for processing each to-be-changed project according to the parameter file, wherein the generating comprises the following steps of: and generating an UNLOAD job flow, a file processing job flow, a SPUFI job flow and a LOAD job flow for processing the item to be changed according to the parameter file.
CN201711103217.5A 2017-11-10 2017-11-10 Data conversion method and device Active CN107798120B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711103217.5A CN107798120B (en) 2017-11-10 2017-11-10 Data conversion method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711103217.5A CN107798120B (en) 2017-11-10 2017-11-10 Data conversion method and device

Publications (2)

Publication Number Publication Date
CN107798120A CN107798120A (en) 2018-03-13
CN107798120B true CN107798120B (en) 2022-01-21

Family

ID=61535850

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711103217.5A Active CN107798120B (en) 2017-11-10 2017-11-10 Data conversion method and device

Country Status (1)

Country Link
CN (1) CN107798120B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109472680A (en) * 2018-10-26 2019-03-15 中国银行股份有限公司 A kind of accounting processing method and system
CN109739916A (en) * 2018-12-29 2019-05-10 中国银行股份有限公司 Data loading or unloading method and device
CN110618988B (en) * 2019-09-20 2022-09-23 中国银行股份有限公司 Data processing method and device based on big data platform
CN111949614B (en) * 2020-08-12 2024-04-02 中国工商银行股份有限公司 Bank system file conversion method and device

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090125692A1 (en) * 2007-10-24 2009-05-14 Masayuki Yamamoto Backup system and method
CN102375891A (en) * 2011-11-15 2012-03-14 山东浪潮金融信息***有限公司 Implementation tool for unloading and loading incremental data
CN103124381B (en) * 2011-11-18 2018-06-15 中兴通讯股份有限公司 Business collocation method and system
CN103135976B (en) * 2011-11-30 2016-05-11 阿里巴巴集团控股有限公司 code automatic generation method and device
US9218370B2 (en) * 2013-04-19 2015-12-22 International Business Machines Corporation Processing data loads
CN103995854A (en) * 2014-05-13 2014-08-20 大唐移动通信设备有限公司 Equipment cross-version upgrading method and device
CN104007984B (en) * 2014-06-20 2017-06-16 中国银行股份有限公司 A kind of method and device of change data
MY188208A (en) * 2014-06-26 2021-11-24 Mimos Berhad System and method for managing change data in database
CN105320680A (en) * 2014-07-15 2016-02-10 ***通信集团公司 Data synchronization method and device
CN104331309B (en) * 2014-10-31 2018-04-17 北京思特奇信息技术股份有限公司 It is a kind of to configure the management method and system for realizing data add-in shell
CN106156047B (en) * 2015-03-27 2019-10-29 ***通信集团福建有限公司 A kind of SNAPSHOT INFO processing method and processing device
CN106020801B (en) * 2016-05-12 2020-11-10 祝冠英 Graphic fourth generation language and application generation system thereof

Also Published As

Publication number Publication date
CN107798120A (en) 2018-03-13

Similar Documents

Publication Publication Date Title
CN107798120B (en) Data conversion method and device
EP3353672B1 (en) Method and apparatus for transferring data between databases
US9135071B2 (en) Selecting processing techniques for a data flow task
CN106649828B (en) Data query method and system
US10120658B2 (en) Method and system for realizing software development tasks
CN106446019B (en) A kind of software function treating method and apparatus
US20140222766A1 (en) System and method for database migration and validation
CN106557307B (en) Service data processing method and system
CN110471754A (en) Method for exhibiting data, device, equipment and storage medium in job scheduling
CN104317957A (en) Open platform and system for processing reports and report processing method
CN111190814B (en) Method and device for generating software test case, storage medium and terminal
CN110738038A (en) Contract text generation method, device, equipment and computer readable storage medium
CN111782404A (en) Data processing method and related equipment
JPWO2017090475A1 (en) Information processing system, function creation method, and function creation program
CN111435367A (en) Knowledge graph construction method, system, equipment and storage medium
CN110134646B (en) Knowledge platform service data storage and integration method and system
CN111078573A (en) Test message generation method and device
CN107766519B (en) Method for visually configuring data structure
CN103809947B (en) A kind of method for automatically releasing of development requirement and system
CN111209283A (en) Data processing method and device
CN110928941A (en) Data fragment extraction method and device
CN109389271B (en) Application performance management method and system
CN114138787A (en) Bar code identification method, equipment and medium
CN109150571B (en) Grid mapping method and device
CN113010489A (en) Data migration method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant