CN107229721B - A kind of method and device changing data pick-up - Google Patents
A kind of method and device changing data pick-up Download PDFInfo
- Publication number
- CN107229721B CN107229721B CN201710409482.XA CN201710409482A CN107229721B CN 107229721 B CN107229721 B CN 107229721B CN 201710409482 A CN201710409482 A CN 201710409482A CN 107229721 B CN107229721 B CN 107229721B
- Authority
- CN
- China
- Prior art keywords
- data
- time
- extraction
- major key
- increment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses the method and devices of change data pick-up, comprising: obtains the information of the data of source database；The time field of combined data carries out full dose extraction to source database, the data of extraction is transferred to target database；The mode field of combined data obtains the record major key of the data in target database in upset condition, and record major key is stored in the second tables of data；Increment extraction is carried out to source database, the data of extraction are transferred to target database；The corresponding data of major key will be recorded to delete from target database, the extraction of data is re-started from source database according to record major key, the data of extraction are transferred to target database；The record major key in the second tables of data is emptied, the record major key of the data in target database in upset condition is reacquired, and is stored in the second tables of data.It when solving prior art data increment extraction, modifies to source database, influences the problem of source system business is normally carried out.
Description
Technical field
The present invention relates to database technical fields, more particularly, to a kind of method and device for changing data pick-up.
Background technique
Data pick-up work is considered as ETL (Extract-Transform-Load, extraction, conversion and the loading of data)
Process is usually used when multiple systems cooperate.Since not homologous ray is undertaken the construction of or system database class by not commensurate
Type is inconsistent, and often leading to the system newly built directly can not use identical database with original system.Between guarantee system
The normal operation of cooperation, it is therefore desirable to synchronous using the data between Data Extraction Technology carry out system.
Data Extraction Technology needs guarantee that in the case where not influencing the development of original system regular traffic, in real time or timing updates
The database of goal systems.Data pick-up includes full dose extraction and increment extraction two types, when the data volume of tables of data is larger
When, it if carrying out the mode of full dose extraction every time, will lead to that extraction efficiency is low, influence the development of work, therefore in this feelings
It needs to carry out increment extraction under condition.And there is also various problems in data pick-up implementation process for increment extraction.
Existing data increment extraction scheme is mostly (e.g., to modify table knot by making the modification of respective degrees to source database
Structure, the interim table of creation etc.) come what is further implemented, the scheme of these increment extractions has influenced source database to a certain extent
Performance, the source system business of may cause can not normally carry out.Therefore, do not allow in the practical operation of data increment extraction pair
Existing database carries out structural change.
Therefore it provides a kind of method and device for changing data pick-up, solves carrying out data increment pumping in the prior art
It when taking, need to modify to source database, to be that this field is urgently to be resolved the problem of influencing the normal development of source system business
The problem of.
Summary of the invention
In view of this, the present invention provides it is a kind of change data pick-up method and device, solve in the prior art into
It when row data increment extraction, need to modify to source database, thus the problem of influencing the normal development of source system business.
In order to solve the above-mentioned technical problem, the present invention proposes a kind of method for changing data pick-up, comprising:
Obtain source database data information, wherein the information of the data, comprising: time field, mode field and
Record major key；
The time for obtaining the source database is denoted as full dose and extracts the time, and the full dose extraction time is stored in the
In one tables of data；
In conjunction with the time field of the data, full dose extraction is carried out to the source database, when obtaining full dose extraction
Between pervious all data, and the data of extraction are transferred to target database；
In conjunction with the mode field of the data, the note of the data in the target database in upset condition is obtained
Major key is recorded, and the record major key is stored in the second tables of data；
The extraction time updated for the last time in first tables of data is obtained, and is taken out the extraction time as increment
Take the time started；
The time for obtaining the source database again is denoted as the increment extraction end time, and the increment extraction is terminated
Time is stored in the first tables of data；
In conjunction with the time field of the data, increment extraction is carried out to the source database, the increment extraction is obtained and opens
Time beginning is transferred to target data to all data between the increment extraction end time, and by the data of extraction
Library；
The record major key in second tables of data is obtained, by the corresponding data of the record major key from target
It is deleted in database, while re-starting the extraction of data from source database according to the record major key, it will be described in extraction
Data are transferred to target database；
The record major key in second tables of data is emptied, in conjunction with the mode field of the data, reacquires institute
The record major key of the data in target database in upset condition is stated, and the record major key newly obtained is stored in
In second tables of data.
Further, the full dose extraction time is stored in the first tables of data, comprising: the full dose is extracted into the time
Generate transmitting variable；Further are as follows:
The time for obtaining the source database is denoted as full dose and extracts the time, and the full dose extraction time, which is changed into, to be had
The full dose for transmitting variable characteristics extracts the time, and the full dose extraction time is stored in the first tables of data.
Further, extraction time last time updated is as the increment extraction time started, comprising: will be last
The extraction time once updated generates transmitting variable；Further are as follows:
Obtain the extraction time updated for the last time in first tables of data, and the extraction that last time is updated
The extraction time as the increment extraction time started, is changed into the increment extraction with transmitting variable characteristics and opened by the time
Begin the time.
Further, the increment extraction end time is stored in the first tables of data, comprising: by the increment extraction
End time generates transmitting variable；Further are as follows:
The time for obtaining the source database again is denoted as the increment extraction end time, at the end of the increment extraction
Between, it is changed into the increment extraction end time with transmitting variable characteristics, and the increment extraction end time is stored
In the first tables of data.
Further, the record major key in second tables of data is obtained, comprising: successively give birth to the record major key
At transmitting variable, further are as follows:
The record major key in second tables of data is obtained, the record major key, which is sequentially generated, has transmitting variable
The record major key of characteristic deletes the corresponding data of the record major key from target database, while according to institute
The extraction that record major key re-starts data from source database is stated, the data of extraction are transferred to target database.
It further include a kind of device for changing data pick-up, which is characterized in that the device includes: data capture unit, full dose
Extract time acquisition unit, full dose extracting unit, record major key storage unit, increment extraction time started acquiring unit, increment
End time acquiring unit, increment extraction unit, target database updating unit and the second tables of data updating unit are extracted,
In；
The data capture unit is connected with the full dose extracting unit and the increment extraction unit, is used for: obtaining
The information of the data of source database, wherein the information of the data, comprising: time field, mode field and record major key；
The full dose extracts time acquisition unit and is connected with the full dose extracting unit, is used for: obtaining the source data
The time in library is denoted as full dose and extracts the time, and the full dose extraction time is stored in the first tables of data；
The full dose extracting unit and the data capture unit, the full dose extract time acquisition unit and the record
Major key storage unit is connected, and is used for: in conjunction with the time field of the data, carrying out full dose extraction to the source database, obtains
It takes the full dose to extract time pervious all data, and the data of extraction is transferred to target database；
The record major key storage unit is connected with the full dose extracting unit and the target database updating unit,
For: in conjunction with the mode field of the data, obtain the record of the data in the target database in upset condition
Major key, and the record major key is stored in the second tables of data；
The increment extraction time started acquiring unit is connected with the increment extraction unit, is used for: obtaining described the
The extraction time updated for the last time in one tables of data, and using the extraction time as the increment extraction time started；
The increment extraction end time acquiring unit is connected with the increment extraction unit, is used for: obtaining institute again
The time for stating source database is denoted as the increment extraction end time, and the increment extraction end time is stored in the first data
In table；
It is the increment extraction unit and the data capture unit, the increment extraction time started acquiring unit, described
Increment extraction end time acquiring unit is connected with the target database updating unit, is used for: in conjunction with the data when
Between field, increment extraction is carried out to the source database, obtain the increment extraction time started terminates to the increment extraction
All data between time, and the data of extraction are transferred to target database；
The target database updating unit and the record major key storage unit, the increment extraction unit and described the
Two tables of data updating units are connected, and are used for: the record major key in second tables of data are obtained, by the record major key
The corresponding data are deleted from target database, while data are re-started from source database according to the record major key
Extraction, the data of extraction are transferred to target database；
The second tables of data updating unit is connected with the target database updating unit, is used for: emptying described
The record major key in two tables of data is reacquired and is in the target database in conjunction with the mode field of the data
The record major key of the data of upset condition, and the record major key newly obtained is stored in the second tables of data.
Further, the full dose extracts time acquisition unit, further are as follows:
The full dose extracts time acquisition unit, is used for: obtaining the time of the source database, when being denoted as full dose extraction
Between, the full dose extraction time is changed into the full dose with transmitting variable characteristics and extracts the time, and the full dose is taken out
The time is taken to be stored in the first tables of data.
Further, the increment extraction time started acquiring unit, further are as follows:
The increment extraction time started acquiring unit, is used for: updating for the last time in acquisition first tables of data
The time is extracted, and using the extraction time of last time update as the increment extraction time started, the extraction time is turned
Become the increment extraction time started with transmitting variable characteristics.
Further, the increment extraction end time acquiring unit, further are as follows:
The increment extraction end time acquiring unit, is used for: obtaining the time of the source database again, is denoted as increment
The end time is extracted, by the increment extraction end time, being changed into the increment extraction with transmitting variable characteristics terminates
Time, and the increment extraction end time is stored in the first tables of data.
Further, the target database updating unit, further are as follows:
The target database updating unit, is used for: the record major key in second tables of data is obtained, it will be described
Record major key sequentially generate with transmitting variable characteristics the record major key, by the corresponding data of the record major key from
It is deleted in target database, while re-starting the extraction of data from source database according to the record major key, by extraction
The data are transferred to target database.
Compared with prior art, the method and device of change data pick-up of the invention, realizes following
The utility model has the advantages that
(1) method and device of change data pick-up of the present invention, by rationally utilizing the time word in tables of data
Section and mode field can carry out corresponding full dose data pick-up or increasing in the case where making no modifications to source database
Data pick-up is measured, realizes that the data between cooperative system are synchronous, it can be ensured that the normal operation of source database business is guaranteeing reliability
While with extraction efficiency, has and realize that difficulty is small, reduces the characteristic of user cost.
(2) method and device of change data pick-up of the present invention, when each data pick-up starts, record data are taken out
The time is taken to extract the end time as this, so that data pick-up is since the end time of last time data pick-up next time, energy
It enough avoids powering off because of destination server in certain time period, the shortage of data problem for causing regular delta to update.
(3) method and device of change data pick-up of the present invention generates the ETL work of variable by having the function of
The corresponding data pick-up time is changed into the data pick-up time with transmitting variable characteristics by tool, the transmitting variable of generation
Data can preferentially be transferred out use, avoid mutually obscuring with the historical data extraction time in tables of data, influence data pick-up
Accuracy.
Certainly, implementing any of the products of the present invention specific needs while must not reach all the above technical effect.
By referring to the drawings to the detailed description of exemplary embodiment of the present invention, other feature of the invention and its
Advantage will become apparent.
Detailed description of the invention
It is combined in the description and the attached drawing for constituting part of specification shows the embodiment of the present invention, and even
With its explanation together principle for explaining the present invention.
Fig. 1 is the flow diagram of the method for the change data pick-up that the embodiment of the present invention 1 provides；
Fig. 2 is the flow diagram of the method for the change data pick-up that the embodiment of the present invention 2 provides；
Fig. 3 is the structural schematic diagram of the device for the change data pick-up that the embodiment of the present invention 3 provides；
Fig. 4 is the structural schematic diagram of the device for the change data pick-up that the embodiment of the present invention 4 provides.
Specific embodiment
Carry out the various exemplary embodiments of detailed description of the present invention now with reference to attached drawing.It should also be noted that unless in addition having
Body explanation, the unlimited system of component and the positioned opposite of step, numerical expression and the numerical value otherwise illustrated in these embodiments is originally
The range of invention.
Be to the description only actually of at least one exemplary embodiment below it is illustrative, never as to the present invention
And its application or any restrictions used.
Technology, method and apparatus known to person of ordinary skill in the relevant may be not discussed in detail, but suitable
In the case of, the technology, method and apparatus should be considered as part of specification.
It is shown here and discuss all examples in, any occurrence should be construed as merely illustratively, without
It is as limitation.Therefore, other examples of exemplary embodiment can have different values.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, then in subsequent attached drawing does not need that it is further discussed.
Embodiment 1
As shown in Figure 1, the method for change data pick-up provided by the present embodiment 1, includes the following steps:
The information of step 101, the data of acquisition source database, wherein the information of the data, comprising: time field, shape
State field and record major key.
Source database is made of mass data, and every data carries data information, before carrying out data pick-up, from
The data information of every data is obtained in source database, so that system carries out at corresponding data according to the data information of acquisition
Reason.The information of the data, comprising: time field: the time generated for identification record data, mode field: for identifying
Whether record data are in upset condition, record major key:, can be from source by the record major key for the record of mark data
Database extracts the corresponding data.
Step 102, the time for obtaining the source database are denoted as full dose and extract the time, and the full dose is extracted the time
It is stored in the first tables of data.
So-called full dose extracts, refer to by data source table or view is intact extracts from source database,
And the format that the ETL tool for being converted into oneself can identify.The time that will acquire the source database is stored in the first tables of data
In, it can be used as the increment extraction time started in later period, transfer use at any time convenient for the later period.
Step 103, the time field in conjunction with the data carry out full dose extraction to the source database, obtain described complete
Amount extracts time pervious all data, and the data of extraction are transferred to target database.
It is right in conjunction with the time field information of the data since each data carry corresponding temporal information
The source database carries out full dose extraction, obtains the full dose and extracts time pervious all data, and the data of extraction are passed
The defeated process that into target database, completion full dose is extracted.
In the present embodiment, ETL tool can carry out data filtering to source database according to the information of the time field of data, take out
It takes, to realize the process of data pick-up.
Step 104, in conjunction with the mode field of the data, obtain described in upset condition in the target database
The record major key of data, and the record major key is stored in the second tables of data.
The mode field is used for: whether identification record data are in upset condition, change when the mode field is in
State illustrates the information of the data record, for example, work order, not yet terminates, therefore mention from target database in transmitting state
The record major key information in upset condition is taken, is stored in the second database, facilitates the calling at any time when later period increment extraction.
In the present embodiment, ETL tool meeting foundation, the information of the mode field of data carries out data mistake to target database
Filter is extracted, to obtain the data for being in upset condition, extracts the respective record major key information of the data.
Step 105 obtains the extraction time updated for the last time in first tables of data, and the extraction time is made
For the increment extraction time started.
Step 106, the time for obtaining the source database again, are denoted as the increment extraction end time, and by the increment
The extraction end time is stored in the first tables of data.
Increment is to record source database increased data than before within this time using a period as measurement unit
Record.So-called increment extraction refers to and extracts the data record increased in this time from source database, and is converted into
The format that the ETL tool of oneself can identify.The time of the source database will be obtained again, at the end of being denoted as increment extraction
Between, it is stored in the first tables of data, can be used as the next increment extraction time started, transfer use at any time convenient for the later period.
Step 107, the time field in conjunction with the data carry out increment extraction to the source database, obtain the increasing
The amount extraction time started is transferred to mesh to all data between the increment extraction end time, and by the data of extraction
Mark database.
The record major key in step 108, acquisition second tables of data, by the corresponding number of the record major key
It is deleted according to from target database, while re-starting the extraction of data from source database according to the record major key, will taken out
The data taken are transferred to target database.
What is stored in second tables of data is that full dose extracted in the period, (in the present embodiment, is indicated: work in upset condition
It is single not yet to be completed in flow regime) data record major key information, in the interval of time extracted by subsequent delta
Afterwards, it is in the data of upset condition before, it is now possible to be partially completed or be fully completed.And at this time in target database
The data information in upset condition of storage was still the state of the extraction data of a upper period, it is therefore desirable to number of targets
It is updated according to library, the data that upset condition is in existing target database is deleted, then foundation records major key from source number
According to the extraction again for carrying out data in library, the data of latest tendency are stored in target database.
Step 109, the record major key emptied in second tables of data are weighed in conjunction with the mode field of the data
Newly obtain the record major key of the data in the target database in upset condition, and the record master that will newly obtain
Key is stored in the second tables of data.
This step realizes the update to the second tables of data, and updated data are convenient for using when next increment extraction.
If continuing second of increment extraction, return step 105 if after completing step 109 is increased next time
The process extracted is measured, the loop structure of increment extraction is formed.
By rationally utilizing time field and mode field in tables of data, in the feelings made no modifications to source database
Under condition, corresponding data pick-up can be carried out, realize that the data between cooperative system are synchronous, it can be ensured that source database business it is normal
Operation has while guaranteeing reliability and extraction efficiency and realizes that difficulty is small, reduces the characteristic of user cost.
Embodiment 2
As shown in Fig. 2, the method for change data pick-up provided by the present embodiment 2, includes the following steps:
The information of step 201, the data of acquisition source database, wherein the information of the data, comprising: time field, shape
State field and record major key.
Source database is made of mass data, and every data carries data information, before carrying out data pick-up, from
The data information of every data is obtained in source database, so that system carries out at corresponding data according to the data information of acquisition
Reason.The information of the data, comprising: time field: the time generated for identification record data, mode field: for identifying
Whether record data are in upset condition, record major key:, can be from source by the record major key for the record of mark data
Database extracts the corresponding data.
Step 202, the time for obtaining the source database are denoted as full dose and extract the time, and the full dose is extracted the time
It is stored in the first tables of data.
So-called full dose extracts, refer to by data source table or view is intact extracts from source database,
And the format that the ETL tool for being converted into oneself can identify.The time that will acquire the source database is stored in the first tables of data
In, it can be used as the increment extraction time started in later period, transfer use at any time convenient for the later period.
In some alternative embodiments, the full dose extraction time is stored in the first tables of data, comprising: will be described
Full dose extracts time generation transmitting variable；Step 202, further are as follows:
The time for obtaining the source database is denoted as full dose and extracts the time, and the full dose extraction time, which is changed into, to be had
The full dose for transmitting variable characteristics extracts the time, and the full dose extraction time is stored in the first tables of data.
If having carried out excessive data pick-up, and deposit in first tables of data before the extraction of this full dose
The data that multiple history extract the time are contained, to avoid the full dose from extracting the data obfuscation of time and history extraction time, this
Embodiment generates the ETL tool of variable by having the function of, the full dose is extracted the time, and being changed into has transmitting variable
The full dose of characteristic extracts the time, in the variable that this step generates, is preferentially transferred out use in can be below the step of.
Step 203, the time field in conjunction with the data carry out full dose extraction to the source database, obtain described complete
Amount extracts time pervious all data, and the data of extraction are transferred to target database.
It is right in conjunction with the time field information of the data since each data carry corresponding temporal information
The source database carries out full dose extraction, obtains the full dose and extracts time pervious all data, and the data of extraction are passed
The defeated process that into target database, completion full dose is extracted.
In the present embodiment, ETL tool can foundation, the information of the time field of data to source database carry out data filtering,
It extracts, to realize the process of data pick-up.
Step 204, in conjunction with the mode field of the data, obtain described in upset condition in the target database
The record major key of data, and the record major key is stored in the second tables of data.
The mode field is used for: whether identification record data are in upset condition, change when the mode field is in
State illustrates the information of the data record, for example, work order, not yet terminates, therefore mention from target database in transmitting state
The record major key information in upset condition is taken, is stored in the second database, facilitates the calling at any time when later period increment extraction.
In the present embodiment, ETL tool meeting foundation, the information of the mode field of data carries out data mistake to target database
Filter is extracted, to obtain the data for being in upset condition, extracts the respective record major key information of the data.
Step 205 obtains the extraction time updated for the last time in first tables of data, and last time is updated
The extraction time is as the increment extraction time started.
In some alternative embodiments, when the extraction time that last time updates being started as increment extraction
Between, comprising: the extraction time for updating last time generates transmitting variable；Step 205, further are as follows:
Obtain the extraction time updated for the last time in first tables of data, and the extraction that last time is updated
The extraction time as the increment extraction time started, is changed into the increment extraction with transmitting variable characteristics and opened by the time
Begin the time.
ETL tool has the function of generating variable, and by ETL tool by the extraction time, being changed into has transmitting change
The increment extraction time started of flow characteristic recalls use in the variable that this step generates, can be below the step of.Afterwards
Phase system obtain the increment extraction time started when, will directly acquire with transmitting variable characteristics the increment extraction start when
Between.
Step 206, the time for obtaining the source database again, are denoted as the increment extraction end time, and by the increment
The extraction end time is stored in the first tables of data.
Increment is to record source database increased data than before within this time using a period as measurement unit
Record.So-called increment extraction refers to and extracts the data record increased in this time from source database, and is converted into
The format that the ETL tool of oneself can identify.The time of the source database will be obtained again, at the end of being denoted as increment extraction
Between, it is stored in the first tables of data, can be used as the next increment extraction time started, transfer use at any time convenient for the later period.
In some alternative embodiments, the increment extraction end time is stored in the first tables of data, comprising: will
The increment extraction end time generates transmitting variable；Step 206, further are as follows:
The time for obtaining the source database again is denoted as the increment extraction end time, at the end of the increment extraction
Between, it is changed into the increment extraction end time with transmitting variable characteristics, and the increment extraction end time is stored
In the first tables of data.
The present embodiment generates the ETL tool of variable by having the function of, by the increment extraction end time, transformation
For the increment extraction end time with transmitting variable characteristics, the later period extracts the pumping of the increment in first tables of data
When taking the end time, will directly it extract the increment extraction end time with transmitting variable characteristics.
Step 207, the time field in conjunction with the data carry out increment extraction to the source database, obtain the increasing
The amount extraction time started is transferred to mesh to all data between the increment extraction end time, and by the data of extraction
Mark database.
The record major key in step 208, acquisition second tables of data, by the corresponding number of the record major key
It is deleted according to from target database, while re-starting the extraction of data from source database according to the record major key, will taken out
The data taken are transferred to target database.
What is stored in second tables of data is that full dose extracted in the period, (in the present embodiment, is indicated: work in upset condition
It is single not yet to be completed in flow regime) data record major key information, in the interval of time extracted by subsequent delta
Afterwards, it is in the data of upset condition before, it is now possible to be partially completed or be fully completed.And at this time in target database
The data information in upset condition of storage was still the state of the extraction data of a upper period, it is therefore desirable to number of targets
It is updated according to library, the data that upset condition is in existing target database is deleted, then foundation records major key from source number
According to the extraction again for carrying out data in library, the data of latest tendency are stored in target database.
In some alternative embodiments, the record major key in second tables of data is obtained, comprising: by the note
Record major key sequentially generates transmitting variable；Step 208, further are as follows:
The record major key in second tables of data is obtained, the record major key, which is sequentially generated, has transmitting variable
The record major key of characteristic deletes the corresponding data of the record major key from target database, while according to institute
The extraction that record major key re-starts data from source database is stated, the data of extraction are transferred to target database.
ETL tool has the function of generating variable, and by ETL tool by the record major key, being changed into has transmitting change
The record major key of flow characteristic recalls use in the variable that this step generates, can be below the step of.
Step 209, the record major key emptied in second tables of data are weighed in conjunction with the mode field of the data
Newly obtain the record major key of the data in the target database in upset condition, and the record master that will newly obtain
Key is stored in the second tables of data.
This step realizes the update to the second tables of data, and updated data are convenient for using when next increment extraction.
If continuing second of increment extraction, return step 205 if after completing step 209 is increased next time
The process extracted is measured, the loop structure of increment extraction is formed.
By having the function of generating the ETL tool of variable, by the corresponding data pick-up time, being changed into, there is transmitting to become
The data pick-up time of flow characteristic, being preferentially transferred out in the variable that data conversion step generates, can be below the step of makes
With, avoid in tables of data historical data extract the time mutually obscure, influence the accuracy of data pick-up.
Embodiment 3
As shown in figure 3, the device 30 of change data pick-up provided by the present embodiment 3, comprising: data capture unit 301,
Full dose extracts time acquisition unit 302, full dose extracting unit 303, record major key storage unit 304, increment extraction time started
Acquiring unit 305, increment extraction end time acquiring unit 306, increment extraction unit 307, target database updating unit 308
With the second tables of data updating unit 309.
The data capture unit 301 is connected with the full dose extracting unit 303 and the increment extraction unit 307,
Since source database is made of mass data, every data carries data information, before carrying out data pick-up, the number
It is used for according to acquiring unit 301: obtaining the information of the data of the source database, so that system is carried out according to the data information of acquisition
Corresponding data processing, wherein the information of the data, comprising: the time field of the time for the generation of identification record data,
The record major key of record for the mode field of identification record data movement state and for mark data；The data that will acquire
Information be transmitted to the full dose extracting unit 303 and the increment extraction unit 307.
The full dose extracts time acquisition unit 302 and is connected with the full dose extracting unit 303, and so-called full dose extracts,
Refer to by data source table or view is intact extracts from source database, and be converted into the ETL tool of oneself
The format that can be identified.The full dose extracts time acquisition unit 302 and is used for: obtaining the time of the source database, is denoted as complete
Amount extracts the time, and the full dose extraction time is stored in the first tables of data, transfers use at any time convenient for the later period；It will be described
Data transmission in first tables of data is to the full dose extracting unit 303.
The full dose extracting unit 303 extracts time acquisition unit 302 with the data capture unit 301, the full dose
It is connected with the record major key storage unit 304, it is described complete since each data carry corresponding temporal information
Amount extracting unit 303 is used for: in conjunction with the time field of the data, full dose extraction is carried out to the source database, described in acquisition
Full dose extracts time pervious all data, and the data of extraction are transferred to target database, completes what full dose extracted
Process；The information of target database is transmitted to the record major key storage unit 304.
The record major key storage unit 304 and the full dose extracting unit 303 and the target database updating unit
308 are connected, and whether the mode field is in upset condition for identification record data, change when the mode field is in
State illustrates that the information of the data record is not yet completed, and the record major key storage unit 304 is used for: in conjunction with the data
Mode field obtains the record major key of the data in the target database in upset condition, and the record is led
Key is stored in the second tables of data, facilitates the calling at any time when later period increment extraction；Data in second tables of data are passed
It send to the target database updating unit 308.
The increment extraction time started acquiring unit 305 is connected with the increment extraction unit 307, is used for: obtaining
The extraction time updated for the last time in first tables of data, and using the extraction time as the increment extraction time started,
And the increment extraction time started is sent to the increment extraction unit 307.
The increment extraction end time acquiring unit 306 is connected with the increment extraction unit 307, and increment is with one
A period is measurement unit, records source database increased data record than before within this time.So-called increment extraction,
Refer to and extract the data record increased in this time from source database, and the ETL tool for being converted into oneself can be with
The format of identification.The increment extraction end time acquiring unit 306 is used for: being obtained the time of the source database again, is remembered
Make the increment extraction end time, and the increment extraction end time is stored in the first tables of data, can be used as next increment
The time started is extracted, transfers use at any time convenient for the later period, and the increment extraction end time is sent to the increment extraction
Unit 307.
The increment extraction unit 307 and the data capture unit 301, the increment extraction time started acquiring unit
305, the increment extraction end time acquiring unit 306 is connected with the target database updating unit 308, is used for: knot
The time field for closing the data carries out increment extraction to the source database, obtains the full dose and extracts the time to the increasing
Amount extracts all data between the end time, and the data of extraction are transferred to target database, by the number of targets
According to library data transmission to the target database updating unit 308.
The target database updating unit 308 and the record major key storage unit 304, the increment extraction unit
307 are connected with the second tables of data updating unit 309, since what is stored in the second tables of data is that full dose extracts the period
Interior, the record major key information of the data in upset condition is located before after the interval of time that subsequent delta extracts
In the data of upset condition, it is now possible to be partially completed or be fully completed, it is therefore desirable to be carried out more to target database
Newly.The target database updating unit 308 is used for: the record major key in second tables of data is obtained, by the note
The corresponding data of record major key are deleted from target database, at the same according to the record major key from source database again into
The data of extraction are transferred to target database, and the target database are sent to described by the extraction of row data
Two tables of data updating units 309.
The second tables of data updating unit 309 is connected with the target database updating unit 308, is used for: emptying
The record major key in second tables of data reacquires the target database in conjunction with the mode field of the data
In the data in upset condition record major key, and the record major key newly obtained is stored in the second tables of data
In, realize the update to the second tables of data, updated data are convenient for using when next increment extraction.
Embodiment 4
As shown in figure 4, the device 40 of change data pick-up provided by the present embodiment 4, comprising: data capture unit 401,
Full dose extracts time acquisition unit 402, full dose extracting unit 403, record major key storage unit 404, increment extraction time started
Acquiring unit 405, increment extraction end time acquiring unit 406, increment extraction unit 407, target database updating unit 408
With the second tables of data updating unit 409.
The data capture unit 401 is connected with the full dose extracting unit 403 and the increment extraction unit 407,
Since source database is made of mass data, every data carries data information, before carrying out data pick-up, the number
It is used for according to acquiring unit 401: obtaining the information of the data of the source database, so that system is carried out according to the data information of acquisition
Corresponding data processing, wherein the information of the data, comprising: the time field of the time for the generation of identification record data,
The record major key of record for the mode field of identification record data movement state and for mark data；The data that will acquire
Information be transmitted to the full dose extracting unit 403 and the increment extraction unit 407.
The full dose extracts time acquisition unit 402 and is connected with the full dose extracting unit 403, and so-called full dose extracts,
Refer to by data source table or view is intact extracts from source database, and be converted into the ETL tool of oneself
The format that can be identified.The full dose extracts time acquisition unit 402 and is used for: obtaining the time of the source database, is denoted as complete
Amount extracts the time, generates the ETL tool of variable by having the function of, the full dose is extracted the time, being changed into has transmitting
The full dose of variable characteristics extracts the time, and the full dose extraction time is stored in the first tables of data, raw in this step
At variable, be preferentially transferred out use in can be below the step of；By the data transmission in first tables of data described in
Full dose extracting unit 403.
The full dose extracting unit 403 and the data capture unit 401, the full dose extract the time obtain member 402 and
The record major key storage unit 404 is connected, since each data carry corresponding temporal information, the full dose
Extracting unit 403 is used for: in conjunction with the time field of the data, being carried out full dose extraction to the source database, is obtained described complete
Amount extracts time pervious all data, and the data of extraction are transferred to target database, completes the mistake that full dose extracts
Journey；The information of target database is transmitted to the record major key storage unit 404.
The record major key storage unit 404 and the full dose extracting unit 403 and the target database updating unit
408 are connected, and whether the mode field is in upset condition for identification record data, change when the mode field is in
State illustrates that the information of the data record is not yet completed, and the record major key storage unit 404 is used for: in conjunction with the data
Mode field obtains the record major key of the data in the target database in upset condition, and the record is led
Key is stored in the second tables of data, facilitates the calling at any time when later period increment extraction；Data in second tables of data are passed
It send to the target database updating unit 408.
The increment extraction time started acquiring unit 405 is connected with the increment extraction unit 407, is used for: obtaining
The extraction time updated for the last time in first tables of data, and the extraction time that last time is updated is as increment
The time started is extracted, generates the ETL tool of variable by having the function of, the extraction time, which is changed into, has transmitting variable
The increment extraction time started of characteristic, preferentially being recalled in the variable that this step generates, can be below the step of makes
With.And the increment extraction time started is sent to the increment extraction unit 407.
The increment extraction end time acquiring unit 406 is connected with the increment extraction unit 407, and increment is with one
A period is measurement unit, records source database increased data record than before within this time.So-called increment extraction,
Refer to and extract the data record increased in this time from source database, and the ETL tool for being converted into oneself can be with
The format of identification.The increment extraction end time acquiring unit 406 is used for: being obtained the time of the source database again, is remembered
Make the increment extraction end time, generates the ETL tool of variable by having the function of, the increment extraction end time turns
Become the increment extraction end time with transmitting variable characteristics, and the increment extraction end time is stored in first
In tables of data, and the increment extraction end time is sent to the increment extraction unit 407.
The increment extraction unit 407 and the data capture unit 401, the increment extraction time started acquiring unit
405, the increment extraction end time acquiring unit 406 is connected with the target database updating unit 408, is used for: knot
The time field for closing the data carries out increment extraction to the source database, obtains the increment extraction time started to institute
All data between the increment extraction end time are stated, and the data of extraction are transferred to target database, by the mesh
Mark database data is sent to the target database updating unit 408.
The target database updating unit 408 and the record major key storage unit 404, the increment extraction unit
407 are connected with the second tables of data updating unit 409, since what is stored in the second tables of data is that full dose extracts the period
Interior, the record major key information of the data in upset condition is located before after the interval of time that subsequent delta extracts
In the data of upset condition, it is now possible to be partially completed or be fully completed, it is therefore desirable to be carried out more to target database
Newly.The target database updating unit 408 is used for: the record major key in second tables of data is obtained, by having
The record major key is sequentially generated the record major key with transmitting variable characteristics by the ETL tool for generating the function of variable,
Use is recalled in the variable that this step generates, can be below the step of.By the corresponding data of the record major key from
It is deleted in target database, while re-starting the extraction of data from source database according to the record major key, by extraction
The data are transferred to target database, and the target database is sent to the second tables of data updating unit 409.
The second tables of data updating unit 409 is connected with the target database updating unit 408, is used for: emptying
The record major key in second tables of data reacquires the target database in conjunction with the mode field of the data
In the data in upset condition record major key, and the record major key newly obtained is stored in the second tables of data
In, realize the update to the second tables of data, updated data are convenient for using when next increment extraction.
By above each embodiment it is found that the method and apparatus of change data pick-up of the invention, existing beneficial to effect
Fruit is:
(1) method and device of change data pick-up of the present invention, by rationally utilizing the time word in tables of data
Section and mode field can carry out corresponding full dose data pick-up or increasing in the case where making no modifications to source database
Data pick-up is measured, realizes that the data between cooperative system are synchronous, it can be ensured that the normal operation of source database business is guaranteeing reliability
While with extraction efficiency, has and realize that difficulty is small, reduces the characteristic of user cost.
(2) method and device of change data pick-up of the present invention, when each data pick-up starts, record data are taken out
The time is taken to extract the end time as this, so that data pick-up is since the end time of last time data pick-up next time, energy
It enough avoids powering off because of destination server in certain time period, the shortage of data problem for causing regular delta to update.
(3) method and device of change data pick-up of the present invention generates the ETL work of variable by having the function of
The corresponding data pick-up time is changed into the data pick-up time with transmitting variable characteristics by tool, the transmitting variable of generation
Data can preferentially be transferred out use, avoid mutually obscuring with the historical data extraction time in tables of data, influence data pick-up
Accuracy.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, apparatus or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
Although some specific embodiments of the invention are described in detail by example, the skill of this field
Art personnel it should be understood that example above merely to being illustrated, the range being not intended to be limiting of the invention.The skill of this field
Art personnel are it should be understood that can without departing from the scope and spirit of the present invention modify to above embodiments.This hair
Bright range is defined by the following claims.
Claims (10)
1. a kind of method for changing data pick-up characterized by comprising
Obtain the information of the data of source database, wherein the information of the data, comprising: time field, mode field and record
Major key；
The time for obtaining the source database is denoted as full dose and extracts the time, and the full dose extraction time is stored in the first number
According in table；
In conjunction with the time field of the data, full dose extraction is carried out to the source database, obtain the full dose extract the time with
Preceding all data, and the data of extraction are transferred to target database；
In conjunction with the mode field of the data, the record master of the data in the target database in upset condition is obtained
Key, and the record major key is stored in the second tables of data；
The extraction time updated for the last time in first tables of data is obtained, and is opened using the extraction time as increment extraction
Begin the time；
The time for obtaining the source database again, it is denoted as the increment extraction end time, and by the increment extraction end time
It is stored in the first tables of data；
In conjunction with the time field of the data, increment extraction is carried out to the source database, when obtaining the increment extraction and starting
Between to all data between the increment extraction end time, and the data of extraction are transferred to target database；
The record major key in second tables of data is obtained, by the corresponding data of the record major key from target data
It is deleted in library, while re-starting the extraction of data from source database according to the record major key, by the data of extraction
It is transferred to target database；
The record major key emptied in second tables of data reacquires the mesh in conjunction with the mode field of the data
The record major key of the data in database in upset condition is marked, and the record major key newly obtained is stored in second
In tables of data.
2. the method for change data pick-up according to claim 1, which is characterized in that the full dose is extracted time storage
In the first tables of data, comprising: the full dose is extracted time generation transmitting variable；Further are as follows:
The time for obtaining the source database is denoted as full dose and extracts the time, and the full dose extraction time, which is changed into, has transmitting
The full dose of variable characteristics extracts the time, and the full dose extraction time is stored in the first tables of data.
3. the method for change data pick-up according to claim 1, which is characterized in that the pumping for updating last time
Take the time as the increment extraction time started, comprising: the extraction time for updating last time generates transmitting variable；Into one
Step are as follows:
Obtain the extraction time updated for the last time in first tables of data, and the extraction time that last time is updated
As the increment extraction time started, when the extraction time being changed into the increment extraction with transmitting variable characteristics starting
Between.
4. the method for change data pick-up according to claim 1, which is characterized in that by the increment extraction end time
It is stored in the first tables of data, comprising: the increment extraction end time is generated into transmitting variable；Further are as follows:
The time for obtaining the source database again is denoted as the increment extraction end time, and the increment extraction end time turns
Become the increment extraction end time with transmitting variable characteristics, and the increment extraction end time is stored in first
In tables of data.
5. the method for change data pick-up according to claim 1, which is characterized in that obtain in second tables of data
The record major key, comprising: the record major key is sequentially generated into transmitting variable, further are as follows:
The record major key in second tables of data is obtained, the record major key, which is sequentially generated, has transmitting variable characteristics
The record major key, the corresponding data of the record major key are deleted from target database, while according to the note
Record major key re-starts the extraction of data from source database, and the data of extraction are transferred to target database.
6. a kind of device for changing data pick-up, which is characterized in that the device includes: data capture unit, full dose extraction time
Acquiring unit, full dose extracting unit, record major key storage unit, increment extraction time started acquiring unit, increment extraction terminate
Time acquisition unit, increment extraction unit, target database updating unit and the second tables of data updating unit, wherein；
The data capture unit is connected with the full dose extracting unit and the increment extraction unit, is used for: obtaining source number
According to the information of the data in library, wherein the information of the data, comprising: time field, mode field and record major key；
The full dose extracts time acquisition unit and is connected with the full dose extracting unit, is used for: obtaining the source database
Time is denoted as full dose and extracts the time, and the full dose extraction time is stored in the first tables of data；
The full dose extracting unit and the data capture unit, the full dose extract time acquisition unit and the record major key
Storage unit is connected, and is used for: in conjunction with the time field of the data, carrying out full dose extraction to the source database, obtains institute
It states full dose and extracts time pervious all data, and the data of extraction are transferred to target database；
The record major key storage unit is connected with the full dose extracting unit and the target database updating unit, uses
In: in conjunction with the mode field of the data, obtain the record master of the data in the target database in upset condition
Key, and the record major key is stored in the second tables of data；
The increment extraction time started acquiring unit is connected with the increment extraction unit, is used for: obtaining first number
According to the extraction time updated for the last time in table, and using the extraction time as the increment extraction time started；
The increment extraction end time acquiring unit is connected with the increment extraction unit, is used for: obtaining the source again
The time of database is denoted as the increment extraction end time, and the increment extraction end time is stored in the first tables of data；
The increment extraction unit and the data capture unit, the increment extraction time started acquiring unit, the increment
It extracts end time acquiring unit to be connected with the target database updating unit, be used for: in conjunction with the time word of the data
Section carries out increment extraction to the source database, obtains the increment extraction time started to the increment extraction end time
Between all data, and the data of extraction are transferred to target database；
The target database updating unit and the record major key storage unit, the increment extraction unit and second number
It is connected according to table updating unit, is used for: obtains the record major key in second tables of data, the record major key is corresponding
The data deleted from target database, while the pumpings of data is re-started from source database according to the record major key
It takes, the data of extraction is transferred to target database；
The second tables of data updating unit is connected with the target database updating unit, is used for: emptying second number
According to the record major key in table, in conjunction with the mode field of the data, reacquire in the target database in variation
The record major key of the data of state, and the record major key newly obtained is stored in the second tables of data.
7. the device of change data pick-up according to claim 6, which is characterized in that it is single that the full dose extracts time acquisition
Member, further are as follows:
The full dose extracts time acquisition unit, is used for: obtaining the time of the source database, is denoted as full dose and extracts the time, will
The full dose extraction time is changed into the full dose with transmitting variable characteristics and extracts the time, and the full dose is extracted the time
It is stored in the first tables of data.
8. the device of change data pick-up according to claim 6, which is characterized in that the increment extraction time started is obtained
Unit is taken, further are as follows:
The increment extraction time started acquiring unit, is used for: obtaining the extraction updated for the last time in first tables of data
Time, and using the extraction time of last time update as the increment extraction time started, the extraction time is changed into
The increment extraction time started with transmitting variable characteristics.
9. the device of change data pick-up according to claim 6, which is characterized in that the increment extraction end time is obtained
Unit is taken, further are as follows:
The increment extraction end time acquiring unit, is used for: obtaining the time of the source database again, is denoted as increment extraction
The increment extraction end time is changed into the increment extraction end time with transmitting variable characteristics by the end time,
And the increment extraction end time is stored in the first tables of data.
10. the device of change data pick-up according to claim 6, which is characterized in that the target database updates single
Member, further are as follows:
The target database updating unit, is used for: the record major key in second tables of data is obtained, by the record
Major key sequentially generates the record major key with transmitting variable characteristics, by the corresponding data of the record major key from target
It is deleted in database, while re-starting the extraction of data from source database according to the record major key, it will be described in extraction
Data are transferred to target database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710409482.XA CN107229721B (en) | 2017-06-02 | 2017-06-02 | A kind of method and device changing data pick-up |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710409482.XA CN107229721B (en) | 2017-06-02 | 2017-06-02 | A kind of method and device changing data pick-up |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107229721A CN107229721A (en) | 2017-10-03 |
| CN107229721B true CN107229721B (en) | 2019-10-29 |
Family
ID=59934363
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710409482.XA Active CN107229721B (en) | 2017-06-02 | 2017-06-02 | A kind of method and device changing data pick-up |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107229721B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108062399A (en) * | 2017-12-21 | 2018-05-22 | 新华三大数据技术有限公司 | Data processing method and device |
| CN108595522A (en) * | 2018-03-27 | 2018-09-28 | 北京明朝万达科技股份有限公司 | A kind of increment synchronization method, apparatus and system |
| CN108829747B (en) * | 2018-05-24 | 2019-09-17 | 新华三大数据技术有限公司 | Data load method and device |
| CN110019423A (en) * | 2019-04-11 | 2019-07-16 | 山东浪潮云信息技术有限公司 | A kind of statistical method suitable for government affairs application |
| CN110727724B (en) * | 2019-09-09 | 2023-03-24 | 未鲲(上海)科技服务有限公司 | Data extraction method and device, computer equipment and storage medium |
| CN113094415B (en) * | 2019-12-23 | 2024-03-29 | 北京懿医云科技有限公司 | Data extraction method, data extraction device, computer readable medium and electronic equipment |
| CN111651519B (en) * | 2020-05-08 | 2023-04-25 | 携程计算机技术（上海）有限公司 | Data synchronization method, data synchronization device, electronic equipment and storage medium |
| CN111858566A (en) * | 2020-06-15 | 2020-10-30 | 邯郸钢铁集团有限责任公司 | Real-time data extraction application method |
| CN111881136A (en) * | 2020-07-29 | 2020-11-03 | 山东健康医疗大数据有限公司 | Method for realizing incremental data management in medical industry |
| CN112181979B (en) * | 2020-09-07 | 2024-05-24 | 北京三快在线科技有限公司 | Data updating method and device, storage medium and electronic equipment |
| CN111930821A (en) * | 2020-09-08 | 2020-11-13 | 平安国际智慧城市科技股份有限公司 | One-step data exchange method, device, equipment and storage medium |
| CN113407734B (en) * | 2021-07-14 | 2023-05-19 | 重庆富民银行股份有限公司 | Method for constructing knowledge graph system based on real-time big data |
| CN114925074A (en) * | 2022-06-21 | 2022-08-19 | 中国建设银行股份有限公司 | Data unloading method, device, equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102819608A (en) * | 2012-08-22 | 2012-12-12 | 山东中创软件工程股份有限公司 | Method and device for data extraction based on Oracle database system |
| CN102915336A (en) * | 2012-09-18 | 2013-02-06 | 北京金和软件股份有限公司 | Incremental data capturing and extraction method based on timestamps and logs |
| CN103606032A (en) * | 2013-11-05 | 2014-02-26 | 广东电网公司电力科学研究院 | Two-dimensional grid GIS data concentration method |
| CN104102737A (en) * | 2014-07-28 | 2014-10-15 | 中国农业银行股份有限公司 | Historical data storage method and system |
| CN104361133A (en) * | 2014-12-10 | 2015-02-18 | 用友软件股份有限公司 | Data extraction device and method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102841897B (en) * | 2011-06-23 | 2016-03-02 | 阿里巴巴集团控股有限公司 | A kind of method, Apparatus and system realizing incremental data and extract |
-
2017
- 2017-06-02 CN CN201710409482.XA patent/CN107229721B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102819608A (en) * | 2012-08-22 | 2012-12-12 | 山东中创软件工程股份有限公司 | Method and device for data extraction based on Oracle database system |
| CN102915336A (en) * | 2012-09-18 | 2013-02-06 | 北京金和软件股份有限公司 | Incremental data capturing and extraction method based on timestamps and logs |
| CN103606032A (en) * | 2013-11-05 | 2014-02-26 | 广东电网公司电力科学研究院 | Two-dimensional grid GIS data concentration method |
| CN104102737A (en) * | 2014-07-28 | 2014-10-15 | 中国农业银行股份有限公司 | Historical data storage method and system |
| CN104361133A (en) * | 2014-12-10 | 2015-02-18 | 用友软件股份有限公司 | Data extraction device and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107229721A (en) | 2017-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107229721B (en) | A kind of method and device changing data pick-up | |
| CN105447014B (en) | Metadata management method based on binlog and for providing the method and device of metadata | |
| CN103970833B (en) | The solution of bi-directional synchronization datacycle in a kind of heterogeneous database synchronization system based on daily record | |
| CN103810224B (en) | information persistence and query method and device | |
| CN105354036B (en) | Database manipulation code generating method and device | |
| CN104346458B (en) | Date storage method and storage device | |
| CN110362632A (en) | A kind of method of data synchronization, device, equipment and computer readable storage medium | |
| CN107103068A (en) | The update method and device of service buffer | |
| CN106446140A (en) | Method and device for data persistence | |
| CN104270424B (en) | A kind of database synchronization method, server and system | |
| CN110321383A (en) | Big data platform method of data synchronization, device, computer equipment and storage medium | |
| CN107038222A (en) | Database caches implementation method and its system | |
| CN107562931A (en) | Data pick-up system and data abstracting method | |
| CN104834700A (en) | Method for capturing movement data increment based on track change | |
| CN104392123B (en) | A kind of CDA automotive engine system and implementation method | |
| CN110389967A (en) | Date storage method, device, server and storage medium | |
| CN105718592B (en) | Data calling method and its system based on Redis | |
| CN108628885A (en) | A kind of method of data synchronization, device and storage device | |
| CN109101298A (en) | Windows striding course window management method, storage medium, electronic equipment and system | |
| CN104765792B (en) | A kind of method, apparatus and system of dimension data storage | |
| CN105320669B (en) | Data storage, read method and data storage, reading device | |
| CN108259543A (en) | Distributed cloud storage database and its be deployed in the method for multiple data centers | |
| CN108829747B (en) | Data load method and device | |
| CN111343269B (en) | Data downloading method, device, computer equipment and storage medium | |
| CN108710687A (en) | A kind of acquisition methods and device of service identification sequence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |