CN106777265B - Service data processing method and device - Google Patents
Service data processing method and device Download PDFInfo
- Publication number
- CN106777265B CN106777265B CN201611236586.7A CN201611236586A CN106777265B CN 106777265 B CN106777265 B CN 106777265B CN 201611236586 A CN201611236586 A CN 201611236586A CN 106777265 B CN106777265 B CN 106777265B
- Authority
- CN
- China
- Prior art keywords
- data
- component
- slt
- service
- list
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title description 2
- 238000000034 method Methods 0.000 claims abstract description 36
- 241000282813 Aepyceros melampus Species 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000010076 replication Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a method and a device for processing service Data, relates to the technical field of Data processing, and solves the problem that Data Services in the prior art cannot identify the service Data without increment identification, so that the service Data cannot be updated in real time. The method comprises the steps of acquiring service data in real time through an SAP system; performing increment operation on the service data through an SLT component of the SAP system to generate an increment data table; calling a Data list in the SLT component through a Data Services component, and carrying out batch loading; wherein the data list comprises an incremental data table. The embodiment of the invention is used for processing the service data.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a method and an apparatus for processing service data.
Background
With the continuous increase of data volume and data types, a large amount of data needs to be flexibly processed according to various service requirements and different application scenarios.
In the prior art, a more extensive data processing scheme is used as follows: data Services (full English name: DataServices), for incremental Data DataServices, connecting incremental Data to a programmable Web application program (full English name: Web Service) layer for message queue processing, and then extracting Data according to requirements; the method comprises the steps that Data Services are used for carrying out batch loading on full Data, Service Data are stored in a partial database, a Distributed File System (HDFS for short) or a Web Service interface is connected; however, as the data volume is increased and the services are diversified, the source data of many service data has no increment identification, so the data services cannot store the data without the increment identification to the message queue, but store the service source data in the form of full data; illustratively, when the service Data is stored in the HDFS through the Data Services, the Data Services may load the service Data in batches, and since the Data Services cannot identify the service Data without the incremental identifier, the service Data cannot be updated in real time; and because Data Services are limited by self component configuration, the Data Services only support partial functions of a Database (DB for short) and a Data warehouse infrastructure (Hive for short) on the Hadoop, and limit the Data processing work in the future.
As can be seen from the above, Data Services in the prior art cannot identify service Data without incremental identifiers, and thus cannot update the service Data in real time.
Disclosure of Invention
Embodiments of the present invention provide a method and an apparatus for processing service data, which solve the problem that data services in the prior art cannot identify service data without an incremental identifier, and thus cannot update the service data in real time.
In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:
in a first aspect, an embodiment of the present invention provides a method for processing service data, including:
acquiring service data in real time through an SAP system;
performing increment operation on the service data through an SLT component of the SAP system to generate an increment data table;
calling a Data list in the SLT component through a Data Services component, and carrying out batch loading; wherein the data list comprises an incremental data table.
Specifically, after the service data is obtained in real time by the SAP system, the method further includes:
generating a full data table from the service data through an SLT component of the SAP system;
the data list also includes a full data table.
Specifically, the generating of the incremental data table by performing incremental operation on the service data through the SLT component of the SAP system includes:
and performing increment operation on the service data without the increment identification in the service data through an SLT component of the SAP system, and generating an increment data table together with the service data with the increment identification in the service data.
Specifically, the Data Services component calls a Data list in the SLT component, and the batch loading includes:
calling a Data list in the SLT component through a Data Services component;
judging whether the Data in the Data list extracted by the Data Services component is empty or not;
when the Data in the Data list extracted by the Data Services component is empty, continuously calling the Data in the Data list in the SLT component;
and when the Data in the Data list extracted by the Data Services component is not empty, loading the Data list in batches.
Specifically, the Data Services component calls a Data list in the SLT component and performs batch loading, including:
calling a Data list in the SLT component through a Data Services component;
classifying the data in the called data list according to the data type;
accessing the data in the classified data list to a corresponding storage engine through a Web Service interface; wherein the classified data type corresponds to a category of the storage engine.
Specifically, the storage engine includes: hive, Kudu, HBase, Kafka, and Impala.
In a second aspect, an embodiment of the present invention provides a device for processing service data, including:
the acquisition unit is used for acquiring service data in real time through the SAP system;
the data unit is used for performing incremental operation on the service data acquired by the acquisition unit through an SLT component of the SAP system to generate an incremental data table;
the loading unit is used for calling a Data list in the SLT component through the Data Services component and carrying out batch loading; the data list comprises an incremental data table generated by the data unit.
Specifically, the data unit is further configured to generate a full data table from the service data acquired by the acquisition unit through an SLT component of the SAP system;
the data list also includes a full data table generated by the data unit.
Specifically, the data unit is further configured to perform incremental operation on the service data without the incremental identifier in the service data acquired by the acquisition unit through an SLT component of the SAP system, and generate an incremental data table together with the service data with the incremental identifier in the service data acquired by the acquisition unit.
Specifically, the device for processing service data further includes:
the judging unit is used for judging whether the Data in the Data list extracted by the Data Services component is empty or not;
the loading unit is also used for continuously calling the Data in the Data list in the SLT component when the judging unit judges that the Data in the Data list extracted by the Data Services component is empty;
and the loading unit is also used for loading the Data list in batches when the judging unit judges that the Data in the Data list extracted by the Data Services component is not empty.
Specifically, the processing device of the service data further includes a classification unit and a storage unit:
the loading unit is also used for calling a Data list in the SLT component through the Data Services component;
the classification unit is used for classifying the data in the data list called by the loading unit according to the data type;
the storage unit is used for accessing the data in the data list classified by the classification unit to a corresponding storage engine through a Web Service interface; wherein the classified data type corresponds to a category of the storage engine.
The embodiment of the invention provides a method and a device for processing service data, wherein the method for processing the service data utilizes the acquired service data of an SAP system, and performs incremental operation on the service data through an SLT component of the SAP system to generate an incremental data table; the Data Services component calls a Data list in the SLT component and carries out batch loading; incremental operation is carried out on the service data through an SLT component in the SAP system, so that the data in the service data are provided with incremental identification; when the Data Services component calls the Data list in the SLT component, the Data Services component can update the service Data in real time in the batch loading process because the Data in the Data list has the increment identification; the problem that the data services in the prior art cannot identify the service data without the increment identification, and further cannot update the service data in real time is solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a method for processing service data according to an embodiment of the present invention;
fig. 2 is another flowchart of a method for processing service data according to an embodiment of the present invention;
fig. 3 is another flowchart of a method for processing service data according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a service data processing apparatus according to an embodiment of the present invention;
fig. 5 is another schematic structural diagram of a service data processing apparatus according to an embodiment of the present invention.
Reference numerals:
service data processing means-10;
an acquisition unit-1010;
a data unit-1020;
a load unit-1030;
a discrimination unit-1040;
classification unit-1050;
memory cell-1060.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides a method and a device for processing service data, wherein the method for processing the service data utilizes the acquired service data of an SAP system, and performs incremental operation on the service data through an SLT component of the SAP system to generate an incremental data table; the Data Services component calls a Data list in the SLT component and carries out batch loading; incremental operation is carried out on the service data through an SLT component in the SAP system, so that the data in the service data are provided with incremental identification; when the Data Services component calls the Data list in the SLT component, the Data Services component can update the service Data in real time in the batch loading process because the Data in the Data list has the increment identification; the problem that the data services in the prior art cannot identify the service data without the increment identification, and further cannot update the service data in real time is solved.
An embodiment of the present invention provides a method for processing service data, as shown in fig. 1, including:
and S101, acquiring service data in real time through an SAP system.
It should be noted that the SAP system in S101 refers to software of an enterprise management solution, and english is called as: systems applications and products in data processing.
S102, performing increment operation on the service data through an SLT component of the SAP system to generate an increment data table.
It should be noted that, the SLT component in S102 refers to an SAP synchronous replication server, and english is called: a SAPLANDScape Transformation Replication Server.
S103, calling a Data list in the SLT component through the Data Services component, and carrying out batch loading; wherein the data list comprises an incremental data table.
The embodiment of the invention provides a method for processing service data, which comprises the steps of carrying out increment operation on the service data through an SLT component of an SAP system to generate an increment data table; the Data Services component calls a Data list in the SLT component and carries out batch loading; incremental operation is carried out on the service data through an SLT component in the SAP system, so that the data in the service data are provided with incremental identification; when the Data Services component calls the Data list in the SLT component, the Data Services component can update the service Data in real time in the process of batch loading because the Data in the Data list has the increment identification; the problem that Data Services in the prior art cannot identify the service Data without the increment identification and further cannot update the service Data in real time is solved.
An embodiment of the present invention provides a method for processing service data, as shown in fig. 2, including:
and S1010, acquiring the service data in real time through the SAP system.
It should be noted that the service data includes SAP system data and non-SAP system data; the SAP system data refers to data extracted from the CCS and the ERP of the component per se; non-SAP system data refers to data extracted from the underlying databases DB2, MYSQL, ORACLE, SQLServe, etc.
And S1020, generating a full data table from the service data through an SLT component of the SAP system.
And S1030, performing increment operation on the service data through an SLT component of the SAP system to generate an increment data table.
S1040, calling a Data list in the SLT component through the Data Services component, and carrying out batch loading; wherein the data list comprises a full data table and an incremental data table.
Specifically, the generating of the incremental data table by performing incremental operation on the service data through the SLT component of the SAP system includes:
and performing increment operation on the service data without the increment identification in the service data through an SLT component of the SAP system, and generating an increment data table together with the service data with the increment identification in the service data.
It should be noted that, in the prior art, source Data of many service Data does not have an increment identifier, so Data Services cannot identify the service Data without the increment identifier in the batch loading process; the invention carries out increment operation on the service Data without the increment identification in the service Data through the SLT component of the SAP system, so that the Data Services can identify the corresponding service Data in the process of batch loading; therefore, the Data Services realize the update of the service Data in the batch loading process.
Specifically, the Data Services component calls a Data list in the SLT component, and the batch loading includes:
the Data list in the SLT component is called by the Data Services component.
And judging whether the Data in the Data list extracted by the Data Services component is empty or not.
And when the Data in the Data list extracted by the Data Services component is empty, continuing to call the Data in the Data list in the SLT component.
And when the Data in the Data list extracted by the Data Services component is not empty, loading the Data list in batches.
The embodiment of the invention provides a method for processing service data, which comprises the steps of carrying out increment operation on the service data through an SLT component of an SAP system to generate an increment data table; the Data Services component calls a Data list in the SLT component and carries out batch loading; incremental operation is carried out on the service data through an SLT component in the SAP system, so that the data in the service data are provided with incremental identification; generating a full data table from the service data through an SLT component in the SAP system; when the Data Services component calls the Data list in the SLT component, the Data Services component can update the service Data in real time in the process of batch loading because the Data in the Data list has the increment identification; the problem that Data Services in the prior art cannot identify the service Data without the increment identification and further cannot update the service Data in real time is solved.
An embodiment of the present invention provides a method for processing service data, as shown in fig. 3, including:
and S1011, acquiring the service data in real time through the SAP system.
And S1021, generating a full data table from the service data through an SLT component of the SAP system.
And S1031, performing increment operation on the service data through an SLT component of the SAP system to generate an increment data table.
And S1041, calling a Data list in the SLT component through the Data Services component.
S1051, classifying the data in the called data list according to the data type.
S1061, accessing the data in the classified data list to a corresponding storage engine through a Web Service interface; wherein the classified data type corresponds to a category of the storage engine.
It should be noted that, the Data in the Data Services batch loading are classified according to the Data types, and the Data in the classified Data list is accessed to the corresponding storage engine through the Web Service interface, so that the Data of different Data types are stored in different storage engines, and the problem that the Data Services only support the DB database and partial functions of Hive due to the limitation of self component configuration in the prior art is solved.
Specifically, accessing the data in the classified data list to the corresponding storage engine through the Web Service interface includes:
and judging whether the data in the classified data list accessed into the corresponding storage engine through the Web Service interface contains special characters.
When the data in the classified data list contains special characters, the special characters are uniformly configured in the Web Service interface.
And accessing the data in the classified data list to a corresponding storage engine through a Web Service interface.
It should be noted that, in practical applications, in the process of accessing Data acted by Data Services to the WebService interface, it is necessary to determine whether special characters exist in the Data; the special fields are uniformly configured in the Web Service interface, so that the condition of messy codes of written data is avoided; the corresponding storage engine is called by the Data Services to write the Data into the storage engine.
Specifically, the storage engine includes: hive, Kudu, HBase, Kafka, and Impala.
The embodiment of the invention provides a method for processing service data, which comprises the steps of carrying out increment operation on the service data through an SLT component of an SAP system to generate an increment data table; the Data Services component calls a Data list in the SLT component and carries out batch loading; incremental operation is carried out on the service data through an SLT component in the SAP system, so that the data in the service data are provided with incremental identification; generating a full data table from the service data through an SLT component in the SAP system; when the Data Services component calls the Data list in the SLT component, the Data Services component can update the service Data in real time in the process of batch loading because the Data in the Data list has the increment identification; the problem that Data Services in the prior art cannot identify the service Data without the increment identification and further cannot update the service Data in real time is solved.
Fourth, an embodiment of the present invention provides a device 10 for processing service data, as shown in fig. 4, including:
the acquisition unit 1010 is configured to acquire service data in real time through the SAP system.
The data unit 1020 is configured to perform an incremental operation on the service data acquired by the acquisition unit 1010 through an SLT component of the SAP system, and generate an incremental data table.
A loading unit 1030, configured to invoke a Data list in the SLT component through the Data Services component, and perform batch loading; wherein the data list includes an incremental data table generated by the data unit 1020.
The embodiment of the invention provides a processing device of service data, wherein a data unit performs incremental operation on the service data acquired by an acquisition unit through an SLT (super Link termination) component of an SAP (System application protocol) system to generate an incremental data table; the loading unit calls a Data list in the SLT component through the Data Services component and carries out batch loading; the data unit performs increment operation on the service data acquired by the acquisition unit through an SLT component in the SAP system, so that the data in the service data is provided with an increment identifier; when the loading unit calls the Data list in the SLT component through the Data Services component, the Data Services component can update the service Data in real time in the batch loading process because the Data in the Data list has the increment identification; the problem that Data Services in the prior art cannot identify the service Data without the increment identification and further cannot update the service Data in real time is solved.
Fifth embodiment, an embodiment of the present invention provides a device 10 for processing service data, as shown in fig. 4, including:
the acquisition unit 1010 is configured to acquire service data in real time through the SAP system.
And the data unit 1020 is used for generating a full data table from the service data acquired by the acquisition unit through an SLT component of the SAP system.
The data unit 1020 is further configured to perform an increment operation on the service data acquired by the acquisition unit 1010 through an SLT component of the SAP system, so as to generate an increment data table.
A loading unit 1030, configured to invoke a Data list in the SLT component through the Data Services component, and perform batch loading; wherein the data list includes a full data table and an incremental data table generated by the data unit 1020.
Specifically, the data unit 1020 is further configured to perform incremental operation on the service data without the incremental identifier in the service data acquired by the acquisition unit 1010 through an SLT component of the SAP system, and generate an incremental data table together with the service data with the incremental identifier in the service data acquired by the acquisition unit 1010.
The embodiment of the invention provides a processing device of business data, wherein a data unit generates the business data acquired by an acquisition unit into a full data table through an SLT component of an SAP system; the data unit further performs increment operation on the service data acquired by the acquisition unit through an SLT component of the SAP system to generate an increment data table; the loading unit calls a Data list in the SLT component through the Data Services component and carries out batch loading; the data unit performs increment operation on the service data acquired by the acquisition unit through an SLT component in the SAP system, so that the data in the service data is provided with an increment identifier; when the loading unit calls the Data list in the SLT component through the DataServices component, the Data in the Data list is provided with the increment identification, so that the Data Services component can update the service Data in real time in the batch loading process; the problem that Data Services in the prior art cannot identify the service Data without the increment identification and further cannot update the service Data in real time is solved.
Sixth, an embodiment of the present invention provides a device 10 for processing service data, as shown in fig. 5, including:
the acquisition unit 1010 is configured to acquire service data in real time through the SAP system.
And a data unit 1020, configured to generate a full data table from the service data acquired by the acquisition unit 1010 through an SLT component of the SAP system.
The data unit 1020 is further configured to perform an increment operation on the service data acquired by the acquisition unit 1010 through an SLT component of the SAP system, so as to generate an increment data table.
The judging unit 1040 is configured to judge whether Data in the Data list extracted by the Data Services component is empty.
The loading unit 1030 is further configured to, when the judging unit 1040 judges that the Data in the Data list extracted by the Data Services component is empty, continue to call the Data in the Data list in the SLT component by the loading unit 1030.
The loading unit 1030 is further configured to load the Data list in batch by the loading unit 1030 when the judging unit 1040 judges that the Data in the Data list extracted by the Data Services component is not empty.
Specifically, the processing apparatus 10 for service data shown in fig. 5 further includes a classification unit 1050 and a storage unit 1060:
the loading unit 1030 is further used for calling a Data list in the SLT component through the Data Services component;
a classifying unit 1050 configured to classify the data in the data list called by the loading unit 1030 according to data types;
the storage unit 1060 is configured to access, through a Web Service interface, data in the data list classified by the classification unit 1050 to a corresponding storage engine; wherein the classified data type corresponds to a category of the storage engine.
The embodiment of the invention provides a processing device of business data, wherein a data unit generates the business data acquired by an acquisition unit into a full data table through an SLT component of an SAP system; the data unit further performs increment operation on the service data acquired by the acquisition unit through an SLT component of the SAP system to generate an increment data table; the loading unit calls a Data list in the SLT component through the Data Services component and carries out batch loading; the data unit performs increment operation on the service data acquired by the acquisition unit through an SLT component in the SAP system, so that the data in the service data is provided with an increment identifier; when the loading unit calls the Data list in the SLT component through the DataServices component, the Data in the Data list is provided with the increment identification, so that the Data Services component can update the service Data in real time in the batch loading process; the problem that Data Services in the prior art cannot identify the service Data without the increment identification and further cannot update the service Data in real time is solved.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (7)
1. A method for processing service data is characterized by comprising the following steps:
acquiring service data in real time through an SAP system;
generating a full data table from the service data through an SLT component of an SAP system;
performing increment operation on the service data through an SLT component of the SAP system to generate an increment data table;
calling a Data list in the SLT component through a Data Services component, and carrying out batch loading, wherein the Data loading comprises the following steps: classifying the called data in the data list according to data types, and accessing the classified data in the data list to a corresponding storage engine through a Web Service interface; the classified data types correspond to the classes of the storage engine, and the data list comprises the full data table and the incremental data table.
2. The method for processing the service data according to claim 1, wherein the performing the incremental operation on the service data through the SLT component of the SAP system to generate an incremental data table includes:
and performing increment operation on the service data without the increment identification in the service data through an SLT component of the SAP system, and generating an increment data table together with the service data with the increment identification in the service data.
3. The method for processing business Data according to claim 1, wherein the retrieving the Data list in the SLT component by the Data Services component and performing batch loading comprises:
calling a Data list in the SLT component through a Data Services component;
judging whether the Data in the Data list extracted by the Data Services component is empty or not;
when the Data in the Data list extracted by the Data Services component is empty, continuing to call the Data in the Data list in the SLT component;
and when the Data in the Data list extracted by the Data Services component is not empty, loading the Data list in batches.
4. The method for processing business data according to claim 1, wherein the storage engine comprises: hive, Kudu, HBase, Kafka, and Impala.
5. A device for processing service data, comprising:
the acquisition unit is used for acquiring service data in real time through the SAP system;
the data unit is used for generating a full data table from the service data acquired by the acquisition unit through an SLT component of the SAP system;
the data unit is also used for performing increment operation on the service data acquired by the acquisition unit through an SLT component of the SAP system to generate an increment data table;
the loading unit is used for calling the Data list in the SLT component through the Data Services component and carrying out batch loading; wherein the data list comprises the full data table and the incremental data table generated by the data unit;
the loading unit is also used for calling a Data list in the SLT component through a Data Services component;
the classification unit is used for classifying the data in the data list called by the loading unit according to data types;
the storage unit is used for accessing the data in the data list classified by the classification unit to a corresponding storage engine through a Web Service interface; wherein the classified data type corresponds to a category of the storage engine.
6. The device for processing service data according to claim 5, wherein the data unit is further configured to perform an increment operation on the service data without the increment identifier in the service data collected by the collection unit through an SLT component of the SAP system, and generate an increment data table together with the service data with the increment identifier in the service data collected by the collection unit.
7. The apparatus for processing service data according to claim 5, wherein the apparatus for processing service data further comprises:
the judging unit is used for judging whether the Data in the Data list extracted by the Data Services component is empty or not;
the loading unit is further configured to, when the judging unit judges that the Data in the Data list extracted by the Data Services component is empty, continue to call the Data in the Data list in the SLT component;
the loading unit is further configured to load the Data list in batch when the judging unit judges that the Data in the Data list extracted by the Data Services component is not empty.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611236586.7A CN106777265B (en) | 2016-12-28 | 2016-12-28 | Service data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611236586.7A CN106777265B (en) | 2016-12-28 | 2016-12-28 | Service data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106777265A CN106777265A (en) | 2017-05-31 |
| CN106777265B true CN106777265B (en) | 2020-06-19 |
Family
ID=58925194
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611236586.7A Active CN106777265B (en) | 2016-12-28 | 2016-12-28 | Service data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106777265B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107784098A (en) * | 2017-10-24 | 2018-03-09 | 百味云科技股份有限公司 | Real-time data warehouse platform |
| CN109669916B (en) * | 2018-12-21 | 2023-06-06 | 浪潮软件集团有限公司 | Distributed object storage architecture and platform based on CMSP and KUDU |
| CN109739858B (en) * | 2018-12-29 | 2021-08-17 | 华立科技股份有限公司 | ANSI C12.19-based data classification storage method and device and electronic equipment |
| CN111367984B (en) * | 2020-03-11 | 2023-03-21 | 中国工商银行股份有限公司 | Method and system for loading high-timeliness data into data lake |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011080709A2 (en) * | 2009-12-29 | 2011-07-07 | Limont Group Inc. | Shop floor interaction center |
| CN103646311A (en) * | 2013-12-06 | 2014-03-19 | 因为科技无锡有限公司 | Traffic data service system |
| CN104573100A (en) * | 2015-01-29 | 2015-04-29 | 无锡江南计算技术研究所 | Step-by-step database synchronization method with autoincrement identifications |
-
2016
- 2016-12-28 CN CN201611236586.7A patent/CN106777265B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011080709A2 (en) * | 2009-12-29 | 2011-07-07 | Limont Group Inc. | Shop floor interaction center |
| CN103646311A (en) * | 2013-12-06 | 2014-03-19 | 因为科技无锡有限公司 | Traffic data service system |
| CN104573100A (en) * | 2015-01-29 | 2015-04-29 | 无锡江南计算技术研究所 | Step-by-step database synchronization method with autoincrement identifications |
Non-Patent Citations (1)
| Title |
|---|
| 内存数据库在商务智能中的应用;吴钰彬;《中国优秀硕士学位论文全文数据库 信息科技辑》;20140515(第 05 期);正文第2.2节 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106777265A (en) | 2017-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109997126B (en) | Event driven extraction, transformation, and loading (ETL) processing | |
| CN106777265B (en) | Service data processing method and device | |
| US20190272335A1 (en) | Data retention handling for data object stores | |
| CN102508919B (en) | Data processing method and system | |
| CN113656245B (en) | Data inspection method and device, storage medium and processor | |
| CN107688626B (en) | Slow query log processing method and device and electronic equipment | |
| WO2019076001A1 (en) | Information updating method and device | |
| CN108228664B (en) | Unstructured data processing method and device | |
| CN111400288A (en) | Data quality inspection method and system | |
| CN115374102A (en) | Data processing method and system | |
| CN114461644A (en) | Data acquisition method and device, electronic equipment and storage medium | |
| CN112965979A (en) | User behavior analysis method and device and electronic equipment | |
| CN116205396A (en) | Data panoramic monitoring method and system based on data center | |
| US20110264703A1 (en) | Importing Tree Structure | |
| US10331484B2 (en) | Distributed data platform resource allocator | |
| CN112346775A (en) | General index data processing method, electronic device and storage medium | |
| CN110795331A (en) | Software testing method and device | |
| CN109800069B (en) | Method and device for realizing data management | |
| CN112860412B (en) | Service data processing method and device, electronic equipment and storage medium | |
| CN113836237A (en) | Method and device for auditing data operation of database | |
| CN112433757A (en) | Method and device for determining interface calling relationship | |
| CN109582476B (en) | Data processing method, device and system | |
| CN115936394A (en) | Business event management system and equipment for industrial system | |
| CN105630997A (en) | Data parallel processing method, device and equipment | |
| CN113868138A (en) | Method, system, equipment and storage medium for acquiring test data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| OL01 | Intention to license declared | ||
| OL01 | Intention to license declared |