CN111597245A - Data extraction method and device, information statistics method and related equipment - Google Patents
Data extraction method and device, information statistics method and related equipment Download PDFInfo
- Publication number
- CN111597245A CN111597245A CN202010430470.7A CN202010430470A CN111597245A CN 111597245 A CN111597245 A CN 111597245A CN 202010430470 A CN202010430470 A CN 202010430470A CN 111597245 A CN111597245 A CN 111597245A
- Authority
- CN
- China
- Prior art keywords
- data
- extraction
- target
- service
- data extraction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application discloses a data extraction method, which comprises the steps of obtaining service data; carrying out data loading according to the service data to obtain source data; an extraction actuator is configured according to the service data; performing data extraction on the source data by using the extraction actuator to obtain target data; the data extraction method can configure different types of extraction actuators according to different service types, is used for realizing various types of data extraction services, effectively improves the universality of data extraction equipment, simplifies the equipment development process and reduces the equipment development difficulty. The application also discloses a data extraction device, equipment and a computer readable storage medium, which have the beneficial effects.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data extraction method, and further, to a data extraction device, a data extraction apparatus, and a computer-readable storage medium.
Background
Data extraction is a process of extracting data from a data source, and existing extraction equipment is developed based on business requirements of the equipment from data loading to result output until the requirement of a whole business line is met, namely different extraction equipment is developed according to different types of business requirements, the implementation process is complicated, the requirements of generality, standardization and expandability of random extraction cannot be met, and great development difficulty is brought to technical staff.
Therefore, how to effectively improve the universality of the data extraction device and simplify the device development process is a problem to be urgently solved by those skilled in the art.
Disclosure of Invention
The data extraction method can effectively improve the universality of data extraction equipment and simplify the equipment development process; another object of the present application is to provide a data extraction device, an apparatus and a computer-readable storage medium, which also have the above beneficial effects.
In order to solve the above technical problem, the present application provides a data extraction method, where the data extraction method includes:
acquiring service data;
carrying out data loading according to the service data to obtain source data;
an extraction actuator is configured according to the service data;
and performing data extraction on the source data by using the extraction actuator to obtain target data.
Preferably, the extracting executor configured according to the service data includes:
determining a business rule according to the business data;
and configuring an extraction algorithm, an extraction factor interference unit and a link filter according to the business rule.
Preferably, the extracting the data from the source data by using the extracting executor to obtain the target data includes:
filtering the source data by using the link filter to obtain filtered source data;
performing probability calculation on the filtered source data according to the service data to obtain each initial extraction probability;
carrying out probability floating on each initial extraction probability by using the extraction factor interference unit to obtain each extraction probability;
and performing data extraction on the filtered source data by using the extraction algorithm and each extraction probability to obtain the target data.
Preferably, the data extraction method further includes:
sending a confirmation request to a target object corresponding to the target data;
judging whether confirmation information fed back by the target object is received or not;
if not, returning to the step of performing data extraction on the source data by using the extraction executor until a new target object is obtained.
Preferably, the data extraction method further includes:
and sending the target data to display equipment for visual display.
In order to solve the above technical problem, the present application further provides a data extraction device, including:
the acquisition module is used for acquiring the service data;
the loading module is used for loading data according to the service data to obtain source data;
the configuration module is used for configuring and extracting the actuator according to the service data;
and the extraction module is used for performing data extraction on the source data by using the extraction actuator to obtain target data.
Preferably, the data extraction device further includes:
the confirmation module is used for sending a confirmation request to a target object corresponding to the target data; judging whether confirmation information fed back by the target object is received or not; if not, returning to the step of performing data extraction on the source data by using the extraction executor until a new target object is obtained.
Preferably, the data extraction device further includes:
and the display module is used for sending the target data to display equipment for visual display.
In order to solve the above technical problem, the present application further provides a data extraction device, where the data extraction device includes:
a memory for storing a computer program;
and the processor is used for realizing the steps of any data extraction method when the computer program is executed.
In order to solve the above technical problem, the present application further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements the steps of any one of the above data extraction methods.
The data extraction method provided by the application comprises the steps of obtaining service data; carrying out data loading according to the service data to obtain source data; an extraction actuator is configured according to the service data; and performing data extraction on the source data by using the extraction actuator to obtain target data.
Therefore, after data loading is completed, the data extraction method provided by the application adapts the corresponding extraction actuator to the current service by using the service data, and then executes the current service by using the extraction actuator to realize data extraction.
The data extraction device, the equipment and the computer readable storage medium provided by the application all have the beneficial effects, and are not described again.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic flow chart of a data extraction method provided in the present application;
fig. 2 is a schematic structural diagram of a data extraction system provided in the present application;
fig. 3 is a schematic structural diagram of a data extraction device provided in the present application;
fig. 4 is a schematic structural diagram of a data extraction device provided in the present application.
Detailed Description
The core of the application is to provide a data extraction method, which can effectively improve the universality of data extraction equipment and simplify the equipment development process; another core of the present application is to provide a data extraction apparatus, a device and a computer-readable storage medium, which also have the above beneficial effects.
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a schematic flow chart of a data extraction method provided in the present application, where the data extraction method may include:
s101: acquiring service data;
the step aims to realize the acquisition of the service data, wherein the service data is the relevant data information of the current service to be executed, namely the data information of the current data extraction task. It can be understood that the specific content of the service data does not affect the implementation of the present technical solution, and the data extraction may be completed, for example, the specific content may include type information of a service to be currently executed, an algorithm type for performing data extraction, and type information of a data extraction result, which is not limited in the present application.
S102: carrying out data loading according to the service data to obtain source data;
the step aims to realize the acquisition of the source data, and the source data can be acquired by loading the data according to the service data. The source data is a set of data subjected to data extraction, that is, target data required by the current service to be executed can be obtained by performing data extraction on the source data. Of course, different business data correspond to different source data, for example, for expert extraction in the project purchasing process, the source data is the set of all relevant experts.
S103: extracting an actuator according to the service data configuration;
the step aims to realize the configuration of the extraction executor according to the relevant information configuration in the service data. The extraction executor is an execution subject for executing the data extraction task, and the required target data can be obtained by performing data extraction on the source data through the extraction executor. Similarly, different service data correspond to different types of extraction executors, and the configuration process of different types of extraction executors may be different, for example, when data extraction needs to be implemented by different data extraction algorithms, then different data extraction algorithms need to be bound when the configuration of the extraction executors is extracted.
As a preferred embodiment, the extracting executor configured according to the service data may include: determining a business rule according to the business data; and configuring an extraction algorithm, an extraction factor interference unit and a link filter according to the business rule.
The preferred embodiment provides a more specific configuration method for an extraction actuator, which includes determining a service rule based on service data, and then implementing configuration of the extraction actuator according to the service rule, where the configuration contents mainly include, but are not limited to, an extraction algorithm, an extraction factor disturber, and a link filter, and different types of extraction algorithms, extraction factor disturbers, and link filters may be configured based on different service data, where the link filter is used to implement data filtering, the extraction factor disturber is used to implement probability disturbance, and the extraction algorithm is used to implement data extraction. Of course, if the specific type is not specified in the traffic data, the default type of extraction algorithm, extraction factor disturber, link filter, etc. may be used. In addition, the data extraction device is also provided with an inlet capable of expanding other functions so as to realize the configuration of various types of extraction actuators and improve the universality of the data extraction device.
S104: and performing data extraction on the source data by using an extraction actuator to obtain target data.
The step aims to realize data extraction and obtain target data, wherein the target data is data information required to be obtained through data extraction. Specifically, after the configuration of the extraction executor is completed, the extraction executor completely corresponds to the current data extraction task to execute the current data extraction task, and thus, the target data can be obtained by performing data extraction on the source data obtained by loading through the extraction executor. It should be noted that, the number of the target data is not unique, that is, in the data extraction process, there may be more than one data to be extracted, but this is determined based on the current data extraction task requirement, and does not affect the implementation of the technical solution, which is not limited in this application.
As a preferred embodiment, the extracting the source data by using the extraction executor to obtain the target data may include: filtering the source data by using a link filter to obtain filtered source data; performing probability calculation on the filtered source data according to the service data to obtain each initial extraction probability; carrying out probability floating on each initial extraction probability by using an extraction factor interference device to obtain each extraction probability; and performing data extraction on the filtered source data by using an extraction algorithm and each extraction probability to obtain target data.
The preferred embodiment provides a more specific data extraction method, and specifically, the data extraction is performed based on the configured extraction executor, so that functions of data filtering, probability floating, data extraction and the like can be sequentially realized, and target data can be obtained.
As a preferred embodiment, the data extraction method may further include: sending a confirmation request to a target object corresponding to the target data; judging whether confirmation information fed back by the target object is received; if not, returning to the step of performing data extraction on the source data by using the extraction executor until a new target object is obtained.
The preferred embodiment aims to realize the determination of the target data through human-computer interaction, that is, whether the target data can be output as final extracted data is determined through a target object corresponding to the target data. Specifically, after the target data is determined, a confirmation request may be sent to the target object corresponding to the target data to request the target object to confirm, and if confirmation information fed back by the target object is received, the target data is determined to be feasible data, and the target data is output; if the confirmation information fed back by the target object is not received, the target number data is not feasible, and data extraction needs to be carried out again until feasible new target data is obtained. For example, for the extraction of experts in the item purchasing process, after the target expert is obtained through extraction, a confirmation request needs to be sent to the target expert to obtain the confirmation of the target expert, so that the relevant information of the target expert can be output.
As a preferred embodiment, the data extraction method may further include: and sending the target data to display equipment for visual display.
The preferred embodiment aims to realize the visual display of the target data, namely the target data can be sent to the corresponding display equipment for visual display after the data extraction is finished and the target data is obtained, so that a user can more conveniently and intuitively know the execution result of the current data extraction task.
According to the data extraction method, after data loading is completed, the corresponding extraction actuator is adapted to the current service by using the service data, then the current service is executed by using the extraction actuator, and data extraction is achieved.
On the basis of the above embodiments, the embodiments of the present application take expert extraction as an example, and provide a more specific data extraction method, which is implemented in the following specific flow:
referring to fig. 2, fig. 2 is a schematic structural diagram of a data extraction system provided in the present application, where the data extraction system includes a business processing module, a rule extraction module, and an extraction execution module.
(1) Business processing module
The system is responsible for inputting business data and receiving and displaying result data; the execution steps comprise:
s10: inputting service data; the service data mainly comprises project data and scheme data;
s11: carrying and displaying result data; the resulting data is mainly expert details.
(2) Rule extraction module
The system is responsible for establishing a business model and executing extraction actions to complete the functions of starting and stopping; the execution steps comprise:
s20: establishing a corresponding service model according to the service data and the requirements of the extraction execution module;
s21: adapting the extraction actuator:
s210: determining whether an extended extraction algorithm is required;
s211: determining whether an extended decimation factor interferer is needed;
s212: determining whether a link filter needs to be extended;
s22: completing initialization according to the adaptation condition of the extraction actuator;
s23: and finishing data output according to the actuator object (target data) returned by the extraction execution module, and delivering the data to the communication module to finish the confirmation of the man-machine interaction state.
(3) Extraction execution module
The system is responsible for business execution and completes expert extraction; the execution steps comprise:
s30: completing data filtering according to the expanded link filter and the filtering rule of the expanded link filter;
s31: completing business data probability floating according to the probability interference strategy of the expanded factor interference device and the business data;
s32: constructing an extraction container of each business model;
s33: finishing data extraction according to an extended extraction algorithm or a random algorithm of the data extraction device to obtain an actuator object;
s34: and returning the executor object to the rule extraction module.
Therefore, the data extraction method provided by the embodiment of the application provides a universal extraction service, can achieve the purposes of simplifying codes, simplifying configuration and simplifying monitoring, and meets the requirements of universality, standardization and expandability.
To solve the above problem, please refer to fig. 3, fig. 3 is a schematic structural diagram of a data extraction device provided in the present application, where the data extraction device may include:
an obtaining module 10, configured to obtain service data;
the loading module 20 is configured to load data according to the service data to obtain source data;
the configuration module 30 is used for configuring the extraction executor according to the service data;
and the extraction module 40 is used for performing data extraction on the source data by using the extraction executor to obtain target data.
Therefore, after data loading is completed, the data extraction device provided by the application adapts the corresponding extraction actuator to the current service by using the service data, and then executes the current service by using the extraction actuator to realize data extraction.
As a preferred embodiment, the configuration module 30 may include:
the determining unit is used for determining a business rule according to the business data;
and the configuration unit is used for configuring an extraction algorithm, an extraction factor interference unit and a link filter according to the business rule.
As a preferred embodiment, the extraction module 40 may include:
the filtering unit is used for filtering the source data by using the link filter to obtain filtered source data;
the computing unit is used for carrying out probability computation on the filtered source data according to the service data to obtain each initial extraction probability;
the floating unit is used for carrying out probability floating on each initial extraction probability by utilizing the extraction factor interference unit to obtain each extraction probability;
and the extraction unit is used for extracting the data of the filtered source data by utilizing an extraction algorithm and each extraction probability to obtain target data.
As a preferred embodiment, the data extraction device may further include:
the confirmation module is used for sending a confirmation request to a target object corresponding to the target data; judging whether confirmation information fed back by the target object is received; if not, returning to the step of performing data extraction on the source data by using the extraction executor until a new target object is obtained.
As a preferred embodiment, the data extraction device may further include:
and the display module is used for sending the target data to the display equipment for visual display.
For the introduction of the apparatus provided in the present application, please refer to the above method embodiments, which are not described herein again.
To solve the above problem, please refer to fig. 4, fig. 4 is a schematic structural diagram of a data extraction device provided in the present application, where the data extraction device may include:
a memory 11 for storing a computer program;
a processor 12, configured to implement the steps of any one of the data extraction methods as described above when executing the computer program.
For the introduction of the device provided in the present application, please refer to the above method embodiment, which is not described herein again.
To solve the above problem, the present application further provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, can implement the steps of any one of the data extraction methods described above.
The computer-readable storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
For the introduction of the computer-readable storage medium provided in the present application, please refer to the above method embodiments, which are not described herein again.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The data extraction method, device, apparatus, and computer-readable storage medium provided in the present application are described in detail above. The principles and embodiments of the present application are explained herein using specific examples, which are provided only to help understand the method and the core idea of the present application. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and these improvements and modifications also fall into the elements of the protection scope of the claims of the present application.
Claims (10)
1. A data extraction method, comprising:
acquiring service data;
carrying out data loading according to the service data to obtain source data;
an extraction actuator is configured according to the service data;
and performing data extraction on the source data by using the extraction actuator to obtain target data.
2. The data extraction method of claim 1, wherein the extracting an executor according to the service data configuration comprises:
determining a business rule according to the business data;
and configuring an extraction algorithm, an extraction factor interference unit and a link filter according to the business rule.
3. The data extraction method according to claim 2, wherein the extracting the source data by the extraction executor to obtain the target data comprises:
filtering the source data by using the link filter to obtain filtered source data;
performing probability calculation on the filtered source data according to the service data to obtain each initial extraction probability;
carrying out probability floating on each initial extraction probability by using the extraction factor interference unit to obtain each extraction probability;
and performing data extraction on the filtered source data by using the extraction algorithm and each extraction probability to obtain the target data.
4. A data extraction method as claimed in any one of claims 1 to 3, further comprising:
sending a confirmation request to a target object corresponding to the target data;
judging whether confirmation information fed back by the target object is received or not;
if not, returning to the step of performing data extraction on the source data by using the extraction executor until a new target object is obtained.
5. The data extraction method of claim 4, further comprising:
and sending the target data to display equipment for visual display.
6. A data extraction apparatus, comprising:
the acquisition module is used for acquiring the service data;
the loading module is used for loading data according to the service data to obtain source data;
the configuration module is used for configuring and extracting the actuator according to the service data;
and the extraction module is used for performing data extraction on the source data by using the extraction actuator to obtain target data.
7. The data extraction device as claimed in claim 6, further comprising:
the confirmation module is used for sending a confirmation request to a target object corresponding to the target data; judging whether confirmation information fed back by the target object is received or not; if not, returning to the step of performing data extraction on the source data by using the extraction executor until a new target object is obtained.
8. The data extraction device as claimed in claim 7, further comprising:
and the display module is used for sending the target data to display equipment for visual display.
9. A data extraction device, characterized by comprising:
a memory for storing a computer program;
a processor for implementing the steps of the data extraction method of any one of claims 1 to 5 when executing said computer program.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the data extraction method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010430470.7A CN111597245B (en) | 2020-05-20 | 2020-05-20 | Data extraction method and device and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010430470.7A CN111597245B (en) | 2020-05-20 | 2020-05-20 | Data extraction method and device and related equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111597245A true CN111597245A (en) | 2020-08-28 |
| CN111597245B CN111597245B (en) | 2023-09-29 |
Family
ID=72186116
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010430470.7A Active CN111597245B (en) | 2020-05-20 | 2020-05-20 | Data extraction method and device and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111597245B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115862882A (en) * | 2022-12-02 | 2023-03-28 | 北京百度网讯科技有限公司 | Data extraction method, device, equipment and storage medium |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013131194A (en) * | 2011-12-22 | 2013-07-04 | Nippon Telegr & Teleph Corp <Ntt> | Model learning device, related information extraction device, related information prediction device, method for learning model, method for extracting related information, method for predicting related information, and program |
| CN103678322A (en) * | 2012-09-03 | 2014-03-26 | 阿里巴巴集团控股有限公司 | System and method for sample data integration |
| CN105162760A (en) * | 2015-07-28 | 2015-12-16 | 郝孟一 | Random draw-off method, apparatus and system |
| CN106156286A (en) * | 2016-06-24 | 2016-11-23 | 广东工业大学 | Type extraction system and method towards technical literature knowledge entity |
| CN106886535A (en) * | 2015-12-16 | 2017-06-23 | 大唐软件技术股份有限公司 | A kind of data pick-up method and apparatus for being adapted to multiple data sources |
| CN107657506A (en) * | 2017-09-06 | 2018-02-02 | 北京五八到家信息技术有限公司 | The intelligent recommendation method and commending system of a kind of service commodity |
| CN108133332A (en) * | 2018-01-17 | 2018-06-08 | 政和科技股份有限公司 | The method, apparatus and server that a kind of expert extracts |
| US20190056918A1 (en) * | 2017-08-17 | 2019-02-21 | Tibco Software Inc. | Interpreter for interpreting a data model algorithm and creating a data shema |
| CN109857803A (en) * | 2018-12-13 | 2019-06-07 | 杭州数梦工场科技有限公司 | Method of data synchronization, device, equipment, system and computer readable storage medium |
| CN109903004A (en) * | 2019-01-11 | 2019-06-18 | 西北工业大学 | A kind of bidding supervision flow method for strengthening supervision |
| CN110555073A (en) * | 2019-09-10 | 2019-12-10 | 政采云有限公司 | data processing method and device, electronic equipment and storage medium |
| CN110633301A (en) * | 2019-09-19 | 2019-12-31 | 浪潮软件集团有限公司 | Method and system for extracting data based on engine setting |
| KR102071538B1 (en) * | 2018-10-19 | 2020-01-30 | 주식회사 카카오게임즈 | A computer program for providing a service for selling a stochastic item and a computer program for providing a probability generating service |
| CN110990082A (en) * | 2019-12-19 | 2020-04-10 | 政采云有限公司 | Service data processing method and related device |
-
2020
- 2020-05-20 CN CN202010430470.7A patent/CN111597245B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013131194A (en) * | 2011-12-22 | 2013-07-04 | Nippon Telegr & Teleph Corp <Ntt> | Model learning device, related information extraction device, related information prediction device, method for learning model, method for extracting related information, method for predicting related information, and program |
| CN103678322A (en) * | 2012-09-03 | 2014-03-26 | 阿里巴巴集团控股有限公司 | System and method for sample data integration |
| CN105162760A (en) * | 2015-07-28 | 2015-12-16 | 郝孟一 | Random draw-off method, apparatus and system |
| CN106886535A (en) * | 2015-12-16 | 2017-06-23 | 大唐软件技术股份有限公司 | A kind of data pick-up method and apparatus for being adapted to multiple data sources |
| CN106156286A (en) * | 2016-06-24 | 2016-11-23 | 广东工业大学 | Type extraction system and method towards technical literature knowledge entity |
| US20190056918A1 (en) * | 2017-08-17 | 2019-02-21 | Tibco Software Inc. | Interpreter for interpreting a data model algorithm and creating a data shema |
| CN107657506A (en) * | 2017-09-06 | 2018-02-02 | 北京五八到家信息技术有限公司 | The intelligent recommendation method and commending system of a kind of service commodity |
| CN108133332A (en) * | 2018-01-17 | 2018-06-08 | 政和科技股份有限公司 | The method, apparatus and server that a kind of expert extracts |
| KR102071538B1 (en) * | 2018-10-19 | 2020-01-30 | 주식회사 카카오게임즈 | A computer program for providing a service for selling a stochastic item and a computer program for providing a probability generating service |
| CN109857803A (en) * | 2018-12-13 | 2019-06-07 | 杭州数梦工场科技有限公司 | Method of data synchronization, device, equipment, system and computer readable storage medium |
| CN109903004A (en) * | 2019-01-11 | 2019-06-18 | 西北工业大学 | A kind of bidding supervision flow method for strengthening supervision |
| CN110555073A (en) * | 2019-09-10 | 2019-12-10 | 政采云有限公司 | data processing method and device, electronic equipment and storage medium |
| CN110633301A (en) * | 2019-09-19 | 2019-12-31 | 浪潮软件集团有限公司 | Method and system for extracting data based on engine setting |
| CN110990082A (en) * | 2019-12-19 | 2020-04-10 | 政采云有限公司 | Service data processing method and related device |
Non-Patent Citations (2)
| Title |
|---|
| 刘如九;张振山;柴天佑;: "一种通用的多数据库间数据抽取方法及应用", 北京交通大学学报, no. 04 * |
| 张培森;施应玲;周庆捷;贺成利;付龙明;: "ETL模型在配电生产运行风险管控信息平台建设中的应用", 电脑与信息技术, no. 06 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115862882A (en) * | 2022-12-02 | 2023-03-28 | 北京百度网讯科技有限公司 | Data extraction method, device, equipment and storage medium |
| CN115862882B (en) * | 2022-12-02 | 2024-02-13 | 北京百度网讯科技有限公司 | Data extraction method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111597245B (en) | 2023-09-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111813869B (en) | Distributed data-based multi-task model training method and system | |
| CN110598868A (en) | Machine learning model building method and device and related equipment | |
| CN110825705A (en) | Data set caching method and related device | |
| CN111597245A (en) | Data extraction method and device, information statistics method and related equipment | |
| CN109782736A (en) | Vehicle data read method, device, mobile unit | |
| CN108491890A (en) | Image method and device | |
| CN107203471B (en) | Joint debugging method, service platform and computer storage medium | |
| CN108573477A (en) | Eliminate method, system and the terminal device of image moire fringes | |
| CN105704102B (en) | Vehicle network access control method and device | |
| CN116680668A (en) | Method and device for activating software of vehicle, storage medium, processor and electronic device | |
| CN109919762A (en) | Reporting method, device, equipment and the storage medium of customer information | |
| CN111353577A (en) | Optimization method and device of multi-task-based cascade combination model and terminal equipment | |
| CN111767652B (en) | Simulation operation method and device and electronic equipment | |
| CN110597216B (en) | Transaction arrangement method and device for manufacturing execution system and readable storage medium | |
| CN114820162A (en) | Risk assessment method, system, electronic equipment and storage medium | |
| CN110087230A (en) | Data processing method, device, storage medium and electronic equipment | |
| CN110363314A (en) | A kind of method, apparatus, mobile terminal and the server of shared detection device | |
| CN111444057A (en) | Page performance data acquisition method and device and computing equipment | |
| CN115034725A (en) | Processing method and device for robot not executing successful delivery task | |
| CN107577437B (en) | Storage information display method, device, equipment and storage medium | |
| CN116599575B (en) | Simulation environment construction method and device for large-scale remote sensing task system | |
| CN106447492A (en) | Business object identification method and apparatus | |
| CN108712497B (en) | Application mode sharing method, device and system | |
| CN115114365A (en) | Data importing method and device of graph database | |
| CN117973825A (en) | Multi-bank channel task flow differentiation processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |