CN113486035B - Data record batch processing method and device, storage medium and electronic equipment - Google Patents
Data record batch processing method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN113486035B CN113486035B CN202110765426.6A CN202110765426A CN113486035B CN 113486035 B CN113486035 B CN 113486035B CN 202110765426 A CN202110765426 A CN 202110765426A CN 113486035 B CN113486035 B CN 113486035B
- Authority
- CN
- China
- Prior art keywords
- data record
- record list
- list
- data
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title abstract description 14
- 238000000034 method Methods 0.000 claims abstract description 44
- 238000012545 processing Methods 0.000 claims abstract description 19
- 238000000605 extraction Methods 0.000 claims description 18
- 238000012216 screening Methods 0.000 claims description 13
- 238000010923 batch production Methods 0.000 claims description 9
- 238000004801 process automation Methods 0.000 abstract 1
- 230000008569 process Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000007115 recruitment Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2379—Updates performed during online database operations; commit processing
- G06F16/2386—Bulk updating operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the application discloses a data record batch processing method, a device, a storage medium and electronic equipment. The method comprises the steps of determining a time search condition corresponding to batch processing; determining a first data record list according to the time search condition, wherein the first data record list is composed of first data records which are used for recording attribute information related to a first account and business and meet the time search condition; determining a second data record list according to the time search condition, wherein the second data record list is composed of second data records which meet the time search condition and are used for recording service mode information; acquiring a service mode configuration management table; and updating the service mode configuration management table according to the first data record list and the second data record list. According to the embodiment of the application, the data record is updated in a batch processing mode, so that the labor cost is saved, the whole process automation of data update is realized, and the omission is avoided.
Description
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a data record batch processing method and device, a storage medium and electronic equipment.
Background
In a business scenario, data related to a user may change frequently in response to an operation of the user, and may affect related business configuration data, where the business configuration data cannot be actively updated along with the operation of the user, and only depends on passive update. In order to ensure consistency of service configuration data, a great deal of effort is often required in the related art to perform consistency maintenance on service configuration data which needs to be passively updated, and the consistency maintenance needs to be manually implemented and cannot be automatically implemented, so that the updating efficiency is low and careless mistakes are easy to occur.
Disclosure of Invention
In order to solve at least one of the above technical problems, embodiments of the present application provide a data record batch processing method, apparatus, storage medium, and electronic device.
In one aspect, an embodiment of the present application provides a data record batch processing method, where the method includes:
Determining a time search condition corresponding to batch processing;
Determining a first data record list according to the time search condition, wherein the first data record list is composed of first data records which meet the time search condition and are used for recording attribute information related to a first account and a service;
Determining a second data record list according to the time search condition, wherein the second data record list is composed of second data records which meet the time search condition and are used for recording service mode information;
Acquiring a service mode configuration management table;
And updating the service mode configuration management table according to the first data record list and the second data record list.
In one embodiment, the determining the time search condition corresponding to the batch process includes:
Determining a start time interval of the batch process;
And determining the time search condition according to the time interval.
In one embodiment, the determining the first data record list according to the time search condition includes:
Obtaining a first record table, wherein the first record table at least comprises the following fields: the method comprises the steps of a first account identifier, a business association subject, a business association account, a second account identifier, creation time and update time;
And inquiring the first record table according to the time search condition to obtain a first data record list, wherein the creation time or the update time of each record in the first data record list accords with the time search condition.
In one embodiment, the determining the second list of data records according to the time search condition includes:
obtaining a second record table, wherein the second record table at least comprises the following fields: the method comprises the steps of a service association main body, a service association account, a second account identifier, a service mode and a time interval;
and inquiring the second record table according to the time search condition to obtain a second data record list, wherein the time interval of each record in the second data record list accords with the time search condition.
In one embodiment, said updating said traffic pattern configuration management table according to said first data record list and said second data record list comprises:
screening the second data record list based on the first data record list to obtain a target second data record list;
determining field extraction conditions according to the service association main body, the service association account and the service mode;
Performing field extraction on the target second data record list based on the field extraction condition to generate a third data record list;
And updating the service mode configuration management table based on the third data record list.
In one embodiment, the traffic pattern configuration management table includes at least the following fields: the updating the service mode configuration management table based on the third data record list comprises the following steps:
determining a target third data record list based on the traffic pattern configuration management table, the records in the target third data record list not being hit by the traffic pattern configuration management table and being hit by the third data record list;
determining corresponding service configuration resources for each record in the target third data record list;
Generating a corresponding service mode configuration record according to the service configuration resource;
and adding the service mode configuration record to the service mode configuration management table.
In one embodiment, the filtering the second data record list based on the first data record list to obtain a target second data record list includes:
Screening the second data record list based on the first data record list to obtain an alternative record list, wherein a second account identifier in the alternative record list is hit by a record in the first data record list;
grouping records in the alternative record list according to the service association main body, the service association account and the service mode to obtain a plurality of grouping results;
one record is determined in each grouping result, and the target second data record list is formed.
In another aspect, an embodiment of the present application provides a data record batch processing apparatus, including:
The time search condition determining module is used for determining a time search condition corresponding to batch processing;
the first data record searching module is used for determining a first data record list according to the time searching condition, wherein the first data record list is composed of first data records which meet the time searching condition and are used for recording the attribute information related to the first account and the service;
A second data record searching module, configured to determine a second data record list according to the time searching condition, where the second data record list is formed by a second data record that satisfies the time searching condition and is used for recording service mode information;
The service mode configuration management table acquisition module is used for acquiring a service mode configuration management table;
and the business mode configuration management table updating module is used for updating the business mode configuration management table according to the first data record list and the second data record list.
In one embodiment, the time search condition determining module is configured to determine a start time interval of the batch process; and determining the time search condition according to the time interval.
In one embodiment, the first data record searching module is configured to obtain a first record table, where the first record table includes at least the following fields: the method comprises the steps of a first account identifier, a business association subject, a business association account, a second account identifier, creation time and update time; and inquiring the first record table according to the time search condition to obtain a first data record list, wherein the creation time or the update time of each record in the first data record list accords with the time search condition.
In one embodiment, the second data record searching module is configured to obtain a second record table, where the second record table includes at least the following fields: the method comprises the steps of a service association main body, a service association account, a second account identifier, a service mode and a time interval; and inquiring the second record table according to the time search condition to obtain a second data record list, wherein the time interval of each record in the second data record list accords with the time search condition.
In one embodiment, the service mode configuration management table updating module is configured to perform the following operations:
screening the second data record list based on the first data record list to obtain a target second data record list;
determining field extraction conditions according to the service association main body, the service association account and the service mode;
Performing field extraction on the target second data record list based on the field extraction condition to generate a third data record list;
And updating the service mode configuration management table based on the third data record list.
In one embodiment, the traffic pattern configuration management table includes at least the following fields: the business mode configuration management table updating module is further used for executing the following operations:
determining a target third data record list based on the traffic pattern configuration management table, the records in the target third data record list not being hit by the traffic pattern configuration management table and being hit by the third data record list;
determining corresponding service configuration resources for each record in the target third data record list;
Generating a corresponding service mode configuration record according to the service configuration resource;
and adding the service mode configuration record to the service mode configuration management table.
In one embodiment, the service mode configuration management table updating module is further configured to perform the following operations:
Screening the second data record list based on the first data record list to obtain an alternative record list, wherein a second account identifier in the alternative record list is hit by a record in the first data record list;
grouping records in the alternative record list according to the service association main body, the service association account and the service mode to obtain a plurality of grouping results;
one record is determined in each grouping result, and the target second data record list is formed.
In another aspect, an embodiment of the present application provides a computer readable storage medium, where at least one instruction or at least one program is stored, where the at least one instruction or at least one program is loaded and executed by a processor to implement the data record batch processing method described above.
In another aspect, an embodiment of the present application provides an electronic device including at least one processor, and a memory communicatively coupled to the at least one processor; the storage stores instructions executable by the at least one processor, and the at least one processor implements the data record batch processing method by executing the instructions stored by the storage.
The embodiment of the application provides a data record batch processing method, a data record batch processing device, a storage medium and electronic equipment. The embodiment of the application provides the update of the data record in a batch processing mode, thereby saving the labor cost, realizing the whole-course automation of the data update and avoiding the occurrence of omission. And further, a specific batch update method is disclosed, which can automatically update the business configuration data in a linkage way according to the initiative update of the user.
Drawings
In order to more clearly illustrate the technical solutions and advantages of embodiments of the present application or related technologies, the following description will briefly explain the drawings required for the embodiments or related technologies, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to the drawings without inventive effort for those skilled in the art.
FIG. 1 is a schematic flow chart of a batch processing method for data records according to an embodiment of the present application;
Fig. 2 is a flow chart of a method for updating a service mode configuration management table according to an embodiment of the present application;
FIG. 3 is a flow chart of obtaining a target second data record list provided by an embodiment of the present application;
FIG. 4 is a flowchart for updating the service mode configuration management table according to an embodiment of the present application;
FIG. 5 is a block diagram of a batch processing apparatus for data records according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the embodiments of the present application.
It should be noted that the terms "first," "second," and the like in the description and the claims of the embodiments of the present application and the above-described drawings are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In order to make the objects, technical solutions and advantages of the embodiments of the present application more apparent, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the detailed description and specific examples, while indicating the embodiment of the application, are intended for purposes of illustration only and are not intended to limit the scope of the application.
The terms "first" and "second" are used below for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present embodiment, unless otherwise specified, the meaning of "plurality" is two or more.
The following describes a data record batch processing method according to an embodiment of the present application, which can be applied to the above application environment. FIG. 1 is a flow chart of a batch processing method for data records according to an embodiment of the present application, where the method operations described in the embodiments or the flow charts are provided, but may include more or less operations based on conventional or non-inventive labor. The order of steps recited in the embodiments is merely one way of performing the order of steps and does not represent a unique order of execution. When implemented by a system or server product in practice, the method may be performed sequentially or in parallel (e.g., in a parallel processor or multi-threaded processing environment) as shown in the embodiments or figures, where the method may include:
S101, determining time search conditions corresponding to batch processing.
In the embodiment of the application, the time search condition is determined according to the starting frequency of batch processing. Specifically, a start-up time interval of the above-described batch process may be determined; and determining the time search condition according to the time interval. For example, if the batch process is started once a day, then the time interval is one day, and the time search condition described above may be determined to be one day, that is, only concerned with the relevant data changes within one day.
S102, determining a first data record list according to the time search condition, wherein the first data record list is composed of first data records which are used for recording attribute information related to a first account and business and meet the time search condition.
In the embodiment of the present application, the first data record list is obtained by searching the first record list according to the time search condition, and the present application does not limit the first record list, and is a table structure for recording attribute information related to the first account and the service. The present application is not limited to a first account, which may correspond to a certain role of participating in a service, and may be, for example, a member user who qualifies to participate in a service.
In an embodiment of the present application, the first record table at least includes the following fields: the method comprises the steps of a first account identifier, a business association body, a business association account, a second account identifier, creation time and update time. The service association entity and the service association account are related entities that generate service interaction with the first account, and illustratively, taking recruitment scenario as an example, the first account may be a recruiter, the service association entity may be an enterprise party, and the service association account may be a labor party. The second account is used for managing orders related to the business, that is, the second account identification may be understood as an order identification. In some scenarios, a new record may be generated based on the active operation of the first account, the generation time of the new record being embodied in the creation time field, and in other scenarios, an existing record may be updated based on the active operation of the first account, such update being embodied in the update time field.
Further, the first record table is queried according to the time search condition to obtain a first data record list, and the creation time or the update time of each record in the first data record list accords with the time search condition. Illustratively, taking the time search condition as "one day" as an example, records in the first record table with created times or updated times in the last day may be filtered out to form the first data record table.
S103, determining a second data record list according to the time search condition, wherein the second data record list is composed of second data records which meet the time search condition and are used for recording service mode information.
In the embodiment of the present application, the second data record list is obtained by searching the second record list according to the time search condition, and the present application does not limit the second record list, and is a list structure for recording service mode information.
In the embodiment of the present application, the second record table at least includes the following fields: the method comprises the steps of a business association main body, a business association account, a second account identifier, a business mode and a time interval. The embodiment of the application does not limit the service mode, and can be various service modes, such as a service settlement mode, a service operation mode and the like. The time interval is used for limiting the effective time of the service mode, so that the method provided by the application can be suitable for automatic updating of the relevant configuration of the time-limited service mode.
Further, the second record table is queried according to the time search condition to obtain a second data record list, and the time interval of each record in the second data record list meets the time search condition.
S104, acquiring a service mode configuration management table.
In the embodiment of the present application, service mode configuration management may be understood as a passive updated object, where the service mode configuration management table at least includes the following fields: business association body, business association account, business mode and business configuration resource. That is, according to the service association subject, the service association account and the service mode, the corresponding service configuration resources thereof are determined, by the method in the embodiment of the application, the target triples, namely the service association subject, the service association account and the service mode, can be automatically determined, the corresponding service configuration resources thereof are automatically determined for the target triples, and the service mode configuration management table is updated accordingly, so that the automatic passive update of the service mode configuration management table is realized, the consistency between the service mode configuration management table and the related data which are actively updated can be maintained, the service configuration management table can be automatically executed, the dependence on manpower is not needed, the update efficiency is improved, and the error probability is reduced.
S105, updating the service mode configuration management table according to the first data record list and the second data record list.
Referring to fig. 2, a schematic diagram of a method for updating a service mode configuration management table is shown, where updating the service mode configuration management table according to the first data record list and the second data record list includes:
s1051, screening the second data record list based on the first data record list to obtain a target second data record list.
In one embodiment, referring to fig. 3, the step of screening the second data record list based on the first data record list to obtain a target second data record list includes:
S10511, screening the second data record list based on the first data record list to obtain an alternative record list, wherein a second account identifier in the alternative record list is hit by a record in the first data record list.
Each record in the first list of data records and the second list of data records contains a field that identifies the second account. For a first record in the first data record list, if the second account identifier of the record is recorded in a certain first record in the first data record list, the embodiment considers that the second record identifier is hit by the first data record list, and the second record can participate in forming the alternative record list. If the second account identifier of the record is not recorded in any first record in the first data record list, the embodiment considers that the second record identifier is not hit by the first data record list and cannot participate in the formation of the alternative record list.
S10512, grouping records in the alternative record list according to the service association main body, the service association account and the service mode to obtain a plurality of grouping results.
S10513, determining a record in each grouping result to form the target second data record list.
Steps S10512 to S10513 are to obtain valid data, i.e. the target second data record list, by packet deduplication.
S1052, determining field extraction conditions according to the service association main body, the service association account and the service mode.
S1053, performing field extraction on the target second data record list based on the field extraction condition to generate a third data record list.
And extracting only three fields of a business association body, a business association account and a business mode for each record of the target second data record list to obtain a third data record list. Each record in the third list of data records may be considered to form a target triplet as described above.
S1054, updating the service mode configuration management table based on the third data record list.
In one embodiment, referring to fig. 4, the updating the service mode configuration management table based on the third data record list includes:
S10541, determining a target third data record list based on the service mode configuration management table, wherein the records in the target third data record list are not hit by the service mode configuration management table and are hit by the third data record list.
Specifically, for each target triplet in the third data record list, if a record in the service mode configuration management table includes the target triplet, the embodiment considers that the target triplet is hit by the service mode configuration management table, which indicates that the target triplet does not need to update the corresponding service configuration resource, and if any record in the service mode configuration management table does not include the target triplet, the embodiment considers that the target triplet is not hit by the service mode configuration management table, which indicates that the target triplet needs to configure its corresponding service configuration resource in the service configuration mode configuration table, and the target triplet is used to form the target third data record list.
S10542, determining corresponding service configuration resources according to each record in the target third data record list.
S10543, generating a corresponding service mode configuration record according to the service configuration resource.
S10544, adding the service mode configuration record into the service mode configuration management table.
The application is not limited to a method for determining service configuration resources, and specifically, the method can directly generate the service configuration resources by taking the target triples as parameters according to a preset rule, and can also be manually determined.
The embodiment of the application provides the update of the data record in a batch processing mode, thereby saving the labor cost, realizing the whole-course automation of the data update and avoiding the occurrence of omission. And further, a specific batch update method is disclosed, which can automatically update the business configuration data in a linkage way according to the initiative update of the user.
The embodiment of the application also discloses a batch processing device for data record, as shown in fig. 5, the device comprises:
The time search condition determining module 101 is configured to determine a time search condition corresponding to the batch process.
The first data record searching module 102 is configured to determine a first data record list according to the time search condition, where the first data record list is configured of first data records that satisfy the time search condition and are used to record attribute information related to a first account and a service.
A second data record searching module 103, configured to determine a second data record list according to the time search condition, where the second data record list is configured by second data records for recording service mode information that satisfy the time search condition.
The service mode configuration management table obtaining module 104 is configured to obtain a service mode configuration management table.
A service mode configuration management table updating module 105, configured to update the service mode configuration management table according to the first data record list and the second data record list.
In one embodiment, the time search condition determining module is configured to determine a start time interval of the batch process; and determining the time search condition according to the time interval.
In one embodiment, the first data record searching module is configured to obtain a first record table, where the first record table includes at least the following fields: the method comprises the steps of a first account identifier, a business association subject, a business association account, a second account identifier, creation time and update time; and inquiring the first record table according to the time search condition to obtain a first data record list, wherein the creation time or the update time of each record in the first data record list accords with the time search condition.
In one embodiment, the second data record searching module is configured to obtain a second record table, where the second record table includes at least the following fields: the method comprises the steps of a service association main body, a service association account, a second account identifier, a service mode and a time interval; and inquiring the second record table according to the time search condition to obtain a second data record list, wherein the time interval of each record in the second data record list meets the time search condition.
In one embodiment, the service mode configuration management table updating module is configured to perform the following operations:
screening the second data record list based on the first data record list to obtain a target second data record list;
determining field extraction conditions according to the service association main body, the service association account and the service mode;
Performing field extraction on the target second data record list based on the field extraction condition to generate a third data record list;
And updating the service mode configuration management table based on the third data record list.
In one embodiment, the service mode configuration management table includes at least the following fields: the business mode configuration management table updating module is further used for executing the following operations:
Determining a target third data record list based on the traffic pattern configuration management table, the records in the target third data record list not being hit by the traffic pattern configuration management table and being hit by the third data record list;
Determining corresponding service configuration resources aiming at each record in the target third data record list;
Generating a corresponding service mode configuration record according to the service configuration resource;
And adding the service mode configuration record into the service mode configuration management table.
In one embodiment, the service mode configuration management table updating module is further configured to perform the following operations:
Screening the second data record list based on the first data record list to obtain an alternative record list, wherein a second account identifier in the alternative record list is hit by a record in the first data record list;
Grouping records in the alternative record list according to the service association main body, the service association account and the service mode to obtain a plurality of grouping results;
and determining a record in each grouping result to form the target second data record list.
Specifically, the embodiment of the application discloses a data record batch processing device and the corresponding method embodiment based on the same inventive concept. Please refer to the method embodiment for details, which will not be described herein.
Embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium and executes the computer instructions to cause the computer device to perform the data record batch processing method described above.
The embodiment of the application also provides a computer readable storage medium, which can store a plurality of instructions. The instructions may be adapted to be loaded by a processor and to perform the data record batching method described above in accordance with embodiments of the present application.
The embodiment of the application provides electronic equipment, which comprises at least one processor and a memory, wherein the memory is in communication connection with the at least one processor; the memory stores instructions executable by the at least one processor, and the at least one processor implements the above-described complex data record batch processing method by executing the instructions stored by the memory.
It should be noted that: the sequence of the embodiments of the present application is only for description, and does not represent the advantages and disadvantages of the embodiments. And the foregoing description has been directed to specific embodiments of this application. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
All the embodiments of the present application are described in a progressive manner, and identical and similar parts of all the embodiments are mutually referred to, and each embodiment mainly describes differences from other embodiments. In particular, for the device and server embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and references to the parts of the description of the method embodiments are only required.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, where the program may be stored in a computer readable storage medium, and the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The foregoing description of the preferred embodiments of the present application is not intended to limit the embodiments of the present application, but is intended to cover all modifications, equivalents, improvements and alternatives falling within the spirit and principles of the embodiments of the present application.
Claims (7)
1. A method for batch processing of data records, the method comprising:
Determining a time search condition corresponding to batch processing;
Determining a first data record list according to the time search condition, wherein the first data record list is composed of first data records which meet the time search condition and are used for recording the attribute information related to the first account and the service; the determining the first list of data records includes: obtaining a first record table, wherein the first record table at least comprises the following fields: the method comprises the steps of a first account identifier, a business association subject, a business association account, a second account identifier, creation time and update time; inquiring the first record table according to the time search condition to obtain a first data record list, wherein the creation time or the update time of each record in the first data record list accords with the time search condition;
Determining a second data record list according to the time search condition, wherein the second data record list is composed of second data records which meet the time search condition and are used for recording service mode information; the determining the second list of data records includes: obtaining a second record table, wherein the second record table at least comprises the following fields: the method comprises the steps of a service association main body, a service association account, a second account identifier, a service mode and a time interval; inquiring the second record table according to the time search condition to obtain a second data record list, wherein the time interval of each record in the second data record list accords with the time search condition;
Acquiring a service mode configuration management table;
Updating the service mode configuration management table according to the first data record list and the second data record list; the updating the service mode configuration management table includes: screening the second data record list based on the first data record list to obtain a target second data record list; determining field extraction conditions according to the service association main body, the service association account and the service mode; performing field extraction on the target second data record list based on the field extraction condition to generate a third data record list; and updating the service mode configuration management table based on the third data record list.
2. The method of claim 1, wherein determining a time search condition for a batch process comprises:
Determining a start time interval of the batch process;
And determining the time search condition according to the time interval.
3. The method according to claim 1, wherein the traffic pattern configuration management table comprises at least the following fields: the updating the service mode configuration management table based on the third data record list comprises the following steps:
determining a target third data record list based on the traffic pattern configuration management table, the records in the target third data record list not being hit by the traffic pattern configuration management table and being hit by the third data record list;
determining corresponding service configuration resources for each record in the target third data record list;
Generating a corresponding service mode configuration record according to the service configuration resource;
and adding the service mode configuration record to the service mode configuration management table.
4. A method according to claim 2 or 3, wherein said screening said second list of data records based on said first list of data records to obtain a target second list of data records comprises:
Screening the second data record list based on the first data record list to obtain an alternative record list, wherein a second account identifier in the alternative record list is hit by a record in the first data record list;
grouping records in the alternative record list according to the service association main body, the service association account and the service mode to obtain a plurality of grouping results;
one record is determined in each grouping result, and the target second data record list is formed.
5. A batch processing apparatus for data records, the apparatus comprising:
The time search condition determining module is used for determining a time search condition corresponding to batch processing;
The first data record searching module is used for determining a first data record list according to the time searching condition, wherein the first data record list is composed of first data records which meet the time searching condition and are used for recording the attribute information related to the first account and the service; the determining the first list of data records includes: obtaining a first record table, wherein the first record table at least comprises the following fields: the method comprises the steps of a first account identifier, a business association subject, a business association account, a second account identifier, creation time and update time; inquiring the first record table according to the time search condition to obtain a first data record list, wherein the creation time or the update time of each record in the first data record list accords with the time search condition;
A second data record searching module, configured to determine a second data record list according to the time searching condition, where the second data record list is formed by a second data record that satisfies the time searching condition and is used for recording service mode information; the determining the second list of data records includes: obtaining a second record table, wherein the second record table at least comprises the following fields: the method comprises the steps of a service association main body, a service association account, a second account identifier, a service mode and a time interval; inquiring the second record table according to the time search condition to obtain a second data record list, wherein the time interval of each record in the second data record list accords with the time search condition;
The service mode configuration management table acquisition module is used for acquiring a service mode configuration management table;
A service mode configuration management table updating module, configured to update the service mode configuration management table according to the first data record list and the second data record list; the updating the service mode configuration management table includes: screening the second data record list based on the first data record list to obtain a target second data record list; determining field extraction conditions according to the service association main body, the service association account and the service mode; performing field extraction on the target second data record list based on the field extraction condition to generate a third data record list; and updating the service mode configuration management table based on the third data record list.
6. An electronic device comprising a processor and a memory, wherein the memory has stored therein at least one instruction or at least one program that is loaded and executed by the processor to implement a data record batching method according to any of claims 1 to 4.
7. A computer readable storage medium having stored therein at least one instruction or at least one program loaded and executed by a processor to implement a data record batching method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110765426.6A CN113486035B (en) | 2021-07-07 | 2021-07-07 | Data record batch processing method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110765426.6A CN113486035B (en) | 2021-07-07 | 2021-07-07 | Data record batch processing method and device, storage medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113486035A CN113486035A (en) | 2021-10-08 |
| CN113486035B true CN113486035B (en) | 2024-05-07 |
Family
ID=77941535
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110765426.6A Active CN113486035B (en) | 2021-07-07 | 2021-07-07 | Data record batch processing method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113486035B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111125176A (en) * | 2019-12-20 | 2020-05-08 | 北京百度网讯科技有限公司 | Service data searching method and device, electronic equipment and storage medium |
| CN112148711A (en) * | 2020-09-21 | 2020-12-29 | 建信金融科技有限责任公司 | Processing method and device for batch processing tasks |
| CN112182093A (en) * | 2020-10-23 | 2021-01-05 | 腾讯科技（深圳）有限公司 | Data storage method, device, equipment and computer readable storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004005862A (en) * | 2002-06-03 | 2004-01-08 | Pioneer Electronic Corp | Information recording and reproducing device, list creation method therein, and list creation program |
| US20090187551A1 (en) * | 2008-01-17 | 2009-07-23 | Oracle International Corporation | Search results when searching for records of a business object |
| JP4741689B2 (en) * | 2009-03-11 | 2011-08-03 | 株式会社日立製作所 | Data processing method, data processing apparatus, and data processing program |
| US11074273B2 (en) * | 2014-03-07 | 2021-07-27 | International Business Machines Corporation | Framework for continuous processing of a set of documents by multiple software applications |
| US20200125660A1 (en) * | 2018-10-19 | 2020-04-23 | Ca, Inc. | Quick identification and retrieval of changed data rows in a data table of a database |
-
2021
- 2021-07-07 CN CN202110765426.6A patent/CN113486035B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111125176A (en) * | 2019-12-20 | 2020-05-08 | 北京百度网讯科技有限公司 | Service data searching method and device, electronic equipment and storage medium |
| CN112148711A (en) * | 2020-09-21 | 2020-12-29 | 建信金融科技有限责任公司 | Processing method and device for batch processing tasks |
| CN112182093A (en) * | 2020-10-23 | 2021-01-05 | 腾讯科技（深圳）有限公司 | Data storage method, device, equipment and computer readable storage medium |
Non-Patent Citations (2)
| Title |
|---|
| Oracle数据库全库自动搜索方法研究;徐国天;;信息网络安全(05);第12-14页 * |
| 云计算架构在银行批处理流程优化中的应用研究;赵曦;《软件导刊》;20131025;第1-4页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113486035A (en) | 2021-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108427684B (en) | Data query method and device and computing equipment | |
| CN113760476B (en) | Task dependency processing method and related device | |
| CN109165175B (en) | Equipment identifier generation method and device | |
| CN117238433B (en) | Method for automatically isolating document data based on Libreoffice | |
| CN113407623A (en) | Data processing method and device and server | |
| CN114661736B (en) | Electronic map updating method and device, electronic equipment, storage medium and product | |
| CN112491609A (en) | System application architecture discovery method and system based on business service | |
| CN113486035B (en) | Data record batch processing method and device, storage medium and electronic equipment | |
| CN109766392A (en) | Data processing method and device | |
| US20110093688A1 (en) | Configuration management apparatus, configuration management program, and configuration management method | |
| CN113761052A (en) | Database synchronization method and device | |
| CN115914387A (en) | Resource sharing and data query method, device and server | |
| CN107422991B (en) | Storage strategy management system | |
| CN111125226A (en) | Configuration data acquisition method and device | |
| CN115687276A (en) | File processing method and device, electronic equipment and storage medium | |
| CN113435948B (en) | E-commerce platform data monitoring method and system | |
| CN114625515A (en) | Task management method, device, equipment and storage medium | |
| CN109032641A (en) | Application version update method and device | |
| CN113312412A (en) | Statistical data acquisition method and device, electronic equipment and storage medium | |
| CN110532453B (en) | Method for adjusting crawler updating frequency, storage medium and crawler server | |
| EP4113313A1 (en) | Control method, information processing device, and control program | |
| CN112417259B (en) | Media resource processing method, device, equipment and storage medium | |
| CN114385621A (en) | Locking method, device, equipment and medium | |
| CN112732669B (en) | Data processing method and device | |
| CN113505981A (en) | Method, device and storage medium for determining service resources in flat service scene |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |