CN116149750A

CN116149750A - Data processing method, device, computer equipment and storage medium

Info

Publication number: CN116149750A
Application number: CN202211647627.7A
Authority: CN
Inventors: 罗祖平; 江希; 朱传曦; 曾伟杰; 张鹏; 林华春
Original assignee: Merchants Union Consumer Finance Co Ltd
Current assignee: Merchants Union Consumer Finance Co Ltd
Priority date: 2022-12-21
Filing date: 2022-12-21
Publication date: 2023-05-23

Abstract

The present application relates to a data processing method, apparatus, computer device, storage medium and computer program product. The method comprises the following steps: under the condition that a message is acquired, executing service processing corresponding to the message, and determining whether a time trigger condition of a time point is met or not based on the message; and under the condition that the time trigger condition is met, calculating a variable corresponding to the time, and storing the variable obtained by calculation for later use by a processing node using the variable. The adoption of the method can help to improve the taking efficiency when using the variable.

Description

Data processing method, device, computer equipment and storage medium

Technical Field

The present invention relates to the field of data processing technology, and in particular, to a data processing method, a data processing apparatus, a computer device, a storage medium, and a computer program product.

Background

With the development of computer technology, in the application process of computer technology, various data are usually required to be processed, such as calculation, so as to facilitate application according to the processed data, where the various data are variable data. Taking internet finance as an example, the financial service mode also shows diversification, and in the field of wind control of internet finance, various calculations, such as calculation of risk decisions, are involved. In risk decisions, various variables typically need to be used for computation to make the risk decision. However, the inventors of the present application found that the efficiency of obtaining variables during the use of the variables in the conventional manner was low.

Disclosure of Invention

In view of the foregoing, it is desirable to provide a data processing method, a data processing apparatus, a computer device, a computer-readable storage medium, and a computer program product that can contribute to the efficiency of taking when using variables.

In a first aspect, the present application provides a data processing method, the method comprising:

under the condition that a message is acquired, executing service processing corresponding to the message, and determining whether a time trigger condition of a time point is met or not based on the message;

and under the condition that the time trigger condition is met, calculating a variable corresponding to the time, and storing the variable obtained by calculation for later use by a processing node using the variable.

In some of these embodiments, the method further comprises:

when a time trigger condition is met, if a service call identifier corresponding to the time exists, calling a service interface corresponding to the service call identifier, and pulling external data from an external data source corresponding to the service call identifier;

and storing the pulled external data for a processing node using the data.

In some embodiments, the calculating the variable corresponding to the time point when the time point triggering condition is met includes:

And under the condition that the time trigger condition is met, calculating a variable corresponding to the time based on the pulled external data.

In some embodiments, before the external data to be pulled is stored, the method further includes:

and carrying out standardization processing on the pulled external data based on a preset data standardization format.

In some embodiments, before the executing the service processing corresponding to the message and determining whether the time trigger condition of the time is met based on the message, the method further includes the steps of:

acquiring data carried by the message;

and carrying out standardization processing on the data carried by the message based on a preset data standardization format.

In some embodiments, before the obtaining the data carried by the packet, the method further includes:

checking the message;

and under the condition that the message passes the verification, acquiring the data carried by the message.

In some of these embodiments, the method further comprises:

displaying a time point configuration interface;

responding to the operation of the time point configuration interface, and receiving time point triggering conditions of the configured time and corresponding variables;

and storing the configured time point information of the time point, wherein the time point information comprises the time point triggering condition and the corresponding variable.

In some embodiments, the time point information further includes a time point identifier, and the storing the configured time point information includes:

and correspondingly storing the time point identifier, the time point triggering condition and the corresponding variable.

In some embodiments, the receiving, in response to operation of the configuration interface at the time point, a time point trigger condition of the configured time and a corresponding variable includes:

responding to the operation of the configuration interface under the triggering condition, and acquiring the configured time point name and the time point triggering condition;

and displaying a variable configuration interface, and responding to the operation on the variable configuration interface to obtain the configured variable corresponding to the time point, wherein the variable corresponding to the time point is determined according to the available data type under the configured time point processing condition.

In some embodiments, after the obtaining the configured time point name and the time trigger condition, before displaying the variable configuration interface, the method further includes:

and displaying a data source interface, wherein the data source interface displays the data types available under the configured time processing conditions.

In some embodiments, the time trigger condition of the time includes a plurality of time trigger conditions that are met simultaneously or singly, and the variable corresponding to the time includes more than two variables.

In a second aspect, the present application also provides a data processing apparatus, the apparatus comprising:

the message receiving module is used for receiving the message;

the business processing module is used for executing business processing corresponding to the message under the condition that the message receiving module acquires the message;

the time trigger module is used for determining whether a time trigger condition of a time is met or not based on the message under the condition that the message receiving module acquires the message;

and the variable calculation module is used for calculating the variable corresponding to the time point and storing the variable obtained by calculation for later use by a processing node using the variable when the time point triggering module determines that the time point triggering condition is met.

In a third aspect, the present application also provides a computer device. The computer device comprises a memory storing a computer program and a processor implementing the steps of the method of any of the embodiments described above when the computer program is executed.

In a fourth aspect, the present application also provides a computer-readable storage medium. The computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method in any of the embodiments described above.

In a fifth aspect, the present application also provides a computer program product. The computer program product comprising a computer program which, when executed by a processor, implements the steps of the method in any of the embodiments described above.

The data processing method, the device, the computer equipment, the storage medium and the computer program product, except for executing the service processing corresponding to the acquired message when the message is acquired, determine whether the time trigger condition of the time point is met based on the message, calculate and store the variable corresponding to the time point when the time trigger condition is met, namely, in the case that the message is acquired, execute the service processing which needs to be executed currently, calculate the variable which needs not to be used in the current service processing at the same time, store the variable, so that other processing nodes which need to use the variable can directly acquire the energy to process when the variable is used, do not need to calculate in real time, and can help to improve the taking efficiency when the variable is used and also help to process the efficiency when the processing node processes the service.

Drawings

FIG. 1 is a diagram of an application environment for a data processing method in one embodiment;

FIG. 2 is a flow diagram of a data processing method in one embodiment;

FIG. 3 is a flow chart of a data processing method according to another embodiment;

FIG. 4 is a schematic diagram illustrating an interaction flow between a business process flow and a data platform in one embodiment;

FIG. 5 is a schematic diagram of an architecture of a risk data platform in one embodiment;

FIG. 6 is a schematic diagram of configuration timing in one embodiment;

FIG. 7 is a flow diagram of a data processing method in one embodiment;

FIG. 8 is a block diagram of a data processing apparatus in one embodiment;

FIG. 9 is an internal block diagram of a computer device in one embodiment;

fig. 10 is an internal structural view of a computer device in another embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.

The data processing method provided by the embodiment of the application can be applied to an application environment shown in fig. 1. Wherein the terminal 102 communicates with the server 104 via a network. The data storage system may store data that the server 104 needs to process. The data storage system may be integrated on the server 104 or may be located on a cloud or other network server. The terminal 102 may perform various service processing procedures, and data required to be used in the service processing procedures may be obtained locally from the terminal 102 or obtained from the server 104, for example, the server 104 may obtain data from a data storage system and provide the data to the terminal 102. The service processing performed by the server 104 may be performed locally by the server 104 or may be performed in conjunction with an interaction with the terminal 102, for example, the server 104 may perform a related processing when receiving an instruction from the terminal 102. In other embodiments, in the process of interaction between the terminal 102 and the server 104, the terminal 102 and the server may execute corresponding service processing procedures respectively. In the process of executing the service processing, the terminal 102 and the server 104 may only provide the result of executing the service processing by the terminal 102 to the server 104, and the server 104 executes further service processing, or the result of executing the service processing by the server 104 may be returned to the terminal 102, and the terminal 102 executes further service processing.

In the process of performing service processing between the terminal 102 and the server 104, different service processing may be performed at different service nodes, and various variables may be used to perform various processing. In a conventional service processing process, at the service processing node, a service processing operation that needs to be performed by the service processing node is generally performed, and variables that need to be used in the service processing process generally need to be calculated in real time, so that variable acquisition efficiency in the existing service processing process is low. Based on this, through adding the time point node, the technical scheme provided by the embodiment of the application can calculate the corresponding variable at the same time under the condition that the condition of the time point node is met, and whether the variable needs to be used in real time is not concerned, so that the variable which is calculated in time is needed at the service processing node using the variable, the efficiency of obtaining the variable can be improved, the return efficiency of the variable is high, and the service processing efficiency of the service processing node can be mentioned accordingly.

The terminal 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, internet of things devices, and portable wearable devices, where the internet of things devices may be smart speakers, smart televisions, smart air conditioners, smart vehicle devices, and the like. The portable wearable device may be a smart watch, smart bracelet, headset, or the like. The server 104 may be implemented as a stand-alone server or as a server cluster of multiple servers.

In one embodiment, as shown in fig. 2, a data processing method is provided, and the method is applied to the server 104 in fig. 1 for illustration, and includes the following steps S101 and S102.

Step S101: and under the condition that the message is acquired, executing service processing corresponding to the message, and determining whether a time trigger condition of a time point is met or not based on the message.

The message refers to a message received by the server, and the message may be information received by the server from an external device, for example, information received from the terminal 102, for example, a login request sent by the terminal 102 or other information. The message may also be information obtained by the server performing service processing by itself or satisfying a certain condition, such as information processed by the previous service processing node, for example, information for verifying the login request of the terminal 102 to determine that the login is successful.

The service processing corresponding to the message refers to an operation that the server 104 needs to execute at the service node when the message is received. For example, in the case where the message is a login request, it is necessary to verify whether the login request can pass or not based on the login request, and in the case where the login passes, it is necessary to perform a related process, for example, in the case where the login passes, it is necessary to provide information, such as a page on which the login is successful, or other recommended page, etc., to the login user.

The time point is a preset node for performing processing related to variable calculation, the time point is a node independent of a business processing flow, and the time point is set, so that the variable can be calculated in time under the condition that any data used for calculating the variable is updated or other conditions are updated, and when the variable is needed to be used by a subsequent processing node, the variable can be directly taken without real-time calculation, so that the return efficiency of the variable is improved.

The time trigger condition of a time refers to a condition that can trigger the correlation process of the time, and the time trigger conditions of different time points may be different. One trigger condition may be set only for one time point, or two or more trigger conditions may be set, and in the case where two or more trigger conditions exist, the trigger condition of the time point may be determined to be satisfied only by satisfying one of the trigger conditions, or in the case where all the trigger conditions are satisfied at the same time, the trigger condition of the time point may be determined to be satisfied, or in the case where a certain number of trigger conditions are satisfied, the trigger condition of the time point may be determined to be satisfied.

Step S102: and under the condition that the time trigger condition is met, calculating a variable corresponding to the time, and storing the variable obtained by calculation for later use by a processing node using the variable.

Under the condition that the trigger condition of the time point is met, the variable corresponding to the time point is calculated in time, the calculated variable is stored for later use by a processing node using the variable, namely the processing node using the variable is not required to calculate the variable in real time, the stored calculated variable is directly obtained, and the variable is used, so that the efficiency of the processing node obtaining the variable can be improved, and the efficiency of the processing node for service processing is improved.

According to the data processing method provided by the embodiment of the invention, under the condition that the message is acquired, the service processing corresponding to the acquired message is executed, meanwhile, whether the time trigger condition of the time is met is determined based on the message, under the condition that the time trigger condition is met, the variable corresponding to the time is calculated and stored, namely under the condition that the message is acquired, the service processing which needs to be executed at present is executed, and meanwhile, the variable which needs to be used in the current service processing is calculated and stored, so that other processing nodes which need to use the variable can directly acquire the energy to process when using the variable, and real-time calculation is not needed, the method can help to improve the taking efficiency when using the variable and also help to process efficiency when the processing node processes the service.

According to some embodiments of the present application, referring to fig. 3, optionally, the method further includes:

step S103: when a time trigger condition is met, if a service call identifier corresponding to the time exists, calling a service interface corresponding to the service call identifier, and pulling external data from an external data source corresponding to the service call identifier;

step S104: and storing the pulled external data for a processing node using the data.

The server call identifier refers to an identifier of an external service interface to be called, and external data can be pulled from an external data source corresponding to the service call identifier through the service interface corresponding to the service call identifier.

In the service processing process, the data of the external data source may need to be used, so that the data is pulled from the external data source at the same time under the condition that the time trigger condition of the time is met, the data of the external data source can be prepared in advance, and further improvement of the processing efficiency is facilitated.

Accordingly, according to some embodiments of the present application, when the time trigger condition is satisfied, calculating the variable corresponding to the time includes:

In the actual business processing flow, some variables are needed to be obtained by combining data calculation of an external data source, so that when a service call identifier exists and external data is pulled from the external data source, the calculation of the variable set at the time point is realized based on the pulled external data, and when the external data is pulled, the corresponding variable can be calculated based on the pulled external data in time, so that the follow-up processing node can conveniently take the variables.

According to some embodiments of the present application, before the external data to be pulled is stored, the method further includes:

The data format of the external data source is inconsistent with the data format of the processing platform of the server, so that after the external data is obtained by pulling, the external data is subjected to standardized processing, the data structure of the standardized data is clearer and simpler, and the data is processed based on the data of the same standard in the subsequent processing process of the data, thereby being beneficial to improving the processing efficiency.

According to some embodiments of the present application, optionally, before executing service processing corresponding to the message and determining whether a time trigger condition of a time is met based on the message, the method further includes the steps of:

acquiring data carried by the message;

Therefore, after the message is received and before the business processing corresponding to the message is executed, the data carried by the message is standardized based on a preset data standardized format, so that the data structure of the finally obtained data is clearer and simpler, the data is processed based on the same standard in the subsequent processing process of the data, and the processing efficiency is improved.

Based on a preset data standardization format, the internal data or the external data pulled from an external data source can be processed into the data format with the same standard, so that subsequent data calculation is based on the same standardized data source for processing calculation, repeated work of preprocessing of subsequent data is reduced, and processing efficiency is improved.

According to some embodiments of the present application, before the obtaining the data carried by the packet, the method further includes:

Checking the message;

The verification of the message may be to verify the source validity and integrity of the message. For example, in the case where the message is a message received from an external device, it may be to verify the validity of the source of the message, such as whether the digital signature of the message passes or not, or the like. In the case of digital signature verification, it is verified whether the data of the message is complete. For another example, the validity of the source of the message may be further verified if the data of the message is verified to be complete. It should be understood that the verification of the message may be verification of other contents, and the specific verification manner is not specifically limited in the embodiments of the present application.

According to some embodiments of the present application, the method of embodiments of the present application may further include:

displaying a time point configuration interface;

Therefore, through the time point configuration interface, each time point, the time point triggering condition of each time point and the corresponding variable can be self-defined and set through the time point configuration interface, thereby realizing the self-defined setting of each time point,

according to some embodiments of the present application, optionally, the time point information further includes a time point identifier, and when the configured time point information of the time point is stored, the time point identifier, the time point trigger condition and the corresponding variable may be stored correspondingly.

Therefore, after the time mark, the time trigger condition and the corresponding variable are correspondingly stored, the time trigger condition and the variable of the time to be calculated when the time trigger condition is met can be directly determined based on the stored corresponding relation.

Optionally, according to some embodiments of the present application, in response to an operation of the configuration interface at a time point, receiving a time point trigger condition of the configured time and a corresponding variable includes:

and displaying a variable configuration interface, and responding to the operation on the variable configuration interface to obtain the configured variable corresponding to the time point, wherein the variable corresponding to the time point is determined according to the available data type under the configured time point triggering condition.

Therefore, the time point configuration interface can also comprise a trigger condition configuration interface and a variable configuration interface, the time point name and the time point trigger condition are configured in the trigger condition configuration interface, the variable to be calculated is configured in the variable configuration interface, and the variable to be calculated is determined based on the available data types under the configured viewpoint trigger condition, so that the configuration of the time point can be conveniently realized.

When the variable corresponding to the time point is determined, the variable is determined according to the available data types under the configured time point triggering condition, so that when the configured variable is to be calculated, the data required by calculating the variable can be used under the time point triggering condition, and the calculation of the variable can be accurately performed. When a variable is among the available data types, the variable can be determined as the variable corresponding to the time point. For example, assuming that the currently available data type is a, b, c, d, e, where variable A1 needs to be calculated in combination with data of data types a, b, c, and variable A2 needs to be calculated in combination with data of data types a, c, f, variable A1 may be determined as the variable associated with that point in time.

Where variables are configured based on the data types available under the configured time-point trigger condition, it may be that the data types available under the time-point trigger condition are automatically determined, and the variables associated with those data types are then determined.

In other embodiments, after the data types available under the trigger condition of the time point are provided to the user for viewing, the user views and sets the variable corresponding to the time point. In this case, after the obtaining the configured time point name and the time trigger condition, before displaying the variable configuration interface, the method further includes:

According to some embodiments of the present application, optionally, the time trigger condition of the time point includes a plurality of time trigger conditions that are simultaneously or singly satisfied, and the variable corresponding to the time point includes more than two variables.

Therefore, for one time point, the calculation of more than two variables can be triggered, so that the efficiency of variable preparation can be improved, and the processing efficiency of the subsequent processing nodes can be further improved.

Based on the embodiments described above, the following is exemplified in connection with a specific application procedure. In various service processing platforms, a plurality of different service processing nodes, such as service node 1, service node 2 and … … service node N shown in fig. 4, may be involved, and after the service processing of each service node is completed, final processing, such as risk decision shown in fig. 4, may be performed. In the embodiment of the present application, a plurality of time points are further configured, and under the condition that the time point trigger condition of the time point is satisfied, variables are calculated at the time points and stored in a database for use in a subsequent processing procedure.

For example, in the example shown in fig. 4, at the flow entry node, based on the data of the entry flow, the time trigger condition of the time point 1 is satisfied, so as to trigger the calculation of the variable corresponding to the time point 1, at the service node 2, the time trigger condition of the time point 2 is triggered, so as to trigger the calculation of the variable corresponding to the time point 2, if the calculation of the variable related to the query is triggered, the variables obtained by calculation at the time point 1 and the time point 2 are both stored in the database, and when the risk decision is performed, the variables can be directly obtained from the database by querying to perform the risk decision without real-time calculation. The variables needed to be used in the risk decision process are directly taken from the database without real-time calculation, so that the variable return efficiency is improved, and the processing efficiency of business processing processes such as risk decision making and the like is improved.

Taking a risk data platform as an example, the risk data platform may involve a plurality of different modules, such as an interface service module, an original data acquisition module, a data conversion module, a data cache module, a data exchange module, a data storage module, a data system, and a computing engine. The interface service module can comprise a query variable interface, an update data interface and a trigger service interface, wherein the query variable interface can query the variables required to be used, the update data interface is used for obtaining update data, and the trigger service interface is used for triggering external data to be pulled from an external data source. The data system may be a system containing various information or management systems, such as a listing system, credit rating system, knowledge graph, etc. The data storage module is used for storing various data, such as configuration information, risk data, request snapshot and the like. The data exchange module is used for realizing information data exchange between the data caching module and the data storage module, and is used for reading the data stored by the data storage module into the data caching, and simultaneously writing the data cached into the data storage module. The calculation engine module can calculate based on the data in the data cache and the data obtained by converting the original data or the data obtained by the interface service by the data conversion module. The computing engine module may include various possible engines, such as a synchronous computing engine, a near real-time computing engine, a time series computing engine, a graph computing engine, a model computing engine, a pedestrian computing engine, an exploration engine, and other various engines, among others.

In the embodiment provided by the application, the obtained original data are subjected to data conversion by the data conversion module and then are calculated or stored by the calculation engine. Taking the risk data platform as an example, the original data may include customer information, loans, orders, behaviors, and the like, and it should be understood that the original data of the risk data platform may also include other information, and the original data of other platforms may also include other data.

The data conversion module is used for carrying out data conversion on the acquired original data and the data acquired through the interface service based on a preset data standardization format to generate a data source, wherein the data of the data source is data after data standardization, and compared with the original data, the data source is clearer and simpler. The obtained standardized data are stored in a data cache. Subsequent computing engines perform processing computations based on the same standardized data source. When the data conversion module performs data conversion, after the verification is passed, the data to be standardized can be determined, and then the data to be standardized can be standardized.

As described above, according to the scheme of the embodiment of the present application, by configuring each time point, when the viewpoint trigger condition of each time point is satisfied, the variable corresponding to the time point is calculated. Referring to FIG. 6, a schematic diagram of a configuration interface for setting an initialization time point in one embodiment is shown. As shown in fig. 6, at the time of configuration, the interface related to the time of configuration may contain a plurality of tabs, such as tabs of "basic information", "time-related variable", "data source", "ready data".

When clicking the basic information tab, a trigger condition configuration interface may be displayed, where the user may configure the code, name, description of the time point, and related information of the trigger condition. As shown in fig. 6, the time point of the time point set by the user is encoded as pit_lcg_int, the time point name is an initialization time point, and the time point trigger conditions of the time point include two: the event type eventID is login logic, and the behavior result resultCode of the event is successful. I.e. the time trigger condition that satisfies this time is determined when the login is successful. Meanwhile, the user can set the time description information of the time so that the related information of the time can be known based on the description information in the follow-up application. It should be understood that in other embodiments, other time points may be set, or the same trigger condition configuration interface may be configured with trigger conditions of time points of multiple time points, and the trigger condition configuration interface may also adopt other design manners, which is not specifically limited in the embodiments of the present application.

When clicking the time-point-associated variable tab, the user can switch to display a variable configuration interface in which the user can set the variables to be calculated at each time point. Wherein, when determining the variable that needs to be calculated at that point in time, it can be determined according to the type of data available under the configured point in time trigger condition. For example, by clicking on the "data source" tab, displaying the data source interface and displaying the data types available under the configured time trigger condition on the data source interface, so that the user can determine the variable corresponding to the time in combination with the available data types displayed on the data source interface and the data types associated with the variables, and configure the variable to be calculated at the time in the variable configuration interface. It should be understood that in other embodiments, it is also possible to determine the available data types under the configured time trigger condition, and combine the data types associated with the variables to determine the variable that can be calculated, and then display the variable that can be calculated on the data source interface, where the user can select part or all of the variable that can be calculated as the variable corresponding to the time point. The variable to be calculated at the configuration time point can be checked based on whether the variable is allowed to be calculated or not, specifically, the variable can be checked based on the available data types under the trigger condition of the configuration time point, for example, when the data types required by the variable to be calculated exist in all available data types, the check is considered to be passed, and otherwise, the check is considered to be failed. Therefore, by means of verification, when the variable is actually calculated, the variable can be ensured to be computable, so that the accuracy is further improved.

When clicking the "prepare data" tab, a trigger service configuration interface may be displayed, where the service configuration interface may set whether the service interface needs to be invoked at that point in time to pull data from an external data source through the service interface. The service configuration interface can display marks of a plurality of service interfaces, and display a selection control at a corresponding position, when a user selects a certain selection control, the user is determined to determine that the service interface at the corresponding position of the selection control needs to be called, so that a corresponding service calling identifier is added for the time point, and the service calling identifier corresponds to the service interface. Thus, in the event that a condition is met, the service interface may also be invoked to pull external data from an external data source.

After each time point is set, different time points can be synchronously entered in the actual business processing process, so that the processing process of different time points can be carried out at different time points.

Referring to fig. 7, various messages may be received through the message receiving interface during the service processing. The message may be a message received from an external device, for example, a login request sent by a terminal device or other service indication requests, or may be a message generated by the server itself in a service processing process.

After the message is obtained, checking the message, and after the message passes the checking, analyzing the data source of the message, and carrying out data standardization processing on the data contained in the message to obtain a data source 1 and a data source 2.

In one aspect, in the case where it is determined that the current service processing node needs to calculate a variable based on the message to perform processing based on the calculated variable, the request variable list may be determined simultaneously to learn about each variable that needs to be used in the current service processing. In the case where the variable needs to be calculated in real time, the variable is calculated in real time.

On the other hand, based on the received message, it is determined whether the association to the time point is possible, that is, whether the time point trigger condition configured to each time point is satisfied. If the time point can be associated, a time point variable list of the variables which can be associated with the time point is determined. And meanwhile, determining a service list associated with the time point, wherein the service list can comprise a synchronous service list and an asynchronous service list, and the synchronous service list and the asynchronous service list comprise service call identifiers corresponding to the time point. The service call identifier in the synchronous service list is to call the service interface synchronously and in real time to pull the external data from the corresponding external data source, and the service call identifier in the asynchronous service list can call the service interface asynchronously to pull the external data from the corresponding external data source.

And under the condition that the synchronous service list exists, the external data of the corresponding external data source is synchronously called through the calling service 1 and the calling service 2 in the synchronous service list, and the data source analysis is respectively carried out so as to carry out data standardization processing on the external data, and the external data is converted into a data standardization format, so that the data source 3 and the data source 4 are obtained. And the external data of the corresponding external data source is asynchronously called through a service interface corresponding to the calling service 3, and the data source analysis is carried out so as to carry out data standardization processing on the external data, and the external data is converted into a data standardization format, so that the data source 5 and the data source 6 are obtained.

Under the condition that the service processing node needs real-time calculated variables and needs to calculate by combining external data of an external data source and cached variables, the variables obtained by calculation can be returned in time to enter the next service processing step based on the data source 1 and the data source 2 which are obtained by normalizing the received message data, the data source 3 and the data source 4 which are synchronously pulled from the external data source and obtained by normalizing the data, and the cached variables obtained from the stored cached variables based on the request variable list. The cached variable may be a variable obtained by calculation at other time points.

Further, each variable is calculated based on the time point variable list corresponding to the time point. For example, the data source 5, the data source 6, and the cached variables obtained from the stored cached variables are obtained based on asynchronously obtained asynchronously pulled from an external data source and data standardized, the obtained variables are calculated, and the calculated variables are stored in a database and may be added to a message queue to inform that the variables are calculated or updated, so that the subsequent processing nodes may obtain the variables directly from the database.

By setting the time point, the method of the embodiment separates the calculation and the use of the variable, and can return the variable more efficiently when the variable is needed to be used, thereby improving the efficiency. Also, at a point in time, external data of an external data source may be called and variables may be calculated in addition to variable calculation based on current data. By preparing and calculating the variables in advance, the return efficiency is higher when the variables are used. Further, the obtained data is subjected to data standardization preprocessing, so that the variable is more efficient in the calculation process. And when developing variables, developers develop based on standardized data, so that the processing is simpler. Meanwhile, the system execution process is not easy to make mistakes, and the calculation is more accurate.

It should be understood that, although the steps in the flowcharts related to the embodiments described above are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.

Based on the same inventive concept, the embodiment of the application also provides a data processing device for realizing the above related data processing method. The implementation of the solution provided by the device is similar to the implementation described in the above method, so the specific limitation of one or more embodiments of the data processing device provided below may refer to the limitation of the data processing method hereinabove, and will not be repeated herein.

In one embodiment, as shown in fig. 8, there is provided a data processing apparatus including: a message receiving module 801, a service processing module 802, a time trigger module 803 and a variable calculating module 804, wherein:

a message receiving module 801, configured to receive a message;

a service processing module 802, configured to execute service processing corresponding to a packet when the packet receiving module 801 obtains the packet;

a time trigger module 803, configured to determine, based on the message, whether a time trigger condition of a time is satisfied when the message receiving module 801 obtains the message;

the variable calculating module 804 is configured to calculate a variable corresponding to the time point when the time point triggering module 803 determines that the time point triggering condition is met, and store the calculated variable for a processing node using the variable subsequently.

In some embodiments, the variable computing module 804 is further configured to, if the time trigger module 803 determines that the time trigger condition is met, call a service interface corresponding to the service call identifier if there is a service call identifier corresponding to the time, and pull external data from an external data source corresponding to the service call identifier; and storing the pulled external data for a processing node using the data.

In some embodiments, the variable calculating module 804 is further configured to calculate, based on the pulled external data, a variable corresponding to the time point if the time point triggering condition is met.

In some embodiments, the variable computing module 804 is further configured to perform normalization processing on the pulled external data based on a preset data normalization format.

In some embodiments, the message receiving module 801 is further configured to obtain data carried by the message;

In some embodiments, the message receiving module 801 is further configured to verify the message; and under the condition that the message passes the verification, acquiring the data carried by the message.

In some embodiments, the system further comprises a time point configuration module for displaying a time point configuration interface; responding to the operation of the time point configuration interface, and receiving time point triggering conditions of the configured time and corresponding variables; and storing the configured time point information of the time point, wherein the time point information comprises the time point triggering condition and the corresponding variable.

In some embodiments, the time point information further includes a time point identifier, and the time point configuration module is further configured to store the time point identifier, the time point trigger condition, and the corresponding variable correspondingly.

In some embodiments, the time point configuration module is further configured to obtain a configured time point name and a time point trigger condition in response to an operation of the configuration interface under the trigger condition; and displaying a variable configuration interface, and responding to the operation on the variable configuration interface to obtain the configured variable corresponding to the time point, wherein the variable corresponding to the time point is determined according to the available data type under the configured time point processing condition.

In some of these embodiments, the timepoint configuration module is further configured to display a data source interface on which data types available under the timepoint processing conditions of the configuration are displayed.

Each of the modules in the above-described data processing apparatus may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.

In one embodiment, a computer device is provided, which may be a server, and the internal structure of which may be as shown in fig. 9. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer device is used to store data, such as variables obtained by calculation at a point in time. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a data processing method.

In one embodiment, a computer device is provided, which may be a terminal, and an internal structure diagram thereof may be as shown in fig. 10. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless mode can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a data processing method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.

It will be appreciated by those skilled in the art that the structures shown in fig. 9 and 10 are merely block diagrams of portions of structures related to the aspects of the present application and do not constitute a limitation of the computer device to which the aspects of the present application may be applied, and that a particular computer device may include more or less components than those shown, or may combine some of the components, or may have a different arrangement of components.

In an embodiment, a computer device is provided comprising a memory and a processor, the memory having stored therein a computer program, the processor implementing the steps of the method of any of the embodiments described above when the computer program is executed.

In one embodiment, a computer readable storage medium is provided, on which a computer program is stored which, when executed by a processor, implements the steps of the method of any of the embodiments described above.

In an embodiment, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the steps of the method in any of the embodiments described above.

It should be noted that, user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, presented data, etc.) referred to in the present application are information and data authorized by the user or sufficiently authorized by each party.

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, database, or other medium used in the various embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magnetic random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (Phase Change Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like. The databases referred to in the various embodiments provided herein may include at least one of relational databases and non-relational databases. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processors referred to in the embodiments provided herein may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic units, quantum computing-based data processing logic units, etc., without being limited thereto.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The above examples only represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the present application. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application shall be subject to the appended claims.

Claims

1. A method of data processing, the method comprising:

2. The method according to claim 1, wherein the method further comprises:

and storing the pulled external data for a processing node using the data.

3. The method according to claim 2, wherein the calculating the variable corresponding to the time point when the time point trigger condition is satisfied comprises:

4. A method according to any one of claims 1 to 3, wherein before said performing service processing corresponding to said message and determining whether a time trigger condition of a time is met based on said message, further comprising the steps of:

acquiring data carried by the message;

5. A method according to any one of claims 1 to 3, characterized in that the method further comprises:

Displaying a time point configuration interface;

6. The method of claim 5, wherein receiving the time-point trigger condition and corresponding variable for the configured time in response to operation of the time-point configuration interface comprises:

7. A method according to any one of claims 1 to 3, wherein the time point trigger conditions of the time points comprise a plurality of time point trigger conditions which are satisfied simultaneously or singly, and the variables corresponding to the time points comprise more than two variables.

8. A data processing apparatus, the apparatus comprising:

The message receiving module is used for receiving the message;

9. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any of claims 1 to 7 when the computer program is executed.

10. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 7.