CN109343891B - Data processing system, method and device - Google Patents

Data processing system, method and device Download PDF

Info

Publication number
CN109343891B
CN109343891B CN201710648625.2A CN201710648625A CN109343891B CN 109343891 B CN109343891 B CN 109343891B CN 201710648625 A CN201710648625 A CN 201710648625A CN 109343891 B CN109343891 B CN 109343891B
Authority
CN
China
Prior art keywords
service
processing logic
logic information
configuration
identifier
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710648625.2A
Other languages
Chinese (zh)
Other versions
CN109343891A (en
Inventor
张凤婷
董旗宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201710648625.2A priority Critical patent/CN109343891B/en
Publication of CN109343891A publication Critical patent/CN109343891A/en
Application granted granted Critical
Publication of CN109343891B publication Critical patent/CN109343891B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/20Software design
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/36Software reuse

Abstract

The invention discloses a system, a method and a device for data processing, relates to the technical field of data processing, and can solve the problem of low efficiency in changing a service processing process. The configuration end of the system is used for acquiring and outputting the service processing logic information searched based on the service configuration identifier; receiving service processing logic information modified based on the searched service processing logic information; sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to a server; the server is used for receiving a service configuration modification request; searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier; replacing the configured service processing logic information with the modified service processing logic information; and modifying the service configuration based on the modified service processing logic information, the database type and the result processing logic information. The method and the device are mainly suitable for changing the scene of service processing requirements.

Description

Data processing system, method and device
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a system, a method, and an apparatus for data processing.
Background
With the development of society, data analysis is gradually changed from manual data analysis to automatic data analysis by a computer in any field. For example, a review record analysis field, an evaluation disclosure field (i.e., other information disclosed by the evaluation information obtained by analyzing the evaluation information), and the like.
In the prior art, when a computer automatically analyzes and processes raw data, a programmer is required to perform the following operations: (1) firstly, the operation of the design level is carried out, which mainly comprises the following steps: designing an interface, realizing the design interface correspondingly, designing data parameter processing logic, designing a DataObject object corresponding to the obtained data, designing the realization logic of a data operation layer and designing data acquisition logic; (2) and then, based on the designed content, performing coding operation, which mainly comprises the following steps: interface coding, implementation coding corresponding to the interface, data parameter processing logic coding, data object coding corresponding to the obtained data, implementation logic coding of a data operation layer and data acquisition logic coding; (3) then testing each node in (1) and (2); (4) after the test is passed, compiling the code, and distributing the compiled file to a cluster for running the code; (5) closing the cluster service, loading and running the compiled file, and completing the restart of the cluster service; (6) the cluster re-registers for service.
However, when the service processing requirement changes, the programmer still needs to spend a lot of time to perform the above 6 steps of operations, i.e. not only redesign and recoding are needed, but also the service cluster needs to be restarted, which is very inefficient.
Disclosure of Invention
In view of this, the present invention provides a system, a method and a device for data processing, which can solve the problem in the prior art that when a service processing requirement changes, the efficiency of changing a service processing process is low.
In a first aspect, the present invention provides a data processing system, where the system includes a configuration end and a service end; wherein the content of the first and second substances,
the configuration end is used for acquiring and outputting service processing logic information searched based on an input service configuration identifier, and the service configuration identifier is used for uniquely identifying one service configuration; receiving service processing logic information modified based on the searched service processing logic information; sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to the server;
the server is used for receiving the service configuration modification request; searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information; replacing the configured service processing logic information with the modified service processing logic information; modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
In a second aspect, the present invention provides a method for data processing, where the method is applied to a configuration end, and the method includes:
acquiring and outputting service processing logic information searched based on an input service configuration identifier, wherein the service configuration identifier is used for uniquely identifying one service configuration;
receiving service processing logic information modified based on the searched service processing logic information;
and sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to the service end, so that the service end modifies and configures the corresponding service based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
In a third aspect, the present invention provides a data processing method, where the method is applied to a server, and the method includes:
receiving a service configuration modification request sent by a configuration end, wherein the service configuration modification request comprises a service configuration identifier and modified service processing logic information;
searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information;
replacing the configured service processing logic information with the modified service processing logic information;
modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
In a fourth aspect, the present invention provides an apparatus for data processing, where the apparatus is applied to a configuration end, and the apparatus includes:
the system comprises an acquisition output unit, a service configuration identification and a service processing logic information output unit, wherein the acquisition output unit is used for acquiring and outputting service processing logic information searched based on an input service configuration identification, and the service configuration identification is used for uniquely identifying one service configuration;
a receiving unit, configured to receive service processing logic information modified based on the found service processing logic information;
a sending unit, configured to send a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to the server, so that the server modifies and configures the corresponding service based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
In a fifth aspect, the present invention provides an apparatus for data processing, where the apparatus is applied to a server, and the apparatus includes:
a receiving unit, configured to receive a service configuration modification request sent by a configuration end, where the service configuration modification request includes a service configuration identifier and modified service processing logic information;
the searching unit is used for searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier received by the receiving unit, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information;
a replacing unit, configured to replace the modified service processing logic information received by the receiving unit with the configured service processing logic information found by the searching unit;
and the modification configuration unit is used for modifying service configuration based on the modified service processing logic information, the database type and the result processing logic information which are obtained by the replacement unit.
In a sixth aspect, the present invention provides a storage medium storing a plurality of instructions adapted to be loaded and executed by a processor to:
acquiring and outputting service processing logic information searched based on an input service configuration identifier, wherein the service configuration identifier is used for uniquely identifying one service configuration;
receiving service processing logic information modified based on the searched service processing logic information;
and sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to the service end, so that the service end modifies and configures the corresponding service based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
In a seventh aspect, the present invention provides a storage medium storing a plurality of instructions adapted to be loaded and executed by a processor to:
receiving a service configuration modification request sent by a configuration end, wherein the service configuration modification request comprises a service configuration identifier and modified service processing logic information;
searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information;
replacing the configured service processing logic information with the modified service processing logic information;
modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
In an eighth aspect, the present invention provides a terminal comprising a storage medium and a processor;
the storage medium is used for storing instructions executed by the processor and data required by the processor in the process of executing the instructions;
the processor is configured to execute the following instructions:
acquiring and outputting service processing logic information searched based on an input service configuration identifier, wherein the service configuration identifier is used for uniquely identifying one service configuration;
receiving service processing logic information modified based on the searched service processing logic information;
and sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to the service end, so that the service end modifies and configures the corresponding service based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
In a ninth aspect, the present invention provides a server comprising a storage medium and a processor;
the storage medium is used for storing instructions executed by the processor and data required by the processor in the process of executing the instructions;
the processor is configured to execute the following instructions:
receiving a service configuration modification request sent by a configuration end, wherein the service configuration modification request comprises a service configuration identifier and modified service processing logic information;
searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information;
replacing the configured service processing logic information with the modified service processing logic information;
modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
By means of the technical scheme, the system, the method and the device for data processing provided by the invention can be used for acquiring and outputting the service processing logic information searched based on the input service configuration identifier by the configuration end when the service processing requirement is changed, then receiving the service processing logic information modified based on the service processing logic information, and finally sending a service modification request carrying the service configuration identifier and the modified service processing logic information to the service end; after receiving the service modification request, the server may first search the configured service processing logic information, the database type, and the result processing logic information corresponding to the service configuration identifier in the service modification request, then replace the configured service processing logic information with the modified service processing logic information, and finally modify the service configuration based on the modified service processing logic information, the database type, and the result processing logic information, thereby implementing the modification of the service processing requirement. Therefore, when the service processing requirement changes, a programmer only needs to modify the configured service processing logic information through the configuration end, and then the configuration end and the service end automatically modify the service configuration according to the service processing logic information modified by the programmer and other corresponding pre-configured information, so that the change of the whole service processing requirement can be completed, and the programmer does not need to spend a large amount of time on designing, encoding, restarting cluster services and other operations, thereby improving the efficiency of changing the service processing process.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
FIG. 1 is a block diagram of a data processing system according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating a method of data processing provided by an embodiment of the present invention;
FIG. 3 is a flow chart illustrating another method of data processing provided by an embodiment of the present invention;
fig. 4 shows a flowchart of interaction between a configuration end and a service end according to an embodiment of the present invention;
fig. 5 is a flowchart illustrating an interaction between a configuration end and a service end according to another embodiment of the present invention;
fig. 6 shows an interaction flowchart of a configuration end and a service end in an evaluation-based scenario according to an embodiment of the present invention;
fig. 7 shows another interaction flowchart of a configuration end and a service end in an evaluation-based scenario according to an embodiment of the present invention;
FIG. 8 is a block diagram illustrating components of an apparatus for data processing according to an embodiment of the present invention;
FIG. 9 is a block diagram illustrating another data processing apparatus according to an embodiment of the present invention;
FIG. 10 is a block diagram illustrating another data processing apparatus according to an embodiment of the present invention;
fig. 11 is a block diagram illustrating another data processing apparatus according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Interpretation of terms:
service: if a specific operation content in a business, for example, the business a is a commodity evaluation business, a service under the business is to evaluate a commodity sold by a merchant X.
Service identification: for uniquely identifying a service, for example, service identification "a-b-23" is used to uniquely identify the service for evaluating the goods sold by merchant X.
Service configuration: the process of configuring a processing logic for a certain service, or configuring a processing logic for a certain service to form a service processing function.
Service version number: for example, when a service 1 completes one service configuration for the first time, the service version number is 1.0, and when the first service configuration is modified, the service version number becomes 2.0 when the second service configuration is completed.
Service configuration identification: the unique identification system is used for uniquely identifying a service configuration and mainly comprises a service identification and a service version number, for example, a service configuration 1 is uniquely identified by the combination of the service identification 'a-b-23' and the service version number '1.0', and a service configuration 4 is uniquely identified by the combination of the service identification 'a-c-44' and the service version number '3.0'.
Service processing logic information: a piece of logic code for describing how to process raw data on the service, for example, a piece of logic code for describing how to acquire information on good evaluation, information on bad evaluation, and information on improper commodity size from evaluation information on the merchant X.
Result processing logic information: a logic code for performing a format conversion process on the execution result of the service processing logic information, for example, a logic code for converting information on the merchant X about good evaluation, information on bad evaluation, and information on the size of the product being inappropriate into a histogram format.
The embodiment of the invention provides a data processing system, which comprises a configuration end and a service end, wherein the configuration end is used for configuring a configuration file; wherein the content of the first and second substances,
the configuration end is used for acquiring and outputting service processing logic information searched based on an input service configuration identifier, and the service configuration identifier is used for uniquely identifying one service configuration; receiving service processing logic information modified based on the searched service processing logic information; and sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to the server. For a detailed description of the configuration end side, reference is made to the exemplary embodiment shown in fig. 2.
The server is used for receiving the service configuration modification request; searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information; replacing the configured service processing logic information with the modified service processing logic information; modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information. For a detailed description of the service side, reference may be made to the embodiment shown in fig. 3.
It should be added that the configuration end may be a client end, or may be a web page.
The data processing system provided by the embodiment of the invention can obtain and output the service processing logic information searched based on the input service configuration identifier by the configuration end when the service processing requirement is changed, then receive the service processing logic information modified based on the service processing logic information, and finally send the service modification request carrying the service configuration identifier and the modified service processing logic information to the service end; after receiving the service modification request, the server may first search the configured service processing logic information, the database type, and the result processing logic information corresponding to the service configuration identifier in the service modification request, then replace the configured service processing logic information with the modified service processing logic information, and finally modify the service configuration based on the modified service processing logic information, the database type, and the result processing logic information, thereby implementing the modification of the service processing requirement. Therefore, when the service processing requirement changes, a programmer only needs to modify the configured service processing logic information through the configuration end, and then the configuration end and the service end automatically modify the service configuration according to the service processing logic information modified by the programmer and other corresponding pre-configured information, so that the change of the whole service processing requirement can be completed, and the programmer does not need to spend a large amount of time on designing, encoding, restarting cluster services and other operations, thereby improving the efficiency of changing the service processing process.
Optionally, the configuration end is further configured to receive a configured service identifier before obtaining and outputting service processing logic information found based on an input service configuration identifier, where the service identifier is used to uniquely identify one service; the service identification is verified, and when the verification is passed, the service identification is uploaded to the server side for storage, wherein the verified content comprises uniqueness verification and/or format correctness verification; the server is also used for receiving the successfully registered service identifier sent by the configuration end and storing the successfully registered service identifier;
or, the configuration end is further configured to receive the configured service identifier and send a service registration request carrying the service identifier to the server end before acquiring and outputting the service processing logic information found based on the input service configuration identifier; the service end is also used for receiving the service registration request and sending a registration success notification to the configuration end when the service identification in the service registration request is verified.
Optionally, the configuration end is further configured to receive, after the service identifier is successfully registered, the input service identifier, the database type of the service system to be configured, the service processing logic information, and result processing logic information obtained by performing format conversion processing on an execution result of the service processing logic information;
sending a service configuration request carrying the service identifier, the database type, the service processing logic information and the result processing logic information to the server;
the server is also used for receiving the service configuration request; performing service configuration according to the service identifier, the database type, the service processing logic information and the result processing logic information in the service configuration request; and when the service configuration is completed, generating a service version number so that the combination of the service identifier and the service version number becomes the service configuration identifier.
As can be seen from the above description, the data processing system provided in the embodiment of the present invention may be as shown in fig. 1, where the system includes a configuration end and a service end, a programmer may input relevant information (including a service configuration identifier, service processing logic information, a database type, and result processing logic information) of a service to be configured through the configuration end, and then send the information to the service end, and the service end implements service configuration operation through the information, and after the service configuration is completed, persistently stores the information, and when the service configuration is performed, may obtain original data to be processed from a database corresponding to the database type. When the service configuration needs to be modified subsequently, a programmer can modify the configured service processing logic information through the configuration end, and sends the modified service processing logic information and the corresponding service configuration identifier to the service end, and the service end realizes the modification operation of the service configuration through the information and the searched configured information corresponding to the service configuration identifier. After the server side finds the configured information corresponding to a certain service configuration identifier for the first time, the information can be cached, so that when the information needs to be found again in the following process, the information can be quickly found from the cache, and the information does not need to be found from a persistent storage memory with large data volume.
It is to be added that the embodiments of the present invention may be applied to various application scenarios. For example, the method can be applied to a scene in which evaluation information is processed and implicit information revealed by the evaluation information is acquired; for another example, the method can also be applied to analyzing the browsing records of the user and acquiring scenes of the browsing hobbies of the user.
In addition, for other schemes related to the configuration side and the service side, details can be found in the following method embodiments, and are not described herein again.
Further, according to the foregoing system embodiment, another embodiment of the present invention further provides a data processing method, where the method is applied to a configuration side, as shown in fig. 2, and the method mainly includes:
101. and acquiring and outputting the service processing logic information searched based on the input service configuration identifier.
The service configuration identifier is used for uniquely identifying a service configuration, and mainly comprises a service identifier and a service version number, namely, a service configuration is uniquely identified by the combination of the service identifier and the service version number. The service identifier is used for uniquely identifying a service, and mainly comprises: system coding, service coding and service coding. The system code is the ID of other systems using the system (the system formed by the configuration end and the service end of the invention), the service code is the ID of specific service under the system corresponding to the system ID, and the service code is the ID of specific service under the service corresponding to the service ID. For example, the system code may be a code of shopping system a, the service code may be a code of service 1 (e.g., customer rating service) under shopping system a, and the service code may be an ID of service 1 (rating for store X) under service 1.
Further, the service processing logic information is logic code for describing how to process the raw data. The service processing logic information can adopt general logic, and also can not adopt general logic. When the general logic is adopted, when a subsequent programmer modifies the service processing logic information according to specific requirements, the general code in the general logic can be directly changed into a specific code (for example, the name of a merchant is directly changed into the name of a merchant A). In addition, the service processing logic information can also contain a placeholder, so that the parameter replacement operation can be directly carried out according to the placeholder when the subsequent modification is carried out. When the service processing logic information contains placeholders, the service processing logic information can be written by using CONTENT in an SQL (Structured Query Language) format, and can also be written by using codes in other formats.
In practical application, after the service configuration is completed, the configuration information about the service may be stored in the configuration end side in addition to the service end side, so that the specific implementation manner of the configuration end acquiring the service processing logic information searched based on the input service configuration identifier may be divided into the following two types:
(1) the configuration end can directly search the service processing logic information corresponding to the service configuration identification from local.
(2) And after receiving the input service configuration identifier, the configuration end sends the service configuration identifier to the service end, and receives service processing logic information which is searched by the service end based on the service configuration identifier.
102. And receiving the service processing logic information modified based on the searched service processing logic information.
After the configuration end outputs and displays the searched configured service processing logic information, a programmer can edit and modify the service processing logic information based on the configuration end, and then click a button for indicating the completion of modification on the configuration end, so that the configuration end can confirm that the programmer is modified completely. For example, the preconfigured service processing logic information may be a code for describing how to obtain the browsing preference of the user a by analyzing the web browsing record, and after the configuration end outputs and displays the code, the user may edit and modify the code to obtain a browsing preference change rule of the user a (for example, the preference of monday is different from the preference of tuesday) by analyzing the web browsing record.
In step 101, it is mentioned that, when the service processing logic information is configured, a placeholder may be used, so that when the service processing logic information output and displayed to the programmer contains a placeholder, the programmer may directly replace the placeholder with a required parameter according to a specific requirement, thereby implementing a quick modification operation.
103. And sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to the service end, so that the service end modifies and configures the corresponding service based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
After receiving the modified service processing logic information, the configuration end can determine that a programmer needs to modify the original service configuration, so that a service configuration modification request carrying the modified service processing logic identifier and the corresponding service configuration identifier is sent to the service end, so that the service end can search the pre-configured information according to the service configuration identifier and modify the service configuration according to the pre-configured information and the modified service processing logic information.
According to the data processing method provided by the embodiment of the invention, when the service processing requirement changes, the configuration end firstly obtains and outputs the service processing logic information searched based on the input service configuration identifier, then receives the service processing logic information modified based on the service processing logic information, and finally sends the service modification request carrying the service configuration identifier and the modified service processing logic information to the service end; after receiving the service modification request, the server may first search the configured service processing logic information, the database type, and the result processing logic information corresponding to the service configuration identifier in the service modification request, then replace the configured service processing logic information with the modified service processing logic information, and finally modify the service configuration based on the modified service processing logic information, the database type, and the result processing logic information, thereby implementing the modification of the service processing requirement. Therefore, when the service processing requirement changes, a programmer only needs to modify the configured service processing logic information through the configuration end, and then the configuration end and the service end automatically modify the service configuration according to the service processing logic information modified by the programmer and other corresponding pre-configured information, so that the change of the whole service processing requirement can be completed, and the programmer does not need to spend a large amount of time on designing, encoding, restarting cluster services and other operations, thereby improving the efficiency of changing the service processing process.
Optionally, according to the method for modifying the pre-configured service shown in fig. 2, a specific implementation manner of the configuration end for performing service configuration for the first time is described in detail below:
(1) and registering the service configuration identification.
Specifically, before acquiring and outputting the service processing logic information found based on the input service configuration identifier, the configuration end may receive the configured service identifier first; and then the configuration end checks the service identifier, or the service end checks the service identifier and determines that the registration is successful when the check is passed. The verified content mainly comprises uniqueness verification and/or format correctness verification. The uniqueness check is to verify whether the service identifier input by the programmer can uniquely identify a service and is registered, and the format correctness check is to verify whether the service identifier input by the programmer meets a preset format. For example, the preset format can be system coding, service coding and service coding, and can also be system coding, service coding and service coding.
The process of directly verifying the service identifier by the configuration end is as follows: and the configuration end verifies the service identifier and uploads the service identifier to the server for storage when the verification is passed. The process of verifying the service identifier by the service end comprises the following steps: the configuration end sends the service registration request carrying the service identifier to the service end, so that when the service identifier in the service registration request is verified by the service end, a registration success notification sent by the service end is received.
(2) And realizing a service configuration corresponding to the service configuration identification.
Specifically, after the service identifier is successfully registered, the configuration end may receive the input service identifier, the database type of the service system to be configured, the service processing logic information, and the result processing logic information obtained by performing format conversion processing on the execution result of the service processing logic information; and then sending a service configuration request carrying the service identifier, the database type, the service processing logic information and the result processing logic information to the server so that the server performs service configuration, and generating a service version number when the service configuration is completed so that the service identifier and the service version number are combined to form the service configuration identifier.
When the programmer inputs the database types, the programmer can select the large type of the database from the configuration end, then select the specific small type from the selected large type, and also can directly select the final small type from the configuration end. Databases include, but are not limited to, the following broad categories: SQL type database, file system type database, key-value type database; SQL type databases include MYSQL, file system type databases include HDFS (Hadoop distributed file system), and key-value type databases include orecal.
The processing result obtained based on the service processing logic information is the most original data information obtained by the service processing, and different users may need to output results in different formats, so that the result obtained based on the service processing logic information needs to be processed again based on the result processing logic information to obtain a final result. For example, if the processing result obtained based on the service processing logic information is 10 data and the user needs to output the processing result in the form of a histogram, the 10 data may be processed again based on the corresponding result processing logic information to obtain the histogram.
In addition, since the types of databases supported by different service systems may be different, some service systems may support all types of databases, and some service systems may support only some types of databases. In addition, all the raw data generated by one service system can be stored in one of different types of databases, or different raw data can be stored in different types of databases (for example, raw data 1 is stored in MYSQL database, and raw data 2 is stored in the oral database). And when the types of the databases are different, the codes required by the programmer to write the service processing logic information may be different. Therefore, when performing service configuration, a programmer is required to input a required database type so as to call the original data in the corresponding database when performing subsequent data processing.
In addition, since the service processing logic information and the result processing logic information written by the programmer may have errors such as redundant spaces and redundant semicolons, in order to enable the service processing logic information and the result processing logic information written by the programmer to meet a preset encoding specification, before sending a service configuration request carrying the service identifier, the database type, the service processing logic information and the result processing logic information to the service end, the configuration end may format the service processing logic information and the result processing logic information, and when the service processing logic information and the result processing logic information meet the preset encoding specification, send the service processing logic information and the result processing logic information to the service end.
Further, according to the above system and method embodiments, another embodiment of the present invention further provides a data processing method, where the method is applied to a server, as shown in fig. 3, and the method mainly includes:
201. and receiving a service configuration modification request sent by a configuration end.
Wherein, the service configuration modification request includes a service configuration identifier and modified service processing logic information. The description of the two words about the service configuration identifier and the service processing logic information can be seen in the method embodiment of the configuration end side in detail.
In practical application, in order to ensure the security of service configuration, the server may set different modification permissions for different services, so that only a user with the modification permission can modify the corresponding service configuration. In this case, after receiving the service configuration modification request sent by the configuration end, the service end may perform modification authority authentication according to the service configuration identifier and the user identifier (included in the service configuration modification request), and when determining that the user identifier has the modification authority, perform step 202, otherwise send an indication of no modification authority to the configuration end.
202. And searching configured service processing logic information, database types of the service system and result processing logic information corresponding to the service configuration identification.
Wherein the result processing logic information is a code that performs format conversion processing on an execution result of the service processing logic information. After the service side obtains the service configuration identifier, all configured information corresponding to the service configuration identifier may be searched first, and then service configuration modification operation is performed according to the searched information and the modified service processing logic information received from the configuration side.
When the configured service processing logic information, the database type of the service system, and the result processing logic information corresponding to the service configuration identifier are searched, the configured service processing logic information, the database type of the service system, and the result processing logic information may be searched from the cache first, and if the cache does not have the information, the cache may be searched from a memory (e.g., a database) in persistent storage.
203. And replacing the configured service processing logic information with the modified service processing logic information.
After the configured service processing logic information is found, the modified service processing logic information may replace the configured service processing logic information. In order to determine whether the service processing logic information after information replacement can be executed, after the information replacement is performed, parameter verification may be performed on the modified service processing logic information obtained by the replacement to determine whether all the parameters are replaced completely, and whether the parameters are absent (for example, the operation cannot be performed due to forgetting to write a certain parameter by a programmer), and when the verification passes, step 204 is executed, otherwise, logic error prompt information and an error reason are fed back to the configuration end.
204. Modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
Specifically, the server may first search a corresponding database according to the database type, and run the modified service processing logic information based on the database to obtain a first processing result; and then processing the first processing result based on the result processing logic information to obtain a second processing result so as to realize the modification operation of the service configuration.
More specifically, the server may first search for a processing component (hereinafter, referred to as a processing component 1) corresponding to the database type and a processing component (hereinafter, referred to as a processing component 2) corresponding to the result processing logic information, then operate the processing component 1 with the modified service processing logic information as an operation parameter of the processing component 1 (where, when the processing component 1 operates, the processing component 1 searches for the database corresponding to the database type to obtain the original data), and then operate the processing component 2 with the operation result (i.e., the first processing result) of the processing component 1 as the operation parameter of the processing component 2 to obtain the final result (i.e., the second processing result).
According to the data processing method provided by the embodiment of the invention, when the service processing requirement changes, the configuration end firstly obtains and outputs the service processing logic information searched based on the input service configuration identifier, then receives the service processing logic information modified based on the service processing logic information, and finally sends the service modification request carrying the service configuration identifier and the modified service processing logic information to the service end; after receiving the service modification request, the server may first search the configured service processing logic information, the database type, and the result processing logic information corresponding to the service configuration identifier in the service modification request, then replace the configured service processing logic information with the modified service processing logic information, and finally modify the service configuration based on the modified service processing logic information, the database type, and the result processing logic information, thereby implementing the modification of the service processing requirement. Therefore, when the service processing requirement changes, a programmer only needs to modify the configured service processing logic information through the configuration end, and then the configuration end and the service end automatically modify the service configuration according to the service processing logic information modified by the programmer and other corresponding pre-configured information, so that the change of the whole service processing requirement can be completed, and the programmer does not need to spend a large amount of time on designing, encoding, restarting cluster services and other operations, thereby improving the efficiency of changing the service processing process.
Alternatively, the service processing logic information may be modified by a programmer based on the configuration side. Specifically, the configuration end receives a configured service configuration identifier input by a programmer, and then the configuration end directly searches for service processing logic information corresponding to the service configuration identifier from the local, or the configuration end obtains the service processing logic information corresponding to the service configuration identifier from the service end side.
The specific implementation manner of the configuration side for implementing the modification of the service processing logic information by acquiring the service processing logic information corresponding to the service configuration identifier from the service side may be: before receiving a service configuration modification request sent by a configuration end, a service end firstly receives a service configuration identifier sent by the configuration end; then searching service processing logic information corresponding to the service configuration identifier; and finally, sending the searched service processing logic information to the configuration end, so that the configuration end receives the service processing logic information modified based on the sent service processing logic information after outputting the service processing logic information sent by the service end.
The service processing logic information configured for the first time contains a placeholder, so that a programmer can directly replace parameters according to the placeholder when modifying the service processing logic information.
Optionally, according to the method for modifying the pre-configured service shown in fig. 3, a specific implementation manner of the service configuration performed by the service end for the first time is described in detail below:
(1) and registering the service configuration identification.
Specifically, before receiving a service configuration modification request sent by a configuration end, the service end may directly receive and store a successfully registered service identifier sent by the configuration end, or may verify by itself whether the service identifier input by a programmer is successfully registered.
The specific implementation manner for verifying whether the service identifier input by the programmer can be successfully registered by the server may be: the service end firstly receives the service registration request sent by the configuration end, and then sends a registration success notice to the configuration end when the service identification in the service registration request is verified.
Wherein, the checked content comprises uniqueness check and/or format correctness check. The uniqueness check is to verify whether the service identifier input by the programmer can uniquely identify a service and is registered, and the format correctness check is to verify whether the service identifier input by the programmer meets a preset format.
(2) And realizing a service configuration corresponding to the service configuration identification.
Specifically, after the service identifier is successfully registered, the service end firstly receives a service configuration request sent by the configuration end; then, service configuration is carried out according to the service identification, the database type, the service processing logic information and the result processing logic information in the service configuration request; and finally, generating a service version number when the service configuration is completed, so that the combination of the service identifier and the service version number becomes the service configuration identifier.
For the description of the database types, see the method embodiment of the configuration end side.
As can be seen from the foregoing embodiments, when service configuration is performed for the first time, an interaction process between a configuration end and a service end may be as shown in fig. 4 (including steps 301 and 308), and when service configuration is modified, an interaction process between a configuration end and a service end may be as shown in fig. 5 (including steps 309 and 319):
301. the configuration end receives the configured service identification;
302. the configuration end checks the service identifier;
303. when the verification is passed, the service identification is sent to a server;
304. the server receives and stores the service identifier;
305. the configuration end receives the input service identification, the database type of the service system to be configured, service processing logic information and result processing logic information;
306. the configuration end sends a service configuration request carrying the service identification, the database type, the service processing logic information and the result processing logic information to a service end;
307. the server receives the service configuration request and performs service configuration according to the service identifier, the database type, the service processing logic information and the result processing logic information in the service configuration request;
308. and the service end generates a service version number when the service configuration is completed, so that the combination of the service identifier and the service version number becomes the service configuration identifier.
309. The configuration end receives an input and pre-configured service configuration identifier;
310. the configuration end sends the service configuration identifier to a service end;
311. the server receives the service configuration identifier and searches configured service processing logic information corresponding to the service configuration identifier;
312. the server side sends the configured service processing logic information to a configuration side;
313. the configuration end receives and outputs the service processing logic information searched by the service end;
314. the configuration end receives the service processing logic information modified based on the searched service processing logic information;
315. the configuration end sends a service configuration modification request carrying the service configuration identification and the modified service processing logic information to the service end;
316. the server receives the service configuration modification request;
317. the server side searches configured service processing logic information, database types of the service system and result processing logic information corresponding to the service configuration identification;
318. the server side replaces the configured service processing logic information with the modified service processing logic information;
319. the service end modifies the service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
320. And when the service configuration is completed, the service terminal generates a corresponding service version number, so that the combination of the service identifier and the service version number becomes the service configuration identifier.
When the above embodiment is applied to a scenario in which evaluation information is processed to obtain implicit information derived from the evaluation information, when service configuration is performed for the first time, an interaction process between a configuration end and a service end may be as shown in fig. 6 (including step 401 and step 408), and when service configuration is modified, an interaction process between a configuration end and a service end may be as shown in fig. 7 (including step 409 and step 419):
401. the configuration end receives a service identifier 'a-b-12' formed by a system code a of a shopping system, a service code b of customer evaluation service and a service code 12 for evaluating a merchant X;
402. the configuration end checks the service identifier 'a-b-12';
403. when the verification is passed, the service identifier 'a-b-12' is sent to the server;
404. the server receives and stores the service identifier 'a-b-12';
405. the configuration end receives an input service identifier 'a-b-12', a database type MYSQL type of a shopping system to be configured, service processing logic information 1 for describing information of good and bad appraisal obtained from the evaluation information of a merchant X and result processing logic information 1 for carrying out pie chart output processing on the information of good and bad appraisal;
406. the configuration end sends a service configuration request carrying a service identifier 'a-b-12', MYSQL type, service processing logic information 1 and result processing logic information 1 to the service end;
407. the server receives the service configuration request and performs service configuration according to a service identifier 'a-b-12', the MYSQL type, the service processing logic information 1 and the result processing logic information 1 in the service configuration request;
408. and when the service configuration is completed, the service end generates a service version number 1.0, so that the combination of the service identifier ' a-b-12 ' and the service version number 1.0 becomes a service configuration identifier ' a-b-12: 1.0".
409. The configuration end receives an input service configuration identifier 'a-b-12' which is configured for the service for evaluating the merchant X in advance: 1.0 ";
410. the configuration end makes the service configuration identifier' a-b-12: 1.0' is sent to a server;
411. the service end receives the service configuration identification' a-b-12: 1.0', and searching configured service processing logic information 1 corresponding to the service configuration identification, wherein the service processing logic information 1 is used for describing information of good and bad evaluation obtained from evaluation information of a merchant X;
412. the server side sends the configured service processing logic information 1 to a configuration side;
413. the configuration end receives and outputs the service processing logic information 1 searched by the service end;
414. the configuration end receives service processing logic information 2 which is obtained by modifying the service processing logic information 1 used for describing information of obtaining good and poor comments from the evaluation information of the merchant X and is used for describing information of obtaining good and poor comments from the evaluation information of the merchant Y;
415. the configuration end carries the service configuration identifier' a-b-12: 1.0' and service configuration modification request of service processing logic information 2 are sent to the server;
416. the server receives the service configuration modification request;
417. the server side searches the service configuration identifier' a-b-12: 1.0' corresponding to the service processing logic information 1 which is configured and used for describing information of good and bad appraisal obtained from the appraisal information of the merchant X, MYSQL type of the shopping system and result processing logic information 1 which is used for carrying out pie chart output processing on the information of good and bad appraisal;
418. the server side replaces the configured service processing logic information 1 with the service processing logic information 2;
419. the server side modifies the service configuration based on the service processing logic information 2, the MYSQL type and the result processing logic information;
420. when the service configuration is completed, generating a service version number 2.0, so that the combination of the service identification "a-b-12" and the service version number 2.0 becomes a service configuration identification "a-b-12: 2.0".
Further, according to the method shown in fig. 2, another embodiment of the present invention further provides a data processing apparatus, which is applied to a configuration end, as shown in fig. 8, and includes:
an obtaining and outputting unit 51, configured to obtain and output service processing logic information found based on an input service configuration identifier, where the service configuration identifier is used to uniquely identify one service configuration;
a receiving unit 52, configured to receive the service processing logic information modified based on the found service processing logic information;
a sending unit 53, configured to send a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to the server, so that the server modifies and configures the corresponding service based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
Optionally, the receiving unit 52 is further configured to receive a configured service identifier before acquiring and outputting service processing logic information found based on an input service configuration identifier, where the service identifier is used to uniquely identify one service;
as shown in fig. 9, the apparatus further includes:
a checking unit 54, configured to check the service identifier received by the receiving unit 52;
the sending unit 53 is further configured to upload the service identifier to the server for storage when the verification by the verifying unit 54 is passed, where the verified content includes uniqueness verification and/or format correctness verification;
the sending unit 53 is further configured to send a service registration request carrying the service identifier to the server, so that when the service identifier in the service registration request is verified by the server, a registration success notification sent by the server is received.
Optionally, the receiving unit 52 is further configured to receive, after the service identifier is successfully registered, the input service identifier, the database type of the service system to be configured, the service processing logic information, and result processing logic information obtained by performing format conversion processing on an execution result of the service processing logic information;
the sending unit 53 is further configured to send a service configuration request carrying the service identifier, the database type, the service processing logic information, and the result processing logic information to the server, so that the server performs service configuration, and generates a service version number when completing the service configuration, so that the service identifier and the service version number are combined to form the service configuration identifier.
Optionally, as shown in fig. 9, the apparatus further includes:
a processing unit 55, configured to format the service processing logic information and the result processing logic information before sending a service configuration request carrying the service identifier, the database type, the service processing logic information, and the result processing logic information to the server, so that the service processing logic information and the result processing logic information meet a preset coding specification.
Optionally, as shown in fig. 9, the obtaining and outputting unit 51 includes:
a first receiving module 511, configured to receive an input, preconfigured service configuration identifier;
a searching module 512, configured to locally search for service processing logic information corresponding to the service configuration identifier received by the first receiving module 511;
a first output display module 513, configured to output and display the service processing logic information found by the finding module 512;
a sending module 514, configured to send the service configuration identifier received by the first receiving module 511 to the server;
a second receiving module 515, configured to receive the service processing logic information that is found by the service end based on the service configuration identifier;
a second output display module 516, configured to output the service processing logic information received by the second receiving module 515.
Optionally, the receiving unit 52 is configured to, when the found service processing logic information includes a placeholder, obtain modified service processing logic information after the placeholder in the found service processing logic information is replaced with a parameter.
The data processing device provided by the embodiment of the invention can be used for acquiring and outputting the service processing logic information searched based on the input service configuration identifier by the configuration end when the service processing requirement is changed, receiving the service processing logic information modified based on the service processing logic information, and finally sending the service modification request carrying the service configuration identifier and the modified service processing logic information to the service end; after receiving the service modification request, the server may first search the configured service processing logic information, the database type, and the result processing logic information corresponding to the service configuration identifier in the service modification request, then replace the configured service processing logic information with the modified service processing logic information, and finally modify the service configuration based on the modified service processing logic information, the database type, and the result processing logic information, thereby implementing the modification of the service processing requirement. Therefore, when the service processing requirement changes, a programmer only needs to modify the configured service processing logic information through the configuration end, and then the configuration end and the service end automatically modify the service configuration according to the service processing logic information modified by the programmer and other corresponding pre-configured information, so that the change of the whole service processing requirement can be completed, and the programmer does not need to spend a large amount of time on designing, encoding, restarting cluster services and other operations, thereby improving the efficiency of changing the service processing process.
Further, according to the method shown in fig. 3, another embodiment of the present invention further provides a data processing apparatus, which is applied to a server, as shown in fig. 10, and includes:
a receiving unit 61, configured to receive a service configuration modification request sent by a configuration end, where the service configuration modification request includes a service configuration identifier and modified service processing logic information;
a searching unit 62, configured to search configured service processing logic information, a database type of the service system, and result processing logic information corresponding to the service configuration identifier received by the receiving unit 61, where the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information;
a replacing unit 63, configured to replace the modified service processing logic information received by the receiving unit 61 with the configured service processing logic information found by the searching unit 62;
a modification configuration unit 64, configured to modify the service configuration based on the modified service processing logic information, the database type and the result processing logic information obtained by the replacing unit 63.
Optionally, as shown in fig. 11, the modification configuration unit 64 includes:
the searching module 641 is configured to search a corresponding database according to the database type;
an operation module 642, configured to operate the modified service processing logic information based on the database found by the finding module 641, and obtain a first processing result;
a processing module 643, configured to process the first processing result obtained by the running module based on the result processing logic information to obtain a second processing result, so as to implement a modification operation of the service configuration.
Optionally, the receiving unit 61 is further configured to receive a successfully registered service identifier sent by the configuration end before receiving a service configuration modification request sent by the configuration end;
as shown in fig. 11, the apparatus further includes:
a saving unit 65, configured to save the service identifier received by the receiving unit 61;
the receiving unit 61 is further configured to receive a service registration request sent by the configuration end;
a first sending unit 66, configured to send a registration success notification to the configuration end when the service identifier in the service registration request passes verification, where the verified content includes uniqueness verification and/or format correctness verification.
Optionally, the receiving unit 61 is further configured to receive a service configuration request sent by the configuration end after the service identifier is successfully registered;
as shown in fig. 11, the apparatus further includes:
a service configuration unit 67, configured to perform service configuration according to the service identifier, the database type, the service processing logic information, and the result processing logic information in the service configuration request received by the receiving unit 61;
a generating unit 68, configured to generate a service version number when the service configuration unit 67 completes service configuration, so that a combination of the service identifier and the service version number becomes the service configuration identifier.
Optionally, the receiving unit 61 is further configured to receive a service configuration identifier sent by a configuration end before receiving a service configuration modification request sent by the configuration end;
the searching unit 62 is further configured to search for service processing logic information corresponding to the service configuration identifier received by the receiving unit;
as shown in fig. 11, the apparatus further includes:
a second sending unit 69, configured to send the service processing logic information found by the finding unit 62 to the configuration end, so that after the configuration end outputs the service processing logic information sent by the service end, the configuration end receives the service processing logic information modified based on the sent service processing logic information.
Optionally, the service processing logic information configured for the first time includes a placeholder, so that when the service processing logic information is modified, parameter replacement is directly performed according to the placeholder.
The data processing device provided by the embodiment of the invention can be used for acquiring and outputting the service processing logic information searched based on the input service configuration identifier by the configuration end when the service processing requirement is changed, receiving the service processing logic information modified based on the service processing logic information, and finally sending the service modification request carrying the service configuration identifier and the modified service processing logic information to the service end; after receiving the service modification request, the server may first search the configured service processing logic information, the database type, and the result processing logic information corresponding to the service configuration identifier in the service modification request, then replace the configured service processing logic information with the modified service processing logic information, and finally modify the service configuration based on the modified service processing logic information, the database type, and the result processing logic information, thereby implementing the modification of the service processing requirement. Therefore, when the service processing requirement changes, a programmer only needs to modify the configured service processing logic information through the configuration end, and then the configuration end and the service end automatically modify the service configuration according to the service processing logic information modified by the programmer and other corresponding pre-configured information, so that the change of the whole service processing requirement can be completed, and the programmer does not need to spend a large amount of time on designing, encoding, restarting cluster services and other operations, thereby improving the efficiency of changing the service processing process.
Further, according to the above-mentioned configuration end-side method embodiment, another embodiment of the present invention further provides a storage medium storing a plurality of instructions, the instructions being adapted to be loaded and executed by a processor:
acquiring and outputting service processing logic information searched based on an input service configuration identifier, wherein the service configuration identifier is used for uniquely identifying one service configuration;
receiving service processing logic information modified based on the searched service processing logic information;
and sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to the service end, so that the service end modifies and configures the corresponding service based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
It should be noted that the instructions stored in the storage medium further include other contents in the above configuration end-side embodiment, and are not described herein again.
Further, according to the above-mentioned embodiment of the method at the server side, another embodiment of the present invention further provides a storage medium, where the storage medium stores a plurality of instructions, and the instructions are adapted to be loaded and executed by a processor:
receiving a service configuration modification request sent by a configuration end, wherein the service configuration modification request comprises a service configuration identifier and modified service processing logic information;
searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information;
replacing the configured service processing logic information with the modified service processing logic information;
modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
It should be noted that the instructions stored in the storage medium further include other contents in the above-mentioned server-side embodiment, and are not described herein again.
Further, according to the above embodiment of the method for configuring an end side, another embodiment of the present invention further provides a terminal, where the terminal includes a storage medium and a processor;
the storage medium is used for storing instructions executed by the processor and data required by the processor in the process of executing the instructions;
the processor is configured to execute the following instructions:
acquiring and outputting service processing logic information searched based on an input service configuration identifier, wherein the service configuration identifier is used for uniquely identifying one service configuration;
receiving service processing logic information modified based on the searched service processing logic information;
and sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to the service end, so that the service end modifies and configures the corresponding service based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
It should be noted that the instructions stored in the storage medium and the instructions executed by the processor also include other contents in the above-described configuration end-side embodiment, which are not described herein again.
Further, according to the above embodiment of the server-side method, another embodiment of the present invention further provides a server, where the server includes a storage medium and a processor;
the storage medium is used for storing instructions executed by the processor and data required by the processor in the process of executing the instructions;
the processor is configured to execute the following instructions:
receiving a service configuration modification request sent by a configuration end, wherein the service configuration modification request comprises a service configuration identifier and modified service processing logic information;
searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information;
replacing the configured service processing logic information with the modified service processing logic information;
modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
It should be noted that the instructions stored in the storage medium and the instructions executed by the processor also include other contents in the above-mentioned service-side embodiment, which are not described herein again.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
It will be appreciated that the relevant features of the method and apparatus described above are referred to one another. In addition, "first", "second", and the like in the above embodiments are for distinguishing the embodiments, and do not represent merits of the embodiments.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components of the systems, methods and apparatus for data processing according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Claims (24)

1. A data processing system is characterized by comprising a configuration end and a service end; wherein the content of the first and second substances,
the configuration end is used for acquiring and outputting service processing logic information searched based on an input service configuration identifier when the service processing requirement is changed, wherein the service configuration identifier is used for uniquely identifying one service configuration; the service configuration is a process of configuring processing logic of a service; the service processing logic information is a piece of logic code for describing processing of raw data on a service; receiving service processing logic information modified based on the searched service processing logic information; sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to the server;
the server is used for receiving the service configuration modification request; searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information; replacing the configured service processing logic information with the modified service processing logic information; modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
2. The system according to claim 1, wherein the configuration side is further configured to receive a configured service identifier before acquiring and outputting service processing logic information found based on the input service configuration identifier, where the service identifier is used to uniquely identify one service; the service identification is verified, and when the verification is passed, the service identification is uploaded to the server side for storage, wherein the verified content comprises uniqueness verification and/or format correctness verification; and the server is also used for receiving the successfully registered service identifier sent by the configuration end and storing the successfully registered service identifier.
3. The system according to claim 1, wherein the configuration end is further configured to receive the configured service identifier and send a service registration request carrying the service identifier to the service end before obtaining and outputting the service processing logic information found based on the input service configuration identifier; the service end is also used for receiving the service registration request and sending a registration success notification to the configuration end when the service identification in the service registration request is verified.
4. The system according to claim 2 or 3, wherein the configuration end is further configured to receive, after the service identifier is successfully registered, the input service identifier, the database type of the service system to be configured, the service processing logic information, and the result processing logic information obtained by performing format conversion processing on the execution result of the service processing logic information; sending a service configuration request carrying the service identifier, the database type, the service processing logic information and the result processing logic information to the server;
the server is also used for receiving the service configuration request; performing service configuration according to the service identifier, the database type, the service processing logic information and the result processing logic information in the service configuration request; and when the service configuration is completed, generating a service version number so that the combination of the service identifier and the service version number becomes the service configuration identifier.
5. A method for data processing, the method is applied to a configuration end, and is characterized in that the method comprises the following steps:
when the service processing needs to be changed, acquiring and outputting service processing logic information searched based on an input service configuration identifier, wherein the service configuration identifier is used for uniquely identifying one service configuration; the service configuration is a process of configuring processing logic of a service; the service processing logic information is a piece of logic code for describing processing of raw data on a service;
receiving service processing logic information modified based on the searched service processing logic information;
and sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to a service end, so that the service end modifies and configures the corresponding service based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
6. The method of claim 5, wherein before obtaining and outputting the service processing logic information found based on the input service configuration identifier, the method further comprises:
receiving configured service identification, wherein the service identification is used for uniquely identifying a service;
and checking the service identifier, and uploading the service identifier to the server for storage when the service identifier passes the checking, wherein the checked content comprises uniqueness checking and/or format correctness checking.
7. The method of claim 5, wherein before obtaining and outputting the service processing logic information found based on the input service configuration identifier, the method further comprises:
receiving the configured service identification;
and sending the service registration request carrying the service identifier to the server, so that when the service identifier in the service registration request is verified by the server, a registration success notification sent by the server is received.
8. The method according to claim 6 or 7, wherein after the service identity registration is successful, the method further comprises:
receiving an input service identifier, a database type of a service system to be configured, service processing logic information and result processing logic information for performing format conversion processing on an execution result of the service processing logic information;
and sending a service configuration request carrying the service identifier, the database type, the service processing logic information and the result processing logic information to the server so that the server performs service configuration, and generating a service version number when the service configuration is completed so that the service identifier and the service version number are combined to form the service configuration identifier.
9. The method of claim 8, wherein before sending a service configuration request carrying the service identifier, the database type, the service processing logic information, and the result processing logic information to the server, the method further comprises:
and formatting the service processing logic information and the result processing logic information so that the service processing logic information and the result processing logic information meet a preset coding specification.
10. The method of claim 5, wherein the obtaining and outputting the service processing logic information found based on the input service configuration identifier comprises:
receiving an input and pre-configured service configuration identifier;
searching service processing logic information corresponding to the service configuration identifier from the local, and outputting and displaying the service processing logic information; or, the service configuration identifier is sent to the server, and the service processing logic information searched by the server based on the service configuration identifier is received and output.
11. The method according to any of claims 5-7 and 9-10, wherein the receiving the service processing logic information modified based on the found service processing logic information comprises:
and if the searched service processing logic information contains the placeholder, acquiring the modified service processing logic information after the placeholder in the searched service processing logic information is subjected to parameter replacement.
12. A data processing method is applied to a server side, and is characterized in that the method comprises the following steps:
receiving a service configuration modification request sent by a configuration end, wherein the service configuration modification request comprises a service configuration identifier and modified service processing logic information;
searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information;
replacing the configured service processing logic information with the modified service processing logic information;
modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
13. The method of claim 12, wherein modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information comprises:
searching a corresponding database according to the database type, and running the modified service processing logic information based on the database to obtain a first processing result;
and processing the first processing result based on the result processing logic information to obtain a second processing result so as to realize the modification operation of the service configuration.
14. The method according to claim 12, wherein before receiving the service configuration modification request sent by the configuration end, the method further comprises:
and receiving and storing the successfully registered service identifier sent by the configuration end.
15. The method according to claim 12, wherein before receiving the service configuration modification request sent by the configuration end, the method further comprises:
and receiving a service registration request sent by the configuration end, and sending a registration success notification to the configuration end when the service identification in the service registration request passes the verification, wherein the verified content comprises uniqueness verification and/or format correctness verification.
16. The method according to claim 14 or 15, wherein after the service identity registration is successful, the method further comprises:
receiving a service configuration request sent by the configuration end;
performing service configuration according to the service identifier, the database type, the service processing logic information and the result processing logic information in the service configuration request;
and when the service configuration is completed, generating a service version number so that the combination of the service identifier and the service version number becomes the service configuration identifier.
17. The method of claim 16, wherein before receiving the service configuration modification request sent by the configuration end, the method further comprises:
receiving a service configuration identifier sent by the configuration end;
searching service processing logic information corresponding to the service configuration identifier;
and sending the searched service processing logic information to the configuration end, so that the configuration end receives the service processing logic information modified based on the sent service processing logic information after outputting the service processing logic information sent by the service end.
18. The method according to any of claims 12-15 and 17, wherein the service processing logic information configured for the first time includes a placeholder, so that when the service processing logic information is modified, parameter replacement is directly performed according to the placeholder.
19. An apparatus for data processing, the apparatus being applied to a configuration end, the apparatus comprising:
the system comprises an acquisition output unit, a service configuration identification and a service configuration identification, wherein the acquisition output unit is used for acquiring and outputting service processing logic information searched based on an input service configuration identification when service processing needs to be changed, and the service configuration identification is used for uniquely identifying one service configuration; the service configuration is a process of configuring processing logic of a service; the service processing logic information is a piece of logic code for describing processing of raw data on a service;
a receiving unit, configured to receive service processing logic information modified based on the found service processing logic information;
a sending unit, configured to send a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to a server, so that the server modifies the corresponding service configuration based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
20. An apparatus for data processing, the apparatus being applied to a server, the apparatus comprising:
a receiving unit, configured to receive a service configuration modification request sent by a configuration end, where the service configuration modification request includes a service configuration identifier and modified service processing logic information;
the searching unit is used for searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier received by the receiving unit, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information;
a replacing unit, configured to replace the modified service processing logic information received by the receiving unit with the configured service processing logic information found by the searching unit;
and the modification configuration unit is used for modifying service configuration based on the modified service processing logic information, the database type and the result processing logic information which are obtained by the replacement unit.
21. A storage medium storing a plurality of instructions adapted to be loaded and executed by a processor to:
when the service processing needs to be changed, acquiring and outputting service processing logic information searched based on an input service configuration identifier, wherein the service configuration identifier is used for uniquely identifying one service configuration; the service configuration is a process of configuring processing logic of a service; the service processing logic information is a piece of logic code for describing processing of raw data on a service;
receiving service processing logic information modified based on the searched service processing logic information;
and sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to a service end, so that the service end modifies and configures the corresponding service based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
22. A storage medium storing a plurality of instructions adapted to be loaded and executed by a processor to:
receiving a service configuration modification request sent by a configuration end, wherein the service configuration modification request comprises a service configuration identifier and modified service processing logic information;
searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information;
replacing the configured service processing logic information with the modified service processing logic information;
modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
23. A terminal, comprising a storage medium and a processor;
the storage medium is used for storing instructions executed by the processor and data required by the processor in the process of executing the instructions;
the processor is configured to execute the following instructions:
when the service processing needs to be changed, acquiring and outputting service processing logic information searched based on an input service configuration identifier, wherein the service configuration identifier is used for uniquely identifying one service configuration; the service configuration is a process of configuring processing logic of a service; the service processing logic information is a piece of logic code for describing processing of raw data on a service;
receiving service processing logic information modified based on the searched service processing logic information;
and sending a service configuration modification request carrying the service configuration identifier and the modified service processing logic information to a service end, so that the service end modifies and configures the corresponding service based on the service configuration identifier in the service configuration modification request and the modified service processing logic information.
24. A server, comprising a storage medium and a processor;
the storage medium is used for storing instructions executed by the processor and data required by the processor in the process of executing the instructions;
the processor is configured to execute the following instructions:
receiving a service configuration modification request sent by a configuration end, wherein the service configuration modification request comprises a service configuration identifier and modified service processing logic information;
searching configured service processing logic information, a database type of a service system and result processing logic information corresponding to the service configuration identifier, wherein the result processing logic information is a code for performing format conversion processing on an execution result of the service processing logic information;
replacing the configured service processing logic information with the modified service processing logic information;
modifying a service configuration based on the modified service processing logic information, the database type, and the result processing logic information.
CN201710648625.2A 2017-08-01 2017-08-01 Data processing system, method and device Active CN109343891B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710648625.2A CN109343891B (en) 2017-08-01 2017-08-01 Data processing system, method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710648625.2A CN109343891B (en) 2017-08-01 2017-08-01 Data processing system, method and device

Publications (2)

Publication Number Publication Date
CN109343891A CN109343891A (en) 2019-02-15
CN109343891B true CN109343891B (en) 2022-02-18

Family

ID=65291237

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710648625.2A Active CN109343891B (en) 2017-08-01 2017-08-01 Data processing system, method and device

Country Status (1)

Country Link
CN (1) CN109343891B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110060139B (en) * 2019-02-25 2023-11-07 创新先进技术有限公司 Accounting processing method and device
CN111831713A (en) * 2019-04-18 2020-10-27 阿里巴巴集团控股有限公司 Data processing method, device and equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101945013A (en) * 2010-09-20 2011-01-12 中兴通讯股份有限公司 System and method for implementing server configuration management
CN102323940A (en) * 2011-09-01 2012-01-18 中兴通讯股份有限公司 Configuration platform implementation method, configuration platform and system based on database
CN102750098A (en) * 2012-06-19 2012-10-24 深圳中兴网信科技有限公司 System configuration file processing device and system configuration file processing method
CN104022894A (en) * 2014-05-12 2014-09-03 东软熙康健康科技有限公司 Method for managing application configuration parameters in concentrated mode and method for configuring application parameters
CN104065517A (en) * 2014-07-07 2014-09-24 用友软件股份有限公司 Distributed-system software configuration management method and system
CN106572173A (en) * 2016-11-07 2017-04-19 网易无尾熊(杭州)科技有限公司 Method, apparatus and system for updating configuration information
CN106982236A (en) * 2016-01-18 2017-07-25 阿里巴巴集团控股有限公司 A kind of information processing method, device and system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103176790B (en) * 2011-12-26 2016-04-20 阿里巴巴集团控股有限公司 Application dissemination method and system
US9294482B2 (en) * 2013-07-25 2016-03-22 Oracle International Corporation External platform extensions in a multi-tenant environment
CN106202123B (en) * 2015-05-07 2019-07-05 阿里巴巴集团控股有限公司 The method and apparatus of gray scale publication
US9727330B2 (en) * 2015-11-25 2017-08-08 Red Hat, Inc. Source to image transformation pipeline for a platform-as-a-service system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101945013A (en) * 2010-09-20 2011-01-12 中兴通讯股份有限公司 System and method for implementing server configuration management
CN102323940A (en) * 2011-09-01 2012-01-18 中兴通讯股份有限公司 Configuration platform implementation method, configuration platform and system based on database
CN102750098A (en) * 2012-06-19 2012-10-24 深圳中兴网信科技有限公司 System configuration file processing device and system configuration file processing method
CN104022894A (en) * 2014-05-12 2014-09-03 东软熙康健康科技有限公司 Method for managing application configuration parameters in concentrated mode and method for configuring application parameters
CN104065517A (en) * 2014-07-07 2014-09-24 用友软件股份有限公司 Distributed-system software configuration management method and system
CN106982236A (en) * 2016-01-18 2017-07-25 阿里巴巴集团控股有限公司 A kind of information processing method, device and system
CN106572173A (en) * 2016-11-07 2017-04-19 网易无尾熊(杭州)科技有限公司 Method, apparatus and system for updating configuration information

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李景博 ; 刘金刚 ; 邢云冰.一种改进的业务服务选取方法.《计算机工程》.2012,1-4. *

Also Published As

Publication number Publication date
CN109343891A (en) 2019-02-15

Similar Documents

Publication Publication Date Title
US10296563B2 (en) Automated testing of perceptible web page elements
CN111104392B (en) Database migration method and device, electronic equipment and storage medium
CN112488855B (en) Business verification method and device based on rule template
CN110162516B (en) Data management method and system based on mass data processing
CN112148509A (en) Data processing method, device, server and computer readable storage medium
CN106897342B (en) Data verification method and equipment
CN114116496A (en) Automatic testing method, device, equipment and medium
CN110750433A (en) Interface test method and device
CN105760450A (en) Form file analyzing method and device
CN109343891B (en) Data processing system, method and device
CN111859076A (en) Data crawling method and device, computer equipment and computer readable storage medium
CN110750434A (en) Interface testing method and device, electronic equipment and computer readable storage medium
CN109933486B (en) Logistics data monitoring processing method, device and system
CN112732763A (en) Data aggregation method and device, electronic equipment and medium
EP2535852A1 (en) Case-based retrieval framework
CN111476633A (en) Product service recommendation platform, product service path recommendation method and medium
CN113408254A (en) Page form information filling method, device, equipment and readable medium
CN111061733B (en) Data processing method, device, electronic equipment and computer readable storage medium
CN111045660B (en) Method, device and storage medium for checking tax declaration data on network
CN112651716A (en) Data processing method, device and storage medium
CN113127458A (en) Data quality auditing method and device, electronic equipment and storage medium
CN110019357B (en) Database query script generation method and device
CN112632391A (en) Data processing method, device and storage medium
CN112860722A (en) Data checking method and device, electronic equipment and readable storage medium
CN113806205A (en) Software performance testing method and device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant