CN111988218A

CN111988218A - Data processing method, device, equipment and medium

Info

Publication number: CN111988218A
Application number: CN202010810179.2A
Authority: CN
Inventors: 顾斌; 田昆
Original assignee: Alipay Hangzhou Information Technology Co Ltd
Current assignee: Alipay Hangzhou Information Technology Co Ltd
Priority date: 2020-08-13
Filing date: 2020-08-13
Publication date: 2020-11-24

Abstract

An embodiment of the present specification provides a data processing method, an apparatus, a device, and a medium, where the data processing method includes: storing a plurality of common components for constructing a gateway; receiving a gateway construction application, and determining a target component from the plurality of public components according to the gateway construction application; and constructing a gateway corresponding to the gateway construction application based on the target component, wherein the gateway corresponding to the gateway construction application is used for capturing data conforming to the data characteristics contained in the gateway construction application.

Description

Data processing method, device, equipment and medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to a data processing method, apparatus, device, and medium.

Background

In the prior art, various data are required to be acquired and processed in many cases. In particular, due to the need for data processing, it is required to acquire different types of data and process the different types of data. On the basis, how to respectively acquire different types of data is an important subject to avoid data confusion or interference or leakage in the data acquisition process.

In view of the above, there is a need for a more efficient and effective data processing scheme.

Disclosure of Invention

Embodiments of the present specification provide a data processing method, apparatus, device, and medium, so as to solve a technical problem of how to perform isolation processing of different types of data more efficiently and effectively.

In order to solve the above technical problem, the embodiments of the present specification provide the following technical solutions:

an embodiment of the present specification provides a data processing method, including:

storing a plurality of common components for constructing a gateway;

receiving a gateway construction application, and determining a target component from the plurality of public components according to the gateway construction application;

and constructing a gateway corresponding to the gateway construction application based on the target component, wherein the gateway corresponding to the gateway construction application is used for capturing data conforming to the data characteristics contained in the gateway construction application.

An embodiment of the present specification provides a first data acquisition method, including:

sending a gateway construction application to a gateway management end, wherein the gateway construction application is used for the gateway management end to construct a target gateway; the gateway construction application comprises data characteristics, and the target gateway is used for capturing data conforming to the data characteristics;

after receiving a gateway construction completion message sent by the gateway construction end, sending a data acquisition application to the gateway management end, wherein the data acquisition application is used for the gateway management end to determine the target gateway from the constructed gateways and capture target data corresponding to the data acquisition application through the target gateway;

and receiving and storing the target data sent by the target gateway.

An embodiment of the present specification provides a second data acquisition method, including:

determining data characteristics of data to be acquired, and determining whether a target gateway corresponding to the data characteristics exists or not, wherein the target gateway is used for capturing target data, and the target data is data conforming to the data characteristics;

if yes, capturing and storing the target data through the target gateway;

if not, the target gateway is constructed, and the target data is captured and stored through the target gateway.

An embodiment of the present specification provides a data processing apparatus, including:

the component storage module is used for storing a plurality of public components for constructing the gateway;

the component selection module is used for receiving a gateway construction application and determining a target component from the plurality of public components according to the gateway construction application;

and the gateway construction module is used for constructing a gateway corresponding to the gateway construction application based on the target component, and the gateway corresponding to the gateway construction application is used for capturing data conforming to the data characteristics contained in the gateway construction application.

An embodiment of the present specification provides a data acquisition apparatus, including:

the gateway construction application module is used for sending a gateway construction application to a gateway management end, and the gateway construction application is used for the gateway management end to construct a target gateway; the gateway construction application comprises data characteristics, and the target gateway is used for capturing data conforming to the data characteristics;

the data acquisition application module is used for sending a data acquisition application to the gateway management terminal after receiving a gateway construction completion message sent by the gateway construction terminal, wherein the data acquisition application is used for the gateway management terminal to determine the target gateway from the constructed gateway and capture target data corresponding to the data acquisition application through the target gateway;

and the data acquisition module is used for receiving and storing the target data sent by the target gateway.

An embodiment of the present specification provides another data acquisition apparatus, including:

the gateway determining module is used for determining the data characteristics of the data to be acquired and determining whether a target gateway corresponding to the data characteristics exists or not, wherein the target gateway is used for capturing target data, and the target data are data conforming to the data characteristics;

the data acquisition module is used for capturing and storing the target data through the target gateway if the target data is acquired;

at least one processor;

and the number of the first and second groups,

a memory communicatively coupled to the at least one processor;

wherein,

the memory stores instructions executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to perform the data processing method described above.

at least one processor;

and the number of the first and second groups,

a memory communicatively coupled to the at least one processor;

wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the first data acquisition method described above.

at least one processor;

and the number of the first and second groups,

a memory communicatively coupled to the at least one processor;

wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the second data acquisition method described above.

The present specification provides a computer-readable storage medium, which stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, the data processing method is implemented.

Embodiments of the present specification provide a computer-readable storage medium, which stores computer-executable instructions, and when executed by a processor, the computer-executable instructions implement the first data acquisition method described above.

Embodiments of the present specification provide a computer-readable storage medium, which stores computer-executable instructions, and when executed by a processor, the computer-executable instructions implement the second data acquisition method described above.

The embodiment of the specification adopts at least one technical scheme which can achieve the following beneficial effects:

corresponding gateways are respectively constructed for various data, different kinds of data are captured through different gateways, data confusion or data interference or data leakage in the data capturing and transmitting process are avoided, various data can be more effectively and accurately obtained, and data obtaining efficiency and effect are improved. On the basis, the acquired various data are respectively processed, so that the data processing efficiency and effect can be improved.

Drawings

In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments of the present specification or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present specification, and for those skilled in the art, other drawings can be obtained according to the drawings without inventive labor.

Fig. 1 is a schematic diagram of an execution main body of a data processing method in the first embodiment of the present specification.

Fig. 2 is a flowchart illustrating a data processing method in the first embodiment of the present specification.

Fig. 3 is a flow chart illustrating a data processing method in a second embodiment of the present specification.

Fig. 4 is a flowchart illustrating a data processing method in a third embodiment of the present specification.

Fig. 5 is a schematic structural diagram of a data processing apparatus in a fourth embodiment of this specification.

Fig. 6 is a schematic configuration diagram of a data processing apparatus in a fifth embodiment of the present specification.

Fig. 7 is a schematic configuration diagram of a data processing apparatus in a sixth embodiment of the present specification.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any inventive step based on the embodiments of the present disclosure, shall fall within the scope of protection of the present application.

The first embodiment of this specification provides a data processing method, and the execution subject of this embodiment may be a terminal (including but not limited to a mobile phone, a computer, a pad, a television) or a server or a corresponding data processing platform or an operating system, and the like, that is, the execution subject may be various, and may be set, used, or transformed as needed. In addition, a third party application may assist the execution subject in executing the present embodiment. For example, as shown in fig. 1, the data processing method in this embodiment may be executed by a server, and an application program (corresponding to the server) may be installed on a terminal (held by a user), and data transmission may be performed between the terminal or the application program and the server, and data collection or input or output or page or information presentation (to the user) may be performed by the terminal or the application program, so as to assist the server in executing the data processing method in this embodiment.

As shown in fig. 2, the data processing method provided in this embodiment includes:

s101: storing a number of common components for constructing a gateway (execution agent);

in this embodiment, an execution main body (hereinafter, referred to as "execution main body") of this embodiment may store several common components, and these common components may be used to construct a Gateway (Gateway). The common component has two characteristics:

in this embodiment, the public interface has a characteristic of commonality, that is, any public component can be applied to the construction of any gateway, as long as the gateway construction needs to use the public component.

S103: receiving a gateway construction application, and determining a target component from the plurality of public components according to the gateway construction application;

the execution subject may receive a gateway construction application for instructing the execution subject to construct a gateway corresponding to the gateway construction application.

Specifically, the target component may be determined by 1.1 and/or 1.2 (the present embodiment is not limited to the manner of 1.1 and/or 1.2):

1.1, the gateway construction application contains data characteristics

The data features include, but are not limited to, data type features and/or data scenario features, the data features define what kind of data the gateway corresponding to the gateway construction application is to be constructed for capturing, for example, the data type features define what kind of data the gateway corresponding to the gateway construction application is to be constructed for capturing; the data scene features define data of what scene the gateway corresponding to the gateway construction application is to be constructed for capturing.

The correspondence between the data features and the common components may be established in advance, so that the common components corresponding to the data features in the gateway construction application may be used as target components.

1.2, the gateway construction application includes the gateway characteristics of the gateway to be constructed

The gateway construction application may include a gateway feature, where the gateway feature is a feature of "a gateway to be constructed corresponding to the gateway construction application". Common components that conform to and/or correspond to gateway features in the gateway build application can be targeted components. Wherein the correspondence between the gateway features and the common components may be pre-established.

S105: and (an execution main body) building a gateway corresponding to the gateway building application based on the target component, wherein the gateway corresponding to the gateway building application is used for capturing data conforming to the data characteristics contained in the gateway building application.

After the target component is determined, the gateway corresponding to the gateway construction application can be constructed based on the determined target component. After the gateway is constructed, the constructed gateway corresponding to the gateway construction application is used for capturing data conforming to the data characteristics contained in the gateway construction application (i.e. data can be captured).

In this embodiment, each time a gateway construction application is received, it may be determined whether the received gateway construction application has been received before; if so, the gateway corresponding to the received gateway construction application is not required to be constructed; if not, the gateway corresponding to the gateway construction application received this time is constructed according to the process. Specifically, each time a gateway construction application is received, it can be determined whether the data features included in the received gateway construction application appear in the previously received gateway construction application; if so, the gateway corresponding to the received gateway construction application is not required to be constructed; if not, the gateway corresponding to the gateway construction application received this time is constructed according to the process; and/or, each time a gateway construction application is received, determining whether gateway features contained in the received gateway construction application appear in the previously received gateway construction application, if so, not constructing a gateway corresponding to the received gateway construction application; if not, the gateway corresponding to the gateway construction application received this time is constructed according to the process. Therefore, for different gateway construction applications (if the data features and/or gateway features contained in the gateway construction applications received twice are different, the gateway construction applications received twice are different), the corresponding gateways can be constructed respectively.

In particular, if the gateway construction applications transmitted by the same agent twice are different, the corresponding gateway can be constructed for each transmitted gateway construction application.

According to the above, for the received gateway construction application, the constructed gateway corresponds to both the received gateway construction application and the data feature and/or the gateway feature contained in the received gateway construction application.

After receiving the gateway construction application and constructing the corresponding gateway, the gateway construction completion message may be sent to a sender or a sender (the sender or the sender includes but is not limited to a mobile phone, a computer, a server, and the like) of the gateway construction application.

In this embodiment, the execution subject may receive a data acquisition application sent by a data application party (the application party includes, but is not limited to, a mobile phone, a computer, a server, and the like). For any data applicant, which is not referred to as a data applicant a, if the execution main body receives the data acquisition application sent by the data applicant a, the data characteristic of the data to be acquired by the data applicant a (or the data to be acquired by the data applicant a) may be determined according to the data acquisition application (the data characteristic of the data to be acquired by the data applicant a is not referred to as a data characteristic a, and particularly, the data characteristic a may be included in the data acquisition application sent by the data applicant a). The data characteristics of the data to be acquired by the data applicant may also include data type characteristics and/or data scene characteristics, which is not limited in this embodiment.

Generally, the data applicant a is also a sender of the gateway construction application, and the data applicant a generally sends the gateway construction application and receives the construction completion message of the gateway corresponding to the gateway construction application before sending the data acquisition application, and the data characteristic a is generally consistent with the data characteristic in the gateway construction application sent by the data applicant a before, so that the execution main body has already constructed the gateway corresponding to the data characteristic a when the data applicant a sends the data acquisition application.

Of course, if the data applicant a is not the sender of the gateway construction application, after the data applicant a sends the data acquisition application, if the execution main body determines that there is no constructed gateway corresponding to the data feature a, a relevant notification may be sent to the data applicant a to notify the data applicant a that the target gateway is not found. The data application party A can request the correlation direction capable of sending the gateway construction application to execute the main body sending gateway construction application, the gateway construction application comprises the data characteristic a, so that the gateway corresponding to the data characteristic a is executed and notified to the correlation party, then the data application party A can send the data acquisition application again, and the execution main body determines the corresponding constructed gateway. The above-mentioned related parties of the data applicant can be preset.

When the execution subject determines the data feature a, a gateway corresponding to the data feature a, which is not referred to as gateway a1, may be determined as a target gateway from the constructed gateways. After the gateway a1 is determined, the execution subject captures "target data corresponding to the data acquisition application sent by the data applicant a" through the gateway a1, where the target data is the data to be acquired by the data applicant a, and the target data conforms to the data characteristic a. The gateway actually performing data capture is a constructed gateway, which is hereinafter referred to as a gateway for short.

After the execution agent grabs the target data through the gateway a1 (in a database or data stream), the grabbed target data can be sent to the data applicant A through the gateway a1 so that the data applicant A receives and stores the target data. The data application party A is any data application party, namely for any data application party, corresponding target data can be captured through the corresponding target gateway.

For example, the data applicant a wants to obtain the payment data generated by an application, and because the gateway itself is used for network interconnection and message intercommunication, the gateway a1 can fetch the corresponding payment data from the data stream or database of the application.

In this embodiment, for data acquisition applications received by the execution main body twice, if the data acquisition applications received twice are from different data application parties (the data acquisition applications may include data application party identifiers), gateways for capturing target data corresponding to the data acquisition applications received twice are different. For example, if the data acquisition application received by the execution main body at one time is from the data application party B, and the data acquisition application received at another time is from the data application party C, the gateway for capturing the target data corresponding to the data acquisition application sent by the data application party B is different from the gateway for capturing the target data corresponding to the data acquisition application sent by the data application party C.

Because the constructed gateways correspond to the data characteristics, for the same data application party, if the data characteristics corresponding to the data acquisition applications sent by the data application party in any two times are different, the gateways for capturing the target data corresponding to the data acquisition applications in the two times are different.

In this embodiment, after the gateway a1 captures target data corresponding to the data applicant a, the target data may be preprocessed and/or subjected to authority management through the gateway a1, and then the target data is sent to the data applicant a through the gateway a 1. Preprocessing herein includes, but is not limited to, desensitization processing to prevent sensitive information from leaking; rights management includes, but is not limited to, setting rights of the target data, and may be set, for example, to allow only the data applicant a to view or use or process the target data. Thus, even if the target data is acquired by the other party, the other party cannot view or use or process the target data.

After the gateway a1 sends the captured target data to the data applicant a, the data applicant may execute a predetermined processing operation on the target data and generate or determine a processing result corresponding to the target data. For example, the predetermined processing operation may be a risk identification operation. After the data applicant a determines the processing result, it may send the processing result to the execution agent or gateway a1 to send the processing result to the terminal through the target gateway, i.e. the execution agent receives the processing result through gateway a1 and sends the processing result to the target terminal through gateway a1 to make the target terminal display the processing result.

After receiving the processing result through the gateway a1, the execution body may perform preprocessing and/or authority management on the processing result through the gateway a1, and then send the processing result to the terminal through the gateway a 1. Preprocessing herein includes, but is not limited to, desensitization processing to prevent sensitive information from leaking; the authority management includes, but is not limited to, setting the authority of the processing result, and may be set to, for example, only allow a logged-in user on the terminal to view or use or process the processing result. Thus, even if the processing result is obtained by other party, other party can not view or use or process the target data.

In this embodiment, the executing agent may receive a gateway change application for a certain constructed gateway, so as to change the retrievable data of the constructed gateway. Assuming that the gateway b is any constructed gateway, the executing agent may receive a gateway change application for the gateway b, so that the executing agent may determine the gateway b to be changed according to the gateway change application, and may also determine a change operation for the gateway b according to the gateway change application, where the change operation includes adding a common component, deleting a common component, or replacing a common component. For example, if the gateway b is constructed based on n common components, the common components may be added to the gateway b and/or some common components may be deleted from the n common components and/or some common components may be replaced from the n common components, and so on. After the execution main body executes the change operation on the gateway to be changed, the public component on which the gateway to be changed is based is changed, so that the grippable data of the gateway to be changed can be changed through the change operation.

In this embodiment, for any two constructed gateways, the execution subject places the two constructed gateways in an environment (which may be a trusted environment) isolated from each other, that is, the constructed gateways are isolated pairwise.

In the embodiment, the gateway is constructed by using the universal public component, so that the gateway meeting various requirements is conveniently constructed, the method is suitable for various scenes, and the efficiency and the effect of constructing the gateway can be improved. Corresponding gateways are built for different gateway building applications, and corresponding data can be limited by data characteristics in the gateway building applications, so that the data limited by various data characteristics have corresponding special gateways as capturing channels, the data of different types or characteristics are captured by using different gateways, and the corresponding gateways can be built no matter the granularity of the data to be captured. According to the embodiment, data confusion or data interference or data leakage (permission of captured data can be set through a gateway to avoid leakage) and the like in different types or characteristic data capturing and transmitting processes are avoided, various data can be acquired more effectively and accurately, and the data acquisition efficiency and effect are improved. Particularly, the gateways are used as capture and transmission channels of various data (including captured data, processing results and the like), and different constructed gateways are isolated from each other, so that the acquisition isolation and the transmission isolation of different data pieces are further ensured. On the basis, the acquired various data are respectively processed, so that the data processing efficiency and effect can be improved.

In this embodiment, the constructed gateway may be changed, so that the data that can be captured by the gateway may be changed, and the construction, deployment, and application of the gateway may be more convenient and efficient.

In the prior art, various internet services generally meet the requirements of supervision and compliance, such as financial services. In order to more accurately judge the development of the service and whether each service data meets the requirements of supervision and compliance, a better mode is to respectively perform compliance judgment (belonging to the data processing) on each service data and determine a compliance judgment result (belonging to the processing result), so that various service data are required to be accurately acquired, and confusion and interference among the service data are avoided. In addition, data generally has privacy and security requirements, such as financial data, and thus leakage in data acquisition and compliance judgment processes is avoided. Various service data can be accurately acquired through the embodiment, different types of service data are isolated from each other in the processes of acquisition, transmission, compliance judgment, judgment result transmission and the like, and the permission of the service data and the judgment result can be set through the embodiment. It can be seen that the present embodiment is particularly applicable to business supervision and compliance scenarios.

The first embodiment of the present specification is mainly described from the management side of the gateway, the second embodiment of the present specification is described from the perspective of the sender of the gateway construction application, and the first embodiment and the second embodiment correspond to each other.

The execution subject of the second embodiment (hereinafter referred to as "the present embodiment") in this specification may be a terminal (including but not limited to a mobile phone, a computer, a pad, a television) or a server or a corresponding data acquisition platform or an operating system, and the like, that is, the execution subject may be various and may be set, used, or transformed as needed. In addition, a third party application may assist the execution subject in executing the present embodiment. For example, as shown in fig. 1, the data acquisition method in this embodiment may be executed by a server, and an application program (corresponding to the server) may be installed on a terminal (held by a user), and data transmission may be performed between the terminal or the application program and the server, and data collection or input or output or page or information presentation (to the user) may be performed by the terminal or the application program, so as to assist the server in executing the data acquisition method in this embodiment.

As shown in fig. 3, the present embodiment provides a data acquisition method, including:

s201: sending a gateway construction application (which is an execution subject of the first embodiment) to a gateway management side (which is an execution subject of the present embodiment), where the gateway construction application is used for the gateway management side to construct a target gateway; the gateway construction application comprises data characteristics, and the target gateway is used for capturing data conforming to the data characteristics;

the execution main body of this embodiment sends a gateway construction application to a gateway management end, where the gateway construction application is used for the gateway management end to construct a target gateway. The gateway management end receives a gateway construction application and determines a target component from the plurality of public components according to the gateway construction application; and constructing a target gateway corresponding to the gateway construction application based on the target component, which is not called as a first target gateway. The gateway construction application comprises data characteristics, and the target gateway is used for capturing data conforming to the data characteristics.

The first target gateway in this embodiment refers to a gateway corresponding to a gateway construction application, and the target gateway (which is not referred to as a second target gateway) in the first embodiment refers to a gateway corresponding to a data acquisition application. If the data characteristics in the gateway construction application sent at a certain time are the same as the data characteristics in the data acquisition application sent at a certain time, the first target gateway (in this embodiment) corresponding to the gateway construction application sent at the certain time is the second target gateway (in the first embodiment) corresponding to the data acquisition application sent at the certain time.

S203: after receiving a gateway construction completion message sent by the gateway construction end, sending a data acquisition application to the gateway management end, where the data acquisition application is used for the gateway management end to determine the target gateway from the constructed gateways, and capturing target data corresponding to the data acquisition application through the target gateway;

after receiving the gateway construction completion message sent by the gateway construction end, the execution main body in this embodiment may send a data acquisition application to the gateway management end (at this time, the execution main body in this embodiment becomes a data application party in the first embodiment), where the data acquisition application is used for the gateway management end to determine the first target gateway from the constructed gateways (at this time, the role of the first target gateway is equivalent to that of the second target gateway in the first embodiment, that is, the data capture function is performed, and the first target gateway captures target data corresponding to the data acquisition application.

S205: (the execution subject of this embodiment) receives and stores the target data sent by the target gateway.

After the first target gateway captures the target data, the first target gateway sends the data to the execution main body of the embodiment, and the execution main body of the embodiment receives and stores the target data.

After receiving the target data, the execution main body in this embodiment may execute a predetermined processing operation (for example, a risk identification operation) on the target data, determine a processing result corresponding to the target data, and send the processing result to the first target gateway, so as to send the processing result to a terminal through the target gateway.

The execution main body of the embodiment is used as an initiator for gateway construction, and can also send a gateway change application to the gateway management end, wherein the gateway change application is used for determining a gateway to be changed and a change operation of the gateway to be changed by the gateway management end, and the change operation comprises adding a public component or deleting the public component or replacing the public component; and executing the change operation on the gateway to be changed, wherein the change operation is used for changing the grippable data of the gateway to be changed.

For details which are not described in detail in this embodiment, reference is made to the first embodiment.

The first and second embodiments of the present specification are described from the perspective of the corresponding two execution bodies, respectively, and the execution of the third embodiment can execute the contents of the first and second embodiments, that is, the execution body of the third embodiment (hereinafter, referred to as "the present embodiment") can be a combination of the first and second embodiments.

The execution main body of this embodiment may be a terminal (including but not limited to a mobile phone, a computer, a pad, a television) or a server or a corresponding data acquisition platform or an operating system, and the like, that is, the execution main body may be various, and may be set, used, or transformed as needed. In addition, a third party application may assist the execution subject in executing the present embodiment. For example, as shown in fig. 1, the data acquisition method in this embodiment may be executed by a server, and an application program (corresponding to the server) may be installed on a terminal (held by a user), and data transmission may be performed between the terminal or the application program and the server, and data collection or input or output or page or information presentation (to the user) may be performed by the terminal or the application program, so as to assist the server in executing the data acquisition method in this embodiment.

As shown in fig. 4, the present embodiment provides a data acquisition method, including:

s301: determining data characteristics of data to be acquired, and determining whether a target gateway corresponding to the data characteristics exists, wherein the target gateway is used for capturing target data, and the target data is data conforming to the data characteristics;

in this embodiment, the execution subject may construct a gateway and process data. If the execution subject needs to acquire data, the data characteristics of the data to be acquired can be determined, and then whether a target gateway (not called a third target gateway, the construction process is the same as that of the first embodiment) corresponding to the data characteristics exists is determined; the third target gateway is used for capturing target data, and the target data is data conforming to the data characteristics.

S303: if yes, capturing and storing the target data through the target gateway; if not, the target gateway is constructed, and the target data is captured and stored through the target gateway.

If the target gateway is constructed, capturing and storing the target data through the target gateway; if the target gateway is not constructed, an object serving as a gateway can be constructed according to the data characteristics of the data to be acquired, and the object data is captured and stored through the object gateway.

In this embodiment, constructing the target gateway includes:

determining a target component from a plurality of stored common components according to the data characteristics;

building the target gateway based on the target component.

In this embodiment, after capturing target data, the execution subject in this embodiment may execute a predetermined processing operation (for example, a risk identification operation) on the target data, and determine a processing result corresponding to the target data;

and sending the processing result to a terminal through the target gateway so that the terminal displays the processing result.

In this embodiment, for any two constructed gateways, the execution agent may place the two constructed gateways in an isolated environment.

For details which are not described in detail in this embodiment, reference is made to the first or second embodiment.

As shown in fig. 5, a fourth embodiment of the present specification provides a data processing apparatus including:

a component storage module 401, configured to store a plurality of common components for constructing a gateway;

a component selection module 403, configured to receive a gateway construction application, and determine a target component from the plurality of common components according to the gateway construction application;

a gateway construction module 405, configured to construct a gateway corresponding to the gateway construction application based on the target component, where the gateway corresponding to the gateway construction application is configured to capture data that conforms to the data characteristics included in the gateway construction application.

Optionally, the apparatus further comprises:

the data acquisition module is used for receiving a data acquisition application sent by a data applicant, determining the data characteristics of the data to be acquired according to the data acquisition application, and determining a target gateway from the constructed gateways according to the data characteristics of the data to be acquired;

capturing target data corresponding to the data acquisition application through the target gateway, wherein the target data is the data to be acquired;

and sending the target data to the data applicant through the target gateway.

Optionally, the data module is further configured to: and after the target gateway captures the target data corresponding to the data acquisition application, preprocessing and/or authority management are carried out on the target data.

Optionally, the data module is further configured to: after the target data are sent to the data application party through the target gateway, the processing result corresponding to the target data sent by the data application party is received through the target gateway, and the processing result is sent to a terminal through the target gateway, so that the terminal displays the processing result.

Optionally, the data module is further configured to: and after receiving the processing result through the target gateway, preprocessing and/or authority management are carried out on the processing result.

Optionally, the processing result is a risk identification result.

Optionally, for any two received data acquisition applications, if the two received data acquisition applications are from different data application parties, the gateways for capturing the target data corresponding to the two received data acquisition applications are different.

Optionally, the apparatus further comprises:

the gateway changing module is used for receiving a gateway changing application, determining a gateway to be changed and changing operation of the gateway to be changed according to the gateway changing application, wherein the changing operation comprises adding a public component, deleting the public component or replacing the public component;

and executing the change operation on the gateway to be changed, wherein the change operation is used for changing the grippable data of the gateway to be changed.

Optionally, determining a target component from the plurality of common components according to the gateway construction application includes:

and determining a target component from the plurality of common components according to the data characteristics contained in the gateway construction application.

Optionally, the gateway construction application further includes a gateway feature of the gateway to be constructed, and determining the target component from the plurality of common components according to the gateway construction application includes:

and determining a target component from the plurality of common components according to the data characteristics and/or gateway characteristics contained in the gateway construction application.

Optionally, the data feature includes a data type feature and/or a data scene feature.

Optionally, the gateway building module 405 is further configured to: and constructing the gateway corresponding to the gateway construction application, and sending a gateway construction completion message to a sending end of the gateway construction application.

Optionally, the gateway building module 405 is further configured to: for any two constructed gateways, the two constructed gateways are placed in an isolated environment.

Optionally, the environment is a trusted environment.

As shown in fig. 6, a fifth embodiment of the present specification provides a data acquisition apparatus including:

a gateway construction application module 501, configured to send a gateway construction application to a gateway management end, where the gateway construction application is used for the gateway management end to construct a target gateway; the gateway construction application comprises data characteristics, and the target gateway is used for capturing data conforming to the data characteristics;

a data acquisition application module 503, configured to send a data acquisition application to the gateway management end after receiving a gateway construction completion message sent by the gateway construction end, where the data acquisition application is used for the gateway management end to determine the target gateway from the constructed gateways, and capture, by the target gateway, target data corresponding to the data acquisition application;

and a data obtaining module 505, configured to receive and store the target data sent by the target gateway.

Optionally, the apparatus further comprises:

the gateway change module is used for sending a gateway change application to the gateway management end after receiving a gateway construction completion message sent by the gateway construction end, wherein the gateway change application is used for determining a gateway to be changed and change operation of the gateway to be changed by the gateway management end, and the change operation comprises adding a public component or deleting the public component or replacing the public component; and executing the change operation on the gateway to be changed, wherein the change operation is used for changing the grippable data of the gateway to be changed.

Optionally, the gateway construction application includes gateway characteristics of a gateway to be constructed.

Optionally, the target data conforms to the data characteristics included in the gateway construction application.

Optionally, the apparatus further comprises:

and the data processing module is used for executing preset processing operation on the target data after receiving the target data and determining a processing result corresponding to the target data.

Optionally, the data processing module is further configured to: and after the processing result of the target data is determined, sending the processing result to the target gateway so as to send the processing result to a terminal through the target gateway.

Optionally, the predetermined processing operation is a risk identification operation.

As shown in fig. 7, a sixth embodiment of the present specification provides a data acquisition apparatus including:

a gateway determining module 601, configured to determine a data feature of data to be acquired, and determine whether a target gateway corresponding to the data feature exists, where the target gateway is configured to capture target data, and the target data is data conforming to the data feature;

a data obtaining module 603, configured to capture and store the target data through the target gateway if the target data is valid;

Optionally, constructing the target gateway includes:

building the target gateway based on the target component.

Optionally, the apparatus further comprises:

the data processing module is used for executing preset processing operation on the target data after the target data are captured, and determining a processing result corresponding to the target data;

Optionally, the data obtaining module 603 is further configured to: for any two constructed gateways, the two constructed gateways are placed in an isolated environment.

A seventh embodiment of the present specification provides a data processing apparatus comprising:

at least one processor;

and the number of the first and second groups,

a memory communicatively coupled to the at least one processor;

wherein,

the memory stores instructions executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to perform the data processing method of the first embodiment.

An eighth embodiment of the present specification provides a data processing apparatus including:

at least one processor;

and the number of the first and second groups,

a memory communicatively coupled to the at least one processor;

wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data acquisition method of the second embodiment.

A ninth embodiment of the present specification provides a data processing apparatus comprising:

at least one processor;

and the number of the first and second groups,

a memory communicatively coupled to the at least one processor;

wherein,

the memory stores instructions executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to perform the data acquisition method of the third embodiment.

A tenth embodiment of the present specification provides a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the data processing method of the first embodiment.

An eleventh embodiment of the present specification provides a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the data acquisition method of the second embodiment.

A twelfth embodiment of the present specification provides a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the data acquisition method of the third embodiment.

The above embodiments may be combined, and the modules with the same name may be the same or different between different embodiments.

While certain embodiments of the present disclosure have been described above, other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily have to be in the particular order shown or in sequential order to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus, device, and non-volatile computer-readable storage medium embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and in relation to the description, reference may be made to some portions of the description of the method embodiments.

The apparatus, the device, the nonvolatile computer readable storage medium, and the method provided in the embodiments of the present specification correspond to each other, and therefore, the apparatus, the device, and the nonvolatile computer storage medium also have similar advantageous technical effects to the corresponding method.

In the 90 s of the 20 th century, improvements in a technology could clearly distinguish between improvements in hardware (e.g., improvements in circuit structures such as diodes, transistors, switches, etc.) and improvements in software (improvements in process flow). However, as technology advances, many of today's process flow improvements have been seen as direct improvements in hardware circuit architecture. Designers almost always obtain the corresponding hardware circuit structure by programming an improved method flow into the hardware circuit. Thus, it cannot be said that an improvement in the process flow cannot be realized by hardware physical modules. For example, a Programmable Logic Device (PLD), such as a Field Programmable Gate Array (FPGA), is an integrated circuit whose Logic functions are determined by programming the Device by a user. A digital system is "integrated" on a PLD by the designer's own programming without requiring the chip manufacturer to design and fabricate application-specific integrated circuit chips. Furthermore, nowadays, instead of manually making an Integrated Circuit chip, such Programming is often implemented by "logic compiler" software, which is similar to a software compiler used in program development and writing, but the original code before compiling is also written by a specific Programming Language, which is called Hardware Description Language (HDL), and HDL is not only one but many, such as abel (advanced Boolean Expression Language), ahdl (alternate Hardware Description Language), traffic, pl (core universal Programming Language), HDCal (jhdware Description Language), lang, Lola, HDL, laspam, hardward Description Language (vhr Description Language), vhal (Hardware Description Language), and vhigh-Language, which are currently used in most common. It will also be apparent to those skilled in the art that hardware circuitry that implements the logical method flows can be readily obtained by merely slightly programming the method flows into an integrated circuit using the hardware description languages described above.

The controller may be implemented in any suitable manner, for example, the controller may take the form of, for example, a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, and an embedded microcontroller, examples of which include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320, the memory controller may also be implemented as part of the control logic for the memory. Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may thus be considered a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.

The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functions of the various elements may be implemented in the same one or more software and/or hardware implementations of the present description.

As will be appreciated by one skilled in the art, the present specification embodiments may be provided as a method, system, or computer program product. Accordingly, embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present description may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.

The description has been presented with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the description. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices, or any other non-transmission medium which can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

This description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

The above description is only an example of the present specification, and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A method of data processing, comprising:

storing a plurality of common components for constructing a gateway;

2. The method of claim 1, further comprising:

receiving a data acquisition application sent by a data application party, determining the data characteristics of data to be acquired according to the data acquisition application, and determining a target gateway from constructed gateways according to the data characteristics of the data to be acquired;

and sending the target data to the data applicant through the target gateway.

3. The method of claim 2, wherein after the target gateway captures the target data corresponding to the data acquisition application, the method further comprises:

and preprocessing and/or managing the authority of the target data.

4. The method of claim 2, after sending the target data to the data applicant through the target gateway, the method further comprising:

and receiving a processing result corresponding to the target data sent by the data applicant through the target gateway, and sending the processing result to a terminal through the target gateway so that the terminal displays the processing result.

5. The method of claim 4, after receiving the processing result by the target gateway, the method further comprising:

and carrying out preprocessing and/or authority management on the processing result.

6. The method of claim 4, wherein the processing result is a risk identification result.

7. The method of claim 2, wherein for any two received data acquisition applications, if the two received data acquisition applications are from different data applicants, the gateways for capturing the target data corresponding to the two received data acquisition applications are different.

8. The method of claim 1, further comprising:

receiving a gateway change application, and determining a gateway to be changed and a change operation of the gateway to be changed according to the gateway change application, wherein the change operation comprises adding a public component, deleting the public component or replacing the public component;

9. The method of claim 1, wherein determining a target component from the number of common components according to the gateway build application comprises:

10. The method of claim 1, the gateway construction application further comprising gateway features of a gateway to be constructed, the determining a target component from the number of common components according to the gateway construction application comprising:

11. The method of claim 1, the data features comprising data type features and/or data scene features.

12. The method of claim 1, wherein after the gateway construction application is constructed, the method further comprises:

and sending a gateway construction completion message to the sending end of the gateway construction application.

13. The method of any one of claims 1 to 12, further comprising: for any two constructed gateways, the two constructed gateways are placed in an isolated environment.

14. The method of claim 13, the environment being a trusted environment.

15. A method of data acquisition, comprising:

and receiving and storing the target data sent by the target gateway.

16. The method of claim 15, after receiving a gateway construction completion message sent by the gateway construction side, the method further comprising:

sending a gateway change application to the gateway management end, wherein the gateway change application is used for determining a gateway to be changed and change operation of the gateway to be changed by the gateway management end, and the change operation comprises adding a public component or deleting the public component or replacing the public component; and executing the change operation on the gateway to be changed, wherein the change operation is used for changing the grippable data of the gateway to be changed.

17. The method of claim 15, the gateway build application comprising gateway features of a gateway to be built.

18. The method of any one of claims 15, the target data conforming to data characteristics contained in the gateway construction application.

19. The method of any of claims 15 to 18, after receiving the target data, the method further comprising:

and executing preset processing operation on the target data, and determining a processing result corresponding to the target data.

20. The method of claim 19, after determining a result of processing the target data, the method further comprising:

and sending the processing result to the target gateway so as to send the processing result to a terminal through the target gateway.

21. The method of claim 19, wherein the predetermined processing operation is a risk identification operation.

22. A method of data acquisition, comprising:

if yes, capturing and storing the target data through the target gateway;

23. The method of claim 22, constructing the target gateway comprises:

building the target gateway based on the target component.

24. The method of claim 22, after crawling the target data, the method further comprising:

executing preset processing operation on the target data, and determining a processing result corresponding to the target data;

25. The method of claim 24, wherein the predetermined processing operation is a risk identification operation.

26. The method of any one of claims 22 to 25, wherein for any two constructed gateways, the two constructed gateways are placed in an isolated environment from each other.

27. A data processing apparatus comprising:

28. A data acquisition apparatus comprising:

29. A data acquisition apparatus comprising:

30. A data processing apparatus comprising:

at least one processor;

and the number of the first and second groups,

a memory communicatively coupled to the at least one processor;

wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data processing method of any one of claims 1 to 14.

31. A data acquisition device comprising:

at least one processor;

and the number of the first and second groups,

a memory communicatively coupled to the at least one processor;

wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data acquisition method of any one of claims 15 to 21.

32. A data acquisition device comprising:

at least one processor;

and the number of the first and second groups,

a memory communicatively coupled to the at least one processor;

wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data acquisition method of any one of claims 22 to 26.

33. A computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the data processing method of any one of claims 1 to 14.

34. A computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the data acquisition method of any one of claims 15 to 21.

35. A computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the data acquisition method of any one of claims 22 to 26.