CN113076155A

CN113076155A - Data processing method and device, electronic equipment and computer storage medium

Info

Publication number: CN113076155A
Application number: CN202010006180.XA
Authority: CN
Inventors: 周月侨; 谭啸
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-01-03
Filing date: 2020-01-03
Publication date: 2021-07-06
Anticipated expiration: 2040-01-03
Also published as: CN113076155B

Abstract

The embodiment of the invention provides a data processing method and device, electronic equipment and a computer storage medium. The data processing method comprises the following steps: receiving operation information of a user for selecting and operating displayed visual objects, wherein the visual objects are multiple and correspond to pre-configured algorithm objects for realizing preset functions; determining at least two selected visual objects and an execution relation between at least two algorithm objects corresponding to the at least two visual objects according to the operation information; and synthesizing the at least two algorithm objects according to the execution relation to generate a synthesis algorithm corresponding to the at least two algorithm objects. By the embodiment of the invention, the expansibility can be improved, and a user can conveniently splice required algorithms.

Description

Data processing method and device, electronic equipment and computer storage medium

Technical Field

The embodiment of the invention relates to the technical field of computers, in particular to a data processing method and device, electronic equipment and a computer storage medium.

Background

With the development and progress of science and technology, Artificial Intelligence (AI) technology is also gradually developing and maturing. The prior art artificial intelligence techniques are mainly scenario-specific solutions based on user needs and usage scenario customization. For example, in a usage scenario of a smart city, a vehicle needs to be identified, and then a set of artificial intelligence algorithms capable of identifying the vehicle and the brand and model of the vehicle are separately developed. In addition, in a usage scenario of a smart city, the license plate of a vehicle may need to be identified, and for this reason, a set of artificial intelligence algorithm capable of identifying the license plate number of the vehicle may be separately developed.

Because the development of the artificial intelligence algorithm needs to use a large number of training samples and a large amount of training time, the development of the artificial intelligence algorithm is long in time consumption and high in cost, and the usable surface is narrow due to the fact that the artificial intelligence algorithm is customized according to the requirements of a use scene.

Disclosure of Invention

In view of the above, embodiments of the present invention provide a data processing scheme to solve some or all of the above problems.

According to a first aspect of the embodiments of the present invention, there is provided a data processing method, including: receiving operation information of a user for selecting and operating displayed visual objects, wherein the visual objects are multiple and correspond to pre-configured algorithm objects for realizing preset functions; determining at least two selected visual objects and an execution relation between at least two algorithm objects corresponding to the at least two visual objects according to the operation information; and synthesizing the at least two algorithm objects according to the execution relation to generate a synthesis algorithm corresponding to the at least two algorithm objects.

According to a second aspect of an embodiment of the present invention, a data processing method includes: receiving a load request for instructing to load an algorithm object and/or a synthesis algorithm; determining corresponding algorithm object data and/or synthetic algorithm data according to the loading request, wherein the algorithm object data comprise algorithm objects and visual objects corresponding to the algorithm objects, and the synthetic algorithm data comprise synthetic algorithms and visual object chains corresponding to the synthetic algorithms; and generating a request response message corresponding to the loading request according to the algorithm object data and/or the synthetic algorithm data.

According to a third aspect of embodiments of the present invention, there is provided a data processing apparatus including: the operation receiving module is used for receiving operation information of a user for selecting and operating displayed visual objects, wherein the visual objects are multiple and correspond to pre-configured algorithm objects for realizing preset functions; the object determining module is used for determining at least two selected visual objects and an execution relation between at least two algorithm objects corresponding to the at least two visual objects according to the operation information; and the algorithm synthesis module is used for synthesizing the at least two algorithm objects according to the execution relation to generate a synthesis algorithm corresponding to the at least two algorithm objects.

According to a fourth aspect of the embodiments of the present invention, there is provided a data processing apparatus including: a loading request receiving module, configured to receive a loading request for instructing to load an algorithm object and/or a synthesis algorithm; the data determining module is used for determining corresponding algorithm object data and/or synthetic algorithm data according to the loading request, wherein the algorithm object data comprise algorithm objects and visual objects corresponding to the algorithm objects, and the synthetic algorithm data comprise synthetic algorithms and visual object chains corresponding to the synthetic algorithms; and the response generation module is used for generating a request response message corresponding to the loading request according to the algorithm object data and/or the synthetic algorithm data.

According to a fifth aspect of embodiments of the present invention, there is provided an electronic apparatus, including: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus; the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to execute the corresponding operation of the data processing method according to the first aspect or the second aspect.

According to a sixth aspect of embodiments of the present invention, there is provided a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the data processing method according to the first or second aspect.

According to the data processing scheme provided by the embodiment of the invention, the visual objects and the algorithm objects capable of realizing different functions are preset, so that a user can realize the combination of the algorithm objects by operating the visual objects, and a synthesis algorithm capable of meeting the requirements is generated. On one hand, function atomization is realized, namely, a complex function is split into a plurality of atomized algorithm objects, each algorithm object can only realize a certain single function, on the other hand, the visualization of the algorithm objects is realized through the visualization objects, so that the operation of the algorithm objects is simpler and more convenient, and the synthesis algorithm capable of realizing the complex function is realized through the synthesis of the algorithm objects, thereby meeting the specific function requirements of users.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the embodiments of the present invention, and it is also possible for a person skilled in the art to obtain other drawings based on the drawings.

FIG. 1a is a flowchart illustrating steps of a data processing method according to a first embodiment of the present invention;

FIG. 1b is a schematic interface diagram of a usage scenario according to a first embodiment of the present invention;

FIG. 2a is a flowchart illustrating steps of a data processing method according to a second embodiment of the present invention;

FIG. 2b is a schematic diagram of an interface change for generating and displaying an algorithm chain in a usage scenario according to a second embodiment of the present invention;

FIG. 2c is a schematic diagram of an interface change for encapsulating a new algorithm object in a usage scenario according to a second embodiment of the present invention;

FIG. 2d is a schematic diagram of an interface change using object parameters of a modification algorithm in a scene according to a second embodiment of the present invention;

FIG. 2e is a schematic diagram of an interface change using object codes of a modification algorithm in a scene according to the second embodiment of the present invention;

FIG. 2f is a schematic diagram of an interface showing algorithm processing results in a usage scenario according to a second embodiment of the present invention;

FIG. 3 is a flowchart illustrating steps of a data processing method according to a third embodiment of the present invention;

fig. 4 is a block diagram of a data processing apparatus according to a fourth embodiment of the present invention;

fig. 5 is a block diagram of a data processing apparatus according to a fifth embodiment of the present invention;

fig. 6 is a schematic structural diagram of an electronic device according to a sixth embodiment of the present invention.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments of the present invention shall fall within the scope of the protection of the embodiments of the present invention.

The following further describes specific implementation of the embodiments of the present invention with reference to the drawings.

Example one

Referring to fig. 1a, a flowchart illustrating steps of a data processing method according to a first embodiment of the present invention is shown.

The data processing method of the embodiment comprises the following steps:

step S102: and receiving operation information of the user for selecting and operating the displayed visual object.

In this embodiment, a data processing method implementation procedure will be described by taking an example where a user performs an operation through an algorithm synthesis application. Of course, in other embodiments, the user may operate through other methods, such as synthesizing a web page through an algorithm, which is not limited in this embodiment.

A plurality of algorithm objects for implementing different functions and the visualization object corresponding to each algorithm object are configured in advance in the algorithm synthesis application (hereinafter referred to as application).

Each algorithm object may be a packaged algorithm capable of implementing a certain preset function, and the preset function may be determined as needed, for example, it is an atomic capability of a certain packaged artificial intelligence algorithm. For example, an algorithm capable of face recognition (e.g., a trained neural network model with face recognition functionality) is packaged as a "face recognition algorithm object", and an associated visualization object is created for it in an application. As another example, an algorithm capable of gesture recognition is packaged as a "gesture recognition algorithm object," and an associated visualization object is created for it in an application.

The visualized objects are used for users to view and operate the algorithm objects, in application, the visualized objects serve as operable entities of the algorithm objects, and the users can select or drag the visualized objects in the application to realize combination and splicing of the corresponding algorithm objects. For example, the visual object may be an icon or control, etc.

By creating the visual object for each algorithm object, a user can conveniently and intuitively operate the algorithm object without operating the algorithm object through codes, the convenience of operating the algorithm object is improved, and the learning cost and difficulty are reduced.

For example, in a specific usage scenario, the data processing method is described as being configured on a terminal device, but of course, the data processing method may also be configured on a server (the server includes a server or a cloud), which interacts with a user only through the terminal device.

As shown in fig. 1b, an application interface is displayed in a display of the terminal device, and the application has a function display area (shown in fig. 1) and an algorithm display area (shown in fig. 2), where the function display area is used to display a preset visualization object in the application, and the algorithm display area is used to display an algorithm chain formed by algorithm objects corresponding to the visualization object selected by the user.

The function display area is provided with a plurality of visual objects, each visual object corresponds to a packaged algorithm object, and each algorithm object is used for realizing a function, such as face recognition, posture recognition, image fusion, stylized Van-Gao, stylized aging, matting and the like.

The user may select a visual object from the function exposure area and add it to the algorithm exposure area, for example, drag visual object a from the function exposure area and drop it to a certain position in the algorithm exposure area, or click visual object a in the function exposure area, which will be automatically added to the algorithm exposure area for exposure.

In the algorithm exposure area, the selected visualization objects form a chain of algorithms. The connection relationship between the visualized objects in the algorithm chain indicates the execution relationship between the corresponding algorithm objects. The user may drag the selected visualization objects in the algorithm display area to adjust the connection relationship between the selected visualization objects in the algorithm chain, thereby adjusting the execution relationship between the corresponding algorithm objects.

In this embodiment, the operation information of the selection operation for the visual object may be operation information of the selection operation for the plurality of visual objects presented by the user. For example, the application displays the visual objects a to D, and the received operation information may be operation information in which the user selects the visual objects A, C and D.

The operation information may include selection target information, such as an identifier (e.g., an ID value, a name, etc.) of the visualization object a. Other information may also be included in the operation information as needed, such as a sequential relationship between the selected visualization objects, display position information of the selected visualization objects, and the like, and a person skilled in the art may determine the content included in the operation information according to specific needs, which is not limited in this embodiment.

Step S104: and determining at least two selected visual objects and an execution relation between at least two algorithm objects corresponding to the at least two visual objects according to the operation information.

The execution relationship between the algorithm objects is used to indicate the data transfer relationship between the corresponding algorithm objects.

For different operation information, the execution relationship between the visualized objects and the corresponding algorithm objects may be determined in any suitable manner, which is not limited by the embodiment.

Taking the example that the operation information includes the visual objects corresponding to the selection operation, the target position information of the visual objects (the target position information is used for indicating the coordinates of the visual objects in the algorithm display area), and the connection relationship between the visual objects, when the execution relationship is determined, the algorithm objects with data interaction can be determined according to the connection relationship between the visual objects, and the data transmission direction between the algorithm objects can be determined according to the target position information of the visual objects.

For example, if the operation information indicates that the user selects the visualization objects A, B and C (corresponding to the algorithm objects A, B and C, respectively), determines the connection between the visualization objects a and B and the connection between the visualization objects B and C according to the connection relationship between the visualization objects, and determines that the visualization objects A, B and C are sequentially arranged and displayed according to the target position information of the visualization objects, the determined execution relationship is: the data output by the algorithm object a corresponding to the visualization object a is used as the input data of the algorithm object B corresponding to the visualization object B, and the data output by the algorithm object B is used as the input data of the algorithm object C corresponding to the visualization object C.

Step S106: and synthesizing the at least two algorithm objects according to the execution relation to generate a synthesis algorithm corresponding to the at least two algorithm objects.

In a specific implementation, synthesizing the algorithm object indicated by the execution relationship according to the data transmission relationship indicated by the execution relationship may be implemented as: and generating a splicing code which indicates that the output data of the input data generator is used as the input data of the algorithm object according to the grammar rule of the algorithm object.

For example, when the output data of the algorithm object a is input to the algorithm object B, a concatenation code is generated in which the output data of the algorithm object a is used as the input data of the algorithm object B. Thus, the synthesis algorithm can be generated according to the splicing code, the algorithm object A and the algorithm object B.

Of course, in other embodiments, the algorithm objects may be synthesized in other manners to generate a synthesis algorithm, which is not limited in this embodiment.

It should be noted that the aforementioned algorithm object may be an encapsulated artificial intelligence algorithm, or other suitable algorithm. By encapsulating the atomic capability of the artificial intelligence algorithm, a specific artificial intelligence solution can be no longer customized for a specific scene of different users, but an application (such as an editor of an AI laboratory property) is established, so that different users can freely and quickly combine an algorithm chain (i.e. an AI capability set) meeting the needs of the user scene through the application, the adaptability is better, and the cost for generating the needed AI capability set by the user is lower.

Through the embodiment, the visual objects and the algorithm objects capable of realizing different functions are preset, so that a user can realize combination of the algorithm objects by operating the visual objects, and a synthesis algorithm capable of meeting requirements is generated. On one hand, function atomization is realized, namely, a complex function is split into a plurality of atomized algorithm objects, each algorithm object can only realize a certain single function, on the other hand, the visualization of the algorithm objects is realized through the visualization objects, so that the operation of the algorithm objects is simpler and more convenient, and the synthesis algorithm capable of realizing the complex function is realized through the synthesis of the algorithm objects, thereby meeting the specific function requirements of users.

The data processing method of the present embodiment may be performed by any suitable electronic device having data processing capabilities, including but not limited to: servers, mobile terminals (such as tablet computers, mobile phones and the like), PCs and the like.

Example two

Referring to fig. 2a, a flow chart of steps of a data processing method according to a second embodiment of the invention is shown.

The data processing method of the embodiment comprises the following steps:

step S202: and receiving operation information of the user for selecting and operating the displayed visual object.

This step can be implemented by the step S102 in the first embodiment.

It should be noted that the algorithm object corresponding to the visualization object may be uploaded by other users, or may be packaged by the user or preset by a developer.

In this embodiment, the operation information is a generic term of selection operations performed by the user for a plurality of visual objects, and the operation information of the selection operations received in this step may be operation information received at a plurality of different times. For example, when the user performs a selection operation on the visual object a at time t1, the user receives operation information on the selection operation, and when the user performs a selection operation on the visual object B at time t2, the user receives operation information on the selection operation.

The operation information may include selection target information indicating a visualization object targeted by the selection operation. The selection target information may be an identification (e.g., an ID value, name, etc.) of the visualization object a.

Other information may also be included in the operation information as needed, such as a connection relationship between the selected visualization objects, and the like, for example, the connection relationship may be that the visualization object a is connected with the visualization object B, and the visualization object B is connected with the visualization object C, and a person skilled in the art may determine the content included in the operation information according to specific needs, which is not limited in this embodiment.

Step S204: and determining at least two selected visual objects and an execution relation between at least two algorithm objects corresponding to the at least two visual objects according to the operation information.

In this embodiment, the determining of the execution relationship between the at least two algorithm objects corresponding to the at least two visualization objects in step S204 may be implemented as: and determining an execution relation between at least two algorithm objects corresponding to the at least two visual objects according to the connection relation between the at least two visual objects.

In this embodiment, the execution relationship indicates a data transfer relationship between algorithm objects. The user operates the visual objects through the application, the visual objects are placed in the algorithm display area in the application interface, the connection relation is established among the visual objects, and the execution sequence among the algorithm objects and the data transmission relation among the algorithm objects can be determined according to the connection relation.

Step S206: and synthesizing the at least two algorithm objects according to the execution relation to generate a synthesis algorithm corresponding to the at least two algorithm objects.

In a specific implementation, step S206 can be implemented as: displaying an algorithm chain generated according to the at least two visualization objects and the execution relation, synthesizing algorithm objects corresponding to the visualization objects contained in the algorithm chain, and generating a synthetic algorithm corresponding to the at least two algorithm objects.

The algorithm chain is used for completely displaying the synthesis algorithm, and a user can visually check and manage the whole synthesis algorithm through the algorithm chain, so that the user experience is better.

In a specific implementation, the interface 3 in fig. 2b shows a schematic diagram of an algorithm chain, which may be generated by:

for each selection operation of a plurality of selection operations indicated by the operation information, performing the following process:

process A: and determining the visual object selected by the current selection operation, and accessing the selected visual object into the spliced visual object chain.

The chain of stitched visual objects may have no visual object (e.g., no visual object in the algorithm display area when initially stitched, as shown in interface 1 in fig. 2 b), or may include one or more visual objects.

When a user selects a visual object from the function display area, the visual object is added to the algorithm display area, and if no visual object exists in the algorithm display area, the selected visual object is the first visual object, and the first visual object can be displayed at a proper position in the algorithm display area (as shown in an interface 2 in fig. 2 b); and if the visual objects exist in the algorithm display area, accessing the visual objects to the back of the corresponding visual objects in the spliced visual object chain according to the indication of the operation information.

And a process B: determining a spliceable object which can be synthesized with the selected visual object from the displayed remaining visual objects, and performing differential display on the spliceable object to indicate the user to perform selection operation on the spliceable object.

Because the preset algorithm objects in the application can process different data types, the preset algorithm objects allow the input data types and the output data types to be different. For example, algorithm object A is used to process image data, which allows both the input data type and the output data type to be image-related data types. The algorithm object B is used to process audio data, which allows both the input data type and the output data type to be audio-related data types.

In order to enable a user to quickly determine visual objects which can be spliced when splicing algorithm objects, so that the efficiency is improved, the user can use the visual objects more conveniently, after the user selects one visual object, whether the rest visual objects can be spliced with the selected visual object is judged, the visual objects which can be spliced with the selected visual object are displayed in a distinguishing mode, and the user can determine the visual objects which can be spliced more intuitively.

In a specific implementation manner, the determining, from the remaining displayed visual objects, a mosaicable object that can be synthesized with the selected visual object, and performing differential display on the mosaicable object to instruct the user to perform a selection operation on the mosaicable object includes: determining the spliceable object from the remaining visual objects according to the input data type of the algorithm object corresponding to the remaining visual objects and the output data type of the algorithm object corresponding to the selected visual object; and performing differential display on the spliceable object to indicate the user to perform selection operation on the spliceable object.

For example, if the user selects the visual object a and the output data type of the corresponding algorithm object a is the image type, the input data type of the corresponding algorithm object is determined from the remaining visual objects B to E as the visual object of the image type, and if the input data types of the algorithm objects B and D corresponding to the visual objects B and D are the image types, the visual objects B and D are the objects capable of being spliced. The user is prompted by a distinctive presentation of the visual objects B and D (e.g., changing the color of the visual objects B and D).

The person skilled in the art can use any suitable manner to perform the differential display on the object that can be spliced, as long as the object that can be spliced and the object that cannot be spliced can be distinguished, which is not limited in this embodiment.

After accessing the selected visualization object into the spliced chain of visualization objects, it may be determined whether the current chain of visualization objects satisfies a link completion condition. For example, if a completion operation by the user is received, it is determined that the link completion condition is satisfied, or if operation information of a selection operation by the user is not received for a set length of time, it is determined that the link completion condition is satisfied, and the like. Any suitable link completion condition can be set by those skilled in the art as required, and the embodiment is not limited thereto.

When it is determined that the link completion condition is satisfied, the process C is performed, otherwise, the process D is performed.

And a process C: and if the link completion condition is determined to be met, generating the algorithm chain according to the spliced visual object chain.

One skilled in the art may generate the algorithm chain according to the spliced visualization object chain in any suitable manner as needed, for example, the algorithm objects indicated by the visualization object chain are spliced according to the execution relationship indicated by the visualization object chain to generate the algorithm chain.

The process D is as follows: and if the link completion condition is determined not to be met, returning to the operation of determining the visual object selected by the current selection operation for continuing execution.

And when the link completion condition is not met, indicating that the user does not obtain the needed visual object link, determining a new current selection operation to obtain a new visual object selected by the user, and accessing the new visual object into the spliced visual object chain until the link completion condition is met.

After the algorithm chain is completed, a synthesis algorithm can be generated, and the user can save the synthesis algorithm as required for subsequent use or export.

Optionally, in this embodiment, in order to facilitate the user to add a new visualization object and an algorithm object according to the user's own needs, the method further includes:

step S208: displaying an input interface for a user to input an algorithm, acquiring the algorithm input by the user through the input interface, and generating an algorithm object corresponding to the algorithm input by the user and a visual object corresponding to the generated algorithm object according to the packaging operation of the algorithm input by the user.

It should be noted that step S208 may be executed at any suitable timing, for example, before step S202, or at any timing between step S202 and step S206, or after step S206, which is not limited in this embodiment.

In a specific example, as shown in fig. 2c, if the algorithm object preset in the application cannot meet the requirement of the user, the user may call an input interface (shown in fig. 1) by operating the application, and in the input interface, the user may input an algorithm (for example, algorithm a shown in interface 1 in the figure) and encapsulate it into an algorithm object and a visual object (for example, visual object a shown in interface 2 in the figure), so that the user may add the algorithm object according to the need of the user, and enhance extensibility. The application can be preset with a packaging rule, and when the algorithm input by a user is packaged, the algorithm is packaged according to the uniform packaging rule.

For example, if an algorithm object is packaged as a function, the function object is packaged as a corresponding function according to a definition rule of the function and an algorithm input by a user.

Optionally, after packaging the new algorithm object, the user may perform: and according to the obtained uploading operation of the user on the algorithm object, generating and sending an algorithm object uploading message by using the algorithm object and the visual object corresponding to the algorithm object. Therefore, the user can release the algorithm object packaged by the user to the platform, and the platform can distribute the algorithm object to the applications of other users, so that the algorithm object is shared.

Optionally, in this embodiment, in order to facilitate a user to adjust parameters of an algorithm object in an algorithm chain as needed, so that the algorithm chain better meets the needs of the user, the method further includes:

step S210: showing a parameter modification interface for a user to modify the parameters of the configured algorithm object; and acquiring new parameters input by a user through the parameter modification interface, and modifying the parameters to be modified in the algorithm object to be modified.

In a specific example, as shown in fig. 2d, the user may call a parameter modification interface (shown at 1 in the figure) by operating (e.g., clicking) on a visualization object in a visualization object chain in an algorithm display area of the application, and at least part of the modifiable parameters in the algorithm object corresponding to the clicked visualization object may be displayed in the parameter modification interface. The modifiable parameters may be different for different algorithm objects, and those skilled in the art can set the modifiable parameters in the algorithm objects as needed, which is not limited by the embodiment.

For example, the modifiable parameter of the algorithm object may be an output data type, an input data type, or the like of the algorithm object.

Therefore, the user can adjust the parameters of the algorithm object through a GUI (graphical user interface), so that the algorithm object can meet the customized requirement.

Optionally, in this embodiment, in order to meet a requirement of a user for more personalization, the method further includes:

step S212: displaying a code editing interface for a user to modify the code content of the configured algorithm object; acquiring the position information of the code segment to be replaced and the replacement code segment input by a user through the code modification interface; and updating the code segment to be replaced indicated by the position information in the algorithm object to be modified by using the replacement code segment.

In a specific example, as shown in fig. 2e, a user may call a code editing interface (shown in fig. 1) through a visual object in an algorithm display area by operating (e.g., long pressing), and the code editing interface may display a code of an algorithm object corresponding to the visual object, so that the user modifies the code of the algorithm object according to the need of the user, so that the modified code of the algorithm object meets the need of the user.

Optionally, in this embodiment, in order to enable a user to conveniently view the effect of the algorithm chain running, the method further includes:

step S214: receiving the data to be processed input by the user; and carrying out algorithm processing on the data to be processed by using the synthesis algorithm to obtain an algorithm processing result and displaying the algorithm processing result.

In a specific example, the user may enter the data to be processed through an input option, or access the data set, or data in a third party database, through a data entry interface (input API). Wherein the data to be processed includes at least one of image data, audio data and audiovisual data input by a user through an input option or a data input interface of the application.

Inputting the data to be processed into a synthesis algorithm, processing the data to be processed by the synthesis algorithm to obtain output data, performing visualization processing on the output data to generate an algorithm processing result, and displaying the algorithm processing result.

In a feasible manner, the performing algorithm processing on the data to be processed by using the synthesis algorithm to obtain an algorithm processing result and displaying may be implemented as: and processing the data to be processed by using the algorithm objects in the synthesis algorithm according to the execution relation of the algorithm objects indicated by the synthesis algorithm to obtain and display the processing result of each algorithm object.

For example, as shown in fig. 2f, the synthesis algorithm includes algorithm objects a to C, the execution relationship indicates that the algorithm objects a to C are executed in sequence, the data to be processed is input into the algorithm object a, and the algorithm object a processes the data to obtain an algorithm processing result a and displays the algorithm processing result a; and then inputting the algorithm processing result A into the algorithm object B, processing the algorithm processing result A to obtain an algorithm processing result B, displaying the algorithm processing result B, inputting the algorithm processing result B into the algorithm object C, processing the algorithm processing result B to obtain an algorithm processing result C, and displaying the algorithm processing result C.

Therefore, a user can visually check the algorithm processing result of each algorithm object, and whether the algorithm processing result meets the requirement is determined, so that the algorithm object needing to be adjusted is determined more quickly, and the algorithm synthesis efficiency is improved.

Optionally, in this embodiment, in order to make it more convenient for the user to process the result of the algorithmic process, the method further includes:

step S216: receiving result output operation of a user on at least one displayed algorithm processing result; and outputting the algorithm processing result indicated by the result output operation as preset type data.

The preset type of data may be any suitable data, for example, picture type data (e.g., JPG, BMP, etc.), or audio type data (e.g., MP3, etc.), or audio-visual type data (e.g., MP4, MVP, etc.).

In a specific implementation, a user can call a result output option through the displayed algorithm processing result, and the user can output a required algorithm processing result into data of a preset type through the operation result output option, so that the user can visually check the algorithm processing result, and each algorithm processing result can be stored or downloaded to facilitate subsequent processing.

Optionally, in this embodiment, in order to facilitate users to share the composition algorithm, the method further includes:

step S218: and outputting the generated synthesis algorithm as an executable file.

It should be noted that step S218 may be executed at any suitable timing, for example, before step S202, or at any timing between step S202 and step S216, or after step S216, which is not limited in this embodiment.

The executable file may be any suitable type of executable file. Such as a Windows executable (exe file) or an applet for some applications, etc. Therefore, the synthesis algorithm can be directly put in, and can be repeatedly used and spread, and the publishing convenience is improved.

Those skilled in the art can generate the required executable file in any appropriate manner in the prior art, which is not described in detail in this embodiment.

Optionally, the method further comprises:

step S220: and according to the obtained uploading operation of the user on the synthesis algorithm, generating and sending a synthesis algorithm uploading message by using the synthesis algorithm and the visual object chain corresponding to the synthesis algorithm.

After the synthesis algorithm is generated, a user can trigger the uploading operation of the synthesis algorithm by clicking the synthesis algorithm uploading option displayed in the interface, after the user triggers the uploading operation of the synthesis algorithm, the synthesis algorithm and the visual object chain corresponding to the synthesis algorithm are used for generating a synthesis algorithm uploading message and sending the synthesis algorithm uploading message to the platform, so that the platform can push the synthesis algorithm to other users, and the users with the same requirements can directly use the synthesis algorithm.

It should be noted that, the user can set corresponding payment information for the uploaded algorithm object and the synthesis algorithm according to needs, so as to be purchased and used for compensation by other users.

The data processing method of the embodiment can be applied to any suitable scenes including but not limited to security, e-commerce, entertainment and the like.

For example, in a security scene, if a user needs to identify a person in a surveillance video and identify corresponding person information, a synthesis algorithm (denoted as synthesis algorithm a) capable of identifying the person and identifying the person information may be spliced by using a face recognition algorithm object, a face matching algorithm object and an intelligent pattern algorithm object preset therein through an algorithm synthesis application. Therefore, through the synthesis algorithm A, as long as a user inputs the monitoring video and the original information base into the synthesis algorithm A, the user can automatically recognize the face in the monitoring video, compare and match the recognized face with the face in the original information base, and if the matched face is found, the person information corresponding to the face in the original information base is added into the image frame corresponding to the recognized face to identify the person. Therefore, suspicious molecules can be rapidly and automatically monitored, and security reliability is improved.

For another example, in an e-commerce scene, if a user needs to adjust (e.g., beautify, crop, etc.) a product introduction chart or an introduction video, a desired synthesis algorithm (denoted as synthesis algorithm B) may be spliced by an algorithm synthesis application using various preset image processing algorithm objects (including, but not limited to, a whitening algorithm object, a blurring algorithm object, etc.) therein. Therefore, through the synthesis algorithm B, the user can automatically process the commodity introduction chart or the introduction video only by inputting the commodity introduction chart or the introduction video into the synthesis algorithm B, and the commodity introduction chart or the introduction video which needs to be adjusted is obtained.

For another example, in an entertainment scene, specifically, in a live video scene, if a user needs to adjust a live video stream, a desired synthesis algorithm (denoted as synthesis algorithm C) may be spliced by using various preset algorithm objects for image processing (including but not limited to a whitening algorithm object, a large-eye algorithm object, etc.) and/or algorithm objects for audio processing through an algorithm synthesis application. Therefore, the image and/or audio in the live video stream can be automatically processed by using the synthesis algorithm C to obtain the required live video stream, so that the live effect is improved.

Through the embodiment, the visual object and the algorithm object capable of realizing different functions are preset in the application, so that a user can realize combination of the algorithm objects by operating the visual object, and a synthesis algorithm capable of meeting requirements is generated. On one hand, function atomization is realized, namely, a complex function is split into a plurality of atomized algorithm objects, each algorithm object can only realize a certain single function, on the other hand, the visualization of the algorithm objects is realized through the visualization objects, so that the operation of the algorithm objects is simpler and more convenient, and the synthesis algorithm capable of realizing the complex function is realized through the synthesis of the algorithm objects, thereby meeting the specific function requirements of users.

Through the application, abstract Artificial Intelligence (AI) capability (namely, packaged algorithm objects) can be combined and called, and algorithm processing results corresponding to the algorithm objects are subjected to visual processing, so that technical trial and experiment thresholds are reduced, the popularization rate of the novel technology is improved, more complex algorithm object splicing can be realized, a global link of an algorithm chain and algorithm processing results of the algorithm objects can be visually checked, and in addition, the usability is high.

By packaging the algorithm, the atomic capability of the artificial intelligence algorithm is packaged into an algorithm object, and a corresponding visual object is generated aiming at the algorithm object, so that a user can give input and adjustment parameters by operating the visual object, and a synthesis algorithm (namely an AI capability set) can be generated by splicing the algorithm object, thereby realizing the visualization of the algorithm object, and realizing the visual editing by operating the visual object corresponding to the algorithm object, namely allowing the user to adjust the parameters of the algorithm object by controlling the graphic elements instead of inputting texts. The algorithm processing result of each step of the object to be processed of the synthetic algorithm object can be visually displayed.

EXAMPLE III

Referring to fig. 3, a flowchart of steps of a data processing method according to a third embodiment of the present invention is shown.

The data processing method of the embodiment comprises the following steps:

step S302: a load request is received that indicates to load an algorithm object and/or a composition algorithm.

The load request may be a request sent by a user through an algorithmic composition application (hereinafter referred to as an application) provided on the terminal device. For example, when a user triggers an algorithm object refresh option and/or a composition algorithm refresh option presented in an algorithm composition application, the application generates and sends a load request to the platform, thereby causing the platform to receive the load request.

It should be noted that the load request may indicate part or all of the algorithm objects stored in the load platform, and/or part or all of the synthesis algorithms.

Step S304: and determining corresponding algorithm object data and/or synthetic algorithm data according to the loading request.

The algorithm object data comprises an algorithm object and a visual object corresponding to the algorithm object, and the synthetic algorithm data comprises a synthetic algorithm and a visual object chain corresponding to the synthetic algorithm.

And the platform searches algorithm objects and/or synthesis algorithms meeting the requirements according to the loading request. For example, if the loading request indicates that only the algorithm object and/or the synthesis algorithm whose generation time is after a certain time point is loaded, or the loading request indicates that only the algorithm object and/or the synthesis algorithm capable of realizing a certain function is loaded, the platform searches the algorithm object and/or the synthesis algorithm meeting the requirement from all the algorithm objects and/or the synthesis algorithms, and obtains the corresponding visual object and/or the visual object chain thereof, so as to generate algorithm object data using the algorithm object and the corresponding visual object, and generate synthesis algorithm data using the synthesis algorithm and the corresponding visual object chain, so as to be sent to the corresponding application later.

Step S306: and generating a request response message corresponding to the loading request according to the algorithm object data and/or the synthetic algorithm data.

And generating a request response message by using the acquired algorithm object data and/or the synthetic algorithm data and sending the request response message to the application corresponding to the loading request, so that the application can acquire the required algorithm object and/or synthetic algorithm and display the corresponding visual object and/or visual object chain in an interface for the user to operate and use.

The platform may send the synthesis algorithms and/or algorithm objects to the user to better meet the user's needs. The algorithm object and/or the synthesis algorithm can be preset by a platform developer and can also be uploaded by a user, so that the algorithm object and the synthesis algorithm stored in the platform are enriched, and the requirements of the user can be better met.

Optionally, in order to enable sharing of algorithm objects and/or synthesis algorithms among users and improve interactivity among users, the method further includes step S308 and/or step S310:

step S308: acquiring a new algorithm object uploaded by a user and a visual object corresponding to the new algorithm object, and generating and broadcasting an algorithm object issuing message for issuing the new algorithm object according to the new algorithm object and the corresponding visual object.

The new algorithm object uploaded by the user can be an algorithm object packaged by the user through an input interface in the application and a visual object generated by the application according to the algorithm object. The user can upload the packaged algorithm object and the corresponding visual object to the platform through the operation application.

Because the algorithm object uploaded by the user indicates that the user wants to share the algorithm object, after the platform acquires the newly added algorithm object and the corresponding visual object, the platform can automatically generate an algorithm object issuing message according to the newly added algorithm object and the corresponding visual object so as to push the newly added algorithm object and the visual object thereof to other users.

Step S310: acquiring a newly added synthetic algorithm uploaded by a user and a visual object chain corresponding to the newly added synthetic algorithm, and generating and broadcasting a synthetic algorithm issuing message for issuing the newly added synthetic algorithm according to the newly added synthetic algorithm and the corresponding visual object chain.

The newly added synthesis algorithm uploaded by the user can be a synthesis algorithm formed by splicing algorithm objects in application by the user and a visual object chain generated by applying the synthesis algorithm. The user can upload the synthesis algorithm and the corresponding visual object chain to the platform by operating the application.

Because the user uploads the synthesis algorithm to indicate that the user wants to share the synthesis algorithm, after the platform acquires the newly added synthesis algorithm and the corresponding visual object chain, the platform can automatically generate a synthesis algorithm release message according to the newly added synthesis algorithm and the corresponding visual object chain so as to push the newly added synthesis algorithm and the visual object chain thereof to other users.

Therefore, when the user uploads the new algorithm object and/or the new synthesis algorithm, the new algorithm object and/or the new synthesis algorithm are automatically pushed to other users (the users are users for receiving pushing), and the new algorithm object and/or the new synthesis algorithm are more convenient to share.

Example four

Referring to fig. 4, a block diagram of a data processing apparatus according to a third embodiment of the present invention is shown.

The data processing apparatus of the present embodiment includes: an operation receiving module 402, configured to receive operation information of a user through selection operation on displayed visual objects, where the number of visual objects is multiple, and each visual object corresponds to a preconfigured algorithm object for implementing a preset function; an object determining module 404, configured to determine, according to the operation information, at least two selected visualization objects and an execution relationship between at least two algorithm objects corresponding to the at least two visualization objects; and an algorithm synthesizing module 406, configured to synthesize the at least two algorithm objects according to the execution relationship, and generate a synthesis algorithm corresponding to the at least two algorithm objects.

Optionally, the object determining module 404 is configured to determine, according to the operation information, at least two selected visualization objects, and determine, according to a connection relationship between the at least two visualization objects, an execution relationship between at least two algorithm objects corresponding to the at least two visualization objects.

Optionally, the execution relationship between the at least two algorithm objects is a data transmission relationship between the at least two algorithm objects.

Optionally, the algorithm synthesizing module 406 is configured to display an algorithm chain generated according to the at least two visualization objects and the execution relationship, synthesize algorithm objects corresponding to the visualization objects included in the algorithm chain, and generate a synthesis algorithm corresponding to the at least two algorithm objects.

Optionally, the algorithm synthesis module 406 generates the algorithm chain by: for each selection operation of a plurality of selection operations indicated by the operation information: determining the visual object selected by the current selection operation, and accessing the selected visual object into the spliced visual object chain; determining a spliceable object which can be synthesized with the selected visual object from the displayed remaining visual objects, and performing differential display on the spliceable object to indicate the user to perform selection operation on the spliceable object; if the link completion condition is determined to be met, generating the algorithm chain according to the spliced visual object chain; and if the link completion condition is determined not to be met, returning to the operation of determining the visual object selected by the current selection operation for continuing execution.

Optionally, the algorithm synthesizing module 406 determines, when determining a spliceable object that can be synthesized with the selected visual object from the displayed remaining visual objects and performing differential display on the spliceable object to indicate that the user performs a selection operation on the spliceable object, the spliceable object from the remaining visual objects according to the input data type of the algorithm object corresponding to the remaining visual object and the output data type of the algorithm object corresponding to the selected visual object; and performing differential display on the spliceable object to indicate the user to perform selection operation on the spliceable object.

Optionally, the apparatus further comprises: the algorithm packaging module 408 is configured to display an input interface for a user to input an algorithm, obtain an algorithm input by the user through the input interface, and generate an algorithm object corresponding to the algorithm input by the user and a visualization object corresponding to the generated algorithm object according to a packaging operation on the algorithm input by the user.

Optionally, the apparatus further comprises: a parameter modification module 410, configured to display a parameter modification interface for a user to modify a parameter of the configured algorithm object; and acquiring new parameters input by a user through the parameter modification interface, and modifying the parameters to be modified in the algorithm object to be modified.

Optionally, the apparatus further comprises: the algorithm editing module 412 is used for displaying a code editing interface for a user to modify the code content of the configured algorithm object; acquiring the position information of the code segment to be replaced and the replacement code segment input by a user through the code modification interface; and updating the code segment to be replaced indicated by the position information in the algorithm object to be modified by using the replacement code segment.

Optionally, the apparatus further comprises: a result display module 414, configured to receive the data to be processed input by the user; and carrying out algorithm processing on the data to be processed by using the synthesis algorithm to obtain an algorithm processing result and displaying the algorithm processing result.

Optionally, the result displaying module 414 is configured to, when performing algorithm processing on the data to be processed by using the synthesis algorithm to obtain an algorithm processing result and displaying the algorithm processing result, process the data to be processed by using the algorithm object in the synthesis algorithm according to the execution relationship of the algorithm object indicated by the synthesis algorithm to obtain a processing result of each algorithm object and display the processing result.

Optionally, the apparatus further comprises: a result output module 416, configured to receive a result output operation performed by the user on the displayed at least one algorithm processing result; and outputting the algorithm processing result indicated by the result output operation as preset type data.

Optionally, the data to be processed includes at least one of image data, audio data, and audiovisual data input by a user through an input option of the application or a data input interface.

Optionally, the apparatus further comprises an algorithm output module 418 for outputting the generated synthesis algorithm as an executable file.

Optionally, the apparatus further includes an upload module 420, configured to generate and send a composite algorithm upload message by using the composite algorithm and the visual object chain corresponding to the composite algorithm according to the obtained upload operation of the user on the composite algorithm.

The data processing apparatus of this embodiment is configured to implement the corresponding data processing method in the foregoing multiple method embodiments, and has the beneficial effects of the corresponding method embodiment, which are not described herein again. In addition, the functional implementation of each module in the data processing apparatus of this embodiment can refer to the description of the corresponding part in the foregoing method embodiment, and is not repeated here.

EXAMPLE five

Referring to fig. 5, a block diagram of a data processing apparatus according to a fifth embodiment of the present invention is shown.

The data processing apparatus of the present embodiment includes: a load request receiving module 502, configured to receive a load request for instructing to load an algorithm object and/or a synthesis algorithm; a data determining module 504, configured to determine corresponding algorithm object data and/or synthetic algorithm data according to the loading request, where the algorithm object data includes an algorithm object and a visual object corresponding to the algorithm object, and the synthetic algorithm data includes a synthetic algorithm and a visual object chain corresponding to the synthetic algorithm; a response generating module 506, configured to generate a request response message corresponding to the loading request according to the algorithm object data and/or the synthesis algorithm data.

Optionally, the apparatus further comprises: and the algorithm object pushing module 508 is configured to obtain a new algorithm object uploaded by a user and a visual object corresponding to the new algorithm object, and generate and broadcast an algorithm object issuing message for issuing the new algorithm object according to the new algorithm object and the corresponding visual object.

Optionally, the apparatus further comprises: the synthesis algorithm pushing module 510 is configured to obtain a newly added synthesis algorithm uploaded by a user and a visual object chain corresponding to the newly added synthesis algorithm, and generate and broadcast a synthesis algorithm issuing message for issuing the newly added synthesis algorithm according to the newly added synthesis algorithm and the corresponding visual object chain.

EXAMPLE six

Referring to fig. 6, a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention is shown, and the specific embodiment of the present invention does not limit the specific implementation of the electronic device.

As shown in fig. 6, the electronic device may include: a processor (processor)602, a communication Interface 604, a memory 606, and a communication bus 608.

Wherein:

the processor 602, communication interface 604, and memory 606 communicate with one another via a communication bus 608.

A communication interface 604 for communicating with other electronic devices, such as a terminal device or a server.

The processor 602 is configured to execute the program 610, and may specifically perform relevant steps in the foregoing data processing method embodiment.

In particular, program 610 may include program code comprising computer operating instructions.

The processor 602 may be a central processing unit CPU or an application Specific Integrated circuit asic or one or more Integrated circuits configured to implement embodiments of the present invention. The electronic device comprises one or more processors, which can be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.

And a memory 606 for storing a program 610. The memory 606 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

The program 610 may specifically be configured to cause the processor 602 to perform the following operations: receiving operation information of a user for selecting and operating displayed visual objects, wherein the visual objects are multiple and correspond to pre-configured algorithm objects for realizing preset functions; determining at least two selected visual objects and an execution relation between at least two algorithm objects corresponding to the at least two visual objects according to the operation information; and synthesizing the at least two algorithm objects according to the execution relation to generate a synthesis algorithm corresponding to the at least two algorithm objects.

In an alternative embodiment, the program 610 is further configured to, when determining an execution relationship between at least two algorithm objects corresponding to the at least two visualization objects, determine the execution relationship between the at least two algorithm objects corresponding to the at least two visualization objects according to a connection relationship between the at least two visualization objects.

In an alternative embodiment, the execution relationship between at least two algorithm objects is a data transfer relationship between the at least two algorithm objects.

In an optional implementation manner, the program 610 is further configured to, when the at least two algorithm objects are synthesized according to the execution relationship to generate a synthesis algorithm corresponding to the at least two algorithm objects, display an algorithm chain generated according to the at least two visualization objects and the execution relationship, and synthesize the algorithm objects corresponding to the visualization objects included in the algorithm chain to generate the synthesis algorithm corresponding to the at least two algorithm objects.

In an alternative embodiment, the algorithm chain is generated by: for each selection operation of a plurality of selection operations indicated by the operation information: determining the visual object selected by the current selection operation, and accessing the selected visual object into the spliced visual object chain; determining a spliceable object which can be synthesized with the selected visual object from the displayed remaining visual objects, and performing differential display on the spliceable object to indicate the user to perform selection operation on the spliceable object; if the link completion condition is determined to be met, generating the algorithm chain according to the spliced visual object chain; and if the link completion condition is determined not to be met, returning to the operation of determining the visual object selected by the current selection operation for continuing execution.

In an optional embodiment, the program 610 is further configured to, when determining, from the remaining displayed visual objects, a spliceable object that can be synthesized with the selected visual object and performing differential display on the spliceable object to instruct the user to perform a selection operation on the spliceable object, determine, from the remaining displayed visual objects, the spliceable object according to an input data type of an algorithm object corresponding to the remaining displayed visual objects and an output data type of an algorithm object corresponding to the selected visual object; and performing differential display on the spliceable object to indicate the user to perform selection operation on the spliceable object.

In an optional implementation, the program 610 is further configured to enable the processor 602 to display an input interface for a user to input an algorithm, obtain the algorithm input by the user through the input interface, and generate an algorithm object corresponding to the algorithm input by the user and a visualization object corresponding to the generated algorithm object according to a packaging operation on the algorithm input by the user.

In an alternative embodiment, program 610 is further operative to cause processor 602 to present a parameter modification interface for a user to modify a parameter of a configured algorithm object; and acquiring new parameters input by a user through the parameter modification interface, and modifying the parameters to be modified in the algorithm object to be modified.

In an alternative embodiment, program 610 is further operative to cause processor 602 to present a code editing interface for a user to modify code content of a configured algorithm object; acquiring the position information of the code segment to be replaced and the replacement code segment input by a user through the code modification interface; and updating the code segment to be replaced indicated by the position information in the algorithm object to be modified by using the replacement code segment.

In an alternative embodiment, program 610 is further operative to cause processor 602 to receive the user-entered data to be processed; and carrying out algorithm processing on the data to be processed by using the synthesis algorithm to obtain an algorithm processing result and displaying the algorithm processing result.

In an optional implementation manner, the program 610 is further configured to enable the processor 602, when performing algorithm processing on the data to be processed by using the synthesis algorithm to obtain an algorithm processing result and displaying the algorithm processing result, to process the data to be processed by using an algorithm object in the synthesis algorithm according to an execution relation of the algorithm object indicated by the synthesis algorithm to obtain a processing result of each algorithm object and display the processing result.

In an alternative embodiment, the program 610 is further configured to enable the processor 602 to receive a result output operation performed by a user on the presented at least one processing result of the algorithm; and outputting the algorithm processing result indicated by the result output operation as preset type data.

In an alternative embodiment, the data to be processed includes at least one of image data, audio data and audiovisual data input by a user through an input option or a data input interface.

In an alternative embodiment, program 610 is also operative to cause processor 602 to output the generated synthesis algorithm as an executable file.

In an alternative embodiment, the program 610 is further configured to enable the processor 602 to generate and send a composite algorithm upload message according to the obtained upload operation of the composite algorithm by the user, by using the composite algorithm and the visual object chain corresponding to the composite algorithm.

Alternatively, the program 610 may specifically be configured to cause the processor 602 to perform the following operations: receiving a load request for instructing to load an algorithm object and/or a synthesis algorithm; determining corresponding algorithm object data and/or synthetic algorithm data according to the loading request, wherein the algorithm object data comprise algorithm objects and visual objects corresponding to the algorithm objects, and the synthetic algorithm data comprise synthetic algorithms and visual object chains corresponding to the synthetic algorithms; and generating a request response message corresponding to the loading request according to the algorithm object data and/or the synthetic algorithm data.

In an optional implementation manner, the program 610 is further configured to enable the processor 602 to obtain a new algorithm object uploaded by a user and a visual object corresponding to the new algorithm object, and generate and broadcast an algorithm object issuing message for issuing the new algorithm object according to the new algorithm object and the corresponding visual object.

In an optional implementation manner, the program 610 is further configured to enable the processor 602 to obtain a newly added synthesis algorithm uploaded by a user and a visual object chain corresponding to the newly added synthesis algorithm, and generate and broadcast a synthesis algorithm publishing message for publishing the newly added synthesis algorithm according to the newly added synthesis algorithm and the corresponding visual object chain.

For specific implementation of each step in the program 610, reference may be made to corresponding steps and corresponding descriptions in units in the foregoing data processing method embodiments, which are not described herein again. It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described devices and modules may refer to the corresponding process descriptions in the foregoing method embodiments, and are not described herein again.

Through the electronic equipment of the embodiment, the visual object and the algorithm object capable of realizing different functions are preset in the application, so that a user can realize combination of the algorithm objects by operating the visual object, and a synthesis algorithm capable of meeting requirements is generated. On one hand, function atomization is realized, namely, a complex function is split into a plurality of atomized algorithm objects, each algorithm object can only realize a certain single function, on the other hand, the visualization of the algorithm objects is realized through the visualization objects, so that the operation of the algorithm objects is simpler and more convenient, and the synthesis algorithm capable of realizing the complex function is realized through the synthesis of the algorithm objects, thereby meeting the specific function requirements of users.

It should be noted that, according to the implementation requirement, each component/step described in the embodiment of the present invention may be divided into more components/steps, and two or more components/steps or partial operations of the components/steps may also be combined into a new component/step to achieve the purpose of the embodiment of the present invention.

The above-described method according to an embodiment of the present invention may be implemented in hardware, firmware, or as software or computer code storable in a recording medium such as a CD ROM, a RAM, a floppy disk, a hard disk, or a magneto-optical disk, or as computer code originally stored in a remote recording medium or a non-transitory machine-readable medium downloaded through a network and to be stored in a local recording medium, so that the method described herein may be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware such as an ASIC or FPGA. It will be appreciated that the computer, processor, microprocessor controller or programmable hardware includes memory components (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code that, when accessed and executed by the computer, processor or hardware, implements the data processing methods described herein. Further, when a general-purpose computer accesses code for implementing the data processing method shown herein, execution of the code converts the general-purpose computer into a special-purpose computer for executing the data processing method shown herein.

Those of ordinary skill in the art will appreciate that the various illustrative elements and method steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present embodiments.

The above embodiments are only for illustrating the embodiments of the present invention and not for limiting the embodiments of the present invention, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the embodiments of the present invention, so that all equivalent technical solutions also belong to the scope of the embodiments of the present invention, and the scope of patent protection of the embodiments of the present invention should be defined by the claims.

Claims

1. A method of data processing, comprising:

receiving operation information of a user for selecting and operating displayed visual objects, wherein the visual objects are multiple and correspond to pre-configured algorithm objects for realizing preset functions;

determining at least two selected visual objects and an execution relation between at least two algorithm objects corresponding to the at least two visual objects according to the operation information;

and synthesizing the at least two algorithm objects according to the execution relation to generate a synthesis algorithm corresponding to the at least two algorithm objects.

2. The method of claim 1, wherein said determining an execution relationship between at least two algorithm objects corresponding to said at least two visualization objects comprises:

and determining an execution relation between at least two algorithm objects corresponding to the at least two visual objects according to the connection relation between the at least two visual objects.

3. The method of claim 2, wherein the execution relationship between the at least two algorithm objects is a data transfer relationship between the at least two algorithm objects.

4. The method of claim 3, wherein the synthesizing the at least two algorithm objects according to the execution relationship to generate a synthesis algorithm corresponding to the at least two algorithm objects comprises:

displaying an algorithm chain generated according to the at least two visualization objects and the execution relation, synthesizing algorithm objects corresponding to the visualization objects contained in the algorithm chain, and generating a synthetic algorithm corresponding to the at least two algorithm objects.

5. The method of claim 4, wherein the chain of algorithms is generated by:

for each selection operation of a plurality of selection operations indicated by the operation information:

determining the visual object selected by the current selection operation, and accessing the selected visual object into the spliced visual object chain;

determining a spliceable object which can be synthesized with the selected visual object from the displayed remaining visual objects, and performing differential display on the spliceable object to indicate the user to perform selection operation on the spliceable object;

if the link completion condition is determined to be met, generating the algorithm chain according to the spliced visual object chain; and if the link completion condition is determined not to be met, returning to the operation of determining the visual object selected by the current selection operation for continuing execution.

6. The method of claim 5, wherein the determining a mosaicable object which can be synthesized with the selected visual object from the remaining displayed visual objects and performing a distinguishing display on the mosaicable object to instruct the user to perform a selection operation on the mosaicable object comprises:

determining the spliceable object from the remaining visual objects according to the input data type of the algorithm object corresponding to the remaining visual objects and the output data type of the algorithm object corresponding to the selected visual object;

and performing differential display on the spliceable object to indicate the user to perform selection operation on the spliceable object.

7. The method of claim 1, wherein the method further comprises:

an input interface for a user to input an algorithm is presented,

and acquiring the algorithm input by the user through the input interface, and generating an algorithm object corresponding to the algorithm input by the user and a visual object corresponding to the generated algorithm object according to the packaging operation of the algorithm input by the user.

8. The method of claim 1, wherein the method further comprises:

showing a parameter modification interface for a user to modify the parameters of the configured algorithm object;

and acquiring new parameters input by a user through the parameter modification interface, and modifying the parameters to be modified in the algorithm object to be modified.

9. The method of claim 1, wherein the method further comprises:

displaying a code editing interface for a user to modify the code content of the configured algorithm object;

acquiring the position information of the code segment to be replaced and the replacement code segment input by a user through the code modification interface;

and updating the code segment to be replaced indicated by the position information in the algorithm object to be modified by using the replacement code segment.

10. The method of claim 1, wherein the method further comprises:

receiving the data to be processed input by the user;

and carrying out algorithm processing on the data to be processed by using the synthesis algorithm to obtain an algorithm processing result and displaying the algorithm processing result.

11. The method of claim 10, wherein the performing algorithm processing on the data to be processed by using the synthesis algorithm to obtain and display an algorithm processing result comprises:

and processing the data to be processed by using the algorithm objects in the synthesis algorithm according to the execution relation of the algorithm objects indicated by the synthesis algorithm to obtain and display the processing result of each algorithm object.

12. The method of claim 10, wherein the method further comprises:

receiving result output operation of a user on at least one displayed algorithm processing result;

and outputting the algorithm processing result indicated by the result output operation as preset type data.

13. The method of claim 10, wherein the data to be processed comprises at least one of image data, audio data, and audiovisual data input by a user through an input option or a data input interface.

14. The method of claim 1, wherein the method further comprises:

and outputting the generated synthesis algorithm as an executable file.

15. The method of claim 1, wherein the method further comprises:

and according to the obtained uploading operation of the user on the synthesis algorithm, generating and sending a synthesis algorithm uploading message by using the synthesis algorithm and the visual object chain corresponding to the synthesis algorithm.

16. A method of data processing, comprising:

receiving a load request for instructing to load an algorithm object and/or a synthesis algorithm;

determining corresponding algorithm object data and/or synthetic algorithm data according to the loading request, wherein the algorithm object data comprise algorithm objects and visual objects corresponding to the algorithm objects, and the synthetic algorithm data comprise synthetic algorithms and visual object chains corresponding to the synthetic algorithms;

and generating a request response message corresponding to the loading request according to the algorithm object data and/or the synthetic algorithm data.

17. The method of claim 16, wherein the method further comprises:

acquiring a new algorithm object uploaded by a user and a visual object corresponding to the new algorithm object, and generating and broadcasting an algorithm object issuing message for issuing the new algorithm object according to the new algorithm object and the corresponding visual object.

18. The method of claim 16, wherein the method further comprises:

acquiring a newly added synthetic algorithm uploaded by a user and a visual object chain corresponding to the newly added synthetic algorithm, and generating and broadcasting a synthetic algorithm issuing message for issuing the newly added synthetic algorithm according to the newly added synthetic algorithm and the corresponding visual object chain.

19. A data processing apparatus comprising:

the operation receiving module is used for receiving operation information of a user for selecting and operating displayed visual objects, wherein the visual objects are multiple and correspond to pre-configured algorithm objects for realizing preset functions;

the object determining module is used for determining at least two selected visual objects and an execution relation between at least two algorithm objects corresponding to the at least two visual objects according to the operation information;

and the algorithm synthesis module is used for synthesizing the at least two algorithm objects according to the execution relation to generate a synthesis algorithm corresponding to the at least two algorithm objects.

20. A data processing apparatus comprising:

a loading request receiving module, configured to receive a loading request for instructing to load an algorithm object and/or a synthesis algorithm;

the data determining module is used for determining corresponding algorithm object data and/or synthetic algorithm data according to the loading request, wherein the algorithm object data comprise algorithm objects and visual objects corresponding to the algorithm objects, and the synthetic algorithm data comprise synthetic algorithms and visual object chains corresponding to the synthetic algorithms;

and the response generation module is used for generating a request response message corresponding to the loading request according to the algorithm object data and/or the synthetic algorithm data.

21. An electronic device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to execute the operation corresponding to the data processing method according to any one of claims 1-15 or the operation corresponding to the data processing method according to any one of claims 16-18.

22. A computer storage medium having stored thereon a computer program which, when executed by a processor, implements a data processing method as claimed in any one of claims 1 to 15, or which, when executed, implements a data processing method as claimed in any one of claims 16 to 18.