CN102222110A - Data processing device and method - Google Patents
Data processing device and method Download PDFInfo
- Publication number
- CN102222110A CN102222110A CN 201110177665 CN201110177665A CN102222110A CN 102222110 A CN102222110 A CN 102222110A CN 201110177665 CN201110177665 CN 201110177665 CN 201110177665 A CN201110177665 A CN 201110177665A CN 102222110 A CN102222110 A CN 102222110A
- Authority
- CN
- China
- Prior art keywords
- node
- data processing
- data
- nodes
- business operation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data processing device and method. The data processing method provided by the invention comprises: step 102, creating one or multiple nodes, each of which is used to implement corresponding business operation in a business process; and step 104, implementing all business operations in the business process so as to obtain the output data of the business process. According to the invention, different nodes corresponding to different business operations are set, and the multiple different nodes are used to achieve the business operations in various business processes, thereby obtaining final result data.
Description
Technical field
The present invention relates to field of computer technology, in particular to a kind of data processing method and a kind of data processing equipment.
Background technology
In information system, need to handle the data of a large amount of (being magnanimity sometimes), and, no matter which kind of infosystem (ERP, HR, SCM, CRM, OA, health care, government affairs management, Tax Check or the like), countless ties, complicated relation are all arranged between the data wherein, and this relation is along with the level of informatization gos deep into also constantly complicated.
Want deal with data, at first need data to be processed are extracted from system.
On classic method, generally all be that the system design developer is responsible for preparing data.
Be accompanied by the appearance of ORMapping (Object Relation Mapping) and MDA (model-driven exploitation) technology, the software developer found obtain data by predefined entity structure method (for example, obtain the technical scheme of data from a plurality of entities, wherein generally entity attribute is called data source), this method is obtained the dirigibility that provides certain for data, but it must be based on existing entity, and the realization scope is greatly limited.
Afterwards, software design personnel had taken out data acquisition interface, realized this interface at different data source types, like this, just for data consumer provides unified Access Model, had made things convenient for data to obtain.But this mode has only provided a kind of standard, does not provide implementation method how to obtain data.(for example, there is the integrated technical scheme of a kind of multi-data source in prior art, can be used for single-node login system, wherein the data from different system is called data source).
Present data source obtaining means more and more can not adapt to fast-developing information system requirement:
1. present informationization more and more requires the data processing of cross-module even interdepartmental system.
Along with the continuous refinement of the division of labor in society, designer and developer often only are familiar with module of oneself and the data relationship in the system, and data processing cross-module and interdepartmental system need participate in from the designer and the developer of disparate modules different system.
2. use the user of information system, surging to the enthusiasm of autonomous deal with data.
In the process of using information system, user's (comprising the information system management personnel among the user) is more and more familiar to system, and the maintenance work of information system little by little carries out the transition in user's hand; On the other hand, after using one section system, have only the user just to be familiar with data in the system, the user wishes oneself can handle these data.
3. the data of classic method preparation are sealing, rigid, do not support or be not easy expansion.
For dealing with above-mentioned situation, information-based field presses for a kind of method and system is provided, and for various data processing scenes provide data source, supports the data processing of cross-module interdepartmental system, be convenient to the autonomous deal with data of user, and expand at different scenes easily.
Summary of the invention
Technical scheme to be solved by this invention is, a kind of method and system is provided, and for various data processing scenes provide data source, supports the data processing of cross-module interdepartmental system, is convenient to the autonomous deal with data of user, and expands at different scenes easily.
In view of this, the invention provides a kind of data processing method, comprising: step 102, create one or more nodes, each node is used for carrying out the operation of operation flow corresponding service; Step 104 by one or more nodes, is carried out all business operations in the operation flow, obtains the output data of operation flow.By this technical scheme, corresponding different business operation is provided with different nodes, by the business operation in a plurality of different nodes realization miscellaneous service flow processs, to obtain last result data.Particularly, can offer the module of the visual establishment node of user, create different nodes according to user's input content.And when operation flow was expanded, the business operation that only needs to add the corresponding expansion of new node got final product, and expansion is realized easily.
In technique scheme, preferably, after step 102, before the step 104, also comprise: create one or more orders and carry out control stream, wherein, each is carried out control stream in proper order and connects two predetermined nodes, and determines the execution sequence of described predetermined two nodes.By this technical scheme, guaranteed the operate as normal execution sequence of node, be complementary with the order of business operation in the operation flow.
In technique scheme, preferably, after step 102, before the step 104, also comprise: create one or more operation result transmission control stream, wherein, each operation result transmission control stream is with the output data of the destined node data source as another destined node.By this technical scheme, realize different data between nodes inflow and outflows, be complementary with business operation in the operation flow.
In technique scheme, preferably, each node is provided with attribute, in step 102, according to business operation, the attribute of each node is set, to finish the establishment of each node.By this technical scheme, each node corresponding service operation types can be set, the querying condition of this business operation and result's form etc. are to finish the establishment of whole node.Attribute can comprise that specifically node definition, querying condition definition, result are listed as definition.
In technique scheme, preferably, node types comprises: the sql script node, realize business operation by sql (Structured Query Language (SQL)) statement that execution sets in advance; The storing process node is realized business operation by the database store process that execution sets in advance; The entity node is by obtaining the solid data that presets to realize business operation; Program node, by the program code that sets in advance to realize business operation; Union (combination) node by the union in the database (combination) operation, is realized business operation; Join (connection) node by the join in the database (connection) operation, is realized business operation.
The present invention also provides a kind of data processing equipment, comprising: the node administration module, create one or more nodes, and each node is used for carrying out the operation of operation flow corresponding service; Flow executing modules by one or more nodes, is carried out all business operations in the operation flow, obtains the output data of operation flow.By this technical scheme, corresponding different business operation is provided with different nodes, by the business operation in a plurality of different nodes realization miscellaneous service flow processs, to obtain last result data.Particularly, can provide the user visual node administration module, can create different nodes according to user's input content.And when operation flow was expanded, the business operation that only needs to add the corresponding expansion of new node got final product, and expansion is realized easily.
In technique scheme, preferably, also comprise: carry out control flow management module in proper order, create one or more orders execution controls and flow, wherein, each carries out two predetermined nodes of control stream connection in proper order, and determines the execution sequence of two predetermined nodes.By this technical scheme, guaranteed the operate as normal execution sequence of node, be complementary with the order of business operation in the operation flow.
In technique scheme, preferably, also comprise: operation result transmission control flow management module, create one or more operation result transmission control streams, wherein, each operation result transmission control stream is with the output data of the destined node data source as another destined node.By this technical scheme, realize different data between nodes inflow and outflows, be complementary with business operation in the operation flow.
In technique scheme, preferably, each node is provided with attribute, and the node administration module is provided with the attribute of each node according to business operation, to finish the establishment of each node.By this technical scheme, each node corresponding service operation types can be set, the querying condition of this business operation and result's form etc. are to finish the establishment of whole node.Attribute can comprise that specifically node definition, querying condition definition, result are listed as definition.
In technique scheme, preferably, node types comprises: the sql script node, realize business operation by sql (Structured Query Language (SQL)) statement that execution sets in advance; The storing process node is realized business operation by the database store process that execution sets in advance; The entity node is by obtaining the solid data that presets to realize business operation; Program node, by the program code that sets in advance to realize business operation; Union (combination) node by the union in the database (combination) operation, is realized business operation; Join (connection) node, join (connection) operation by database realizes business operation.
By above technical scheme, can realize a kind of data processing method and a kind of data processing equipment,, support the data processing of cross-module interdepartmental system for various data processing scenes provide data source, be convenient to the autonomous deal with data of user, and expand at different scenes easily.
Description of drawings
Fig. 1 is the process flow diagram of data processing method according to an embodiment of the invention;
Fig. 2 is the block diagram of data processing equipment according to an embodiment of the invention;
Fig. 3 is the synoptic diagram of the example flow of data processing equipment according to an embodiment of the invention;
Fig. 4 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Fig. 5 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Fig. 6 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Fig. 7 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Fig. 8 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Fig. 9 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 10 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 11 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 12 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 13 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 14 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 15 is the principle schematic of the program node of data processing equipment according to an embodiment of the invention;
Figure 16 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 17 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 18 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 19 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 20 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 21 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 22 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 23 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 24 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 25 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 26 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 27 is the interface synoptic diagram of data processing equipment according to an embodiment of the invention;
Figure 28 is the synoptic diagram of the example flow expansion of data processing equipment according to an embodiment of the invention.
Embodiment
In order more to be expressly understood above-mentioned purpose of the present invention, feature and advantage, the present invention is further described in detail below in conjunction with the drawings and specific embodiments.
Set forth a lot of details in the following description so that fully understand the present invention, still, the present invention can also adopt other to be different from other modes described here and implement, and therefore, the present invention is not limited to the restriction of following public specific embodiment.
Fig. 1 is the process flow diagram of data processing method according to an embodiment of the invention.
As shown in Figure 1, the invention provides a kind of data processing method, comprising: step 102, create one or more nodes, each node is used for carrying out the operation of operation flow corresponding service; Step 104 by one or more nodes, is carried out all business operations in the operation flow, obtains the output data of operation flow.By this technical scheme, corresponding different business operation is provided with different nodes, by the business operation in a plurality of different nodes realization miscellaneous service flow processs, to obtain last result data.Particularly, can offer the module of the visual establishment node of user, create different nodes according to user's input content.And when operation flow was expanded, the business operation that only needs to add the corresponding expansion of new node got final product, and expansion is realized easily.
In technique scheme, after step 102, before the step 104, also comprise: create one or more orders execution controls and flow, wherein, each carries out two predetermined nodes of control stream connection in proper order, and determines the execution sequence of two predetermined nodes.By this technical scheme, guaranteed the operate as normal execution sequence of node, be complementary with the order of business operation in the operation flow.
In technique scheme, after step 102, before the step 104, also comprise: create one or more operation result transmission control stream, wherein, each operation result transmission control stream is with the output data of the destined node data source as another destined node.By this technical scheme, realize different data between nodes inflow and outflows, be complementary with business operation in the operation flow.
In technique scheme, each node is provided with attribute, in step 102, according to business operation, the attribute of each node is set, to finish the establishment of each node.By this technical scheme, each node corresponding service operation types can be set, the querying condition of this business operation and result's form etc. are to finish the establishment of whole node.Attribute can comprise that specifically node definition, querying condition definition, result are listed as definition.
In technique scheme, node types comprises: the sql script node, realize business operation by sql (Structured Query Language (SQL)) statement that execution sets in advance; The storing process node is realized business operation by the database store process that execution sets in advance; The entity node is by obtaining the solid data that presets to realize business operation; Program node, by the program code that sets in advance to realize business operation; Union (combination) node by the union in the database (combination) operation, is realized business operation; Join (connection) node by the join in the database (connection) operation, is realized business operation.
Fig. 2 is the block diagram of data processing equipment according to an embodiment of the invention.
As shown in Figure 2, the present invention also provides a kind of data processing equipment 200, comprising: node administration module 202, create one or more nodes, and each node is used for carrying out the operation of operation flow corresponding service; Flow executing modules 204 by one or more nodes, is carried out all business operations in the operation flow, obtains the output data of operation flow.By this technical scheme, corresponding different business operation is provided with different nodes, by the business operation in a plurality of different nodes realization miscellaneous service flow processs, to obtain last result data.Particularly, can provide the user visual node administration module, can create different nodes according to user's input content.And when operation flow was expanded, the business operation that only needs to add the corresponding expansion of new node got final product, and expansion is realized easily.
In technique scheme, also comprise: carry out control flow management module 206 in proper order, create one or more orders execution controls and flow, wherein, each carries out two predetermined nodes of control stream connection in proper order, and determines the execution sequence of two predetermined nodes.By this technical scheme, guaranteed the operate as normal execution sequence of node, be complementary with the order of business operation in the operation flow.
In technique scheme, also comprise: operation result transmission control flow management module 208, create one or more operation result transmission control stream, wherein, each operation result transmission control stream is with the output data of the destined node data source as another destined node.By this technical scheme, realize different data between nodes inflow and outflows, be complementary with business operation in the operation flow.
In technique scheme, each node is provided with attribute, and node administration module 202 is provided with the attribute of each node according to business operation, to finish the establishment of each node.By this technical scheme, each node corresponding service operation types can be set, the querying condition of this business operation and result's form etc. are to finish the establishment of whole node.Attribute can comprise that specifically node definition, querying condition definition, result are listed as definition.
In technique scheme, node types comprises: the sql script node, realize business operation by sql (Structured Query Language (SQL)) statement that execution sets in advance; The storing process node is realized business operation by the database store process that execution sets in advance; The entity node is by obtaining the solid data that presets to realize business operation; Program node, by the program code that sets in advance to realize business operation; Union (combination) node by the union in the database (combination) operation, is realized business operation; Join (connection) node, join (connection) operation by database realizes business operation.
Below the principle of technical scheme of the present invention is described.
Wherein, at first process flow diagram legend of the present invention is described:
Start node.
→ order is carried out control stream, does not have decision node in the flow process, has only " order is carried out control stream ", and each node all is that the order of carrying out control stream is in order carried out successively.
Operation result transmission control stream.
The sql script node: the sql statement that sets in advance by execution obtains the result, can be the result of other nodes as data source in the sql statement.
The storing process node, the database store process that sets in advance by execution obtains the result, can be the result of other nodes as data source in the storing process.
The entity node, as data source, the result that can not accept other nodes is as data source the entity among ORMapping or the MDA.
ORMapping (Object Relational Mapping, Object Relation Mapping are called for short ORM)--be a kind of technology for the mutual unmatched phenomenon that solves the existence of object-oriented and relational database.
MDA (Model Driven Architecture, model-driven framework)--by a software development framework of OMG definition, it is a kind of framework based on UML and other industrial standards, support software design and model in visibleization, storage and exchange.
Program node is obtained data by writing one section program code, generally is used for the situation of Data Source more complicated, and the result that can accept other nodes is as data source.
The union node, the Union that is equivalent to database operates, and the table union in various sources together, supports union and union all operations.The source table comprises the table as a result of physics table, view, other nodes.
The join node, the join that is equivalent to database operates, and the table join in various sources together, supports left join, right join, inner join, cross join operation.The source table comprises the table as a result of physics table, view, other nodes.
End node.
Below be the process flow diagram constraint rule:
1) flow process is made up of node and control stream, has and can only have a start node and end node.
2) can only have an order to carry out control stream link, order is carried out the calculating process of control stream indication flow process.
3) each node can be provided with the description title of this step.
4) indication of operation result transmission control stream is the input data source of the operation result of certain step as another step node.
As shown in Figure 3, be according to a flow process of technical scheme of the present invention for example.
In the business model of fixing output quota by sales, often need calculate the quantity that needs are assigned generation according to order, the Data Source that wherein relates to comprises:
1) consignment of sales order derives from distribution and canalization.
2) standard sales order derives from the direct selling system.
3) the storage situation of product derives from the depositary management system.
According to these Data Sources, finally calculate the quantity that need assign production:
Flow process is described:
Step 302 is supposed the OR Mapping data entity model of having set up the consignment of sales order, directly obtains the consignment of sales order by data entity here.
Step 304 is supposed the OR Mapping data entity model of having set up the standard sales order, directly obtains the standard sales order by data entity here.
Step 306 as input, combines step 302 and step 304 result to them according to rule.
Step 308 as input, calculates the quantity that need assign production to the result of step 306 with storing process.
Below the data processing equipment according to technical scheme of the present invention is elaborated.
At first noun is made an explanation node table: the output after the node computing is table as a result.
This data processing equipment can define various types of nodes, and each node comprises three partial contents: node definition, querying condition definition, result are listed as definition.
Below describe all types of nodes in detail.
The Sql script node:
1.Sql the script definition as shown in Figure 4.
Node table: list other nodes as data source.
ID: the ID that shows node.
Title: acquiescence shows the title of node, can be compiled as a significant title.
Another name: can edit, must import, can not be null character string.Using this another name in the sql script, is the temporary table of node according to this alias resolution when operation.
The select part of Select:sql script.
The where part of Where:sql script.
The group by part of Group by:sql script.
The having part of Having:sql script.
The orderby part of Orderby:sql script.
Verification button: be used for the sql script is carried out after finishing with the top spelling, see if there is grammar mistake.
2. the result is listed as definition as shown in Figure 5.
Wherein, refresh button: carry out the sql script, result's row are filled in the form.
Field name: can not change.
Field type: must input.
Guarantee that the row title does not repeat as a result.
3. the querying condition definition as shown in Figure 6.
Refresh button: carry out the sql script, result's row are filled in the form, as alternative conditions.
Increase button: the increase condition, because be not that the result of sql script is listed as could be as condition, other effective physical column also can be used as condition.
Delete button: the condition that the deletion current line is chosen.
Original word name section: refer to the field name of physical column here, can edit.After carrying out refresh button, what fill here is the field name that the result is listed as, and it might be the another name (by as clause) of physical column field name.Attention: if select partly connects and (join) a plurality of physics tables or view, the original word name section here may need additional table name prefix, for example department.createdon.
Field type: must input.
Another name: querying condition ID, can edit.
Comparison operators: can revise comparison operators in the condition picture when being illustrated in operation during for sky, otherwise not support to revise comparison operators.
Whether must import: identifying this condition, and must show in the condition picture if must have value.
Constant condition whether: as long as carry out inquiry, the constant condition will work, not in the condition screen displayed.
Conditional value: effective and necessary input when being the constant condition, support to be set to context variable and constant.
The storing process node:
1. the storing process definition as shown in Figure 7.
Node table: list other nodes as data source.
ID: the ID that shows node.
Title: acquiescence shows the title of node.Can be compiled as a significant title.
Another name: can edit, must import, can not be null character string.In the storing process script, use this another name, in when operation is the temporary table [parsing scheme: the temporary table table name as querying condition, finally import in the parameter of storing process-storing process has the parameter that receives the temporary table table name] of node according to this alias resolution.
The storing process title: input, also can from database, search and select a storing process title.
2. the querying condition definition as shown in Figure 8.
Refresh button: by carrying out sql, the input parameter of storing process is read out,, then compare parameter name if had content in the tabulation before refreshing:
If parameter exists then does not handle in the tabulation;
If parameter does not exist then newly-increased in the tabulation;
If the parameter in the tabulation no longer is the parameter of storing process, then deletion.
Parameter name: can change.
Parameter type: must input.
Another name: querying condition ID, can edit.
Comparison operators: can revise comparison operators in the condition picture when being illustrated in operation during for sky, otherwise not support to revise comparison operators.
Whether must import: identifying this condition, and must show in the condition picture if must have value.
Constant condition whether: as long as carry out inquiry, the constant condition will work, not in the condition screen displayed.
Conditional value: effective and necessary input when being the constant condition, support to be set to context variable and constant.
3. the result is listed as definition as shown in Figure 9.
Refresh button: carry out storing process, the row of result set are filled in the form, the parameter value that needs to eject before execution as shown in figure 10 is provided with picture, so that the user imports the parameter value of carrying out storing process.
Parameter name: the parameter name that storing process comprises.
Field type: must input.
The entity node:
In application system, business object can well be described concrete service feature, on implementation, business object is made up of a plurality of entities and relation thereof, be the encapsulation again in the application-oriented field of entity,, so more can press close to business here so use business object to replace entity.
1. business object is selected as shown in figure 11.
Demonstrate the business object of having selected.
Select the business object button: eject business object and select dialog box, can only select a business object.If be revised as another business object from a business object, provide confirm prompting " confirming the change business object? ", the user could revise business object after confirming, and the content of result's row and querying condition tab is emptied.
2. the result is listed as definition as shown in figure 12.
Delete columns: the current line that tabulation is chosen removes from result's row.
Increase row: click back ejection picture as shown in figure 13,
The Business Entity that in this picture, can select business object to comprise,
In tabulation, list the field of selected Business Entity,
In tabulation, need to select the field of increase,
Clicking " determining " button is brought into the result who selects in result's tabulation.
3. the querying condition definition as shown in figure 14.
Increase condition: eject the picture of " selecting row ", can after this picture and selecting entities field, be brought in the condition list.
The deletion condition: the current line that tabulation is chosen removes from condition.
Field name: read-only.
Field title: read-only.
Business Entity: read-only.
Another name: querying condition ID, can edit.
Comparison operators: can revise comparison operators in the condition picture when being illustrated in operation during for sky, otherwise not support to revise comparison operators.
Whether must import: identifying this condition, and must show in the condition picture if must have value.
Constant condition whether: as long as carry out inquiry, the constant condition will work, not in the condition screen displayed.
Conditional value: effective and necessary input when being the constant condition, support to be set to context variable, predicate and constant.
Program node:
Use the C# program to realize program node here.
1.C# the realization principle of program node as shown in figure 15.
The execution engine of data flow discloses an interface ICustomQuery, comprise a Query method in the interface, two parameters are arranged in the method, one is when operation context RuntimeContext, one is query argument set QueryParameters, each query argument is one<querying condition ID, parameter value, comparison operators〉tlv triple.
MyQuery is a C# class that realizes interface ICustomQuery.
The definition of C# procedure set as shown in figure 16.
Node table: list other nodes as data source.
ID: the ID that shows node.
Title: acquiescence shows the title of node.Can be compiled as a significant title.
Another name: can edit, must import, can not be null character string.Using this another name in the storing process script, is the temporary table of node according to this alias resolution when operation, the parsing scheme: the temporary table table name as querying condition, is finally imported in the parameter-storing process has the parameter that receives the temporary table table name.
Assembly file: show the assembly file title of having selected, read-only.Eject picture as shown in figure 17 behind the click selector button.
In this picture, finish the selection of assembly file and class:
After selecting an assembly file, list the class that realizes specified interface (being ICustomQuery) here in the object type tabulation, in a procedure set, such class has a plurality of.
The class that selection will be registered is clicked confirming button.
The class title: show the class title of having selected, read-only.
2. the querying condition definition as shown in figure 18.
Increase button: the increase condition increases row in condition class table.
Delete button: the condition that the deletion current line is chosen.
Conditional name: in the ICustomQuery interface that refers to here the condition<key of Query method needs value comparison operators right key name claims, can edit, must input.
Field type: must input.
Another name: querying condition ID, be set to identically with the condition entry of same meaning in other nodes, can edit, must input.
Comparison operators: can revise comparison operators in the condition picture when being illustrated in operation during for sky, otherwise not support to revise comparison operators.
Whether must import: identifying this condition, and must show in the condition picture if must have value.
Constant condition whether: as long as carry out inquiry, the constant condition will work, not in the condition screen displayed.
Conditional value: effective and necessary input when being the constant condition, support to be set to context variable and constant.
3. the result is listed as definition as shown in figure 19.
Increase button: increase a null.
Delete button: delete current selected line.
Field name: can change.
Field type: must input.
The Union node:
1.Union contextual definition as shown in figure 20.
The Union contextual definition is supported Union and two kinds of Union types of Union All;
Can increase physics table and view in the database, support the list picture that ejects physics table and view to select for the user.
ID:, then show the ID of node if come source node; If physics table and view, then indicator gauge title or view name can be edited.
Title: if come source node, then acquiescence shows the title of node, if physics table and view are then given tacit consent to indicator gauge title and view name.Can be compiled as a significant title.
Another name: can edit, must import, can not be null character string.
Type: comprise node, physics table, view
2. the querying condition definition as shown in figure 21.
Here the querying condition of She Zhiing is each table Union result's afterwards a filtercondition, as:
Select*from(
Select?f1,f2?from?a
Union?All
Select?f11,f22?from?b
)t
The Where[querying condition here]
Can be by increase condition button, the field that ejects is as shown in figure 22 selected picture, lists all result's row.
Deletion condition button: the condition that the deletion current line is chosen.
Field name: read-only.
Field type: must input.
Another name: querying condition ID, can edit.
Comparison operators: can revise comparison operators in the condition picture when being illustrated in operation during for sky, otherwise not support to revise comparison operators.
Whether must import: identifying this condition, and must show in the condition picture if must have value.
Constant condition whether: as long as carry out inquiry, the constant condition will work, not in the condition screen displayed.
Conditional value: effective and necessary input when being the constant condition, support to be set to context variable and constant.
3. the result is listed as definition as shown in figure 23.
Refresh button: the identical rule that combines of name according to result's row generates result's row.
Increase button: increase a null.
Delete button: delete current selected line.
Field name: input, can edit.
Field type: must input.
DelegateSO: source table alias 1, support to select field and input field title.
StandardSO: source table alias 2, support to select field and input field title.
The Join node:
1.Join contextual definition as shown in figure 24.
Can increase physics table and view in the database, support the list picture that ejects physics table and view to select for the user.
Only support Left Join relation, later version is considered other join relations.
Can by on move and following shift button adjustment each the table precedence relationship.
ID:, then show the ID of node if come source node; If physics table and view, then indicator gauge title and view name can be edited.
Title: if come source node, then acquiescence shows the title of node, if physics table and view are then given tacit consent to indicator gauge title and view name.Can be compiled as a significant title.
Another name: can edit, must import, can not be null character string.
Type: comprise node, physics table, view.
The On condition: first row need not be provided with, other row: can edit, must import, can not be null character string.
Have two source tables at least.
Row order in this tabulation is exactly the Join order of every source table, and the source table that is in first row is a master meter.
The table of node type will resolve to concrete temporary table when operation.
2. the querying condition definition as shown in figure 25.
Here the condition of She Zhiing is each table join where condition afterwards, is not the On condition.As:
Select*from a left join b on xxxx where[querying condition here]
Can be by increase condition button, the field that enters is as shown in figure 26 selected picture.
Table: list the table as a result (another name) that all come source node with combobox.
After selecting a table, in tabulation, list this all fields of table as a result.
Deletion condition button: the condition that the deletion current line is chosen.
Field name: read-only.
Affiliated table: the source table (another name) under the display field, read-only.
Field type: must input.
Another name: querying condition ID, can edit.
Comparison operators: can revise comparison operators in the condition picture when being illustrated in operation during for sky, otherwise not support to revise comparison operators.
Whether must import: identifying this condition, and must show in the condition picture if must have value.
Constant condition whether: as long as carry out inquiry, the constant condition will work, not in the condition screen displayed.
Conditional value: effective and necessary input when being the constant condition, support to be set to context variable and constant.
3. the result is listed as definition as shown in figure 27.
Increase refresh button: result's row are preset out.
Increase button: eject the picture of " field of selecting the source table ", select the field of row as a result of.
Delete button: delete current selected line.
Field name: read-only.
Affiliated table: read-only.
Field type: must input.
Another name: be defaulted as sky (expression is another name not), can change.
The flow performing engine:
Carry out the link that control is flowed according to order, resolve each node on the link, the manner of execution different according to the node type different choice, execution result is cached in the temporary table, and the table name of record temporary table claims; According to operation result transmission control stream, if node table then claims to pass to node to the table name of temporary table as the input data source of another node, the flow performing engine, the parse node metadata replaces the another name of node table with the temporary table table name, and XM.The output result of last node is exactly the externally data source of output of whole flow process.
Extendability:
According to top analysis, can expand from two aspects:
1. expand new node type
If there is new node type need join flow process, the present invention can support easily, and the information of the following aspect of new node type only need be provided:
The definition of node type;
The querying condition definition;
The result is listed as definition;
Resolve execution algorithm.
2. expand the flow process that has existed
If solve the complex data source based on technical scheme of the present invention, after development of information system finished, the developer had preset the lot of data source and has obtained flow process.The user of infosystem expands existing flow process if desired, and it is just passable only need to increase a node in last node back of flow process.
For example, order in the previous examples is assigned the flow process of production, after the user uses, find to need to increase the dimension of product, specifications and models, brand, unit weight as product, it is just passable only need to increase a node on stream, and amended flow process has promptly increased step 310 on the flow process as shown in figure 28.
By above technical scheme, can realize a kind of data processing method and a kind of data processing equipment, be characterized in:
1. support user's design data to obtain flow process, obtain data step by step, data can be prepared by each module and system in the step of oneself like this, then by flow process the data integration of each step together;
2. the complex data source is divided into a plurality of step process, thereby has simplified the data processing algorithm of each step, allow the own deal with data of user become possibility.
3. flow process is easy to expansion, so just can handle the data with existing source by increasing step again.
The above is the preferred embodiments of the present invention only, is not limited to the present invention, and for a person skilled in the art, the present invention can have various changes and variation.Within the spirit and principles in the present invention all, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. a data processing equipment is characterized in that, comprising:
The node administration module is created one or more nodes, and each node is used for carrying out the operation of operation flow corresponding service;
Flow executing modules by described one or more nodes, is carried out all business operations in the described operation flow, obtains the output data of described operation flow.
2. data processing equipment according to claim 1 is characterized in that, also comprises:
Order is carried out control flow management module, creates one or more orders and carries out control stream, and wherein, each is carried out control stream in proper order and connects two predetermined nodes, and determines the execution sequence of described predetermined two nodes.
3. data processing equipment according to claim 1 is characterized in that, also comprises:
Operation result transmission control flow management module is created one or more operation result transmission control streams, and wherein, each operation result transmission control stream is with the output data of the destined node data source as another destined node.
4. data processing equipment according to claim 1 is characterized in that, described each node is provided with attribute, and described node administration module is provided with the attribute of described each node according to described business operation, to finish the establishment of described each node.
5. according to each described data processing equipment in the claim 1 to 4, it is characterized in that described node types comprises:
Script node is realized described business operation by the Structured Query Language (SQL) statement that execution sets in advance;
The storing process node is realized described business operation by the database store process that execution sets in advance;
The entity node is by obtaining the solid data that presets to realize described business operation;
Program node, by the program code that sets in advance to realize described business operation;
Combined joint by the combination operation in the database, is realized described business operation;
Connected node by the attended operation in the database, is realized described business operation.
6. a data processing method is characterized in that, comprising:
Step 102 is created one or more nodes, and each node is used for carrying out the operation of operation flow corresponding service;
Step 104 by described one or more nodes, is carried out all business operations in the described operation flow, obtains the output data of described operation flow.
7. data processing method according to claim 6 is characterized in that, after described step 102, before the described step 104, also comprises:
Create one or more orders and carry out control stream, each is carried out control stream in proper order and connects two predetermined nodes, and determines the execution sequence of described predetermined two nodes.
8. data processing method according to claim 6 is characterized in that, after described step 102, before the described step 104, also comprises:
Create one or more operation result transmission control stream, wherein, each operation result transmission control stream is with the output data of the destined node data source as another destined node.
9. data processing method according to claim 6 is characterized in that, described each node is provided with attribute,
In described step 102, according to described business operation, the attribute of described each node is set, to finish the establishment of described each node.
10. according to each described data processing method in the claim 6 to 9, it is characterized in that described node types comprises:
Script node is realized described business operation by the Structured Query Language (SQL) statement that execution sets in advance;
The storing process node is realized described business operation by the database store process that execution sets in advance;
The entity node is by obtaining the solid data that presets to realize described business operation;
Program node, by the program code that sets in advance to realize described business operation;
Combined joint by the combination operation in the database, is realized described business operation;
Connected node by the attended operation in the database, is realized described business operation.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 201110177665 CN102222110A (en) | 2011-06-28 | 2011-06-28 | Data processing device and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 201110177665 CN102222110A (en) | 2011-06-28 | 2011-06-28 | Data processing device and method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN102222110A true CN102222110A (en) | 2011-10-19 |
Family
ID=44778662
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 201110177665 Pending CN102222110A (en) | 2011-06-28 | 2011-06-28 | Data processing device and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN102222110A (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103176896A (en) * | 2011-12-23 | 2013-06-26 | 阿里巴巴集团控股有限公司 | Generating method and generating device of test cases |
CN106777076A (en) * | 2016-12-13 | 2017-05-31 | 广东金赋科技股份有限公司 | A kind of SQL limits inquiry clause generation method and combinational logic filter |
CN109508242A (en) * | 2017-09-14 | 2019-03-22 | 河南理工大学 | Geoscience Multiple Source Sensor data software pipeline stream process technology |
CN109616213A (en) * | 2018-11-14 | 2019-04-12 | 金色熊猫有限公司 | Data processing method and device, storage medium and electronic equipment |
CN110019207A (en) * | 2017-11-02 | 2019-07-16 | 阿里巴巴集团控股有限公司 | Data processing method and device and script display methods and device |
CN110413605A (en) * | 2018-04-26 | 2019-11-05 | 中移(苏州)软件技术有限公司 | A kind of method and apparatus of data visualization |
CN110632878A (en) * | 2019-10-08 | 2019-12-31 | 上海宝阶智能科技有限公司 | Method and device for heterogeneous embedded tabular processing and action flow execution |
CN111049916A (en) * | 2019-12-18 | 2020-04-21 | 腾讯云计算(北京)有限责任公司 | Control method, control device, proxy server and storage medium |
CN111435938A (en) * | 2019-01-14 | 2020-07-21 | 阿里巴巴集团控股有限公司 | Data request processing method, device and equipment |
CN112328216A (en) * | 2020-11-03 | 2021-02-05 | 成都中科大旗软件股份有限公司 | Method, system, computer device and storage medium for developing data based on canvas nodes |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6904448B2 (en) * | 2001-12-20 | 2005-06-07 | International Business Machines Corporation | Dynamic quorum adjustment |
CN101216906A (en) * | 2007-12-29 | 2008-07-09 | 中国建设银行股份有限公司 | A flow control method and a flow engine |
CN101256492A (en) * | 2008-03-31 | 2008-09-03 | 宋乃辉 | Software development method and system for executing model drive structure |
-
2011
- 2011-06-28 CN CN 201110177665 patent/CN102222110A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6904448B2 (en) * | 2001-12-20 | 2005-06-07 | International Business Machines Corporation | Dynamic quorum adjustment |
CN101216906A (en) * | 2007-12-29 | 2008-07-09 | 中国建设银行股份有限公司 | A flow control method and a flow engine |
CN101256492A (en) * | 2008-03-31 | 2008-09-03 | 宋乃辉 | Software development method and system for executing model drive structure |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103176896B (en) * | 2011-12-23 | 2015-08-26 | 阿里巴巴集团控股有限公司 | A kind of generation method of test case and device |
CN103176896A (en) * | 2011-12-23 | 2013-06-26 | 阿里巴巴集团控股有限公司 | Generating method and generating device of test cases |
CN106777076B (en) * | 2016-12-13 | 2020-05-05 | 广东金赋科技股份有限公司 | SQL limited query clause generation method and combinational logic filter |
CN106777076A (en) * | 2016-12-13 | 2017-05-31 | 广东金赋科技股份有限公司 | A kind of SQL limits inquiry clause generation method and combinational logic filter |
CN109508242A (en) * | 2017-09-14 | 2019-03-22 | 河南理工大学 | Geoscience Multiple Source Sensor data software pipeline stream process technology |
CN109508242B (en) * | 2017-09-14 | 2023-07-25 | 河南理工大学 | Geoscience multisource sensor data software pipeline flow processing technology |
CN110019207A (en) * | 2017-11-02 | 2019-07-16 | 阿里巴巴集团控股有限公司 | Data processing method and device and script display methods and device |
CN110019207B (en) * | 2017-11-02 | 2023-07-21 | 阿里巴巴集团控股有限公司 | Data processing method and device and script display method and device |
CN110413605A (en) * | 2018-04-26 | 2019-11-05 | 中移(苏州)软件技术有限公司 | A kind of method and apparatus of data visualization |
CN109616213A (en) * | 2018-11-14 | 2019-04-12 | 金色熊猫有限公司 | Data processing method and device, storage medium and electronic equipment |
CN111435938A (en) * | 2019-01-14 | 2020-07-21 | 阿里巴巴集团控股有限公司 | Data request processing method, device and equipment |
CN110632878A (en) * | 2019-10-08 | 2019-12-31 | 上海宝阶智能科技有限公司 | Method and device for heterogeneous embedded tabular processing and action flow execution |
CN111049916A (en) * | 2019-12-18 | 2020-04-21 | 腾讯云计算(北京)有限责任公司 | Control method, control device, proxy server and storage medium |
CN112328216A (en) * | 2020-11-03 | 2021-02-05 | 成都中科大旗软件股份有限公司 | Method, system, computer device and storage medium for developing data based on canvas nodes |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN102222110A (en) | Data processing device and method | |
Ceri et al. | Web Modeling Language (WebML): a modeling language for designing Web sites | |
CN105849726B (en) | For efficiently supporting the general index of the extemporaneous inquiry by demixing marking data | |
US7668860B2 (en) | Apparatus and method for constructing and using a semantic abstraction for querying hierarchical data | |
CN102693310B (en) | A kind of resource description framework querying method based on relational database and system | |
CN100520716C (en) | Code automatically generating device based on model component, system and method | |
US10579678B2 (en) | Dynamic hierarchy generation based on graph data | |
CN107111639B (en) | Building reports | |
EP1482432A2 (en) | System and method of modelling of a multi-dimensional data source in an entity-relationship model | |
JP5147952B2 (en) | System model conversion method, computer program, and system model conversion apparatus | |
CN102609402B (en) | Device and method for generation and management of ontology model based on real-time strategy | |
US20120317096A1 (en) | Relational Query Planning for Non-Relational Data Sources | |
US20170193036A1 (en) | Framework for joining datasets | |
US20150331928A1 (en) | User-created members positioning for olap databases | |
CN111078094B (en) | Distributed machine learning visualization device | |
CN103246704A (en) | Mapping method for describing entity and relational data based on conventional data structure | |
CN101408909B (en) | Method for describing product information model | |
CN107729396A (en) | Data Dynamic Query method and device | |
CN104317936A (en) | ROLAP (relational on-line analysis processing) analysis engine design method and device on basis of star models | |
US20230350899A1 (en) | Query engine for recursive searches in a self-describing data system | |
CN113535177A (en) | Form generation method, device and equipment | |
KR100899616B1 (en) | Method and system of management metadata using relational database management system | |
US9471640B2 (en) | Automatic conversion of units of measure during data stream processing | |
CN113342325A (en) | Visual modeling method, system, electronic device and storage medium | |
JP5196924B2 (en) | Database processing apparatus, method and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C12 | Rejection of a patent application after its publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20111019 |