CN110399089A - Date storage method, device, equipment and medium - Google Patents

Date storage method, device, equipment and medium Download PDF

Info

Publication number
CN110399089A
CN110399089A CN201810355324.5A CN201810355324A CN110399089A CN 110399089 A CN110399089 A CN 110399089A CN 201810355324 A CN201810355324 A CN 201810355324A CN 110399089 A CN110399089 A CN 110399089A
Authority
CN
China
Prior art keywords
data processing
persistent storage
attribute information
data
storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810355324.5A
Other languages
Chinese (zh)
Other versions
CN110399089B (en
Inventor
高海军
彭自然
沈华品
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201810355324.5A priority Critical patent/CN110399089B/en
Publication of CN110399089A publication Critical patent/CN110399089A/en
Application granted granted Critical
Publication of CN110399089B publication Critical patent/CN110399089B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/445—Program loading or initiating
    • G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/448—Execution paradigms, e.g. implementations of programming paradigms
    • G06F9/4488—Object-oriented
    • G06F9/4493—Object persistence

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the present application discloses a kind of date storage method and device.The described method includes: obtaining the attribute information of data processing node, persistent storage rule is determined according to attribute information later, again based on persistent storage rule, persistent storage is carried out to the result data of data processing node, realize the mechanism that persistent storage can change because the attribute information of data processing node changes, allow flow engine to provide flexible and changeable persistent storage rule, improves the persistent storage of flow engine for the adaptability of the service product of various complexity.

Description

Date storage method, device, equipment and medium
Technical field
This application involves technical field of data processing, and in particular to a kind of date storage method, a kind of data storage device, A kind of computer equipment, a kind of computer readable storage medium.
Background technique
With information-based development, people handle work and are increasingly dependent on computer, are worked using computer disposal Various data.Work has a process, and process is made of the node of multiple processing data, handles on each node each From data processing task.During executing a process, need to change between different nodes, usually by process The operation of state and user that engine is presently according to process determines which node is process should change to, that is, stream Journey engine controls the traffic control of interdependent node.
The a part of flow engine as application system, and be provided determinative to each application system according to angle Color, the division of labor and the different of condition determine the Core Solutions such as information transmitting routing, content rating.Flow engine includes process Node administration, flow direction management etc. critical functions.
The persistence of the result of node processing data is the essential component part of flow engine, so-called " lasting Change " it is with respect to for " non-persistentization ", for the data in caching, the data in memory are exactly persistence, relatively For data in memory, the data in hard disk are exactly persistence, that is to say, that the data of persistence are than non-persistentization Data are more non-volatile.
Applicant it has been investigated that, a large amount of complexity internet product requires process for using engine as core business Driving, but traditional process engine can not provide flexile persistence mode, it is each to meet various complex product brings Kind persistence demand can not adapt to complicated demand in short, the persistence mode that traditional flow engine is supported is single.
Summary of the invention
In view of the above problems, it proposes on the application overcomes the above problem or at least be partially solved in order to provide one kind State the date storage method of problem, data storage device and computer equipment, computer readable storage medium.
According to the one aspect of the application, a kind of date storage method is provided, comprising:
Obtain the attribute information of data processing node；
Persistent storage rule is determined according to the attribute information；
Based on the persistent storage rule, persistent storage is carried out to the result data of the data processing node.
Optionally, the persistent storage rule includes serializing storage or normal form storage.
Optionally, the attribute information include belonging to the process concurrency number of flow chart of data processing, node number and described At least one of task number of concurrent of data processing node.
Optionally, described to determine that persistent storage rule includes: according to the attribute information
According to the numberical range of the attribute information, persistent storage rule is determined.
Optionally, the numberical range according to the attribute information determines that persistent storage rule includes:
If the attribute information exceeds corresponding setting numberical range, it is determined that the persistent storage rule includes sequence Change storage；
If the attribute information is without departing from corresponding setting numberical range, it is determined that the persistent storage rule includes model Formula storage.
Optionally, the attribute information includes the task type of the data processing node, data type, in node identification It is at least one；
It is described to determine that persistent storage rule includes: according to the attribute information
It whether include that setting attribute information determines persistent storage rule according to the attribute information.
Optionally, the attribute information includes at least one of historical status information and current attribute information；
When the attribute information includes historical status information, the attribute information for obtaining data processing node includes:
The historical record that process executes is obtained, is believed according to the historical status that the history statistic handles node Breath.
Optionally, the method also includes:
The persistent storage rule is added to the configuration file of flow chart of data processing, for the data processing section When the result data of point carries out persistent storage, the persistent storage rule is read from the configuration file.
Optionally, the method also includes:
The storage container of persistent storage is determined according to the attribute information of the data processing node.
Optionally, the attribute information according to the data processing node determines the storage container packet of persistent storage It includes:
Obtain the life cycle of the affiliated flow chart of data processing of the data processing node；
The storage container for being suitable for the life cycle is chosen, the storage container includes caching, memory, hard disk or outer It deposits.
Optionally, the method also includes:
The document form of persistent storage is determined according to the attribute information of the data processing node.
Optionally, the attribute information according to the data processing node determines the document form packet of persistent storage It includes:
Whether detect in the data processing task of the data processing node includes data base call；
If including data base call, it is determined that the document form of persistent storage includes database；
If not including data base call, it is determined that the document form of persistent storage includes data file.
Optionally, described based on the persistent storage rule, the result data of the data processing node is held Longization stores
The corresponding feature card of the persistent storage rule is called, the result data of the data processing node is carried out Persistent storage.
Optionally, the serializing, which stores, includes:
The result data of the data processing node is obtained, and reads a variety of subdatas from the result data；
The character string for setting format is converted to after sequentially combining a variety of subdatas.
Optionally, the serializing storage further include:
Serialization version mark is added in the character string being converted to.
Optionally, the result data of the data processing node is carried out based on the persistent storage rule described Before persistent storage, the method also includes:
The flow chart of data processing is driven to current data processing according to the result data of a upper data processing node and is saved Point；
Execute the corresponding data processing task of current data processing node.
Correspondingly, present invention also provides a kind of data storage devices, comprising:
Data obtaining module, for obtaining the attribute information of data processing node；
Regular determining module, for determining persistent storage rule according to the attribute information；
Persistent storage module, for regular based on the persistent storage, to the number of results of the data processing node According to progress persistent storage.
Optionally, the persistent storage rule includes serializing storage or normal form storage.
Optionally, the attribute information include belonging to the process concurrency number of flow chart of data processing, node number and described At least one of task number of concurrent of data processing node.
Optionally, the regular determining module includes:
First rule determines submodule, for the numberical range according to the attribute information, determines persistent storage rule.
Optionally, first rule determines that submodule includes:
Serializing storage determination unit, if exceeding corresponding setting numberical range for the attribute information, it is determined that institute Stating persistent storage rule includes serializing storage；
Normal form stores determination unit, if for the attribute information without departing from corresponding setting numberical range, it is determined that institute Stating persistent storage rule includes normal form storage.
Optionally, the attribute information includes the task type of the data processing node, data type, in node identification It is at least one；
It is described rule determining module include:
Whether Second Rule determines submodule, for including that setting attribute information determines persistence according to the attribute information Storage rule.
Optionally, the attribute information includes at least one of historical status information and current attribute information；
When the attribute information includes historical status information, the data obtaining module includes:
Acquisition of information submodule, for obtaining the historical record of process execution, at the history statistic Manage the historical status information of node.
Optionally, described device further include:
File adding module, for the persistent storage rule to be added to the configuration file of flow chart of data processing, with When carrying out persistent storage for the result data to the data processing node, the persistence is read from the configuration file Storage rule.
Optionally, described device further include:
Container determining module, for determining that the storage of persistent storage is held according to the attribute information of the data processing node Device.
Optionally, the container determining module includes:
Period acquisition submodule, for obtaining the life cycle of the affiliated flow chart of data processing of the data processing node；
Storage container chooses submodule, for choosing the storage container for being suitable for the life cycle, the storage container Including caching, memory, hard disk or external memory.
Optionally, described device further include:
Document form determining module, for determining the text of persistent storage according to the attribute information of the data processing node Part form.
Optionally, the document form determining module includes:
Detection sub-module is called, whether includes database in the data processing task for detecting the data processing node It calls；
Database determines submodule, if for including data base call, it is determined that the document form of persistent storage includes Database；
Data file determines submodule, if for not including data base call, it is determined that the document form of persistent storage Including data file.
Optionally, the persistent storage module includes:
Plug-in unit calls submodule, for calling the corresponding feature card of the persistent storage rule, at the data The result data for managing node carries out persistent storage.
Optionally, the persistent storage module includes:
Subdata reading submodule, for obtaining the result data of the data processing node, and from the result data It is middle to read a variety of subdatas；
Character string transform subblock, for sequentially combining the character string for being converted to setting format after a variety of subdatas.
Optionally, the persistent storage module further include:
Mark addition submodule, for adding serialization version mark in the character string being converted to.
Optionally, described device further include:
Flow driving module, for being based on the persistent storage rule described, to the knot of the data processing node Before fruit data carry out persistent storage, the flow chart of data processing is driven according to the result data of a upper data processing node Node is handled to current data；
Task execution module is handled, for executing the corresponding data processing task of current data processing node.
Correspondingly, present invention also provides a kind of computer equipments, including memory, processor and storage are on a memory And the computer program that can be run on a processor, which is characterized in that the processor is realized when executing the computer program Such as the method for above-mentioned one or more.
Correspondingly, present invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, special Sign is, the method such as above-mentioned one or more is realized when which is executed by processor.
According to the embodiment of the present application, by obtaining the attribute information of data processing node, determined later according to attribute information Persistent storage rule, then based on persistent storage rule, persistent storage is carried out to the result data of data processing node, it is real The mechanism that persistent storage can change because the attribute information of data processing node changes is showed, flow engine is provided Flexible and changeable persistent storage rule improves the persistent storage of flow engine and the service product of various complexity is fitted Ying Xing.
Further, the storage container and file shape of persistent storage are determined according to the attribute information of data processing node Formula realizes the mechanism that storage container and document form change by the variation of the attribute information of data processing node, so that process Engine can be directed to different data processing nodes, improve flow engine and carry out selection for storage container and document form Flexibility.
It further, can be from configuration file when carrying out persistent storage by the result data to data processing node Read persistent storage rule.Configuration file can be met certainly by business root according to the customized modification of self-demand with customizing out The persistent storage rule of body demand, improves flexibility and the configurability of persistent storage.
Above description is only the general introduction of technical scheme, in order to better understand the technological means of the application, And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects, features and advantages of the application can It is clearer and more comprehensible, below the special specific embodiment for lifting the application.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the application Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows a kind of schematic diagram of data persistence storing process；
Fig. 2 shows the flow charts according to a kind of date storage method embodiment of the embodiment of the present application one；
Fig. 3 shows a kind of flow chart of date storage method embodiment according to the embodiment of the present application two；
Fig. 4 shows a kind of flow chart of date storage method embodiment according to the embodiment of the present application three；
Fig. 5 shows the configuration diagram of flow engine；
Fig. 6 shows the schematic diagram of flow chart of data processing；
Fig. 7 shows a kind of block diagram of data storage device embodiment according to the embodiment of the present application four；
Fig. 8 shows the exemplary system that can be used for realizing each embodiment described in the disclosure.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure It is fully disclosed to those skilled in the art.
To make those skilled in the art more fully understand the application, below to this application involves concept be illustrated:
Flow chart of data processing includes a series of data processing nodes for being mutually linked, carrying out automatically, can use computer, Document, information or task are transmitted automatically according to certain scheduled program.A process for example, employee asks for leave, employee need to ask Fictitious time needs to submit an application of asking for leave in enterprise management platform, and application of asking for leave occurs in the start node of process of asking for leave, stream Journey engine obtains the data such as " origin of an incident of asking for leave " of start node, " number of days of asking for leave ", " copending ", is driven process according to these data Move corresponding node, may include the process of Liang Ge branch: if number of days of asking for leave is more than 3 days, next node is department's warp Approval node is managed, if number of days of asking for leave was no more than 3 days, next node is group leader's approval node, whichever branch will wait To line manager or group leader examine as a result, flow engine according to line manager's approval node or the data of group leader's approval node, By Flow driving to end node, sends mail notification employee and ask for leave the approval results of application.It can specifically include any suitable Flow chart of data processing, the embodiment of the present application is without limitation.
Data processing node can obtain result data, usual data processing according to some input datas after treatment The input data of node comes from a upper data processing node, and result data can pass to next data processing section Point.For example, asking for leave in process in employee, the input data of line manager's approval node is from the result data of start node (data such as " origin of an incident of asking for leave ", " number of days of asking for leave ", " copending "), after line manager inputs approval results, result data includes " origin of an incident of asking for leave ", " number of days of asking for leave ", " examination & approval pass through/do not pass through " etc..It can specifically include any suitable data processing node And its result data, the embodiment of the present application are without limitation.
Correspondingly, being specifically data processing task to the processing task that data execute in data processing node.For example, " portion Gate manager examination & approval ", " group leader's examination & approval ", " financial approval ", " money is beaten by bank " etc. or any other applicable data processing are appointed Business, the embodiment of the present application are without limitation.
The attribute information of data processing node may include the process concurrency number of affiliated flow chart of data processing, node number with And task number of concurrent of data processing node etc., it can also include task type, data type, the node mark of data processing node Knowledge etc. or any other applicable attribute information, the embodiment of the present application are without limitation.
In a kind of alternative embodiment of the application, attribute information may include the process concurrency of affiliated flow chart of data processing At least one of number, node number and task number of concurrent of the data processing node.Process concurrency number is for characterizing application The quantity of certain flow chart of data processing run simultaneously in system, for example, employee asks for leave, process is performed simultaneously there may be multiple Flow instance, i.e., the request process of multiple employees.Node number is for characterizing the data for including in certain flow chart of data processing The number for handling node includes " start node ", " line manager's approval node ", " group leader's examination & approval in process for example, employee asks for leave Node " and " end node " totally 4 nodes.Certain number that the task concurrent data of data processing node is used to characterize while run According to the quantity of the task of processing node, for example, employee asks for leave in process, while the line manager run examines the quantity of task.
In a kind of alternative embodiment of the application, attribute information may include the task class of the data processing node At least one of type, data type, node identification.Task type is used to characterize the type of performed task, for example, inquiry is appointed Business, list generate task dispatching type.Data type is used to characterize the type for the data that performed task is related to, for example, asking for leave " number of days of asking for leave " in process etc. belongs to the data for type of asking for leave, and submits an expense account the number for belonging to reimbursement type in process " reimbursed sum " etc. According to.Node identification handles node for unique mark data, for example, for unique sequence of each data processing node distribution Number.
The result data of data processing node is applied not only to by Flow driving to next corresponding data processing node, also The node currently run to for recording process, therefore need to store result data, namely carry out persistently result data Change storage.
Persistent storage is a relative concept, and for the data in caching, the data in memory are exactly lasting Change, for the data in memory, the data in hard disk are exactly persistence, that is to say, that the data ratio of persistence The data of non-persistentization are more non-volatile.
For different data processing nodes, flow chart of data processing, can by the way of different persistent storages, with Meet the demand and ever-increasing complexity of different software operations.Correspondingly, it is held using persistent storage rule to control Longization storage, persistent storage rule include serializing storage, normal form storage etc. or any other applicable rule, this Shen Please embodiment it is without limitation.
In a kind of alternative embodiment of the application, persistent storage rule may include that serializing storage or normal form are deposited Storage.Wherein, serializing storage can be by orderly format or byte sequence storage result data, for example, will according to agreement Result data is converted into character string, and storage character string is for indicating result data.For different flow chart of data processing Customized serializing agreement can be designed, to meet the needs of various flow chart of data processing or data processing node, specifically may be used To include any suitable mode by result data serializing storage, the embodiment of the present application is without limitation.Serializing is deposited Storage can reduce redundant data storage, save memory space, reduce the data volume transmitted when data transmission, improve data transfer effect Rate.
Wherein, persistent storage of the normal form storage including the use of normal form (database Normal Formula) table, storage result data When need multiple matched normal form tables to establish the relationship between data, for example, RDBMS (Relational Database Management System, relational database management system) matched 10 or so normal form tables are usually had as bottom Persistence mechanism establishes normal form table for the relationship between all data in the result data of data processing node, according to normal form Result data is carried out persistent storage by table.It can specifically include any suitable mode to store result data normal form, this Apply for that embodiment is without limitation.Normal form storage remains the direct relation between data, is conducive to inquire data, The inquiry velocity of data can be improved.
In a kind of alternative embodiment of the application, storage container may include caching, memory, hard disk or external memory etc., or Any other applicable container of person, the embodiment of the present application are without limitation.
In a kind of alternative embodiment of the application, document form may include database, data file etc. or other Any suitable form, the embodiment of the present application are without limitation.Wherein, database is to come tissue, storage according to data result Warehouse of the foundation on computer memory device with management data, for example, (Not Only SQL, refers to non-relational to NoSQL Database), RDBMS etc..Data file includes XML (eXtensible Markup Language, extensible markup language) Non-databases document form or any other applicable files such as file, TXT (text) file, the embodiment of the present application is to this With no restrictions.
In a kind of alternative embodiment of the application, what persistent storage rule can be realized by feature card, process Engine can be by calling feature card corresponding with persistent storage rule, to realize that the persistence to result data is deposited Storage.For example, serializing storage can correspond to and be written as a feature card, normal form storage can correspond to that be written as a function slotting Part is stored in mechanical hard disk and can correspond to and writes a feature card, is stored in solid state hard disk and can correspond to and writes a function Plug-in unit is stored in memory and can correspond to and writes feature card etc. or any other applicable feature card, and the application is real It is without limitation to apply example.Due to mutually indepedent between feature card, so that various persistent storage rules have easily modification, spirit The features such as living changeable, maintainable strong.
According to one embodiment of the application, flow engine is essential to need to carry out persistent storage to data.This Application provides a kind of data storage scheme, the schematic diagram of data persistence storing process as shown in Figure 1, and the process can be with It applies on the flow engine of application system, the attribute information of the available data processing node of flow engine, later according to category Property information determine persistent storage rule, then based on persistent storage rule, the result data of data processing node is held Longization storage realizes the mechanism that persistent storage can change because the attribute information of data processing node changes, so that process Engine can provide flexible and changeable persistent storage rule, improve the persistent storage of flow engine for various complexity The adaptability of service product.The application is applicable in but is not limited to above-mentioned application scenarios.
Referring to Fig. 2, a kind of flow chart of date storage method embodiment according to the embodiment of the present application one, the party are shown Method can specifically include following steps:
Step 101, the attribute information of data processing node is obtained.
In the embodiment of the present application, the available a variety of attribute informations of flow engine, for attribute information not of the same race, tool Body may include that attribute information is obtained before process flow operation to data processing node, further include in process flow operation to data processing Attribute information is obtained after node or any other applicable mode, the embodiment of the present application are without limitation.
For example, obtaining the historical record for process of asking for leave first in the example for asking for leave process, then counting process of asking for leave Process concurrency number, the task of the node number and each data processing node wherein included that include in process of asking for leave it is concurrent The attribute informations such as number.In another example, for " line manager's approval node ", obtaining the data processing in the example for asking for leave process The task type of node is examination & approval task, data type is the node identification of related data, " line manager's approval node " of asking for leave Equal attribute informations.
Step 102, persistent storage rule is determined according to the attribute information.
In the embodiment of the present application, persistent storage rule can be determined according to one or more attribute informations, for holding The variation of longization storage rule, different attribute informations play different effects, for example, process concurrency number is higher, reach certain After threshold value, whether persistent storage rule is just related to query type using serializing storage mode or data processing node Task uses normal form storage mode if being related to query type of the task.
Whether persistent storage rule can be determined by the numberical range of attribute information, can also include setting by attribute information Determine attribute information determination or any other applicable mode determines that the embodiment of the present application is without limitation.
For example, asking for leave in process in employee, if the quantity of the process of asking for leave run simultaneously has the feelings more than given threshold Condition, then using the persistent storage rule of serializing storage in process of asking for leave.In another example ask for leave in process in employee, " department Query task, the then persistent storage that can be stored using normal form are regular if it exists in manager's approval node ".
In the embodiment of the present application, persistent storage rule is determined for data processing node, at a data It manages in process, each data processing node can also be directed to each data processing section using a kind of persistent storage rule Point determines respective persistent storage rule respectively.
Step 103, based on the persistent storage rule, persistence is carried out to the result data of the data processing node Storage.
In the embodiment of the present application, after data processing node operation, result data is obtained, flow engine obtains result data Afterwards, the persistent storage rule based on the data processing node, carries out persistent storage to result data.For example, to number of results After being serialized, the data of serializing are stored into the database of hard disk.
In one implementation, persistent storage rule can specifically be realized by feature card, when flow engine will Flow chart of data processing drives to data processing node, and after obtaining result data, calls the function of realizing persistent storage rule Plug-in unit completes the persistent storage to result data.It specifically can also include any other applicable implementation, the application is real It is without limitation to apply example.
According to the embodiment of the present application, by obtaining the attribute information of data processing node, determined later according to attribute information Persistent storage rule, then based on persistent storage rule, persistent storage is carried out to the result data of data processing node, it is real The mechanism that persistent storage can change because the attribute information of data processing node changes is showed, flow engine is provided Flexible and changeable persistent storage rule improves the persistent storage of flow engine and the service product of various complexity is fitted Ying Xing.
In a kind of alternative embodiment of the application, attribute information may include the task type of data processing node, number It is corresponding according at least one of type, node identification, a kind of realization of persistent storage rule is determined according to the attribute information Whether it includes that setting attribute information determines persistent storage rule that mode may include: according to the attribute information.
Setting attribute information be it is pre-set, can also by change configuration modify, including setting task type, Data type, setting node identification etc. are set, for example, setting task type includes query task, executes list generation task dispatching. The corresponding relationship that attribute information there can be setting with persistent storage rule is set, for example, attribute information includes setting attribute Information, it is determined that the persistent storage rule or attribute information of normal form storage do not include setting attribute information, it is determined that sequence The persistent storage rule or any other applicable mode for changing storage determine persistent storage rule, the embodiment of the present application It is without limitation.
It, can also be according to the process concurrency number of flow chart of data processing, node number and the number in a kind of implementation Task type, data type, the node identification of the attribute informations such as the task number of concurrent according to processing node and data processing node Equal attribute informations, it is common to determine persistent storage rule.For example, asking for leave in process in employee, if the process concurrency for process of asking for leave Number is more than 100 per second, and task type does not include query task, it is determined that persistent storage rule is using serializing storage. In another example ask for leave in process in employee, if " line manager's approval node " includes that list generates task, and process packet of entirely asking for leave The node number contained is no more than 10, it is determined that persistent storage rule is stored using normal form, can specifically include any suitable Mode, the embodiment of the present application is without limitation.
In a kind of alternative embodiment of the application, attribute information may include historical status information and current attribute information At least one of, when the attribute information includes historical status information, the attribute information for obtaining data processing node A kind of implementation may include: the historical record of acquisition process execution, handle node according to the history statistic Historical status information.
The attribute information for the data processing node that flow engine is currently running is denoted as current attribute information, will transport The attribute information obtained before row data processing node, is denoted as historical status information.The attribute information that flow engine obtains can be with Including at least one of current attribute information and historical status information.When attribute information includes historical status information, first data Process flow executes the historical record generated, for example, ask for leave in process in employee, historical record includes every day in 1 year in the past In the quantity of the process of asking for leave of execution, further according to this historical record, the quantity of the process of asking for leave averagely executed daily is counted, Or the odd-numbered day asks for leave the peak etc. of the quantity of process, i.e. historical status information.
Referring to Fig. 3, a kind of flow chart of date storage method embodiment according to the embodiment of the present application two, the party are shown Method can specifically include following steps:
Step 201, the attribute information of data processing node is obtained.
In the embodiment of the present application, the specific implementation of this step may refer to the description in previous embodiment, herein It does not repeat separately.
Step 202, according to the numberical range of the attribute information, persistent storage rule is determined.
In the embodiment of the present application, when being numerical value for attribute information, can according to the numberical range locating for attribute information, Determine persistent storage rule.In general, process concurrency number is higher, and serializing is more necessary to adopt to store, at a data It is more to manage node number present in process, serializing is more necessary to adopt to store, the task number of concurrent of data processing node is got over Height is more necessary to adopt serializing to store.
When specific implementation, data area is preset for different attribute informations, the numberical range of setting can basis Actual conditions are adjusted, and when attribute information falls into the numberical range of setting, are determined as corresponding to the numberical range fallen into Persistent storage rule.
In a kind of alternative embodiment of the application, according to the numberical range of the attribute information, persistent storage is determined If a kind of implementation of rule may include: the attribute information beyond corresponding setting numberical range, it is determined that described to hold Longization storage rule includes serializing storage, if the attribute information is without departing from corresponding setting numberical range, it is determined that described Persistent storage rule includes normal form storage.
For example, process concurrency number is more than 100 per second, it is determined that it is stored for serializing, if being less than 100 per second, It is determined as normal form storage.
Attribute information include it is a variety of, then every attribute information can be respectively arranged with corresponding numberical range, determination hold When longization storage rule, the numberical range that can integrate a variety of attribute informations is determined.It, can be for not in a kind of implementation Same attribute information sets up priority, i.e., the high attribute information of priority exceeds corresponding setting numberical range, but priority is low Attribute information without departing from corresponding setting numberical range, priority of being subject to is high, determines the persistent storage rule packet Include serializing storage.In another implementation, it may also require that all properties information without departing from corresponding setting numerical value Range, it is determined that the persistent storage rule includes normal form storage, otherwise determines serializing storage.It specifically can be using any Applicable mode determines that persistent storage rule, the embodiment of the present application are without limitation.
Step 203, the storage container of persistent storage is determined according to the attribute information of the data processing node.
In the embodiment of the present application, attribute information can also determine the storage container of persistent storage, for example, data type It can determine storage container, if data are related datas of asking for leave, can temporarily store, storage container is determined as memory, if Data are reimbursement related datas, then need to store for a long time, storage container is determined as hard disk.It can specifically use any suitable Mode, the embodiment of the present application are without limitation.
It is described to be determined persistently according to the attribute information of the data processing node in a kind of alternative embodiment of the application A kind of implementation for changing the storage container of storage may include: to obtain the affiliated flow chart of data processing of data processing node Life cycle, chooses the storage container for being suitable for the life cycle, and the storage container includes caching, memory, hard disk or outer It deposits.
The life cycle of flow chart of data processing starts to the time span of end from flow chart of data processing, usually same Flow chart of data processing the time it takes be also likely to be present difference, therefore average life period or longest life can be used In period etc., the embodiment of the present application is without limitation.
In general, life cycle is longer, it is meant that data need to save the longer time, and cache volatile with memory etc. The space of property storage medium is limited, and stability is poor, is easily lost data, according to the sequence of life cycle from long to short, Corresponding to hard disk or external memory, memory, the storage containers such as caching choose the storage container for being suitable for life cycle, as persistence The storage container of storage.The flow chart of data processing short for life cycle selects such as caching or content that operation speed can be improved Degree selects such as hard disk or external memory that the stability of data can be improved, avoids counting for the long flow chart of data processing of life cycle It is lost according to because of power-off.
Step 204, the document form of persistent storage is determined according to the attribute information of the data processing node.
In the embodiment of the present application, attribute information can also determine the document form of persistent storage, for example, task type It can determine document form, if data processing node includes query task, document form uses database, if data processing section Point does not include query task, then document form uses data file.Specifically can be by the way of any suitable, the application is implemented Example is without limitation.
In a kind of alternative embodiment of the application, determine that persistence is deposited according to the attribute information of the data processing node Whether a kind of implementation of the document form of storage may include: to wrap in the data processing task for detect the data processing node Data base call is included, if including data base call, it is determined that the document form of persistent storage includes database, if not including number It is called according to library, it is determined that the document form of persistent storage includes data file.
Data processing node may include one or more data processing tasks, in detection data processing task whether include Data base call, if including data base call, it is determined that the document form of persistent storage includes database, in favor of improving The speed of inquiry improves operational efficiency, if not including data base call, it is determined that the document form of persistent storage includes data File saves memory space to reduce storage volume.
When specific implementation, the attribute information of data processing node can determine persistent storage rule, storage container simultaneously And document form.For example, asking for leave in process in employee, attribute information includes the life of process concurrency number, flow chart of data processing Period, the task type etc. for including in data processing node, if process concurrency number, more than 100 per second, life cycle is more than 1 It, and do not include query task in data processing node, then using serializing storage, storage container is determined as hard-disc storage, and It is stored using the document form of data file.
Step 205, the flow chart of data processing is driven to current number according to the result data of a upper data processing node According to processing node.
In the embodiment of the present application, flow engine obtains the result data of a upper data processing node, according to a upper data The result data for handling node, by flow chart of data processing driving to current data processing node.
Step 206, the corresponding data processing task of current data processing node is executed.
In the embodiment of the present application, current data processing node may include one or more data processing tasks, execute Corresponding data processing task obtains the result data of current data processing result.
Step 207, based on the persistent storage rule, persistence is carried out to the result data of the data processing node Storage.
In the embodiment of the present application, the specific implementation of this step may refer to the description in previous embodiment, herein It does not repeat separately.
According to the embodiment of the present application, by obtaining the attribute information of data processing node, according to the numerical value model of attribute information Enclose, determine persistent storage rule, later according to the result data of a upper data processing node by flow chart of data processing drive to Current data handles node, executes the corresponding data processing task of current data processing node, right based on persistent storage rule The result data of data processing node carries out persistent storage, and realizing persistent storage can believe because of the attribute of data processing node The mechanism of breath variation and variation, allows flow engine to provide flexible and changeable persistent storage rule, improves process and draw Adaptability of the persistent storage held up for the service product of various complexity.
Further, the storage container and file shape of persistent storage are determined according to the attribute information of data processing node Formula realizes the mechanism that storage container and document form change by the variation of the attribute information of data processing node, so that process Engine can be directed to different data processing nodes, improve flow engine and carry out selection for storage container and document form Flexibility.
Referring to Fig. 4, a kind of flow chart of date storage method embodiment according to the embodiment of the present application three, the party are shown Method can specifically include following steps:
Step 301, the attribute information of data processing node is obtained.
In the embodiment of the present application, the specific implementation of this step may refer to the description in previous embodiment, herein It does not repeat separately.
Step 302, persistent storage rule is determined according to the attribute information.
In the embodiment of the present application, the specific implementation of this step may refer to the description in previous embodiment, herein It does not repeat separately.
Step 303, the persistent storage rule is added to the configuration file of flow chart of data processing, for the number When carrying out persistent storage according to the result data of processing node, the persistent storage rule is read from the configuration file.
In the embodiment of the present application, configuration file is used to control flow chart of data processing, including to persistent storage Control, persistent storage rule can be specifically added in the configuration file of flow chart of data processing, be can specifically include pair The persistent storage rule of each data processing node in flow chart of data processing.
Specific implementation is, can be from configuration file when carrying out persistent storage to the result data of data processing node Read persistent storage rule.Configuration file can be met certainly by business root according to the customized modification of self-demand with customizing out The persistent storage rule of body demand, improves flexibility and the configurability of persistent storage.
Step 304, the corresponding feature card of the persistent storage rule is called, to the result of the data processing node Data carry out persistent storage.
In the embodiment of the present application, each to have corresponding feature card by oneself to realize different persistent storage rules, it calls The feature card can carry out persistent storage to the result data of data processing node.
It is worth noting that storage container, document form also have a corresponding plug-in unit, when specific implementation, can write respectively One feature card, then calls several feature cards to complete persistent storage, for example, serializing storage can be corresponded to and be write For a feature card, normal form storage, which can correspond to, is written as a feature card, is stored in mechanical hard disk and can correspond to and writes One feature card is stored in solid state hard disk and can correspond to and writes a feature card, is stored as database and can correspond to write One feature card is stored as data file and can correspond to write feature card etc., calling sequence store function plug-in unit, It is stored in solid state hard disk feature card and is stored as database function plug-in unit, carry out persistent storage jointly.Or it can be with Write one include persistent storage rule, storage container and document form feature card, to complete persistent storage, example Such as, serializing storage, be stored in solid state hard disk, be stored as data file and can correspond to write a feature card, serializing is deposited It stores up, be stored in mechanical hard disk, be stored as data file and can correspond to write another feature card.It can specifically include any suitable Feature card, the embodiment of the present application are without limitation.
In a kind of alternative embodiment of the application, a kind of implementation of the serializing storage may include: to obtain The result data of the data processing node, and a variety of subdatas are read from the result data, sequentially combine a variety of subnumbers The character string of setting format is converted to after.It may include a variety of subdatas in result data, for example, asking for leave process in employee In, " number of days of asking for leave " and " origin of an incident of asking for leave " two seed datas.After reading subdata, according to the sequence of setting, a variety of subnumbers are combined According to, be then converted into setting format character string.
In a kind of alternative embodiment of the application, the serializing storage can also include: in the character being converted to Serialization version mark is added in string.
Serialization version mark is for identifying the version of serializing agreement, since serializing agreement can be changed, so adding Serialization version is added to identify, assisted using corresponding serializing for being identified during unserializing according to serialization version View, obtains former result data.
According to the embodiment of the present application, by obtaining the attribute information of data processing node, it is lasting to be determined according to attribute information Change storage rule, persistent storage rule is added to the configuration file of flow chart of data processing, calls persistent storage rule right The feature card answered carries out persistent storage to the result data of data processing node, and realizing persistent storage can be because of data The mechanism for handling the attribute information variation of node and changing, allows flow engine to provide flexible and changeable persistent storage rule Then, the persistent storage of flow engine is improved for the adaptability of the service product of various complexity.
To make those skilled in the art more fully understand the application, below by way of specific example to a kind of reality of the application Existing mode is illustrated.
The configuration diagram of flow engine as shown in Figure 5.
The bottom of flow engine is basis instrument layer, and the responsibility of this layer mainly includes providing XML parsing function and to insert The mode of part loads the behaviors of various flow chart of data processing nodes.
The effect of flow definition analytic sheaf mainly determines parsing phase model and corresponding each solution to model parser.Process is fixed Justice: one complete flow chart of data processing of description is made of several data processing nodes, including the basic of flow chart of data processing The rule to circulate between information, the beginning and end condition of flow chart of data processing, the data processing node of composition, data processing node Then, the information such as task, the application program that can be capable of calling and the process related data of user's execution are needed.
After flow definition has parsed, then the data that parsing obtains are converted to runtime model and are executed, the runtime Between it is corresponding runtime behavior occurs, including the persistent storage to result data.Process virtual machine is multipaths language Basis.The primary support of any process language could set up on process virtual machine.Each movable fortune in flow chart Departure date behavior is delegated to the interface of a java.
Entrance of the flow engine as all services, provide API (Application Programming Interface, Application programming interface).
The schematic diagram of flow chart of data processing as shown in FIG. 6.
Step 1, flow chart of data processing starting or driving are directed to newly generated flow chart of data processing respectively, and are directed to thing First already present flow chart of data processing.
Step 2, parameter configuration, the parameter etc. including current service request.
Step 3, flow definition is searched, is searched according to the parameter of configuration, finds corresponding flow definition.
Step 4, instance objects are created, flow engine is according to current service request parameter and flow definition, creation one A new flow instance object (i.e. flow chart of data processing), or flow chart of data processing is driven to corresponding data processing section Point.
Step 5, link state computation, operation data handle the data processing task in node, obtain result data (i.e. ring Nodular state).
Step 6, storage example state, the i.e. persistent storage of result data, can choose DB storage (database purchase), Perhaps memory storage or customized storage (including serializing storage) etc..
Referring to Fig. 7, a kind of structural block diagram of data storage device embodiment according to the embodiment of the present application four is shown, is had Body may include:
Data obtaining module 401, for obtaining the attribute information of data processing node；
Regular determining module 402, for determining persistent storage rule according to the attribute information；
Persistent storage module 403, for regular based on the persistent storage, to the result of the data processing node Data carry out persistent storage.
In a kind of alternative embodiment of the application, the persistent storage rule includes that serializing storage or normal form are deposited Storage.
In a kind of alternative embodiment of the application, the attribute information includes the process concurrency of affiliated flow chart of data processing At least one of number, node number and task number of concurrent of the data processing node.
In a kind of alternative embodiment of the application, the rule determining module includes:
First rule determines submodule, for the numberical range according to the attribute information, determines persistent storage rule.
In a kind of alternative embodiment of the application, first rule determines that submodule includes:
Serializing storage determination unit, if exceeding corresponding setting numberical range for the attribute information, it is determined that institute Stating persistent storage rule includes serializing storage；
Normal form stores determination unit, if for the attribute information without departing from corresponding setting numberical range, it is determined that institute Stating persistent storage rule includes normal form storage.
In a kind of alternative embodiment of the application, the attribute information includes the task class of the data processing node At least one of type, data type, node identification；
It is described rule determining module include:
Whether Second Rule determines submodule, for including that setting attribute information determines persistence according to the attribute information Storage rule.
In a kind of alternative embodiment of the application, the attribute information includes historical status information and current attribute information At least one of；
When the attribute information includes historical status information, the data obtaining module includes:
Acquisition of information submodule, for obtaining the historical record of process execution, at the history statistic Manage the historical status information of node.
In a kind of alternative embodiment of the application, described device further include:
File adding module, for the persistent storage rule to be added to the configuration file of flow chart of data processing, with When carrying out persistent storage for the result data to the data processing node, the persistence is read from the configuration file Storage rule.
In a kind of alternative embodiment of the application, described device further include:
Container determining module, for determining that the storage of persistent storage is held according to the attribute information of the data processing node Device.
In a kind of alternative embodiment of the application, the container determining module includes:
Period acquisition submodule, for obtaining the life cycle of the affiliated flow chart of data processing of the data processing node；
Storage container chooses submodule, for choosing the storage container for being suitable for the life cycle, the storage container Including caching, memory, hard disk or external memory.
In a kind of alternative embodiment of the application, described device further include:
Document form determining module, for determining the text of persistent storage according to the attribute information of the data processing node Part form.
In a kind of alternative embodiment of the application, the document form determining module includes:
Detection sub-module is called, whether includes database in the data processing task for detecting the data processing node It calls；
Database determines submodule, if for including data base call, it is determined that the document form of persistent storage includes Database；
Data file determines submodule, if for not including data base call, it is determined that the document form of persistent storage Including data file.
In a kind of alternative embodiment of the application, the persistent storage module includes:
Plug-in unit calls submodule, for calling the corresponding feature card of the persistent storage rule, at the data The result data for managing node carries out persistent storage.
In a kind of alternative embodiment of the application, the persistent storage module includes:
Subdata reading submodule, for obtaining the result data of the data processing node, and from the result data It is middle to read a variety of subdatas；
Character string transform subblock, for sequentially combining the character string for being converted to setting format after a variety of subdatas.
In a kind of alternative embodiment of the application, the persistent storage module further include:
Mark addition submodule, for adding serialization version mark in the character string being converted to.
In a kind of alternative embodiment of the application, described device further include:
Flow driving module, for being based on the persistent storage rule described, to the knot of the data processing node Before fruit data carry out persistent storage, the flow chart of data processing is driven according to the result data of a upper data processing node Node is handled to current data；
Task execution module is handled, for executing the corresponding data processing task of current data processing node.
According to the embodiment of the present application, by obtaining the attribute information of data processing node, determined later according to attribute information Persistent storage rule, then based on persistent storage rule, persistent storage is carried out to the result data of data processing node, it is real The mechanism that persistent storage can change because the attribute information of data processing node changes is showed, flow engine is provided Flexible and changeable persistent storage rule improves the persistent storage of flow engine and the service product of various complexity is fitted Ying Xing.
For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple Place illustrates referring to the part of embodiment of the method.
Embodiment of the disclosure can be implemented as using any suitable hardware, firmware, software, or and any combination thereof into The system of the desired configuration of row.Fig. 8, which is schematically shown, can be used for realizing showing for each embodiment described in the disclosure Example property system (or device) 500.
For one embodiment, Fig. 8 shows exemplary system 500, the system have one or more processors 502, It is coupled to the system control module (chipset) 504 of at least one of (one or more) processor 1102, is coupled to The system storage 506 of system control module 504, be coupled to the nonvolatile memory (NVM) of system control module 504/ Storage equipment 508 is coupled to one or more input-output apparatus 510 of system control module 504, and is coupled to The network interface 512 of system control module 506.
Processor 502 may include one or more single or multiple core processors, processor 502 may include general processor or Any combination of application specific processor (such as graphics processor, application processor, Baseband processor etc.).In some embodiments, System 500 can be as the browser described in the embodiment of the present application.
In some embodiments, system 500 may include with instruction one or more computer-readable mediums (for example, System storage 506 or NVM/ store equipment 508) and mutually merge with the one or more computer-readable medium and be configured as Execute instruction the one or more processors 502 to realize module thereby executing movement described in the disclosure.
For one embodiment, system control module 504 may include any suitable interface controller, with to (one or It is multiple) at least one of processor 502 and/or any suitable equipment or component that communicate with system control module 504 mentions For any suitable interface.
System control module 504 may include Memory Controller module, to provide interface to system storage 506.Storage Device controller module can be hardware module, software module and/or firmware module.
System storage 506 can be used for for example, load of system 500 and storing data and/or instruction.For a reality Example is applied, system storage 506 may include any suitable volatile memory, for example, DRAM appropriate.In some embodiments In, system storage 506 may include four Synchronous Dynamic Random Access Memory of Double Data Rate type (DDR4SDRAM).
For one embodiment, system control module 504 may include one or more i/o controllers, with to NVM/ stores equipment 508 and (one or more) input-output apparatus 510 provides interface.
For example, NVM/ storage equipment 508 can be used for storing data and/or instruction.NVM/ stores equipment 1008 Any suitable nonvolatile memory (for example, flash memory) and/or may include that any suitable (one or more) is non-volatile Equipment is stored (for example, one or more hard disk drives (HDD), one or more CD (CD) drivers and/or one or more A digital versatile disc (DVD) driver).
NVM/ storage equipment 508 may include a part for the equipment being physically mounted on as system 500 Storage resource or its can by the equipment access without a part as the equipment.For example, NVM/ storage equipment 508 can It is accessed by network via (one or more) input-output apparatus 1010.
(one or more) input-output apparatus 510 can be provided for system 500 interface with other any equipment appropriate Communication, input-output apparatus 510 may include communication component, audio component, sensor module etc..Network interface 1112 can be System 500 provides interface so that by one or more network communications, system 500 can be according to one or more wireless network standards And/or arbitrary standards in agreement and/or agreement are carried out wireless communication with the one or more components of wireless network, such as are connect Enter the wireless network based on communication standard, such as WiFi, 2G or 3G or their combination are carried out wireless communication.
For one embodiment, at least one of (one or more) processor 502 can be with system control module 504 The logic of one or more controllers (for example, Memory Controller module) is packaged together.For one embodiment, (one Or multiple) at least one of processor 502 can be encapsulated in the logic of one or more controllers of system control module 504 Together to form system in package (SiP).For one embodiment, at least one of (one or more) processor 502 can It is integrated on same mold with the logic of one or more controllers of system control module 504.For one embodiment, (one It is a or multiple) at least one of processor 502 can be integrated with the logic of one or more controllers of system control module 504 To form system on chip (SoC) on same mold.
In various embodiments, system 500 can be, but not limited to be: browser, work station, desk-top calculating equipment or movement It calculates equipment (for example, lap-top computing devices, handheld computing device, tablet computer, net book etc.).In various embodiments, System 500 can have more or fewer components and/or different frameworks.For example, in some embodiments, system 500 includes One or more video cameras, keyboard, liquid crystal display (LCD) screen (including touch screen displays), nonvolatile memory port, Mutiple antennas, graphic chips, specific integrated circuit (ASIC) and loudspeaker.
Wherein, if display includes touch panel, display screen may be implemented as touch screen displays, be used by oneself with receiving The input signal at family.Touch panel includes one or more touch sensors to sense the hand on touch, slide, and touch panel Gesture.The touch sensor can not only sense the boundary of a touch or slide action, but also detect and the touch or sliding Operate relevant duration and pressure.
The embodiment of the present application also provides a kind of non-volatile readable storage medium, be stored in the storage medium one or Multiple modules (programs) when the one or more module is used in terminal device, can make the terminal device execute The instruction (instructions) of various method steps in the embodiment of the present application.
Provide a kind of computer equipment in one example, including memory, processor and storage are on a memory simultaneously The computer program that can be run on a processor, which is characterized in that the processor is realized such as when executing the computer program The method of the embodiment of the present application.
A kind of computer readable storage medium is additionally provided in one example, is stored thereon with computer program, it is special Sign is, one or more methods such as the embodiment of the present application are realized when which is executed by processor.
The embodiment of the present application discloses a kind of date storage method and device, and example 1 includes a kind of date storage method, packet It includes:
Obtain the attribute information of data processing node；
Persistent storage rule is determined according to the attribute information；
Based on the persistent storage rule, persistent storage is carried out to the result data of the data processing node.
Example 2 may include method described in example 1, wherein the persistent storage rule includes serializing storage or model Formula storage.
Example 3 may include method described in example 1 and/or example 2, wherein the attribute information includes at affiliated data Manage at least one of process concurrency number, node number and the task number of concurrent of the data processing node of process.
Example 4 may include method described in 3 one or more of example 1- example, wherein described according to the attribute information Determine that persistent storage rule includes:
According to the numberical range of the attribute information, persistent storage rule is determined.
Example 5 may include method described in 4 one or more of example 1- example, wherein described according to the attribute information Numberical range, determine that persistent storage rule includes:
If the attribute information exceeds corresponding setting numberical range, it is determined that the persistent storage rule includes sequence Change storage；
If the attribute information is without departing from corresponding setting numberical range, it is determined that the persistent storage rule includes model Formula storage.
Example 6 may include method described in 5 one or more of example 1- example, wherein the attribute information includes described At least one of the task type of data processing node, data type, node identification；
It is described to determine that persistent storage rule includes: according to the attribute information
It whether include that setting attribute information determines persistent storage rule according to the attribute information.
Example 7 may include method described in 6 one or more of example 1- example, wherein the attribute information includes history At least one of attribute information and current attribute information；
When the attribute information includes historical status information, the attribute information for obtaining data processing node includes:
The historical record that process executes is obtained, is believed according to the historical status that the history statistic handles node Breath.
Example 8 may include method described in 7 one or more of example 1- example, wherein the method also includes:
The persistent storage rule is added to the configuration file of flow chart of data processing, for the data processing section When the result data of point carries out persistent storage, the persistent storage rule is read from the configuration file.
Example 9 may include method described in 8 one or more of example 1- example, wherein the method also includes:
The storage container of persistent storage is determined according to the attribute information of the data processing node.
Example 10 may include method described in 9 one or more of example 1- example, wherein described according to the data processing The attribute information of node determines that the storage container of persistent storage includes:
Obtain the life cycle of the affiliated flow chart of data processing of the data processing node；
The storage container for being suitable for the life cycle is chosen, the storage container includes caching, memory, hard disk or outer It deposits.
Example 11 may include method described in 10 one or more of example 1- example, wherein the method also includes:
The document form of persistent storage is determined according to the attribute information of the data processing node.
Example 12 may include method described in 11 one or more of example 1- example, wherein it is described according to the data at The attribute information of reason node determines that the document form of persistent storage includes:
Whether detect in the data processing task of the data processing node includes data base call；
If including data base call, it is determined that the document form of persistent storage includes database；
If not including data base call, it is determined that the document form of persistent storage includes data file.
Example 13 may include method described in 12 one or more of example 1- example, wherein described to be based on the persistence Storage rule, carrying out persistent storage to the result data of the data processing node includes:
The corresponding feature card of the persistent storage rule is called, the result data of the data processing node is carried out Persistent storage.
Example 14 may include method described in 13 one or more of example 1- example, wherein the serializing, which stores, includes:
The result data of the data processing node is obtained, and reads a variety of subdatas from the result data；
The character string for setting format is converted to after sequentially combining a variety of subdatas.
Example 15 may include method described in 14 one or more of example 1- example, wherein the serializing storage is also wrapped It includes:
Serialization version mark is added in the character string being converted to.
Example 16 may include method described in 15 one or more of example 1- example, wherein described based on described lasting Change storage rule, before carrying out persistent storage to the result data of the data processing node, the method also includes:
The flow chart of data processing is driven to current data processing according to the result data of a upper data processing node and is saved Point；
Execute the corresponding data processing task of current data processing node.
Example 17 includes a kind of data storage device, comprising:
Data obtaining module, for obtaining the attribute information of data processing node；
Regular determining module, for determining persistent storage rule according to the attribute information；
Persistent storage module, for regular based on the persistent storage, to the number of results of the data processing node According to progress persistent storage.
Example 18 may include device described in example 17, wherein the persistent storage rule include serializing storage or Normal form storage.
Example 19 may include device described in example 17 and/or example 18, wherein the attribute information includes affiliated data At least one of process concurrency number, node number and task number of concurrent of the data processing node of process flow.
Example 20 may include device described in 19 one or more of example 17- example, wherein the rule determining module packet It includes:
First rule determines submodule, for the numberical range according to the attribute information, determines persistent storage rule.
Example 21 may include device described in 20 one or more of example 17- example, wherein first rule determines son Module includes:
Serializing storage determination unit, if exceeding corresponding setting numberical range for the attribute information, it is determined that institute Stating persistent storage rule includes serializing storage；
Normal form stores determination unit, if for the attribute information without departing from corresponding setting numberical range, it is determined that institute Stating persistent storage rule includes normal form storage.
Example 22 may include device described in 21 one or more of example 17- example, wherein the attribute information includes institute State at least one of the task type of data processing node, data type, node identification；
It is described rule determining module include:
Whether Second Rule determines submodule, for including that setting attribute information determines persistence according to the attribute information Storage rule.
Example 23 may include device described in 22 one or more of example 17- example, wherein the attribute information includes going through At least one of history attribute information and current attribute information；
When the attribute information includes historical status information, the data obtaining module includes:
Acquisition of information submodule, for obtaining the historical record of process execution, at the history statistic Manage the historical status information of node.
Example 24 may include device described in 23 one or more of example 17- example, wherein described device further include:
File adding module, for the persistent storage rule to be added to the configuration file of flow chart of data processing, with When carrying out persistent storage for the result data to the data processing node, the persistence is read from the configuration file Storage rule.
Example 25 may include device described in 24 one or more of example 17- example, wherein described device further include:
Container determining module, for determining that the storage of persistent storage is held according to the attribute information of the data processing node Device.
Example 26 may include device described in 25 one or more of example 17- example, wherein the container determining module packet It includes:
Period acquisition submodule, for obtaining the life cycle of the affiliated flow chart of data processing of the data processing node；
Storage container chooses submodule, for choosing the storage container for being suitable for the life cycle, the storage container Including caching, memory, hard disk or external memory.
Example 27 may include device described in 26 one or more of example 17- example, wherein described device further include:
Document form determining module, for determining the text of persistent storage according to the attribute information of the data processing node Part form.
Example 28 may include device described in 27 one or more of example 17- example, wherein the document form determines mould Block includes:
Detection sub-module is called, whether includes database in the data processing task for detecting the data processing node It calls；
Database determines submodule, if for including data base call, it is determined that the document form of persistent storage includes Database；
Data file determines submodule, if for not including data base call, it is determined that the document form of persistent storage Including data file.
Example 29 may include device described in 28 one or more of example 17- example, wherein the persistent storage module Include:
Plug-in unit calls submodule, for calling the corresponding feature card of the persistent storage rule, at the data The result data for managing node carries out persistent storage.
Example 30 may include device described in 29 one or more of example 17- example, wherein the persistent storage module Include:
Subdata reading submodule, for obtaining the result data of the data processing node, and from the result data It is middle to read a variety of subdatas；
Character string transform subblock, for sequentially combining the character string for being converted to setting format after a variety of subdatas.
Example 31 may include device described in 30 one or more of example 17- example, wherein the persistent storage module Further include:
Mark addition submodule, for adding serialization version mark in the character string being converted to.
Example 32 may include device described in 31 one or more of example 17- example, wherein described device further include:
Flow driving module, for being based on the persistent storage rule described, to the knot of the data processing node Before fruit data carry out persistent storage, the flow chart of data processing is driven according to the result data of a upper data processing node Node is handled to current data；
Task execution module is handled, for executing the corresponding data processing task of current data processing node.
Example 33 includes a kind of computer equipment, including memory, processor and storage on a memory and can handled The computer program run on device, which is characterized in that the processor realizes such as example 1-16 when executing the computer program One or more methods.
Example 34 includes a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the journey The method such as example 1-16 one or more is realized when sequence is executed by processor.
Although some embodiments are various substitutions, and/or equivalent implementation for the purpose of illustrating and describing Scheme calculates to reach same purpose and implement the realization for exemplifying and describing, and does not depart from the practical range of the application.This Shen It please be intended to cover any modification or variation of the embodiment being discussed herein.It is, therefore, apparent that embodiment described herein only by right It is required that being limited with their equivalent.

Claims (34)

1. a kind of date storage method characterized by comprising
Obtain the attribute information of data processing node；
Persistent storage rule is determined according to the attribute information；
Based on the persistent storage rule, persistent storage is carried out to the result data of the data processing node.
2. the method according to claim 1, wherein the persistent storage rule includes serializing storage or model Formula storage.
3. the method according to claim 1, wherein the attribute information includes the stream of affiliated flow chart of data processing At least one of task number of concurrent of journey number of concurrent, node number and the data processing node.
4. according to the method described in claim 3, it is characterized in that, described determine that persistent storage is advised according to the attribute information Then include:
According to the numberical range of the attribute information, persistent storage rule is determined.
5. according to the method described in claim 4, it is characterized in that, the numberical range according to the attribute information, determines Persistent storage rule includes:
If the attribute information exceeds corresponding setting numberical range, it is determined that the persistent storage rule includes that serializing is deposited Storage；
If the attribute information is without departing from corresponding setting numberical range, it is determined that the persistent storage rule is deposited including normal form Storage.
6. the method according to claim 1, wherein the attribute information includes appointing for the data processing node At least one of service type, data type, node identification；
It is described to determine that persistent storage rule includes: according to the attribute information
It whether include that setting attribute information determines persistent storage rule according to the attribute information.
7. the method according to claim 1, wherein the attribute information includes historical status information and current category At least one of property information；
When the attribute information includes historical status information, the attribute information for obtaining data processing node includes:
The historical record that process executes is obtained, the historical status information of node is handled according to the history statistic.
8. the method according to claim 1, wherein the method also includes:
The persistent storage rule is added to the configuration file of flow chart of data processing, for the data processing node When result data carries out persistent storage, the persistent storage rule is read from the configuration file.
9. the method according to claim 1, wherein the method also includes:
The storage container of persistent storage is determined according to the attribute information of the data processing node.
10. according to the method described in claim 9, it is characterized in that, the attribute information according to the data processing node The storage container for determining persistent storage includes:
Obtain the life cycle of the affiliated flow chart of data processing of the data processing node；
The storage container for being suitable for the life cycle is chosen, the storage container includes caching, memory, hard disk or external memory.
11. the method according to claim 1, wherein the method also includes:
The document form of persistent storage is determined according to the attribute information of the data processing node.
12. according to the method for claim 11, which is characterized in that the attribute information according to the data processing node The document form for determining persistent storage includes:
Whether detect in the data processing task of the data processing node includes data base call；
If including data base call, it is determined that the document form of persistent storage includes database；
If not including data base call, it is determined that the document form of persistent storage includes data file.
13. the method according to claim 1, wherein described be based on the persistent storage rule, to the number Carrying out persistent storage according to the result data of processing node includes:
The corresponding feature card of the persistent storage rule is called, it is lasting to carry out to the result data of the data processing node Change storage.
14. according to the method described in claim 2, it is characterized in that, serializing storage includes:
The result data of the data processing node is obtained, and reads a variety of subdatas from the result data；
The character string for setting format is converted to after sequentially combining a variety of subdatas.
15. according to the method for claim 14, which is characterized in that the serializing storage further include:
Serialization version mark is added in the character string being converted to.
16. the method according to claim 1, wherein described based on the persistent storage rule, to described Before the result data of data processing node carries out persistent storage, the method also includes:
The flow chart of data processing is driven to current data according to the result data of a upper data processing node and handles node；
Execute the corresponding data processing task of current data processing node.
17. a kind of data storage device characterized by comprising
Data obtaining module, for obtaining the attribute information of data processing node；
Regular determining module, for determining persistent storage rule according to the attribute information；
Persistent storage module, for based on persistent storage rule, to the result data of the data processing node into Row persistent storage.
18. device according to claim 17, which is characterized in that the persistent storage rule include serializing storage or Normal form storage.
19. device according to claim 17, which is characterized in that the attribute information includes affiliated flow chart of data processing At least one of task number of concurrent of process concurrency number, node number and the data processing node.
20. device according to claim 19, which is characterized in that it is described rule determining module include:
First rule determines submodule, for the numberical range according to the attribute information, determines persistent storage rule.
21. device according to claim 20, which is characterized in that first rule determines that submodule includes:
Serializing storage determination unit, if exceeding corresponding setting numberical range for the attribute information, it is determined that described to hold Longization storage rule includes serializing storage；
Normal form stores determination unit, if for the attribute information without departing from corresponding setting numberical range, it is determined that described to hold Longization storage rule includes normal form storage.
22. device according to claim 17, which is characterized in that the attribute information includes the data processing node At least one of task type, data type, node identification；
It is described rule determining module include:
Whether Second Rule determines submodule, for including that setting attribute information determines persistent storage according to the attribute information Rule.
23. device according to claim 17, which is characterized in that the attribute information includes historical status information and current At least one of attribute information；
When the attribute information includes historical status information, the data obtaining module includes:
Acquisition of information submodule is handled according to the history statistic and is saved for obtaining the historical record of process execution The historical status information of point.
24. device according to claim 17, which is characterized in that described device further include:
File adding module, for the persistent storage rule to be added to the configuration file of flow chart of data processing, for right When the result data of the data processing node carries out persistent storage, the persistent storage is read from the configuration file Rule.
25. device according to claim 17, which is characterized in that described device further include:
Container determining module, for determining the storage container of persistent storage according to the attribute information of the data processing node.
26. device according to claim 25, which is characterized in that the container determining module includes:
Period acquisition submodule, for obtaining the life cycle of the affiliated flow chart of data processing of the data processing node；
Storage container chooses submodule, and for choosing the storage container for being suitable for the life cycle, the storage container includes Caching, memory, hard disk or external memory.
27. device according to claim 17, which is characterized in that described device further include:
Document form determining module, for determining the file shape of persistent storage according to the attribute information of the data processing node Formula.
28. device according to claim 27, which is characterized in that the document form determining module includes:
Detection sub-module is called, whether includes database tune in the data processing task for detecting the data processing node With；
Database determines submodule, if for including data base call, it is determined that the document form of persistent storage includes data Library；
Data file determines submodule, if for not including data base call, it is determined that the document form of persistent storage includes Data file.
29. device according to claim 17, which is characterized in that the persistent storage module includes:
Plug-in unit calls submodule, for calling the corresponding feature card of the persistent storage rule, to the data processing section The result data of point carries out persistent storage.
30. device according to claim 18, which is characterized in that the persistent storage module includes:
Subdata reading submodule is read for obtaining the result data of the data processing node, and from the result data Take a variety of subdatas；
Character string transform subblock, for sequentially combining the character string for being converted to setting format after a variety of subdatas.
31. device according to claim 30, which is characterized in that the persistent storage module further include:
Mark addition submodule, for adding serialization version mark in the character string being converted to.
32. device according to claim 17, which is characterized in that described device further include:
Flow driving module, for being based on the persistent storage rule described, to the number of results of the data processing node According to before carrying out persistent storage, the flow chart of data processing is driven to working as according to the result data of a upper data processing node Preceding data processing node；
Task execution module is handled, for executing the corresponding data processing task of current data processing node.
33. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor Calculation machine program, which is characterized in that the processor realizes such as claim 1-16 mono- or more when executing the computer program A method.
34. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor The method such as claim 1-16 one or more is realized when execution.
CN201810355324.5A 2018-04-19 2018-04-19 Data storage method, device, equipment and medium Active CN110399089B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810355324.5A CN110399089B (en) 2018-04-19 2018-04-19 Data storage method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810355324.5A CN110399089B (en) 2018-04-19 2018-04-19 Data storage method, device, equipment and medium

Publications (2)

Publication Number Publication Date
CN110399089A true CN110399089A (en) 2019-11-01
CN110399089B CN110399089B (en) 2023-05-05

Family

ID=68319560

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810355324.5A Active CN110399089B (en) 2018-04-19 2018-04-19 Data storage method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN110399089B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111427899A (en) * 2020-03-17 2020-07-17 中国建设银行股份有限公司 Method, device, equipment and computer readable medium for storing file
CN112422613A (en) * 2020-09-16 2021-02-26 北京中兵数字科技集团有限公司 Data processing method, data processing platform and computer readable storage medium
CN113645287A (en) * 2021-07-29 2021-11-12 腾讯科技（深圳）有限公司 Automobile message storage method and device and automobile message storage system
CN114138776A (en) * 2021-11-01 2022-03-04 杭州欧若数网科技有限公司 Method, system, apparatus and medium for graph structure and graph attribute separation design

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103425462A (en) * 2012-05-14 2013-12-04 阿里巴巴集团控股有限公司 Method and device for workflow data persistence
CN106326331A (en) * 2016-06-29 2017-01-11 河南许继仪表有限公司 Intelligent power utilization data service system based on cloud computation
CN107506408A (en) * 2017-08-08 2017-12-22 北京盛华安信息技术有限公司 To the method and system of magnanimity event distribution formula association matching

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103425462A (en) * 2012-05-14 2013-12-04 阿里巴巴集团控股有限公司 Method and device for workflow data persistence
CN106326331A (en) * 2016-06-29 2017-01-11 河南许继仪表有限公司 Intelligent power utilization data service system based on cloud computation
CN107506408A (en) * 2017-08-08 2017-12-22 北京盛华安信息技术有限公司 To the method and system of magnanimity event distribution formula association matching

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111427899A (en) * 2020-03-17 2020-07-17 中国建设银行股份有限公司 Method, device, equipment and computer readable medium for storing file
CN112422613A (en) * 2020-09-16 2021-02-26 北京中兵数字科技集团有限公司 Data processing method, data processing platform and computer readable storage medium
CN113645287A (en) * 2021-07-29 2021-11-12 腾讯科技（深圳）有限公司 Automobile message storage method and device and automobile message storage system
CN113645287B (en) * 2021-07-29 2022-09-20 腾讯科技（深圳）有限公司 Automobile message storage method and device and automobile message storage system
CN114138776A (en) * 2021-11-01 2022-03-04 杭州欧若数网科技有限公司 Method, system, apparatus and medium for graph structure and graph attribute separation design

Also Published As

Publication number Publication date
CN110399089B (en) 2023-05-05

Similar Documents

Publication Publication Date Title
CN110399089A (en) Date storage method, device, equipment and medium
US11194793B1 (en) Dynamically materialized views for sheets based data
CN107958028A (en) Method, apparatus, storage medium and the terminal of data acquisition
CN107644286A (en) Workflow processing method and device
WO2019134232A1 (en) Method for performing underwriting verification, device, storage medium, and terminal
CN106649212A (en) Business data processing method and device
CN106547766A (en) A kind of data access method and device
CN108073688B (en) Data migration method and device
US20120036089A1 (en) System and Method for Dynamic, Real-Time Data Management and Processing to Facilitate Business Decisions
CN110134516A (en) Finance data processing method, device, equipment and computer readable storage medium
US20170351980A1 (en) Method, device, system of model-driven engineering of efficient industrial automation process and business process modeling with bpmn using native computation of xml schemas and objects
JP2005521947A5 (en)
CN103646049B (en) The method and system of automatically generated data form
CN109656963A (en) Metadata acquisition methods, device, equipment and computer readable storage medium
Sahni et al. The IT transformation health care needs
US20050144552A1 (en) Master data quality
CN108205582A (en) Data access is optimized based on data aging
CN107133323A (en) Data model construction method, the implementation method of government affairs service business and device
CN108399547A (en) A kind of method, system and medium for sentencing duty according to express mail circulation node and problem types
Schlossnagle Monitoring in a DevOps world
WO2022048362A1 (en) Data storage method and apparatus, electronic device, and storage medium
CN108197309A (en) A kind of method, system and the readable storage medium storing program for executing of the storage of server assets information
CN107679065A (en) Method for exhibiting data, device and computer-readable recording medium
Versendaal et al. Procurement maturity and IT-alignment models: overview and a case study
CN115840567A (en) Application editing method and related equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40015689

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant