CN103188306B - Distributed preprocess method and system - Google Patents
Distributed preprocess method and system Download PDFInfo
- Publication number
- CN103188306B CN103188306B CN201110455625.3A CN201110455625A CN103188306B CN 103188306 B CN103188306 B CN 103188306B CN 201110455625 A CN201110455625 A CN 201110455625A CN 103188306 B CN103188306 B CN 103188306B
- Authority
- CN
- China
- Prior art keywords
- node
- processing
- executive module
- module
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Hardware Redundancy (AREA)
Abstract
The invention discloses a kind of distributed pretreated method and system, wherein, the method comprises: processing node is received from the data that source node sends; Administration module is according to the kind of the different demand configuration Executive Modules of processing node and execution sequence; Processing node calls the Executive Module set including multiple Executive Module configured by administration module self disposed and carries out pretreatment operation to the data received.Distributed preprocess method of the present invention and system, can manage the preprocessing process of Process node dynamically, neatly, the set of management Executive Module, ensures consistency and the atomicity of Process node preprocessing process; System ensure that the preliminary treatment intermediate object program of multiple Executive Modules of Process node all processes in internal memory, does not need interim storage, improves preliminary treatment performance.
Description
Technical field
The present invention relates to distributed system in computer realm, particularly, relate to distributed pretreated method and system.
Background technology
Existing distributed data loads, the logical architecture of pretreatment system comprises:
Source node (i.e. source node): be deployed in source side, encapsulates data source to be loaded, and the data in data source are sent to Dest node;
Dest node (i.e. destination node): be deployed in and store side, receive the data from Source node, import in the storage of rear end;
Process node: before data store by Dest node, multiple Process node can be introduced, some preliminary treatment are carried out to data, as filtration, conversion etc.Process node can share a node with Dest node physically.
Current distributed data loads, the pretreatment work of pretreatment system, mainly through the mode of manual intervention configuration Process node.If need to carry out multistep preliminary treatment to data, then need to introduce multiple Process node, can land stored in temporary memory space by data after each Process node processing, next Process node reads data from temporary memory space again and processes.
Realizing in process of the present invention, inventor finds that in prior art, at least there are the following problems:
First, adopt mode that is static, hard coded, just can not on-the-fly modify once set, upgrading, upgrading preprocessing process is more loaded down with trivial details, need to increase or renewal Process node and configuration thereof;
Secondly, multiple preprocessing process intermediate object program also needs interim storage, and waste system read-write IO, causes performance to reduce.
Summary of the invention
The object of the invention is for the lower defect of distributed system preliminary treatment efficiency in prior art, propose a kind of distributed pretreated method and system.
For achieving the above object, according to an aspect of the present invention, a kind of distributed pretreated method is provided.
According to the distributed preprocess method of the embodiment of the present invention, comprising:
Processing node is received from the data that source node sends;
Administration module is according to the kind of the different demand configuration Executive Modules of processing node and execution sequence;
Processing node calls the Executive Module set including multiple Executive Module configured by administration module self disposed and carries out pretreatment operation to the data received.
In technique scheme, also comprise after the step of pretreatment operation: preliminary treatment intermediate object program is placed in internal memory and stores by Executive Module set.
In technique scheme, administration module configures identical Executive Module and carries out pretreatment operation in multiple processing nodes corresponding with identical destination node.
In technique scheme, method also comprises:
Administration module collects the process status of each processing node when carrying out preliminary treatment to data;
If there is the inconsistent state of process when carrying out preliminary treatment to data in processing node, all processing nodes are then rolled back to untreated state by administration module, after all processing nodes complete renewal in confirmation, then start all processing nodes simultaneously and carry out pretreatment operation;
If processing node is when carrying out preliminary treatment to data, there is part processing node to start, the state that other node does not start, the processing node do not started suspends by administration module, the processing node started is rolled back to untreated state, after all processing nodes complete renewal in confirmation, then start all processing nodes simultaneously and carry out pretreatment operation.In technique scheme, method also comprises:
Executive Module set completes the operation of the initialization of Executive Module execution environment, module interface inspection, module loading and unloading, execution.
In technique scheme, method also comprises:
Pending data according to configuration storage allocation, and are kept in internal memory by Executive Module set;
Executive Module set using memory pointer as Parameter transfer to Executive Module, Executive Module distributes required memory and is also kept in internal memory by preliminary treatment intermediate object program;
After the Executive Module preliminary treatment intermediate object program be integrated in described internal memory is called, releasing memory.
For achieving the above object, according to another aspect of the present invention, a kind of distributed pretreatment system is provided.
According to the distributed pretreatment system of the embodiment of the present invention, comprising:
Processing node, for being received from the data that source node sends, calling the Executive Module set including multiple Executive Module configured by administration module self disposed and carrying out pretreatment operation to the data received;
Administration module, for kind and the execution sequence of the different demand configuration Executive Modules according to processing node.
In technique scheme, Executive Module set, stores for preliminary treatment intermediate object program is placed in internal memory.
In technique scheme, administration module, also carries out pretreatment operation for configuring identical Executive Module in multiple processing nodes corresponding with identical destination node.
In technique scheme, administration module, for collecting the process status of each processing node when carrying out preliminary treatment to data, according to process status, carries out state processing to processing node;
Administration module comprises:
State collection submodule, for collecting the process status of each processing node when carrying out preliminary treatment to data;
State processing submodule, for according to the process status of processing node when carrying out preliminary treatment to data, carries out state processing to processing node:
If processing node exists the inconsistent state of process when carrying out preliminary treatment to data, all processing nodes being rolled back to untreated state, after all processing nodes complete renewal in confirmation, then starting all processing nodes simultaneously and carry out pretreatment operation;
If processing node is when carrying out preliminary treatment to data, there is part processing node to start, the state that other node does not start, the processing node do not started is suspended, the processing node started is rolled back to untreated state, after all processing nodes complete renewal in confirmation, then start all processing nodes simultaneously and carry out pretreatment operation.
In technique scheme, Executive Module set comprises: initialization submodule, for completing the operation of the initialization of Executive Module execution environment, module interface inspection, module loading and unloading, execution.
In technique scheme, Executive Module set comprises: memory management submodule, for according to configuration storage allocation, and pending data are kept in internal memory, using memory pointer as Parameter transfer to Executive Module, after the preliminary treatment intermediate object program in internal memory is called, releasing memory;
Executive Module, for completing set processing logic, and is kept at preliminary treatment intermediate object program from the internal memory of Executive Module set application.
The distributed preprocess method of various embodiments of the present invention and system, can manage the preprocessing process of Process node dynamically, neatly, the set of management Executive Module, ensures consistency and the atomicity of Process node preprocessing process; System ensure that the preliminary treatment intermediate object program of multiple Executive Modules of Process node all processes in internal memory, does not need interim storage, improves preliminary treatment performance.
Other features and advantages of the present invention will be set forth in the following description, and, partly become apparent from specification, or understand by implementing the present invention.Object of the present invention and other advantages realize by structure specifically noted in write specification, claims and accompanying drawing and obtain.
Below by drawings and Examples, technical scheme of the present invention is described in further detail.
Accompanying drawing explanation
Accompanying drawing is used to provide a further understanding of the present invention, and forms a part for specification, together with embodiments of the present invention for explaining the present invention, is not construed as limiting the invention.In the accompanying drawings:
Fig. 1 is the framework schematic diagram according to the distributed pretreatment system of the present invention;
Fig. 2 is the structural representation according to Executive Module set of the present invention;
Fig. 3 is the structural representation upgraded according to Process node preprocessing process of the present invention;
Fig. 4 is according to the conforming structural representation of Process node guarantee preprocessing process of the present invention;
Fig. 5 is the structural representation upgraded according to Process node administration of the present invention;
Fig. 6 is the schematic flow sheet according to the distributed preprocess method of the present invention;
Fig. 7 is the structural representation according to the distributed pretreatment system of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the preferred embodiments of the present invention are described, should be appreciated that preferred embodiment described herein is only for instruction and explanation of the present invention, is not intended to limit the present invention.
Distributed pretreatment system of the present invention devises main controlled node PMaster, the preprocessing process of dynamic, organically management Process node (i.e. processing node), ensures consistency and the atomicity of Process node preprocessing process; And system ensure that the intermediate object program that Process node calls multiple Executive Module all processes in internal memory, does not need interim storage.
As shown in Figure 1, distributed pretreatment system of the present invention comprises administration module (i.e. PManager) and Executive Module set (i.e. PModule), administration module is deployed on main controlled node PMaster usually, and Executive Module collection portion is deployed on processing node Process.
As shown in Figure 2, dispose multiple Executive Module in PModule, i.e. Module1, Module2, Module3......ModuleK, PModule mainly completes the operation of Executive Module, comprise enforcement engine, memory management, management and monitoring etc., PModule is formed primarily of such as lower component:
Enforcement engine (i.e. ExecuteEngine): complete the initialization of Executive Module execution environment, module interface inspection, module loading and the work such as unloading, execution;
Memory management: allocate internal memory in advance as requested, and reclaim internal memory in time.In order to ensure the execution efficiency of Executive Module, memory management is one of Core Feature, mainly comprises following operation:
Pending data according to configuration storage allocation, and are kept in internal memory by enforcement engine;
Using memory pointer as Parameter transfer to Executive Module, Executive Module distributes required memory and is also kept in internal memory by the preliminary treatment intermediate object program of data;
The preliminary treatment intermediate object program of each Executive Module is all temporarily stored in internal memory, can be used by other modules;
After all modules perform and terminate, the internal memory that this lot data takies is released, and data result is persistence as requested;
Management and monitoring: according to the requirement of PManager, completes the management work of Executive Module, and provides policer operation.
PManager realizes management to Executive Module, comprises the functions such as installations, deployment, upgrading, degradation, status tracking, primarily of such as lower component formation:
Module management parts: mainly implement the every bookkeeping to Executive Module, owing to being distributed system, therefore need the atomicity supporting bookkeeping, namely an operation on all the nodes or all successful, or all failed, and can not be partly successful, otherwise data can be caused inconsistent;
Module and slip condition database: the main management implementing Executive Module and state thereof;
Interpersonal interface: be supplied to management system display.
The major function of PManager comprises:
1) all Executive Modules are managed: the Executive Module interface of definition standard, guarantee is needed to provide preprocessing process as required to different Process nodes: the preprocessing process of configuration Process node, such as, which Executive Module has been used in preprocessing process, what order to run Executive Module etc. successively according to, upgrade the preprocessing process of Process node;
As shown in Figure 3, if there is Process node preprocessing process to upgrade, then amendment configures and notifies corresponding Process node;
Configuration information is as follows:
Source1process1 (Executive Module 1, Executive Module 2, Executive Module 3) dest1
Source2process2 (Executive Module 1, Executive Module 3, Executive Module 4) dest2
SourceNprocessN (Executive Module 1, Executive Module 5) destN
2) consistency of the preprocessing process to multiple Process nodes that same Source node processes can be ensured: when adopting load balancing or highly reliable mode to load data, a Source node may send the data to multiple Process node and multiple Dest node, needs the consistency of the preprocessing process ensureing this multiple Process node.
Such as, in highly reliable load mode situation, the corresponding Dest node of each Process node, processes the data that this Dest node receives.System needs the consistency of the preprocessing process ensureing multiple Dest nodes that same Source node sends to, this is by the process for same Source node, realizes in different Process nodes for the one or more identical Executive Module of this Source Joint Enterprise.If the Executive Module configuration for Source2 node in Process2 with the ProcessM node in Fig. 4 is consistent, be all Executive Module 1, Executive Module 3, Executive Module 4.
Meanwhile, also need the different Source node datas ensureing to receive Process node, preprocessing process is as required provided.As provided different Executive Module configurations for Source1 node and Source2 node in Process2 node in Fig. 4.
The configuration information of Fig. 4 is as follows:
Source1process1 (module 1, module 2) dest1, process2 (module 1, module 2, module 3) dest2
Source2process2 (module 1, module 3, module 4) dest2, processM (module 1, module 3, module 4) destM
SourceNprocessM (module 1, module 5) destM, process1 (module 1, module 5) dest1
3) management update, comprising: the renewal of (1) Process node, comprises its additions and deletions, upgrading, rollback; (2) for the renewal of specific Source node each Process node preprocessing process pretreated.
Notice Process node updates information: comprise module upgrade, rollback information, and/or node preprocessing process lastest imformation, as carried out for the preliminary treatment of specific Source node the operation increasing, delete Executive Module;
Collect the preprocessing process state of Process node, once the problem of Discovery Status or configuration, system can be intervened in time.
As shown in Figure 5, the preprocessing process of pretreated Process1 and the Process2 node of responsible Source1 node is upgraded, newly-increased Executive Module 4 after Executive Module 3.
Ensure consistency and the atomicity of preprocessing tasks during renewal, when namely ensureing to upgrade, the preprocessing process of Process node to be updated does not all also perform, or rolls back to non-executing state.First system judges whether to need rollback by collecting Process node state, is then suspended by the preprocessing process of Process node to be updated, waits renewal to complete, restart preprocessing process.As shown in Figure 5, system obtains the node state of Process1 and Process2, and as Process1 does not also have treatment S ource1 data, and Process2 has started to process Source1 data; Suspend Process1 node, notice Process2 rolls back to untreated state and suspends; Notice Process1 and Process2 node updates preprocessing process, and confirm to upgrade; Start the preprocessing process of Process1 and Process2 node simultaneously.
Those skilled in the art can understand, in Figure 5, if Process1 node and Process2 node have all started the data processing Source1, but both processes are inconsistent, notice Process1 node and Process2 node are rolled back to untreated state, suspend Process1 node and Process2 node, start the preprocessing process of Process1 and Process2 node simultaneously.
4) in order to avoid the Single Point of Faliure of Pmaster node, also in order to answering system node scale increases the control flow check bottleneck caused, system supports multiple Pmaster node, and keeps between Pmaster node synchronously copying and data consistency.
embodiment of the method
According to the embodiment of the present invention, provide a kind of distributed preprocess method, as shown in Figure 6, the present embodiment comprises:
Step 102: processing node Process be received from source node S ource send data, and call Executive Module set PModule to receive data carry out pretreatment operation;
Step 104: preliminary treatment intermediate object program is placed in internal memory and stores by Executive Module set PModule;
Step 106: the described data received are placed in destination node Dest by processing node Process.
Distributed preprocess method of the present invention, system dynamically, manage the preprocessing process of Process node neatly, the set of management Executive Module, ensures consistency and the atomicity of Process node preprocessing process; System ensure that the preliminary treatment intermediate object program of multiple Executive Modules of Process node all processes in internal memory, does not need interim storage, improves preliminary treatment performance.
Distributed preprocess method of the present invention, has following advantage compared with present mode:
Present mode: a large amount of data, as the data of 1000GB, is loaded into (as oracle) in database, and then user completes preliminary treatment by sending sql command on the database, completes repeatedly preliminary treatment, then needs to send multiple sql command; But when each SQL operation, database all needs:
From disk scanning 1000GB data, by meeting the data decimation of user's requirement out, be put in another one database
I/O operation amounts to:
(1), during warehouse-in, the data of 1000GB are saved;
(2) N SQL preliminary treatment, needs the data reading 1000GB for N time;
(3) accumulative: write for 1 time, N time 1000GB data are read;
Pattern of the present invention: mass data, as 1000GB data, is transferred on PModule, and PModule completes N preliminary treatment (internal memory) successively, the disk operating to the data of 1000GB occur:
(1) put in storage, preserve the data of 1000GB;
(2) N preliminary treatment, does not need disk I/O operation;
(3) accumulative: to write for 1 time;
Eliminate the reading time of N 1000GB data.
System embodiment
According to the embodiment of the present invention, provide a kind of distributed pretreatment system.As shown in Figure 7, the present embodiment comprises:
Processing node 10, for being received from the data that source node sends, calling the Executive Module set including multiple Executive Module configured by administration module self disposed and carrying out pretreatment operation to the data received;
Administration module 20, for kind and the execution sequence of the different demand configuration Executive Modules according to processing node 10.
Executive Module set 30, stores for preliminary treatment intermediate object program is placed in internal memory.
Wherein:
Administration module 20, also carries out pretreatment operation for configuring identical Executive Module in multiple processing nodes corresponding with identical destination node.
Wherein:
Administration module 20, for collecting the process status of each processing node 10 when carrying out preliminary treatment to data, according to process status, carries out state processing to processing node 10;
Administration module 20 comprises:
State collection submodule 21, for collecting the process status of each processing node when carrying out preliminary treatment to data;
State processing submodule 22, for according to the process status of processing node when carrying out preliminary treatment to data, carries out state processing to processing node:
If processing node exists the inconsistent state of process when carrying out preliminary treatment to data, all processing nodes being rolled back to untreated state, after all processing nodes complete renewal in confirmation, then starting all processing nodes simultaneously and carry out pretreatment operation;
If processing node is when carrying out preliminary treatment to data, there is part processing node to start, the state that other node does not start, the processing node do not started is suspended, the processing node started is rolled back to untreated state, after all processing nodes complete renewal in confirmation, then start all processing nodes simultaneously and carry out pretreatment operation.
Wherein:
Executive Module set 30 comprises: initialization submodule 31, for completing the operation of the initialization of Executive Module execution environment, module interface inspection, module loading and unloading, execution.
Pending data, for according to configuration storage allocation, and are kept in internal memory by memory management submodule 32, using memory pointer as Parameter transfer to Executive Module, after the preliminary treatment intermediate object program in internal memory is called, releasing memory;
Executive Module, for completing set processing logic, and is kept at preliminary treatment intermediate object program from the internal memory of Executive Module set application.
Distributed pretreatment system of the present invention, dynamically, manage the preprocessing process of Process node neatly, the set of management Executive Module, ensures consistency and the atomicity of Process node preprocessing process; System ensure that the preliminary treatment intermediate object program of multiple Executive Modules of Process node all processes in internal memory, does not need interim storage, improves preliminary treatment performance.
One of ordinary skill in the art will appreciate that: all or part of step realizing said method embodiment can have been come by the hardware that program command is relevant, aforesaid program can be stored in a computer read/write memory medium, this program, when performing, performs the step comprising said method embodiment; And aforesaid storage medium comprises: ROM, RAM, magnetic disc or CD etc. various can be program code stored medium.
Last it is noted that the foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, although with reference to previous embodiment to invention has been detailed description, for a person skilled in the art, it still can be modified to the technical scheme described in foregoing embodiments, or carries out equivalent replacement to wherein portion of techniques feature.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. a distributed preprocess method, is characterized in that, comprising:
Processing node is received from the data that source node sends;
Administration module is according to the kind of the different demand configuration Executive Modules of described processing node and execution sequence;
Described processing node calls the Executive Module set including multiple Executive Module configured by described administration module self disposed and carries out pretreatment operation to the described data received;
Described administration module collects the process status of each processing node when carrying out preliminary treatment to data, according to described process status, carries out state processing to described processing node;
Also comprise:
If there is the inconsistent state of process when carrying out preliminary treatment to data in processing node, all processing nodes are then rolled back to untreated state by described administration module, after all processing nodes complete renewal in confirmation, then start all processing nodes simultaneously and carry out pretreatment operation;
If processing node is when carrying out preliminary treatment to data, there is part processing node to start, the state that other node does not start, the processing node do not started suspends by described administration module, the processing node started is rolled back to untreated state, after all processing nodes complete renewal in confirmation, then start all processing nodes simultaneously and carry out pretreatment operation.
2. method according to claim 1, is characterized in that, also comprises after the step of pretreatment operation: preliminary treatment intermediate object program is placed in internal memory and stores by described Executive Module set.
3. method according to claim 1, is characterized in that, described administration module configures identical Executive Module and carries out pretreatment operation in multiple processing nodes corresponding with identical destination node.
4. method according to claim 1, is characterized in that, also comprises:
Described Executive Module set completes the operation of the initialization of Executive Module execution environment, module interface inspection, module loading and unloading, execution.
5. method according to claim 1, is characterized in that, also comprises:
Pending data according to configuration storage allocation, and are kept in internal memory by described Executive Module set;
Described Executive Module set using memory pointer as Parameter transfer to Executive Module, Executive Module completes set processing logic, and preliminary treatment intermediate object program is kept at from the internal memory of Executive Module set application;
After the described Executive Module preliminary treatment intermediate object program be integrated in described internal memory is called, releasing memory.
6. a distributed pretreatment system, is characterized in that, comprising:
Processing node, for being received from the data that source node sends, calling the Executive Module set including multiple Executive Module configured by administration module self disposed and carrying out pretreatment operation to the described data received;
Administration module, for kind and the execution sequence of the different demand configuration Executive Modules according to described processing node;
Described administration module, for collecting the process status of each processing node when carrying out preliminary treatment to data, according to described process status, carries out state processing to described processing node;
Described administration module comprises:
State collection submodule, for collecting the process status of each processing node when carrying out preliminary treatment to data;
State processing submodule, for according to the process status of processing node when carrying out preliminary treatment to data, carries out state processing to described processing node:
If processing node exists the inconsistent state of process when carrying out preliminary treatment to data, all processing nodes being rolled back to untreated state, after all processing nodes complete renewal in confirmation, then starting all processing nodes simultaneously and carry out pretreatment operation;
If processing node is when carrying out preliminary treatment to data, there is part processing node to start, the state that other node does not start, the processing node do not started is suspended, the processing node started is rolled back to untreated state, after all processing nodes complete renewal in confirmation, then start all processing nodes simultaneously and carry out pretreatment operation.
7. system according to claim 6, is characterized in that, described Executive Module set, stores for preliminary treatment intermediate object program is placed in internal memory.
8. system according to claim 6, is characterized in that, described administration module, also carries out pretreatment operation for configuring identical Executive Module in multiple processing nodes corresponding with identical destination node.
9. system according to claim 6, is characterized in that, described Executive Module set comprises: initialization submodule, for completing the operation of the initialization of Executive Module execution environment, module interface inspection, module loading and unloading, execution.
10. system according to claim 6, it is characterized in that, described Executive Module set comprises: memory management submodule, for according to configuration storage allocation, and pending data are kept in internal memory, using memory pointer as Parameter transfer to Executive Module, after the preliminary treatment intermediate object program in described internal memory is called, releasing memory;
Described Executive Module, for completing set processing logic, and is kept at preliminary treatment intermediate object program from the internal memory of Executive Module set application.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110455625.3A CN103188306B (en) | 2011-12-30 | 2011-12-30 | Distributed preprocess method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110455625.3A CN103188306B (en) | 2011-12-30 | 2011-12-30 | Distributed preprocess method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103188306A CN103188306A (en) | 2013-07-03 |
| CN103188306B true CN103188306B (en) | 2016-04-27 |
Family
ID=48679271
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110455625.3A Active CN103188306B (en) | 2011-12-30 | 2011-12-30 | Distributed preprocess method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103188306B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105426493B (en) * | 2015-11-24 | 2019-11-19 | 北京中电普华信息技术有限公司 | A kind of data processing system and method applied to distributed memory system |
| CN106021543A (en) * | 2016-05-26 | 2016-10-12 | 中国农业银行股份有限公司 | Data pre-processing method and device |
| CN108733691A (en) * | 2017-04-18 | 2018-11-02 | 北京京东尚科信息技术有限公司 | Data preprocessing method and device |
| CN107037989A (en) * | 2017-05-17 | 2017-08-11 | 北京小米移动软件有限公司 | Data processing method and device in distributed computing system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1176426A (en) * | 1996-05-15 | 1998-03-18 | 摩托罗拉公司 | Method and apparatus for sequencing computer instruction execution in data processing system |
| CN1890658A (en) * | 2003-12-02 | 2007-01-03 | 交互式内容引擎有限责任公司 | Synchronized data transfer system |
| CN1969258A (en) * | 2004-06-16 | 2007-05-23 | 先进微装置公司 | Multipurpose media access data processing system |
| CN101526982A (en) * | 2001-02-16 | 2009-09-09 | 索尼株式会社 | Data processing method and the device thereof |
| CN101609544A (en) * | 2009-07-21 | 2009-12-23 | 华中科技大学 | A kind of image processor data load and method of testing and device |
| CN102063330A (en) * | 2011-01-05 | 2011-05-18 | 北京航空航天大学 | Performance data acquisition method for large-scale parallel program |
| CN102279888A (en) * | 2011-08-24 | 2011-12-14 | 北京新媒传信科技有限公司 | Method and system for scheduling tasks |
| CN102279730A (en) * | 2010-06-10 | 2011-12-14 | 阿里巴巴集团控股有限公司 | Parallel data processing method, device and system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7467216B2 (en) * | 2004-01-12 | 2008-12-16 | International Business Machines Corporation | Method, system and computer program product for dynamically optimized handling of messages received from a message transmission backbone by a data processing system node |
| US8122446B2 (en) * | 2005-11-03 | 2012-02-21 | International Business Machines Corporation | Method and apparatus for provisioning software on a network of computers |
-
2011
- 2011-12-30 CN CN201110455625.3A patent/CN103188306B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1176426A (en) * | 1996-05-15 | 1998-03-18 | 摩托罗拉公司 | Method and apparatus for sequencing computer instruction execution in data processing system |
| CN101526982A (en) * | 2001-02-16 | 2009-09-09 | 索尼株式会社 | Data processing method and the device thereof |
| CN1890658A (en) * | 2003-12-02 | 2007-01-03 | 交互式内容引擎有限责任公司 | Synchronized data transfer system |
| CN1969258A (en) * | 2004-06-16 | 2007-05-23 | 先进微装置公司 | Multipurpose media access data processing system |
| CN101609544A (en) * | 2009-07-21 | 2009-12-23 | 华中科技大学 | A kind of image processor data load and method of testing and device |
| CN102279730A (en) * | 2010-06-10 | 2011-12-14 | 阿里巴巴集团控股有限公司 | Parallel data processing method, device and system |
| CN102063330A (en) * | 2011-01-05 | 2011-05-18 | 北京航空航天大学 | Performance data acquisition method for large-scale parallel program |
| CN102279888A (en) * | 2011-08-24 | 2011-12-14 | 北京新媒传信科技有限公司 | Method and system for scheduling tasks |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103188306A (en) | 2013-07-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101574366B1 (en) | Synchronizing virtual machine and application life cycles | |
| CN104142847B (en) | Stateless virtual machine and its application under cloud computing environment | |
| CN106155759A (en) | virtual machine batch creation method and device | |
| CN101964725B (en) | Method and system for realizing upgrading without interrupting service | |
| CN103188306B (en) | Distributed preprocess method and system | |
| CN104281906A (en) | Process engine achieving method and system in service process | |
| CN108427571A (en) | A kind of dynamic link library update method and server | |
| CN105389186A (en) | Hot deployment method and system for Java application | |
| CN109885642B (en) | Hierarchical storage method and device for full-text retrieval | |
| CN111666088A (en) | Pod replacement method and device, electronic equipment and computer-readable storage medium | |
| CN111045802B (en) | Redis cluster component scheduling system and method and platform equipment | |
| CN106569863A (en) | Android app resource updating and repairing method based on resource and code modularization | |
| CN104111843A (en) | Sandbox based script updating method and system | |
| CN114490062A (en) | Local disk scheduling method and device, electronic equipment and storage medium | |
| CN104268097A (en) | Metadata processing method and system | |
| CN114385349A (en) | Container group deployment method and device | |
| CN103309696B (en) | Method and device for updating Java card extended library, and Java card | |
| CN107003880A (en) | Kernel update method and device, computer equipment | |
| WO2021139358A1 (en) | Service method and apparatus based on micro-kernel model plug-in mode, device, and storage medium | |
| CN115563226A (en) | Database-based data consumption method, control device and readable storage medium | |
| CN114579364A (en) | Cloud native database backup method based on hybrid cloud | |
| CN111880905B (en) | Method for migrating virtual machines across cells by using openstack | |
| CN111625256B (en) | Application program upgrading method, system, equipment and computer storage medium | |
| CN110532000B (en) | Kbroker distributed operating system for operation publishing and operation publishing system | |
| CN104503811B (en) | Upgrade method for communication device and system based on single memory block |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |