CN101901162A - System and method for dynamic data integration and scheduling by cloud computing in computer software system - Google Patents
System and method for dynamic data integration and scheduling by cloud computing in computer software system Download PDFInfo
- Publication number
- CN101901162A CN101901162A CN2010102229271A CN201010222927A CN101901162A CN 101901162 A CN101901162 A CN 101901162A CN 2010102229271 A CN2010102229271 A CN 2010102229271A CN 201010222927 A CN201010222927 A CN 201010222927A CN 101901162 A CN101901162 A CN 101901162A
- Authority
- CN
- China
- Prior art keywords
- data
- subsystem
- scheduling
- cloud computing
- external
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Stored Programmes (AREA)
Abstract
The invention relates to a system for dynamic data integration and scheduling by cloud computing in a computer software system, which comprises a plurality of external data subsystems, a dynamic data integration platform and a dynamic data scheduling platform. The external data subsystems are connected with the dynamic data scheduling platform by the dynamic data integration platform and the dynamic data scheduling platform is provided with a uniform data access interface. The invention also relates to a method for dynamic data integration and scheduling by the cloud computing in the computer software system which is realized based on the system. By adopting the system and the method for dynamic data integration and scheduling by the cloud computing in the computer software system, the invention enhances the reusability, composability and flexibility of a component, reduces implementation cost of software, shortens publication cycle of software, has simple and clear framework, stable and reliable work performance and wider range of application, largely improves timeliness of data integration, and lays a solid foundation for further development of a component-based software technology and further popularization and application of a cloud computing component technology.
Description
Technical field
The present invention relates to computer software fields, particularly the software of cloud computing member is realized technical field, specifically is meant the system and method for realizing cloud computing dynamic data integration and scheduling in a kind of computer software.
Background technology
More existing Related product reports in the present enterprise information system cloud component resource; About component software and component base system many products and research and development report are arranged also, the infosystem and the middleware that wherein comprise business component and User Defined management service member reach the ERP system product that business component system Life cycle is managed maintenance.Colleges and universities more both domestic and external also research and develop the business component Evolution Environment.
But in the prior art, traditional member has interfaces such as the specific programming of each member, service, thereby application system need be known the interface of member when using member, thereby member has had cured interface and environment for use when designing and developing, thereby when enterprise faces the various application demands of numerous and complicated and changes, can't change flexibly, also can't in based on the professional Evolution Environment of the list formula of internet, acquisition support simultaneously.
Simultaneously, in the traditional many application enterprise, the data definition between different application (comprising title, type, span, numerical value meaning etc.) difference allows application system be difficult to integrate.In the prior art, data integration such as ETL, DI technology all is from different system data to be concentrated in together according to unified Definition by the method that data are migrated, in the data system of concentrating, just possesses the uniform data definition, thereby need the long-term participation of software business men, thereby increased corresponding enforcement cost of development greatly, prolong the product release cycle, brought certain obstacle for further developing of computer software technology.
Summary of the invention
The objective of the invention is to have overcome above-mentioned shortcoming of the prior art, provide a kind of can effectively solve diversification of demand problem, system architecture simply distinct, the data integration of computer software in issue and implementation process ageing strong, use is efficient and convenient, stable and reliable working performance, the scope of application system and method for realization cloud computing dynamic data integration and scheduling in the computer software comparatively widely.
In order to realize above-mentioned purpose, realize in the computer software of the present invention that the system and method for cloud computing dynamic data integration and scheduling is as follows:
Realize the system of cloud computing dynamic data integration and scheduling in this computer software, comprise several external data subsystems, its principal feature is, also comprise dynamic data integration platform and dynamic data dispatching platform in the described system, described each external data subsystem is connected with described dynamic data dispatching platform by described dynamic data integration platform, and described dynamic data dispatching platform has the uniform data access interface.
Comprise data in real time interactive function module and data timing acquiring functional module in the dynamic data integration platform in this computer software in the system of realization cloud computing dynamic data integration and scheduling, described data in real time interactive function module is connected with each external data subsystem respectively with data timing acquiring functional module.
External data subsystem in this computer software in the system of realization cloud computing dynamic data integration and scheduling is connected with described dynamic data integration platform by data access interface.
External data subsystem in this computer software in the system of realization cloud computing dynamic data integration and scheduling is CRM external data subsystem, ERP external data subsystem or PDM external data subsystem.
Should be based on the method for cloud computing dynamic data integration and scheduling in above-mentioned system's realization computer software, its principal feature is that described method may further comprise the steps:
(1) system operates according to the user, sets up enterprise-level uniform data model and corresponding data definition;
(2) relation between the data definition of system configuration external data subsystem and described enterprise-level uniform data model and the corresponding data definition;
(3) the member supports basic platform in the system carries out data access operation to each external data subsystem respectively according to described relation in using data procedures;
(4) system becomes enterprise's uniform data definition according to described relation with the data-switching in each external data subsystem, and uses for new application system.
Relation between the data definition of the configuring external data subsystem in this realization computer software in the method for cloud computing dynamic data integration and scheduling and described enterprise-level uniform data model and the corresponding data definition may further comprise the steps:
(21) system operates according to the user, need to confirm integrated external data subsystem;
(22) data source of system's configuring external data subsystem on described dynamic data integration platform;
(23) system is according to business demand definition of data model on described dynamic data integration platform;
(24) system sets up the corresponding relation between described data model and the external data subsystem;
(25) system operates according to the user, and the mode of data acquisition is set;
(26) system carries out business operation according to described data model to corresponding external data subsystem.
The mode of the data acquisition in this realization computer software in the method for cloud computing dynamic data integration and scheduling is mutual collection of data in real time or data timing acquiring.
The data-switching with in each external data subsystem in this realization computer software in the method for cloud computing dynamic data integration and scheduling becomes enterprise's uniform data definition, may further comprise the steps:
(31) system extracts correspondent service logic according to the demand analysis that the user carried out;
(32) system sets up data model according to described service logic;
(33) system sets up mapping relations to described data model and external data subsystem;
(34) system is provided with the mode of data acquisition;
(35) system carries out the unified operation of data model, and visits corresponding external data subsystem by described data model according to the mapping relations of definition and the mode of data acquisition.
Adopted the system and method for realizing cloud computing dynamic data integration and scheduling in the computer software of this invention, because wherein enterprise can set up the uniform data model and the data definition of enterprise-level, the relation of data definition in data definition by the fixed application system of collocation method and the enterprise data model simultaneously, new application system can use enterprise's uniform data definition to programme, the member supports basic platform is when using data, automatically divide other access data from each application data source according to this definition, and convert the definition of enterprise uniform data to by this definition and allow new application system use, thereby strengthened the reusability of member greatly, but assembleability, dirigibility, not only greatly reduce the implementation cost of software, and obviously shortened the cycle of software issue, the simultaneity factor framework is simply distinct, strengthened the ageing of data integration significantly, use is efficient and convenient, stable and reliable working performance, the scope of application is comparatively extensive, for further developing of component-based software technology and further applying of cloud computing component technology have been established solid foundation.
Description of drawings
Fig. 1 is an overall architecture synoptic diagram of realizing the system of cloud computing dynamic data integration and scheduling in the computer software of the present invention.
Fig. 2 is a data definition of realizing the configuring external data subsystem in the method for cloud computing dynamic data integration and scheduling in the computer software of the present invention and described enterprise-level uniform data model and the relational process process flow diagram between the data definition accordingly.
Fig. 3 becomes enterprise's uniform data definition procedure process flow diagram for the data-switching with in each external data subsystem in the method that realizes cloud computing dynamic data integration and scheduling in the computer software of the present invention.
Embodiment
In order more to be expressly understood technology contents of the present invention, describe in detail especially exemplified by following examples.
See also shown in Figure 1, realize the system of cloud computing dynamic data integration and scheduling in this computer software, comprise several external data subsystems, wherein, also comprise dynamic data integration platform and dynamic data dispatching platform in the described system, described each external data subsystem is connected with described dynamic data dispatching platform by described dynamic data integration platform, and described dynamic data dispatching platform has the uniform data access interface.
Comprise data in real time interactive function module and data timing acquiring functional module in the dynamic data integration platform in this computer software in the system of realization cloud computing dynamic data integration and scheduling, described data in real time interactive function module is connected with each external data subsystem respectively with data timing acquiring functional module.
External data subsystem in this computer software in the system of realization cloud computing dynamic data integration and scheduling is connected with described dynamic data integration platform by data access interface.
External data subsystem in this computer software in the system of realization cloud computing dynamic data integration and scheduling is CRM external data subsystem, ERP external data subsystem or PDM external data subsystem.
See also Fig. 2 and shown in Figure 3 again, should realize the method for cloud computing dynamic data integration and scheduling in the computer software based on above-mentioned system, comprising following steps:
(1) system operates according to the user, sets up enterprise-level uniform data model and corresponding data definition;
(2) relation between the data definition of system configuration external data subsystem and described enterprise-level uniform data model and the corresponding data definition may further comprise the steps:
(a) system operates according to the user, need to confirm integrated external data subsystem;
(b) data source of system's configuring external data subsystem on described dynamic data integration platform;
(c) system is according to business demand definition of data model on described dynamic data integration platform;
(d) system sets up the corresponding relation between described data model and the external data subsystem;
(e) system operates according to the user, and the mode of data acquisition is set; The mode of this data acquisition is mutual collection of data in real time or data timing acquiring;
(f) system carries out business operation according to described data model to corresponding external data subsystem;
(3) the member supports basic platform in the system carries out data access operation to each external data subsystem respectively according to described relation in using data procedures;
(4) system becomes enterprise's uniform data definition according to described relation with the data-switching in each external data subsystem, and uses for new application system; Wherein, the data-switching in each external data subsystem is become enterprise's uniform data definition, may further comprise the steps:
(a) system extracts correspondent service logic according to the demand analysis that the user carried out;
(b) system sets up data model according to described service logic;
(c) system sets up mapping relations to described data model and external data subsystem;
(d) system is provided with the mode of data acquisition;
(e) system carries out the unified operation of data model, and visits corresponding external data subsystem by described data model according to the mapping relations of definition and the mode of data acquisition.
In the middle of reality was used, the uniform data model and the data definition of this enterprise-level were specific as follows:
Data (data) are to describe the symbol record of things.Model (Model) is the abstract of real world.Data model (DataModel) is the abstract of data characteristics, is the instructional mode framework of data base administration.
The described content of data model comprises three parts: data structure, data manipulation, data constraint.
(1) data structure: the contact between type, content, character and the data of the main data of description of data structure in the data model etc.Data structure is the basis of data model, and data manipulation and constraint all are based upon on the data structure.Different data structures has different operations and constraint.
(2) data manipulation: data manipulation mainly is described in action type and the mode of operation on the related data structure in the data model.
(3) data constraint: the grammer in the main data of description structure of the data constraint in the data model between data, meaning of a word contact, the restriction between them and dependence, and the rule of Data Dynamic variation, to guarantee the correct, effective and compatible of data.
Data model is divided into three types by different application levels: be respectively conceptual data model, logic data model, Physical data model.
(1) conceptual data model (Conceptual Data Model): be called for short conceptual model, it is the model in data base-oriented user's the realization world, be mainly used to describe the generalities structure in the world, it makes the starting stage of the designer of database in design, break away from the concrete technical matters of computer system and DBMS, concentrate one's energy to analyze contact between data and the data etc., irrelevant with concrete data management system (Database Management System is called for short DBMS).Conceptual data model must change logic data model into, could realize in DBMS.
(2) logic data model (Logical Data Model): be called for short data model, this is the model that the user sees from database, be the concrete data model that DBMS supported, as network data model (Network Data Model), hierarchical data mode (Hierarchical Data Model) or the like.This model should user oriented, and system-oriented again is mainly used in the realization of data base management system (DBMS) (DBMS).
(3) Physical data model (Physical Data Model): be called for short physical model, it is the model of computer-oriented physical representation, described the institutional framework of data on storage medium, it is not only relevant with concrete DBMS, but also relevant with operating system and hardware.Each logic data model has all had the corresponding physical data model when realizing.DBMS is in order to guarantee its independence with portable, and the realization work of most of Physical data model system is again finished automatically, and the deviser only designs special constructions such as index, gathering.
The most frequently used in conceptual data model is E-R model, object oriented programming model and the predicate model of E-R model, expansion.The most frequently used in the logical data type is hierarchical model, network model, relational model.
(1) provide unified data definition center, the user needn't be concerned about type of database, is a kind of abstract entity form of expression.
(2) data structure, data manipulation and data constraint all are directly configurations in the browser, and the user need not to be concerned about the concrete form of underlying database.
(3) the momentum data model adopts tree structure, and each node abstraction is an entity, can edit concrete entity, and content edited comprises data field and field constraint etc.
System platform of the present invention provides unified data access interface, as shown in Figure 1, and wherein integrated CRM, ERP and three external systems of PDM.
Each external system is defined as several basic data models on system platform of the present invention, this platform provides two kinds of access stencils:
(1) a kind of is the real-time, interactive mode, promptly by integrated data that can the dynamic access external system;
(2) a kind of is the mode of timing acquiring, excessive when quantity, when requirement in real time is not very high, can adopt this to use mode, and platform provides a kind of Job mechanism, can make the user freely select integrated mode and time.
Two kinds of forms all need the partial data model in the external system (according to concrete operating position definition of data model) is defined on the system platform.
It is as follows how this dynamic data integration and dispatching system dispose the detailed step of the concrete processing of the relation of data definition in the data definition of this application system and the enterprise data model:
(1) need at first to confirm integrated external system (as: CRM);
(2) data source of configuring external system on platform;
(3) according to business demand definition of data model on platform;
(4) set up between data model and the external system and concern;
(5) mode of definition of data collection (real-time or timer access external data);
(6) data model that provides by step (3) is done business operation to corresponding external system.
How this member supports basic platform automatically divides other access data from each application data source according to this definition when using data, and converts enterprise's uniform data definition to by this definition, and makes new application system to use, and may further comprise the steps:
(1) at first new system is carried out detailed demand analysis;
(2) extract service logic;
(3) set up data model according to service logic;
(4) data model and other application data source are set up mapping relations;
(5) mode of definition of data collection;
(6) unify the service data model, visit the data source of other system by data model according to the mode of mapping relations that define and data acquisition.
Adopted the system and method for realizing cloud computing dynamic data integration and scheduling in the above-mentioned computer software, because wherein enterprise can set up the uniform data model and the data definition of enterprise-level, the relation of data definition in data definition by the fixed application system of collocation method and the enterprise data model simultaneously, new application system can use enterprise's uniform data definition to programme, the member supports basic platform is when using data, automatically divide other access data from each application data source according to this definition, and convert the definition of enterprise uniform data to by this definition and allow new application system use, thereby strengthened the reusability of member greatly, but assembleability, dirigibility, not only greatly reduce the implementation cost of software, and obviously shortened the cycle of software issue, the simultaneity factor framework is simply distinct, strengthened the ageing of data integration significantly, use is efficient and convenient, stable and reliable working performance, the scope of application is comparatively extensive, for further developing of component-based software technology and further applying of cloud computing component technology have been established solid foundation.
In this instructions, the present invention is described with reference to its certain embodiments.But, still can make various modifications and conversion obviously and not deviate from the spirit and scope of the present invention.Therefore, instructions and accompanying drawing are regarded in an illustrative, rather than a restrictive.
Claims (8)
1. realize the system of cloud computing dynamic data integration and scheduling in the computer software, comprise several external data subsystems, it is characterized in that, also comprise dynamic data integration platform and dynamic data dispatching platform in the described system, described each external data subsystem is connected with described dynamic data dispatching platform by described dynamic data integration platform, and described dynamic data dispatching platform has the uniform data access interface.
2. realize the system of cloud computing dynamic data integration and scheduling in the computer software according to claim 1, it is characterized in that, comprise data in real time interactive function module and data timing acquiring functional module in the described dynamic data integration platform, described data in real time interactive function module is connected with each external data subsystem respectively with data timing acquiring functional module.
3. realize the system of cloud computing dynamic data integration and scheduling in the computer software according to claim 1 and 2, it is characterized in that described external data subsystem is connected with described dynamic data integration platform by data access interface.
4. realize the system of cloud computing dynamic data integration and scheduling in the computer software according to claim 1 and 2, it is characterized in that described external data subsystem is CRM external data subsystem, ERP external data subsystem or PDM external data subsystem.
5. method that realizes cloud computing dynamic data integration and scheduling in the computer software based on the described system of claim 1 is characterized in that described method may further comprise the steps:
(1) system operates according to the user, sets up enterprise-level uniform data model and corresponding data definition;
(2) relation between the data definition of system configuration external data subsystem and described enterprise-level uniform data model and the corresponding data definition;
(3) the member supports basic platform in the system carries out data access operation to each external data subsystem respectively according to described relation in using data procedures;
(4) system becomes enterprise's uniform data definition according to described relation with the data-switching in each external data subsystem, and uses for new application system.
6. the method for cloud computing dynamic data integration and scheduling in the realization computer software according to claim 5, it is characterized in that, relation between the data definition of described configuring external data subsystem and described enterprise-level uniform data model and the corresponding data definition may further comprise the steps:
(21) system operates according to the user, need to confirm integrated external data subsystem;
(22) data source of system's configuring external data subsystem on described dynamic data integration platform;
(23) system is according to business demand definition of data model on described dynamic data integration platform;
(24) system sets up the corresponding relation between described data model and the external data subsystem;
(25) system operates according to the user, and the mode of data acquisition is set;
(26) system carries out business operation according to described data model to corresponding external data subsystem.
7. the method for cloud computing dynamic data integration and scheduling is characterized in that in the realization computer software according to claim 6, and the mode of described data acquisition is mutual collection of data in real time or data timing acquiring.
8. according to the method for cloud computing dynamic data integration and scheduling in each described realization computer software in the claim 5 to 7, it is characterized in that, described data-switching in each external data subsystem is become the definition of enterprise uniform data, may further comprise the steps:
(31) system extracts correspondent service logic according to the demand analysis that the user carried out;
(32) system sets up data model according to described service logic;
(33) system sets up mapping relations to described data model and external data subsystem;
(34) system is provided with the mode of data acquisition;
(35) system carries out the unified operation of data model, and visits corresponding external data subsystem by described data model according to the mapping relations of definition and the mode of data acquisition.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2010102229271A CN101901162A (en) | 2010-07-09 | 2010-07-09 | System and method for dynamic data integration and scheduling by cloud computing in computer software system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2010102229271A CN101901162A (en) | 2010-07-09 | 2010-07-09 | System and method for dynamic data integration and scheduling by cloud computing in computer software system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN101901162A true CN101901162A (en) | 2010-12-01 |
Family
ID=43226714
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN2010102229271A Pending CN101901162A (en) | 2010-07-09 | 2010-07-09 | System and method for dynamic data integration and scheduling by cloud computing in computer software system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101901162A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103747022A (en) * | 2011-12-31 | 2014-04-23 | 华茂云天科技(北京)有限公司 | Customer relation management system |
CN106570107A (en) * | 2016-11-01 | 2017-04-19 | 广西电网有限责任公司电力科学研究院 | Big data calculation and analysis scheme fruiting system |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1744037A (en) * | 2005-08-26 | 2006-03-08 | 南京邮电大学 | Method for avoiding grid computing application to depend on bottom development tool box |
US20080159506A1 (en) * | 2006-12-28 | 2008-07-03 | Bellsouth Intellectual Property Corporation | Network element provisioning and event simulation in a communications network |
CN101354696A (en) * | 2008-09-08 | 2009-01-28 | 北京航空航天大学 | Data integration and application service system based on electric communication field sharing information model |
US20100042720A1 (en) * | 2008-08-12 | 2010-02-18 | Sap Ag | Method and system for intelligently leveraging cloud computing resources |
CN101739460A (en) * | 2009-12-16 | 2010-06-16 | 中国科学院对地观测与数字地球科学中心 | Grid-based spatial data source unification service system and method |
-
2010
- 2010-07-09 CN CN2010102229271A patent/CN101901162A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1744037A (en) * | 2005-08-26 | 2006-03-08 | 南京邮电大学 | Method for avoiding grid computing application to depend on bottom development tool box |
US20080159506A1 (en) * | 2006-12-28 | 2008-07-03 | Bellsouth Intellectual Property Corporation | Network element provisioning and event simulation in a communications network |
US20100042720A1 (en) * | 2008-08-12 | 2010-02-18 | Sap Ag | Method and system for intelligently leveraging cloud computing resources |
CN101354696A (en) * | 2008-09-08 | 2009-01-28 | 北京航空航天大学 | Data integration and application service system based on electric communication field sharing information model |
CN101739460A (en) * | 2009-12-16 | 2010-06-16 | 中国科学院对地观测与数字地球科学中心 | Grid-based spatial data source unification service system and method |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103747022A (en) * | 2011-12-31 | 2014-04-23 | 华茂云天科技(北京)有限公司 | Customer relation management system |
CN106570107A (en) * | 2016-11-01 | 2017-04-19 | 广西电网有限责任公司电力科学研究院 | Big data calculation and analysis scheme fruiting system |
CN106570107B (en) * | 2016-11-01 | 2019-08-20 | 广西电网有限责任公司电力科学研究院 | A kind of big data calculating analytical plan achievement system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9800675B2 (en) | Methods for dynamically generating an application interface for a modeled entity and devices thereof | |
CN102663103B (en) | Configurable method for automatically generating database and accessing data | |
Gupta et al. | Cloud computing and big data analytics: what is new from databases perspective? | |
CN103279358B (en) | A kind of explanation type Service Component dynamic fixing method of Industry-oriented application | |
CN103714129B (en) | Dynamic data structure based on conditional plan and the construction device of relation and construction method | |
CN105224631B (en) | The method built the system of the open cloud of industry and work out XBRL financial statement | |
CN101763266A (en) | Platform system and method for realizing cloud component deployment and configuration of computer software system | |
CN103441900A (en) | Centralization cross-platform automated testing system and control method thereof | |
CN106951552A (en) | A kind of user behavior data processing method based on Hadoop | |
CN111061788A (en) | Multi-source heterogeneous data conversion integration system based on cloud architecture and implementation method thereof | |
CN102999537A (en) | System and method for data migration | |
CN103473108A (en) | Java code generating method | |
CN103279509A (en) | Fast inquiring method using dynamic inquiring language | |
CN101609473B (en) | Method and device for reconstructing structured query language of report inquiry | |
CN103631596A (en) | Configuration device and configuration method of business object data entry and updating rule | |
CN101826100A (en) | Automatic integrated system and method of wide area network (WAN)-oriented multisource emergency information | |
CN107103064A (en) | Data statistical approach and device | |
CN104461671A (en) | Method and system for periodically managing code modification report | |
Simitsis | Modeling and managing ETL processes. | |
CN103823660A (en) | Method and system for IT (information technology) operation and maintenance configuration management | |
CN109829660A (en) | Data processing system and its design method based on electric power enterprise grade data model | |
CN114218218A (en) | Data processing method, device and equipment based on data warehouse and storage medium | |
CN102567517A (en) | Device and method for issuing data of database | |
CN102420862B (en) | A kind of Internet of things middleware message form conversion method | |
CN104834742A (en) | ETL architecture management method based on SCA |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20101201 |