CN103237042A - Elastic cloud platform storage and scheduling system model based on XEN - Google Patents
Elastic cloud platform storage and scheduling system model based on XEN Download PDFInfo
- Publication number
- CN103237042A CN103237042A CN2012104884074A CN201210488407A CN103237042A CN 103237042 A CN103237042 A CN 103237042A CN 2012104884074 A CN2012104884074 A CN 2012104884074A CN 201210488407 A CN201210488407 A CN 201210488407A CN 103237042 A CN103237042 A CN 103237042A
- Authority
- CN
- China
- Prior art keywords
- data
- virtual
- distributed
- virtual machine
- file system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses an elastic cloud platform storage and scheduling system model based on the XEN. Virtual machines in the platform all run on the XEN. Virtual disks required by the virtual machines are stimulated from a distributed virtual block storage device DVBD which is based on an Hbase and an HDFS (Hadoop distributed file system). The HDFS is a distributed file system on a Hadoop, and all data on the HDFS are redundant and back-up while security of data in the virtual machines is guaranteed; and otherwise, the data on the HDFS are distributed and free of physical locations, so that the virtual machines are free of physical locations. When one virtual machine is in failure, the virtual machine can be switched off or removed by the platform. Reliability and sustainability of the data are guaranteed. The platform further comprises a scheduling system which is used for performing source scheduling of the virtual machines of the platform.
Description
Technical field
The present invention relates to computer application field, particularly relate to the design of a kind of virtual memory and dispatching patcher
Background technology
With the growth of this Internet scope of the enterprise, nearly all enterprise faces following problem:
(1) guarantee the safety of data: and along with the growth of server cluster, it is a very usual thing that the machine hard disk breaks down.But the data on the hard disk can not be lost, because data are lifelines of the Internet enterprise, we can say and have lost data, and the chance of development may just have been lost by this Internet enterprise.Even therefore all the Internet enterprises must guarantee that the physical machine hard disk breaks down, data can not be lost.
(2) guarantee reliability of service: in order to improve user's experience, the service on the Internet must be to want whole day service in 24 hours, so even the Internet enterprise will guarantee some physical machine crash to be fallen, these services should not dredged and be subjected to any influence.
(3) reduction of cost: along with the growth of mutual footwear net, the cost of enterprise is also in rapid increase.It is reported that domestic certain electricity charge in 1 year of tame Internet firm have all surpassed 100,000,000 yuan, add general enterprise and all will change 1/3rd server every year that these expenses all are that each big the Internet enterprise is difficult to bear.We can say future competition more bundle heal strong interconnected in, who has reduced cost, who will win the world.
(4) improve resource utilization: because the inequality of Internet Server pressure has caused the average utilization of server to descend.The average utilization of overwhelming majority web server remains on about 10% substantially.At present domestic interconnected gold industry resource utilization also has bigger gap more abroad.
Summary of the invention
Technical problem to be solved by this invention provides the elasticity cloud platform of a kind of XEN, solves the low problem of resource utilization.
For achieving the above object, the invention provides distributed virtual piece design Storage, comprise HDFS, Hbase.
Described HDFS is used for: ensure Information Security, because all data all have the copy backup, so the damage of individual machine can't cause losing of data; Secondly, in distributed file system, the user reads long-range file or local file system all is the same.So file specifically deposit path, machine location etc., all be transparent for the user.
Described Hbase is used for: solves the Internet business data and sharply expands, and traditional relational data data that are difficult to support magnanimity like this slowly.Along with the development of cloud computing, will advance the development of distributed data base greatly.The same with all common KEY-VALEU, Hbase provides three interfaces:
(1) get (key): obtain corresponding value according to key;
(2) put (key, value): a newly-built key/value is right, perhaps upgrades the value of the key correspondence existed;
(3) delete (key): delete a key and corresponding value thereof.
It is a kind of based on XEN elasticity cloud dispatching platforms system that the present invention also provides, and comprising: Master, Cluster, Agent
Described Master is used for: the core of dispatching patcher, and physical resource and VM running statuses all in the system all are kept among the Master, and all VM are Guaranteed at it.Also be responsible for receiving external message simultaneously.
Described Cluster is used for: be responsible for the state-maintenance of VM and the forwarding of message.
Described Agent is used for: control VM, operate on each physical machine, and be responsible for the control virtual machine, for example configuring virtual machine reports virtual machine heartbeat etc.
Preferably have, in the said method, also comprise: command messages processing, heartbeat message and VM service data are handled.
By such scheme as can be seen, the joint source of dummy block will storage node dispatching patcher constitutes elasticity cloud platform among the present invention, solves the problem of resources of virtual machine utilance.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, to do simple the introduction to the accompanying drawing of required use in embodiment or the description of the Prior Art below, apparently, accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is elasticity cloud platform overall framework of the present invention;
Fig. 2 is HDFS Organization Chart in the embodiment of the invention one.
Embodiment
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, the present invention is further detailed explanation below in conjunction with the drawings and specific embodiments.Obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.
Embodiment one, referring to Fig. 2.
The invention provides a kind ofly based on distributed design Storage, described system comprises HDFS.
Wherein:
HDFS、Hbase。
Described HDFS is used for: ensure Information Security, because all data all have the copy backup, so the damage of individual machine can't cause losing of data; Secondly, in distributed file system, the user reads long-range file or local file system all is the same.So file specifically deposit path, machine location etc., all be transparent for the user.
Described Hbase is used for: solves the Internet business data and sharply expands, and traditional relational data data that are difficult to support magnanimity like this slowly.Along with the development of cloud computing, will advance the development of distributed data base greatly.The same with all common KEY-VALEU, Hbase provides three interfaces:
(1) get (key): obtain corresponding value according to key;
(2) put (key, value): a newly-built key/value is right, perhaps upgrades the value of the key correspondence existed;
(3) delete (key): delete a key and corresponding value thereof.
The course of work of said system specifically may further comprise the steps referring to Fig. 2:
Adopt the master/slave pattern.Under this pattern, read to read from multiple spot, when writing, need write data to all copies in the cluster.When reading valuel among the figure, can at will look for data that have valuel, and when writing value3, need think that all copy machines write vahe3, just three machines among the figure.The safety of the data of so just having accelerated data reading speed and having guaranteed, even if a certain machine hung, data are still alive, in addition in HDFS, we see a unified NameNodes, and metadata (Metadata) has been deposited in this machine the inside. and this Metadata the inside is protected
The Back ground Informations such as concrete deposit position of these data have been deposited.Certainly NameNodes only is the manager of data, and it is managing the copy control of all data, heartbeat of DataNodes etc.But all data can't so just can improve the fail safe of NameNodes greatly through here.Certainly because NameNodes is unique manager of global data, so add a HA server to NameNodes.
Therefore HDFS provided by the invention has following advantage for common file system.
(1) Information Security: because all data all have the copy backup, so the damage of individual machine can't cause losing of data.
(2) resource-sharing: in distributed file system, the user reads long-range file or this her file
Embodiment one, referring to Fig. 1, Fig. 2
It is a kind of based on XEN elasticity cloud dispatching platforms system that the present invention also provides, and comprising: Master, Cluster, Agent
Described Master is used for: the core of dispatching patcher, and physical resource and VM running statuses all in the system all are kept among the Master, and all VM are Guaranteed at it.Also be responsible for receiving external message simultaneously.
Described Cluster is used for: be responsible for the state-maintenance of VM and the forwarding of message.
Described Agent is used for: control VM, operate on each physical machine, and be responsible for the control virtual machine, for example configuring virtual machine reports virtual machine heartbeat etc.
Description by above method embodiment, the those skilled in the art can be well understood to the present invention, and the distributed virtual piece is deposited by proposing, the dispatching patcher design, satisfy problem low to resource utilization in the virtualization system, UFSOFT strengthens fail safe under the XEN environment, and advantage such as reduce cost.
The above only is the specific embodiment of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the principle of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.
Claims (6)
1. the elasticity cloud platform based on XEN is stored and the dispatching patcher model, it is characterized in that, fictionalize piece memory device one by one a distributed file system, hard disc data all is to leave in the distributed file system, and the branch that all data all can be broken up is on many physical machine.
2. method according to claim 1 is characterized in that, optimized allocation of resources: a big purpose of whole elasticity cloud platform reduces cost exactly, excavates the potential of server as far as possible.Follow certain strategy so distribute virtual machine, the VM of many high I/O is concentrated on a certain physical machine, because the overall I/O of physical machine is limited, so such distribution can cause the CPU free time, I/O is wretched insufficiency but, if but VM and those the high VM that calculates of these high I/O is distributed in together, the utilance of total system just promotes.
3. method according to claim 1, it is characterized in that, guarantee the stalwartness operation of virtual machine: another general objective of elasticity cloud platform is for not interrupting of guaranteeing to serve, the fail safe of data, so whole dispatching patcher need go to safeguard oneself running status of all virtual machines under one's name, when a certain virtual machine breaks down, just can recover it according to certain strategy, certainly recover to comprise manual reversion and automatic fault switching here, generally speaking be exactly that dispatching patcher needs the real-time servicing vm health, and make correct processing according to corresponding fault.
4. method according to claim 1 is characterized in that, the collection of virtual machine service data: by collecting the service data of VM, and go to pass judgment on the type of VM according to these data.
5. method according to claim 1 is characterized in that, also comprises: the data redundancy backup in the distributed file system has guaranteed the fail safe of data.And operate in virtual machine on the distributed virtual piece memory device, because the characteristic of virtual machine, migration that can be random has increased reliability of service greatly.The cooperation of this two aspect has just ensured the not disruptive of fail safe and the service of data.
6. method according to claim 1 is characterized in that, also comprises:
(1) distributed file system and key-value system: the key-valuc system virtualization that is implemented in distributed file system is become a block device, because distributed system has just guaranteed the fail safe of data.Adopt the HDFS among the famous soft hadoop that increases income and the Hbase that is implemented in above it to realize;
(2) dummy block will storage: the virtual block device that comes out from the key-value system is gone inside being applied to virtual machine, so just can guarantee the fail safe of virtual-machine data;
(3) based on the realization of image snapshot and the cow (copy on write) of distributed virtual piece memory device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012104884074A CN103237042A (en) | 2012-11-16 | 2012-11-16 | Elastic cloud platform storage and scheduling system model based on XEN |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012104884074A CN103237042A (en) | 2012-11-16 | 2012-11-16 | Elastic cloud platform storage and scheduling system model based on XEN |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103237042A true CN103237042A (en) | 2013-08-07 |
Family
ID=48885058
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012104884074A Pending CN103237042A (en) | 2012-11-16 | 2012-11-16 | Elastic cloud platform storage and scheduling system model based on XEN |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103237042A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104219318A (en) * | 2014-09-15 | 2014-12-17 | 北京联创信安科技有限公司 | Distributed file storage system and method thereof |
| CN104750757A (en) * | 2013-12-31 | 2015-07-01 | ***通信集团公司 | Data storage method and equipment based on HBase |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120136960A1 (en) * | 2010-11-29 | 2012-05-31 | Beijing Z & W Technology Consulting Co., Ltd | Cloud Storage Data Access Method, Apparatus and System |
| CN102724215A (en) * | 2012-07-07 | 2012-10-10 | 成都国腾实业集团有限公司 | Method for storing user key safely and improving data security of cloud platform based on user login password |
-
2012
- 2012-11-16 CN CN2012104884074A patent/CN103237042A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120136960A1 (en) * | 2010-11-29 | 2012-05-31 | Beijing Z & W Technology Consulting Co., Ltd | Cloud Storage Data Access Method, Apparatus and System |
| CN102724215A (en) * | 2012-07-07 | 2012-10-10 | 成都国腾实业集团有限公司 | Method for storing user key safely and improving data security of cloud platform based on user login password |
Non-Patent Citations (1)
| Title |
|---|
| 徐永: "《基于XEN的弹性云平台的研究》", 《中国优秀硕士学位论文全文数据库》, 31 December 2010 (2010-12-31), pages 21 - 61 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104750757A (en) * | 2013-12-31 | 2015-07-01 | ***通信集团公司 | Data storage method and equipment based on HBase |
| CN104750757B (en) * | 2013-12-31 | 2018-05-08 | ***通信集团公司 | A kind of date storage method and equipment based on HBase |
| CN104219318A (en) * | 2014-09-15 | 2014-12-17 | 北京联创信安科技有限公司 | Distributed file storage system and method thereof |
| CN104219318B (en) * | 2014-09-15 | 2018-02-13 | 北京联创信安科技股份有限公司 | A kind of distributed file storage system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102981931B (en) | Backup method and device for virtual machine | |
| US9513946B2 (en) | Maintaining high availability during network partitions for virtual machines stored on distributed object-based storage | |
| US9785523B2 (en) | Managing replicated virtual storage at recovery sites | |
| CN104081354B (en) | Subregion is managed in scalable environment | |
| CN105659562B (en) | It is a kind of for hold barrier method and data processing system and include for holds hinder computer usable code storage equipment | |
| CN104427002A (en) | Cluster system and method for providing service availability in cluster system | |
| CN103414712B (en) | A kind of distributed virtual desktop management system and method | |
| WO2015116483A1 (en) | Prioritizing data reconstruction in distributed storage systems | |
| US9223626B2 (en) | Task execution and management in a clustered computing environment | |
| KR20140074311A (en) | System and method for supporting a dynamic resource broker in a transactional middleware machine environment | |
| Barr et al. | Building fault-tolerant applications on AWS | |
| US10705754B2 (en) | Zero-data loss recovery for active-active sites configurations | |
| CN105335251A (en) | Fault recovery method and system | |
| CN104142847A (en) | Stateless virtual machine under cloud computation environment and application thereof | |
| CA2969210A1 (en) | Method, apparatus, and computer-readable medium for processing a message by a message broker system | |
| CN108038201B (en) | A kind of data integrated system and its distributed data integration system | |
| CN105493474A (en) | System and method for supporting partition level journaling for synchronizing data in a distributed data grid | |
| CN105635311A (en) | Method for synchronizing resource pool information in cloud management platform | |
| US20140136878A1 (en) | Scaling Up and Scaling Out of a Server Architecture for Large Scale Real-Time Applications | |
| CN102523257A (en) | Infrastructure as a service (IAAS)-cloud-platform-based virtual machine fault-tolerance method | |
| CN102968457B (en) | Database method for switching between and system | |
| CN105357042A (en) | High-availability cluster system, master node and slave node | |
| CN103297264B (en) | Cloud platform failure recovery method and system | |
| CN103237042A (en) | Elastic cloud platform storage and scheduling system model based on XEN | |
| US10461991B1 (en) | Dynamic replication peering |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130807 |