CN102307206B - Caching system and caching method for rapidly accessing virtual machine images based on cloud storage - Google Patents
Caching system and caching method for rapidly accessing virtual machine images based on cloud storage Download PDFInfo
- Publication number
- CN102307206B CN102307206B CN201010292102.7A CN201010292102A CN102307206B CN 102307206 B CN102307206 B CN 102307206B CN 201010292102 A CN201010292102 A CN 201010292102A CN 102307206 B CN102307206 B CN 102307206B
- Authority
- CN
- China
- Prior art keywords
- virtual machine
- node
- processing module
- caching
- service processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention relates to the technical field of cloud computing, in particular to a caching system and a caching method for rapidly accessing virtual machine images based on cloud storage. The system comprises a service processing module, a node cache management module, a cloud storage service processing module and a front-end cache management module, wherein the service processing module is configured on a computing node, receives and processes requests and determines whether to execute and distribute the requests; the node cache management module is configured on the computing node, stores new image files in a local node for caching, and searches for the virtual machine images cached in the local node; the cloud storage service processing module is configured on a management node, acquires image file blocks from a cloud storage system, and performs operations on the file blocks; and the front-end cache management module is configured on the management node, manages cached files on a front-end management node, searches for the virtual machine images from a local cache and stores the virtual machine image files into the local cache. By the system and the method, virtual machine creation time can be fully shortened, repeated data transmission among nodes can be avoided and the utilization rate of a network bandwidth can be increased; and the system and the method can be widely applied to virtual machine image caching.
Description
Technical field
The present invention relates to cloud computing technology field, refer in particular to a kind of caching method of caching system of the fast access virtual machine image based on cloud storage.
Background technology
Cloud computing is the development of distributed treatment (Distributed Computing), parallel processing (Parallel Computing) and grid computing (Grid Computing), its general principle is to move same task by a large amount of computers in network simultaneously, and every computer is just called a node.And these nodes are not the computer that the hardware composing such as traditional dependence CPU, mainboard, memory bar are got up, but on traditional computer, pass through the virtual computer out of Intel Virtualization Technology, it is exactly the unit using virtual machine as distributes calculation resources that these out virtual computers are just virtual machine, the core of cloud computing.
Cloud storage is in cloud computing (cloud computing) conceptive extension and a development new concept out, refer to by functions such as cluster application, grid or distributed file systems, a large amount of various dissimilar memory devices in network are gathered to collaborative work by application software, a system of data storage and Operational Visit function is externally provided jointly.
As can be seen here, cloud computing and cloud storage system are related mutually, and compared with cloud computing system, cloud storage can think to have configured a cloud computing system in large capacity storage space.How can be effectively the topic of a very worth discussion altogether by cloud computing and cloud storage node.But on cloud storage basis, provide the fast access of virtual machine image but also not see good realization.
Summary of the invention
The present invention's technical problem of dealing with problems is to provide a kind of caching system caching method of the fast access virtual machine image based on cloud storage, the method is utilized the powerful storage capacity of cloud storage system, the storage of virtual machine image is provided, realizes on this basis the fast access to virtual machine image buffer memory.
The technical scheme that the present invention solves the problems of the technologies described above is: comprise the following steps:
The 1st step, the service processing module of computing node receives the Web service request that creates virtual machine;
The 2nd step, the service processing module on computing node judges whether local node has enough resources to carry out this request;
If can, carry out the 3rd step; If not, the service processing module on computing node can be distributed to other computing nodes by this Web service request;
The 3rd step, the nodal cache administration module on computing node is searched the virtual machine image file of coupling according to Web service request;
If existed, the buffered results of coupling is returned to service processing module by nodal cache administration module, and service processing module is processed this request; If there is no, service processing module sends to the image file information in request on management node, carries out the 4th step;
The 4th step, management node receives after Web Service request, and front end caching management module is searched match data cached;
If existed, buffered results is returned to the service processing module on computing node by front end node, and the service processing module on computing node is by this result of buffer memory simultaneously;
If there is no, carry out the 5th step;
The 5th step, the cloud stores service processing module on management node is according to the description of virtual machine image file, goes to and in cloud storage system, searches virtual machine image file piece;
If existed, carry out the 6th step; If there is no, Query Result is returned to the computing node that sends this request;
The 6th step, the cloud stores service processing module on management node is decrypted virtual machine image file piece, and is reduced into complete virtual machine image after blocks of files is merged;
The 7th step, new virtual machine image is put into buffer memory by the front end caching management module on management node.
Described Web service request comprises service request classification, parameter and result.
Described the 2nd step, if local computing node does not have enough resources to carry out this Web service request, the service processing module on local computing node sends to other computing nodes by this request classification and parameter with Web service form.
Described the 4th step, if the front end buffer process module on management node has been found the virtual machine image file matching in caching system, computing node also can this virtual machine image of buffer memory in the time carrying out Web service request in local cache.
Described the 5th step, meets if do not existed in cloud storage system the record that virtual machine image is described, and computing node can occur mistake by prompt system.
Described the 7th step, on management node, data cached metamessage is to be stored in embedded database.
Adopt system and method for the present invention can fully shorten the virtual machine creating time, avoid the transfer of data that repeats between each node, strengthen network bandwidth utilization factor; Improve the speed of service.
Brief description of the drawings
Below in conjunction with accompanying drawing, the present invention is further described:
Fig. 1 is the caching system schematic diagram that the present invention is based on the fast access virtual machine image of cloud storage;
Fig. 2 is the schematic diagram that the present invention is based on the caching system implementation step of the fast access virtual machine image of cloud storage.
Embodiment
As shown in Figure 1, service processing module 1, nodal cache administration module 2, cloud stores service processing module 3 and cloud stores service processing module 4 have been the present invention includes; Service processing module 1 is deployed on computing node, for receiving request, process request, determining whether carry out request and dispense request.Nodal cache administration module 2 is deployed on computing node, for new image file is saved in to local node buffer memory, searches on local node the virtual machine image of buffer memory.Cloud stores service processing module 3 is deployed on management node, for obtain image file piece from cloud storage system, and these blocks of files is operated, and makes it be reduced to an available image file.Front end caching management module 4 is deployed on management node, and the cache file on management front end management node is searched virtual machine image in local cache, and virtual machine image file is saved in to local cache.
As shown in Figure 2, the present invention is based on the caching system of the fast access virtual machine image of cloud storage, its caching method comprises the following steps:
The 1st step, the service processing module 1 of computing node receives the Web service request that creates virtual machine;
The 2nd step, the service processing module 1 on computing node judges whether local node has enough resources to carry out this request;
If can, carry out the 3rd step; If not, the service processing module 1 on computing node can be distributed to other computing nodes by this Web service request;
The 3rd step, the nodal cache administration module 2 on computing node is searched the virtual machine image file of coupling according to Web service request;
If existed, the buffered results of coupling is returned to service processing module 1 by nodal cache administration module 2, and service processing module 1 is processed this request; If there is no, service processing module 1 sends to the image file information in request on management node, carries out the 4th step;
The 4th step, management node receives after Web Service request, and front end caching management module 4 is searched match data cached;
If existed, buffered results is returned to the service processing module 1 on computing node by front end node, and the service processing module 1 on computing node is by this result of buffer memory simultaneously;
If there is no, carry out the 5th step;
The 5th step, the cloud stores service processing module 3 on management node is according to the description of virtual machine image file, goes to and in cloud storage system, searches virtual machine image file piece;
If existed, carry out the 6th step; If there is no, Query Result is returned to the computing node that sends this request;
The 6th step, the cloud stores service processing module 3 on management node is decrypted virtual machine image file piece, and is reduced into complete virtual machine image after blocks of files is merged;
The 7th step, new virtual machine image is put into buffer memory by the front end caching management module 4 on management node.
In aforementioned method steps, Web service request comprises service request classification, parameter and result.The 2nd step, if local computing node does not have enough resources to carry out this Web service request, the service processing module 1 on local computing node sends to other computing nodes by this request classification and parameter with Web service form.The 4th step, if the front end buffer process module 4 on management node has been found the virtual machine image file matching in caching system, computing node also can this virtual machine image of buffer memory in the time carrying out Web service request in local cache.The 5th step, meets if do not existed in cloud storage system the record that virtual machine image is described, and computing node can occur mistake by prompt system.The 7th step, on management node, data cached metamessage is to be stored in embedded database.
Claims (11)
1. the caching method of the caching system of the fast access virtual machine image based on cloud storage, is characterized in that: comprise the following steps:
The 1st step, the service processing module (1) of computing node receives the Web service request that creates virtual machine;
The 2nd step, the service processing module (1) on computing node judges whether local node has enough resources to carry out this request;
If can, carry out the 3rd step; If not, the service processing module on computing node (1) can be distributed to other computing nodes by this Web service request;
The 3rd step, the nodal cache administration module (2) on computing node is searched the virtual machine image file of coupling according to Web service request;
If existed, the buffered results of coupling is returned to service processing module (1) by nodal cache administration module (2), and service processing module (1) is processed this request; If there is no, service processing module (1) sends to the image file information in request on management node, carries out the 4th step;
The 4th step, management node receives after Web Service request, and front end caching management module (4) is searched match data cached;
If existed, buffered results is returned to the service processing module (1) on computing node by front end node, and the service processing module (1) on computing node is by this result of buffer memory simultaneously;
If there is no, carry out the 5th step;
The 5th step, the cloud stores service processing module (3) on management node is according to the description of virtual machine image file, goes to and in cloud storage system, searches virtual machine image file piece;
If existed, carry out the 6th step; If there is no, Query Result is returned to the computing node that sends this request;
The 6th step, the cloud stores service processing module (3) on management node is decrypted virtual machine image file piece, and is reduced into complete virtual machine image after blocks of files is merged;
The 7th step, new virtual machine image is put into buffer memory by the front end caching management module (4) on management node.
2. caching method according to claim 1, is characterized in that: described Web service request comprises service request classification, parameter and result.
3. caching method according to claim 1, it is characterized in that: described the 2nd step, if local computing node does not have enough resources to carry out this Web service request, the service processing module (1) on local computing node sends to other computing nodes by this request classification and parameter with Web service form.
4. caching method according to claim 2, it is characterized in that: described the 2nd step, if local computing node does not have enough resources to carry out this Web service request, the service processing module (1) on local computing node sends to other computing nodes by this request classification and parameter with Web service form.
5. according to the caching method described in claim 1,2,3 or 4, it is characterized in that: described the 4th step, if the front end buffer process module (4) on management node has been found the virtual machine image file matching in caching system, computing node also can this virtual machine image of buffer memory in the time carrying out Web service request in local cache.
6. according to the caching method described in claim 1,2,3 or 4, it is characterized in that: described the 5th step, meet if do not existed in cloud storage system the record that virtual machine image is described, can there is mistake by prompt system in computing node.
7. caching method according to claim 5, is characterized in that: described the 5th step, meet if do not existed in cloud storage system the record that virtual machine image is described, and can there is mistake by prompt system in computing node.
8. according to the caching method described in claim 1,2,3 or 4, it is characterized in that: described the 7th step, on management node, data cached metamessage is to be stored in embedded database.
9. caching method according to claim 5, is characterized in that: described the 7th step, on management node, data cached metamessage is to be stored in embedded database.
10. caching method according to claim 6, is characterized in that: described the 7th step, on management node, data cached metamessage is to be stored in embedded database.
11. caching methods according to claim 7, is characterized in that: described the 7th step, on management node, data cached metamessage is to be stored in embedded database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010292102.7A CN102307206B (en) | 2010-09-25 | 2010-09-25 | Caching system and caching method for rapidly accessing virtual machine images based on cloud storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010292102.7A CN102307206B (en) | 2010-09-25 | 2010-09-25 | Caching system and caching method for rapidly accessing virtual machine images based on cloud storage |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102307206A CN102307206A (en) | 2012-01-04 |
| CN102307206B true CN102307206B (en) | 2014-10-01 |
Family
ID=45381015
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010292102.7A Active CN102307206B (en) | 2010-09-25 | 2010-09-25 | Caching system and caching method for rapidly accessing virtual machine images based on cloud storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102307206B (en) |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105808165B (en) * | 2016-03-03 | 2019-03-15 | 天津书生云科技有限公司 | Method and device for accessing storage device by virtual machine in cloud computing management platform |
| CN102629941B (en) * | 2012-03-20 | 2014-12-31 | 武汉邮电科学研究院 | Caching method of a virtual machine mirror image in cloud computing system |
| US8880638B2 (en) * | 2012-06-18 | 2014-11-04 | International Business Machines Corporation | Distributed image cache for servicing virtual resource requests in the cloud |
| CN102739785B (en) * | 2012-06-20 | 2014-12-17 | 东南大学 | Method for scheduling cloud computing tasks based on network bandwidth estimation |
| CN102932415B (en) * | 2012-09-26 | 2015-04-15 | 东软集团股份有限公司 | Method and device for storing mirror image document |
| US9218193B2 (en) | 2013-07-12 | 2015-12-22 | International Business Machines Corporation | Distributed virtual machine image management for cloud computing |
| CN103455577A (en) * | 2013-08-23 | 2013-12-18 | 中国科学院计算机网络信息中心 | Multi-backup nearby storage and reading method and system of cloud host mirror image file |
| CN104572274A (en) * | 2013-10-18 | 2015-04-29 | 宇宙互联有限公司 | Cross-cloud-node migration system and cross-cloud-node migration method |
| CN105635273A (en) * | 2015-12-25 | 2016-06-01 | 国云科技股份有限公司 | Method for enhancing private cloud network bandwidth utilization rate |
| CN106371889B (en) * | 2016-08-22 | 2020-05-29 | 浪潮(北京)电子信息产业有限公司 | Method and device for realizing high-performance cluster system of scheduling mirror image |
| CN108076078A (en) * | 2016-11-09 | 2018-05-25 | 北京金山云网络技术有限公司 | A kind of cloud host creation method, device and cloud service system |
| CN108475201B (en) * | 2016-11-24 | 2021-02-26 | 华为技术有限公司 | Data acquisition method in virtual machine starting process and cloud computing system |
| CN108540510B (en) * | 2017-03-02 | 2021-11-05 | 北京金山云网络技术有限公司 | Cloud host creation method and device and cloud service system |
| CN111800442B (en) * | 2019-04-08 | 2022-10-28 | 阿里巴巴集团控股有限公司 | Network system, mirror image management method, device and storage medium |
| CN111158851B (en) * | 2019-12-10 | 2022-04-29 | 航天物联网技术有限公司 | Rapid deployment method of virtual machine |
| CN112363795B (en) * | 2020-10-13 | 2021-11-26 | 南京赛宁信息技术有限公司 | Method and system for quickly starting virtual machine of network security practical training platform |
| CN113778615B (en) * | 2021-08-06 | 2022-04-15 | 北京永信至诚科技股份有限公司 | Rapid and stable network shooting range virtual machine construction system |
| CN115794319A (en) * | 2023-02-07 | 2023-03-14 | 天翼云科技有限公司 | Edge computing storage service providing method, device, electronic equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101662483A (en) * | 2008-08-28 | 2010-03-03 | 盛大计算机（上海）有限公司 | Cache system for cloud computing system and method thereof |
| CN101753617A (en) * | 2009-12-11 | 2010-06-23 | 中兴通讯股份有限公司 | Cloud storage system and method |
| CN101819545A (en) * | 2010-04-09 | 2010-09-01 | 济南银泉科技有限公司 | Method for realizing platform migration by using virtualization technology |
| EP2228719A1 (en) * | 2009-03-11 | 2010-09-15 | Zimory GmbH | Method of executing a virtual machine, computing system and computer program |
| CN101840346A (en) * | 2009-12-30 | 2010-09-22 | 北京世纪互联宽带数据中心有限公司 | Method and system for deploying cloud host computer |
-
2010
- 2010-09-25 CN CN201010292102.7A patent/CN102307206B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101662483A (en) * | 2008-08-28 | 2010-03-03 | 盛大计算机（上海）有限公司 | Cache system for cloud computing system and method thereof |
| EP2228719A1 (en) * | 2009-03-11 | 2010-09-15 | Zimory GmbH | Method of executing a virtual machine, computing system and computer program |
| CN101753617A (en) * | 2009-12-11 | 2010-06-23 | 中兴通讯股份有限公司 | Cloud storage system and method |
| CN101840346A (en) * | 2009-12-30 | 2010-09-22 | 北京世纪互联宽带数据中心有限公司 | Method and system for deploying cloud host computer |
| CN101819545A (en) * | 2010-04-09 | 2010-09-01 | 济南银泉科技有限公司 | Method for realizing platform migration by using virtualization technology |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102307206A (en) | 2012-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102307206B (en) | Caching system and caching method for rapidly accessing virtual machine images based on cloud storage | |
| CN109254733B (en) | Method, device and system for storing data | |
| CN105144121B (en) | Cache content addressable data block is for Storage Virtualization | |
| US10114682B2 (en) | Method and system for operating a data center by reducing an amount of data to be processed | |
| US20160132541A1 (en) | Efficient implementations for mapreduce systems | |
| Kim et al. | GTS: A fast and scalable graph processing method based on streaming topology to GPUs | |
| JP5006348B2 (en) | Multi-cache coordination for response output cache | |
| CN104881466B (en) | The processing of data fragmentation and the delet method of garbage files and device | |
| US20230214225A1 (en) | Effective and scalable building and probing of hash tables using multiple gpus | |
| US20140379985A1 (en) | Multi-level aggregation techniques for memory hierarchies | |
| WO2013078583A1 (en) | Method and apparatus for optimizing data access, method and apparatus for optimizing data storage | |
| TW201220197A (en) | for improving the safety and reliability of data storage in a virtual machine based on cloud calculation and distributed storage environment | |
| CN111708719B (en) | Computer storage acceleration method, electronic equipment and storage medium | |
| CN111258978B (en) | Data storage method | |
| CN103399894A (en) | Distributed transaction processing method on basis of shared storage pool | |
| CN109284195A (en) | A kind of real-time representation data calculation method and system | |
| CN108573029B (en) | Method, device and storage medium for acquiring network access relation data | |
| CN103198097A (en) | Massive geoscientific data parallel processing method based on distributed file system | |
| CN108540510B (en) | Cloud host creation method and device and cloud service system | |
| CN103491155A (en) | Cloud computing method and system for achieving mobile computing and obtaining mobile data | |
| CN106874067B (en) | Parallel computing method, device and system based on lightweight virtual machine | |
| CN114201421A (en) | Data stream processing method, storage control node and readable storage medium | |
| CN113392863A (en) | Method and device for acquiring machine learning training data set and terminal | |
| CN107391402A (en) | A kind of data operating method, device and a kind of data operation card | |
| KR101765725B1 (en) | System and Method for connecting dynamic device on mass broadcasting Big Data Parallel Distributed Processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |