CN102546780A - Operation method for file distributed storage based on thin client - Google Patents

Operation method for file distributed storage based on thin client Download PDF

Info

Publication number
CN102546780A
CN102546780A CN2011104480409A CN201110448040A CN102546780A CN 102546780 A CN102546780 A CN 102546780A CN 2011104480409 A CN2011104480409 A CN 2011104480409A CN 201110448040 A CN201110448040 A CN 201110448040A CN 102546780 A CN102546780 A CN 102546780A
Authority
CN
China
Prior art keywords
file
client computer
storage
server
client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011104480409A
Other languages
Chinese (zh)
Other versions
CN102546780B (en
Inventor
张海霞
王君君
薛良飞
党飞
颜廷芝
冯新建
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong University
Original Assignee
Shandong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong University filed Critical Shandong University
Priority to CN201110448040.9A priority Critical patent/CN102546780B/en
Publication of CN102546780A publication Critical patent/CN102546780A/en
Application granted granted Critical
Publication of CN102546780B publication Critical patent/CN102546780B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to an operation method for file distributed storage based on thin client, which belongs to the technical field of distributed storage. A system for implementing the method includes a thin client and so on. The operation method comprises the steps of constructing a LAMP (Linux, Apache, MySQL and PHP) architecture on a MFS (MooseFS) client; deploying source files of a web disk below Apache of the architecture; setting a file folder on the MFS client to serve as the store directory of files uploaded by a subscriber, and setting the store directory as a mount directory of the client; and the client executing distributed read-write operation based on the directory to achieve distributed storage of the files uploaded by the subscriber. The subscriber can view the Web page of the web disk to execute file uploading and downloading operation by accessing the web disk below Apache through the internet. The method provided by the invention changes the conventional network storage and local storage modes, breaks the performance bottleneck of a single server for concentrated storage, and provides a novel storage mode by combining network storage with distributed storage, thereby greatly improving the storage performance.

Description

A kind of operation method of storing based on the file distribution formula of thin-client
Technical field
The present invention relates to a kind of operation method of storing based on the file distribution formula of thin-client, belong to technical field of distributed memory.
Background technology
Along with the application and the development of cloud computing, will serve in a large number with resource and be placed on the remote server cluster, the pattern that the user only needs from the terminal or PC visits resource needed becomes a kind of epoch trend.And,, will cause the redundant and waste of local resource if adopt the PC that costs an arm and a leg, disposes high-end and complicated operation for this pattern.So, arise at the historic moment based on the novel information pattern of " thin-client+network+cloud computing server ".Thin-client is local a no hard disk, only the client of browser is housed, and is furnished with the most simply to import (keyboard, mouse) and output equipment (display) and accomplish the function with network service.Do not have memory space in this locality in view of thin-client, so how user's privately owned file is effectively stored and managed becomes a key issue that must solve.The present invention accomplishes the safe and effective storage to user file through network disk and distributed memory system, has broken through the traditional document memory module.
The traditional document storage is divided into the local storage and the network storage.Wherein, local storage be with file storage among the hard disk of computer, the size of hard disk is had high requirements.And the network storage be with the file data centralized stores on a server, the performance of storage server becomes the bottleneck of systematic function, also is faced with the problem of reliability and fail safe.And present network storage disk; Like 115 net dishes, 126 net dishes, association's net dish etc. all is to PC service to be provided; Need some technical support of operating system toward contact, exist that transmission speed is slow, poor stability, operation costs are high, recovery capability is low problem.Though for improving the server bottleneck of centralized stores; There are many load balance scheduling algorithms to propose; But remain based on centralized stores; Problem is not solved well, is 200710152665 like the patent No., and the patent that name is called " storage subsystem, master computer, storage system, load-balancing method and program " just belongs to these row.
The novel distributed storage system gathers collaborative work with a large amount of dissimilar memory devices, and data are disperseed to be stored on the equipment of many platform independent, forms the data-storage system of a safety, and access interface externally is provided.It adopts extendible system configuration, utilizes many storage servers to share the storage load, through management server location stored information, has improved reliability, availability, extensibility and the storage efficiency of storage system greatly.Under all very huge situation of data access amount and file storage amount, distributed memory system is undoubtedly a kind of efficient highly reliable storage mode.Traditional memory module can not satisfy user's demand, and distributed storage will become the memory module of main flow.
Summary of the invention
To the deficiency of traditional document memory module and the restriction of thin-client itself; The present invention proposes a kind of operation method of storing based on the file distribution formula of thin-client; Being intended to provides a kind of effective document memory module based on thin-client with traditional network storage and the organic set of distributed storage.
Technical scheme of the present invention is following:
A kind of operation method of storing based on the file distribution formula of thin-client; Realize by following system; This system comprises thin-client, network disk and MooseFS (being called for short MFS); Wherein thin-client is based on the client of built-in Linux operating system, and it only provides input-output equipment and Web browser; Network disk is based on the network file storage application system of Web; MFS is a kind of distributed file system; Its file system structure comprises management server (master), metadata log server (metalogger), data storage server (chunkservers) and client computer (client); Running between thin-client, network disk and the MFS three is: form an extendible server cluster by many physical servers; On every physical server, fictionalize the virtual machine of many stylobates, on the virtual machine of server cluster, build MFS, on the client computer of MFS, build LAMP (Linux+Apache+MySQL+PHP) framework in (SuSE) Linux OS; The network disk source file is placed under the Apache; The network disk database is placed under the Mysql, the storage directory of a file as user's upload file is set on the client computer of MFS, and with the mount directory of this storage directory as client computer; The kernel of Client OS can be the operation of file under this catalogue (newly-built, read, revise) is passed to the fuse module; This module can and the mfsmount process communicate, the mfsmount process communicates through network and management server and data storage server again, client computer just can be carried out distributed read-write operation based on this storage directory like this; The user on the thin-client through the network disk under the internet access Apache; The user just can see the Web page of network disk on the browser of thin-client, the uploading and down operation of execute file, and this operation method step is following:
1) on the virtual machine of server cluster, build MFS, and at the client computer deploy LAMP of MFS framework, the network disk source file is placed under the Apache of LAMP framework, the database file of network disk is placed under the MySQL of LAMP framework;
A) virtual machine is selected: select a virtual machine as management server; Select another virtual machine as the metadata log server; Select other many (>=3) virtual machines as data storage server; Select the virtual machine as client computer in addition again, these virtual machines all are based on (SuSE) Linux OS;
B) dispose management server: editor's configuration file is set, and appointment can long-rangely be mounted to the IP address of the client computer of MFS management server, and authorizes this client access authority;
C) dispose the metadata log server: editor's configuration file is set, indicates the IP address of management server, be used to carry out data backup, data shift and recovery so that when management server breaks down, carry out;
D) dispose data storage server: newly-increased hard disk is separately for MFS carries out file storage, and editor's configuration file, indicates the IP address and the COM1 of management server;
E) dispose client computer: the fuse module is installed carries out the carry deployment;
2) configuration file of modification PHP is to increase the file size that the user can upload;
3) storage directory of a file as user's upload file is set on the client computer of MFS, and this storage directory is set at the mount directory that client computer is mounted to management server;
4) Apache under startup MFS and the LAMP framework;
5) user logins the network disk Web page from the thin-client browser, after registering and landing, in storage directory, produces with the file of this user name name memory space as this user, changes step 6) and step 7) then respectively over to;
6) user carries out the upload operation of file based on the privately owned storage folder of oneself, and the user clicks file and uploads button, and the Apache on client computer submits upload request to, after its response, file is uploaded to memory space.Client computer can be sent the request of writing to management server, and MFS carries out write operation, and this user's under the storage directory the file of uploading is divided into a plurality of data block store in data storage server, realizes distributed storage, changes step 8) then over to;
7) user carries out the down operation of file based on the privately owned storage folder of oneself, and the user clicks download button, submits request to Apache, after its response, reads file to file storage.Client computer can be sent read request to management server; MFS carries out read operation; From each data storage server, read the data block information of this document; Client computer is integrated the data block information of obtaining and turn back in the mount directory, realizes the merging to the distributed document data block, changes next step then over to;
8) after the read-write operation, the user sees network disk Web renewal of the page content afterwards through thin-client.
Above-mentioned LAMP is one group of open source software that is used for building dynamic website or server building on the client computer of MFS, comprises Linux, Apache, MySQL and PHP, has formed a powerful web application platform jointly.Wherein, Linux is in lowermost layer, and operating system is provided; Inferior low layer is Apache, and it is a Web server, and Apache provides the mechanism that can let the user obtain the Web page; MySQL is a small-sized Relational DBMS, the storage data; PHP is the abbreviation of English supertext preliminary treatment language Hypertext Preprocessor; Mean the supertext preliminary treatment, the embedded language of its a kind of HTML is a kind of script of the embedding html document of carrying out at server end; The style of language is similar to the C language, by utilization widely.
Above-mentioned network disk is the network file storage application system that is deployed under the LAMP framework, and its source file is based on the PHP language, comprises JavaScript, HTML, CSS, PHP and database file.Wherein, JavaScript is a kind of based on object and event-driven and have the client script language of relative safety, also is simultaneously a kind of script that is widely used in client Web exploitation, is commonly used to add dynamic function to html web page; CSS is English Cascading Style Sheets (CSS be'ss single) abbreviation, and it is a kind of computer language that is used for showing file styles such as HTML or XML.The network disk source file is placed under the Apache, and database file is placed under the MySQL, and the user can obtain the Web page of this network disk through Apache.
Above-mentioned server cluster is that many physical servers are put together the cluster that carries out together with a kind of service, similarly is to have only a server In the view of the user.
Above-mentioned virtual machine (Virtual Machine) be meant through software simulation have the complete hardware system function, operate in a complete computer in the complete isolation environment.Can on a physical computer, simulate one or more virtual computer, these virtual machines can carry out work fully as real computer.
Above-mentioned Apache is the Web server under the LAMP framework just, for the user provides visit Web the mechanism of the page.
Above-mentioned fuse module is user's space file system (Filesystem in Userspace) module, is to be used for the module of some cyberspace of carry to local file system among the Linux.The Fuse module provides the interface of a file operation, fuse monitoring file operation on this interface then, in case there is operation (newly-built, read, revise) to take place, the fuse module can hand over control the mfsmount process to handle.
Above-mentioned mfsmount process is the process of among the MFS mount directory file operation on the client computer being handled, and can set up through network with data storage server with the management server of MFS and communicate by letter.
MFS in the above-mentioned operation method in the step 6) carries out write operation, and step is following:
< 1>client computer is sent write data requests based on mount directory to management server;
< 2>the IP address of each data storage server of management server queries, and each IP address returned to client computer;
< 3>client computer is set up with data storage server and is communicated by letter, and the file that the user is uploaded is written to data storage server with data block (chunk), and each data block is 64MB to the maximum; If file is less than 64MB; Then the size of data block is this document size, and file is if surpass 64MB, and then this document will be divided equally; The size of each piece of data piece is a principle to be no more than 64MB; Each piece is stored on the hard disk of data storage server dispersedly, and each data block can independently set the backup number that needs, to improve the fault freedom and the security performance of system;
< 4>duplicate communication between each data storage server, guarantee that each data block all has copy on different data storage servers, to realize optimal storage to data;
< 5>each data storage server returns to client computer with the message that successfully writes;
< 6>client computer is sent to management server and is written to function signal, finishes this write operation.
Through said process, carry out the function of distributed storage with regard to the file of having realized the user is uploaded.
MFS in the above-mentioned operation method in the step 7) carries out read operation, and step is following:
1. client computer is sent the request of reading file data to management server;
2. management server retrieve data obtains each data storage server IP address of storage this document data block, and the address of data storage server is returned to client computer;
3. client computer is set up with each data storage server and is communicated by letter, to concrete data storage server initiation request and reading of data;
4. each data storage server returns to client computer with the data block of file;
5. client computer each data block that will read merges processing, forms complete file, and sends to management server and to read into function signal, finishes this read operation.
Through said process, just realized each data block of distributed storage is merged into the function of complete file.
The present invention organically combines traditional network storage and MFS a kind of new file storage service based on thin-client is provided, and the user is uploaded to file on the network disk be dispersed into a plurality of data blocks and be put on the different servers and store.The key that realizes is to have a storage directory that is used for storage networking disk user upload file on the client computer of MFS; This catalogue also is the mount directory of the client computer of MFS simultaneously, can handle the file operation under this catalogue through the mfsmount module.So; In case user's upload file is under this catalogue; Just be equivalent to take place under this catalogue the operation of new files; The fuse module of client computer will be with giving mfsmount resume module to the control of this document operation so, and the mfsmount module then can be set up with data storage server with management server through network and communicate by letter, and the file distribution formula under this catalogue is stored in each data storage server.Thus, network disk and MFS are physically setting up contact through this storage directory, and centralized stores has been become distributed storage effectively.
MFS among the present invention is the distributed file system of a lightweight.It mainly comprises four parts:
A. management server: have only one, be responsible for the management of each data storage server, the file read-write scheduling, the file space is reclaimed and is recovered the multinode copy;
B. metadata log server: be responsible for the journal file that archive management server changes, carry out work so that when management server goes wrong, take over it; The existence of metadata log server has solved the drawback that the MFS system has only a management server effectively, has avoided Single Point of Faliure, has improved the fail safe and the restorability of system;
C. data storage server: can have many, be responsible for the connection management server, accept the management and dispatching of management server, memory space is provided, and transfer of data is provided for the client.After data storage server starts, can initiatively get in touch with management server, how many data storage servers let management server know has in network;
D. client computer: can have many, through kernel loads fuse module, again through with the communication of management server, the subregion that data storage server is shared is mounted to this locality, carries out read-write operation then.The high availability of MFS is to realize through a plurality of copies of on a plurality of data storage servers, storing each file.Data file is divided into a lot of data blocks, and each data block is 64MB to the maximum, and each data block all shows as an independently file on data storage server.Can accomplish the copy of data between the data storage server through communication, to realize many copy storages to each data block of a file.For client computer, its all operations to file can be handed to the fuse module through operating system, and through fuse module and mfsmount process communication.And the mfsmount process will be linked up through network and management server and data storage server.On client computer, the file of carry on MFS operated and be on all four in this locality.
The advantage of operation method of the present invention is to change traditional network storage and local memory module, breaks the individual server performance bottleneck of centralized stores, produces a kind of novel memory module with the network storage and distributed storage combination, improves memory property greatly.
Description of drawings
Fig. 1 is the FB(flow block) of operation method of the present invention.Wherein, 1)-8) be its each step.
Fig. 2 is the FB(flow block) of the write operation of the execution MFS file in the step 6) in the operation method of the present invention.Wherein, < 1 >-< 6>are its each step.
Fig. 3 is the FB(flow block) of the read operation of the execution MFS file in the step 7) in the operation method of the present invention.Wherein, 1.-5. be its each step.
Embodiment
Below in conjunction with accompanying drawing and embodiment the present invention is further specified, but be not limited thereto.
Embodiment:
The embodiment of the invention is as shown in Figure 1; A kind of operation method of storing based on the file distribution formula of thin-client; Realize by following system; This system comprises thin-client, network disk and MooseFS (being called for short MFS), and wherein thin-client is based on the client of built-in Linux operating system, and it only provides input-output equipment and web browser; Network disk is based on the network file storage application system of Web; MooseFS is a kind of distributed file system; Its file system structure comprises management server (master), metadata log server (metalogger), data storage server (chunkservers) and client computer (client); Running between thin-client, network disk and the MFS three is: form an extendible server cluster by many physical servers; On every physical server, fictionalize the virtual machine of many stylobates, on the virtual machine of server cluster, build MFS, on the client computer of MFS, build LAMP (Linux+Apache+MySQL+PHP) framework in (SuSE) Linux OS; The network disk source file is placed under the Apache; The network disk database is placed under the Mysql, the storage directory of a file as user's upload file is set on the client computer of MFS, and with the mount directory of this storage directory as client computer; The kernel of Client OS can be the operation of file under this catalogue (newly-built, read, revise) is passed to the fuse module; This module can and the mfsmount process communicate, the mfsmount process communicates through network and management server and data storage server again, client computer just can be carried out distributed read-write operation based on this storage directory like this; The user on the thin-client through the network disk under the internet access Apache; The user just can see the Web page of network disk on the browser of thin-client, the uploading and down operation of execute file, and this operation method step is following:
1) on the virtual machine of server cluster, build MFS, and at the client computer deploy LAMP of MFS framework, the network disk source file is placed under the Apache of LAMP framework, the database file of network disk is placed under the MySQL of LAMP framework;
A) virtual machine is selected: select a virtual machine as management server, select another virtual machine to obey as the metadata daily record
The affair device selects other 3 virtual machines as data storage server, selects a virtual machine as client computer in addition again,
These virtual machines all are based on (SuSE) Linux OS;
B) dispose management server: editor's configuration file is set, and appointment can long-rangely be mounted to the IP address of the client computer of MFS management server, and authorizes this client access authority;
C) dispose the metadata log server: editor's configuration file is set, indicates the IP address of management server, be used to carry out data backup, data shift and recovery so that when management server breaks down, carry out;
D) dispose data storage server: newly-increased hard disk is separately for MFS carries out file storage, and editor's configuration file, indicates the IP address and the COM1 of management server;
E) dispose client computer: the fuse module is installed carries out the carry deployment;
2) configuration file of modification PHP is to increase the file size that the user can upload;
3) storage directory of a file as user's upload file is set on the client computer of MFS, and this storage directory is set at the mount directory that client computer is mounted to management server;
4) Apache under startup MFS and the LAMP framework;
5) user logins the network disk Web page from the thin-client browser, after registering and landing, in storage directory, produces with the file of this user name name memory space as this user, changes step 6) and step 7) then respectively over to;
6) user carries out the upload operation of file based on the privately owned storage folder of oneself, and the user clicks file and uploads button, and the Apache on client computer submits upload request to, after its response, file is uploaded to memory space.Client computer can be sent the request of writing to management server, and MFS carries out write operation, and this user's under the storage directory the file of uploading is divided into a plurality of data block store in data storage server, realizes distributed storage, changes step 8) then over to;
7) user carries out the down operation of file based on the privately owned storage folder of oneself, and the user clicks download button, submits request to Apache, after its response, reads file to file storage.Client computer can be sent read request to management server; MFS carries out read operation; From each data storage server, read the data block information of this document; Client computer is integrated the data block information of obtaining and turn back in the mount directory, realizes the merging to the distributed document data block, changes next step then over to;
8) after the read-write operation, the user sees network disk Web renewal of the page content afterwards through thin-client.
MFS in the above-mentioned operation method in the step 6) carries out write operation, and as shown in Figure 2, step is following:
< 1>client computer is sent write data requests based on mount directory to management server;
< 2>the IP address of each data storage server of management server queries, and each IP address returned to client computer;
< 3>client computer is set up with data storage server and is communicated by letter, and the file that the user is uploaded is written to data storage server with data block (chunk), and each data block is 64MB to the maximum; If file is less than 64MB; Then the size of data block is this document size, and file is if surpass 64MB, and then this document will be divided equally; The size of each piece of data piece is a principle to be no more than 64MB; Each piece is stored on the hard disk of data storage server dispersedly, and each data block can independently set the backup number that needs, to improve the fault freedom and the security performance of system;
< 4>duplicate communication between each data storage server, guarantee that each data block all has copy on different data storage servers, to realize optimal storage to data;
< 5>each data storage server returns to client computer with the message that successfully writes;
< 6>client computer is sent to management server and is written to function signal, finishes this write operation.
Through said process, carry out the function of distributed storage with regard to the file of having realized the user is uploaded.
MFS in the above-mentioned operation method in the step 7) carries out read operation, and as shown in Figure 3, step is following:
1. client computer is sent the request of reading file data to management server;
2. management server retrieve data obtains each data storage server IP address of storage this document data block, and the address of data storage server is returned to client computer;
3. client computer is set up with each data storage server and is communicated by letter, to concrete data storage server initiation request and reading of data;
4. each data storage server returns to client computer with the data block of file;
5. client computer each data block that will read merges processing, forms complete file, and sends to management server and to read into function signal, finishes this read operation.

Claims (3)

1. operation method based on the storage of the file distribution formula of thin-client; Realize by following system; This system comprises thin-client, network disk and MooseFS, and wherein thin-client is based on the client of built-in Linux operating system, and it only provides input-output equipment and web browser; Network disk is based on the network file storage application system of Web; MooseFS is a kind of distributed file system; Its file system structure comprises management server, metadata log server, data storage server and client computer, and the running between thin-client, network disk and the MFS three is: form an extendible server cluster by many physical servers, on every physical server, fictionalize the virtual machine of many stylobates in (SuSE) Linux OS; On the virtual machine of server cluster, build MFS; On the client computer of MFS, build the LAMP framework, the network disk source file is placed under the Apache, the network disk database is placed under the Mysql; The storage directory of a file as user's upload file is set on the client computer of MFS; And with the mount directory of this storage directory as client computer, the kernel of Client OS can pass to the fuse module to the operation to file under this catalogue, and this module meeting and mfsmount process communicate; The mfsmount process communicates through network and management server and data storage server again; Client computer just can be carried out distributed read-write operation based on this storage directory like this, the user on the thin-client through the network disk under the internet access Apache, the user just can see the Web page of network disk on the browser of thin-client; Uploading and down operation of execute file, this operation method step is following:
1) on the virtual machine of server cluster, build MFS, and at the client computer deploy LAMP of MFS framework, the network disk source file is placed under the Apache of LAMP framework, the database file of network disk is placed under the MySQL of LAMP framework;
A) virtual machine is selected: select a virtual machine as management server; Select another virtual machine as the metadata log server; Select other 3 or 4 virtual machines as data storage server; Select the virtual machine as client computer in addition again, these virtual machines all are based on (SuSE) Linux OS;
B) dispose management server: editor's configuration file is set, and appointment can long-rangely be mounted to the IP address of the client computer of MFS management server, and authorizes this client access authority;
C) dispose the metadata log server: editor's configuration file is set, indicates the IP address of management server, be used to carry out data backup, data shift and recovery so that when management server breaks down, carry out;
D) dispose data storage server: newly-increased hard disk is separately for MFS carries out file storage, and editor's configuration file, indicates the IP address and the COM1 of management server;
E) dispose client computer: the fuse module is installed carries out the carry deployment;
2) configuration file of modification PHP is to increase the file size that the user can upload;
3) storage directory of a file as user's upload file is set on the client computer of MFS, and this storage directory is set at the mount directory that client computer is mounted to management server;
4) Apache under startup MFS and the LAMP framework;
5) user logins the network disk Web page from the thin-client browser, after registering and landing, in storage directory, produces with the file of this user name name memory space as this user, changes step 6) and step 7) then respectively over to;
6) user carries out the upload operation of file based on the privately owned storage folder of oneself, and the user clicks file and uploads button, and the Apache on client computer submits upload request to, after its response, file is uploaded to memory space.Client computer can be sent the request of writing to management server, and MFS carries out write operation, and this user's under the storage directory the file of uploading is divided into a plurality of data block store in data storage server, realizes distributed storage, changes step 8) then over to;
7) user carries out the down operation of file based on the privately owned storage folder of oneself, and the user clicks download button, submits request to Apache, after its response, reads file to file storage.Client computer can be sent read request to management server; MFS carries out read operation; From each data storage server, read the data block information of this document; Client computer is integrated the data block information of obtaining and turn back in the mount directory, realizes the merging to the distributed document data block, changes next step then over to;
8) after the read-write operation, the user sees network disk Web renewal of the page content afterwards through thin-client.
2. the MFS in the step 6) of operation method as claimed in claim 1 carries out write operation, and step is following:
< 1>client computer is sent write data requests based on mount directory to management server;
< 2>the IP address of each data storage server of management server queries, and each IP address returned to client computer;
< 3>client computer is set up with data storage server and is communicated by letter, and the file that the user is uploaded is written to data storage server with data block, and each data block is 64MB to the maximum; If file is less than 64MB; Then the size of data block is this document size, and file is if surpass 64MB, and then this document will be divided equally; The size of each piece of data piece is a principle to be no more than 64MB; Each piece is stored on the hard disk of data storage server dispersedly, and each data block can independently set the backup number that needs, to improve the fault freedom and the security performance of system;
< 4>duplicate communication between each data storage server, guarantee that each data block all has copy on different data storage servers, to realize optimal storage to data;
< 5>each data storage server returns to client computer with the message that successfully writes;
< 6>client computer is sent to management server and is written to function signal, finishes this write operation.
Through said process, carry out the function of distributed storage with regard to the file of having realized the user is uploaded.
3. the MFS in the step 7) of operation method as claimed in claim 1 carries out read operation, and step is following:
1. client computer is sent the request of reading file data to management server;
2. management server retrieve data obtains each data storage server IP address of storage this document data block, and the address of data storage server is returned to client computer;
3. client computer is set up with each data storage server and is communicated by letter, to concrete data storage server initiation request and reading of data;
4. each data storage server returns to client computer with the data block of file;
5. client computer each data block that will read merges processing, forms complete file, and sends to management server and to read into function signal, finishes this read operation.
CN201110448040.9A 2011-12-28 2011-12-28 Operation method for file distributed storage based on thin client Active CN102546780B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110448040.9A CN102546780B (en) 2011-12-28 2011-12-28 Operation method for file distributed storage based on thin client

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110448040.9A CN102546780B (en) 2011-12-28 2011-12-28 Operation method for file distributed storage based on thin client

Publications (2)

Publication Number Publication Date
CN102546780A true CN102546780A (en) 2012-07-04
CN102546780B CN102546780B (en) 2014-04-16

Family

ID=46352726

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110448040.9A Active CN102546780B (en) 2011-12-28 2011-12-28 Operation method for file distributed storage based on thin client

Country Status (1)

Country Link
CN (1) CN102546780B (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102917050A (en) * 2012-10-17 2013-02-06 山东大学 Remote security monitoring system and method based on android embedded type thin client end
CN103024020A (en) * 2012-12-05 2013-04-03 蓝盾信息安全技术股份有限公司 Network data file storing method and device based on WEB application
CN103067505A (en) * 2012-12-30 2013-04-24 乐视网信息技术(北京)股份有限公司 Method for uploading files to server
CN103458048A (en) * 2013-09-16 2013-12-18 浪潮电子信息产业股份有限公司 Examination system set-up method based on cloud computation
CN104090913A (en) * 2014-06-10 2014-10-08 深圳市深信服电子科技有限公司 File operation method and device based on thin client
CN105069009A (en) * 2015-07-06 2015-11-18 无锡天脉聚源传媒科技有限公司 Folder uploading/downloading method and device
CN105490999A (en) * 2014-12-23 2016-04-13 哈尔滨安天科技股份有限公司 Distributed storage system based on extensible messaging and presence protocol (XMPP)
CN105975328A (en) * 2016-04-29 2016-09-28 上海交通大学 Log file security auditing system and method based on security virtual machine
CN106202350A (en) * 2016-07-05 2016-12-07 浪潮(北京)电子信息产业有限公司 A kind of distributed file system simplifies the method and system of configuration automatically
CN103747064B (en) * 2013-12-26 2017-06-20 广东中科遥感技术有限公司 Hanging method, client and system based on MooseFS Distribute file systems
CN106993004A (en) * 2017-06-12 2017-07-28 深圳市永达电子信息股份有限公司 A kind of method that super large annex is uploaded in B/S framework system
CN107454053A (en) * 2016-05-31 2017-12-08 卡巴斯基实验室股份制公司 The system and method that the malicious file on virtual machine is detected in distributed network
CN107580232A (en) * 2017-09-28 2018-01-12 郑州云海信息技术有限公司 A kind of video living transmission system and method
CN105242988B (en) * 2015-10-10 2018-02-02 国家电网公司 The data back up method of distributed file system and distributed file system
CN107707507A (en) * 2016-08-08 2018-02-16 深圳中电长城信息安全***有限公司 Control method and system based on safe pool network data transmission
CN107733667A (en) * 2016-08-10 2018-02-23 北京京东尚科信息技术有限公司 A kind of blog management method and system
CN107832423A (en) * 2017-11-13 2018-03-23 中山大学 A kind of file read/write method for distributed file system
CN109725913A (en) * 2017-10-27 2019-05-07 北京京东尚科信息技术有限公司 The method and apparatus that data update
CN109726041A (en) * 2017-10-27 2019-05-07 伊姆西Ip控股有限责任公司 Restore method, equipment and the computer-readable medium of the file in magnetic disk of virtual machine
CN109977083A (en) * 2019-03-27 2019-07-05 深圳市云语科技有限公司 A kind of document transmission system based on file system mounted disk technology
CN110321077A (en) * 2019-06-17 2019-10-11 浩云科技股份有限公司 A kind of management method and device of centrally stored file
CN112667565A (en) * 2020-12-30 2021-04-16 湖南博匠信息科技有限公司 Storage unit file management method and system based on FUSE
CN112764830A (en) * 2021-01-19 2021-05-07 长沙证通云计算有限公司 Data migration method and system applied to domestic substitution
CN114895852A (en) * 2022-05-09 2022-08-12 北京星辰天合科技股份有限公司 Data processing method, system, device, storage medium and electronic equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101135971A (en) * 2006-09-01 2008-03-05 环达电脑(上海)有限公司 Accessing route device install configuring method based on personal computer hardware equipment
CN102012933A (en) * 2010-12-02 2011-04-13 清华大学 Distributed file system and method for storing data and providing services by utilizing same

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101135971A (en) * 2006-09-01 2008-03-05 环达电脑(上海)有限公司 Accessing route device install configuring method based on personal computer hardware equipment
CN102012933A (en) * 2010-12-02 2011-04-13 清华大学 Distributed file system and method for storing data and providing services by utilizing same

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
S._J.S.TSAI,MEMBER,IEEE,AND C.C.LUO: "synchronized power-quality measurement network with LAMP", 《IEEE/IEE ELECTRONIC LIBRARY(IEL)数据库》, vol. 24, no. 1, 31 January 2009 (2009-01-31) *

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102917050A (en) * 2012-10-17 2013-02-06 山东大学 Remote security monitoring system and method based on android embedded type thin client end
CN103024020A (en) * 2012-12-05 2013-04-03 蓝盾信息安全技术股份有限公司 Network data file storing method and device based on WEB application
CN103024020B (en) * 2012-12-05 2015-06-03 蓝盾信息安全技术股份有限公司 Network data file storing method and device based on WEB application
CN103067505A (en) * 2012-12-30 2013-04-24 乐视网信息技术(北京)股份有限公司 Method for uploading files to server
CN103458048A (en) * 2013-09-16 2013-12-18 浪潮电子信息产业股份有限公司 Examination system set-up method based on cloud computation
CN103747064B (en) * 2013-12-26 2017-06-20 广东中科遥感技术有限公司 Hanging method, client and system based on MooseFS Distribute file systems
CN104090913B (en) * 2014-06-10 2017-11-03 深信服科技股份有限公司 File operation method and device based on thin client
CN104090913A (en) * 2014-06-10 2014-10-08 深圳市深信服电子科技有限公司 File operation method and device based on thin client
CN105490999A (en) * 2014-12-23 2016-04-13 哈尔滨安天科技股份有限公司 Distributed storage system based on extensible messaging and presence protocol (XMPP)
CN105069009A (en) * 2015-07-06 2015-11-18 无锡天脉聚源传媒科技有限公司 Folder uploading/downloading method and device
CN105242988B (en) * 2015-10-10 2018-02-02 国家电网公司 The data back up method of distributed file system and distributed file system
CN105975328A (en) * 2016-04-29 2016-09-28 上海交通大学 Log file security auditing system and method based on security virtual machine
CN105975328B (en) * 2016-04-29 2019-10-08 上海交通大学 Journal file safety auditing system and method based on secure virtual machine
CN107454053B (en) * 2016-05-31 2020-07-21 卡巴斯基实验室股份制公司 System and method for detecting malicious files on virtual machines in a distributed network
CN107454053A (en) * 2016-05-31 2017-12-08 卡巴斯基实验室股份制公司 The system and method that the malicious file on virtual machine is detected in distributed network
CN106202350A (en) * 2016-07-05 2016-12-07 浪潮(北京)电子信息产业有限公司 A kind of distributed file system simplifies the method and system of configuration automatically
CN107707507A (en) * 2016-08-08 2018-02-16 深圳中电长城信息安全***有限公司 Control method and system based on safe pool network data transmission
CN107733667A (en) * 2016-08-10 2018-02-23 北京京东尚科信息技术有限公司 A kind of blog management method and system
CN107733667B (en) * 2016-08-10 2021-05-25 北京京东尚科信息技术有限公司 Log management method and system
CN106993004A (en) * 2017-06-12 2017-07-28 深圳市永达电子信息股份有限公司 A kind of method that super large annex is uploaded in B/S framework system
CN107580232A (en) * 2017-09-28 2018-01-12 郑州云海信息技术有限公司 A kind of video living transmission system and method
CN109726041A (en) * 2017-10-27 2019-05-07 伊姆西Ip控股有限责任公司 Restore method, equipment and the computer-readable medium of the file in magnetic disk of virtual machine
CN109726041B (en) * 2017-10-27 2023-09-08 伊姆西Ip控股有限责任公司 Method, apparatus and computer readable medium for restoring files in a virtual machine disk
CN109725913A (en) * 2017-10-27 2019-05-07 北京京东尚科信息技术有限公司 The method and apparatus that data update
CN107832423A (en) * 2017-11-13 2018-03-23 中山大学 A kind of file read/write method for distributed file system
CN107832423B (en) * 2017-11-13 2020-05-15 中山大学 File reading and writing method for distributed file system
CN109977083B (en) * 2019-03-27 2021-04-06 深圳市瑞云科技有限公司 File transmission system based on file system hanging disc technology
CN109977083A (en) * 2019-03-27 2019-07-05 深圳市云语科技有限公司 A kind of document transmission system based on file system mounted disk technology
CN110321077A (en) * 2019-06-17 2019-10-11 浩云科技股份有限公司 A kind of management method and device of centrally stored file
CN110321077B (en) * 2019-06-17 2023-04-14 浩云科技股份有限公司 Method and device for managing centrally stored files
CN112667565A (en) * 2020-12-30 2021-04-16 湖南博匠信息科技有限公司 Storage unit file management method and system based on FUSE
CN112764830A (en) * 2021-01-19 2021-05-07 长沙证通云计算有限公司 Data migration method and system applied to domestic substitution
CN114895852A (en) * 2022-05-09 2022-08-12 北京星辰天合科技股份有限公司 Data processing method, system, device, storage medium and electronic equipment

Also Published As

Publication number Publication date
CN102546780B (en) 2014-04-16

Similar Documents

Publication Publication Date Title
CN102546780B (en) Operation method for file distributed storage based on thin client
US11068395B2 (en) Cached volumes at storage gateways
Shan et al. Distributed shared persistent memory
US10296494B2 (en) Managing a global namespace for a distributed filesystem
US9852150B2 (en) Avoiding client timeouts in a distributed filesystem
US9811532B2 (en) Executing a cloud command for a distributed filesystem
Nicolae et al. BlobSeer: Bringing high throughput under heavy concurrency to Hadoop Map-Reduce applications
US9811662B2 (en) Performing anti-virus checks for a distributed filesystem
US9268651B1 (en) Efficient recovery of storage gateway cached volumes
US9274956B1 (en) Intelligent cache eviction at storage gateways
US9559889B1 (en) Cache population optimization for storage gateways
CN102571905A (en) Managing networks and machines for an online service
JPWO2013061388A1 (en) Information processing system and file restoration method using the same
Dwivedi et al. Analytical review on Hadoop Distributed file system
CN102523101A (en) Machine manager service fabric
US20210055885A1 (en) Enhanced data access using composite data views
US11818012B2 (en) Online restore to different topologies with custom data distribution
Jin et al. Checkpointing orchestration: Toward a scalable hpc fault-tolerant environment
Won et al. Moving metadata from ad hoc files to database tables for robust, highly available, and scalable HDFS
Azagury et al. GPFS-based implementation of a hyperconverged system for software defined infrastructure
Wei et al. DSC: Dynamic stripe construction for asynchronous encoding in clustered file system
Arteaga et al. Towards scalable application checkpointing with parallel file system delegation
Liu et al. User-oriented Mobile Filesystem Middleware for Mobile Cloud Systems.
Gu et al. Sector and sphere: Towards simplified storage and processing of large scale distributed data
Bortnikov Open-source grid technologies for web-scale computing

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant