CN103595761B - Data processing method based on distributed file system and server - Google Patents
Data processing method based on distributed file system and server Download PDFInfo
- Publication number
- CN103595761B CN103595761B CN201310482041.4A CN201310482041A CN103595761B CN 103595761 B CN103595761 B CN 103595761B CN 201310482041 A CN201310482041 A CN 201310482041A CN 103595761 B CN103595761 B CN 103595761B
- Authority
- CN
- China
- Prior art keywords
- data
- client computer
- server
- file
- property cache
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Computer And Data Communications (AREA)
Abstract
nullThe present invention provides a kind of data processing method based on distributed file system and server，By receiving the file manipulation command of the data for indicating required process，The property cache of the data of inquiry file manipulation command instruction，Judge that the property cache of data corresponding data copy is the most identical with the property cache inquired，If it is identical，Described data trnascription is performed the described operation of described file manipulation command instruction，Generate the first operating result，And send described first operating result to described first client computer，Owing to prestoring the property cache of data，And prestore the data trnascription that data are corresponding，Decreasing the first client computer utilizes network to conduct interviews server，The number of times by the network between server and the second client computer, the data including file or catalogue in the second client computer processed again，Thus solve in distributed file system，The performance that data process is affected bigger technical problem by network condition.
Description
Technical field
The present invention relates to communication technology, particularly relate to a kind of data process side based on distributed file system
Method and server.
Background technology
Distributed file system (Distributed File System), including server and at least
Two client computer.Server is arranged at high in the clouds, is connected with each client computer by network, each client
Mutually can also be conducted interviews by this network between machine.In distributed file system, the second client
Machine delivers the file directory allowing the first client computer to access, the storage of the file indicated by this document catalogue
Position is positioned on the second client computer place physical node, thus the first client computer can be to this by server
File under file directory carries out the process including read operation and write operation, and to this document mesh
Record carries out the process opened and closed.
In prior art, owing to the first client computer utilizes network to conduct interviews server, then by clothes
Business device and the second client computer between network in the second client computer including file or catalogue
Data process, and the data volume of often file is relatively big, therefore, and existing distributed field system
In system, the performance that data process is affected bigger by network condition.
Summary of the invention
The present invention provides a kind of data processing method based on distributed file system and server, is used for solving
Certainly in distributed file system, the performance that data process is affected bigger technology by network condition and is asked
Topic.
It is an aspect of the invention to provide a kind of data processing method based on distributed file system, bag
Include:
Server receives the file manipulation command that the first client computer sends；Described file manipulation command is used for referring to
Show the data of required process, to the second client belonging to the operation performed needed for described data and described data
Machine；Described data include at least one in file and file directory；Described file directory is used for indicating institute
State file storage position in described second client computer；
The property cache of the described data of file manipulation command instruction described in described server lookup；Described genus
Property caching for indicating the metadata of described data；
Described server judges the property cache of described data corresponding data copy and the property cache inquired
The most identical；Described data trnascription is to carry out data described in described second client computer in advance replicating obtaining
's；
If the property cache of described data corresponding data copy is identical with the described property cache inquired, institute
State server and described data trnascription is performed the described operation of described file manipulation command instruction, generate first
Operating result, sends described first operating result to described first client computer.
Another aspect of the present invention is to provide a kind of server, is arranged in distributed file system, bag
Include:
Receiver module, for receiving the file manipulation command that the first client computer sends；Described file process is ordered
Order is for indicating the data of required process, to belonging to the operation performed needed for described data and described data
Second client computer；Described data include at least one in file and file directory；Described file directory is used
In instruction described file storage position in described second client computer；
Enquiry module, for inquiring about the property cache of the described data of described file manipulation command instruction；Institute
State property cache for indicating the metadata of described data；
Judge module, for judging the property cache of described data corresponding data copy and the attribute inquired
Cache the most identical；Described data trnascription is to replicate data described in described second client computer in advance
Obtain；
First sending module, if the result for the judgement of described judge module is identical, secondary to described data
The described operation of this execution described file manipulation command instruction, generates the first operating result, to described first
Client computer sends described first operating result.
The data processing method based on distributed file system of present invention offer and server, by service
Device receives the file manipulation command of the data for indicating required process, inquiry file manipulation command instruction
The property cache of data, it is judged that the property cache of data corresponding data copy with the property cache inquired is
No identical, if identical, described data trnascription is performed the described operation of described file manipulation command instruction,
Generate the first operating result, and send described first operating result, due in advance to described first client computer
Store the property cache of data and the data trnascription that data are corresponding, can logarithm the most on the server
According to processing, decrease the first client computer and utilize network that server is conducted interviews, then pass through server
And the data including file or catalogue in the second client computer are carried out by the network between the second client computer
The number of times processed, thus solve in distributed file system, the performance that data process is by network condition
The bigger technical problem of impact.
Accompanying drawing explanation
The stream of the data processing method based on distributed file system that Fig. 1 provides for one embodiment of the invention
Journey schematic diagram；
The data processing method based on distributed file system that Fig. 2 provides for another embodiment of the present invention
Schematic flow sheet；
The structural representation of the server that Fig. 3 provides for one embodiment of the invention；
The structural representation of the server that Fig. 4 provides for another embodiment of the present invention.
Detailed description of the invention
The stream of the data processing method based on distributed file system that Fig. 1 provides for one embodiment of the invention
Journey schematic diagram, as it is shown in figure 1, include:
101, server receives the file manipulation command that the first client computer sends.
Wherein, file manipulation command is for indicating the data of required process, to the operation performed needed for data
With the second client computer belonging to data；Data include at least one in file and file directory；File mesh
Employ in instruction file storage position in the second client computer.
The property cache of the data of 102, server lookup file manipulation command instruction.
Wherein, property cache is for indicating the metadata of data；Metadata, including: data volume, last
Modification time, finally access at least one in time and establishment time.
Judging whether to be previously stored with the property cache of described data, the described property cache prestored is
Obtain in advance from described second client computer；If being previously stored with described property cache, determining and prestoring
Time of setting up of property cache whether beyond first threshold, however, it is determined that building of the property cache prestored
Without departing from described first threshold between immediately, the described property cache prestored is inquired as described
Property cache；The time of setting up of described property cache be from get in advance moment of described property cache to
Time between current time；If not storing the property cache of described data in advance, or determine described
The time of setting up of the property cache prestored exceeds described first threshold, then obtain from described second client computer
Take the property cache of described data, the property cache of the described data got is inquired as described
Property cache.
103, server judges whether are the property cache of data corresponding data copy and the property cache inquired
Identical.
Wherein, data trnascription is to carry out data in the second client computer in advance replicating obtaining.
If 104 is identical, server performs the operation of file manipulation command instruction to data trnascription, generates the
One operating result, and send the first operating result to the first client computer.
Further, the data processing method based on distributed file system that the present embodiment provides also includes, if not
With, the second client computer to file manipulation command instruction sends file process instruction, so that the second client computer
Data execution file to file process instruction instruction processes the operation of instruction instruction, generates the second operation knot
Really；Obtain the second operating result from the second client computer, described second operating result got is joined
In message queue；Described server processes described second in described message queue according to first in first out
Operating result；When the second operating result gone in described message queue, described server judges institute
The second operating result stated in message queue joins the time in described message queue；If described second behaviour
Join time in described message queue beyond Second Threshold as result, described server abandon described in disappear
Described second operating result in breath queue；If described second operating result joins in described message queue
Time without departing from described Second Threshold, described server sends described second behaviour to described first client computer
Make result.
Further, before 101, also include the connection request sent according to the first client computer, to described the
One client computer carries out identity and Authority Verification, and connection request includes username and password, if being verified,
Setting up the service processes corresponding with the first client computer, described service processes is used for receiving described first client computer
The described file manipulation command sent.
In the present embodiment, receive the file manipulation command for indicating the required data processed by server,
The property cache of the data of inquiry file manipulation command instruction, it is judged that the attribute of data corresponding data copy delays
The property cache deposited and inquire is the most identical, if identical, data trnascription performed file manipulation command and refers to
The operation shown, generates the first operating result, and sends the first operating result to the first client computer, due in advance
First store the property cache of data, and prestore the data trnascription that data are corresponding, decrease the first visitor
Family machine utilizes network to conduct interviews server, then by the network pair between server and the second client computer
The data including file or catalogue in second client computer carry out the number of times processed, thus solve dividing
In cloth file system, the performance that data process is affected bigger technical problem by network condition.
The data processing method based on distributed file system that Fig. 2 provides for another embodiment of the present invention
Schematic flow sheet, the data processing method based on distributed file system that the present embodiment is provided, can answer
Server in distributed file system, wherein, distributed file system, including at least two visitor
Family machine and the server being positioned at high in the clouds, as in figure 2 it is shown, include:
201, the connection request that server sends according to the first client computer, the first client computer is carried out identity and
Authority Verification.
Wherein, connection request includes username and password.
Server, the first client computer and the second client computer can be used for providing software i.e. to service (Software as
A Service), SaaS is a kind of Software Delivery pattern, and software supplier's unified management is deployed in server
In application software, user pass through above-mentioned client access networks network, thus in RAS should
With software, in other words, performing on the server being positioned at high in the clouds of application software, utilize answering of high in the clouds
With software, the file of user is processed.The file of user can be stored in above-mentioned client computer, it is also possible to
Storage is in the server.The file processed needed for user is stored in the second client computer, and it is the most sharp
When accessing server with the first client remote, user needs to send connection request by the first client computer,
To be opened the file directory in the second client computer by server, know the file under this document catalogue, enter
And therefrom obtain the file of required process.
User space file system (Filesystem in Userapace, FUSE) in server allows pin
Each user sets up a user class file system, and the run mode of application program is moved by FUSE from kernel mode
Move on to User space, reduce complexity, decrease the workload of exploitation, improve operation stability.
If 202 are verified, server sets up the service processes corresponding with the first client computer.
Wherein, service processes is for receiving the file manipulation command that the first client computer sends.
203, server receives the file manipulation command that the first client computer sends.
Wherein, file manipulation command is for indicating the data of required process, to the operation performed needed for data
The second client computer with storage data；Data include file and file directory；File directory is used for indicating literary composition
Part storage position in the second client computer；Operation includes: opens, close, in read operation and write operation
At least one.
Server by utilizing service processes receives file manipulation command, carries out the file manipulation command received
Analyze, know that sending this document processes the first client computer of order, processes order by this document and joins this
In the service processes that first client computer is corresponding, to this document process order cache, with etc. pending should
File manipulation command.
204, server judges whether to be previously stored with the property cache of the data of file manipulation command instruction,
And the time of setting up of the property cache prestored is without departing from first threshold, if so, execution 205, no
Then perform 206.
Wherein, the property cache prestored obtains in advance from the second client computer.Building of property cache
It is from the time to current time in the moment getting property cache in advance between immediately.
Server inquires about the property cache of the data of file manipulation command instruction in the buffer, if inquiring,
Current time is deducted the moment getting property cache in advance, building of the property cache that calculating prestores
Between immediately, the time of setting up of the property cache prestored is judged mutually with first threshold.Obtain the most in advance
Getting moment of property cache can be that this property cache adds the form of timestamp and carries out record.Wherein,
First threshold may be configured as relatively short period of time, to ensure that it is effective, and such as 3 seconds.
If 205 are previously stored with property cache, and the time of setting up of the property cache prestored does not surpasses
Go out first threshold, then server determines the property cache prestored as the property cache inquired.
If 206 property caches not storing data in advance, or the foundation of the property cache prestored
Time exceeds first threshold, then server obtains the property cache of data from the second client computer, determines and will obtain
The property cache of the data got is as the property cache inquired.
If the time of setting up of the property cache prestored exceeds first threshold, then illustrate what this prestored
Property cache lost efficacy, abandoned this in caching property cache of prestoring, from the second client computer again
Obtain the property cache of data, determine and the property cache of the data got is delayed as the attribute inquired
Deposit.If not storing the property cache of data in advance, the attribute from the second client computer acquisition data equally delays
Deposit, determine the property cache of the data got as the property cache inquired.Due to property cache
For indicating metadata, and the data volume of metadata is the least, therefore, is affected the least by network state,
Avoid owing to the best the brought server performance of network state declines.
207, server judges whether are the property cache of data corresponding data copy and the property cache inquired
Identical, if identical, perform 208, if it is different, perform 209-211.
Wherein, data trnascription is to carry out data in the second client computer in advance replicating obtaining.
The property cache of the property cache inquired with data corresponding data copy is judged, according to genus
Property caching instruction metadata know that the data trnascription replicating acquisition in advance is whether current with the second client computer
The data of storage are identical, and the data trnascription replicating acquisition the most in advance is the most effective.
It should be noted that the server in the present embodiment needs to utilize disk or caching to enter data trnascription
Row prestores, if disk or caching exist idle storage space, can directly store, if disk
Or caching is not when existing idle storage space, need to use, recent minimum use (Least Recently
Used, LRU) algorithm stores after in disk or caching, the data trnascription that stored is replaced.
If 208 is identical, data trnascription is performed the operation of file manipulation command instruction, generate the first operation
As a result, and send the first operating result to the first client computer, and send the first operation to the second client computer
As a result, so that the data of storage in the second client computer are carried out more by the second client computer according to the first operating result
Newly.
209 if it is different, the second client computer transmission file process that server indicates to file manipulation command refers to
Order, so that the second client computer processes instruction instruction to the data execution file of file process instruction instruction
Operation, generates the second operating result.
210, server obtains the second operating result from the second client computer, the second operating result that will get
Join in message queue.
Server obtains the second operating result from the second client computer, is added by the second operating result got
In message queue, server is according to first in first out (First Input First Output, FIFO)
Principle processes the second operating result in described message queue.
211, server is when going to the second operating result in message queue, sends to the first client computer
The second operating result in message queue.
When the second operating result gone in described message queue, described server judges described message
The second operating result in queue joins the time in described message queue；If described second operating result
The time in described message queue that joins, described server abandoned described message queue beyond Second Threshold
In described second operating result, thus reduce the propagation delay time of data；If described second operating result
The time in described message queue that joins, described server was to described first without departing from described Second Threshold
Client computer sends described second operating result.
In the present embodiment, receive the file manipulation command for indicating the required data processed by server,
The property cache of the data of inquiry file manipulation command instruction, it is judged that the attribute of data corresponding data copy delays
The property cache deposited and inquire is the most identical, if identical, data trnascription performed file manipulation command and refers to
The operation shown, generates the first operating result, and sends the first operating result to the first client computer, due in advance
First store the property cache of data, and prestore the data trnascription that data are corresponding, decrease the first visitor
Family machine utilizes network to conduct interviews server, then by the network pair between server and the second client computer
The data including file or catalogue in second client computer carry out the number of times processed, thus solve dividing
In cloth file system, the performance that data process is affected bigger technical problem by network condition.
The structural representation of the server that Fig. 3 provides for one embodiment of the invention, as it is shown on figure 3, include:
Receiver module 31, enquiry module 32, judge module 33 and the first sending module 34.
Receiver module 31, for receiving the file manipulation command that the first client computer sends.
Wherein, file manipulation command is for indicating the data of required process, to the operation performed needed for data
With the second client computer belonging to data；Data include file and file directory；File directory is used for indicating literary composition
Part storage position in the second client computer.
Enquiry module 32, is connected with receiver module 31, for inquiring about the data of file manipulation command instruction
Property cache.
Wherein, property cache is for indicating the metadata of data.Metadata, including: data volume, last
Modification time, finally access at least one in time and establishment time.
Judge module 33, for judging that the property cache of data corresponding data copy delays with the attribute inquired
Deposit the most identical.
Wherein, data trnascription is to carry out data in the second client computer in advance replicating obtaining；
First sending module 34, if the result for judge module judgement is identical, performs data trnascription
The operation of file manipulation command instruction, generates the first operating result, and sends the first behaviour to the first client computer
Make result.
Wherein, operation, including: open, close, at least one in read operation and write operation.
In the present embodiment, receive the file manipulation command for indicating the required data processed by server,
The property cache of the data of inquiry file manipulation command instruction, it is judged that the attribute of data corresponding data copy delays
The property cache deposited and inquire is the most identical, if identical, data trnascription performed file manipulation command and refers to
The operation shown, generates the first operating result, and sends the first operating result to the first client computer, due in advance
First store the property cache of data, and prestore the data trnascription that data are corresponding, decrease the first visitor
Family machine utilizes network to conduct interviews server, then by the network pair between server and the second client computer
The data including file or catalogue in second client computer carry out the number of times processed, thus solve dividing
In cloth file system, the performance that data process is affected bigger technical problem by network condition.
The structural representation of the server that Fig. 4 provides for another embodiment of the present invention, as shown in Figure 4,
On the basis of a upper embodiment, the enquiry module 32 in the present embodiment farther includes:
Judging unit 321, for judging whether to be previously stored with the property cache of data.
Wherein, the property cache prestored obtains in advance from the second client computer.
First determines unit 322, is connected with judging unit 321, if for being previously stored with property cache,
Determine that whether the time of setting up of the property cache prestored is beyond first threshold, however, it is determined that prestore
The time of setting up of property cache without departing from first threshold, using the property cache prestored as inquiring
Property cache.
Wherein, the time of setting up of property cache is to get the moment of property cache to current time from advance
Between time.
Second determines unit 323, determines that unit 322 is connected with judging unit 321 and first respectively, uses
If in not storing the property cache of data in advance, or determining when setting up of the property cache prestored
Between beyond first threshold, then obtain the property cache of data from the second client computer, by the data that get
Property cache is as the property cache inquired.
Further, the server that the present embodiment provides, also include: the second sending module 35, identity and power
Limit authentication module 36 and set up module 37.
Second sending module 35, is connected with judge module 33, if the result judged for judge module 33
For difference, the second client computer to file manipulation command instruction sends file process instruction, so that the second visitor
Family machine processes the operation of instruction instruction to the data execution file of file process instruction instruction, generates the second behaviour
Make result；Obtain the second operating result from the second client computer, the second operating result got is joined
In message queue；Monitoring the second operating result joins the time in message queue in real time, when the second operation
Result join time in message queue beyond Second Threshold time, abandon the second operation in message queue
Result；When going to the second operating result in message queue, send message queue to the first client computer
In the second operating result.
Identity and Authority Verification module 36, for the connection request sent according to the first client computer, to first
Client computer carries out identity and Authority Verification；Connection request includes username and password；
Set up module 37, be connected with identity and Authority Verification module 36 and receiver module 31 respectively, be used for
If being verified, setting up the service processes corresponding with the first client computer, service processes is for receiving the first visitor
The file manipulation command that family machine sends.
Based on this, receiver module sends specifically for utilizing described service processes to receive described first client computer
Described file manipulation command.
Server in the present embodiment can be the server in distributed file system, this distributed field system
System, including at least two client computer and the server being positioned at high in the clouds.Server, the first client computer and second
Client computer can be used for providing software i.e. to service (Software as a Service), and SaaS is a kind of software
Delivery mode, software supplier's unified management deployment application software in the server, user is by above-mentioned
Client access networks network, thus the application software in RAS, in other words, application software
Perform on the server being positioned at high in the clouds, utilize the application software in high in the clouds that the file of user is processed.
The file of user can be stored in above-mentioned client computer, it is also possible to storage is in the server.Locate needed for user
The file of reason is stored in the second client computer, and when it is utilizing the first client remote to access server,
User needs to send connection request, to be opened in the second client computer by server by the first client computer
File directory, knows the file under this document catalogue, and then therefrom obtains the required file processed.
In the present embodiment, by receiving the file manipulation command of the data for indicating required process, inquiry
The property cache of data of file manipulation command instruction, it is judged that the property cache of data corresponding data copy with
The property cache inquired is the most identical, if identical, data trnascription performs file manipulation command instruction
Operation, generates the first operating result, and sends the first operating result to the first client computer, owing to depositing in advance
The property cache of storage data, and prestore the data trnascription that data are corresponding, decrease the first client computer
Utilize network that server is conducted interviews, then by the network between server and the second client computer to second
The data including file or catalogue in client computer carry out the number of times processed, thus solve distributed
In file system, the performance that data process is affected bigger technical problem by network condition.
One of ordinary skill in the art will appreciate that: realize all or part of step of above-mentioned each method embodiment
Suddenly can be completed by the hardware that programmed instruction is relevant.Aforesaid program can be stored in a computer can
Read in storage medium.This program upon execution, performs to include the step of above-mentioned each method embodiment；And
Aforesaid storage medium includes: ROM, RAM, magnetic disc or CD etc. are various can store program code
Medium.
Last it is noted that various embodiments above is only in order to illustrate technical scheme, rather than right
It limits；Although the present invention being described in detail with reference to foregoing embodiments, this area common
Skilled artisans appreciate that the technical scheme described in foregoing embodiments still can be modified by it,
Or the most some or all of technical characteristic is carried out equivalent；And these amendments or replacement, and
The essence not making appropriate technical solution departs from the scope of various embodiments of the present invention technical scheme.
Claims (8)
1. a data processing method based on distributed file system, it is characterised in that including:
Server receives the file manipulation command that the first client computer sends；Described file manipulation command is used for referring to
Show the data of required process, to the second client belonging to the operation performed needed for described data and described data
Machine；Described data include at least one in file and file directory；Described file directory is used for indicating institute
State file storage position in described second client computer；
The property cache of the described data of file manipulation command instruction described in described server lookup；Described genus
Property caching for indicating the metadata of described data；
Described server judges the property cache of described data corresponding data copy and the property cache inquired
The most identical；Described data trnascription is to carry out data described in described second client computer in advance replicating obtaining
's；
If the property cache of described data corresponding data copy is identical with the described property cache inquired, institute
State server and described data trnascription is performed the described operation of described file manipulation command instruction, generate first
Operating result, sends described first operating result to described first client computer；
The property cache of the described data of file manipulation command instruction described in described server lookup, including:
Described server judges whether to be previously stored with the property cache of described data；Prestore is described
Property cache obtains in advance from described second client computer；
If described server is previously stored with described property cache, determine building of the property cache prestored
Whether beyond first threshold between immediately, however, it is determined that the time of setting up of the property cache prestored is without departing from institute
State first threshold, described server using the described property cache prestored as the described attribute inquired
Caching；The time of setting up of described property cache is to get the moment of described property cache to currently from advance
Time between moment；
If described server does not stores the property cache of described data in advance, or deposit in advance described in determining
The time of setting up of the property cache of storage, the most described server was from described second client beyond described first threshold
Machine obtains the property cache of described data, using the property cache of described data that gets as described inquiry
The property cache arrived.
Data processing method based on distributed file system the most according to claim 1, its feature
Being, described data processing method based on distributed file system also includes:
If the property cache of described data corresponding data copy is different from the described property cache inquired, institute
State server to described file manipulation command indicate described second client computer send described file process refer to
Order, so that described second client computer performs described file to the described data of described file process instruction instruction
Process the described operation of instruction instruction, generate the second operating result；Described server is from described second client
Machine obtains described second operating result；Described server sends described second operation to described first client computer
Result.
Data processing method based on distributed file system the most according to claim 2, its feature
Being, described server sends described second operating result to described first client computer, including:
Described second operating result got is joined in message queue by described server；
Described server processes the described second operation knot in described message queue according to first in first out
Really；
When the second operating result gone in described message queue, described server judges described message
The second operating result in queue joins the time in described message queue；
If described second operating result joins the time in described message queue and exceeds Second Threshold, described
Server abandons described second operating result in described message queue；
If described second operating result joins the time in described message queue without departing from described second threshold
Value, described server sends described second operating result to described first client computer.
Data processing method based on distributed file system the most according to claim 1, its feature
It is, before the file manipulation command that described reception the first client computer sends, including:
The connection request sent according to described first client computer, carries out identity and power to described first client computer
Limit checking；Described connection request includes username and password；
If being verified, set up the service processes corresponding with described first client computer；
Based on this, described server receives the file manipulation command that the first client computer sends, including:
Described service processes is utilized to receive the described file manipulation command that described first client computer sends.
5. according to the data process side based on distributed file system described in any one of claim 1-4
Method, it is characterised in that described metadata, including: data volume, last modification time, finally access time
Between and the establishment time at least one；
Described operation, including: open, close, at least one in read operation and write operation.
6. a server, is arranged in distributed file system, it is characterised in that including:
Receiver module, for receiving the file manipulation command that the first client computer sends；Described file process is ordered
Order is for indicating the data of required process, to belonging to the operation performed needed for described data and described data
Second client computer；Described data include at least one in file and file directory；Described file directory is used
In instruction described file storage position in described second client computer；
Enquiry module, for inquiring about the property cache of the described data of described file manipulation command instruction；Institute
State property cache for indicating the metadata of described data；
Judge module, for judging the property cache of described data corresponding data copy and the attribute inquired
Cache the most identical；Described data trnascription is to replicate data described in described second client computer in advance
Obtain；
First sending module, if the result for the judgement of described judge module is identical, secondary to described data
The described operation of this execution described file manipulation command instruction, generates the first operating result, to described first
Client computer sends described first operating result；
Described enquiry module, including:
Judging unit, for judging whether to be previously stored with the property cache of described data；Prestore
Described property cache obtains in advance from described second client computer；
First determines unit, if for being previously stored with described property cache, determining the attribute prestored
Whether the time of setting up of caching beyond first threshold, however, it is determined that the property cache prestored set up the time
Without departing from described first threshold, the described property cache prestored is delayed as the described attribute inquired
Deposit；The time of setting up of described property cache is to get the moment of described property cache to time current from advance
Time between quarter；
Second determines unit, if being used for not storing in advance the property cache of described data, or determines institute
The time of setting up stating the property cache prestored exceeds described first threshold, then from described second client computer
Obtain the property cache of described data, the property cache of the described data got is inquired as described
Property cache.
Server the most according to claim 6, it is characterised in that described server also includes:
Second sending module, if the result judged for described judge module is as difference, at described file
Described second client computer of reason order instruction sends the instruction of described file process, so that described second client computer
Described data to the instruction instruction of described file process perform the described behaviour of described file process instruction instruction
Make, generate the second operating result；Described second operating result is obtained, to described from described second client computer
First client computer sends described second operating result.
Server the most according to claim 6, it is characterised in that described server also includes:
Identity and Authority Verification module, for the connection request sent according to described first client computer, to institute
State the first client computer and carry out identity and Authority Verification；Described connection request includes username and password；
Set up module, if for being verified, setting up the service processes corresponding with described first client computer；
Based on this, described receiver module receives described first client computer specifically for utilizing described service processes
The described file manipulation command sent.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310482041.4A CN103595761B (en) | 2013-10-15 | 2013-10-15 | Data processing method based on distributed file system and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310482041.4A CN103595761B (en) | 2013-10-15 | 2013-10-15 | Data processing method based on distributed file system and server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103595761A CN103595761A (en) | 2014-02-19 |
| CN103595761B true CN103595761B (en) | 2017-01-04 |
Family
ID=50085741
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310482041.4A Active CN103595761B (en) | 2013-10-15 | 2013-10-15 | Data processing method based on distributed file system and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103595761B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105760395A (en) * | 2014-12-18 | 2016-07-13 | 华为技术有限公司 | Data processing method, device and system |
| CN106790666A (en) * | 2017-01-20 | 2017-05-31 | 泰华智慧产业集团股份有限公司 | Load balancing mesh architecture and its build operation method |
| CN106850827A (en) * | 2017-02-24 | 2017-06-13 | 深圳市中博睿存信息技术有限公司 | A kind of metadata of distributed type file system treating method and apparatus |
| CN110888840A (en) * | 2019-11-07 | 2020-03-17 | 浪潮电子信息产业股份有限公司 | File query method, device, equipment and medium in distributed file system |
| CN113419879B (en) * | 2021-07-09 | 2023-08-04 | 天翼云科技有限公司 | Message processing method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101741986A (en) * | 2009-12-31 | 2010-06-16 | 优视科技有限公司 | Page cache method for mobile communication equipment terminal |
| CN102299960A (en) * | 2011-08-22 | 2011-12-28 | 盛乐信息技术（上海）有限公司 | Peer-to-peer (P2P) technology-based network file system and method |
| CN102523279A (en) * | 2011-12-12 | 2012-06-27 | 云海创想信息技术（无锡）有限公司 | Distributed file system and hot file access method thereof |
| CN102523285A (en) * | 2011-12-15 | 2012-06-27 | 杭州电子科技大学 | Storage caching method of object-based distributed file system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8832023B2 (en) * | 2009-01-30 | 2014-09-09 | Apple Inc. | System for managing distributed assets and metadata |
-
2013
- 2013-10-15 CN CN201310482041.4A patent/CN103595761B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101741986A (en) * | 2009-12-31 | 2010-06-16 | 优视科技有限公司 | Page cache method for mobile communication equipment terminal |
| CN102299960A (en) * | 2011-08-22 | 2011-12-28 | 盛乐信息技术（上海）有限公司 | Peer-to-peer (P2P) technology-based network file system and method |
| CN102523279A (en) * | 2011-12-12 | 2012-06-27 | 云海创想信息技术（无锡）有限公司 | Distributed file system and hot file access method thereof |
| CN102523285A (en) * | 2011-12-15 | 2012-06-27 | 杭州电子科技大学 | Storage caching method of object-based distributed file system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103595761A (en) | 2014-02-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11632392B1 (en) | Distributed malware detection system and submission workflow thereof | |
| CN103595761B (en) | Data processing method based on distributed file system and server | |
| KR101946195B1 (en) | Control system for controlling private block-chain system | |
| KR101946196B1 (en) | Control system for controlling private block-chain system | |
| CN112597472B (en) | Single sign-on method, device and storage medium | |
| JP5961638B2 (en) | System and method for application certification | |
| CN106911687B (en) | Page construction control method and device | |
| KR102150750B1 (en) | Trusted login method and device | |
| CN102035815B (en) | Data acquisition method, access node and system | |
| CN105224255B (en) | A kind of storage file management method and device | |
| CN105765901B (en) | Intelligent firewall access rule | |
| US10771372B2 (en) | Transmitting test traffic on a communication link | |
| CN110197075A (en) | Resource access method, calculates equipment and storage medium at device | |
| CN106656911A (en) | Portal authentication method, access device and management server | |
| CN108881066A (en) | A kind of method of route requests, access server and storage equipment | |
| KR20160056944A (en) | Acceleration based on cached flows | |
| CN110061876B (en) | Optimization method and system of operation and maintenance auditing system | |
| CN114745145B (en) | Business data access method, device and equipment and computer storage medium | |
| CN110839023A (en) | Electric power marketing multi-channel customer service system | |
| CN103416027B (en) | The system of the method, buffer and cache optimization of cache optimization | |
| CN114201362A (en) | Prometheus-based enterprise-level high-availability monitoring system and implementation method | |
| Roos | Identity management on the blockchain | |
| KR102567900B1 (en) | Method and Apparatus for Ensuring Continuous Device Operational Stability in Cloud Degraded Mode | |
| CN115914300B (en) | Zero trust realization system and method for Internet of things based on block chain | |
| US9137121B1 (en) | Managing networks utilizing network simulation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |