CN106649702A - File storage method and apparatus of cloud storage system, and cloud storage system - Google Patents
File storage method and apparatus of cloud storage system, and cloud storage system Download PDFInfo
- Publication number
- CN106649702A CN106649702A CN201611183124.3A CN201611183124A CN106649702A CN 106649702 A CN106649702 A CN 106649702A CN 201611183124 A CN201611183124 A CN 201611183124A CN 106649702 A CN106649702 A CN 106649702A
- Authority
- CN
- China
- Prior art keywords
- storage
- file
- storage device
- placement group
- acquisition module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
- G06F16/183—Provision of network file services by network file servers, e.g. by using NFS, CIFS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the technical field of cloud storage and discloses a file storage method and apparatus of a cloud storage system, and the cloud storage system. The file storage method of the cloud storage system comprises the steps of obtaining storage files from a client; performing addressing on the obtained storage files to obtain storage file objects; performing addressing on the obtained storage file objects to obtain a placement group corresponding to the objects; performing addressing on the obtained placement group corresponding to the objects to obtain object storage devices corresponding to the placement group; and writing the obtained storage file objects into the obtained object storage devices corresponding to the placement group. According to the technical scheme, the addressing operation from the storage files to the object storage devices is quickly realized through three-time mapping, and the object storage devices are configured to perform secure backup storage on the storage files of a user, so that the convenience, security, reliability and working efficiency of file storage of the cloud storage system are improved, and the system performance of the cloud storage system and the user experience are enhanced.
Description
Technical field
The present invention relates to cloud storage technical field, more particularly to a kind of file memory method of cloud storage system, device and
Cloud storage system.
Background technology
With the high speed development and maturation of the technologies such as internet, Internet of Things, mobile Internet, big data, social informatization
Degree is higher, and the information data of generation is more, and the problem of information security is more prominent.The mistake that information storage security is stored in information
In journey and life cycle of information, authenticity, confidentiality, integrality, availability, reliability, non repudiation of information etc. are ensured
Characteristic, is the main foundation of information security.Cloud storage system is capable of achieving the secure network storage of subscriber data file, but existing
Cloud storage system carries out serial addressing storage process to storage file, and the storage efficiency and storage performance of storage server is poor,
While only holding storage in enterprising racking of object storage device, user's storage cannot be ensured once object storage device malfunctions
The integrality of data, safety and reliability, cause convenience, security, reliability and the work effect of existing cloud storage system
Rate is relatively low, have impact on the systematic function and Consumer's Experience of cloud storage system.
The content of the invention
In consideration of it, the present invention provides a kind of file memory method of cloud storage system, device and cloud storage system, solve existing
Have convenience, security, reliability and the operating efficiency of cloud storage system relatively low and affect cloud storage system systematic function and
The technical problem of Consumer's Experience.
According to one embodiment of present invention, there is provided a kind of file memory method of cloud storage system, including：From client
Obtain storage file；Storage file to obtaining is addressed to obtain the object of storage file；To the storage file for obtaining
Object is addressed to obtain the corresponding placement group of object；The corresponding placement group of object to obtaining is addressed to obtain placement
The corresponding object storage device of group；And the corresponding object storage of placement group for obtaining the object write of the storage file for obtaining
Equipment.
Preferably, the object storage device is three.
Preferably, the corresponding object storage device of placement group that the object write of the storage file for obtaining is obtained,
Including：Corresponding first object storage device of placement group that the object write of the storage file for obtaining is obtained；By the first object
The object of storage device write is respectively written into the second object storage device and the 3rd object storage device；And send to client
Storage file success storage information.
Preferably, described pair acquisition storage file be addressed to obtain the object of storage file, including：Obtain object
Default maximum file size；And the storage file for obtaining is carried out point according to the default maximum file size of the object for obtaining
Cut, to obtain the object of storage file.
Preferably, the object of storage file of described pair of acquisition is addressed to obtain the corresponding placement group of object, including：
The cryptographic Hash of identifier is calculated by hash function, to obtain the corresponding pseudorandom values of identifier；And the identifier that will be obtained
Corresponding pseudorandom values and mask step-by-step phase and computing, to obtain the corresponding placement group mark of object.
Preferably, the corresponding placement group of object of described pair of acquisition is addressed to obtain the corresponding object storage of placement group
Equipment, including：Computing is carried out to the corresponding placement group mark of object for obtaining by extendible pseudo-random data Distribution Algorithm,
To obtain the corresponding object storage device of placement group.
According to another embodiment of the invention, there is provided a kind of file storage device of cloud storage system, including：File is obtained
Delivery block, for obtaining storage file from client；Object acquisition module, for the storage obtained to the file acquisition module
File is addressed to obtain the object of storage file；Placement group acquisition module, for what is obtained to the object acquisition module
The object of storage file is addressed to obtain the corresponding placement group of object；Object storage device acquisition module, for described
The corresponding placement group of object that placement group acquisition module is obtained is addressed to obtain the corresponding object storage device of placement group；With
And file storage module, the object write object storage device of the storage file for the object acquisition module to be obtained
The corresponding object storage device of placement group that acquisition module is obtained.
Preferably, the object storage device that the object storage device acquisition module is obtained is three.
Preferably, the file storage module, including：First writing unit, for the object acquisition module to be obtained
The object of storage file write the corresponding first object storage of placement group that the object storage device acquisition module obtains and set
It is standby；Second writing unit, the object write for first writing unit to be write to the first object storage device is described right
As the second object storage device that storage device acquisition module is obtained；3rd writing unit, for by first writing unit
The 3rd object storage that the object write object storage device acquisition module of the first object storage device write is obtained is set
It is standby；And storage information transmitting element, for sending storage file success storage information to client.
Preferably, the object acquisition module, including：Object size acquiring unit, for obtaining the default maximum of object
File size；And object acquisition unit, the default maximum text of the object for being obtained according to the object size acquiring unit
Part size is split to the storage file that the file acquisition module is obtained, to obtain the object of storage file.
Preferably, the placement group acquisition module, including：Pseudorandom values acquiring unit, for being calculated by hash function
The cryptographic Hash of identifier is obtaining the corresponding pseudorandom values of identifier；And placement group mark acquiring unit, for by the puppet
The corresponding pseudorandom values of identifier and mask step-by-step phase and computing that random value acquiring unit is obtained, to obtain, object is corresponding to be put
Put a group mark.
Preferably, the object storage device acquisition module is put by extendible pseudo-random data Distribution Algorithm to described
Putting group corresponding placement group mark of object of acquisition module acquisition carries out computing, is set with obtaining the corresponding object storage of placement group
It is standby.
According to still another embodiment of the invention, there is provided a kind of cloud storage system, the cloud storage system includes client
With the file storage device of above-mentioned cloud storage system.
Preferably, the cloud storage system, also includes：Object storage cluster, for cloud storage system described in Automatic Optimal
File storage device the mapping from object to block；And object storage cluster monitoring module, it is described for detecting and safeguarding
Mapping of the object storage cluster from object to block.
The file memory method of cloud storage system, device and cloud storage system that the present invention is provided, to obtaining from client
Storage file be addressed to obtain the object of storage file, to obtain storage file object be addressed it is right to obtain
As corresponding placement group, the corresponding placement group of object to obtaining is addressed to be set to obtain the corresponding object storage of placement group
It is standby, and the corresponding object storage device of placement group that the object write of the storage file for obtaining is obtained, it is fast by cubic map
Speed realizes storage file to the addressing operation of object storage device, and configures multiple object storage devices user's storage file is entered
Row carrying out safety backup is stored, and improves convenience, security, reliability and the operating efficiency of the storage of cloud stocking system file, is lifted
The systematic function and Consumer's Experience of cloud storage system.
Description of the drawings
Technical scheme in order to be illustrated more clearly that the embodiment of the present invention, below will be to making needed for embodiment description
Accompanying drawing is briefly described.It should be evident that drawings in the following description are only some embodiments of the present invention, for
For those of ordinary skill in the art, on the premise of not paying creative work, can be obtaining other according to these accompanying drawings
Accompanying drawing.
Fig. 1 is the schematic flow sheet of the file memory method of cloud storage system in one embodiment of the invention.
Fig. 2 is the schematic flow sheet of the object that storage file is obtained in one embodiment of the invention.
Fig. 3 is the schematic flow sheet that the corresponding placement group of object is obtained in one embodiment of the invention.
Fig. 4 is the schematic flow sheet that the object of storage file in one embodiment of the invention writes object storage device.
Fig. 5 is the structural representation of the file storage device of cloud storage system in another embodiment of the present invention.
Fig. 6 is the structural representation of object acquisition module in another embodiment of the present invention.
Fig. 7 is the structural representation of placement group acquisition module in another embodiment of the present invention.
Fig. 8 is the structural representation of file storage module in another embodiment of the present invention.
Fig. 9 is the structural representation of cloud storage system in another embodiment of the invention.
Figure 10 is the structural representation of cloud storage system in further embodiment of the present invention.
Specific embodiment
Make further more detailed description to technical scheme with reference to the accompanying drawings and detailed description.It is aobvious
So, described embodiment a part of embodiment only of the invention, rather than the embodiment of whole.Based in the present invention
Embodiment, the every other embodiment that those of ordinary skill in the art are obtained on the premise of creative work is not made,
The scope of protection of the invention should all be belonged to.
In describing the invention, it is to be understood that term " first ", " second " etc. are not only used for describing purpose, and not
It is understood that to indicate or implying relative importance.In describing the invention, it should be noted that unless otherwise clearly regulation
And restriction, term " connected ", " connection " should be interpreted broadly, for example, it may be fixedly connected, or be detachably connected,
Or be integrally connected；Can be mechanically connected, or electrically connect；Can be joined directly together, it is also possible to by intermediary
It is indirectly connected to.For the ordinary skill in the art, above-mentioned term can be understood in the present invention with reference to concrete condition
Concrete meaning.Additionally, in describing the invention, unless otherwise stated, " multiple " are meant that two or more.
In flow chart or here any process described otherwise above or method description are construed as, expression includes
It is one or more for realizing specific logical function or process the step of the module of code of executable instruction, fragment or portion
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussion suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Fig. 1 is the schematic flow sheet of the file memory method of cloud storage system in one embodiment of the invention.As illustrated,
The file memory method of the cloud storage system, including：
Step S101：Storage file is obtained from client.
In the present embodiment, when user wants that the logical cloud storage system of local storage file (File) is carried out into high in the clouds deposits safely
Chu Shi, can use local client to connect the server of cloud storage system by internet, and storage file is transferred into cloud and deposit
The server of storage system, the PORT COM of the server of cloud storage system is received from client and obtains storage file, such as text
Files and database.
Step S102：Storage file to obtaining is addressed to obtain the object of storage file.
After storage file is got, the storage file to obtaining is addressed to obtain the object of storage file
(Object).Referring to Fig. 2, the object of the acquisition storage file, including：
Step S201：Obtain the default maximum file size of object.
Step S202：The storage file for obtaining is split according to the default maximum file size of the object for obtaining, with
Obtain the object of storage file.
In the present embodiment, default the maximum file size such as 2M or 4M of object are obtained first, then according to acquisition
The default maximum file size of object is split to the storage file for obtaining, and to obtain the object of multiple storage files, makes not
With the file division of file size into default maximum file size and can the efficient management of being serviced device object, and can be directed to multiple
Object carries out parallelization process and is no longer the serial process for single storage file simultaneously, improves cloud storage system to depositing
The operating efficiency that the management and storage of storage file is processed.
Step S103：The object of the storage file to obtaining is addressed to obtain the corresponding placement group of object.
After the object of storage file is got, the object of the storage file to obtaining is addressed to obtain object correspondence
Placement group.Referring to Fig. 3, the corresponding placement group of the acquisition object, including：
Step S301：The cryptographic Hash of identifier is calculated by hash function, to obtain the corresponding pseudorandom values of identifier.
Step S302：By the corresponding pseudorandom values of identifier for obtaining and mask step-by-step phase and computing, to obtain object pair
The placement group mark answered.
In the present embodiment, the cryptographic Hash of identifier (Oid) is calculated by static Hashing (Hash) function, to obtain mark
Symbol correspondence approaches uniformity distribution pseudorandom values, and by obtain the corresponding pseudorandom values of identifier and mask (Mask) step-by-step phase
With computing, to obtain corresponding placement group PG of object (Placement Group) (ID) is identified.When having a large amount of objects and put in a large number
When putting group, server can ensure the approaches uniformity mapping between object and placement group.Due to pair as if uniformly divided by storage file
Acquisition is cut, the file size of most of object is identical, address the corresponding placement group of object for obtaining and finally ensure each
The total amount of data approaches uniformity of the object stored in placement group, improves the distributed storage efficiency and systematicness of cloud storage system
Energy.
Step S104：The corresponding placement group of object to obtaining is addressed to be set to obtain the corresponding object storage of placement group
It is standby.
After the corresponding placement group of object is obtained, the corresponding placement group of object to obtaining is addressed to obtain placement group
Corresponding object storage device OSD (Object Storage Device).Specifically, by extendible pseudo-random data point
Cloth CRUSH (Controlled Replication Under Scalable Hashing) algorithms are corresponding to the object for obtaining
Placement group mark carries out computing, and to obtain the corresponding object storage device of multiple placement groups, multiple object storage devices are born jointly
All of object in the corresponding placement group of duty storage and maintenance.
In the present embodiment, the cloud storage system is assembled for each placement and puts three corresponding object storage devices, real
Triple backups of existing user's storage file, improve security, integrality, reliability and the user data of user data
Resume speed, while object storage device configuration solid-state hard disk SSD (Solid State Drive) realizes the quick of data
Read-write operation, improves the speed and operating efficiency of the process of cloud storage system cloud storage.
Step S105：The corresponding object storage device of placement group that the object write of the storage file for obtaining is obtained.
After the corresponding object storage device of placement group is got, by putting that the object write of the storage file of acquisition is obtained
Put the corresponding object storage device of group.Referring to Fig. 4, the object of the storage file writes object storage device, including：
Step S401：The corresponding first object storage of placement group that the object write of the storage file of acquisition is obtained is set
It is standby.
Step S402：The object that first object storage device writes is respectively written into the second object storage device and the 3rd pair
As storage device.
Step S403：Storage file success storage information is sent to client.
In the present embodiment, the first-selected corresponding sequence number of placement group for obtaining the object write of the storage file for obtaining is forward
The first object storage device, the object point for writing the first object storage device after first object storage device write
The second object storage device and the 3rd object storage device are not write, and write operation is all completed in three object storage devices
Afterwards, control to send storage file success storage information to client, finally realize that client storage file takes in cloud storage system
Triple safe storage in three object storage devices of business device.In cloud storage system, multiple client can be with multiple objects
Storage device carries out parallel write operation simultaneously, and multiple object storage devices can uniformly share cloud storage data write operation pressure
Power, it is to avoid the storage of single object storage device processes bottleneck, improves the systematic function and operating efficiency of cloud storage system.
In the file memory method of the cloud storage system of the present embodiment, the storage file to obtaining from client is sought
To obtain the object of storage file, the object of the storage file to obtaining is addressed to obtain the corresponding placement group of object for location,
The corresponding placement group of object to obtaining is addressed to obtain the corresponding object storage device of placement group, and the storage that will be obtained
The corresponding object storage device of placement group that the object write of file is obtained, quickly realizes storage file to right by cubic map
As the addressing operation of storage device, and configure multiple object storage devices carrying out safety backup storage is carried out to user's storage file, carry
The high convenience of cloud stocking system file storage, security, reliability and operating efficiency, the system for improving cloud storage system
Performance and Consumer's Experience.
Fig. 5 is the structural representation of the file storage device of cloud storage system in another embodiment of the present invention.As schemed
Show, the file storage device 100 of the cloud storage system, including file acquisition module 10, object acquisition module 20, placement group are obtained
Delivery block 30, object storage device acquisition module 40 and file storage module 50.
In the present embodiment, when user wants that the logical cloud storage system of local storage file (File) is carried out into high in the clouds deposits safely
Chu Shi, can use local client to connect the server of cloud storage system by internet, and storage file is transferred into cloud and deposit
The server of storage system, the PORT COM of the server that the file acquisition module 10 passes through cloud storage system is received from client
With acquisition storage file, such as document files and database.
After the file acquisition module 10 gets storage file, 20 pairs of file acquisitions of the object acquisition module
The storage file that module 10 is obtained is addressed to obtain the object of storage file.Referring to Fig. 6, the object acquisition module 20,
Including object size acquiring unit 201 and object acquisition unit 202.
In the present embodiment, the object size acquiring unit 201 obtains first the default maximum file size ratio of object
Such as 2M or 4M, the object that then the object acquisition unit 202 is obtained according to the object size acquiring unit 201 it is default most
Big file size is split to the storage file for obtaining, and to obtain the object of multiple storage files, makes different file sizes
File division into default maximum file size and can the efficient management of being serviced device object, and can simultaneously carry out for multiple objects
Parallelization is processed and is no longer the serial process for single storage file, improves management of the cloud storage system to storage file
The operating efficiency processed with storage.
After the object acquisition module 20 gets the object of storage file, described in the placement group acquisition module 30 pairs
The object of the storage file that object acquisition module 20 is obtained is addressed to obtain the corresponding placement group of object.It is described referring to Fig. 7
Placement group acquisition module 30, including pseudorandom values acquiring unit 301 and placement group mark acquiring unit 302.
In the present embodiment, the pseudorandom values acquiring unit 301 calculates identifier by static Hashing (Hash) function
(Oid) cryptographic Hash, to obtain the pseudorandom values of identifier correspondence approaches uniformity distribution, the placement group mark acquiring unit
The 302 corresponding pseudorandom values of identifier for obtaining the pseudorandom values acquiring unit 301 and mask (Mask) step-by-step phase and fortune
Calculate, to obtain corresponding placement group PG of object (Placement Group) mark (ID).When the object acquisition module 20 is obtained
When getting a large amount of placement groups to a large amount of objects, the placement group acquisition module 30, server can ensure object and placement group it
Between approaches uniformity mapping.Due to pair as if the file acquisition module 10 obtained by storage file even partition, it is most of
The file size of object is identical, and the corresponding placement group of object that the addressing of placement group acquisition module 30 is obtained finally ensures
The total amount of data approaches uniformity of the object stored in each placement group, improves the distributed storage efficiency of cloud storage system and is
System performance.
After the placement group acquisition module 30 obtains the corresponding placement group of object, the object storage device acquisition module
The corresponding placement group of object of 40 pairs of acquisitions of placement group acquisition module 30 is addressed to obtain the corresponding object of placement group
Storage device OSD (Object Storage Device).Specifically, the object storage device acquisition module 40 is by expanding
Pseudo-random data distribution CRUSH (the Controlled Replication Under Scalable Hashing) algorithm pair of exhibition
The corresponding placement group mark of object that the placement group acquisition module 30 is obtained carries out computing, corresponding to obtain multiple placement groups
Object storage device, multiple object storage devices are collectively responsible for all of object in the corresponding placement group of storage and maintenance.
In the present embodiment, the cloud storage system is that placement that each described placement group acquisition module 30 is obtained is assembled and put
Three corresponding object storage devices, realize triple backups of user's storage file, improve the security of user data, complete
Property, the resume speed of reliability and user data, while object storage device configuration solid-state hard disk SSD (Solid
State Drive) realize that the fast reading and writing of data is operated, improve the speed and work effect of the process of cloud storage system cloud storage
Rate.
After the object storage device acquisition module 40 gets the corresponding object storage device of placement group, the file
The placement group that the object write of the storage file that memory module 50 obtains the object storage device acquisition module 40 is obtained is right
The object storage device answered.Referring to Fig. 8, the file storage module 50, including the first writing unit 501, the second writing unit
502nd, the 3rd writing unit 503 and storage information transmitting element 504.
In the present embodiment, the storage text that the first-selection of the first writing unit 501 obtains the object acquisition module 20
The first object that the corresponding sequence number of placement group of the object write acquisition of object storage device acquisition module 40 of part is forward is deposited
Storage equipment, after first writing unit, 501 pairs of the first object storage device writes, second writing unit 502
The object of first writing unit, 501 pairs of the first object storage devices write is respectively written into the with the 3rd writing unit 503
Two object storage devices and the 3rd object storage device, and in first writing unit 501, the second writing unit 502 and
Three object storage devices of writing unit 503 3 are all completed after write operation, and the storage information transmitting element 504 is controlled to visitor
Family end sends storage file success storage information, finally realizes that client storage file is right at three of cloud storage system server
As the triple safe in storage device is stored.In cloud storage system, multiple client can be with multiple object storage devices simultaneously
Parallel write operation is carried out, multiple object storage devices can uniformly share cloud storage data write operation pressure, it is to avoid list
The storage of individual object storage device processes bottleneck, improves the systematic function and operating efficiency of cloud storage system.
In the document storage system 100 of the cloud storage system of the present embodiment, to described in the object acquisition module 20 pairs
File acquisition module 10 is addressed that to obtain the object of storage file the placement group is obtained from the storage file that client is obtained
The object of the storage file that the object acquisition module 20 of delivery block 30 pairs is obtained is addressed to obtain the corresponding placement of object
Group, the corresponding placement group of object that the placement group acquisition module 30 of the object storage device acquisition module 40 pairs is obtained is carried out
To obtain the corresponding object storage device of placement group, the file storage module 50 obtains the object acquisition module 20 for addressing
The object of storage file write the corresponding object storage device of placement group that the object storage device acquisition module 40 is obtained,
Storage file is quickly realized to the addressing operation of object storage device by cubic map, and configures multiple object storage devices pair
User's storage file carries out carrying out safety backup storage, improve cloud stocking system file storage convenience, security, reliability and
Operating efficiency, improves the systematic function and Consumer's Experience of cloud storage system.
Fig. 9 is the structural representation of cloud storage system in another embodiment of the invention.As illustrated, the cloud storage system
System 300 includes the file storage device 100 of client 200 and cloud storage system, is stored by the file of the cloud storage system
Device 100 realizes cubic map and quickly realizes storage file to the addressing operation of object storage device, and configures multiple objects
Storage device carries out carrying out safety backup storage to user's storage file, improves convenience, the peace of the storage of the file of cloud stocking system 300
Quan Xing, reliability and operating efficiency, improve the systematic function and Consumer's Experience of cloud storage system 300.
Figure 10 is the structural representation of cloud storage system in further embodiment of the present invention.As illustrated, in above-mentioned enforcement
On the basis of example, the cloud storage system 300 includes that the file storage device 100, object of client 200, cloud storage system is deposited
Accumulation 400 and object storage cluster monitoring module 500.In the present embodiment, the Automatic Optimal institute of the object storage cluster 400
The mapping from object to block of the file storage device of cloud storage system is stated, selects optimal storage mode to automate to point to
Storage object.The object storage cluster monitoring module 500 detects and safeguards the object storage cluster 400 from object to block
Mapping, realizes the monitoring and management of the mapping of the object storage cluster 400.By the object storage cluster 400 and object
Storage cluster monitoring module 500 further optimize and manage the file storage device of the cloud storage system from object to block
Mapping, further increases convenience, security, reliability and the operating efficiency of the storage of the file of cloud stocking system 300, improves
The systematic function and Consumer's Experience of cloud storage system 300.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, the software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage
Or firmware is realizing.For example, if realized with hardware, and in another embodiment, can be with well known in the art
Any one of row technology or their combination are realizing：With for realizing the logic gates of logic function to data-signal
Discrete logic, the special IC with suitable combinational logic gate circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description such as example " or " some examples " means to combine specific features, structure, material or feature that the embodiment or example are described
In being contained at least one embodiment of the present invention or example.In this manual, the schematic representation of above-mentioned term is differed
Surely identical embodiment or example are referred to.And, the specific features of description, structure, material or feature can be any
Combine in an appropriate manner in one or more embodiments or example.
Although an embodiment of the present invention has been shown and described, it will be understood by those skilled in the art that：Not
These embodiments can be carried out with various changes, modification, replacement and modification in the case of the principle and objective that depart from the present invention, this
The scope of invention is limited by claim and its equivalent.
Claims (14)
1. a kind of file memory method of cloud storage system, it is characterised in that include：
Storage file is obtained from client；
Storage file to obtaining is addressed to obtain the object of storage file；
The object of the storage file to obtaining is addressed to obtain the corresponding placement group of object；
The corresponding placement group of object to obtaining is addressed to obtain the corresponding object storage device of placement group；And
The corresponding object storage device of placement group that the object write of the storage file for obtaining is obtained.
2. the file memory method of cloud storage system according to claim 1, it is characterised in that the object storage device
For three.
3. the file memory method of cloud storage system according to claim 2, it is characterised in that the storage that will be obtained
The corresponding object storage device of placement group that the object write of file is obtained, including：
Corresponding first object storage device of placement group that the object write of the storage file for obtaining is obtained；
The object that first object storage device writes is respectively written into the second object storage device and the 3rd object storage device；With
And
Storage file success storage information is sent to client.
4. the file memory method of cloud storage system according to claim 1 and 2, it is characterised in that the described pair of acquisition
Storage file is addressed to obtain the object of storage file, including：
Obtain the default maximum file size of object；And
The storage file for obtaining is split according to the default maximum file size of the object for obtaining, to obtain storage file
Object.
5. the file memory method of cloud storage system according to claim 1 and 2, it is characterised in that the described pair of acquisition
The object of storage file is addressed to obtain the corresponding placement group of object, including：
The cryptographic Hash of identifier is calculated by hash function, to obtain the corresponding pseudorandom values of identifier；And
By the corresponding pseudorandom values of identifier for obtaining and mask step-by-step phase and computing, to obtain the corresponding placement group mark of object
Know.
6. the file memory method of cloud storage system according to claim 5, it is characterised in that the object of described pair of acquisition
Corresponding placement group is addressed to obtain the corresponding object storage device of placement group, including：
Computing is carried out to the corresponding placement group mark of object for obtaining by extendible pseudo-random data Distribution Algorithm, to obtain
The corresponding object storage device of placement group.
7. a kind of file storage device of cloud storage system, it is characterised in that include：
File acquisition module, for obtaining storage file from client；
Object acquisition module, for being addressed to obtain storage file to the storage file that the file acquisition module is obtained
Object；
Placement group acquisition module, it is right to obtain that the object of the storage file for obtaining to the object acquisition module is addressed
As corresponding placement group；
Object storage device acquisition module, for seeking to the corresponding placement group of object that the placement group acquisition module is obtained
Location is obtaining the corresponding object storage device of placement group；And
File storage module, the object of the storage file for the object acquisition module to be obtained writes the object storage and sets
The corresponding object storage device of placement group that standby acquisition module is obtained.
8. the file storage device of cloud storage system according to claim 7, it is characterised in that the object storage device
The object storage device that acquisition module is obtained is three.
9. the file storage device of cloud storage system according to claim 8, it is characterised in that the file stores mould
Block, including：
First writing unit, the object of the storage file for the object acquisition module to be obtained writes the object storage and sets
Corresponding first object storage device of placement group that standby acquisition module is obtained；
Second writing unit, the object write for first writing unit to be write to the first object storage device is described right
As the second object storage device that storage device acquisition module is obtained；
3rd writing unit, the object write for first writing unit to be write to the first object storage device is described right
As the 3rd object storage device that storage device acquisition module is obtained；And
Storage information transmitting element, for sending storage file success storage information to client.
10. the file storage device of the cloud storage system according to claim 7 or 8, it is characterised in that the object acquisition
Module, including：
Object size acquiring unit, for obtaining the default maximum file size of object；And
Object acquisition unit, for the default maximum file size of object that obtained according to the object size acquiring unit to institute
The storage file for stating the acquisition of file acquisition module is split, to obtain the object of storage file.
The file storage device of 11. cloud storage systems according to claim 7 or 8, it is characterised in that the placement group is obtained
Delivery block, including：
Pseudorandom values acquiring unit, for the cryptographic Hash of identifier is calculated by hash function with obtain identifier it is corresponding it is pseudo- with
Machine value；And
Placement group mark acquiring unit, for the corresponding pseudorandom values of identifier that obtain the pseudorandom values acquiring unit and
Mask step-by-step phase and computing, to obtain the corresponding placement group mark of object.
The file storage device of 12. cloud storage systems according to claim 11, it is characterised in that the object storage sets
Standby acquisition module is corresponding to the object that the placement group acquisition module is obtained by extendible pseudo-random data Distribution Algorithm
Placement group mark carries out computing, to obtain the corresponding object storage device of placement group.
13. a kind of cloud storage systems, it is characterised in that the cloud storage system includes client and such as claim 7 to 11 times
The file storage device of the cloud storage system described in.
14. cloud storage systems according to claim 13, it is characterised in that also include：
Object storage cluster, for the mapping from object to block of the file storage device of cloud storage system described in Automatic Optimal；
And
Object storage cluster monitoring module, for detecting and safeguarding mapping of the object storage cluster from object to block.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611183124.3A CN106649702A (en) | 2016-12-20 | 2016-12-20 | File storage method and apparatus of cloud storage system, and cloud storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611183124.3A CN106649702A (en) | 2016-12-20 | 2016-12-20 | File storage method and apparatus of cloud storage system, and cloud storage system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106649702A true CN106649702A (en) | 2017-05-10 |
Family
ID=58833995
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611183124.3A Pending CN106649702A (en) | 2016-12-20 | 2016-12-20 | File storage method and apparatus of cloud storage system, and cloud storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106649702A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107391761A (en) * | 2017-08-28 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of data managing method and device based on data de-duplication technology |
| CN107402727A (en) * | 2017-08-08 | 2017-11-28 | 郑州云海信息技术有限公司 | A kind of memory management method and device |
| CN109597903A (en) * | 2018-11-21 | 2019-04-09 | 北京市商汤科技开发有限公司 | Image file processing apparatus and method, document storage system and storage medium |
| WO2021238285A1 (en) * | 2020-05-24 | 2021-12-02 | 苏州浪潮智能科技有限公司 | Method and system for balancing and optimizing main placement group, and device and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204331728U (en) * | 2014-12-25 | 2015-05-13 | 唐山蓝普科技有限公司 | A kind of data-storage system based on cloud computing |
| CN105095794A (en) * | 2015-07-20 | 2015-11-25 | 武汉科技大学 | Verification method for dynamic cloud data integrity based on balanced Merkle Hash tree |
| CN105187502A (en) * | 2015-08-07 | 2015-12-23 | 北京思特奇信息技术股份有限公司 | Method and system based on distributed elastic block storage |
| CN105338118A (en) * | 2015-11-30 | 2016-02-17 | 上海斐讯数据通信技术有限公司 | Distributed storage system |
-
2016
- 2016-12-20 CN CN201611183124.3A patent/CN106649702A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204331728U (en) * | 2014-12-25 | 2015-05-13 | 唐山蓝普科技有限公司 | A kind of data-storage system based on cloud computing |
| CN105095794A (en) * | 2015-07-20 | 2015-11-25 | 武汉科技大学 | Verification method for dynamic cloud data integrity based on balanced Merkle Hash tree |
| CN105187502A (en) * | 2015-08-07 | 2015-12-23 | 北京思特奇信息技术股份有限公司 | Method and system based on distributed elastic block storage |
| CN105338118A (en) * | 2015-11-30 | 2016-02-17 | 上海斐讯数据通信技术有限公司 | Distributed storage system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107402727A (en) * | 2017-08-08 | 2017-11-28 | 郑州云海信息技术有限公司 | A kind of memory management method and device |
| CN107391761A (en) * | 2017-08-28 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of data managing method and device based on data de-duplication technology |
| CN107391761B (en) * | 2017-08-28 | 2020-03-06 | 苏州浪潮智能科技有限公司 | Data management method and device based on repeated data deletion technology |
| CN109597903A (en) * | 2018-11-21 | 2019-04-09 | 北京市商汤科技开发有限公司 | Image file processing apparatus and method, document storage system and storage medium |
| WO2021238285A1 (en) * | 2020-05-24 | 2021-12-02 | 苏州浪潮智能科技有限公司 | Method and system for balancing and optimizing main placement group, and device and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106649702A (en) | File storage method and apparatus of cloud storage system, and cloud storage system | |
| US20210226770A1 (en) | Method, system, computer system and storage medium of uploading blockchain data | |
| CN102891869B (en) | CDN (Content Delivery Network) and content distribution and scheduling method | |
| CN104902010A (en) | Cloud storage method and system for file | |
| CN104050248B (en) | A kind of document storage system and storage method | |
| CN103078965B (en) | The IP address management method of virtual machine | |
| CN102523290B (en) | Data processing method, device and system | |
| CN104811473B (en) | A kind of method, system and management system for creating virtual non-volatile storage medium | |
| JP2021501358A (en) | How to manage cryptographic objects, computer implementations, systems and programs | |
| DE102016102424A1 (en) | Content-based hardware security module assignment to virtual machines | |
| CN104636084A (en) | Device and method for carrying out reasonable and efficient distributive storage on big power data | |
| CN103327085A (en) | Distributed data processing method, data center and distributed data system | |
| CN103281361A (en) | Personal cloud cooperation system and data management method | |
| CN106406980B (en) | A kind of dispositions method and device of virtual machine | |
| CN105718299A (en) | Virtual machine configuration method, device and system | |
| CN107832169A (en) | Internal storage data moving method, device, terminal device and storage medium | |
| CN107329853A (en) | Backup method, standby system and the electronic equipment of data-base cluster | |
| US20110154015A1 (en) | Method For Segmenting A Data File, Storing The File In A Separate Location, And Recreating The File | |
| CN107357630A (en) | A kind of method, apparatus and storage medium for realizing that virtual machine is synchronous | |
| CN103823807A (en) | Data de-duplication method, device and system | |
| CN113961908B (en) | Data storage method and device, computer equipment and storage medium | |
| CN109582509A (en) | Distributed file system disaster tolerance configuration method, device and readable storage medium storing program for executing | |
| CN103297514A (en) | Virtual machine management platform and virtual machine management method based on cloud infrastructure | |
| CN105262796A (en) | Cloud platform storage resource management system and disposition framework thereof | |
| CN112653539B (en) | Storage method, device and equipment for data to be stored |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170510 |
|
| WD01 | Invention patent application deemed withdrawn after publication |