CN109117292A - A kind of method and apparatus and cluster storage system of cluster-based storage - Google Patents
A kind of method and apparatus and cluster storage system of cluster-based storage Download PDFInfo
- Publication number
- CN109117292A CN109117292A CN201710480600.6A CN201710480600A CN109117292A CN 109117292 A CN109117292 A CN 109117292A CN 201710480600 A CN201710480600 A CN 201710480600A CN 109117292 A CN109117292 A CN 109117292A
- Authority
- CN
- China
- Prior art keywords
- storage
- storage server
- cluster
- correcting
- eleting codes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
- G06F11/0709—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
- G06F11/0727—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a storage system, e.g. in a DASD or network based storage system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/062—Securing storage systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A kind of method of cluster-based storage, comprising: according to the quantity of preset correcting and eleting codes and cluster storage server, determine the storage server quantity for allowing to break down；According to the correcting and eleting codes and the storage server quantity for allowing to break down, the number of copies at most allowing storage file piecemeal in each storage server is determined；After receiving write request message, blocked file copy is encoded according to the redundancy strategy of the correcting and eleting codes, according at most allow in each storage server storage file piecemeal number of copies select storage server stored.A kind of device and cluster storage system of cluster-based storage.This programme in limited storage resource, can guarantee the safety of the high availability and data of storage system.
Description
Technical field
The present embodiments relate to but be not limited to internet communication and cloud computing technology, espespecially a kind of method of cluster-based storage
With device and cluster storage system.
Background technique
With the continuous development of internet communication and cloud computing technology, the data of storage are in explosive growth, are taken to storage
More stringent requirements are proposed for the security reliability of business device hardware quantity and cluster storage system.
Existing cluster storage system is in order to guarantee the high availability and Information Security of storage system, usual redundancy strategy
Using more copies or correcting and eleting codes (Erasure Code, abbreviation EC) both of which, to guarantee in some node failure or delay machine,
The regular traffic of whole system is not influenced.Wherein, copy mode generally uses 2 copies, tolerates the server where 1 copy
Failure or delay machine.And a data file is divided into N by the way that different N and M (being positive integer) value is arranged by correcting and eleting codes mode
A isometric data block generates N+M data block, storage by codings such as RS (Reed-Solomon, reed solomon product code)
On different memory nodes.According to arbitrarily N number of piece in N+M data block, original document can be recovered, then tolerates M
Memory node failure or delay machine where data block.If N=6, M=2, in order to guarantee the security and reliability of data, storage
Node generally configures N+M, totally 8 servers.Tolerate 2 memory node simultaneous faults or delay machine, will not influence the normal of business
It uses.In order to ensure Information Security, storage server in the prior art is had to be larger than equal to N+M, needs largely to store
Server, cost are too high.
Summary of the invention
The embodiment of the present invention provides the method and apparatus and cluster storage system of a kind of cluster-based storage, in limited storage
Resource guarantees the safety of the high availability and data of storage system.
A kind of method of cluster-based storage, comprising:
According to the quantity of preset correcting and eleting codes and cluster storage server, the storage server number for allowing to break down is determined
Amount；
According to the correcting and eleting codes and the storage server quantity for allowing to break down, determine in each storage server
At most allow the number of copies of storage file piecemeal；
After receiving write request message, blocked file copy is encoded according to the redundancy strategy of the correcting and eleting codes, root
According at most allow in each storage server storage file piecemeal number of copies select storage server stored.
Optionally, the quantity S according to preset correcting and eleting codes N, M and cluster storage server, determining allows that event occurs
The storage server quantity D of barrier is determining in the following manner:
D is less than or equal to (M*S)/(N+M) and is rounded downwards, wherein N, M are positive integer.
Optionally, described according to the correcting and eleting codes M and the storage server quantity D for allowing to break down, it determines every
The number of copies C at most allowing storage file piecemeal in a storage server is determining in the following manner:
C is rounded equal to M/D, wherein M is positive integer.
Optionally, positive integer of the N between 1-10, positive integer of the M between 1-6.
A kind of device of cluster-based storage, wherein include:
First determining module, for the quantity according to preset correcting and eleting codes and cluster storage server, determination allows to occur
The storage server quantity of failure；
Second determining module determines every according to the correcting and eleting codes and the storage server quantity for allowing to break down
At most allow the number of copies of storage file piecemeal in a storage server；
Selecting module, after receiving write request message, according to the redundancy strategy of the correcting and eleting codes to blocked file pair
This is encoded, according to the number of copies selection storage server at most allowing storage file piecemeal in each storage server
It is stored.
Optionally, first determining module, according to the number of parameter N, M of preset correcting and eleting codes and cluster storage server
Measure S, determine the storage server quantity D for allowing to break down, be determining in the following manner: D is less than or equal to (M*S)/(N+
M it) is rounded downwards, wherein N, M are positive integer.
Optionally, second determining module, according to the correcting and eleting codes M and the storage server for allowing to break down
Quantity D determines the number of copies C at most allowing storage file piecemeal in each storage server, is determining in the following manner:
C is rounded equal to M/D, wherein M is positive integer.
Optionally, positive integer of the N between 1-10, positive integer of the M between 1-6.
A kind of device of cluster-based storage, comprising: memory, processor and storage can transport on a memory and on a processor
Capable computer program, wherein the processor performs the steps of when executing described program
According to the quantity of preset correcting and eleting codes and cluster storage server, the storage server number for allowing to break down is determined
Amount；
According to the correcting and eleting codes and the storage server quantity for allowing to break down, determine in each storage server
At most allow the number of copies of storage file piecemeal；
After receiving write request message, blocked file copy is encoded according to the redundancy strategy of the correcting and eleting codes, root
According at most allow in each storage server storage file piecemeal number of copies select storage server stored.
A kind of cluster storage system, the device including multiple storage servers and the cluster-based storage.
The embodiment of the present invention provides the method and apparatus and cluster storage system of a kind of cluster-based storage, may be implemented limited
Storage resource, guarantee the safety of the high availability and data of storage system.
Detailed description of the invention
Fig. 1 is a kind of flow chart of the method for cluster-based storage of the embodiment of the present invention.
Fig. 2 is the schematic diagram of the device of the cluster-based storage of the embodiment of the present invention.
Fig. 3 is the schematic diagram of the cluster storage system of the embodiment of the present invention.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with attached drawing to the present invention
Embodiment be described in detail.It should be noted that in the absence of conflict, in the embodiment and embodiment in the application
Feature can mutual any combination.
Embodiment one
Fig. 1 is a kind of flow chart of the method for cluster-based storage of the embodiment of the present invention, as shown in Figure 1, the side of the present embodiment
Method includes:
Step 11, the storage for allowing to break down according to the quantity of preset correcting and eleting codes and cluster storage server, determination
Number of servers；
Step 12, according to the correcting and eleting codes and the storage server quantity for allowing to break down, determine each storage
At most allow the number of copies of storage file piecemeal on server；
Step 13 after receiving write request message, carries out blocked file copy according to the redundancy strategy of the correcting and eleting codes
Coding, according at most allow in each storage server storage file piecemeal number of copies select storage server deposited
Storage.
The method of the present embodiment can make full use of limited storage resource, guarantee the high availability and data of storage system
Safety.
One data file is divided into N number of etc. by correcting and eleting codes mode by the way that different N and M (being positive integer) value is arranged
Long data block generates N+M data block by codings such as RS (Reed-Solomon, reed solomon product code), is stored in not
On same memory node.The present embodiment realizes correcting and eleting codes mode (EC N:M:D) redundancy plan under the conditions of limited memory resources
Slightly, wherein N value range: 1-10, M value range: 1-6, wherein N, M are positive integer.
D is to break down or the number of servers of delay machine, the value of D according to limited storage server total (S) according to
Certain algorithm is calculated, it may be assumed that D is less than or equal to (M*S)/(N+M) and is rounded downwards.For example, entire cluster storage system only has 5
Storage server, using EC 6:2 redundancy, then D=1, D cannot be greater than 1.
According to RS encryption algorithm, when being equal to or less than M dropout of data block, the number that can be lost by RS code restoration
According to block.D=(M*S)/(N+M) ensure that the data number of blocks stored in the storage server to break down is less than or equal to M value.
In one embodiment, cluster storage system is when the storage of select file piecemeal is to which storage server, according to permitting
Perhaps the number of servers (D) of failure or delay machine controls the copy number stored in any one storage server, calculates each
At most allow the number of copies (C) of storage file piecemeal in storage server, in which: C=M/D is rounded.
According to D=(M*S)/(N+M), C=(N+M)/S, the data number of blocks C in storage server is less than or equal to M/D,
It ensure that when some storage server failure or delay machine business access are normal
Such as: EC 6:2 is used, D=1 redundancy strategy, then at most allowing stored copies number in single storage server is 2；
Using configuration 10:3, D=1, it is 3 that storage file piecemeal number of copies is at most allowed in single storage server.
The present embodiment is based on correcting and eleting codes N:M redundancy strategy in the limited situation of storage server resource, in storage point
When block file copy, the blocked file copy storage server to be stored is navigated to according to consistency Hash (Hash) algorithm,
Count whether existing blocked file number of copies on currently stored server is less than C, in which: C=M/D is rounded.If it is less than C,
The storage server can be just selected, and otherwise select other storage servers.Guarantee to work as some storage server failure or delay machine
Business access is normal, while storing data safety.
Embodiment two
Fig. 2 is the schematic diagram of the device of the cluster-based storage of the embodiment of the present invention, as shown in Fig. 2, the device packet of the present embodiment
It includes:
First determining module, for the quantity according to preset correcting and eleting codes and cluster storage server, determination allows to occur
The storage server quantity of failure；
Second determining module determines every according to the correcting and eleting codes and the storage server quantity for allowing to break down
At most allow the number of copies of storage file piecemeal in a storage server；
Selecting module, after receiving write request message, according to the redundancy strategy of the correcting and eleting codes to blocked file pair
This is encoded, according to the number of copies selection storage server at most allowing storage file piecemeal in each storage server
It is stored.
The device of the present embodiment can make full use of limited storage resource, guarantee the high availability and data of storage system
Safety.
In one embodiment, first determining module, according to parameter N, M and cluster storage service of preset correcting and eleting codes
The quantity S of device determines the storage server quantity D for allowing to break down, is determining in the following manner: D is less than or equal to (M*
S)/(N+M) is rounded downwards, wherein N, M are positive integer.
In one embodiment, second determining module according to the parameter M of the correcting and eleting codes and described allows to break down
Storage server quantity D, determine the number of copies C at most allowing storage file piecemeal in each storage server, be by with
What under type determined: C is rounded equal to M/D, and M is positive integer.
Wherein, positive integer of the N between 1-10, positive integer of the M between 1-6.
The embodiment of the present invention also provides a kind of device of cluster-based storage, comprising: memory, processor and is stored in memory
Computer program that is upper and can running on a processor, wherein the processor performs the steps of when executing described program
According to the quantity of preset correcting and eleting codes and cluster storage server, the storage server number for allowing to break down is determined
Amount；
According to the correcting and eleting codes and the storage server quantity for allowing to break down, determine in each storage server
At most allow the number of copies of storage file piecemeal；
After receiving write request message, blocked file copy is encoded according to the redundancy strategy of the correcting and eleting codes, root
According at most allow in each storage server storage file piecemeal number of copies select storage server stored.
Embodiment three
Fig. 3 is the schematic diagram of the cluster storage system of the embodiment of the present invention, as shown in figure 3, the cluster-based storage of the present embodiment
System includes the device of multiple storage servers and above-mentioned cluster-based storage, can also include nms subsystem, wherein
Functional module in the device of cluster-based storage can have different divisions, may include: management module, database mould
Block and file access module.
Nms subsystem is shown for cluster storage system deployment, storage system configuration management, monitoring, alarm, performance
Function provides visualization interface, is convenient for system maintenance and setting.
Application program passes through NFS (Network File System, Network File System)/CIFS (Common
Internet File System, universal network file system)/POSIX (Portable Operating System
Interface of UNIX, portable operating system interface)/FTP (File Transfer Protocol, file transmission association
View) etc. standard interfaces access cluster storage system.
Method that the cluster storage system of the present embodiment is stored the following steps are included:
Step 101, when cluster storage system deployment/beginning, the number with current cluster storage server is needed according to business
EC N:M numerical value is arranged, wherein N value range: 1-10, M value range: 1-6 in amount in nms subsystem.Configuration cluster is deposited
The quantity of server: S is stored up, (Transmission Control Protocol passes transport control protocol to nms subsystem by TCP
View) related configuration data is sent to database module, in database module storage configuration data to local disk.
Step 102, database module is according to N, M and S value, and calculating allows to break down or the number of servers D of delay machine, and
It is stored on local disk.
The value algorithm of D: D is less than (M*S)/(N+M), is rounded downwards.If cluster storage system configures 5 storage services
Device then allows to break down or the number of servers D of delay machine using EC 6:2 redundancy strategy, is 1.
Step 103, application program accesses cluster storage system by NFS, and file access module receives application program
When write request message, request to create is sent to management module, by management module the metadata information carried in write request message
Database module is write, correcting and eleting codes N:M redundancy strategy information is returned and gives file access module；
Step 104, file access module is encoded according to correcting and eleting codes N:M redundancy strategy, and sends memory partitioning file
Association requests are given to database module to management module, management module by locations of copies request message, and database module is according to one
Cause property hash algorithm navigates to the blocked file copy server to be stored, meanwhile, it calculates existing in the storage server
Whether blocked file number of copies is less than C, in which: C=M/D is rounded.If it is less than C, which will be selected, otherwise select
The storage server information chosen is sent to file access module, file by other storage servers in cluster, management module
Access modules are written in the storage server chosen by blocked file.
Step 105, when having, D platform storage server breaks down or delay machine, correcting and eleting codes N:M and system provide normal read-write
Service, e.g., group system has 5 storage servers, using EC 6:2, has a server delay machine, according to highly reliable system side
The piecemeal number of copies stored in any one storage server of method is 2, and group system can provide normal read-write business.
The embodiment of the present invention also provides a kind of device of cluster-based storage, comprising: memory, processor and is stored in memory
Computer program that is upper and can running on a processor, wherein the processor performs the steps of when executing described program
According to the quantity of parameter N, M of preset correcting and eleting codes and cluster storage server, determine that allow to break down deposits
Store up number of servers, wherein N, M are positive integer；
According to the parameter M of the correcting and eleting codes and the storage server quantity for allowing to break down, each storage is determined
At most allow the number of copies of storage file piecemeal on server；
After receiving write request message, blocked file copy is encoded according to the redundancy strategy of the correcting and eleting codes, root
According at most allow in each storage server storage file piecemeal number of copies select storage server stored.
Currently, video monitoring or other similar product, in order to promote the competitiveness of product in market, through this embodiment
Scheme can reduce storage server quantity, improve system and store redundancy, reach reduction hardware cost, avoid when some or portion
Sub-server failure or delay machine influence the safety of business normal use and data.
Those of ordinary skill in the art will appreciate that all or part of the steps in the above method can be instructed by program
Related hardware is completed, and described program can store in computer readable storage medium, such as read-only memory, disk or CD
Deng.Optionally, one or more integrated circuits can be used also to realize in all or part of the steps of above-described embodiment.Accordingly
Ground, each module/unit in above-described embodiment can take the form of hardware realization, can also use the shape of software function module
Formula is realized.The present invention is not limited to the combinations of the hardware and software of any particular form.
The above is only a preferred embodiment of the present invention, and certainly, the invention may also have other embodiments, without departing substantially from this
In the case where spirit and its essence, those skilled in the art make various corresponding changes in accordance with the present invention
And deformation, but these corresponding changes and modifications all should fall within the scope of protection of the appended claims of the present invention.
Claims (10)
1. a kind of method of cluster-based storage, comprising:
According to the quantity of preset correcting and eleting codes and cluster storage server, the storage server quantity for allowing to break down is determined；
According to the correcting and eleting codes and the storage server quantity for allowing to break down, determine in each storage server at most
Allow the number of copies of storage file piecemeal；
After receiving write request message, blocked file copy is encoded according to the redundancy strategy of the correcting and eleting codes, according to institute
Stating at most allows the number of copies of storage file piecemeal that storage server is selected to be stored in each storage server.
2. the method as described in claim 1, it is characterised in that: described according to preset correcting and eleting codes N, M and cluster storage service
The quantity S of device determines the storage server quantity D for allowing to break down, is determining in the following manner:
D is less than or equal to (M*S)/(N+M) and is rounded downwards, wherein N, M are positive integer.
3. the method as described in claim 1, it is characterised in that: described according to the correcting and eleting codes M and described to allow to break down
Storage server quantity D, determine the number of copies C at most allowing storage file piecemeal in each storage server, be by with
What under type determined:
C is rounded equal to M/D, wherein M is positive integer.
4. the method according to claim 1, it is characterised in that:
Positive integer of the N between 1-10, positive integer of the M between 1-6.
5. a kind of device of cluster-based storage characterized by comprising
First determining module, for the quantity according to preset correcting and eleting codes and cluster storage server, determination allows to break down
Storage server quantity；
Second determining module, according to the correcting and eleting codes and the storage server quantity for allowing to break down, determination is each deposited
At most allow the number of copies of storage file piecemeal on storage server；
Selecting module, after receiving write request message, according to the redundancy strategy of the correcting and eleting codes to blocked file copy into
Row coding, according to the number of copies selection storage server progress at most allowing storage file piecemeal in each storage server
Storage.
6. device as claimed in claim 5, it is characterised in that:
First determining module determines and permits according to the quantity S of parameter N, M of preset correcting and eleting codes and cluster storage server
Permitted the storage server quantity D to break down, be determining in the following manner: D is less than or equal to (M*S)/(N+M) and takes downwards
It is whole, wherein N, M are positive integer.
7. device as claimed in claim 6, it is characterised in that:
Second determining module is determined according to the correcting and eleting codes M and the storage server quantity D for allowing to break down
The number of copies C at most allowing storage file piecemeal in each storage server, be determining in the following manner: C takes equal to M/D
It is whole, wherein M is positive integer.
8. such as the described in any item devices of claim 5-7, it is characterised in that:
Positive integer of the N between 1-10, positive integer of the M between 1-6.
9. a kind of device of cluster-based storage, comprising: memory, processor and storage can be run on a memory and on a processor
Computer program, which is characterized in that the processor performs the steps of when executing described program
According to the quantity of preset correcting and eleting codes and cluster storage server, the storage server quantity for allowing to break down is determined；
According to the correcting and eleting codes and the storage server quantity for allowing to break down, determine in each storage server at most
Allow the number of copies of storage file piecemeal；
After receiving write request message, blocked file copy is encoded according to the redundancy strategy of the correcting and eleting codes, according to institute
Stating at most allows the number of copies of storage file piecemeal that storage server is selected to be stored in each storage server.
10. a kind of cluster storage system, including multiple storage servers and such as described in any item cluster-based storages of claim 5-9
Device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710480600.6A CN109117292B (en) | 2017-06-22 | 2017-06-22 | Cluster storage method and device and cluster storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710480600.6A CN109117292B (en) | 2017-06-22 | 2017-06-22 | Cluster storage method and device and cluster storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109117292A true CN109117292A (en) | 2019-01-01 |
| CN109117292B CN109117292B (en) | 2021-07-13 |
Family
ID=64732692
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710480600.6A Active CN109117292B (en) | 2017-06-22 | 2017-06-22 | Cluster storage method and device and cluster storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109117292B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110209670A (en) * | 2019-05-09 | 2019-09-06 | 北京猫盘技术有限公司 | Data processing method and device based on network storage equipment cluster |
| CN110990189A (en) * | 2019-11-29 | 2020-04-10 | 北京金山云网络技术有限公司 | Data storage method and device, electronic equipment and computer readable storage medium |
| CN112882908A (en) * | 2019-11-29 | 2021-06-01 | 北京百度网讯科技有限公司 | Method and apparatus for generating information |
| CN117240873A (en) * | 2023-11-08 | 2023-12-15 | 阿里云计算有限公司 | Cloud storage system, data reading and writing method, device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103838860A (en) * | 2014-03-19 | 2014-06-04 | 华存数据信息技术有限公司 | File storing system based on dynamic transcript strategy and storage method of file storing system |
| CN103984607A (en) * | 2013-02-08 | 2014-08-13 | 华为技术有限公司 | Distributed storage method, device and system |
| CN105630418A (en) * | 2015-12-24 | 2016-06-01 | 曙光信息产业(北京)有限公司 | Data storage method and device |
| US20170046227A1 (en) * | 2015-08-14 | 2017-02-16 | Samsung Electronics Co., Ltd | Xf erasure code for distributed storage systems |
| CN106527993A (en) * | 2016-11-09 | 2017-03-22 | 北京搜狐新媒体信息技术有限公司 | Mass file storage method and device for distributed type system |
-
2017
- 2017-06-22 CN CN201710480600.6A patent/CN109117292B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103984607A (en) * | 2013-02-08 | 2014-08-13 | 华为技术有限公司 | Distributed storage method, device and system |
| CN103838860A (en) * | 2014-03-19 | 2014-06-04 | 华存数据信息技术有限公司 | File storing system based on dynamic transcript strategy and storage method of file storing system |
| US20170046227A1 (en) * | 2015-08-14 | 2017-02-16 | Samsung Electronics Co., Ltd | Xf erasure code for distributed storage systems |
| CN105630418A (en) * | 2015-12-24 | 2016-06-01 | 曙光信息产业(北京)有限公司 | Data storage method and device |
| CN106527993A (en) * | 2016-11-09 | 2017-03-22 | 北京搜狐新媒体信息技术有限公司 | Mass file storage method and device for distributed type system |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110209670A (en) * | 2019-05-09 | 2019-09-06 | 北京猫盘技术有限公司 | Data processing method and device based on network storage equipment cluster |
| CN110209670B (en) * | 2019-05-09 | 2022-03-25 | 北京猫盘技术有限公司 | Data processing method and device based on network storage device cluster |
| CN110990189A (en) * | 2019-11-29 | 2020-04-10 | 北京金山云网络技术有限公司 | Data storage method and device, electronic equipment and computer readable storage medium |
| CN112882908A (en) * | 2019-11-29 | 2021-06-01 | 北京百度网讯科技有限公司 | Method and apparatus for generating information |
| CN112882908B (en) * | 2019-11-29 | 2023-08-01 | 北京百度网讯科技有限公司 | Method and device for generating information |
| CN117240873A (en) * | 2023-11-08 | 2023-12-15 | 阿里云计算有限公司 | Cloud storage system, data reading and writing method, device and storage medium |
| CN117240873B (en) * | 2023-11-08 | 2024-03-29 | 阿里云计算有限公司 | Cloud storage system, data reading and writing method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109117292B (en) | 2021-07-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11740826B2 (en) | Policy-based hierarchical data protection in distributed storage | |
| CN107544862B (en) | Stored data reconstruction method and device based on erasure codes and storage node | |
| US9773015B2 (en) | Dynamically varying the number of database replicas | |
| US8612284B1 (en) | Quality of service differentiated cloud storage | |
| US10735545B2 (en) | Routing vault access requests in a dispersed storage network | |
| CN103890729B (en) | computerized method, storage server and management server | |
| US7925856B1 (en) | Method and apparatus for maintaining an amount of reserve space using virtual placeholders | |
| CN103929500A (en) | Method for data fragmentation of distributed storage system | |
| CN109117292A (en) | A kind of method and apparatus and cluster storage system of cluster-based storage | |
| US11442827B2 (en) | Policy-based hierarchical data protection in distributed storage | |
| CN103631666A (en) | Data redundancy fault-tolerance adaptation management device, service device, system and method | |
| CN105630418A (en) | Data storage method and device | |
| CN108319618B (en) | Data distribution control method, system and device of distributed storage system | |
| CN110825698B (en) | Metadata management method and related device | |
| US10860256B2 (en) | Storing data utilizing a maximum accessibility approach in a dispersed storage network | |
| CN108540315A (en) | Distributed memory system, method and apparatus | |
| CN109582213A (en) | Data reconstruction method and device, data-storage system | |
| CN110413694A (en) | Metadata management method and relevant apparatus | |
| CN103535014A (en) | A network storage system, data processing method and the client | |
| CN115834587A (en) | Method and device for selecting target storage server and electronic equipment | |
| CN109840051B (en) | Data storage method and device of storage system | |
| US11144638B1 (en) | Method for storage system detection and alerting on potential malicious action | |
| CN109510730A (en) | Distributed system and its monitoring method, device, electronic equipment and storage medium | |
| US10498822B2 (en) | Adaptive scanning rates | |
| CN115756955A (en) | Data backup and data recovery method and device and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |