CN105426127A - File storage method and apparatus for distributed cluster system - Google Patents
File storage method and apparatus for distributed cluster system Download PDFInfo
- Publication number
- CN105426127A CN105426127A CN201510779342.2A CN201510779342A CN105426127A CN 105426127 A CN105426127 A CN 105426127A CN 201510779342 A CN201510779342 A CN 201510779342A CN 105426127 A CN105426127 A CN 105426127A
- Authority
- CN
- China
- Prior art keywords
- file
- read
- written
- write
- buffer memory
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a file storage method and apparatus for a distributed cluster system. The method comprises: receiving a file writing request of a client; obtaining the size of a to-be-written file and comparing the size of the to-be-written file with a preset threshold; when the size of the to-be-written file is smaller than the preset threshold, distributing a cache of a preset size to the to-be-written file; and writing the to-be-written file into the cache. According to the file storage method and apparatus, the cache with a certain capacity is distributed to small file storage; and the cache is composed of a memory space of a server and the access speed of a memory is relatively high and is much higher than that of any disk media including an SSD, so that the performance of small file storage can be greatly improved through a cache mechanism.
Description
Technical field
The present invention relates to technical field of memory, particularly relate to a kind of file memory method and device of distributed cluster system.
Background technology
Current distributed type assemblies storage becomes more and more popular, and object provides Large Copacity and high-performance by enhanced scalability.But for small documents (below 256K), the storage of the small documents such as such as 4K, 8K, 16K, can not embody the advantage of its performance.
A kind of implementation promoted for distributed cluster storage system small documents in prior art is: by increasing SSD hard disk, small documents being stored on SSD hard disk, utilizing the high speed of SSD hard disk to promote small documents performance.But because SSD hard disk cost is high, therefore this mode carries high performance by increasing hardware cost.This with disagreed by the original intention of cheap constructed in hardware large-scale cluster storage system.
Therefore, the performance how promoting the storage of distributed cluster storage system small documents on the basis not increasing hardware cost becomes particularly important.
Summary of the invention
The object of this invention is to provide a kind of file memory method and device of distributed cluster system, object is the performance promoting the storage of distributed cluster storage system small documents on the basis not increasing hardware cost.
For solving the problems of the technologies described above, the invention provides a kind of file memory method of distributed cluster system, comprising:
Receive the request of client writing in files;
Obtain the size of file to be written, the sizes values of described file to be written and predetermined threshold value are compared;
When the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Described file to be written is write described buffer memory.
Alternatively, describedly described file to be written write described buffer memory comprise:
Described file to be written is write described buffer memory, and returns the successful confirmation information of write to described client.
Alternatively, also comprise after described file to be written is write described buffer memory:
After the file total amount of the described buffer memory of write reaches default fixed capacity, the file of the described buffer memory of write is written in disk.
Alternatively, also comprise:
Receive the request that client initiates file reading;
Obtain the size of file to be read, the sizes values of described file to be read and described predetermined threshold value are compared;
When the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache;
Spatial cache is read described in being read to from disk by described file to be read;
Described file to be read is read spatial cache from described reading.
Alternatively, also comprise after described reception client initiates the request of file reading:
Read in spatial cache, whether to there is described file to be read described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
Present invention also offers a kind of file storage device of distributed cluster system, comprising:
Receiver module, for receiving the request of client writing in files;
Comparison module, for obtaining the size of file to be written, compares the sizes values of described file to be written and predetermined threshold value;
Distribution module, for when the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Writing module, for writing described buffer memory by described file to be written.
Alternatively, said write module specifically for:
Described file to be written is write described buffer memory, and returns the successful confirmation information of write to described client.
Alternatively, also comprise:
Write disk module, for after described file to be written is write described buffer memory, after the file total amount of the described buffer memory of write reaches default fixed capacity, is written to the file of the described buffer memory of write in disk.
Alternatively, also comprise:
Read module, initiates the request of file reading for receiving client; Obtain the size of file to be read, the sizes values of described file to be read and described predetermined threshold value are compared; When the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache; Spatial cache is read described in being read to from disk by described file to be read; Described file to be read is read spatial cache from described reading.
Alternatively, described read module also comprises:
Detecting unit, after initiating the request of file reading in described reception client, reads whether there is described file to be read in spatial cache described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
The file memory method of distributed cluster system provided by the present invention and device, receive the request of client writing in files; And obtain the size of file to be written, the sizes values of file to be written and predetermined threshold value are compared; When the size of file to be written is less than predetermined threshold value, for file allocation to be written presets the buffer memory of size; File to be written is write described buffer memory.The present invention by being the buffer memory of small documents storage allocation certain capacity, and is made up of server memory space due to buffer memory, and the access speed of internal memory is very fast, far away higher than any magnetic disk media, comprise SSD hard disk, therefore by this caching mechanism, significantly can promote the performance that small documents stores.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of a kind of embodiment of the file memory method of distributed cluster system provided by the present invention;
Fig. 2 is the process flow diagram that a kind of embodiment file of the file memory method of distributed cluster system provided by the present invention reads;
Fig. 3 is the structured flowchart of a kind of embodiment of the file storage device of distributed cluster system provided by the present invention.
Embodiment
In order to make those skilled in the art person understand the present invention program better, below in conjunction with the drawings and specific embodiments, the present invention is described in further detail.Obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
As shown in Figure 1, the method comprises the process flow diagram of a kind of embodiment of the file memory method of distributed cluster system provided by the present invention:
Step S101: the request receiving client writing in files;
Step S102: the size obtaining file to be written, compares the sizes values of described file to be written and predetermined threshold value;
Step S103: when the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Step S104: described file to be written is write described buffer memory.
Particularly, after file to be written is write buffer memory, the successful confirmation information of write can be returned to client.
Further, after the file total amount of write buffer memory reaches default fixed capacity, the file of write buffer memory is written in disk.
The file memory method of distributed cluster system provided by the present invention, receives the request of client writing in files; And obtain the size of file to be written, the sizes values of file to be written and predetermined threshold value are compared; When the size of file to be written is less than predetermined threshold value, for file allocation to be written presets the buffer memory of size; File to be written is write described buffer memory.The present invention by being the buffer memory of small documents storage allocation certain capacity, and is made up of server memory space due to buffer memory, and the access speed of internal memory is very fast, far away higher than any magnetic disk media, comprise SSD hard disk, therefore by this caching mechanism, significantly can promote the performance that small documents stores.
Corresponding with above-mentioned ablation process, also comprise the process that small documents is read.The process flow diagram of this process as Fig. 2 so, it can be specially:
Step S201: receive the request that client initiates file reading;
Step S202: the size obtaining file to be read, compares the sizes values of described file to be read and described predetermined threshold value;
Step S203: when the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache;
Step S204: read spatial cache described in being read to from disk by described file to be read;
Step S205: read described file to be read spatial cache from described reading.
As a kind of embodiment, can further include after described reception client initiates the request of file reading:
Read in spatial cache, whether to there is described file to be read described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
Be described in detail the course of work that the file memory method of distributed cluster system provided by the present invention runs on server end below, it specifically includes small documents write and the process that reads.It is pointed out that size that small file of the present invention refers to file is less than the file of predetermined threshold value.Can arrange the predetermined threshold value of storage system small documents in advance, if the file that can define below 256k is small documents.
When client has file to write, comparing according to the size of file and predetermined threshold value, as being small documents, is then that it distributes fixing buffer memory, such as 10GB.When after small documents write buffer memory, client returns the successful indication information of write immediately.After server end write small documents reaches buffer memory fixed capacity, start the operation carrying out data back-end rule.
After client initiates small documents read operation, server end can distribute reads spatial cache, and small documents reads spatial cache from disk; When other clients continue this small documents, first detect storage system and read whether there is this file in spatial cache, if had, then directly to read from buffer memory; Otherwise, then the operation that spatial cache is read in above-mentioned distribution is repeated.Visible, the present invention, when reading small documents, by the setting pre-read, can improve the probability of small documents hit, thus the performance of elevator system.
As shown in Figure 3, this device comprises the structured flowchart of a kind of embodiment of the file storage device of distributed cluster system provided by the present invention:
Receiver module 100, for receiving the request of client writing in files;
Comparison module 200, for obtaining the size of file to be written, compares the sizes values of described file to be written and predetermined threshold value;
Distribution module 300, for when the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Writing module 400, for writing described buffer memory by described file to be written.
As a kind of embodiment, above-mentioned writing module 400 can be specifically for:
Described file to be written is write described buffer memory, and returns the successful confirmation information of write to described client.
As a kind of embodiment, the file storage device of distributed cluster system provided by the present invention can further include:
Write disk module, for after described file to be written is write described buffer memory, after the file total amount of the described buffer memory of write reaches default fixed capacity, is written to the file of the described buffer memory of write in disk.
As a kind of embodiment, the file storage device of distributed cluster system provided by the present invention can further include:
Read module, initiates the request of file reading for receiving client; Obtain the size of file to be read, the sizes values of described file to be read and described predetermined threshold value are compared; When the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache; Spatial cache is read described in being read to from disk by described file to be read; Described file to be read is read spatial cache from described reading.
As a kind of embodiment, above-mentioned read module can further include:
Detecting unit, after initiating the request of file reading in described reception client, reads whether there is described file to be read in spatial cache described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
The file storage device of distributed cluster system provided by the present invention is corresponding with the file memory method of above-mentioned distributed cluster system, can be cross-referenced, does not repeat them here.
To sum up, the file memory method of distributed cluster system provided by the present invention and device, arranged by the distribution carrying out writing global buffer at server end, distribute the read-write cache of fixed size, and ensure, after file enters and writes buffer memory, to return client immediately and write successful information.Like this can brief IO flow process, promote the memory property of small documents, thus promote the performance of total system.
In this instructions, each embodiment adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiment, between each embodiment same or similar part mutually see.
To the above-mentioned explanation of the disclosed embodiments, professional and technical personnel in the field are realized or uses the present invention.To be apparent for those skilled in the art to the multiple amendment of these embodiments, General Principle as defined herein can without departing from the spirit or scope of the present invention, realize in other embodiments.Therefore, the present invention can not be restricted to these embodiments shown in this article, but will meet the widest scope consistent with principle disclosed herein and features of novelty.
Claims (10)
1. a file memory method for distributed cluster system, is characterized in that, comprising:
Receive the request of client writing in files;
Obtain the size of file to be written, the sizes values of described file to be written and predetermined threshold value are compared;
When the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Described file to be written is write described buffer memory.
2. the file memory method of distributed cluster system as claimed in claim 1, is characterized in that, describedly described file to be written is write described buffer memory comprises:
Described file to be written is write described buffer memory, and returns the successful confirmation information of write to described client.
3. the file memory method of distributed cluster system as claimed in claim 2, is characterized in that, also comprise after described file to be written is write described buffer memory:
After the file total amount of the described buffer memory of write reaches default fixed capacity, the file of the described buffer memory of write is written in disk.
4. the file memory method of the distributed cluster system as described in any one of claims 1 to 3, is characterized in that, also comprises:
Receive the request that client initiates file reading;
Obtain the size of file to be read, the sizes values of described file to be read and described predetermined threshold value are compared;
When the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache;
Spatial cache is read described in being read to from disk by described file to be read;
Described file to be read is read spatial cache from described reading.
5. the file memory method of distributed cluster system as claimed in claim 4, is characterized in that, also comprises after described reception client initiates the request of file reading:
Read in spatial cache, whether to there is described file to be read described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
6. a file storage device for distributed cluster system, is characterized in that, comprising:
Receiver module, for receiving the request of client writing in files;
Comparison module, for obtaining the size of file to be written, compares the sizes values of described file to be written and predetermined threshold value;
Distribution module, for when the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Writing module, for writing described buffer memory by described file to be written.
7. the file storage device of distributed cluster system as claimed in claim 6, is characterized in that, said write module specifically for:
Described file to be written is write described buffer memory, and returns the successful confirmation information of write to described client.
8. the file storage device of distributed cluster system as claimed in claim 7, is characterized in that, also comprise:
Write disk module, for after described file to be written is write described buffer memory, after the file total amount of the described buffer memory of write reaches default fixed capacity, is written to the file of the described buffer memory of write in disk.
9. the file storage device of the distributed cluster system as described in any one of claim 6 to 8, is characterized in that, also comprises:
Read module, initiates the request of file reading for receiving client; Obtain the size of file to be read, the sizes values of described file to be read and described predetermined threshold value are compared; When the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache; Spatial cache is read described in being read to from disk by described file to be read; Described file to be read is read spatial cache from described reading.
10. the file memory method of distributed cluster system as claimed in claim 9, it is characterized in that, described read module also comprises:
Detecting unit, after initiating the request of file reading in described reception client, reads whether there is described file to be read in spatial cache described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510779342.2A CN105426127A (en) | 2015-11-13 | 2015-11-13 | File storage method and apparatus for distributed cluster system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510779342.2A CN105426127A (en) | 2015-11-13 | 2015-11-13 | File storage method and apparatus for distributed cluster system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105426127A true CN105426127A (en) | 2016-03-23 |
Family
ID=55504360
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510779342.2A Pending CN105426127A (en) | 2015-11-13 | 2015-11-13 | File storage method and apparatus for distributed cluster system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105426127A (en) |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106487653A (en) * | 2016-09-21 | 2017-03-08 | 腾讯数码(天津)有限公司 | A kind of message treatment method and server |
CN106776759A (en) * | 2016-11-17 | 2017-05-31 | 郑州云海信息技术有限公司 | The small documents pre-head method and system of distributed file system |
CN107341267A (en) * | 2017-07-24 | 2017-11-10 | 郑州云海信息技术有限公司 | A kind of distributed file system access method and platform |
CN107844258A (en) * | 2016-09-18 | 2018-03-27 | ***通信集团公司 | Data processing method, client, node server and distributed file system |
CN107885819A (en) * | 2017-11-07 | 2018-04-06 | 长沙曙通信息科技有限公司 | A kind of network attached storage partitions of file deposits implementation method |
CN108008912A (en) * | 2016-11-02 | 2018-05-08 | 华为技术有限公司 | A kind of memory buffers method and intelligent terminal based on DRAM |
CN108089825A (en) * | 2018-01-11 | 2018-05-29 | 郑州云海信息技术有限公司 | A kind of storage system based on distributed type assemblies |
CN108427537A (en) * | 2018-01-12 | 2018-08-21 | 上海凯翔信息科技有限公司 | Distributed memory system and its file write-in optimization method, client process method |
CN108874310A (en) * | 2018-05-28 | 2018-11-23 | 郑州云海信息技术有限公司 | The read buffer method, apparatus and computer readable storage medium of distributed storage |
CN108958659A (en) * | 2018-06-29 | 2018-12-07 | 郑州云海信息技术有限公司 | A kind of small documents polymerization, device and the medium of distributed memory system |
CN109471671A (en) * | 2017-09-06 | 2019-03-15 | 武汉斗鱼网络科技有限公司 | A kind of program cold start-up method and system |
CN109783032A (en) * | 2019-01-24 | 2019-05-21 | 山东超越数控电子股份有限公司 | A kind of distributed storage accelerating method and device based on Heterogeneous Computing |
CN111159124A (en) * | 2019-12-30 | 2020-05-15 | 浪潮电子信息产业股份有限公司 | Asynchronous write caching method, device and medium for Linux kernel file system |
CN112084163A (en) * | 2020-09-04 | 2020-12-15 | 珠海大横琴科技发展有限公司 | Data writing method and device and computer equipment |
CN113485978A (en) * | 2021-06-23 | 2021-10-08 | 华泰证券股份有限公司 | Method and system for improving read-write throughput of file storage NAS and storage |
CN113867646A (en) * | 2021-09-30 | 2021-12-31 | 福建极存数据科技有限公司 | Disk performance improving method and terminal |
CN114116634A (en) * | 2022-01-26 | 2022-03-01 | 苏州浪潮智能科技有限公司 | Caching method and device and readable storage medium |
CN114297172A (en) * | 2022-01-04 | 2022-04-08 | 北京乐讯科技有限公司 | Cloud-native-based distributed file system |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101277211A (en) * | 2008-05-16 | 2008-10-01 | 腾讯科技(深圳)有限公司 | Method and apparatus for buffering data |
CN101673191A (en) * | 2009-09-28 | 2010-03-17 | 成都市华为赛门铁克科技有限公司 | Data writing method and device as well as data memory system |
CN102521349A (en) * | 2011-12-12 | 2012-06-27 | 深圳市创新科信息技术有限公司 | Pre-reading method of files |
CN102567427A (en) * | 2010-12-30 | 2012-07-11 | ***通信集团公司 | Method and device for processing object data |
CN103399713A (en) * | 2013-08-02 | 2013-11-20 | 浙江大学 | Data buffering method for balancing multistage memory property and solid-state disk service life |
-
2015
- 2015-11-13 CN CN201510779342.2A patent/CN105426127A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101277211A (en) * | 2008-05-16 | 2008-10-01 | 腾讯科技(深圳)有限公司 | Method and apparatus for buffering data |
CN101673191A (en) * | 2009-09-28 | 2010-03-17 | 成都市华为赛门铁克科技有限公司 | Data writing method and device as well as data memory system |
CN102567427A (en) * | 2010-12-30 | 2012-07-11 | ***通信集团公司 | Method and device for processing object data |
CN102521349A (en) * | 2011-12-12 | 2012-06-27 | 深圳市创新科信息技术有限公司 | Pre-reading method of files |
CN103399713A (en) * | 2013-08-02 | 2013-11-20 | 浙江大学 | Data buffering method for balancing multistage memory property and solid-state disk service life |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107844258A (en) * | 2016-09-18 | 2018-03-27 | ***通信集团公司 | Data processing method, client, node server and distributed file system |
CN106487653B (en) * | 2016-09-21 | 2020-09-15 | 腾讯数码(天津)有限公司 | Message processing method and server |
CN106487653A (en) * | 2016-09-21 | 2017-03-08 | 腾讯数码(天津)有限公司 | A kind of message treatment method and server |
WO2018082616A1 (en) * | 2016-11-02 | 2018-05-11 | 华为技术有限公司 | Dram-based storage cache method and intelligent terminal |
CN108008912A (en) * | 2016-11-02 | 2018-05-08 | 华为技术有限公司 | A kind of memory buffers method and intelligent terminal based on DRAM |
CN106776759A (en) * | 2016-11-17 | 2017-05-31 | 郑州云海信息技术有限公司 | The small documents pre-head method and system of distributed file system |
CN107341267A (en) * | 2017-07-24 | 2017-11-10 | 郑州云海信息技术有限公司 | A kind of distributed file system access method and platform |
CN109471671A (en) * | 2017-09-06 | 2019-03-15 | 武汉斗鱼网络科技有限公司 | A kind of program cold start-up method and system |
CN107885819A (en) * | 2017-11-07 | 2018-04-06 | 长沙曙通信息科技有限公司 | A kind of network attached storage partitions of file deposits implementation method |
CN108089825B (en) * | 2018-01-11 | 2020-07-07 | 郑州云海信息技术有限公司 | Storage system based on distributed cluster |
CN108089825A (en) * | 2018-01-11 | 2018-05-29 | 郑州云海信息技术有限公司 | A kind of storage system based on distributed type assemblies |
CN108427537A (en) * | 2018-01-12 | 2018-08-21 | 上海凯翔信息科技有限公司 | Distributed memory system and its file write-in optimization method, client process method |
CN108874310A (en) * | 2018-05-28 | 2018-11-23 | 郑州云海信息技术有限公司 | The read buffer method, apparatus and computer readable storage medium of distributed storage |
CN108958659A (en) * | 2018-06-29 | 2018-12-07 | 郑州云海信息技术有限公司 | A kind of small documents polymerization, device and the medium of distributed memory system |
CN109783032A (en) * | 2019-01-24 | 2019-05-21 | 山东超越数控电子股份有限公司 | A kind of distributed storage accelerating method and device based on Heterogeneous Computing |
CN111159124A (en) * | 2019-12-30 | 2020-05-15 | 浪潮电子信息产业股份有限公司 | Asynchronous write caching method, device and medium for Linux kernel file system |
CN111159124B (en) * | 2019-12-30 | 2022-04-22 | 浪潮电子信息产业股份有限公司 | Asynchronous write caching method, device and medium for Linux kernel file system |
CN112084163A (en) * | 2020-09-04 | 2020-12-15 | 珠海大横琴科技发展有限公司 | Data writing method and device and computer equipment |
CN113485978A (en) * | 2021-06-23 | 2021-10-08 | 华泰证券股份有限公司 | Method and system for improving read-write throughput of file storage NAS and storage |
CN113485978B (en) * | 2021-06-23 | 2023-07-21 | 华泰证券股份有限公司 | Method, system and memory for improving read-write throughput capacity of file storage NAS |
CN113867646A (en) * | 2021-09-30 | 2021-12-31 | 福建极存数据科技有限公司 | Disk performance improving method and terminal |
CN113867646B (en) * | 2021-09-30 | 2022-03-18 | 福建极存数据科技有限公司 | Disk performance improving method and terminal |
CN114297172A (en) * | 2022-01-04 | 2022-04-08 | 北京乐讯科技有限公司 | Cloud-native-based distributed file system |
CN114297172B (en) * | 2022-01-04 | 2022-07-12 | 北京乐讯科技有限公司 | Cloud-native-based distributed file system |
CN114116634A (en) * | 2022-01-26 | 2022-03-01 | 苏州浪潮智能科技有限公司 | Caching method and device and readable storage medium |
CN114116634B (en) * | 2022-01-26 | 2022-04-22 | 苏州浪潮智能科技有限公司 | Caching method and device and readable storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105426127A (en) | File storage method and apparatus for distributed cluster system | |
US10037285B2 (en) | Multi-tiered storage systems and methods for adaptive content streaming | |
US9489148B2 (en) | Selecting between non-volatile memory units having different minimum addressable data unit sizes | |
US20170322888A1 (en) | Zoning of logical to physical data address translation tables with parallelized log list replay | |
CN103399823B (en) | The storage means of business datum, equipment and system | |
US8886884B2 (en) | System and method for increasing read and write speeds of hybrid storage unit | |
CN106445405B (en) | Data access method and device for flash memory storage | |
US20160092361A1 (en) | Caching technologies employing data compression | |
KR20140045269A (en) | Apparatus and method for low power low latency high capacity storage class memory | |
US10540114B2 (en) | System and method accelerated random write layout for bucket allocation with in hybrid storage systems | |
US9158695B2 (en) | System for dynamically adaptive caching | |
CN105117351A (en) | Method and apparatus for writing data into cache | |
TWI584120B (en) | Method and system for dynamically adaptive caching | |
US8856439B2 (en) | Method and device for utilizing application-level prior knowledge for selectively storing data in higher performance media | |
US20190057035A1 (en) | Method of storage management, storage system and computer program product | |
CN103198021B (en) | A kind of method improving solid state disk data transmission efficiency | |
CN103473266A (en) | Solid state disk and method for deleting repeating data thereof | |
CN104616680A (en) | Repeating data deleting system based on optical disc storage as well as data operating method and device | |
CN105516313A (en) | Distributed storage system used for big data | |
CN105005510A (en) | Error correction protection architecture and method applied to resistive random access memory cache of solid state disk | |
US20180004668A1 (en) | Searchable hot content cache | |
KR101686346B1 (en) | Cold data eviction method using node congestion probability for hdfs based on hybrid ssd | |
US10025664B2 (en) | Selective buffer protection | |
CN103399783A (en) | Storage method and device of mirror image documents of virtual machines | |
CN110990301A (en) | Sequential reading method of multi-plane storage medium and related device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160323 |