CN105426127A - File storage method and apparatus for distributed cluster system - Google Patents

File storage method and apparatus for distributed cluster system Download PDF

Info

Publication number
CN105426127A
CN105426127A CN201510779342.2A CN201510779342A CN105426127A CN 105426127 A CN105426127 A CN 105426127A CN 201510779342 A CN201510779342 A CN 201510779342A CN 105426127 A CN105426127 A CN 105426127A
Authority
CN
China
Prior art keywords
file
read
written
write
buffer memory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510779342.2A
Other languages
Chinese (zh)
Inventor
胡振
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Beijing Electronic Information Industry Co Ltd
Original Assignee
Inspur Beijing Electronic Information Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Beijing Electronic Information Industry Co Ltd filed Critical Inspur Beijing Electronic Information Industry Co Ltd
Priority to CN201510779342.2A priority Critical patent/CN105426127A/en
Publication of CN105426127A publication Critical patent/CN105426127A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061Improving I/O performance
    • G06F3/0611Improving I/O performance in relation to response time
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0656Data buffering arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a file storage method and apparatus for a distributed cluster system. The method comprises: receiving a file writing request of a client; obtaining the size of a to-be-written file and comparing the size of the to-be-written file with a preset threshold; when the size of the to-be-written file is smaller than the preset threshold, distributing a cache of a preset size to the to-be-written file; and writing the to-be-written file into the cache. According to the file storage method and apparatus, the cache with a certain capacity is distributed to small file storage; and the cache is composed of a memory space of a server and the access speed of a memory is relatively high and is much higher than that of any disk media including an SSD, so that the performance of small file storage can be greatly improved through a cache mechanism.

Description

A kind of file memory method of distributed cluster system and device
Technical field
The present invention relates to technical field of memory, particularly relate to a kind of file memory method and device of distributed cluster system.
Background technology
Current distributed type assemblies storage becomes more and more popular, and object provides Large Copacity and high-performance by enhanced scalability.But for small documents (below 256K), the storage of the small documents such as such as 4K, 8K, 16K, can not embody the advantage of its performance.
A kind of implementation promoted for distributed cluster storage system small documents in prior art is: by increasing SSD hard disk, small documents being stored on SSD hard disk, utilizing the high speed of SSD hard disk to promote small documents performance.But because SSD hard disk cost is high, therefore this mode carries high performance by increasing hardware cost.This with disagreed by the original intention of cheap constructed in hardware large-scale cluster storage system.
Therefore, the performance how promoting the storage of distributed cluster storage system small documents on the basis not increasing hardware cost becomes particularly important.
Summary of the invention
The object of this invention is to provide a kind of file memory method and device of distributed cluster system, object is the performance promoting the storage of distributed cluster storage system small documents on the basis not increasing hardware cost.
For solving the problems of the technologies described above, the invention provides a kind of file memory method of distributed cluster system, comprising:
Receive the request of client writing in files;
Obtain the size of file to be written, the sizes values of described file to be written and predetermined threshold value are compared;
When the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Described file to be written is write described buffer memory.
Alternatively, describedly described file to be written write described buffer memory comprise:
Described file to be written is write described buffer memory, and returns the successful confirmation information of write to described client.
Alternatively, also comprise after described file to be written is write described buffer memory:
After the file total amount of the described buffer memory of write reaches default fixed capacity, the file of the described buffer memory of write is written in disk.
Alternatively, also comprise:
Receive the request that client initiates file reading;
Obtain the size of file to be read, the sizes values of described file to be read and described predetermined threshold value are compared;
When the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache;
Spatial cache is read described in being read to from disk by described file to be read;
Described file to be read is read spatial cache from described reading.
Alternatively, also comprise after described reception client initiates the request of file reading:
Read in spatial cache, whether to there is described file to be read described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
Present invention also offers a kind of file storage device of distributed cluster system, comprising:
Receiver module, for receiving the request of client writing in files;
Comparison module, for obtaining the size of file to be written, compares the sizes values of described file to be written and predetermined threshold value;
Distribution module, for when the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Writing module, for writing described buffer memory by described file to be written.
Alternatively, said write module specifically for:
Described file to be written is write described buffer memory, and returns the successful confirmation information of write to described client.
Alternatively, also comprise:
Write disk module, for after described file to be written is write described buffer memory, after the file total amount of the described buffer memory of write reaches default fixed capacity, is written to the file of the described buffer memory of write in disk.
Alternatively, also comprise:
Read module, initiates the request of file reading for receiving client; Obtain the size of file to be read, the sizes values of described file to be read and described predetermined threshold value are compared; When the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache; Spatial cache is read described in being read to from disk by described file to be read; Described file to be read is read spatial cache from described reading.
Alternatively, described read module also comprises:
Detecting unit, after initiating the request of file reading in described reception client, reads whether there is described file to be read in spatial cache described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
The file memory method of distributed cluster system provided by the present invention and device, receive the request of client writing in files; And obtain the size of file to be written, the sizes values of file to be written and predetermined threshold value are compared; When the size of file to be written is less than predetermined threshold value, for file allocation to be written presets the buffer memory of size; File to be written is write described buffer memory.The present invention by being the buffer memory of small documents storage allocation certain capacity, and is made up of server memory space due to buffer memory, and the access speed of internal memory is very fast, far away higher than any magnetic disk media, comprise SSD hard disk, therefore by this caching mechanism, significantly can promote the performance that small documents stores.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of a kind of embodiment of the file memory method of distributed cluster system provided by the present invention;
Fig. 2 is the process flow diagram that a kind of embodiment file of the file memory method of distributed cluster system provided by the present invention reads;
Fig. 3 is the structured flowchart of a kind of embodiment of the file storage device of distributed cluster system provided by the present invention.
Embodiment
In order to make those skilled in the art person understand the present invention program better, below in conjunction with the drawings and specific embodiments, the present invention is described in further detail.Obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
As shown in Figure 1, the method comprises the process flow diagram of a kind of embodiment of the file memory method of distributed cluster system provided by the present invention:
Step S101: the request receiving client writing in files;
Step S102: the size obtaining file to be written, compares the sizes values of described file to be written and predetermined threshold value;
Step S103: when the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Step S104: described file to be written is write described buffer memory.
Particularly, after file to be written is write buffer memory, the successful confirmation information of write can be returned to client.
Further, after the file total amount of write buffer memory reaches default fixed capacity, the file of write buffer memory is written in disk.
The file memory method of distributed cluster system provided by the present invention, receives the request of client writing in files; And obtain the size of file to be written, the sizes values of file to be written and predetermined threshold value are compared; When the size of file to be written is less than predetermined threshold value, for file allocation to be written presets the buffer memory of size; File to be written is write described buffer memory.The present invention by being the buffer memory of small documents storage allocation certain capacity, and is made up of server memory space due to buffer memory, and the access speed of internal memory is very fast, far away higher than any magnetic disk media, comprise SSD hard disk, therefore by this caching mechanism, significantly can promote the performance that small documents stores.
Corresponding with above-mentioned ablation process, also comprise the process that small documents is read.The process flow diagram of this process as Fig. 2 so, it can be specially:
Step S201: receive the request that client initiates file reading;
Step S202: the size obtaining file to be read, compares the sizes values of described file to be read and described predetermined threshold value;
Step S203: when the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache;
Step S204: read spatial cache described in being read to from disk by described file to be read;
Step S205: read described file to be read spatial cache from described reading.
As a kind of embodiment, can further include after described reception client initiates the request of file reading:
Read in spatial cache, whether to there is described file to be read described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
Be described in detail the course of work that the file memory method of distributed cluster system provided by the present invention runs on server end below, it specifically includes small documents write and the process that reads.It is pointed out that size that small file of the present invention refers to file is less than the file of predetermined threshold value.Can arrange the predetermined threshold value of storage system small documents in advance, if the file that can define below 256k is small documents.
When client has file to write, comparing according to the size of file and predetermined threshold value, as being small documents, is then that it distributes fixing buffer memory, such as 10GB.When after small documents write buffer memory, client returns the successful indication information of write immediately.After server end write small documents reaches buffer memory fixed capacity, start the operation carrying out data back-end rule.
After client initiates small documents read operation, server end can distribute reads spatial cache, and small documents reads spatial cache from disk; When other clients continue this small documents, first detect storage system and read whether there is this file in spatial cache, if had, then directly to read from buffer memory; Otherwise, then the operation that spatial cache is read in above-mentioned distribution is repeated.Visible, the present invention, when reading small documents, by the setting pre-read, can improve the probability of small documents hit, thus the performance of elevator system.
As shown in Figure 3, this device comprises the structured flowchart of a kind of embodiment of the file storage device of distributed cluster system provided by the present invention:
Receiver module 100, for receiving the request of client writing in files;
Comparison module 200, for obtaining the size of file to be written, compares the sizes values of described file to be written and predetermined threshold value;
Distribution module 300, for when the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Writing module 400, for writing described buffer memory by described file to be written.
As a kind of embodiment, above-mentioned writing module 400 can be specifically for:
Described file to be written is write described buffer memory, and returns the successful confirmation information of write to described client.
As a kind of embodiment, the file storage device of distributed cluster system provided by the present invention can further include:
Write disk module, for after described file to be written is write described buffer memory, after the file total amount of the described buffer memory of write reaches default fixed capacity, is written to the file of the described buffer memory of write in disk.
As a kind of embodiment, the file storage device of distributed cluster system provided by the present invention can further include:
Read module, initiates the request of file reading for receiving client; Obtain the size of file to be read, the sizes values of described file to be read and described predetermined threshold value are compared; When the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache; Spatial cache is read described in being read to from disk by described file to be read; Described file to be read is read spatial cache from described reading.
As a kind of embodiment, above-mentioned read module can further include:
Detecting unit, after initiating the request of file reading in described reception client, reads whether there is described file to be read in spatial cache described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
The file storage device of distributed cluster system provided by the present invention is corresponding with the file memory method of above-mentioned distributed cluster system, can be cross-referenced, does not repeat them here.
To sum up, the file memory method of distributed cluster system provided by the present invention and device, arranged by the distribution carrying out writing global buffer at server end, distribute the read-write cache of fixed size, and ensure, after file enters and writes buffer memory, to return client immediately and write successful information.Like this can brief IO flow process, promote the memory property of small documents, thus promote the performance of total system.
In this instructions, each embodiment adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiment, between each embodiment same or similar part mutually see.
To the above-mentioned explanation of the disclosed embodiments, professional and technical personnel in the field are realized or uses the present invention.To be apparent for those skilled in the art to the multiple amendment of these embodiments, General Principle as defined herein can without departing from the spirit or scope of the present invention, realize in other embodiments.Therefore, the present invention can not be restricted to these embodiments shown in this article, but will meet the widest scope consistent with principle disclosed herein and features of novelty.

Claims (10)

1. a file memory method for distributed cluster system, is characterized in that, comprising:
Receive the request of client writing in files;
Obtain the size of file to be written, the sizes values of described file to be written and predetermined threshold value are compared;
When the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Described file to be written is write described buffer memory.
2. the file memory method of distributed cluster system as claimed in claim 1, is characterized in that, describedly described file to be written is write described buffer memory comprises:
Described file to be written is write described buffer memory, and returns the successful confirmation information of write to described client.
3. the file memory method of distributed cluster system as claimed in claim 2, is characterized in that, also comprise after described file to be written is write described buffer memory:
After the file total amount of the described buffer memory of write reaches default fixed capacity, the file of the described buffer memory of write is written in disk.
4. the file memory method of the distributed cluster system as described in any one of claims 1 to 3, is characterized in that, also comprises:
Receive the request that client initiates file reading;
Obtain the size of file to be read, the sizes values of described file to be read and described predetermined threshold value are compared;
When the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache;
Spatial cache is read described in being read to from disk by described file to be read;
Described file to be read is read spatial cache from described reading.
5. the file memory method of distributed cluster system as claimed in claim 4, is characterized in that, also comprises after described reception client initiates the request of file reading:
Read in spatial cache, whether to there is described file to be read described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
6. a file storage device for distributed cluster system, is characterized in that, comprising:
Receiver module, for receiving the request of client writing in files;
Comparison module, for obtaining the size of file to be written, compares the sizes values of described file to be written and predetermined threshold value;
Distribution module, for when the size of described file to be written is less than described predetermined threshold value, for described file allocation to be written presets the buffer memory of size;
Writing module, for writing described buffer memory by described file to be written.
7. the file storage device of distributed cluster system as claimed in claim 6, is characterized in that, said write module specifically for:
Described file to be written is write described buffer memory, and returns the successful confirmation information of write to described client.
8. the file storage device of distributed cluster system as claimed in claim 7, is characterized in that, also comprise:
Write disk module, for after described file to be written is write described buffer memory, after the file total amount of the described buffer memory of write reaches default fixed capacity, is written to the file of the described buffer memory of write in disk.
9. the file storage device of the distributed cluster system as described in any one of claim 6 to 8, is characterized in that, also comprises:
Read module, initiates the request of file reading for receiving client; Obtain the size of file to be read, the sizes values of described file to be read and described predetermined threshold value are compared; When the size of described file to be read is less than described predetermined threshold value, for described file allocation to be read reads spatial cache; Spatial cache is read described in being read to from disk by described file to be read; Described file to be read is read spatial cache from described reading.
10. the file memory method of distributed cluster system as claimed in claim 9, it is characterized in that, described read module also comprises:
Detecting unit, after initiating the request of file reading in described reception client, reads whether there is described file to be read in spatial cache described in detection; If had, then directly to read spatial cache from described reading; If not, then subsequent operation is performed.
CN201510779342.2A 2015-11-13 2015-11-13 File storage method and apparatus for distributed cluster system Pending CN105426127A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510779342.2A CN105426127A (en) 2015-11-13 2015-11-13 File storage method and apparatus for distributed cluster system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510779342.2A CN105426127A (en) 2015-11-13 2015-11-13 File storage method and apparatus for distributed cluster system

Publications (1)

Publication Number Publication Date
CN105426127A true CN105426127A (en) 2016-03-23

Family

ID=55504360

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510779342.2A Pending CN105426127A (en) 2015-11-13 2015-11-13 File storage method and apparatus for distributed cluster system

Country Status (1)

Country Link
CN (1) CN105426127A (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106487653A (en) * 2016-09-21 2017-03-08 腾讯数码(天津)有限公司 A kind of message treatment method and server
CN106776759A (en) * 2016-11-17 2017-05-31 郑州云海信息技术有限公司 The small documents pre-head method and system of distributed file system
CN107341267A (en) * 2017-07-24 2017-11-10 郑州云海信息技术有限公司 A kind of distributed file system access method and platform
CN107844258A (en) * 2016-09-18 2018-03-27 ***通信集团公司 Data processing method, client, node server and distributed file system
CN107885819A (en) * 2017-11-07 2018-04-06 长沙曙通信息科技有限公司 A kind of network attached storage partitions of file deposits implementation method
CN108008912A (en) * 2016-11-02 2018-05-08 华为技术有限公司 A kind of memory buffers method and intelligent terminal based on DRAM
CN108089825A (en) * 2018-01-11 2018-05-29 郑州云海信息技术有限公司 A kind of storage system based on distributed type assemblies
CN108427537A (en) * 2018-01-12 2018-08-21 上海凯翔信息科技有限公司 Distributed memory system and its file write-in optimization method, client process method
CN108874310A (en) * 2018-05-28 2018-11-23 郑州云海信息技术有限公司 The read buffer method, apparatus and computer readable storage medium of distributed storage
CN108958659A (en) * 2018-06-29 2018-12-07 郑州云海信息技术有限公司 A kind of small documents polymerization, device and the medium of distributed memory system
CN109471671A (en) * 2017-09-06 2019-03-15 武汉斗鱼网络科技有限公司 A kind of program cold start-up method and system
CN109783032A (en) * 2019-01-24 2019-05-21 山东超越数控电子股份有限公司 A kind of distributed storage accelerating method and device based on Heterogeneous Computing
CN111159124A (en) * 2019-12-30 2020-05-15 浪潮电子信息产业股份有限公司 Asynchronous write caching method, device and medium for Linux kernel file system
CN112084163A (en) * 2020-09-04 2020-12-15 珠海大横琴科技发展有限公司 Data writing method and device and computer equipment
CN113485978A (en) * 2021-06-23 2021-10-08 华泰证券股份有限公司 Method and system for improving read-write throughput of file storage NAS and storage
CN113867646A (en) * 2021-09-30 2021-12-31 福建极存数据科技有限公司 Disk performance improving method and terminal
CN114116634A (en) * 2022-01-26 2022-03-01 苏州浪潮智能科技有限公司 Caching method and device and readable storage medium
CN114297172A (en) * 2022-01-04 2022-04-08 北京乐讯科技有限公司 Cloud-native-based distributed file system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101277211A (en) * 2008-05-16 2008-10-01 腾讯科技(深圳)有限公司 Method and apparatus for buffering data
CN101673191A (en) * 2009-09-28 2010-03-17 成都市华为赛门铁克科技有限公司 Data writing method and device as well as data memory system
CN102521349A (en) * 2011-12-12 2012-06-27 深圳市创新科信息技术有限公司 Pre-reading method of files
CN102567427A (en) * 2010-12-30 2012-07-11 ***通信集团公司 Method and device for processing object data
CN103399713A (en) * 2013-08-02 2013-11-20 浙江大学 Data buffering method for balancing multistage memory property and solid-state disk service life

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101277211A (en) * 2008-05-16 2008-10-01 腾讯科技(深圳)有限公司 Method and apparatus for buffering data
CN101673191A (en) * 2009-09-28 2010-03-17 成都市华为赛门铁克科技有限公司 Data writing method and device as well as data memory system
CN102567427A (en) * 2010-12-30 2012-07-11 ***通信集团公司 Method and device for processing object data
CN102521349A (en) * 2011-12-12 2012-06-27 深圳市创新科信息技术有限公司 Pre-reading method of files
CN103399713A (en) * 2013-08-02 2013-11-20 浙江大学 Data buffering method for balancing multistage memory property and solid-state disk service life

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107844258A (en) * 2016-09-18 2018-03-27 ***通信集团公司 Data processing method, client, node server and distributed file system
CN106487653B (en) * 2016-09-21 2020-09-15 腾讯数码(天津)有限公司 Message processing method and server
CN106487653A (en) * 2016-09-21 2017-03-08 腾讯数码(天津)有限公司 A kind of message treatment method and server
WO2018082616A1 (en) * 2016-11-02 2018-05-11 华为技术有限公司 Dram-based storage cache method and intelligent terminal
CN108008912A (en) * 2016-11-02 2018-05-08 华为技术有限公司 A kind of memory buffers method and intelligent terminal based on DRAM
CN106776759A (en) * 2016-11-17 2017-05-31 郑州云海信息技术有限公司 The small documents pre-head method and system of distributed file system
CN107341267A (en) * 2017-07-24 2017-11-10 郑州云海信息技术有限公司 A kind of distributed file system access method and platform
CN109471671A (en) * 2017-09-06 2019-03-15 武汉斗鱼网络科技有限公司 A kind of program cold start-up method and system
CN107885819A (en) * 2017-11-07 2018-04-06 长沙曙通信息科技有限公司 A kind of network attached storage partitions of file deposits implementation method
CN108089825B (en) * 2018-01-11 2020-07-07 郑州云海信息技术有限公司 Storage system based on distributed cluster
CN108089825A (en) * 2018-01-11 2018-05-29 郑州云海信息技术有限公司 A kind of storage system based on distributed type assemblies
CN108427537A (en) * 2018-01-12 2018-08-21 上海凯翔信息科技有限公司 Distributed memory system and its file write-in optimization method, client process method
CN108874310A (en) * 2018-05-28 2018-11-23 郑州云海信息技术有限公司 The read buffer method, apparatus and computer readable storage medium of distributed storage
CN108958659A (en) * 2018-06-29 2018-12-07 郑州云海信息技术有限公司 A kind of small documents polymerization, device and the medium of distributed memory system
CN109783032A (en) * 2019-01-24 2019-05-21 山东超越数控电子股份有限公司 A kind of distributed storage accelerating method and device based on Heterogeneous Computing
CN111159124A (en) * 2019-12-30 2020-05-15 浪潮电子信息产业股份有限公司 Asynchronous write caching method, device and medium for Linux kernel file system
CN111159124B (en) * 2019-12-30 2022-04-22 浪潮电子信息产业股份有限公司 Asynchronous write caching method, device and medium for Linux kernel file system
CN112084163A (en) * 2020-09-04 2020-12-15 珠海大横琴科技发展有限公司 Data writing method and device and computer equipment
CN113485978A (en) * 2021-06-23 2021-10-08 华泰证券股份有限公司 Method and system for improving read-write throughput of file storage NAS and storage
CN113485978B (en) * 2021-06-23 2023-07-21 华泰证券股份有限公司 Method, system and memory for improving read-write throughput capacity of file storage NAS
CN113867646A (en) * 2021-09-30 2021-12-31 福建极存数据科技有限公司 Disk performance improving method and terminal
CN113867646B (en) * 2021-09-30 2022-03-18 福建极存数据科技有限公司 Disk performance improving method and terminal
CN114297172A (en) * 2022-01-04 2022-04-08 北京乐讯科技有限公司 Cloud-native-based distributed file system
CN114297172B (en) * 2022-01-04 2022-07-12 北京乐讯科技有限公司 Cloud-native-based distributed file system
CN114116634A (en) * 2022-01-26 2022-03-01 苏州浪潮智能科技有限公司 Caching method and device and readable storage medium
CN114116634B (en) * 2022-01-26 2022-04-22 苏州浪潮智能科技有限公司 Caching method and device and readable storage medium

Similar Documents

Publication Publication Date Title
CN105426127A (en) File storage method and apparatus for distributed cluster system
US10037285B2 (en) Multi-tiered storage systems and methods for adaptive content streaming
US9489148B2 (en) Selecting between non-volatile memory units having different minimum addressable data unit sizes
US20170322888A1 (en) Zoning of logical to physical data address translation tables with parallelized log list replay
CN103399823B (en) The storage means of business datum, equipment and system
US8886884B2 (en) System and method for increasing read and write speeds of hybrid storage unit
CN106445405B (en) Data access method and device for flash memory storage
US20160092361A1 (en) Caching technologies employing data compression
KR20140045269A (en) Apparatus and method for low power low latency high capacity storage class memory
US10540114B2 (en) System and method accelerated random write layout for bucket allocation with in hybrid storage systems
US9158695B2 (en) System for dynamically adaptive caching
CN105117351A (en) Method and apparatus for writing data into cache
TWI584120B (en) Method and system for dynamically adaptive caching
US8856439B2 (en) Method and device for utilizing application-level prior knowledge for selectively storing data in higher performance media
US20190057035A1 (en) Method of storage management, storage system and computer program product
CN103198021B (en) A kind of method improving solid state disk data transmission efficiency
CN103473266A (en) Solid state disk and method for deleting repeating data thereof
CN104616680A (en) Repeating data deleting system based on optical disc storage as well as data operating method and device
CN105516313A (en) Distributed storage system used for big data
CN105005510A (en) Error correction protection architecture and method applied to resistive random access memory cache of solid state disk
US20180004668A1 (en) Searchable hot content cache
KR101686346B1 (en) Cold data eviction method using node congestion probability for hdfs based on hybrid ssd
US10025664B2 (en) Selective buffer protection
CN103399783A (en) Storage method and device of mirror image documents of virtual machines
CN110990301A (en) Sequential reading method of multi-plane storage medium and related device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160323