CN105069091A - HBASE based virtual file system and realization method therefor - Google Patents
HBASE based virtual file system and realization method therefor Download PDFInfo
- Publication number
- CN105069091A CN105069091A CN201510473964.2A CN201510473964A CN105069091A CN 105069091 A CN105069091 A CN 105069091A CN 201510473964 A CN201510473964 A CN 201510473964A CN 105069091 A CN105069091 A CN 105069091A
- Authority
- CN
- China
- Prior art keywords
- file
- hbase
- catalogue
- module
- distributed memory
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/188—Virtual file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to an HBASE based virtual file system and a realization method therefor. The method comprises: step 1: performing initialized connection on a virtual file system and a distributed memory bank; step 2: opening a directory and loading all files and subdirectories in the directory to a memory; step 3: reading the directory and returning all the files and subdirectories loaded into the memory in sequence; step 4: opening files in the distributed memory bank and obtaining read data from HBASE or storing the data in HBASE; step 5: executing a file closing operation; and step 6: closing the directory and ending. The method solves the problem that a data storage method needs to be greatly changed during big data storage by HBASE in a big data storage process. The influence of a business layer on change of a data storage layer is reduced, so that change of a business system from a conventional file system storage mode to a big data storage mode is more convenient.
Description
Technical field
The present invention relates to a kind of Virtual File System based on HBASE and its implementation.
Background technology
Along with the arrival of large data age, response mass memory becomes the principal character of data storage scheme fast.So the HBASE based on distributed structure/architecture becomes rapidly the preferred version that large data store, but is carrying out traditional file systems in HBASE file system migration process, data store the change of principle to be become one and unavoidablely to assault fortified position a little.
Summary of the invention
Technical matters to be solved by this invention is to provide one and solves in large data storage procedure, use HBASE to carry out large data when storing, need the use of the problem that date storage method significantly changes based on the Virtual File System of HBASE and its implementation.
The present invention is in conjunction with the data storage characteristics of traditional file systems and HBASE file system, use distributed memory storehouse as secondary storage medium storage file level directory index, use HBASE store file data content, simulate the file read-write operations of traditional file systems, effectively reduce in data migration process, the impact that business changes for data storage layer medium.
The technical scheme that the present invention solves the problems of the technologies described above is as follows: a kind of implementation method of the Virtual File System based on HBASE, specifically comprises the following steps:
Step 1: initialization connection is carried out to Virtual File System and distributed memory storehouse;
Step 2: open catalogue, reads the directory information stored in distributed memory storehouse, and is loaded in internal memory by the All Files under catalogue and sub-directory;
Step 3: read catalogue, and the All Files be loaded in internal memory and sub-directory are returned according to the order of sequence successively;
Step 4: open the file in distributed memory storehouse, reads data or is stored in HBASE by data from HBASE;
Step 5: execute file shutoff operation;
Step 6: close catalogue, terminates.
The invention has the beneficial effects as follows: the invention solves in large data storage procedure, when using HBASE to carry out the storage of large data, need the problem that date storage method is significantly changed.Use distributed memory database and the virtual traditional file system of HBASE, decrease the impact that operation layer changes for data storage layer, make operation system more convenient to the change of large data model storage by traditional file systems memory module.
On the basis of technique scheme, the present invention can also do following improvement.
Further, described step 4 specifically comprises the following steps:
Step 4.1: judge whether current operation is read mode, if so, performs step 4.2; Otherwise, perform step 4.4;
Step 4.2: unique ID that locating file is corresponding from distributed memory storehouse, opens scanner, utilizes this ID to generate rowkey prefix and carries out HBASE table scan, obtain scan-data;
Step 4.3: read scan-data, performs step 5;
Step 4.4: current is write mode, to the unique ID of data genaration in distributed memory storehouse, and carries out HBASE and opens table handling, and the ID controlling to generate generates corresponding rowkey prefix;
Step 4.5: adding index by after rowkey prefix, with this index for rowkey, is that data are stored in HBASE by key word with file record, performs step 5.
Further, described step 5 specifically comprises the following steps:
Step 5.1: whether determining step 4 performs read mode, if so, performs step 5.2; Otherwise, perform step 5.3;
Step 5.2: close the scanner opened in step 4.2, performs step 6;
Step 5.3: call refresh interface, carries out HBASE submit operation, assuring data security, performs step 6.
Further, the index relative of described step 1 file and catalogue is stored in distributed memory storehouse, can obtain corresponding directory index relation after Virtual File System connects with distributed memory storehouse.
Further, when opening catalogue in described step 2, need the corresponding relation reading catalogue and file index in distributed memory storehouse, search the All Files under current directory and sub-directory.
Further, when carrying out file reading in described step 4.2, need the status information reading distributed memory storehouse file, and from HBASE, obtain file data record.
Further, when carrying out file erase, need to revise file status information corresponding in distributed memory storehouse, be disarmed state, follow-up deletion action of being carried out corresponding data in HBASE by aid, avoids the efficiency that data are directly deleted.
The technical scheme that the present invention solves the problems of the technologies described above is as follows: a kind of Virtual File System based on HBASE, comprises link block, catalogue opens module, catalogue read module, File Open module, closing of a file module and catalogue closing module;
Described link block is used for carrying out initialization connection to Virtual File System and distributed memory storehouse;
Described catalogue opens module for opening catalogue, reads the directory information stored in distributed memory storehouse, and is loaded in internal memory by the All Files under catalogue and sub-directory;
The All Files be loaded in internal memory and sub-directory for reading catalogue, and are returned to distributed memory storehouse by described catalogue read module according to the order of sequence successively;
Described File Open module, for opening the file in distributed memory storehouse, reads data or is stored in HBASE by data from HABSE;
Described closing of a file module is used for execute file shutoff operation;
Described catalogue closing module, for closing catalogue, terminates.
On the basis of technique scheme, the present invention can also do following improvement.
Further, described File Open module comprises mode decision module, read module and writing module;
Described mode decision module, for judging whether current operation is read mode, if so, triggers read module; Otherwise, trigger writing module;
Described read module is used for unique ID that locating file is corresponding from distributed memory storehouse, opens scanner, utilizes this ID to generate rowkey prefix and carries out HBASE table scan, obtain scan-data; Read scan-data;
Said write module is used for the unique ID of data genaration in distributed memory storehouse, and carries out HBASE and open table handling, and the ID controlling to generate generates corresponding rowkey prefix; Adding index by after rowkey prefix, with this index for rowkey, is that data are stored in HBASE by key word with file record.
Further, when described catalogue is opened in module and opened catalogue, need the corresponding relation reading catalogue and file index in distributed memory storehouse, search the All Files under current directory and sub-directory.
Further, when carrying out file reading in described read module, need the status information reading distributed memory storehouse file, and from HBASE, obtain file data record.
Further, when carrying out file erase, need to revise file status information corresponding in distributed memory storehouse, be disarmed state, follow-up deletion action of being carried out corresponding data in HBASE by aid.
Traditional file systems forms unique file path with file directory and file name, based on the implementation method of HBASE Virtual File System, use distributed memory storehouse as the storage medium of file path and index, in HBASE, identify unique record of specified file with rowkey, row bunch, row name, value.
Based on HBASE Virtual File System, first need memory bank in a distributed manner as the storage medium of file directory and file name and index, least unit is file, and each file or catalogue are to a unique index, and the relation of catalogue and file is stored in distributed memory storehouse with the form of recurrence.
Based on HBASE Virtual File System, the data that secondly file is corresponding are stored in HBASE, and least unit is record, and the organizational form of rowkey adds record unique index for " file unique index inverted order ", is convenient to the read-write of file.
Based on HBASE Virtual File System, again provide the read-write interface being similar to traditional file systems, comprise directory operation and file operation, interface parameters and rreturn value implication substantially identical with traditional file systems, decrease the change of operation layer for date storage method and interface interchange.
Main thought of the present invention is: the feature storing data in conjunction with traditional file systems and HBASE file system, by the design of rowkey and value to HBASE data and the use in distributed memory storehouse, the data storage method of virtual traditional file systems, provides the file operation such as sopen (File Open), swrite (data write), sclose (closing of a file) and the directory operation such as smkdir (createing directory), sopendir (opening catalogue), sreaddir (reading catalogue), sclosedir (closedown catalogue).The form of data according to key-value is stored in HBASE simultaneously.Reduce the perception that service application changes for data Layer storage medium as far as possible, simultaneously based on the feature of Virtual File System, provide the querying method of Virtual File System, thus achieve when carrying out different file system data inquiries, the consistance of inquiry principle.
Accompanying drawing explanation
Fig. 1 is the implementation method process flow diagram of a kind of Virtual File System based on HBASE described in the embodiment of the present invention;
Fig. 2 is the structured flowchart of a kind of Virtual File System based on HBASE described in the embodiment of the present invention
In accompanying drawing, the list of parts representated by each label is as follows:
1, link block, 2, catalogue opens module, 3, catalogue read module, 4, File Open module, 5, closing of a file module, 6, catalogue closing module, 41, mode decision module, 42, read module, 43, writing module.
Embodiment
Be described principle of the present invention and feature below in conjunction with accompanying drawing, example, only for explaining the present invention, is not intended to limit scope of the present invention.
As shown in Figure 1, be the implementation method of a kind of Virtual File System based on HBASE described in the embodiment of the present invention, specifically comprise the following steps:
Step 1: initialization connection is carried out to Virtual File System and distributed memory storehouse;
Step 2: open catalogue, reads the directory information stored in distributed memory storehouse, and is loaded in internal memory by the All Files under catalogue and sub-directory;
Step 3: read catalogue, and the All Files be loaded in internal memory and sub-directory are returned according to the order of sequence successively;
Step 4: judge whether current operation is read mode, if so, performs step 5; Otherwise, perform step 7;
Step 5: unique ID that locating file is corresponding from distributed memory storehouse, opens scanner, utilizes this ID to generate rowkey prefix and carries out HBASE table scan, obtain scan-data;
Step 6: read scan-data, performs step 9;
Step 7: current is write mode, to the unique ID of data genaration in distributed memory storehouse, and carries out HBASE and opens table handling, and the ID controlling to generate generates corresponding rowkey prefix;
Step 8: adding index by after rowkey prefix, with this index for rowkey, is that data are stored in HBASE by key word with file record, performs step 9;
Step 9: execute file shutoff operation;
Step 10: close catalogue, terminates.
Described step 9 specifically comprises the following steps:
Step 9: whether determining step 4 performs read mode, if so, performs step 9.2; Otherwise, perform step 9.3;
Step 9.2: close the scanner opened in step 5, performs step 10;
Step 9.3: call refresh interface, carries out HBASE submit operation, assuring data security, performs step 10.
When opening catalogue in described step 2, need the corresponding relation reading catalogue and file index in distributed memory storehouse, search the All Files under current directory and sub-directory.
When carrying out file reading in described step 5, need the status information reading distributed memory storehouse file, and from HBASE, obtain file data record.
When carrying out file erase, need to revise file status information corresponding in distributed memory storehouse, be disarmed state, follow-up deletion action of being carried out corresponding data in HBASE by aid.
As shown in Figure 2, be a kind of Virtual File System based on HBASE described in the embodiment of the present invention, comprise link block 1, catalogue opens module 2, catalogue read module 3, File Open module 4, closing of a file module 5 and catalogue closing module 6;
Described link block 1 is for carrying out initialization connection to Virtual File System and distributed memory storehouse;
Described catalogue opens module 2 for opening catalogue, reads the directory information stored in distributed memory storehouse, and is loaded in internal memory by the All Files under catalogue and sub-directory;
The All Files be loaded in internal memory and sub-directory for reading catalogue, and are returned to distributed memory storehouse by described catalogue read module 3 according to the order of sequence successively;
Described File Open module 4, for opening the file in distributed memory storehouse, reads data or is stored in HBASE by data from HBASE;
Described closing of a file module 5 is for execute file shutoff operation;
Described catalogue closing module 6, for closing catalogue, terminates.
Described File Open module 4 comprises mode decision module 41, read module 42 and writing module 43;
Described mode decision module 41, for judging whether current operation is read mode, if so, triggers read module 42; Otherwise, trigger writing module 43;
Described read module 42, for unique ID corresponding to locating file from distributed memory storehouse, opens scanner, utilizes this ID to generate rowkey prefix and carries out HBASE table scan, obtain scan-data; Read scan-data;
Said write module 43 in distributed memory storehouse to the unique ID of data genaration, and carry out HBASE and open table handling, the ID controlling to generate generates corresponding rowkey prefix; Adding index by after rowkey prefix, with this index for rowkey, is that data are stored in HBASE by key word with file record.
When described catalogue is opened and opened catalogue in module 2, need the corresponding relation reading catalogue and file index in distributed memory storehouse, search the All Files under current directory and sub-directory.
When carrying out file reading in described read module 42, need the status information reading distributed memory storehouse file, and from HBASE, obtain file data record.
When carrying out file erase, need to revise file status information corresponding in distributed memory storehouse, be disarmed state, follow-up deletion action of being carried out corresponding data in HBASE by aid.
HBASE file system is distributed file system, before use HBASE system storage, first will carry out initialization connection to HABSE file system.After normal connection, in conjunction with the file in distributed memory storehouse and directory index relation, the file read/write method being similar to traditional file systems can be adopted to operate to HBASE file system.Operating process is as follows:
1. call sinit and carry out the connection of distributed memory storehouse and HBASE attended operation;
2. call sopendir and carry out catalogue opening operation, need the information reading catalogue in distributed memory storehouse in this operating process, and the All Files under catalogue and sub-directory are loaded in internal memory;
3. call sreaddir and carry out catalogue read operation, this operating process needs step 2 to be loaded into file in internal memory and catalogue returns in order successively;
4. call sopen and carry out file open operation, this operating process comprises two kinds of patterns, one class is read mode, unique ID that locating file is corresponding from distributed memory storehouse, the prefix utilizing this ID to generate rowkey carries out HBASE table scan, one class is write mode, in distributed memory storehouse, generate unique ID, and carries out HBASE and open table handling;
5. call sread and carry out File read operation, this operating process needs read step 4 read mode to scan the data obtained;
6. call swrite and carry out file write operations, this operating process needs additional record index after the rowkey prefix of step 4 generation, as rowkey, is that value is stored in HBASE with file record;
7. call sclose and carry out file close operation, if this operating process read mode, then the scanner needing cut out step 4 to open, if write mode, then needs to call sflush interface, carries out HBASE submit operation, assuring data security;
8. call sclosedir and carry out catalogue shutoff operation;
9. system release sdestroy.
The present invention is in conjunction with the data storage characteristics of traditional file systems and HBASE file system, memory database is secondary storage medium in a distributed manner, the storage relation of file and catalogue is stored in distributed memory in a recursive manner, minimum memory unit is file, Single document or catalogue have unique ID mark in distributed memory storehouse, Single document or catalogue have fileinfo state in distributed memory storehouse, file data is stored in HBASE, minimum memory unit is record, the organizational form of rowkey adds record unique index for " file unique index inverted order ", value is file data record.
Memory bank is secondary storage medium in a distributed manner, and the storage relation of file-level catalogue is stored in distributed memory storehouse in a recursive manner;
In distributed memory, minimum memory unit is file, and Single document or catalogue have unique ID mark again in distributed memory storehouse;
File data record is stored in HBASE with the form of key-value, and minimum memory unit is record, and the organizational form of rowkey adds record unique index for " file unique index inverted order ", and value is file data record;
When carrying out opening directory operation, need the corresponding relation reading catalogue and file index in distributed memory storehouse, search the All Files under current directory and catalogue;
When carrying out File read operation, need the status information reading distributed memory storehouse file, and from HBASE, obtain file data record;
When carrying out file write operations, need the status information reading distributed memory storehouse file, and file data is write HBASE, and the status information of renewal distribution formula memory bank file;
Under file is write mode, needs during close file that end is write to HBASE and carry out sflush operation, ensure the integrality of HBASE data;
When carrying out file erase, needing to revise file status information corresponding in distributed memory storehouse, being disarmed state, follow-up deletion action of being carried out corresponding data in HBASE by aid.
Be below a specific embodiment of the present invention:
Operation layer needs read in Virtual File System and store a file, and suppose that the target directory of file is /test, source filename is called test.txt, and directory file name is store.txt;
The connection of initialization and HBASE file system and the connection of memory bank;
Call sopendir and open the catalogue/test that will operate;
Call sreaddir and read the file or directory information opened in catalogue, read file by test.txt;
Call sopen read mode to open file/test/test.txt;
Call sopen write mode to open file/test/store.txt;
Call the data content in sread reading/test/test.txt;
Call swrite the content read is written to/test/store.txt in;
Call sclose close file/test/test.txt;
Call sclose close file/test/store.txt;
Call sclosedir shutoff operation catalogue;
Call sdestory and discharge HBASE connection and memory bank connection;
After aforesaid operations has called, have in distributed memory storehouse/the relative index information of this file of test/store.txt and file status generate, and in HBASE, store a batch record, these records belong to/test/store.txt.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. based on an implementation method for the Virtual File System of HBASE, it is characterized in that, specifically comprise the following steps:
Step 1: initialization connection is carried out to Virtual File System and distributed memory storehouse;
Step 2: open catalogue, reads the directory information stored in distributed memory storehouse, and is loaded in internal memory by the All Files under catalogue and sub-directory;
Step 3: read catalogue, and the All Files be loaded in internal memory and sub-directory are returned according to the order of sequence successively;
Step 4: open the file in distributed memory storehouse, obtains and reads data or be stored in HBASE by data from HBASE;
Step 5: execute file shutoff operation;
Step 6: close catalogue, terminates.
2. the implementation method of a kind of Virtual File System based on HBASE according to claim 1, it is characterized in that, described step 4 specifically comprises the following steps:
Step 4.1: judge whether current operation is read mode, if so, performs step 4.2; Otherwise, perform step 4.4;
Step 4.2: unique ID that locating file is corresponding from distributed memory storehouse, opens scanner, utilizes this ID to generate rowkey prefix and carries out HBASE table scan, obtain scan-data;
Step 4.3: read scan-data, performs step 5;
Step 4.4: current is write mode, to the unique ID of data genaration in distributed memory storehouse, and carries out HBASE and opens table handling, and the ID controlling to generate generates corresponding rowkey prefix;
Step 4.5: adding index by after rowkey prefix, with this index for rowkey, is that data are stored in HBASE by key word with file record, performs step 5.
3. the method for operating of a kind of Virtual File System according to claim 2, is characterized in that, described step 5 specifically comprises the following steps:
Step 5.1: whether determining step 4 performs read mode, if so, performs step 5.2; Otherwise, perform step 5.3;
Step 5.2: close the scanner opened in step 4.2, performs step 6;
Step 5.3: call refresh interface, carries out HBASE submit operation, assuring data security, performs step 6.
4. the implementation method of a kind of Virtual File System based on HBASE according to claim 1, it is characterized in that, the index relative of described step 1 file and catalogue is stored in distributed memory storehouse, can obtain corresponding directory index relation after Virtual File System connects with distributed memory storehouse.
5. the implementation method of a kind of Virtual File System based on HBASE according to claim 1, it is characterized in that, when opening catalogue in described step 2, need the corresponding relation reading catalogue and file index in distributed memory storehouse, search the All Files under current directory and sub-directory.
6. the implementation method of a kind of Virtual File System based on HBASE according to claim 2, it is characterized in that, when carrying out file reading in described step 4.2, need the status information reading distributed memory storehouse file, and from HBASE, obtain file data record.
7. the implementation method of a kind of Virtual File System based on HBASE according to any one of claim 1-6, it is characterized in that, when carrying out file erase, need to revise file status information corresponding in distributed memory storehouse, be disarmed state, follow-up deletion action of being carried out corresponding data in HBASE by aid.
8. based on a Virtual File System of HBASE, it is characterized in that, comprise link block, catalogue opens module, catalogue read module, File Open module, closing of a file module and catalogue closing module;
Described link block is used for carrying out initialization connection to Virtual File System and distributed memory storehouse;
Described catalogue opens module for opening catalogue, reads the directory information stored in distributed memory storehouse, and is loaded in internal memory by the All Files under catalogue and sub-directory;
The All Files be loaded in internal memory and sub-directory for reading catalogue, and are returned to distributed memory storehouse by described catalogue read module according to the order of sequence successively;
Described File Open module, for opening the file in distributed memory storehouse, reads data or is stored in HBASE by data from HBASE;
Described closing of a file module is used for execute file shutoff operation;
Described catalogue closing module, for closing catalogue, terminates.
9. a kind of Virtual File System based on HBASE according to claim 7, is characterized in that, described File Open module comprises mode decision module, read module and writing module;
Described mode decision module, for judging whether current operation is read mode, if so, triggers read module; Otherwise, trigger writing module;
Described read module is used for unique ID that locating file is corresponding from distributed memory storehouse, opens scanner, utilizes this ID to generate rowkey prefix and carries out HBASE table scan, obtain scan-data; Read scan-data;
Said write module is used for the unique ID of data genaration in distributed memory storehouse, and carries out HBASE and open table handling, and the ID controlling to generate generates corresponding rowkey prefix; Adding index by after rowkey prefix, with this index for rowkey, is that data are stored in HBASE by key word with file record.
10. a kind of Virtual File System based on HBASE according to claim 7, it is characterized in that, when described catalogue is opened in module and opened catalogue, need the corresponding relation reading catalogue and file index in distributed memory storehouse, search the All Files under current directory and sub-directory; When carrying out file reading in described read module, need the status information reading distributed memory storehouse file, and from HBASE, obtain file data record.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510473964.2A CN105069091B (en) | 2015-08-05 | 2015-08-05 | A kind of Virtual File System and its implementation based on HBASE |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510473964.2A CN105069091B (en) | 2015-08-05 | 2015-08-05 | A kind of Virtual File System and its implementation based on HBASE |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105069091A true CN105069091A (en) | 2015-11-18 |
| CN105069091B CN105069091B (en) | 2018-09-11 |
Family
ID=54498461
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510473964.2A Active CN105069091B (en) | 2015-08-05 | 2015-08-05 | A kind of Virtual File System and its implementation based on HBASE |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105069091B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110287201A (en) * | 2019-07-02 | 2019-09-27 | 重庆紫光华山智安科技有限公司 | Data access method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101398824A (en) * | 2007-09-26 | 2009-04-01 | 新奥特硅谷视频技术有限责任公司 | Method for implementing data storage by virtual file systems technology after processing |
| US20120209894A1 (en) * | 2010-12-20 | 2012-08-16 | International Business Machines Corporation | Partition file system for virtual machine memory management |
| CN103116618A (en) * | 2013-01-28 | 2013-05-22 | 南开大学 | Telefile system mirror image method and system based on lasting caching of client-side |
| CN104462185A (en) * | 2014-10-13 | 2015-03-25 | 南京邮电大学 | Digital library cloud storage system based on mixed structure |
-
2015
- 2015-08-05 CN CN201510473964.2A patent/CN105069091B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101398824A (en) * | 2007-09-26 | 2009-04-01 | 新奥特硅谷视频技术有限责任公司 | Method for implementing data storage by virtual file systems technology after processing |
| US20120209894A1 (en) * | 2010-12-20 | 2012-08-16 | International Business Machines Corporation | Partition file system for virtual machine memory management |
| CN103116618A (en) * | 2013-01-28 | 2013-05-22 | 南开大学 | Telefile system mirror image method and system based on lasting caching of client-side |
| CN104462185A (en) * | 2014-10-13 | 2015-03-25 | 南京邮电大学 | Digital library cloud storage system based on mixed structure |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110287201A (en) * | 2019-07-02 | 2019-09-27 | 重庆紫光华山智安科技有限公司 | Data access method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105069091B (en) | 2018-09-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102779180B (en) | The operation processing method of data-storage system, data-storage system | |
| CN104978151B (en) | Data reconstruction method in the data de-duplication storage system perceived based on application | |
| CN103080910B (en) | Storage system | |
| CN103136243B (en) | File system duplicate removal method based on cloud storage and device | |
| CN102012852B (en) | Method for implementing incremental snapshots-on-write | |
| US10120795B2 (en) | Wear-leveling nandflash memory reading/writing method | |
| JP6178859B2 (en) | Database storage system based on optical disk and method of using the same | |
| CN105988723A (en) | Snapshot processing method and device | |
| CN103514249B (en) | A kind of automatic data reduction and system and storage device | |
| JP2009510552A (en) | Data management method in flash memory media | |
| CN101784996A (en) | Emulated storage system | |
| CN104408111A (en) | Method and device for deleting duplicate data | |
| CN102915278A (en) | Data deduplication method | |
| CN103473298B (en) | Data archiving method and device and storage system | |
| CN103186617B (en) | A kind of method and apparatus storing data | |
| CN105718217A (en) | Method and device for maintaining data consistency of thin provisioning database | |
| CN101980203A (en) | Embedded file system for high-definition media | |
| CN100507919C (en) | FAT file system and its processing method | |
| CN109726175A (en) | A kind of offline partition management method of mass file based on HBase | |
| WO2021169163A1 (en) | File data access method and apparatus, and computer-readable storage medium | |
| CN107037988B (en) | A kind of flash memory safety deleting method and system based on file-level granularity | |
| EP2669806B1 (en) | Storage system | |
| JP4825719B2 (en) | Fast file attribute search | |
| CN103339615A (en) | Storage system | |
| CN102096613B (en) | Method and device for generating snapshot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |