CN103548004B - The method and apparatus of dynamic data attemper is realized in file system - Google Patents
The method and apparatus of dynamic data attemper is realized in file system Download PDFInfo
- Publication number
- CN103548004B CN103548004B CN201180003291.4A CN201180003291A CN103548004B CN 103548004 B CN103548004 B CN 103548004B CN 201180003291 A CN201180003291 A CN 201180003291A CN 103548004 B CN103548004 B CN 103548004B
- Authority
- CN
- China
- Prior art keywords
- file
- value
- storage device
- primary storage
- secondary storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000012545 processing Methods 0.000 claims description 18
- 238000012546 transfer Methods 0.000 claims description 8
- 239000007787 solid Substances 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000013508 migration Methods 0.000 description 2
- 230000005012 migration Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000035800 maturation Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000035939 shock Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/185—Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Embodiments provide a kind of method realizing dynamic data attemper in file system.In file system, use primary storage device and secondary storage devices to carry out storage file respectively, obtain the value of each file stored in described primary storage device and secondary storage devices; Develop and manage the first file sorting out value list according to the putting in order of value of each file stored in described primary storage device, develop and manage the second file sorting out value list according to the putting in order of value of each file stored in described secondary storage devices; According to described first file sorting out value list and the second file sorting out value list, in described primary storage device and secondary storage devices, carry out file move according to the strategy of moving of setting.The embodiment of the present invention can realize being stored in by costly file on the high storage medium of performance, is left at a slow speed on storage medium by the low file of value, makes system reach overall performance the best.
Description
Technical Field
The present invention relates to the field of electronic technologies, and in particular, to a method and an apparatus for implementing multi-level storage in a file system.
Background
With the development of storage technology, new storage media and storage interfaces are emerging in addition to traditional storage media such as magnetic tapes and mechanical disks, which generally mean higher transmission rates, and SSD (solid state disk) is a typical technology.
The SSD is also called an electronic hard disk or a solid state electronic disk, and is composed of a control unit and a solid state storage unit, and the function, form and use method of its interface are the same as those of a magnetic medium hard disk. At present, most of SSD is applied to notebook computers, and in order to match with the existing notebook computers, the outline dimensions of most products are consistent with those of the traditional notebook hard disks, and the products with other specifications and dimensions also exist. Because the SSD has no mechanical structure inside and does not need a motor to rotate during reading, the SSD has the advantages in shock resistance and noise, and in addition, the chip of the SSD can work in a wide temperature range (-40-85 ℃). Therefore, the SSD is currently widely used in various fields such as military, electric power, medical, aviation, vehicle-mounted, industrial control, video monitoring, network terminal, navigation device, and the like.
With the continuous maturation of the SSD technology, users begin to use the SSD to construct a storage system, and there is a need for the users to construct a hybrid storage system using a new storage medium and an original storage medium due to the comprehensive consideration of performance and cost and protection of the existing investment. The expensive high-speed SSD is used as a primary storage system, the high-capacity and cheap low-speed mechanical disk is used as a rear-end secondary storage system, and finally the overall optimal configuration with high performance, high capacity and low cost is achieved.
In a hybrid storage system, data that is accessed frequently is generally stored in a fast storage device, and data that is not accessed frequently is stored in a slow storage device, so that the overall performance of the system can be optimized by using fewer high-speed storage devices.
A multilevel storage system in the prior art is constructed by: adding the SSD into a storage system formed by a traditional mechanical HDD (hard disk drive) to form a mixed storage pool, taking the SSD as a second-level cache in the system, automatically caching frequently accessed data on a magnetic disk onto the SSD, and eliminating the cached data according to an ARC algorithm after the SSD is fully written.
The disadvantages in the prior art are as follows: the SSD is used as a second-level cache of the system, so that the performance of the system is improved on the whole, but the SSD only has the function of cache, and the storage space of the SSD is wasted. The multi-level storage system described above is only suitable for systems where hot spot distribution is very concentrated, such as the thermal model system of 1/99. However, for a system with a low concentration of hot spots, such as model 30/70 (30% of data provides 70% of access), 30% of the hottest data needs to be cached in the SSD, and the system needs to be additionally equipped with the SSD storage space, which occupies 30% of the total storage capacity, and this part of the storage space is not sensible to the application and cannot be embodied in the total storage capacity of the system, which is definitely a huge waste.
Disclosure of Invention
Embodiments of the present invention provide a method and an apparatus for implementing multi-level storage in a file system, so as to implement multi-level storage based on a value of a file in the file system.
The purpose of the invention is realized by the following technical scheme:
a method of implementing multi-level storage in a file system, comprising:
respectively using a primary storage device and a secondary storage device in a file system to store files, and acquiring the value of each file stored in the primary storage device and the secondary storage device;
establishing and managing a first file value ordered list according to the value ordering sequence of the files stored in the primary storage device, and establishing and managing a second file value ordered list according to the value ordering sequence of the files stored in the secondary storage device;
and carrying out file transfer in the primary storage device and the secondary storage device according to a set transfer strategy according to the first file value rank list and the second file value rank list.
An apparatus for implementing multi-level storage in a file system, comprising:
the file storage module is used for respectively using a primary storage device and a secondary storage device in the file system to store files;
the file value processing module is used for acquiring the value of each file stored in the primary storage device and the secondary storage device, establishing and managing a first file value ranking list according to the ranking sequence of the value of each file stored in the primary storage device, and establishing and managing a second file value ranking list according to the ranking sequence of the value of each file stored in the secondary storage device;
and the moving processing module is used for moving the files in the primary storage device and the secondary storage device according to a set moving strategy according to the first file value rank list and the second file value rank list.
It can be seen from the technical solutions provided by the embodiments of the present invention that, in the embodiments of the present invention, a primary storage device and a secondary storage device are respectively used in a file system to store files, and the files are moved in the primary storage device and the secondary storage device based on the value of each file and according to a set movement policy, so that the files with high value can be stored in a storage medium with high performance (i.e., the primary storage device), and the files with low value are stored in a slow storage medium (i.e., the secondary storage device), so that the overall performance of the system is optimal.
Drawings
Fig. 1 is a flowchart illustrating a specific process of a method for implementing multi-level storage in a file system according to an embodiment of the present invention;
fig. 2 is a schematic diagram of fields in metadata information of a file according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a specific process of a method for implementing multi-level storage in a file system when determining the value of a file only according to the latest access time of the file according to a second embodiment of the present invention;
fig. 4 is a specific structural diagram of an apparatus for implementing multi-level storage in a file system according to a third embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
Example one
The embodiment provides a method for implementing multi-level storage in a file system, and a specific processing flow of the method is shown in fig. 1, and the method includes the following processing steps:
and 11, respectively using a primary storage device and a secondary storage device in the file system to store files, and acquiring the value of each file stored in the primary storage device and the secondary storage device.
For example, the SSD may be used as a primary storage device, and the mechanical disk may be used as a secondary storage device, where the primary storage device and the secondary storage device are both used for storing files, so as to form a multi-level overall storage space of the file system.
In the embodiment of the present invention, the value of each file stored in the primary storage device and the secondary storage device needs to be calculated, and the specific calculation method is as follows:
and updating a time interval (such as 30 minutes) according to the set file value, and calculating the value of each file stored in the primary storage device and the secondary storage device according to a set algorithm according to at least one of the latest access time of the file, the access times in a set time period, the content of the file and system configuration information.
For example, when the value of a file is determined based only on the last access time of the file, the value of the file with the most recent access time is the greatest.
For another example, when the value of a file is determined based on the latest access time of the file and the number of accesses within a set time period, the value of each file may be calculated by multiplying the latest access time of the file by the corresponding weight and then adding the number of accesses within the set time period to the corresponding weight.
For another example, a system administrator may directly set the value of one or more files according to actual needs.
The field diagram in the metadata information of a file provided by this embodiment is shown in fig. 2, and in practical application, the value of the file may be calculated by using the existing partial field in the metadata information of each file and information recorded in other optional extension fields, and the value information, the sorting information, and the storage location information of the file are stored in the optional extension fields in the metadata information. For example, after a file is accessed, the system updates the metadata information of the file, and calculates the value of the file by using the latest access time of the file recorded in the timestamp field in fig. 2; or simultaneously using at least one of the recent and historical access times of the file recorded in the timestamp field of fig. 2, the length of the file field, and the information recorded in the number of file blocks field to calculate the value of the file. Then, the original value of the file stored in the file value field in fig. 2 is deleted, the value of the file just calculated is stored in the file value field, and the sorting information field is correspondingly updated.
The files stored in the storage location field in fig. 2 are information stored in the primary storage device or the secondary storage device, and the files stored in the sorting information field in fig. 2 are sorted in a first file value sorted list or a second file value sorted list, which will be described below. The above-described sort information field, storage location field, and file value field in fig. 2 are extension fields in the metadata information.
Since the primary storage device is a fast hard disk and the secondary storage device is a slow hard disk, files with a relatively high value are stored in the primary storage device, and files with a relatively low value are stored in the mechanical hard disk. Ideally, the value of any one file stored in the primary storage device is greater than the value of all files stored in the mechanical hard disk.
And step 12, establishing and managing a first file value ranking list according to the ranking sequence of the values of the files stored in the primary storage equipment, and establishing and managing a second file value ranking list according to the ranking sequence of the values of the files stored in the secondary storage equipment.
And sorting the files stored in the primary storage equipment from large to small according to the value to establish a first file value sorting list. And when the value of each file stored in the primary storage device is updated according to a set file value updating time interval, the first file value ordered list needs to be correspondingly updated.
And sorting the files stored in the secondary storage equipment from large to small according to the value size to establish a second file value sorting list. And when the value of each file stored in the secondary storage device is updated according to a set file value updating time interval, the second file value ordered list needs to be correspondingly updated.
The first file value ordered list and the second file value ordered list are arranged with the identifiers of the files.
And step 13, carrying out file transfer in the primary storage device and the secondary storage device according to a set transfer strategy according to the first file value sorting list and the second file value sorting list.
Presetting a time interval for file moving in the primary storage device and the secondary storage device, starting timing of the time interval, and after timing of the time interval is finished, performing file moving processing in the primary storage device and the secondary storage device, wherein the specific file moving processing process can be as follows:
if the value of one or more files in the second file value ordered list exceeds the value of at least one file in the first file value ordered list, moving one or more files in the second file value ordered list from a secondary storage device to the primary storage device, and then updating the first file value ordered list and the second file value ordered list; or
If the space utilization rate of the primary storage device exceeds a set threshold value, one or more files arranged at the back in the first file value ordered list are moved from the primary storage device to the secondary storage device until the space utilization rate of the primary storage device does not exceed the set threshold value, and then the first file value ordered list and the second file value ordered list are updated.
It should be further noted that, if the space utilization of the secondary storage device exceeds a set threshold, one or more files arranged in the second file value ordered list in the later stage are deleted from the secondary storage device until the space utilization of the secondary storage device does not exceed the set threshold, and then the second file value ordered list is updated.
Example two
When the value of a file is determined only according to the latest access time of the file, the specific processing flow of the method for realizing multi-level storage in the file system is shown in fig. 3 and comprises the following processing steps:
in step 31, a file in the file system is accessed, where the file may be a file stored in the primary storage device or the secondary storage device.
Step 32, because the value of the file is determined only according to the latest access time of the file, the value of the file which is accessed at present is the highest, and the value of the file is set to be the maximum.
Step 33, judging whether the file is stored in the primary storage device, if so, executing step 34; otherwise, step 35 is executed.
And step 34, arranging the identifications of the files in the top row in the first file value ordered list in the primary storage device.
And step 35, adding the files into a moving file list of the secondary storage device, and moving the files in the moving list of the secondary storage device from the secondary storage device to the primary storage device after the timing of the preset time interval for moving the files is finished.
EXAMPLE III
An embodiment of the present invention further provides a device for implementing multi-level storage in a file system, where a specific structure of the device is shown in fig. 4, and the device includes the following modules:
the file storage module 41 is configured to store a file in a file system by using a primary storage device and a secondary storage device, for example, an SSD may be used as the primary storage device, and a mechanical disk may be used as the secondary storage device;
the file value processing module 42 is configured to acquire values of the files stored in the primary storage device and the secondary storage device, establish and manage a first file value sorted list according to an arrangement order of the values of the files stored in the primary storage device, and establish and manage a second file value sorted list according to an arrangement order of the values of the files stored in the secondary storage device;
and a moving processing module 43, configured to move files in the primary storage device and the secondary storage device according to a set moving policy according to the first file value rank list and the second file value rank list.
Specifically, the document value processing module 42 may include:
the file value calculating module 421 is configured to update the time interval according to the set file value, and determine the value of each file stored in the primary storage device and the secondary storage device according to at least one of the latest access time of the file, the access times within the set time period, the content of the file, and the system configuration information. For example, after a file is accessed, the system updates the metadata information of the file, and calculates the value of the file by using the latest access time of the file recorded in the timestamp field in the metadata information of the file; or after the file is accessed and the system updates the metadata information of the file, the value of the file is calculated by using the latest and historical access time of the file recorded in the timestamp field in the metadata information of the file and at least one of the information recorded in the file length field and the file block number field.
A file ordered list establishing module 422, configured to establish a first file value ordered list by sorting the files stored in the primary storage device from large to small according to the size of the value, and update the first file value ordered list according to the update result of the value of each file stored in the primary storage device;
and sequencing the files stored in the secondary storage equipment from large to small according to the value sizes to establish a second file value ordered list, and updating the second file value ordered list according to the updating results of the values of the files stored in the secondary storage equipment.
Specifically, the transfer processing module 43: and is also used for presetting the time interval for file moving in the primary storage device and the secondary storage device, starting the timing of the time interval, after the timing of the time interval is finished,
if the value of one or more files in the second file value ordered list exceeds the value of at least one file in the first file value ordered list, moving one or more files in the second file value ordered list from a secondary storage device to the primary storage device;
updating the first file value ordered list and the second file value ordered list.
Specifically, the transfer processing module 43: the file processing method is also used for presetting a time interval for file moving in the primary storage device and the secondary storage device, starting timing of the time interval, and moving one or more files arranged at the back in the first file value sorted list from the primary storage device to the secondary storage device after timing of the time interval is finished and if the space utilization rate of the primary storage device exceeds a set threshold value until the space utilization rate of the primary storage device does not exceed the set threshold value;
updating the first file value ordered list and the second file value ordered list.
The specific process of implementing multi-level storage in a file system by applying the device of the embodiment of the present invention is similar to that of the foregoing method embodiment, and is not described here again.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-only memory (ROM), a Random Access Memory (RAM), or the like.
In summary, in the embodiments of the present invention, the primary storage device and the secondary storage device are respectively used in the file system to store files, and the files are moved in the primary storage device and the secondary storage device based on the value of each file and according to the set moving policy, so that the files with high value can be stored in the storage medium with high performance (i.e., the primary storage device), and the files with low value can be stored in the storage medium with low speed (i.e., the secondary storage device), so that the overall performance of the system is optimal.
The embodiment of the invention supports the unified management of heterogeneous storage media, and the whole storage space presented to a user is the sum of the spaces of all levels of storage; when the user uses the file system, the file system provides uniform management for the user without distinguishing storage media of different levels. Thereby avoiding the use of additional hierarchical storage management software and reducing complexity.
The embodiment of the invention provides flexible strategy configuration, and can flexibly control the frequency period of file migration and the algorithm followed by the file migration.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A method for implementing multi-level storage in a file system, comprising:
respectively using a primary storage device and a secondary storage device in a file system to store files, and acquiring the value of each file stored in the primary storage device and the secondary storage device;
establishing and managing a first file value ordered list according to the value ordering sequence of the files stored in the primary storage device, and establishing and managing a second file value ordered list according to the value ordering sequence of the files stored in the secondary storage device;
according to the first file value ranking list and the second file value ranking list, file transfer is carried out in the primary storage device and the secondary storage device according to a set transfer strategy;
wherein, the file moving is performed in the primary storage device and the secondary storage device according to a set moving strategy according to the first file value rank list and the second file value rank list, and the method comprises the following steps:
presetting a time interval for file moving in the primary storage device and the secondary storage device, starting timing of the time interval, and after timing of the time interval is finished,
if the value of one or more files in the second file value ordered list exceeds the value of at least one file in the first file value ordered list, moving one or more files in the second file value ordered list from a secondary storage device to the primary storage device;
updating the first file value ordered list and the second file value ordered list.
2. The method of claim 1, wherein the obtaining the value of each file stored in the primary storage device and the secondary storage device comprises:
and updating time intervals according to the set file value in the file system, and determining the value of each file stored in the primary storage device and the secondary storage device according to at least one of the latest access time of the file, the access times in the set time period, the content of the file and system configuration information.
3. The method of claim 2, wherein the obtaining the value of each file stored in the primary storage device and the secondary storage device comprises:
after a file is accessed, a system updates metadata information of the file, and calculates the value of the file by using the latest access time of the file recorded in a timestamp field in the metadata information of the file;
or,
after the file is accessed, the system updates the metadata information of the file, and calculates the value of the file by using the latest and historical access time of the file recorded in the timestamp field in the metadata information of the file and at least one of the information recorded in the file length field and the file block number field.
4. The method of claim 3, wherein the creating and managing a first sorted list of file values according to the ranking order of the values of the files stored in the primary storage device, and creating and managing a second sorted list of file values according to the ranking order of the values of the files stored in the secondary storage device comprises:
sorting all files stored in the primary storage equipment from large to small according to the value to establish a first file value sorting list, and updating the first file value sorting list according to the updating result of the value of all files stored in the primary storage equipment;
and sequencing the files stored in the secondary storage equipment from large to small according to the value sizes to establish a second file value ordered list, and updating the second file value ordered list according to the updating results of the values of the files stored in the secondary storage equipment.
5. The method of claim 1, wherein the primary storage device comprises a solid state disk; the secondary storage device comprises a mechanical disk.
6. The method according to any one of claims 1 to 5, wherein the moving of the files in the primary storage device and the secondary storage device according to the set moving policy based on the first file value sorted list and the second file value sorted list comprises:
presetting a time interval for file moving in the primary storage device and the secondary storage device, starting timing of the time interval, and after timing of the time interval is finished,
if the space utilization rate of the primary storage equipment exceeds a set threshold value, moving one or more files arranged at the back in the first file value ordered list from the primary storage equipment to the secondary storage equipment until the space utilization rate of the primary storage equipment does not exceed the set threshold value;
updating the first file value ordered list and the second file value ordered list.
7. An apparatus for implementing multi-level storage in a file system, comprising:
the file storage module is used for respectively using a primary storage device and a secondary storage device in the file system to store files;
the file value processing module is used for acquiring the value of each file stored in the primary storage device and the secondary storage device, establishing and managing a first file value ranking list according to the ranking sequence of the value of each file stored in the primary storage device, and establishing and managing a second file value ranking list according to the ranking sequence of the value of each file stored in the secondary storage device;
the moving processing module is used for moving files in the primary storage device and the secondary storage device according to a set moving strategy according to the first file value rank list and the second file value rank list;
wherein, the moving processing module is further configured to preset a time interval for moving the file in the primary storage device and the secondary storage device, and start timing of the time interval, and after the timing of the time interval is finished,
if the value of one or more files in the second file value ordered list exceeds the value of at least one file in the first file value ordered list, moving one or more files in the second file value ordered list from a secondary storage device to the primary storage device;
updating the first file value ordered list and the second file value ordered list.
8. The apparatus of claim 7, wherein the file value processing module comprises:
the file value calculation module is used for updating the time interval according to the set file value and determining the value of each file stored in the primary storage equipment and the secondary storage equipment according to at least one of the latest access time of the file, the access times in the set time period, the content of the file and the system configuration information;
the file value sorting table establishing module is used for sorting all files stored in the primary storage equipment from large to small according to the value to establish a first file value sorting table and updating the first file value sorting table according to the updating result of the value of all the files stored in the primary storage equipment;
and sequencing the files stored in the secondary storage equipment from large to small according to the value sizes to establish a second file value ordered list, and updating the second file value ordered list according to the updating results of the values of the files stored in the secondary storage equipment.
9. The apparatus for implementing multilevel storage in a file system of claim 8, wherein:
the file value calculation module is further configured to calculate the value of the file by using the latest access time of the file recorded in the timestamp field in the metadata information of the file after the metadata information of the file is updated by the system after the file is accessed;
or,
after the file is accessed, the system updates the metadata information of the file, and calculates the value of the file by using at least one of the latest and historical access time of the file, the file length field and the information recorded in the file block number field, which are recorded in the timestamp field in the metadata information of the file.
10. An apparatus for implementing multi-level storage in a file system according to any of claims 7-9, wherein:
the moving processing module is further configured to preset a time interval for moving files in the primary storage device and the secondary storage device, and start timing of the time interval, and after the timing of the time interval is ended, if the space utilization rate of the primary storage device exceeds a set threshold, move one or more files arranged in the first file value ranking list, to the secondary storage device from the primary storage device until the space utilization rate of the primary storage device does not exceed the set threshold;
updating the first file value ordered list and the second file value ordered list.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2011/084830 WO2013097119A1 (en) | 2011-12-28 | 2011-12-28 | Method and device for realizing multilevel storage in file system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103548004A CN103548004A (en) | 2014-01-29 |
| CN103548004B true CN103548004B (en) | 2016-03-30 |
Family
ID=48696205
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201180003291.4A Active CN103548004B (en) | 2011-12-28 | 2011-12-28 | The method and apparatus of dynamic data attemper is realized in file system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN103548004B (en) |
| WO (1) | WO2013097119A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107092564A (en) * | 2017-04-21 | 2017-08-25 | 深信服科技股份有限公司 | A kind of data processing method and device |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104537104A (en) * | 2015-01-13 | 2015-04-22 | 百度在线网络技术（北京）有限公司 | Software ranking method and system |
| CN105653591B (en) * | 2015-12-22 | 2019-02-05 | 浙江中控研究院有限公司 | A kind of industrial real-time data classification storage and moving method |
| CN107844271A (en) * | 2017-10-27 | 2018-03-27 | 郑州云海信息技术有限公司 | A kind of method, apparatus and computer-readable recording medium for being classified storage |
| CN111367469B (en) * | 2020-02-16 | 2022-07-08 | 苏州浪潮智能科技有限公司 | Method and system for migrating layered storage data |
| CN111917882B (en) * | 2020-08-07 | 2023-04-07 | 湖南快乐阳光互动娱乐传媒有限公司 | File caching method and device and electronic equipment |
| CN116257563B (en) * | 2022-11-30 | 2023-11-21 | 荣耀终端有限公司 | Data value evaluation method and electronic equipment |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7177883B2 (en) * | 2004-07-15 | 2007-02-13 | Hitachi, Ltd. | Method and apparatus for hierarchical storage management based on data value and user interest |
| WO2006131978A1 (en) * | 2005-06-10 | 2006-12-14 | Fujitsu Limited | Hsm control program, device, and method |
| CN100451976C (en) * | 2007-07-23 | 2009-01-14 | 清华大学 | Migration management based on massive data classified memory system |
| CN102291450B (en) * | 2011-08-08 | 2014-01-15 | 浪潮电子信息产业股份有限公司 | Data online hierarchical storage method in cluster storage system |
-
2011
- 2011-12-28 WO PCT/CN2011/084830 patent/WO2013097119A1/en active Application Filing
- 2011-12-28 CN CN201180003291.4A patent/CN103548004B/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107092564A (en) * | 2017-04-21 | 2017-08-25 | 深信服科技股份有限公司 | A kind of data processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103548004A (en) | 2014-01-29 |
| WO2013097119A1 (en) | 2013-07-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103548004B (en) | The method and apparatus of dynamic data attemper is realized in file system | |
| CN103092526B (en) | The method and apparatus of Data Migration is carried out between memory device | |
| CN105302478B (en) | A kind of date storage method and electronic equipment | |
| CN101673192B (en) | Method for time-sequence data processing, device and system therefor | |
| US20140195761A1 (en) | Logical volume space sharing | |
| CN104583930B (en) | Method, controller and the data migration device of Data Migration | |
| US20170269848A1 (en) | Selecting pages implementing leaf nodes and internal nodes of a data set index for reuse | |
| CN105786401A (en) | Data management method and device in server cluster system | |
| EP2765522B1 (en) | Method and device for data pre-heating | |
| CN102981971B (en) | A kind of phase transition storage loss equalizing method of quick response | |
| CN104199784A (en) | Data migration method and device based on hierarchical storage | |
| CN103984644B (en) | A kind of data managing method and device | |
| CN104092670A (en) | Method for utilizing network cache server to process files and device for processing cache files | |
| CN107368608A (en) | The HDFS small documents buffer memory management methods of algorithm are replaced based on ARC | |
| CN105095495B (en) | A kind of distributed file system buffer memory management method and system | |
| CN103198021B (en) | A kind of method improving solid state disk data transmission efficiency | |
| CN103270499A (en) | Log storage method and system | |
| CN102104494B (en) | Metadata server, out-of-band network file system and processing method of system | |
| KR101226600B1 (en) | Memory System And Memory Mapping Method thereof | |
| CN103019964B (en) | A kind of cache data access method and data buffering system | |
| CN109445695A (en) | A kind of data migration method | |
| CN102354301B (en) | Cache partitioning method | |
| CN111159130A (en) | Small file merging method and electronic equipment | |
| CN102937993A (en) | Method and device for accessing keywords | |
| CN104156173A (en) | Method and device for disk defragmentation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220218 Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province Patentee after: Huawei Cloud Computing Technologies Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd. |