CN111506251A - Data processing method, data processing device, SMR storage system and storage medium - Google Patents
Data processing method, data processing device, SMR storage system and storage medium Download PDFInfo
- Publication number
- CN111506251A CN111506251A CN201910091933.9A CN201910091933A CN111506251A CN 111506251 A CN111506251 A CN 111506251A CN 201910091933 A CN201910091933 A CN 201910091933A CN 111506251 A CN111506251 A CN 111506251A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- index information
- smr
- object block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0676—Magnetic disk device
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Management Or Editing Of Information On Record Carriers (AREA)
Abstract
The embodiment of the application provides a data processing method, a data processing device, an SMR storage system and a storage medium, and obtains a data write-in instruction; determining a target object block to be written with target data in an SMR area of a target SMR disk according to a data writing instruction; generating target main index information and target standby index information aiming at target data and target object blocks; writing the target data and the target standby index information into a target object block; writing the target main index information into a CMR area or other storage media; and writing database index information of the target data in other storage media, wherein the database index information of the target data comprises the target Unit key and the identification of the target object block. By the aid of the database index information, the main index information and the standby index information, the data writing sequence among the data blocks in the SMR area is not limited, operability of data storage of the SMR disk is improved, and data storage efficiency is high.
Description
Technical Field
The present application relates to the field of data storage technologies, and in particular, to a data processing method, an apparatus, an SMR storage system, and a storage medium.
Background
SMR (Shingled Magnetic Recording) disks are a disk data storage technology that overlaps data tracks on the disks like tiles on a roof, and therefore are called Shingled Magnetic Recording technologies that can greatly increase disk storage density. However, because of its special storage structure, the SMR disk does not support random data writing and in-place updating, and has poor operability and low efficiency of data storage.
It is therefore desirable to improve the operability of SMR disk data storage and increase data storage efficiency.
Disclosure of Invention
Embodiments of the present application provide a data processing method, an apparatus, an SMR storage system, and a storage medium, so as to improve operability of SMR disk data storage and increase data storage efficiency. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a data processing method, which is applied to a shingled magnetic recording SMR storage system, where the SMR storage system includes an SMR disk and other storage media, the SMR disk includes a CMR area and an SMR area, the SMR area is logically divided into a plurality of blocks ZONE, and the blocks include object blocks, and the method includes:
acquiring a data writing instruction, wherein the data writing instruction comprises target data to be written, an identifier of a target SMR disk of the target data to be written and a target Unit key;
determining a target object block to be written with the target data in an SMR area of the target SMR disk according to the data writing instruction;
generating target main index information and target standby index information aiming at the target data and the target object block;
writing the target data and the target standby index information into the target object block;
writing the target primary index information into the CMR area or the other storage medium;
and writing database index information of the target data in the other storage media, wherein the database index information of the target data comprises the target Unit key and the identification of the target object block.
Optionally, the determining, according to the data write instruction, a target object block to be written with the target data in an SMR area of the target SMR disk includes:
and selecting a target object block to be written with the target data from the free object blocks in the SMR area of the target SMR disk according to the data writing instruction.
Optionally, the determining, according to the data write instruction, a target object block to be written with the target data in an SMR area of the target SMR disk includes:
according to the target Unit key, reading database index information of the target Unit key from the other storage media;
and determining a target object block to be written in the target data in the SMR area of the target SMR disk according to the database index information of the target Unit key.
Optionally, the data processing method according to the embodiment of the present application further includes:
acquiring a data reading instruction, wherein the data reading instruction comprises an identifier of an SMR disk where data to be read is located and a Unit key of the data to be read;
according to the data reading instruction, database index information of the data to be read is obtained from the other storage media;
determining an object block where the data to be read is located according to database index information of the data to be read;
and reading the data to be read in the object block where the data to be read is located.
Optionally, the data processing method according to the embodiment of the present application further includes:
acquiring a data deletion instruction, wherein the data deletion instruction comprises an identifier of an SMR disk where data to be deleted is located and a Unit key of the data to be deleted;
according to the data deleting instruction, database index information of the data to be deleted is obtained from the other storage media;
determining the identifier of the object block where the data to be deleted is located according to the database index information of the data to be deleted;
deleting the main index information of the object block where the data to be deleted is located according to the identifier of the object block where the data to be deleted is located;
and deleting the database index information of the data to be deleted.
Optionally, the data processing method according to the embodiment of the present application further includes:
acquiring disk recovery information, wherein the disk recovery information comprises an identifier of an SMR disk to be recovered;
acquiring each main index information of the SMR disk to be recovered according to the disk recovery information;
and according to the main index information of the SMR disk to be restored, restoring the database index information of the SMR disk to be restored in the other storage media.
In a second aspect, an embodiment of the present application provides a data processing apparatus, which is applied to an SMR storage system, where the SMR storage system includes an SMR disk and other storage media, the SMR disk includes a CMR area and an SMR area, the SMR area is logically divided into a plurality of blocks ZONE, and the blocks include object blocks, and the apparatus includes:
the data writing instruction comprises target data to be written, an identifier of a target SMR disk to be written with the target data and a target Unit key;
a target object block determination module, configured to determine, according to the data write instruction, a target object block to which the target data is to be written in an SMR area of the target SMR disk;
the index information generation module is used for generating target main index information and target standby index information aiming at the target data and the target object block;
a first index information writing module, configured to write the target data and the target standby index information into the target object block;
a second index information writing module, configured to write the target primary index information into the CMR area or the other storage medium;
and a third index information writing module, configured to write database index information of the target data in the other storage media, where the database index information of the target data includes the target Unit key and the identifier of the target object block.
Optionally, the target object block determining module is specifically configured to:
and selecting a target object block to be written with the target data from the free object blocks in the SMR area of the target SMR disk according to the data writing instruction.
Optionally, the target object block determining module includes:
a database index information acquisition submodule, configured to read database index information of the target Unit key from the other storage media according to the target Unit key;
and the target object block determining submodule is used for determining a target object block to be written with the target data in the SMR area of the target SMR disk according to the database index information of the target Unit key.
Optionally, the data processing apparatus according to the embodiment of the present application further includes:
the device comprises a reading instruction acquisition module, a data reading instruction processing module and a data processing module, wherein the reading instruction acquisition module is used for acquiring a data reading instruction, and the data reading instruction comprises an identifier of an SMR disk where data to be read is located and a Unit key of the data to be read;
the first index information acquisition module is used for acquiring database index information of the data to be read from the other storage media according to the data reading instruction;
the reading position determining module is used for determining an object block where the data to be read is located according to the database index information of the data to be read;
and the data reading module is used for reading the data to be read in the object block where the data to be read is located.
Optionally, the data processing apparatus according to the embodiment of the present application further includes:
the data deleting method comprises a deleting instruction obtaining module, a deleting instruction obtaining module and a deleting module, wherein the deleting instruction obtaining module is used for obtaining a data deleting instruction, and the data deleting instruction comprises an identifier of an SMR disk where data to be deleted is located and a Unit key of the data to be deleted;
a second index information obtaining module, configured to obtain, according to the data deletion instruction, database index information of the data to be deleted from the other storage media;
the object block identification determining module is used for determining the identification of the object block where the data to be deleted is located according to the database index information of the data to be deleted;
a main index information deleting module, configured to delete the main index information of the object block in which the data to be deleted is located according to the identifier of the object block in which the data to be deleted is located;
and the database index information deleting module is used for deleting the database index information of the data to be deleted.
Optionally, the data processing apparatus according to the embodiment of the present application further includes:
the recovery information acquisition module is used for acquiring disk recovery information, wherein the disk recovery information comprises an identifier of an SMR disk to be recovered;
a main index information obtaining module, configured to obtain, according to the disk recovery information, each main index information of the SMR disk to be recovered;
and the database index information recovery module is used for recovering the database index information of the SMR disk to be recovered in the other storage media according to the main index information of the SMR disk to be recovered.
In a third aspect, an embodiment of the present application provides an SMR storage system, including: the SMR disk comprises a CMR area and an SMR area, and the SMR area comprises a plurality of object blocks;
the object block is used for storing object data and index information;
the CMR area is used for storing main index information;
the other storage media are used for storing database index information;
the processor is configured to implement the data processing method according to any one of the first aspect when running.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and the computer program, when executed by a processor, implements the data processing method according to any one of the above first aspects.
The data processing method, the data processing device, the SMR storage system and the storage medium, provided by the embodiment of the application, are used for acquiring a data writing instruction, wherein the data writing instruction comprises target data to be written, an identifier of a target SMR disk of the target data to be written and a target Unit key; determining a target object block to be written with target data in an SMR area of a target SMR disk according to a data writing instruction; generating target main index information and target standby index information aiming at target data and target object blocks; writing the target data and the target standby index information into a target object block; writing the target main index information into a CMR area or other storage media; and writing database index information of the target data in other storage media, wherein the database index information of the target data comprises the target Unit key and the identification of the target object block. By means of the database index information, the main index information and the standby index information, data writing aiming at each data block in the SMR area can be achieved, the data writing sequence among the data blocks is not limited, operability of SMR disk data storage is improved, and data storage efficiency is high. Of course, not all of the above advantages need be achieved in the practice of any one product or method of the present application.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic illustration of a SMR disk of the related art;
FIG. 2 is a first schematic diagram of a data processing method according to an embodiment of the present application;
FIG. 3 is a schematic diagram of the partitioning of SMR regions in an embodiment of the present application;
FIG. 4 is a schematic diagram of a three-level index according to an embodiment of the present application;
FIG. 5 is a schematic diagram of an embodiment of the present application;
FIG. 6 is a diagram illustrating a primary index according to an embodiment of the present application;
FIG. 7 is a second schematic diagram of a data processing method according to an embodiment of the present application;
FIG. 8 is a third schematic diagram of a data processing method according to an embodiment of the present application;
FIG. 9 is a fourth diagram illustrating a data processing method according to an embodiment of the present application;
FIG. 10 is a fifth exemplary diagram of a data processing method according to an embodiment of the present application;
FIG. 11 is a schematic diagram of an SMR storage system according to an embodiment of the present application;
fig. 12 is a schematic diagram of a data processing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the security industry, video data, pictures and audio data are called streaming data for short, and the streaming data has the characteristics of large data volume, less writing and reading, high coverage frequency and the like; when storing streaming data in project application, the problems of writing of a large amount of new data and deleting of expired data and the problem of hardware cost caused by storage of a large amount of streaming data need to be solved. The shingled hard disk has the characteristic of high storage density and is very suitable for the security industry. However, because of its special storage structure, the SMR disk does not support random data writing such as writing and in-place updating, and has poor operability and low efficiency of data storage.
In the related art, in order to increase the read/write efficiency of the SMR disk, an HM (Host management) SMR technique is used. Referring to fig. 1, an HM SMR disk is divided into two storage areas according to a CMR (conventional magnetic recording), each of which is divided into a plurality of ZONEs (blocks), and the CMR area supports random reading and writing. For the ZONEs of the SMR ZONE, only sequential writes are supported within each ZONE, and parallel writes are supported among a plurality of ZONEs; there is one WP (Write Pointer) inside each ZONE of the SMR area, each Write operation must start from the Write Pointer, the Write operations must be aligned according to the physical sector size, a single read/Write operation cannot span multiple ZONE spaces, and a ZONE to which data has been written must be RESET before the next multiplexed Write. After the HM SMR disk exposes the ZONE and WP, the application layer software can directly manage the complete lifecycle of the ZONE, including in-ZONE data sequence writes, ZONE reclaim resets, and the like.
The CMR area stores the ZONE index information in the SMR area, and the SMR area and the CMR area share one disk surface and a magnetic head, so that frequent magnetic head movement is caused by data updating, and particularly, the overall storage performance of the SMR area is reduced when data is frequently updated.
In view of this, an embodiment of the present application provides a data processing method, which is applied to an SMR storage system, where the SMR storage system includes an SMR disk and other storage media, the SMR disk includes a CMR area and an SMR area, the SMR disk is logically divided into a plurality of ZONEs (blocks), and the blocks include object blocks, and referring to fig. 2, the method includes:
s101, a data writing instruction is obtained, wherein the data writing instruction comprises target data to be written, an identifier of a target SMR disk of the target data to be written and a target Unit key.
The data processing method of the embodiment of the application is applied to the SMR storage system, so that the data processing method can be realized by the SMR storage system, and particularly can be realized by a processor in the SMR storage system. The SMR storage system acquires a data writing instruction, wherein the data writing instruction comprises target data to be written, an identifier of a target SMR disk of the target data to be written and a target Unit key.
The identification of the target SMR disk may be the ID of the target SMR disk, or the WWN (World wide name) of the target SMR disk, or the like. Other storage media use different disk surfaces and heads than the CMR and SMR regions, or other storage media are not read from or written to by heads. Alternatively, the other storage medium may be an SSD (Solid State Disk). The DATA ZONE (object block) in the SMR area is used to store object DATA, auxiliary index information DATA, and auxiliary DATA. Optionally, referring to fig. 3, the SMR area may further include a Reserve ZONE (spare block) and a META ZONE (META block), wherein the Reserve ZONE is used as an intermediate medium in data recovery; META ZONE is used to store metadata information.
Referring to fig. 4, in the embodiment of the present application, three levels of indexes are used, including a DB Index (Database Index), a Main Index (Main Index), and a Back Index (backup Index). The database index information is stored in the other storage medium, and after the backup index information is stored in the data stored in each object block of the SMR area, the main index information may be stored in the CMR area and may be stored in the other storage medium.
And S102, according to the data writing command, determining a target object block to be written with target data in the SMR area of the target SMR disk.
The SMR storage system identifies the current SMR disk according to the identification of the target SMR disk in the data write command, and identifies a target object block for storing target data from an SMR area in the target SMR disk. The SMR storage system selects the specified object block as the target object block according to a preset selection strategy, and the preset selection strategy can be set according to actual conditions.
Optionally, the determining, according to the data writing instruction, a target object block to which target data is to be written in an SMR area of the target SMR disk includes:
and according to the data writing instruction, selecting a target object block to be written with target data from free object blocks in an SMR area of the target SMR disk.
Optionally, the determining, according to the data writing instruction, a target object block to which target data is to be written in an SMR area of the target SMR disk includes:
step one, according to the target Unit key, reading the database index information of the target Unit key from the other storage media.
And step two, determining a target object block to be written with target data in an SMR area of the target SMR disk according to the database index information of the target Unit key.
Optionally, before determining, according to the data writing instruction, a target object block to be written with target data in an SMR area of the target SMR disk, the method further includes:
detecting whether the target SMR disk is available, if so, executing S102, and determining a target object block to be written with target data in an SMR area of the target SMR disk according to the data writing instruction; and if the target SMR disk is unavailable, returning information for representing that the target SMR disk is unavailable.
S103, generating target primary index information and target backup index information for the target data and the target object block.
The SMR storage system organizes and generates target primary index information and target backup index information for target data and target object blocks. The target main index information and the target standby index information include a Unit key and FS data (file system data) of the target data, and the FS data includes an address of an object block (i.e., a target object block) where the target data is located.
Optionally, before generating the target primary index information and the target secondary index information for the target data and the target object block, the method further includes:
and calculating a check value of the target data. If the calculated check value is the same as the check value of the received target data, indicating that the target data is complete, executing S103, and generating target primary index information and target backup index information for the target data and the target object block. If the calculated check value is different from the check value of the received target data, the problem of the target data in the transmission process is shown, and information representing the transmission error of the target data is returned.
And S104, writing the target data and the target standby index information into the target object block.
And the SMR storage system writes the target data into the target object block, and writes the target data in the target object block into the target standby index information. Alternatively, as shown in fig. 5, the standby index information is stored after the object block data, and is stored immediately after each object block.
And S105 writing the target main index information into the CMR area or the other storage medium.
Optionally, as shown in fig. 6, the main index information is in a continuous storage form, which is convenient for random IO merge processing and reduces movement of a magnetic head of a magnetic disk. When the main index information is stored in other storage media, the SMR storage system writes the target main index information into other storage media; when the primary index information is stored in the CMR region in another storage medium, movement of the SMR disk head during data updates may be reduced, thereby increasing the overall storage performance of the SMR region.
And S106, writing database index information of the target data into the other storage media, wherein the database index information of the target data comprises the target Unit key and the identification of the target object block.
The SMR storage system writes database index information of the target data to the other storage medium.
In the embodiment of the application, data writing aiming at each data block in the SMR area can be realized through the database index information, the main index information and the standby index information, the data writing sequence among the data blocks is not limited, the operability of SMR disk data storage is increased, and the data storage efficiency is high. The database index information, the main index information and the standby metadata are respectively stored on different media, so that the high efficiency of reading and writing of index information deployment and the data security are fully ensured. The main index information is simplified and stored and is used for randomly updating scenes, and the standby index information is stored in full and is stored next to the object data, so that the storage performance of the whole system is fully improved.
Optionally, the data processing method further includes:
s201, a data reading instruction is obtained, wherein the data reading instruction comprises an identifier of an SMR disk where data to be read is located and a Unit key of the data to be read.
The SMR storage system acquires a data reading instruction, wherein the data reading instruction comprises an identification of an SMR disk where the data to be read is located and a Unit key of the data to be read.
And S202, according to the data reading instruction, obtaining the database index information of the data to be read from the other storage media.
And the SMR storage system acquires the database index information of the data to be read in other storage media according to the Unit key of the data to be read in the data reading instruction.
And S203, determining the object block of the data to be read according to the database index information of the data to be read.
And determining the object block of the data to be read according to the identifier of the object block in the database index information of the data to be read.
And S204, reading the data to be read in the object block where the data to be read is located.
And the SMR storage system reads the data to be read in the object block where the data to be read is located.
In the embodiment of the application, the object block where the data to be read is located is obtained through the database index information in other storage media, the magnetic head in the SMR disk can directly read the data from the object block without reading the main index information or the auxiliary index information, the data reading operability of the SMR disk is strong, and the data reading efficiency is improved.
Alternatively, the process of reading the data to be read may be specifically as shown in fig. 7. The method comprises the steps of obtaining database information of data records (namely obtaining database index information of data to be read in other storage media), obtaining a data writing position and check value information, then reading data information of a specified position and calculating a check value, and returning the data information to be obtained to a user when the check value is consistent. The user data reading process only needs to pass through the index information of the database without the participation of other index information, wherein the object data refers to the data to be read, and the object id refers to the identification of the object block.
Optionally, the data processing method further includes:
s301, acquiring a data deletion instruction, wherein the data deletion instruction comprises an identifier of an SMR disk where to-be-deleted data is located and a Unit key of the to-be-deleted data.
And S302, according to the data deleting instruction, acquiring database index information of the data to be deleted from the other storage media.
And S303, determining the identifier of the object block where the data to be deleted is located according to the database index information of the data to be deleted.
The SMR storage system determines an identification of the object block, e.g., object id of the object block, where the data to be deleted is located.
And S304, deleting the main index information of the object block in which the data to be deleted is located according to the identifier of the object block in which the data to be deleted is located.
S305, deleting the database index information of the data to be deleted.
In the embodiment of the application, when the data to be deleted is deleted, only the main index information of the object block where the data to be deleted is located and the database index information of the data to be deleted need to be deleted, the data block where the data to be deleted is located does not need to be emptied, and the data deleting efficiency is high.
Optionally, the process of deleting the data to be deleted may be specifically as shown in fig. 8. Firstly, the database information of the data record (namely, the database Index information of the data to be deleted in other storage media) needs to be acquired, the data writing position is acquired, and then the Main Index information and the database information of the corresponding data are deleted without operating the Back Index.
Optionally, the data processing method further includes:
s401, obtaining disk recovery information, wherein the disk recovery information includes an identifier of an SMR disk to be recovered.
And S402, acquiring each piece of main index information of the SMR disk to be recovered according to the disk recovery information.
And S403, according to the main index information of the SMR disk to be restored, restoring the database index information of the SMR disk to be restored in the other storage media.
Optionally, the process of disk recovery may be specifically as shown in fig. 9. When the SMR disk drifts or the index information data is damaged or lost, the database index information needs to be reconstructed from the SMR disk. The Index information is reconstructed only by scanning the Main Index information of each Object, and the database Index information of the disk can be rapidly reconstructed due to the centralized storage of the Main Index.
Optionally, the data processing method further includes:
s501, a formatting command is obtained, wherein the formatting command comprises the size of an object block and the size of an index information block.
The format instructions are used to format a specified SMR disk. And after the SMR storage system acquires the formatting instruction, triggering and executing the formatting of each SMR disk. Optionally, the format instruction may further include an identifier of an SMR disk to be formatted, and the SMR storage system may select a designated SMR disk to perform a format operation according to the identifier of the SMR disk to be formatted.
And S502, calculating metadata information according to the formatting command and downloading the metadata information.
And the SMR storage system calculates the block division condition of the SMR disk to be formatted according to the object block size and the index information block size included in the formatting instruction and downloads the SMR disk.
S503, initializing the main index information of each object block and downloading.
Directly calculating main index information corresponding to each object block, wherein the main index information mainly records metadata information of each object block; the main index information area storage area may be the CMR area of the SMR disk, or may be other storage media such as an SSD.
S505, the initialization block uses a bitmap.
Each object block corresponds to the unique block in the file system and uses bitmap information, and the bitmap of each block is emptied when the disk is formatted.
S506, initialize the other storage media.
And initializing the information corresponding to the SMR disk in other storage media according to the identification of the SMR disk.
Alternatively, the process of initializing the disk may be specifically as shown in fig. 10. And acquiring formatting parameters (the formatting parameters can be acquired by analyzing the formatting instruction), wherein the formatting parameters comprise the size of the object block and the size information of the index information block. And then directly calculating metadata information and downloading the metadata, calculating Main Index information and downloading the Main Index information, wherein the initialization block initializes the database Index information by using a bitmap.
An embodiment of the present application further provides an SMR storage system, referring to fig. 11, where the SMR storage system includes: an SMR disk, another storage medium, and a processor, the SMR disk including a CMR area and an SMR area, the SMR area including a plurality of object blocks;
the object block is used for storing object data and index information;
the CMR area is used for storing main index information;
other storage media are used for storing database index information;
the processor is configured to perform any of the above-described data processing methods when executed.
Other storage media use different disk surfaces and heads than the CMR and SMR regions, or other storage media are not read from or written to by heads. Alternatively, the other storage medium may be an SSD (Solid State Disk). The DATA ZONE (object block) in the SMR area is used to store object DATA, auxiliary index information DATA, and auxiliary DATA. Optionally, referring to fig. 3, the SMR area may further include a Reserve ZONE (spare block) and a META ZONE (META block), wherein the Reserve ZONE is used as an intermediate medium in data recovery; META ZONE is used to store metadata information.
Referring to fig. 4, in the embodiment of the present application, three levels of Index information are used, including a DB Index (Database Index), a Main Index (Main Index), and a Back Index (backup Index). The database index information is stored in the other storage medium, the backup index information is stored in data stored in each object block of the SMR area, and the main index information may be stored in the CMR area.
In the embodiment of the application, data writing aiming at each data block in the SMR area can be realized through the database index information, the main index information and the standby index information, the data writing sequence among the data blocks is not limited, the operability of SMR disk data storage is increased, and the data storage efficiency is high. The database index information, the main index information and the standby metadata are respectively stored on different media, so that the high efficiency of reading and writing of index information deployment and the data security are fully ensured. The main index information is simplified and stored and is used for randomly updating scenes, and the standby index information is stored in full and is stored next to the object data, so that the storage performance of the whole system is fully improved.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component.
An embodiment of the present application further provides a data processing apparatus, which is applied to a shingled magnetic recording SMR storage system, where the SMR storage system includes an SMR disk and other storage media, the SMR disk includes a CMR area and an SMR area, the SMR area is logically divided into a plurality of blocks ZONE, and each of the blocks includes an object block, and referring to fig. 12, the apparatus includes:
a write instruction obtaining module 1201, configured to obtain a data write instruction, where the data write instruction includes target data to be written, an identifier of a target SMR disk to be written with the target data, and a target Unit key;
a target object block determination module 1202, configured to determine, according to the data write instruction, a target object block to be written with the target data in an SMR area of the target SMR disk;
an index information generating module 1203, configured to generate target primary index information and target secondary index information for the target data and the target object block;
a first index information writing module 1204, configured to write the target data and the target backup index information into the target object block;
a second index information writing module 1205, configured to write the target main index information into the CMR area or the other storage medium;
a third index information writing module 1206, configured to write database index information of the target data in the other storage medium, where the database index information of the target data includes the target Unit key and the identifier of the target object block.
Optionally, the target object block determining module 1202 is specifically configured to:
and according to the data writing instruction, selecting a target object block to be written with the target data from free object blocks in an SMR area of the target SMR disk.
Optionally, the target object block determining module 1202 includes:
a database index information acquisition submodule, configured to read database index information of the target Unit key from the other storage media according to the target Unit key;
and the target object block determining submodule is used for determining a target object block to be written with the target data in the SMR area of the target SMR disk according to the database index information of the target Unit key.
Optionally, the data processing apparatus according to the embodiment of the present application further includes:
the reading instruction acquisition module is used for acquiring a data reading instruction, wherein the data reading instruction comprises an identifier of an SMR disk where data to be read is located and a Unit key of the data to be read;
a first index information obtaining module, configured to obtain database index information of the data to be read from the other storage media according to the data reading instruction;
a reading position determining module, configured to determine, according to database index information of the data to be read, an object block in which the data to be read is located;
and the data reading module is used for reading the data to be read in the object block where the data to be read is located.
Optionally, the data processing apparatus according to the embodiment of the present application further includes:
the system comprises a deletion instruction acquisition module, a deletion instruction acquisition module and a deletion instruction processing module, wherein the deletion instruction acquisition module is used for acquiring a data deletion instruction, and the data deletion instruction comprises an identifier of an SMR disk where data to be deleted is located and a Unit key of the data to be deleted;
a second index information obtaining module, configured to obtain, according to the data deletion instruction, database index information of the data to be deleted from the other storage media;
an object block identifier determining module, configured to determine, according to the database index information of the to-be-deleted data, an identifier of an object block in which the to-be-deleted data is located;
a main index information deleting module, configured to delete the main index information of the object block in which the to-be-deleted data is located according to the identifier of the object block in which the to-be-deleted data is located;
and the database index information deleting module is used for deleting the database index information of the data to be deleted.
Optionally, the data processing apparatus according to the embodiment of the present application further includes:
the recovery information acquisition module is used for acquiring disk recovery information, wherein the disk recovery information comprises an identifier of an SMR disk to be recovered;
a main index information obtaining module, configured to obtain, according to the disk recovery information, each main index information of the SMR disk to be recovered;
and a database index information recovery module, configured to recover, in the other storage media, the database index information of the SMR disk to be recovered according to each piece of main index information of the SMR disk to be recovered.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements any of the data processing methods described above.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the embodiments of the apparatus, the system and the storage medium, since they are substantially similar to the method embodiments, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiments.
The above description is only for the preferred embodiment of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application are included in the protection scope of the present application.
Claims (14)
1. A data processing method applied to a Shingled Magnetic Recording (SMR) storage system, the SMR storage system including an SMR disk and other storage media, the SMR disk including a CMR area and an SMR area, the SMR area being logically divided into a plurality of blocks ZONE, the blocks including object blocks, the method comprising:
acquiring a data writing instruction, wherein the data writing instruction comprises target data to be written, an identifier of a target SMR disk of the target data to be written and a target Unit key;
determining a target object block to be written with the target data in an SMR area of the target SMR disk according to the data writing instruction;
generating target main index information and target standby index information aiming at the target data and the target object block;
writing the target data and the target standby index information into the target object block;
writing the target primary index information into the CMR area or the other storage medium;
and writing database index information of the target data in the other storage media, wherein the database index information of the target data comprises the target Unit key and the identification of the target object block.
2. The method of claim 1, wherein the determining, in accordance with the data write instruction, a target object block to write the target data in an SMR area of the target SMR disk comprises:
and selecting a target object block to be written with the target data from the free object blocks in the SMR area of the target SMR disk according to the data writing instruction.
3. The method of claim 1, wherein the determining, in accordance with the data write instruction, a target object block to write the target data in an SMR area of the target SMR disk comprises:
according to the target Unit key, reading database index information of the target Unit key from the other storage media;
and determining a target object block to be written in the target data in the SMR area of the target SMR disk according to the database index information of the target Unit key.
4. The method of claim 1, further comprising:
acquiring a data reading instruction, wherein the data reading instruction comprises an identifier of an SMR disk where data to be read is located and a Unit key of the data to be read;
according to the data reading instruction, database index information of the data to be read is obtained from the other storage media;
determining an object block where the data to be read is located according to database index information of the data to be read;
and reading the data to be read in the object block where the data to be read is located.
5. The method of claim 1, further comprising:
acquiring a data deletion instruction, wherein the data deletion instruction comprises an identifier of an SMR disk where data to be deleted is located and a Unit key of the data to be deleted;
according to the data deleting instruction, database index information of the data to be deleted is obtained from the other storage media;
determining the identifier of the object block where the data to be deleted is located according to the database index information of the data to be deleted;
deleting the main index information of the object block where the data to be deleted is located according to the identifier of the object block where the data to be deleted is located;
and deleting the database index information of the data to be deleted.
6. The method of claim 1, further comprising:
acquiring disk recovery information, wherein the disk recovery information comprises an identifier of an SMR disk to be recovered;
acquiring each main index information of the SMR disk to be recovered according to the disk recovery information;
and according to the main index information of the SMR disk to be restored, restoring the database index information of the SMR disk to be restored in the other storage media.
7. A data processing apparatus applied to an SMR storage system, the SMR storage system including an SMR disk and other storage media, the SMR disk including a CMR area and an SMR area, the SMR area being logically divided into a plurality of blocks ZONE, the blocks including object blocks, the apparatus comprising:
the data writing instruction comprises target data to be written, an identifier of a target SMR disk to be written with the target data and a target Unit key;
a target object block determination module, configured to determine, according to the data write instruction, a target object block to which the target data is to be written in an SMR area of the target SMR disk;
the index information generation module is used for generating target main index information and target standby index information aiming at the target data and the target object block;
a first index information writing module, configured to write the target data and the target standby index information into the target object block;
a second index information writing module, configured to write the target primary index information into the CMR area or the other storage medium;
and a third index information writing module, configured to write database index information of the target data in the other storage media, where the database index information of the target data includes the target Unit key and the identifier of the target object block.
8. The apparatus of claim 7, wherein the target object block determination module is specifically configured to:
and selecting a target object block to be written with the target data from the free object blocks in the SMR area of the target SMR disk according to the data writing instruction.
9. The apparatus of claim 7, wherein the target object block determination module comprises:
a database index information acquisition submodule, configured to read database index information of the target Unit key from the other storage media according to the target Unit key;
and the target object block determining submodule is used for determining a target object block to be written with the target data in the SMR area of the target SMR disk according to the database index information of the target Unit key.
10. The apparatus of claim 7, further comprising:
the device comprises a reading instruction acquisition module, a data reading instruction processing module and a data processing module, wherein the reading instruction acquisition module is used for acquiring a data reading instruction, and the data reading instruction comprises an identifier of an SMR disk where data to be read is located and a Unit key of the data to be read;
the first index information acquisition module is used for acquiring database index information of the data to be read from the other storage media according to the data reading instruction;
the reading position determining module is used for determining an object block where the data to be read is located according to the database index information of the data to be read;
and the data reading module is used for reading the data to be read in the object block where the data to be read is located.
11. The apparatus of claim 7, further comprising:
the data deleting method comprises a deleting instruction obtaining module, a deleting instruction obtaining module and a deleting module, wherein the deleting instruction obtaining module is used for obtaining a data deleting instruction, and the data deleting instruction comprises an identifier of an SMR disk where data to be deleted is located and a Unit key of the data to be deleted;
a second index information obtaining module, configured to obtain, according to the data deletion instruction, database index information of the data to be deleted from the other storage media;
the object block identification determining module is used for determining the identification of the object block where the data to be deleted is located according to the database index information of the data to be deleted;
a main index information deleting module, configured to delete the main index information of the object block in which the data to be deleted is located according to the identifier of the object block in which the data to be deleted is located;
and the database index information deleting module is used for deleting the database index information of the data to be deleted.
12. The apparatus of claim 7, further comprising:
the recovery information acquisition module is used for acquiring disk recovery information, wherein the disk recovery information comprises an identifier of an SMR disk to be recovered;
a main index information obtaining module, configured to obtain, according to the disk recovery information, each main index information of the SMR disk to be recovered;
and the database index information recovery module is used for recovering the database index information of the SMR disk to be recovered in the other storage media according to the main index information of the SMR disk to be recovered.
13. An SMR storage system, comprising: the SMR disk comprises a CMR area and an SMR area, and the SMR area comprises a plurality of object blocks;
the object block is used for storing object data and index information;
the CMR area is used for storing main index information;
the other storage media are used for storing database index information;
the processor is adapted to perform the data processing method of any of the preceding claims 1-6 when executed.
14. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910091933.9A CN111506251B (en) | 2019-01-30 | 2019-01-30 | Data processing method and device, SMR storage system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910091933.9A CN111506251B (en) | 2019-01-30 | 2019-01-30 | Data processing method and device, SMR storage system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111506251A true CN111506251A (en) | 2020-08-07 |
| CN111506251B CN111506251B (en) | 2023-06-02 |
Family
ID=71864623
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910091933.9A Active CN111506251B (en) | 2019-01-30 | 2019-01-30 | Data processing method and device, SMR storage system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111506251B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112947862A (en) * | 2021-03-10 | 2021-06-11 | 歌尔科技有限公司 | Device, Flash memory and data storage method thereof |
| CN113031869A (en) * | 2021-03-25 | 2021-06-25 | 联想凌拓科技有限公司 | Data processing method and device and computer readable storage medium |
| CN113419685A (en) * | 2021-07-12 | 2021-09-21 | 杭州海康威视数字技术股份有限公司 | RAID creation based on SMR, data writing aiming at RAID and RAID recovery method |
| CN113568582A (en) * | 2021-07-30 | 2021-10-29 | 重庆紫光华山智安科技有限公司 | Data management method and device and storage equipment |
| WO2021249201A1 (en) * | 2020-06-10 | 2021-12-16 | 杭州海康威视数字技术股份有限公司 | Monitoring data storage method and apparatus based on shingled magnetic recording disk |
| CN113900590A (en) * | 2021-09-28 | 2022-01-07 | 重庆紫光华山智安科技有限公司 | Shingled disk storage method, apparatus, device and medium |
| CN114153394A (en) * | 2021-11-30 | 2022-03-08 | 浙江大华技术股份有限公司 | Data storage management method, device and equipment |
| CN115905219A (en) * | 2022-11-04 | 2023-04-04 | 上海威固信息技术股份有限公司 | Data storage driving system for multi-channel data storage cloud library and transmission method thereof |
| WO2023098641A1 (en) * | 2021-11-30 | 2023-06-08 | Zhejiang Dahua Technology Co., Ltd. | Systems and methods for data storage in storage device |
| CN116301670A (en) * | 2023-05-25 | 2023-06-23 | 极限数据(北京)科技有限公司 | Data partitioning method and data processing method |
| CN117539690A (en) * | 2023-12-06 | 2024-02-09 | 广州鼎甲计算机科技有限公司 | Method, device, equipment, medium and product for merging and recovering multi-disk data |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110238716A1 (en) * | 2010-03-25 | 2011-09-29 | International Business Machiness Corporation | File index, metadata storage, and file system management for magnetic tape |
| CN105096964A (en) * | 2014-05-16 | 2015-11-25 | 西部数据技术公司 | Vibration mitigation for a data storage device |
| US20160147650A1 (en) * | 2014-11-24 | 2016-05-26 | Seagate Technology Llc | Non-sequential write for sequential read back |
| WO2016086819A1 (en) * | 2014-12-05 | 2016-06-09 | 华为技术有限公司 | Method and apparatus for writing data into shingled magnetic record smr hard disk |
| US20160232168A1 (en) * | 2015-02-06 | 2016-08-11 | HGST Netherlands B.V. | Indirection data structures to manage file system metadata |
| CN106201355A (en) * | 2016-07-12 | 2016-12-07 | 腾讯科技（深圳）有限公司 | Data processing method and device and storage system |
| CN106548789A (en) * | 2015-09-17 | 2017-03-29 | 伊姆西公司 | Method and apparatus for operating stacked tile type magnetic recording equipment |
| US20170123944A1 (en) * | 2015-10-29 | 2017-05-04 | Netapp, Inc. | Storage system to recover and rewrite overwritten data |
| US20170124104A1 (en) * | 2015-10-31 | 2017-05-04 | Netapp, Inc. | Durable file system for sequentially written zoned storage |
| CN107291889A (en) * | 2017-06-20 | 2017-10-24 | 郑州云海信息技术有限公司 | A kind of date storage method and system |
| CN107315533A (en) * | 2016-04-26 | 2017-11-03 | 杭州海康威视数字技术股份有限公司 | A kind of date storage method and device |
| US9997194B1 (en) * | 2017-09-25 | 2018-06-12 | Amazon Technologies, Inc. | Partial updates for shingled magnetic recording devices |
| CN108255408A (en) * | 2016-12-28 | 2018-07-06 | 中国电信股份有限公司 | Date storage method and system |
-
2019
- 2019-01-30 CN CN201910091933.9A patent/CN111506251B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110238716A1 (en) * | 2010-03-25 | 2011-09-29 | International Business Machiness Corporation | File index, metadata storage, and file system management for magnetic tape |
| CN105096964A (en) * | 2014-05-16 | 2015-11-25 | 西部数据技术公司 | Vibration mitigation for a data storage device |
| US20160147650A1 (en) * | 2014-11-24 | 2016-05-26 | Seagate Technology Llc | Non-sequential write for sequential read back |
| WO2016086819A1 (en) * | 2014-12-05 | 2016-06-09 | 华为技术有限公司 | Method and apparatus for writing data into shingled magnetic record smr hard disk |
| US20160232168A1 (en) * | 2015-02-06 | 2016-08-11 | HGST Netherlands B.V. | Indirection data structures to manage file system metadata |
| CN106548789A (en) * | 2015-09-17 | 2017-03-29 | 伊姆西公司 | Method and apparatus for operating stacked tile type magnetic recording equipment |
| US20170123944A1 (en) * | 2015-10-29 | 2017-05-04 | Netapp, Inc. | Storage system to recover and rewrite overwritten data |
| US20170124104A1 (en) * | 2015-10-31 | 2017-05-04 | Netapp, Inc. | Durable file system for sequentially written zoned storage |
| CN107315533A (en) * | 2016-04-26 | 2017-11-03 | 杭州海康威视数字技术股份有限公司 | A kind of date storage method and device |
| CN106201355A (en) * | 2016-07-12 | 2016-12-07 | 腾讯科技（深圳）有限公司 | Data processing method and device and storage system |
| CN108255408A (en) * | 2016-12-28 | 2018-07-06 | 中国电信股份有限公司 | Date storage method and system |
| CN107291889A (en) * | 2017-06-20 | 2017-10-24 | 郑州云海信息技术有限公司 | A kind of date storage method and system |
| US9997194B1 (en) * | 2017-09-25 | 2018-06-12 | Amazon Technologies, Inc. | Partial updates for shingled magnetic recording devices |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021249201A1 (en) * | 2020-06-10 | 2021-12-16 | 杭州海康威视数字技术股份有限公司 | Monitoring data storage method and apparatus based on shingled magnetic recording disk |
| CN112947862B (en) * | 2021-03-10 | 2022-09-20 | 歌尔科技有限公司 | Device, Flash memory and data storage method thereof |
| CN112947862A (en) * | 2021-03-10 | 2021-06-11 | 歌尔科技有限公司 | Device, Flash memory and data storage method thereof |
| CN113031869A (en) * | 2021-03-25 | 2021-06-25 | 联想凌拓科技有限公司 | Data processing method and device and computer readable storage medium |
| CN113031869B (en) * | 2021-03-25 | 2023-02-03 | 联想凌拓科技有限公司 | Data processing method and device and computer readable storage medium |
| CN113419685A (en) * | 2021-07-12 | 2021-09-21 | 杭州海康威视数字技术股份有限公司 | RAID creation based on SMR, data writing aiming at RAID and RAID recovery method |
| CN113419685B (en) * | 2021-07-12 | 2022-08-09 | 杭州海康威视数字技术股份有限公司 | RAID creation based on SMR, data writing aiming at RAID and RAID recovery method |
| CN113568582B (en) * | 2021-07-30 | 2023-05-26 | 重庆紫光华山智安科技有限公司 | Data management method, device and storage equipment |
| CN113568582A (en) * | 2021-07-30 | 2021-10-29 | 重庆紫光华山智安科技有限公司 | Data management method and device and storage equipment |
| CN113900590B (en) * | 2021-09-28 | 2023-01-31 | 重庆紫光华山智安科技有限公司 | Shingled disk storage method, shingled disk storage device, shingled disk storage equipment and shingled disk storage medium |
| CN113900590A (en) * | 2021-09-28 | 2022-01-07 | 重庆紫光华山智安科技有限公司 | Shingled disk storage method, apparatus, device and medium |
| CN114153394A (en) * | 2021-11-30 | 2022-03-08 | 浙江大华技术股份有限公司 | Data storage management method, device and equipment |
| WO2023098641A1 (en) * | 2021-11-30 | 2023-06-08 | Zhejiang Dahua Technology Co., Ltd. | Systems and methods for data storage in storage device |
| CN115905219B (en) * | 2022-11-04 | 2023-09-19 | 上海威固信息技术股份有限公司 | Data storage driving system for multichannel data cloud storage library and transmission method thereof |
| CN115905219A (en) * | 2022-11-04 | 2023-04-04 | 上海威固信息技术股份有限公司 | Data storage driving system for multi-channel data storage cloud library and transmission method thereof |
| CN116301670A (en) * | 2023-05-25 | 2023-06-23 | 极限数据(北京)科技有限公司 | Data partitioning method and data processing method |
| CN116301670B (en) * | 2023-05-25 | 2023-09-05 | 极限数据(北京)科技有限公司 | Data partitioning method and data processing method |
| CN117539690B (en) * | 2023-12-06 | 2024-04-05 | 广州鼎甲计算机科技有限公司 | Method, device, equipment, medium and product for merging and recovering multi-disk data |
| CN117539690A (en) * | 2023-12-06 | 2024-02-09 | 广州鼎甲计算机科技有限公司 | Method, device, equipment, medium and product for merging and recovering multi-disk data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111506251B (en) | 2023-06-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111506251A (en) | Data processing method, data processing device, SMR storage system and storage medium | |
| US11853549B2 (en) | Index storage in shingled magnetic recording (SMR) storage system with non-shingled region | |
| CN102929750B (en) | Nonvolatile media dirty region tracking | |
| US7774565B2 (en) | Methods and apparatus for point in time data access and recovery | |
| CN108319602B (en) | Database management method and database system | |
| CN106951375B (en) | Method and device for deleting snapshot volume in storage system | |
| US8015155B2 (en) | Non-disruptive backup copy in a database online reorganization environment | |
| US7383465B1 (en) | Undoable volume using write logging | |
| JP4304194B2 (en) | File system management apparatus and method | |
| CN107643880A (en) | The method and device of file data migration based on distributed file system | |
| CN110673800B (en) | Data operation method, device and equipment of file system and readable storage medium | |
| US20050165853A1 (en) | Method and apparatus for localized protected imaging of a file system | |
| CN110147203B (en) | File management method and device, electronic equipment and storage medium | |
| CN110597762A (en) | File processing method, device, equipment and storage medium | |
| CN111651127A (en) | Monitoring data storage method and device based on shingled magnetic recording disk | |
| CN105302488B (en) | The method for writing data and system of a kind of storage system | |
| EP2669804A1 (en) | Storage system | |
| CN107506466B (en) | Small file storage method and system | |
| CN114090337A (en) | Quick synthesis backup and recovery method based on snapshot | |
| WO2017087015A1 (en) | Count of metadata operations | |
| CN115098447A (en) | File recovery method and device, electronic equipment and readable storage medium | |
| US20050262033A1 (en) | Data recording apparatus, data recording method, program for implementing the method, and program recording medium | |
| JP4895308B2 (en) | Recording method for magnetic disk device and magnetic disk device | |
| CN114217741A (en) | Storage method of storage device and storage device | |
| CN101739308A (en) | Method for generating image file and storage system for image file |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |