CN109683810B - Read-write method and terminal - Google Patents
Read-write method and terminal Download PDFInfo
- Publication number
- CN109683810B CN109683810B CN201811382357.5A CN201811382357A CN109683810B CN 109683810 B CN109683810 B CN 109683810B CN 201811382357 A CN201811382357 A CN 201811382357A CN 109683810 B CN109683810 B CN 109683810B
- Authority
- CN
- China
- Prior art keywords
- file
- end disk
- disk group
- key information
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Storage Device Security (AREA)
- Power Sources (AREA)
Abstract
The invention provides a reading and writing method and a terminal, wherein a cold data disk is divided into a front-end disk group and a rear-end disk group, the front-end disk group is set to be in a power-on state, and the rear-end disk group is set to be in a power-off state; receiving a file writing request, and extracting key information of the file; acquiring file characteristics of the file according to the key information, analyzing the file characteristics, and selecting a matched front-end disk; and writing the file into the front-end disk, and storing the file name, the storage path and the corresponding key information of the file into a key information server, so that the cold storage is energy-saving and power-saving, and the reliable access of the data is ensured.
Description
The application is a divisional application taking patent application with application number of 201710695573.4, application date of 2017, 08 and 15 as well as name of 'a cold data processing method and terminal' as a parent.
Technical Field
The invention relates to the field of cold data, in particular to a read-write method and a terminal.
Background
Under the big data era, a plurality of IDC data centers, enterprises and service providers CPS are facing the era of the rapid increase of data volume and the continuous generation of mass data. For example, with the popularization of broadband, huge logs and communication records are brought, personal information, video records such as video communication, medical images, geographic information and monitoring videos, which are continuously updated every day in a social network, data information generated by non-traditional IT equipment such as sensors and navigation equipment, and pictures and information generated by various intelligent terminals are continuously increased, so that the total data amount reaches ZB level number, and the data amount is doubled every 18 months. However, many of these growing data items share the same relatively infrequently accessed, relatively low access frequency, older data, so-called "cold" data. If the 'cold' data are migrated to low-cost cold storage, a disk is powered on when the data are accessed, and the disk is powered off when the data are idle, namely a so-called 'cold storage use model', the storage power consumption of each GB of data can be reduced to the maximum extent, and the total operation cost of the user data center computer room is remarkably reduced. Currently, the "cold storage usage model" is used in a large number of applications such as backup, archiving, disaster recovery, and social media, and the "cold storage usage model" already accounts for 50% of the storage capacity of market storage.
However, in the "cold storage usage model", the cold storage hard disk is usually powered off or on for energy saving and power saving, but frequent powering off and on of the hard disk may cause error reporting or data loss of the upper file system, and problems such as file loss, file system error reporting, disk damage, and the like occur, resulting in unreliable access of cold data.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: the reading and writing method and the terminal are provided, energy and power are saved in cold storage, and meanwhile reliable access of data is guaranteed.
In order to solve the technical problems, the invention adopts a technical scheme that:
a method of reading and writing comprising the steps of:
dividing the cold data disk into a front-end disk group and a rear-end disk group, wherein the front-end disk group is set to be in a power-on state, and the rear-end disk group is set to be in a power-off state;
receiving a file writing request, and extracting key information of the file;
acquiring file characteristics of the file according to the key information, analyzing the file characteristics, and selecting a matched front-end disk;
and writing the file into the front-end disk, and storing the file name, the storage path and the corresponding key information of the file to a key information server.
In order to solve the technical problem, the invention adopts another technical scheme as follows:
a read-write terminal 1 comprising a memory 2, a processor 3 and a computer program stored on the memory 2 and executable on the processor 3, said processor 3 implementing the following steps when executing said program:
dividing the cold data disk into a front-end disk group and a rear-end disk group, wherein the front-end disk group is set to be in a power-on state, and the rear-end disk group is set to be in a power-off state;
receiving a file writing request, and extracting key information of the file;
acquiring file characteristics of the file according to the key information, analyzing the file characteristics, and selecting a matched front-end disk;
and writing the file into the front-end disk, and storing the file name, the storage path and the corresponding key information of the file to a key information server.
The invention has the beneficial effects that: the cold data disk is divided into a front disk set and a rear disk set, the front disk set and the rear disk set are respectively set to be in a power-on state and a power-off state, a matched front disk is selected according to file characteristics, key information of files is stored in a key information server, the efficient utilization and the energy saving of the disks are realized, simultaneously, files with the same file characteristics are read and written in a gathering mode, when writing operation is executed, the same group of disks are written in a gathering mode, therefore, when data are read, the data with the same file characteristics are often accessed in a gathering mode, the number of the opened disks can be reduced, the damage rate of the disks is effectively reduced, and as the key information of the files is stored in the key information server, when the disks of the cold storage server are closed and cannot be accessed, basic information of the files can be inquired from the key information server, and the problems of file loss or error report of a file system caused by the closing of the disks of the cold storage server are solved, thereby ensuring access reliability of cold data.
Drawings
FIG. 1 is a flow chart of a read/write method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a read/write terminal according to an embodiment of the present invention;
description of reference numerals:
1. a read-write terminal; 2. a memory; 3. a processor.
Detailed Description
In order to explain technical contents, achieved objects, and effects of the present invention in detail, the following description is made with reference to the accompanying drawings in combination with the embodiments.
The most key concept of the invention is as follows: the cold data disk is divided into a front disk set and a rear disk set, the front disk set and the rear disk set are respectively set to be in a power-on state and a power-off state, the matched front end disk is selected according to the file characteristics, and the key information of the file is stored in a key information server.
Referring to fig. 1, a read/write method includes the steps of:
dividing the cold data disk into a front-end disk group and a rear-end disk group, wherein the front-end disk group is set to be in a power-on state, and the rear-end disk group is set to be in a power-off state;
receiving a file writing request, and extracting key information of the file;
acquiring file characteristics of the file according to the key information, analyzing the file characteristics, and selecting a matched front-end disk;
and writing the file into the front-end disk, and storing the file name, the storage path and the corresponding key information of the file to a key information server.
From the above description, the beneficial effects of the present invention are: the cold data disk is divided into a front disk set and a rear disk set, the front disk set and the rear disk set are respectively set to be in a power-on state and a power-off state, a matched front disk is selected according to file characteristics, key information of files is stored in a key information server, the efficient utilization and the energy saving of the disks are realized, simultaneously, files with the same file characteristics are read and written in a gathering mode, when writing operation is executed, the same group of disks are written in a gathering mode, therefore, when data are read, the data with the same file characteristics are often accessed in a gathering mode, the number of the opened disks can be reduced, the damage rate of the disks is effectively reduced, and as the key information of the files is stored in the key information server, when the disks of the cold storage server are closed and cannot be accessed, basic information of the files can be inquired from the key information server, and the problems of file loss or error report of a file system caused by the closing of the disks of the cold storage server are solved, thereby ensuring access reliability of cold data.
Further, the analyzing the file features and selecting a matched front-end disk specifically includes:
searching whether a second file characteristic identical to the file characteristic exists in key information with a front-end disk as a storage path in a key information server, and if so, selecting the front-end disk where a file corresponding to the second file characteristic is located as a matched front-end disk; otherwise, randomly selecting a front-end disk from the front-end disk group as a matched front-end disk.
According to the description, the disk where the stored file with the same file characteristics as the file to be written is located is preferentially selected as the matching disk of the file to be written, so that the aggregated writing of the file is realized, and thus, when data is read, the data with the same characteristics is often accessed in a centralized manner, the number of opened disks can be reduced, and the damage rate of the disks can be effectively reduced.
Further, the method also comprises the following steps:
and monitoring the disk space use condition and the disk read-write state of the front-end disk group in real time, and if the disk space of the front-end disk group reaches a rated threshold or no read request exists within a preset time period, electrifying the rear-end disk group, electrifying the front-end disk group, and mutually converting the front-end disk group and the rear-end disk group.
From the above description, the automatic switching of the front and rear disk groups is realized by setting certain conditions, and the purposes of efficient utilization of the disks and energy conservation are realized.
Further, the method also comprises the following steps:
receiving a file reading request, and inquiring key information of the file in a key information server according to a file name;
and sending the key information.
It can be known from the above description that, since the key information of the file is stored in the key information server, when the disk of the cold storage server is closed and cannot be accessed, the basic information of the file can be queried from the key information server, and the problems of file loss or file system error report of the cold storage server caused by disk closing are solved.
Further, the method also comprises the following steps:
receiving a file reading request, and inquiring a storage path of the file in a key information server according to a file name;
and judging whether the file is stored in a front-end disk group or a rear-end disk group according to the storage path, if the file is stored in the front-end disk group, reading the file according to the storage path, if the file is stored in the rear-end disk group, electrifying the front-end disk group, mutually converting the front-end disk group and the rear-end disk group, and reading the file according to the storage path.
From the above description, when the cold storage server disk normally works, when a file reading request is received, if the read file is stored in the back-end disk group, the front-end disk group and the back-end disk group are automatically switched, and the purposes of efficient utilization and energy saving of the disk are achieved.
Referring to fig. 2, a read/write terminal 1 includes a memory 2, a processor 3, and a computer program stored in the memory 2 and capable of running on the processor 3, where the processor 3 implements the following steps when executing the program:
dividing the cold data disk into a front-end disk group and a rear-end disk group, wherein the front-end disk group is set to be in a power-on state, and the rear-end disk group is set to be in a power-off state;
receiving a file writing request, and extracting key information of the file;
acquiring file characteristics of the file according to the key information, analyzing the file characteristics, and selecting a matched front-end disk;
and writing the file into the front-end disk, and storing the file name, the storage path and the corresponding key information of the file to a key information server.
From the above description, the beneficial effects of the present invention are: the cold data disk is divided into a front disk set and a rear disk set, the front disk set and the rear disk set are respectively set to be in a power-on state and a power-off state, a matched front disk is selected according to file characteristics, key information of files is stored in a key information server, the efficient utilization and the energy saving of the disks are realized, simultaneously, files with the same file characteristics are read and written in a gathering mode, when writing operation is executed, the same group of disks are written in a gathering mode, therefore, when data are read, the data with the same file characteristics are often accessed in a gathering mode, the number of the opened disks can be reduced, the damage rate of the disks is effectively reduced, and as the key information of the files is stored in the key information server, when the disks of the cold storage server are closed and cannot be accessed, basic information of the files can be inquired from the key information server, and the problems of file loss or error report of a file system caused by the closing of the disks of the cold storage server are solved, thereby ensuring access reliability of cold data.
Further, the analyzing the file features and selecting a matched front-end disk specifically includes:
searching whether a second file characteristic identical to the file characteristic exists in key information with a front-end disk as a storage path in a key information server, and if so, selecting the front-end disk where a file corresponding to the second file characteristic is located as a matched front-end disk; otherwise, randomly selecting a front-end disk from the front-end disk group as a matched front-end disk.
According to the description, the disk where the stored file with the same file characteristics as the file to be written is located is preferentially selected as the matching disk of the file to be written, so that the aggregated writing of the file is realized, and thus, when data is read, the data with the same characteristics is often accessed in a centralized manner, the number of opened disks can be reduced, and the damage rate of the disks can be effectively reduced.
Further, the method also comprises the following steps:
and monitoring the disk space use condition and the disk read-write state of the front-end disk group in real time, and if the disk space of the front-end disk group reaches a rated threshold or no read request exists within a preset time period, electrifying the rear-end disk group, electrifying the front-end disk group, and mutually converting the front-end disk group and the rear-end disk group.
From the above description, the automatic switching of the front and rear disk groups is realized by setting certain conditions, and the purposes of efficient utilization of the disks and energy conservation are realized.
Further, the method also comprises the following steps:
receiving a file reading request, and inquiring key information of the file in a key information server according to a file name;
and sending the key information.
It can be known from the above description that, since the key information of the file is stored in the key information server, when the disk of the cold storage server is closed and cannot be accessed, the basic information of the file can be queried from the key information server, and the problems of file loss or file system error report of the cold storage server caused by disk closing are solved.
Further, the method also comprises the following steps:
receiving a file reading request, and inquiring a storage path of the file in a key information server according to a file name;
and judging whether the file is stored in a front-end disk group or a rear-end disk group according to the storage path, if the file is stored in the front-end disk group, reading the file according to the storage path, if the file is stored in the rear-end disk group, electrifying the front-end disk group, mutually converting the front-end disk group and the rear-end disk group, and reading the file according to the storage path.
From the above description, when the cold storage server disk normally works, when a file reading request is received, if the read file is stored in the back-end disk group, the front-end disk group and the back-end disk group are automatically switched, and the purposes of efficient utilization and energy saving of the disk are achieved.
Example one
Referring to fig. 1, a read/write method includes the steps of:
dividing the cold data disk into a front-end disk group and a rear-end disk group, wherein the front-end disk group is set to be in a power-on state, and the rear-end disk group is set to be in a power-off state;
when the system runs, the front end disk group and the rear end disk group are configured in advance, when the system is started, the front end disk group is started by default, the rear end disk group is not started temporarily, and after the front end disk group is fully written, the rear end disk group is started as required;
the front-end disk group is used for directly interacting with user services and is in a power-on state, and the rear-end disk group is used for storing user data and is in a power-off state; when the front-end disk group reaches a full-writing state or data is not accessed by people, the front-end disk group is automatically changed into a rear-end disk group and is in an electrifying state, and correspondingly, the rear-end disk group is automatically changed into a front-end disk group and is in an electrifying state; when the rear-end disk group has a data reading requirement, the front-end disk group is automatically changed into the front-end disk group and is in a power-on state, and correspondingly, the front-end disk group is automatically changed into the rear-end disk group and is in a power-off state;
particularly, a background monitoring process can be set to monitor the disk space use condition and the disk read-write state of the front-end disk group in real time, if the disk space of the front-end disk group reaches a rated threshold or no read request exists within a preset time period, the rear-end disk group is electrified, the front-end disk group is electrified, and the front-end disk group and the rear-end disk group are mutually converted;
receiving a file writing request, and extracting key information of the file;
the key information comprises information such as file characteristics, file size, generation time and the like;
acquiring file characteristics of the file according to the key information, analyzing the file characteristics, and selecting a matched front-end disk;
the file characteristics comprise the service type of the file, the data type of the file, the generation time period of the file and the like;
the analyzing the file characteristics and selecting the matched front-end disk specifically comprises:
searching whether a second file characteristic identical to the file characteristic exists in key information with a front-end disk as a storage path in a key information server, and if so, selecting the front-end disk where a file corresponding to the second file characteristic is located as a matched front-end disk; otherwise, randomly selecting a front-end disk from the front-end disk group as a matched front-end disk;
and writing the file into the front-end disk, and storing the file name, the storage path and the corresponding key information of the file to a key information server.
The key information server is a server different from a cold storage server for storing cold data, so that when a disk in the cold storage server is closed and cannot be accessed, basic information of a file can be inquired from the key information server.
Example two
A read-write method, which corresponds to the situation when data is read from a cold storage server and a disk in the cold storage server is closed and cannot be accessed, comprises the following steps:
receiving a file reading request, and inquiring key information of the file in a key information server according to a file name;
sending the key information;
at this time, since the disk in the cold storage server is closed and cannot be accessed, the key information corresponding to the file to be read, which is stored in the key information server, can be sent to the user, so that the user can inquire the basic information of the file from the key information server.
EXAMPLE III
A read-write method, corresponding to a case where a disk in a cold storage server is normally available when data is to be read from the cold storage server, comprising the steps of:
receiving a file reading request, and inquiring a storage path of the file in a key information server according to a file name;
and judging whether the file is stored in a front-end disk group or a rear-end disk group according to the storage path, if the file is stored in the front-end disk group, reading the file according to the storage path, if the file is stored in the rear-end disk group, electrifying the front-end disk group, mutually converting the front-end disk group and the rear-end disk group, and reading the file according to the storage path.
Example four
A read-write terminal 1, comprising a memory 2, a processor 3 and a computer program stored in the memory 2 and operable on the processor 3, wherein the processor 3 implements the steps of the first embodiment when executing the program.
EXAMPLE five
A read-write terminal 1 comprises a memory 2, a processor 3 and a computer program which is stored on the memory 3 and can run on the processor 2, and the steps of the second embodiment are realized when the processor 3 executes the program.
EXAMPLE six
A read-write terminal 1, comprising a memory 2, a processor 3 and a computer program stored in the memory 2 and operable on the processor 3, wherein the processor 3 implements the steps of the third embodiment when executing the program.
To sum up, the read-write method and the terminal provided by the present invention divide a cold data disk into a front disk set and a rear disk set, respectively set the front and rear disk sets as a power-on state and a power-off state, select a matched front disk according to file characteristics, and store key information of a file to a key information server, so as to perform aggregation read-write on files with the same file characteristics while achieving efficient utilization and energy saving of the disks, and perform aggregation write-in on the same group of disks when performing write-in operation, so that data with the same file characteristics are often accessed in a centralized manner when data is read, so as to reduce the number of disks that are opened and frequent opening of the disks, effectively reduce the damage rate of the disks, and since the key information of the files is stored in the key information server, when the cold storage server disk is closed and cannot be accessed, the basic information of the files can be queried from the key information server, the problem of file loss or file system error reporting caused by closing of the disk for the cold storage server is solved, and therefore access reliability of cold data is guaranteed.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent changes made by using the contents of the present specification and the drawings, or applied directly or indirectly to the related technical fields, are included in the scope of the present invention.
Claims (8)
1. A method of reading and writing, comprising the steps of:
dividing a cold data disk into a front-end disk group and a rear-end disk group, wherein the disks in the disk groups are fixed, the front-end disk group is set to be in a power-on state, and the rear-end disk group is set to be in a power-off state;
receiving a file writing request, and extracting key information of the file;
acquiring file characteristics of the file according to the key information, analyzing the file characteristics, and selecting a matched front-end disk, wherein the matched front-end disk stores the file with the file characteristics;
and writing the file into the front-end disk, and storing the file name, the storage path and the corresponding key information of the file to a key information server.
2. Read-write method according to claim 1,
the analyzing the file characteristics and selecting a matched front-end disk, wherein the storing of the file with the file characteristics in the matched front-end disk specifically comprises:
searching whether a second file characteristic identical to the file characteristic exists in key information with a front-end disk as a storage path in a key information server, and if so, selecting the front-end disk where a file corresponding to the second file characteristic is located as a matched front-end disk; otherwise, randomly selecting a front-end disk from the front-end disk group as a matched front-end disk.
3. A read-write method according to claim 1, further comprising the steps of:
and monitoring the disk space use condition and the disk read-write state of the front-end disk group in real time, and if the disk space of the front-end disk group reaches a rated threshold or no read request exists within a preset time period, electrifying the rear-end disk group, electrifying the front-end disk group, and mutually converting the front-end disk group and the rear-end disk group.
4. A read-write method according to claim 1, further comprising the steps of:
receiving a file reading request, and inquiring a storage path of the file in a key information server according to a file name;
and judging whether the file is stored in a front-end disk group or a rear-end disk group according to the storage path, if the file is stored in the front-end disk group, reading the file according to the storage path, if the file is stored in the rear-end disk group, electrifying the front-end disk group, mutually converting the front-end disk group and the rear-end disk group, and reading the file according to the storage path.
5. A read-write terminal comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the following steps when executing the program:
dividing a cold data disk into a front-end disk group and a rear-end disk group, wherein the disks in the disk groups are fixed, the front-end disk group is set to be in a power-on state, and the rear-end disk group is set to be in a power-off state;
receiving a file writing request, and extracting key information of the file;
acquiring file characteristics of the file according to the key information, analyzing the file characteristics, and selecting a matched front-end disk, wherein the matched front-end disk stores the file with the file characteristics;
and writing the file into the front-end disk, and storing the file name, the storage path and the corresponding key information of the file to a key information server.
6. Read-write terminal according to claim 5,
the analyzing the file characteristics and selecting a matched front-end disk, wherein the storing of the file with the file characteristics in the matched front-end disk specifically comprises:
searching whether a second file characteristic identical to the file characteristic exists in key information with a front-end disk as a storage path in a key information server, and if so, selecting the front-end disk where a file corresponding to the second file characteristic is located as a matched front-end disk; otherwise, randomly selecting a front-end disk from the front-end disk group as a matched front-end disk.
7. The read-write terminal according to claim 5, characterized by further comprising the steps of:
and monitoring the disk space use condition and the disk read-write state of the front-end disk group in real time, and if the disk space of the front-end disk group reaches a rated threshold or no read request exists within a preset time period, electrifying the rear-end disk group, electrifying the front-end disk group, and mutually converting the front-end disk group and the rear-end disk group.
8. The read-write terminal according to claim 5, characterized by further comprising the steps of:
receiving a file reading request, and inquiring a storage path of the file in a key information server according to a file name;
and judging whether the file is stored in a front-end disk group or a rear-end disk group according to the storage path, if the file is stored in the front-end disk group, reading the file according to the storage path, if the file is stored in the rear-end disk group, electrifying the front-end disk group, mutually converting the front-end disk group and the rear-end disk group, and reading the file according to the storage path.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811382357.5A CN109683810B (en) | 2017-08-15 | 2017-08-15 | Read-write method and terminal |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811382357.5A CN109683810B (en) | 2017-08-15 | 2017-08-15 | Read-write method and terminal |
| CN201710695573.4A CN107436826B (en) | 2017-08-15 | 2017-08-15 | A kind of cold data processing method and terminal |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710695573.4A Division CN107436826B (en) | 2017-08-15 | 2017-08-15 | A kind of cold data processing method and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109683810A CN109683810A (en) | 2019-04-26 |
| CN109683810B true CN109683810B (en) | 2022-02-18 |
Family
ID=60461031
Family Applications (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811382082.5A Active CN109739340B (en) | 2017-08-15 | 2017-08-15 | Energy-saving and power-saving data processing method and terminal |
| CN201811382357.5A Active CN109683810B (en) | 2017-08-15 | 2017-08-15 | Read-write method and terminal |
| CN201710695573.4A Active CN107436826B (en) | 2017-08-15 | 2017-08-15 | A kind of cold data processing method and terminal |
| CN201811382360.7A Active CN109669811B (en) | 2017-08-15 | 2017-08-15 | Data processing method and terminal capable of reliable access |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811382082.5A Active CN109739340B (en) | 2017-08-15 | 2017-08-15 | Energy-saving and power-saving data processing method and terminal |
Family Applications After (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710695573.4A Active CN107436826B (en) | 2017-08-15 | 2017-08-15 | A kind of cold data processing method and terminal |
| CN201811382360.7A Active CN109669811B (en) | 2017-08-15 | 2017-08-15 | Data processing method and terminal capable of reliable access |
Country Status (1)
| Country | Link |
|---|---|
| CN (4) | CN109739340B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112015342B (en) * | 2020-08-27 | 2023-08-18 | 优刻得科技股份有限公司 | IO scheduling system and scheduling method and corresponding electronic equipment |
| CN117234435B (en) * | 2023-11-14 | 2024-02-20 | 苏州元脑智能科技有限公司 | File storage method and device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006032197A1 (en) * | 2004-09-20 | 2006-03-30 | Shoukui Liu | A module of architecture engineering modeling and system and method thereof |
| CN101079902A (en) * | 2007-06-29 | 2007-11-28 | 清华大学 | A great magnitude of data hierarchical storage method |
| CN106293492A (en) * | 2015-05-14 | 2017-01-04 | 中兴通讯股份有限公司 | A kind of memory management method and distributed file system |
Family Cites Families (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6446199B1 (en) * | 1995-06-06 | 2002-09-03 | International Business Machines Corporation | Disk drive incompatible firmware recovery |
| DE19882723T1 (en) * | 1997-10-08 | 2000-09-21 | Seagate Technology | Hybrid data storage and reconstruction system and method for a data storage device |
| CN1582420A (en) * | 2001-10-29 | 2005-02-16 | 西加特技术有限责任公司 | System and method for protecting a peripheral device against hot plug attacks |
| US7330931B2 (en) * | 2003-06-26 | 2008-02-12 | Copan Systems, Inc. | Method and system for accessing auxiliary data in power-efficient high-capacity scalable storage system |
| CN101551804A (en) * | 2008-03-31 | 2009-10-07 | 联想(北京)有限公司 | Computer and file processing method used in same |
| KR101465099B1 (en) * | 2008-09-11 | 2014-11-25 | 시게이트 테크놀로지 엘엘씨 | A hybrid hard disk drive for reading files having specified conditions rapidly, and a control method adapted to the same, a recording medium adapted to the same |
| EP2164007A1 (en) * | 2008-09-11 | 2010-03-17 | Neutrino Concepts Ltd. | Data storage and fusion layer |
| EP2196895A1 (en) * | 2008-12-09 | 2010-06-16 | Thomson Licensing | System for storing and/or retrieving a data-set and method thereof |
| CN101441668B (en) * | 2008-12-31 | 2011-09-21 | 中兴通讯股份有限公司 | Method and apparatus of multiple-magnetic disk packet heat standby in distributed file system |
| CN101854378B (en) * | 2010-02-26 | 2013-02-13 | 深圳市龙视传媒有限公司 | Data operating method and data operating equipment |
| CN102014150B (en) * | 2010-09-29 | 2013-12-11 | 厦门市美亚柏科信息股份有限公司 | Distributed small file storage system based on UDP (User Datagram Protocol) and data processing method thereof |
| JP5846006B2 (en) * | 2012-03-29 | 2016-01-20 | 富士通株式会社 | Program, code generation method, and information processing apparatus |
| CN103488578B (en) * | 2012-12-28 | 2016-05-25 | 晶天电子（深圳）有限公司 | Virtual memory facilities (VMD) application/driver |
| CN103399806A (en) * | 2013-07-26 | 2013-11-20 | 安徽省徽商集团有限公司 | Method and system for updating and managing network backups |
| CN103718151B (en) * | 2013-08-09 | 2015-06-10 | 华为技术有限公司 | Document processing method and storage device |
| CN103442070A (en) * | 2013-08-30 | 2013-12-11 | 华南理工大学 | Private cloud storage resource allocation method based on statistical prediction |
| US9720623B2 (en) * | 2013-12-30 | 2017-08-01 | Teradata Us, Inc. | Management of data in multi-storage systems that can include non-volatile and volatile storages |
| CN104598568A (en) * | 2015-01-12 | 2015-05-06 | 浪潮电子信息产业股份有限公司 | High-efficiency and low-power-consumption offline storage system and method |
| CN104991747A (en) * | 2015-07-30 | 2015-10-21 | 湖南亿谷科技发展股份有限公司 | Method and system for data management |
| CN105389129A (en) * | 2015-11-11 | 2016-03-09 | 北京汉柏科技有限公司 | Virtual cloud disk implementation method in cloud computing system |
| CN106959826A (en) * | 2017-03-28 | 2017-07-18 | 联想(北京)有限公司 | A kind of data-storage system and method |
-
2017
- 2017-08-15 CN CN201811382082.5A patent/CN109739340B/en active Active
- 2017-08-15 CN CN201811382357.5A patent/CN109683810B/en active Active
- 2017-08-15 CN CN201710695573.4A patent/CN107436826B/en active Active
- 2017-08-15 CN CN201811382360.7A patent/CN109669811B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006032197A1 (en) * | 2004-09-20 | 2006-03-30 | Shoukui Liu | A module of architecture engineering modeling and system and method thereof |
| CN101079902A (en) * | 2007-06-29 | 2007-11-28 | 清华大学 | A great magnitude of data hierarchical storage method |
| CN106293492A (en) * | 2015-05-14 | 2017-01-04 | 中兴通讯股份有限公司 | A kind of memory management method and distributed file system |
Non-Patent Citations (1)
| Title |
|---|
| 超大容量NAND FLASH坏区管理方法的设计与实现;文D等;《现代电子技术》;20070815(第16期);55-57 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109683810A (en) | 2019-04-26 |
| CN109739340B (en) | 2021-04-13 |
| CN107436826A (en) | 2017-12-05 |
| CN109669811A (en) | 2019-04-23 |
| CN109739340A (en) | 2019-05-10 |
| CN107436826B (en) | 2018-12-18 |
| CN109669811B (en) | 2021-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11741053B2 (en) | Data management system, method, terminal and medium based on hybrid storage | |
| CN102340530B (en) | The method and system of a kind of memory space adapter and Data Migration | |
| US9996557B2 (en) | Database storage system based on optical disk and method using the system | |
| US20070143559A1 (en) | Apparatus, system and method incorporating virtualization for data storage | |
| CN101673192B (en) | Method for time-sequence data processing, device and system therefor | |
| CN103226965B (en) | Based on the audio/video data access method of time bitmap | |
| CN102158349A (en) | Log management device and method thereof | |
| CN102158550B (en) | IEC61850-based power quality transient data transmission method | |
| CN101582076A (en) | Data de-duplication method based on data base | |
| CN101464908A (en) | Log recording method and device | |
| WO2023185111A1 (en) | Quick access method and device for data file | |
| WO2012083754A1 (en) | Method and device for processing dirty data | |
| CN108089825B (en) | Storage system based on distributed cluster | |
| CN109683810B (en) | Read-write method and terminal | |
| CN1971533A (en) | Displaying method of memory information in data storage device | |
| CN101707633A (en) | Message-oriented middleware persistent message storing method based on file system | |
| CN110727406A (en) | Data storage scheduling method and device | |
| CN1996305A (en) | Data saving and reading method and device therefore, and data transmission system | |
| CN102929935B (en) | A kind of Large Volume Data reading/writing method based on affairs | |
| CN108304142A (en) | A kind of data managing method and device | |
| CN109189724B (en) | Method and device for improving audio and video data storage efficiency of video monitoring system | |
| CN110851318A (en) | Serial port log collection method, system and equipment under server management system | |
| CN103207916A (en) | Metadata processing method and device | |
| CN105068757A (en) | File semantics and system real-time state based redundant data deduplication method | |
| CN105847329B (en) | Management equipment and method based on stock data server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |