CN108089814A - A kind of date storage method and device - Google Patents
A kind of date storage method and device Download PDFInfo
- Publication number
- CN108089814A CN108089814A CN201611038740.XA CN201611038740A CN108089814A CN 108089814 A CN108089814 A CN 108089814A CN 201611038740 A CN201611038740 A CN 201611038740A CN 108089814 A CN108089814 A CN 108089814A
- Authority
- CN
- China
- Prior art keywords
- memory
- data
- utilization rate
- space utilization
- memory set
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a kind of date storage method, the described method includes：Obtain the flow value of pending data；Based on the flow value and default selection strategy, determine target memory and store the pending data into the target memory；Wherein, the target memory includes a memory in first memory set or second memory set；When predetermined period arrives, the space utilization rate of the first memory set and the space utilization rate of the second memory set are obtained；According to the space utilization rate of the first memory set and the space utilization rate of the second memory set, it is determined whether migrate the data in the first memory set into the second memory set.The embodiment of the present invention also discloses a kind of data storage device simultaneously.
Description
Technical field
The present invention relates to the cloud storage technology in field of cloud calculation more particularly to a kind of date storage methods and device.
Background technology
With the rapid development of cloud computing, cloud storage technology is increasingly prominent to the importance of people's Working Life.For cloud
Storage system, writing speed are a key factors for influencing its performance.In data writing process, the storage of data is situated between
Matter limits the raising of cloud storage system writing speed.Numerous cloud storage providers are in the storage server of cloud storage system
In provide and a kind of use that writing speed is fast, memory capacity is small, expensive storage medium such as solid-state hard drive simultaneously
(Solid State Drive, SSD) and the storage medium that memory capacity is big, writing speed is slow, cheap, such as hard disk drive
The storage scheme of dynamic device (Hard Disk Drive, HDD).In existing cloud storage system, mainly by will need storage data
It is compressed after processing transmission or the data that need to store is subjected to the technologies such as transmission after piecemeal processing and improve the write-in of data
Speed is loaded by monitoring the loading condition of each memory node come balanced storage system.
But in prior art, the raising of writing speed is only considered when data write, does not account for depositing
The problem of storage media memory space load imbalance；Or load balancing between storage medium memory space is only considered, do not have
There is the writing speed for considering data, it is impossible to while the load taken into account between writing speed and storage medium memory space is equal
Weighing apparatus.
The content of the invention
To solve problems of the prior art, the embodiment of the present invention provides a kind of date storage method and device, solution
It has determined the problem of cannot taking into account writing speed and storage medium memory space load balancing simultaneously in the prior art, by not
With storage medium storage data when writing speed it is different the characteristics of realize the optimization of writing speed, and ensure that storage
The balanced use in space.
In order to achieve the above objectives, the technical solution of the embodiment of the present invention is realized in：
A kind of date storage method, the described method includes：
Obtain the flow value of pending data；
Based on the flow value and default selection strategy, determine target memory and store the pending data to described
In target memory；Wherein, the target memory includes one in first memory set or second memory set
Memory；
When predetermined period arrives, the space utilization rate of the first memory set and the second memory collection are obtained
The space utilization rate of conjunction；
According to the space utilization rate of the first memory set and the space utilization rate of the second memory set, really
The fixed data whether migrated in the first memory set are into the second memory set.
Optionally, it is described based on the flow value and default selection strategy, it determines target memory and stores the upload
Data into the target memory, including：
Selection any memory from the first memory set and the second memory set obtains first and deposits
Reservoir；
Obtain the select probability of first memory；
Referential data is obtained based on default selection rule, the selection of the referential data and the first memory is general
The magnitude relationship of rate；
If the referential data is less than or equal to the select probability of the first memory, the first memory is selected
For the target memory, and the upload data are stored to the target memory.
Optionally, the method further includes：
If the referential data is more than the select probability of the first memory, perform described from the first memory collection
Selection any memory in conjunction and the second memory set, obtains first memory, until redefining the target
Memory.
Optionally, the select probability for obtaining first memory, including：
Obtain the writing speed of the first memory and space utilization rate；
Obtain the sum of memory in the first memory set and the second memory set；
Writing speed, described total and the first memory based on the flow value, the first memory
Space utilization rate using default selection strategy be calculated the select probability of the first memory.
Optionally, it is described according to the space utilization rate of the first memory set and the sky of the second memory set
Between utilization rate, it is determined whether migrate the data in the first memory set into the second memory set, including：
Judge the space utilization rate of each memory and the magnitude relationship of first threshold in the first memory set；
If in the first memory set there are space utilization rate be more than or equal to the first threshold memory,
The identification information that space utilization rate in the first memory set is more than or equal to the memory of the first threshold is counted,
Obtain first flag information aggregate；
Judge the space utilization rate of memory and the magnitude relationship of second threshold in the second memory set；
If there are the memory that space utilization rate is less than the second threshold in the second memory set, described in statistics
Space utilization rate is less than the identification information of the memory of the second threshold in second memory set, obtains the second identifier
Information aggregate；
Based on the first flag information aggregate and the second identifier information aggregate, according to Data Migration rule migration institute
The data in the corresponding memory of first flag information aggregate are stated into the corresponding memory of the second identifier information aggregate.
Optionally, it is described based on the first flag information aggregate and the second identifier information aggregate, it is moved according to data
Data to the second identifier information aggregate that rule is migrated in the corresponding memory of the first flag information aggregate is moved to correspond to
Memory in, including：
The memory of communication interface free time in the corresponding memory of the first flag information aggregate is obtained, is moved according to data
It moves rule and determines the data packet that the memory of the first flag information aggregate corresponding communication interface free time need to migrate；
The memory of the second identifier information aggregate corresponding communication interface free time is obtained, and migrates the first flag
Data packet to the second identifier information aggregate of migration is needed to correspond in the memory of information aggregate corresponding communication interface free time
The communication interface free time memory in.
Optionally, the first memory set is SSD memory set, and the second memory set is HDD storages
Device set.
A kind of data storage device, described device include：First acquisition unit, first processing units, second acquisition unit
With second processing unit；Wherein：
The first acquisition unit, for obtaining the flow value of pending data；
The first processing units, for being based on the flow value and default selection strategy, determining target memory and depositing
The upload data are stored up into the target memory；Wherein, the target memory includes first memory set or the
A memory in two memory set；
The second acquisition unit, the space for when predetermined period arrives, obtaining the first memory set make
With rate and the space utilization rate of the second memory set；
The second processing unit, for the space utilization rate according to the first memory set and second storage
The space utilization rate of device set, it is determined whether migrate data in the first memory set to the second memory set
In.
Optionally, the first processing units include：First processing module, the first acquisition module, Second processing module and
3rd processing module；Wherein：
The first processing module, for from the selection in the first memory set and the second memory set
Any memory obtains first memory；
First acquisition module, for obtaining the select probability of first memory；
The Second processing module obtains referential data for being based on default selection rule, the referential data with
The magnitude relationship of the select probability of the first memory；
3rd processing module, if the selection for being less than or equal to the first memory for the referential data is general
Rate selects the first memory as the target memory, and stores the upload data to the target memory.
Optionally, the first processing units further include：Fourth processing module；Wherein：
The fourth processing module if being more than the select probability of the first memory for the referential data, performs
The selection any memory from the first memory set and the second memory set obtains the first storage
Device, until redefining the target memory.
Optionally, first acquisition module, is specifically used for：
Obtain the writing speed of the first memory and space utilization rate；
Obtain the sum of memory in the first memory set and the second memory set；
Writing speed, described total and the first memory based on the flow value, the first memory
Space utilization rate using default selection strategy be calculated the select probability of the first memory.
Optionally, the second processing unit, including：Judgment module, the 5th processing module and transferring module；Wherein：
The judgment module, for judging the space utilization rate of each memory in the first memory set and the
The magnitude relationship of one threshold value；
5th processing module, if to be more than or equal to for there are space utilization rates in the first memory set
The memory of the first threshold counts space utilization rate in the first memory set and is more than or equal to first threshold
The identification information of the memory of value obtains first flag information aggregate；
The judgment module is additionally operable to judge the space utilization rate and second of the memory in the second memory set
The magnitude relationship of threshold value；
5th processing module, if being additionally operable in the second memory set, there are space utilization rates to be less than described the
The memory of two threshold values counts the mark that space utilization rate in the second memory set is less than the memory of the second threshold
Know information, obtain the second identifier information aggregate；
The transferring module, for being based on the first flag information aggregate and the second identifier information aggregate, according to
Data Migration rule migrates data in the corresponding memory of the first flag information aggregate to the second identifier information collection
It closes in corresponding memory.
Optionally, the transferring module, is specifically used for：
The memory of communication interface free time in the corresponding memory of the first flag information aggregate is obtained, is moved according to data
It moves rule and determines the data packet that the memory of the first flag information aggregate corresponding communication interface free time need to migrate；
The memory of the second identifier information aggregate corresponding communication interface free time is obtained, and migrates the first flag
Data packet to the second identifier information aggregate of migration is needed to correspond in the memory of information aggregate corresponding communication interface free time
The communication interface free time memory in.
The date storage method and device that the embodiment of the present invention provides, by obtaining the flow value of pending data, and
Based on flow value and default selection strategy, determine target memory and store pending data to target memory, then when pre-
If the cycle arrives, the space utilization rate of first memory set and the space utilization rate of second memory set are obtained, finally
According to the space utilization rate of first memory set and the space utilization rate of second memory set, it is determined whether migration first is deposited
In data value second memory set in reservoir set；In this way, determine that target stores by flow value and default selection strategy
Device optimizes the writing speed in pending data write-in target memory, and when the data volume stored in SSD memory surpasses
When crossing threshold value, by the HDD memories of the Data Migration in SSD memory to extendible capacity, obtain the memory space of SSD memory
It is used to equilibrium, writing speed and storage medium memory space load balancing cannot be taken into account simultaneously in the prior art by solving
The problem of, realized by writing speed during the storage data of different storage mediums the characteristics of different data writing speed it is excellent
Change, and ensure that the balanced use of memory space.
Description of the drawings
Fig. 1 is a kind of flow diagram of date storage method provided in an embodiment of the present invention；
Fig. 2 is the flow diagram of another date storage method provided in an embodiment of the present invention；
Fig. 3 is the flow diagram of another date storage method provided in an embodiment of the present invention；
Fig. 4 is a kind of data storage system architecture schematic diagram provided in an embodiment of the present invention；
Fig. 5 is a kind of structure diagram of data storage device provided in an embodiment of the present invention；
Fig. 6 is the structure diagram of another data storage device provided in an embodiment of the present invention；
Fig. 7 is the structure diagram of another data storage device provided in an embodiment of the present invention；
Fig. 8 is a kind of structure diagram for data storage device that another embodiment of the present invention provides；
Fig. 9 is a kind of Data Migration flow system figure provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes.
The embodiment of the present invention provides a kind of date storage method, and with reference to shown in Fig. 1, this method comprises the following steps：
Step 101, the flow value for obtaining pending data.
Specifically, the flow value that step 101 obtains pending data can be realized by data storage device.Pending number
According to can be user be uploaded to needed in cloud storage system storage data；The flow value of pending data can be that user is uploaded to
The uninterrupted value of the data of storage is needed in cloud storage system.Data storage device can be cloud storage system.
Step 102, based on flow value and default selection strategy, determine target memory and store pending data to target
In memory.
Wherein, target memory includes a memory in first memory set or second memory set.
Specifically, step 102 is based on flow value and default selection strategy, determines target memory and store pending data
It can be realized into target memory by data storage device.Default selection strategy can be for determining target memory
A kind of method, the default selection strategy can have the characteristics that：The space utilization rate of memory is bigger, what memory was selected
Probability is smaller；Flow value is bigger, and the writing speed of memory is faster, then the probability that memory is selected is bigger；Flow value is smaller,
The writing speed of memory is slow, then the probability that memory is selected is bigger.Wherein, first memory set can be SSD storages
Device set, second memory set can be HDD memory set.
Step 103, when predetermined period arrives, obtain the space utilization rate of first memory set and second memory collection
The space utilization rate of conjunction.
Specifically, step 103, when predetermined period arrives, the space utilization rate and second for obtaining first memory set is deposited
The space utilization rate of reservoir set can be realized by data storage device.Data storage device can be obtained every predetermined period
The space utilization rate of first memory set and second memory set, and to first memory set and second memory set
Space utilization rate recorded.Such as predetermined period can be 1 minute or 5 minutes, can also be carried out according to user demand
It sets.
Step 104, according to the space utilization rate of first memory set and the space utilization rate of second memory set, really
The fixed data whether migrated in first memory set are into second memory set.
Specifically, step 104 makes according to the space utilization rate of first memory set and the space of second memory set
With rate, it is determined whether migration first memory set in data into second memory set can by data storage device Lai
It realizes.It, can will be in first memory when the magnitude relationship of the space utilization rate of first memory meets the first predetermined value
Data Migration to second memory, wherein, it is pre- that the magnitude relationship of the space utilization rate of second memory is also required to meet second
Fixed number value.
The date storage method that the embodiment of the present invention is provided, by obtaining the flow value of pending data, and based on stream
Magnitude and default selection strategy determine target memory and store pending data to target memory, then work as predetermined period
During arrival, the space utilization rate of first memory set and the space utilization rate of second memory set are obtained, finally according to the
The space utilization rate of one memory set and the space utilization rate of second memory set, it is determined whether migration first memory collection
In data value second memory set in conjunction；In this way, determining target memory by flow value and default selection strategy, optimize
Writing speed in pending data write-in target memory, and when the data volume stored in SSD memory is more than threshold value
When, by the HDD memories of the Data Migration in SSD memory to extendible capacity, it is equalized the memory space of SSD memory
It uses, asking for writing speed and storage medium memory space load balancing cannot be taken into account simultaneously in the prior art by solving
Topic realizes the optimization of the writing speed of data by writing speed during the storage data of different storage mediums the characteristics of different,
And it ensure that the balanced use of memory space.
The embodiment of the present invention provides a kind of date storage method, and with reference to shown in Fig. 2, this method comprises the following steps：
Step 201, data storage device obtain the flow value of pending data.
Step 202, data storage device are from any storage of selection in first memory set and second memory set
Device obtains first memory.
Specifically, being combined into SSD memory set with first memory collection, second memory collection is combined into HDD memory set
Exemplified by illustrate.Cloud storage system can randomly choose a memory in SSD memory set and HDD memory set
As first memory, illustratively, first memory can be a HDD memory.
Step 203, data storage device obtain the select probability of first memory.
It carries out calculating acquisition specifically, the select probability of first memory can be cloud storage system.Such as cloud storage
The select probability that system obtains HDD memories is 0.3.
Step 204, data storage device are based on default selection rule and obtain referential data, and comparison reference numerical value is deposited with first
The magnitude relationship of the select probability of reservoir.
Specifically, default selection rule can be a kind of selection algorithm, can be used for acquisition can be with first memory
Select probability carries out the referential data of size comparison.
Wherein, step 204 data storage device is based on default selection rule and obtains referential data, comparison reference numerical value and the
After the magnitude relationship of the select probability of one memory, it can select to perform step 205 or step 206, if referential data is small
Step 205 can be performed in or equal to the select probability of first memory, if referential data is more than the selection of first memory
Probability can select to perform step 206；
If step 205, referential data are less than or equal to the select probability of first memory, data storage device selection the
One memory is target memory, and stores and upload data to target memory.
Specifically, for example when according to it is default select the referential data that rule obtains for 0.2 when, less than cloud storage system acquisition
HDD memories select probability 0.3, cloud storage system can determine that target memory is first memory HDD memories, and
The data that user uploads are stored in target memory HDD memories.
If step 206, referential data are more than the select probability of first memory, data storage device is performed from the first storage
Selection any memory in device set and second memory set, obtains first memory, until redefining target storage
Device.
Specifically, for example when according to it is default select the referential data of rule acquisition for 0.4 when, more than the choosing of HDD memories
Select probability 0.3, it is impossible to which it is target memory to select the HDD memories.Cloud storage system can from SSD memory set or
A memory is reselected in HDD memory set as first memory, such as can be SSD memory, is calculated again
The select probability of the SSD memory of selection is 0.6 and can select one referential data of Rule such as according to default again
0.5, then compare the select probability 0.6 of the SSD memory reselected and referential data 0.5, it may be determined that target memory
For the SSD memory reselected；If a referential data 0.8, the SSD reselected are obtained according to preset rules again
Memory is not target memory, needs to choose a memory conduct in SSD memory set and HDD memory set again
First memory, and the first memory to regaining is analyzed, so Xun Huan will be until definite target memory, finally will
The data that user uploads are stored in target memory.
Step 207, when predetermined period arrives, data storage device obtain first memory set space utilization rate and
The space utilization rate of second memory set.
Specifically, when predetermined period arrives, cloud storage system obtains the space utilization rate and HDD of SSD memory set
The space utilization rate of memory set.
Step 208, data storage device judge the space utilization rate of each memory in first memory set and the
The magnitude relationship of one threshold value.
Specifically, first threshold can be the empirical value that user obtains in first memory aggregation process is used.Such as
First threshold can be 0.8, and cloud storage system may determine that the space utilization rate of each memory in SSD memory set and the
Magnitude relationship between one threshold value 0.8.
If in step 209, first memory set there are space utilization rate be more than or equal to first threshold memory,
Space utilization rate is more than or equal to the mark of the memory of first threshold in data storage device statistics first memory set
Information obtains first flag information aggregate.
If specifically, SSD is counted there are the memory that space utilization rate is more than or equal to 0.8 in SSD memory set
Space utilization rate is more than or equal to the identification information of the SSD memory of first threshold 0.8 in memory set, obtains the first mark
Know information aggregate, determine to need the SSD memory of migrating data.
Step 210, data storage transposition judge the space utilization rate and the second threshold of the memory in second memory set
The magnitude relationship of value.
Specifically, second threshold can be used for selecting the memory in second memory set, the second memory set
In memory can receive the data of the memory migration in first memory set.For example, second threshold can be 0.2.
If there are the memory that space utilization rate is less than second threshold, data storages in step 211, second memory set
Space utilization rate is less than the identification information of the memory of second threshold in device statistics second memory set, obtains second identifier
Information aggregate.
Specifically, if there are space utilization rates in second memory set HDD memory set to be less than second threshold 0.2
HDD memories, the identification information of statistics HDD memories obtain second identifier information aggregate.
Step 212, data storage device are based on first flag information aggregate and second identifier information aggregate, are moved according to data
The regular data migrated in the corresponding memory of first flag information aggregate are moved to the corresponding memory of second identifier information aggregate
In.
Need migration more in the corresponding memory of first flag information aggregate specifically, Data Migration rule can be used to determine
A small number of evidences, and under conditions of the corresponding memory of first flag information aggregate meets the requirements, the Data Migration that it need to be migrated
Into the corresponding memory of satisfactory second identifier information aggregate.It is moved for example, Data Migration rule can be SSD memory
After moving data, the space utilization rate of SSD memory is less than the space utilization rate of entire cloud storage system and is deposited simultaneously less than the SSD
The space utilization rate threshold value 0.6 of reservoir.
The date storage method that the embodiment of the present invention is provided, by obtaining the flow value of pending data, and based on stream
Magnitude and default selection strategy determine target memory and store pending data to target memory, then work as predetermined period
During arrival, the space utilization rate of first memory set and the space utilization rate of second memory set are obtained, finally according to the
The space utilization rate of one memory set and the space utilization rate of second memory set, it is determined whether migration first memory collection
In data value second memory set in conjunction；In this way, determining target memory by flow value and default selection strategy, optimize
Writing speed in pending data write-in target memory, and when the data volume stored in SSD memory is more than threshold value
When, by the HDD memories of the Data Migration in SSD memory to extendible capacity, it is equalized the memory space of SSD memory
It uses, asking for writing speed and storage medium memory space load balancing cannot be taken into account simultaneously in the prior art by solving
Topic realizes the optimization of the writing speed of data by writing speed during the storage data of different storage mediums the characteristics of different,
And it ensure that the balanced use of memory space.
The embodiment of the present invention provides a kind of date storage method, and with reference to shown in Fig. 3, this method comprises the following steps：
Step 301, data storage device obtain the flow value of pending data.
Step 302, data storage device are from any storage of selection in first memory set and second memory set
Device obtains first memory.
Specifically, the SSD memory that first memory set can be made of the SSD memory that 10 pieces of capacity are 500G
Set, the HDD memory set that second memory set can be made of the HDD memories that 90 pieces of capacity are 2T, cloud storage
System randomly selects a memory from 10 pieces of SSD memory set and 90 pieces of HDD memory set, such as can be SSD
Memory, as first memory.
Step 303, data storage device obtain the writing speed of first memory and space utilization rate.
Step 304, data storage device obtain the sum of memory in first memory set and second memory set.
Step 305, data storage device are based on flow value, the writing speed of first memory, sum and the first storage
The space utilization rate of device using default selection strategy be calculated the select probability of first memory.
Specifically, formula (1) may be employed to realize in default selection strategy：
P1(x)=sig mod (λ * | x+ μ |+γ)+v (2)
Wherein, T is the flow value of pending data, and N is memory in first memory set and second memory set
Sum, SIFor the writing speed of first memory, RIIt is first memory for the space utilization rate I of first memory；P1(x)
It can be realized by formula (2) and (4), P2(x) function can be realized by formula (3) and (4)；λ, μ, γ, ν in formula (2) can
To be regulation coefficient, with forming the memory of cloud storage system and the space utilization rate of memory and to formula (4) calculating side
Method convergence requirement etc. it is related, can be adjusted as needed, have no fixed value, for example, can take in the present embodiment λ=-
3 π, μ=- 0.75, γ=1, ν=0.15；α, β in formula (3) can be regulation coefficients, be limited with the safe capacity of memory
It etc. related, can be adjusted as needed, such as α=- 2 π, β=π can be taken in the present embodiment.
Step 306, when predetermined period arrives, data storage device obtain first memory set space utilization rate and
The space utilization rate of second memory set.
Step 307, data storage device are based on default selection rule and obtain referential data, and comparison reference numerical value is deposited with first
The magnitude relationship of the select probability of reservoir.
Wherein, step 307 data storage device is based on default selection rule and obtains referential data, comparison reference numerical value and the
After the magnitude relationship of the select probability of one memory, it can select to perform step 308 or step 309, if referential data is small
Step 308 can be performed in or equal to the select probability of first memory, if referential data is more than the selection of first memory
Probability can select to perform step 309；
If step 308, referential data are less than or equal to the select probability of first memory, data storage device selection the
One memory is target memory, and stores and upload data to target memory.
If step 309, referential data are more than the select probability of first memory, data storage device is performed from the first storage
Selection any memory in device set and second memory set, obtains first memory, until redefining target storage
Device.
Step 310, when predetermined period arrives, data storage device obtain first memory set space utilization rate and
The space utilization rate of second memory set.
Step 311, data storage device judge the space utilization rate of each memory in first memory set and the
The magnitude relationship of one threshold value.
If in step 312, first memory set there are space utilization rate be more than or equal to first threshold memory,
Space utilization rate is more than or equal to the mark of the memory of first threshold in data storage device statistics first memory set
Information obtains first flag information aggregate.
Step 313, data storage device judge the space utilization rate and the second threshold of the memory in second memory set
The magnitude relationship of value.
If there are the memory that space utilization rate is less than second threshold, data storages in step 314, second memory set
Space utilization rate is less than the identification information of the memory of second threshold in device statistics second memory set, obtains second identifier
Information aggregate.
Step 315, data storage device obtain the communication interface free time in the corresponding memory of first flag information aggregate
Memory need to be migrated according to the memory of the definite first flag information aggregate of Data Migration rule corresponding communication interface free time
Data packet.
Specifically, it is obtained in the first flag information aggregate of SSD memory of the cloud storage system from space utilization rate more than 0.8
The SSD memory of input/output (I/O) interface free time is taken, and the SSD of the I/O interfaces free time is determined according to Data Migration rule
The data packet that memory need to migrate.Wherein, when I/O rates are less than the 30% of the writing rate of memory, it is believed that storage
The I/O interfaces of device are idle.
Step 316, data storage device obtain the memory of second identifier information aggregate corresponding communication interface free time, and
The data packet migrated is needed in the memory of migration first flag information aggregate corresponding communication interface free time to second identifier information
In the memory for gathering the corresponding communication interface free time.
Specifically, it is obtained in the second identifier information aggregate of HDD memories of the cloud storage system from space utilization rate less than 0.2
It, will be in the SSD memory of first flag information aggregate corresponding I/O interfaces free time after the HDD memories for taking the I/O interfaces free time
The data packet of definite need migration is migrated to the HDD memories of the I/O interfaces free time.Wherein, during Data Migration, data are migrated
SSD memory in only preserve the initial data temporally preserved.
Specifically, date storage method provided in an embodiment of the present invention can be applied to the data storage system shown in Fig. 4
In system, which can include：Traffic monitoring module, write-in policy control module, solid-state hard drive, hard disk
Driver and data transferring module, wherein：Traffic monitoring module is used to obtain the data traffic that user is uploaded to cloud storage system
Value；Write-in policy control module is used to according to flow value and write-in policy determine target memory, wherein, target memory can be with
It is solid-state hard drive or can is hard disk drive；Data Migration module is used to determine to need the solid state disk of migrating data
Driver and the hard disk drive for receiving data are additionally operable to extremely can the Data Migration that need migration in solid-state hard drive
In the hard disk drive for receiving data.
The date storage method that the embodiment of the present invention is provided, by obtaining the flow value of pending data, and based on stream
Magnitude and default selection strategy determine target memory and store pending data to target memory, then work as predetermined period
During arrival, the space utilization rate of first memory set and the space utilization rate of second memory set are obtained, finally according to the
The space utilization rate of one memory set and the space utilization rate of second memory set, it is determined whether migration first memory collection
In data value second memory set in conjunction；In this way, determining target memory by flow value and default selection strategy, optimize
Writing speed in pending data write-in target memory, and when the data volume stored in SSD memory is more than threshold value
When, by the HDD memories of the Data Migration in SSD memory to extendible capacity, it is equalized the memory space of SSD memory
It uses, asking for writing speed and storage medium memory space load balancing cannot be taken into account simultaneously in the prior art by solving
Topic realizes the optimization of the writing speed of data by writing speed during the storage data of different storage mediums the characteristics of different,
And it ensure that the balanced use of memory space.
Data storage device 4 provided in an embodiment of the present invention can be applied to one kind that the corresponding embodiment in Fig. 1~3 provides
In date storage method, with reference to shown in Fig. 5, which includes：First acquisition unit 41, first processing units 42,
Second acquisition unit 43 and second processing unit 44, wherein：
First acquisition unit 41, for obtaining the flow value of pending data.
First processing units 42 for being based on flow value and default selection strategy, determine target memory and store upload
Data are into target memory.
Wherein, target memory includes a memory in first memory set or second memory set.
Second acquisition unit 43, for when predetermined period arrives, obtain first memory set space utilization rate and
The space utilization rate of second memory set.
Second processing unit 44, for the space utilization rate and the sky of second memory set according to first memory set
Between utilization rate, it is determined whether migration first memory set in data into second memory set.
Further, first memory set is SSD memory set, and second memory set is HDD memory set.
The data storage device that the embodiment of the present invention is provided by obtaining the flow value of pending data, and is based on
Flow value and default selection strategy determine target memory and store pending data to target memory, then when default week
When phase arrives, the space utilization rate of first memory set and the space utilization rate of second memory set, last basis are obtained
The space utilization rate of first memory set and the space utilization rate of second memory set, it is determined whether migration first memory
In data value second memory set in set；In this way, target memory is determined by flow value and default selection strategy, it is excellent
Change the writing speed in pending data write-in target memory, and when the data volume stored in SSD memory is more than threshold
During value, by the HDD memories of the Data Migration in SSD memory to extendible capacity, the memory space of SSD memory is made to obtain
Weighing apparatus uses, and asking for writing speed and storage medium memory space load balancing cannot be taken into account simultaneously in the prior art by solving
Topic realizes the optimization of the writing speed of data by writing speed during the storage data of different storage mediums the characteristics of different,
And it ensure that the balanced use of memory space.
Specifically, with reference to shown in Fig. 6, which includes：First processing module 421, the first acquisition module
422nd, 423 and the 3rd processing module 424 of Second processing module, wherein：
First processing module 421, for from any storage of selection in first memory set and second memory set
Device obtains first memory.
First acquisition module 422, for obtaining the select probability of first memory.
Second processing module 423 obtains referential data for being based on default selection rule, and comparison reference numerical value is deposited with first
The magnitude relationship of the select probability of reservoir.
3rd processing module 424, if being less than or equal to the select probability of first memory for referential data, selection the
One memory is target memory, and stores and upload data to target memory.
Further specifically, the first acquisition module 422 is specifically used for performing following steps：
Obtain the writing speed of first memory and space utilization rate.
Obtain the sum of memory in first memory set and second memory set.
Based on the space utilization rate of flow value, the writing speed of first memory, sum and first memory, using pre-
If selection strategy be calculated the select probability of first memory.
Specifically, with reference to shown in Fig. 7, first processing units 42 further include：Fourth processing module 425, wherein：
Fourth processing module 425 if being more than the select probability of first memory for referential data, is performed from the first storage
Selection any memory in device set and second memory set, obtains first memory, until redefining target storage
Device.
Specifically, with reference to shown in Fig. 8, second processing unit 44 includes：It judgment module 441, the 5th processing module 442 and moves
Shifting formwork block 443, wherein：
Judgment module 441, for judging the space utilization rate of each memory in first memory set and the first threshold
The magnitude relationship of value.
5th processing module 442, if to be more than or equal to first for there are space utilization rates in first memory set
The memory of threshold value counts the mark that space utilization rate in first memory set is more than or equal to the memory of first threshold
Information obtains first flag information aggregate.
Judgment module 441 is additionally operable to judge the space utilization rate and second threshold of the memory in second memory set
Magnitude relationship.
5th processing module 442, if being additionally operable in second memory set, there are space utilization rates to be less than second threshold
Memory counts the identification information that space utilization rate in second memory set is less than the memory of second threshold, obtains second
Identification information set.
Transferring module 443 for being based on first flag information aggregate and second identifier information aggregate, is advised according to Data Migration
The data in the corresponding memory of first flag information aggregate are then migrated into the corresponding memory of second identifier information aggregate.
Further specifically, transferring module 443 is specifically used for performing following steps：
The memory of communication interface free time in the corresponding memory of first flag information aggregate is obtained, is advised according to Data Migration
Then determine the data packet that the memory of first flag information aggregate corresponding communication interface free time need to migrate.
The memory of second identifier information aggregate corresponding communication interface free time is obtained, and migrates first flag information aggregate
The data packet that migration is needed in the memory of corresponding communication interface free time is empty to the corresponding communication interface of second identifier information aggregate
In not busy memory.
Specifically, data storage device provided in an embodiment of the present invention can be applied to Data Migration flow shown in Fig. 9
In system, which can include：Solid-state hard drive, hard disk drive and data transferring module,
In：Data Migration module can scan the space utilization rate of solid-state hard drive and hard disk drive, when solid state disk drives
When the space utilization rate of device is more than or equal to first threshold, by the Data Migration in solid-state hard drive to space utilization rate
Less than in the hard disk drive of second threshold.
It should be noted that the interaction in the present embodiment between unit and module, is referred to Fig. 1~3 pair
Interaction in a kind of date storage method that the embodiment answered provides, details are not described herein again.
The data storage device that the embodiment of the present invention is provided by obtaining the flow value of pending data, and is based on
Flow value and default selection strategy determine target memory and store pending data to target memory, then when default week
When phase arrives, the space utilization rate of first memory set and the space utilization rate of second memory set, last basis are obtained
The space utilization rate of first memory set and the space utilization rate of second memory set, it is determined whether migration first memory
In data value second memory set in set；In this way, target memory is determined by flow value and default selection strategy, it is excellent
Change the writing speed in pending data write-in target memory, and when the data volume stored in SSD memory is more than threshold
During value, by the HDD memories of the Data Migration in SSD memory to extendible capacity, the memory space of SSD memory is made to obtain
Weighing apparatus uses, and asking for writing speed and storage medium memory space load balancing cannot be taken into account simultaneously in the prior art by solving
Topic realizes the optimization of the writing speed of data by writing speed during the storage data of different storage mediums the characteristics of different,
And it ensure that the balanced use of memory space.
In practical applications, first acquisition unit 41, first processing units 42, second acquisition unit 43, second processing list
Member 44, first processing module 421, the first acquisition module 422, Second processing module 423, the 3rd processing module 424, fourth process
Module 425, judgment module 441, the 5th processing module 442 and transferring module 443 can be by being located in wireless data sending device
Central processing unit (Central Processing Unit, CPU), microprocessor (Micro Processor Unit, MPU),
Digital signal processor (Digital Signal Processor, DSP) or field programmable gate array (Field
Programmable Gate Array, FPGA) etc. realizations.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, system or computer program
Product.Therefore, the shape of the embodiment in terms of hardware embodiment, software implementation or combination software and hardware can be used in the present invention
Formula.Moreover, the present invention can be used can use storage in one or more computers for wherein including computer usable program code
The form for the computer program product that medium is implemented on (including but not limited to magnetic disk storage and optical memory etc.).
The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that it can be realized by computer program instructions every first-class in flowchart and/or the block diagram
The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided
The processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that the instruction performed by computer or the processor of other programmable data processing devices is generated for real
The device for the function of being specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction generation being stored in the computer-readable memory includes referring to
Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or
The function of being specified in multiple boxes.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps is performed on calculation machine or other programmable devices to generate computer implemented processing, so as in computer or
The instruction offer performed on other programmable devices is used to implement in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a box or multiple boxes.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the scope of the present invention.
Claims (13)
1. a kind of date storage method, which is characterized in that the described method includes：
Obtain the flow value of pending data；
Based on the flow value and default selection strategy, determine target memory and store the pending data to the target
In memory；Wherein, the target memory includes a storage in first memory set or second memory set
Device；
When predetermined period arrives, the space utilization rate of the first memory set and the second memory set are obtained
Space utilization rate；
According to the space utilization rate of the first memory set and the space utilization rate of the second memory set, determine be
Data in the no migration first memory set are into the second memory set.
2. according to the method described in claim 1, which is characterized in that it is described to be based on the flow value and default selection strategy,
It determines target memory and stores the upload data into the target memory, including：
Selection any memory from the first memory set and the second memory set, obtains the first storage
Device；
Obtain the select probability of first memory；
Referential data, the referential data and the select probability of the first memory are obtained based on default selection rule
Magnitude relationship；
If the referential data is less than or equal to the select probability of the first memory, the first memory is selected as institute
Target memory is stated, and stores the upload data to the target memory.
3. according to the method described in claim 2, it is characterized in that, the method further includes：
If the referential data is more than the select probability of the first memory, perform it is described from the first memory set and
Selection any memory in the second memory set, obtains first memory, until redefining the target storage
Device.
4. according to the method described in claim 2, it is characterized in that, it is described obtain first memory select probability, including：
Obtain the writing speed of the first memory and space utilization rate；
Obtain the sum of memory in the first memory set and the second memory set；
Based on the flow value, the writing speed of the first memory, described total and the first memory space
Utilization rate using default selection strategy be calculated the select probability of the first memory.
5. according to the method described in claim 1, it is characterized in that, described use according to the space of the first memory set
The space utilization rate of rate and the second memory set, it is determined whether migrate data in the first memory set to institute
It states in second memory set, including：
Judge the space utilization rate of each memory and the magnitude relationship of first threshold in the first memory set；
If there are the memory that space utilization rate is more than or equal to the first threshold, statistics in the first memory set
Space utilization rate is more than or equal to the identification information of the memory of the first threshold in the first memory set, obtains
First flag information aggregate；
Judge the space utilization rate of memory and the magnitude relationship of second threshold in the second memory set；
If there are the memory that space utilization rate is less than the second threshold, statistics described second in the second memory set
Space utilization rate is less than the identification information of the memory of the second threshold in memory set, obtains the second identifier information
Set；
Based on the first flag information aggregate and the second identifier information aggregate, according to Data Migration rule migration described the
Data in the corresponding memory of one identification information set are into the corresponding memory of the second identifier information aggregate.
It is 6. according to the method described in claim 5, it is characterized in that, described based on the first flag information aggregate and described the
Two identification information set, the data in the corresponding memory of the Data Migration rule migration first flag information aggregate are extremely
In the corresponding memory of the second identifier information aggregate, including：
The memory of communication interface free time in the corresponding memory of the first flag information aggregate is obtained, is advised according to Data Migration
Then determine the data packet that the memory of the first flag information aggregate corresponding communication interface free time need to migrate；
The memory of the second identifier information aggregate corresponding communication interface free time is obtained, and migrates the first flag information
Gathering needs the data packet of migration corresponding logical to the second identifier information aggregate in the memory of corresponding communication interface free time
In the memory for believing the interface free time.
7. according to any method of claim 1~6, which is characterized in that the first memory set is SSD memory
Set, the second memory set is HDD memory set.
8. a kind of data storage device, which is characterized in that described device includes：First acquisition unit, first processing units, second
Acquiring unit and second processing unit；Wherein：
The first acquisition unit, for obtaining the flow value of pending data；
The first processing units for being based on the flow value and default selection strategy, determine target memory and store institute
It states and uploads data into the target memory；Wherein, the target memory is deposited including first memory set or second
A memory in reservoir set；
The second acquisition unit, for when predetermined period arrives, obtaining the space utilization rate of the first memory set
With the space utilization rate of the second memory set；
The second processing unit, for the space utilization rate according to the first memory set and the second memory collection
The space utilization rate of conjunction, it is determined whether migrate the data in the first memory set into the second memory set.
9. data storage device according to claim 8, which is characterized in that the first processing units include：At first
Manage module, the first acquisition module, Second processing module and the 3rd processing module；Wherein：
The first processing module, for any from the selection in the first memory set and the second memory set
Memory obtains first memory；
First acquisition module, for obtaining the select probability of first memory；
The Second processing module obtains referential data for being based on default selection rule, the referential data with it is described
The magnitude relationship of the select probability of first memory；
3rd processing module, if being less than or equal to the select probability of the first memory for the referential data,
The first memory is selected as the target memory, and stores the upload data to the target memory.
10. data storage device according to claim 9, which is characterized in that the first processing units further include：4th
Processing module；Wherein：
The fourth processing module, if being more than the select probability of the first memory for the referential data, described in execution
Selection any memory from the first memory set and the second memory set, obtains first memory, directly
To redefining the target memory.
11. data storage device according to claim 9, which is characterized in that first acquisition module is specifically used for：
Obtain the writing speed of the first memory and space utilization rate；
Obtain the sum of memory in the first memory set and the second memory set；
Based on the flow value, the writing speed of the first memory, described total and the first memory space
Utilization rate using default selection strategy be calculated the select probability of the first memory.
12. data storage device according to claim 8, which is characterized in that the second processing unit, including：Judge
Module, the 5th processing module and transferring module；Wherein：
The judgment module, for judging the space utilization rate of each memory in the first memory set and the first threshold
The magnitude relationship of value；
5th processing module, if described for being more than or equal in the first memory set there are space utilization rate
The memory of first threshold counts space utilization rate in the first memory set and is more than or equal to the first threshold
The identification information of memory obtains first flag information aggregate；
The judgment module is additionally operable to judge the space utilization rate and second threshold of the memory in the second memory set
Magnitude relationship；
5th processing module, if being additionally operable in the second memory set, there are space utilization rates to be less than second threshold
The memory of value counts the mark letter that space utilization rate in the second memory set is less than the memory of the second threshold
Breath, obtains the second identifier information aggregate；
The transferring module, for being based on the first flag information aggregate and the second identifier information aggregate, according to data
Migration rules migrate data in the corresponding memory of the first flag information aggregate to the second identifier information aggregate pair
In the memory answered.
13. data storage device according to claim 12, which is characterized in that the transferring module is specifically used for：
The memory of communication interface free time in the corresponding memory of the first flag information aggregate is obtained, is advised according to Data Migration
Then determine the data packet that the memory of the first flag information aggregate corresponding communication interface free time need to migrate；
The memory of the second identifier information aggregate corresponding communication interface free time is obtained, and migrates the first flag information
Gathering needs the data packet of migration corresponding logical to the second identifier information aggregate in the memory of corresponding communication interface free time
In the memory for believing the interface free time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611038740.XA CN108089814B (en) | 2016-11-23 | 2016-11-23 | Data storage method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611038740.XA CN108089814B (en) | 2016-11-23 | 2016-11-23 | Data storage method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108089814A true CN108089814A (en) | 2018-05-29 |
| CN108089814B CN108089814B (en) | 2021-04-06 |
Family
ID=62170886
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611038740.XA Active CN108089814B (en) | 2016-11-23 | 2016-11-23 | Data storage method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108089814B (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110018788A (en) * | 2019-03-01 | 2019-07-16 | 平安科技（深圳）有限公司 | It is classified storage method, device, electronic equipment and computer readable storage medium |
| CN110045924A (en) * | 2019-03-01 | 2019-07-23 | 平安科技（深圳）有限公司 | It is classified storage method, device, electronic equipment and computer readable storage medium |
| CN110196752A (en) * | 2018-06-07 | 2019-09-03 | 腾讯科技（深圳）有限公司 | Data processing method, device and storage medium |
| CN110809874A (en) * | 2018-08-24 | 2020-02-18 | 深圳市大疆创新科技有限公司 | Data synchronization method and system, movable platform and readable storage medium |
| CN111124304A (en) * | 2019-12-19 | 2020-05-08 | 北京浪潮数据技术有限公司 | Data migration method and device, electronic equipment and storage medium |
| CN111199761A (en) * | 2018-11-19 | 2020-05-26 | 美光科技公司 | Data migration dynamic random access memory |
| CN112363678A (en) * | 2021-01-13 | 2021-02-12 | 北京东方通软件有限公司 | Data migration method and system based on message middleware |
| US11163473B2 (en) | 2018-11-19 | 2021-11-02 | Micron Technology, Inc. | Systems, devices, techniques, and methods for data migration |
| US11182090B2 (en) | 2018-11-19 | 2021-11-23 | Micron Technology, Inc. | Systems, devices, and methods for data migration |
| CN113741819A (en) * | 2021-09-15 | 2021-12-03 | 第四范式（北京）技术有限公司 | Method and device for hierarchical storage of data |
| US11256437B2 (en) | 2018-11-19 | 2022-02-22 | Micron Technology, Inc. | Data migration for memory operation |
| CN114489504A (en) * | 2022-01-21 | 2022-05-13 | 苏州浪潮智能科技有限公司 | SSD data management method and related components |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101646994A (en) * | 2006-12-06 | 2010-02-10 | 弗森多***公司（dba弗森-艾奥） | Apparatus, system, and method for managing commands of solid-state storage using bank interleave |
| CN102968281A (en) * | 2012-11-26 | 2013-03-13 | 华为技术有限公司 | Data migration method and device |
| US20140297971A1 (en) * | 2013-03-26 | 2014-10-02 | Fujitsu Limited | Control program of storage control device, control method of storage control device and storage control device |
| CN105487824A (en) * | 2015-12-07 | 2016-04-13 | 联想(北京)有限公司 | Information processing method, storage device and electronic device |
-
2016
- 2016-11-23 CN CN201611038740.XA patent/CN108089814B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101646994A (en) * | 2006-12-06 | 2010-02-10 | 弗森多***公司（dba弗森-艾奥） | Apparatus, system, and method for managing commands of solid-state storage using bank interleave |
| CN102968281A (en) * | 2012-11-26 | 2013-03-13 | 华为技术有限公司 | Data migration method and device |
| US20140297971A1 (en) * | 2013-03-26 | 2014-10-02 | Fujitsu Limited | Control program of storage control device, control method of storage control device and storage control device |
| CN105487824A (en) * | 2015-12-07 | 2016-04-13 | 联想(北京)有限公司 | Information processing method, storage device and electronic device |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110196752A (en) * | 2018-06-07 | 2019-09-03 | 腾讯科技（深圳）有限公司 | Data processing method, device and storage medium |
| CN110809874A (en) * | 2018-08-24 | 2020-02-18 | 深圳市大疆创新科技有限公司 | Data synchronization method and system, movable platform and readable storage medium |
| US11182090B2 (en) | 2018-11-19 | 2021-11-23 | Micron Technology, Inc. | Systems, devices, and methods for data migration |
| US11442648B2 (en) | 2018-11-19 | 2022-09-13 | Micron Technology, Inc. | Data migration dynamic random access memory |
| CN111199761A (en) * | 2018-11-19 | 2020-05-26 | 美光科技公司 | Data migration dynamic random access memory |
| US11853578B2 (en) | 2018-11-19 | 2023-12-26 | Micron Technology, Inc. | Systems, devices, and methods for data migration |
| US11163473B2 (en) | 2018-11-19 | 2021-11-02 | Micron Technology, Inc. | Systems, devices, techniques, and methods for data migration |
| US11782626B2 (en) | 2018-11-19 | 2023-10-10 | Micron Technology, Inc. | Systems, devices, techniques, and methods for data migration |
| US11256437B2 (en) | 2018-11-19 | 2022-02-22 | Micron Technology, Inc. | Data migration for memory operation |
| US11709613B2 (en) | 2018-11-19 | 2023-07-25 | Micron Technology, Inc. | Data migration for memory operation |
| WO2020177379A1 (en) * | 2019-03-01 | 2020-09-10 | 平安科技（深圳）有限公司 | Hierarchical storage method and apparatus, electronic device and computer-readable storage medium |
| CN110045924A (en) * | 2019-03-01 | 2019-07-23 | 平安科技（深圳）有限公司 | It is classified storage method, device, electronic equipment and computer readable storage medium |
| CN110018788A (en) * | 2019-03-01 | 2019-07-16 | 平安科技（深圳）有限公司 | It is classified storage method, device, electronic equipment and computer readable storage medium |
| CN110045924B (en) * | 2019-03-01 | 2022-02-11 | 平安科技（深圳）有限公司 | Hierarchical storage method and device, electronic equipment and computer readable storage medium |
| CN111124304A (en) * | 2019-12-19 | 2020-05-08 | 北京浪潮数据技术有限公司 | Data migration method and device, electronic equipment and storage medium |
| CN112363678A (en) * | 2021-01-13 | 2021-02-12 | 北京东方通软件有限公司 | Data migration method and system based on message middleware |
| CN112363678B (en) * | 2021-01-13 | 2021-04-30 | 北京东方通软件有限公司 | Data migration method and system based on message middleware |
| CN113741819A (en) * | 2021-09-15 | 2021-12-03 | 第四范式（北京）技术有限公司 | Method and device for hierarchical storage of data |
| CN114489504A (en) * | 2022-01-21 | 2022-05-13 | 苏州浪潮智能科技有限公司 | SSD data management method and related components |
| CN114489504B (en) * | 2022-01-21 | 2023-08-08 | 苏州浪潮智能科技有限公司 | SSD data management method and related components |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108089814B (en) | 2021-04-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108089814A (en) | A kind of date storage method and device | |
| US10180791B2 (en) | Compression sampling in tiered storage | |
| US10216440B2 (en) | Disk management in distributed storage system including grouping disks into cold and hot data disk rings and reducing a spinning rate of disks storing cold data | |
| CN109725829B (en) | System and method for end-to-end QoS solution for data storage system | |
| CN110365768A (en) | Method of data synchronization, device, medium, the electronic equipment of distributed system | |
| CN102156738A (en) | Method for processing data blocks, and data block storage equipment and system | |
| US10541930B2 (en) | Automated data flows using flow-based data processor blocks | |
| US11102322B2 (en) | Data processing method and apparatus, server, and controller | |
| CN105808443B (en) | A kind of method, apparatus and system of Data Migration | |
| CN104811473B (en) | A kind of method, system and management system for creating virtual non-volatile storage medium | |
| US11914894B2 (en) | Using scheduling tags in host compute commands to manage host compute task execution by a storage device in a storage system | |
| US20150331716A1 (en) | Using queues corresponding to attribute values and priorities associated with units of work and sub-units of the unit of work to select the units of work and their sub-units to process | |
| CN111290699B (en) | Data migration method, device and system | |
| CN107122126A (en) | The moving method of data, device and system | |
| CN106603692A (en) | Data storage method in distributed storage system and apparatus thereof | |
| CN109491616A (en) | The storage method and equipment of data | |
| CN109271106A (en) | Message storage, read method and device, server, storage medium | |
| CN103905517A (en) | Data storage method and equipment | |
| CN107168802A (en) | The merging method and device of a kind of cloud storage small file | |
| CN102170466B (en) | Data processing method and system | |
| WO2018053838A1 (en) | Load balancing method and related device | |
| CN104866375B (en) | A kind of method and device for migrating virtual machine | |
| CN103761194B (en) | A kind of EMS memory management process and device | |
| CN103827837A (en) | Method, device and system for accessing solid state disk space | |
| CN106537323A (en) | Storage device access mediation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |