CN104239230B - A kind of data block migration method and device - Google Patents
A kind of data block migration method and device Download PDFInfo
- Publication number
- CN104239230B CN104239230B CN201410431442.1A CN201410431442A CN104239230B CN 104239230 B CN104239230 B CN 104239230B CN 201410431442 A CN201410431442 A CN 201410431442A CN 104239230 B CN104239230 B CN 104239230B
- Authority
- CN
- China
- Prior art keywords
- stabilization
- storage
- value
- threshold value
- data block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of data block migration method and device, the access frequency of statistics block in the present invention；Judge whether access frequency reaches the storage threshold value for carrying out data block migration；If access frequency reaches the storage threshold value for carrying out data block migration, judge access frequency whether in the stabilization regional extent value of storage threshold value；If access frequency is not in the stabilization regional extent value for stating storage threshold value, by data block migration to the storage medium for meeting data block access frequency；If access frequency is in the stabilization regional extent value of storage threshold value, not migrating data block.Can avoid access frequency that the data of minor variations frequent migration between different storage mediums occurs by the present invention, and then improve the service feature of storage system.
Description
Technical field
The present invention relates to technical field of data storage, more particularly to a kind of data block migration method and device.
Background technology
Data hierarchy memory technology disclosure satisfy that full with relatively low price as the mainstream technology of technical field of data storage
The performance and capacity requirement of sufficient data hierarchy storage system.
Data hierarchy memory technology mainly includes the cold and hot identification of data block monitoring, data block and the part of data block migration three.
Data monitoring process, the mainly parameter value such as access frequency of monitoring and record data block, determine the access temperature of data block.Number
According to cold and hot identification process, mainly by the access frequency determined during data monitoring, cold spot data block and focus are identified
Data block.Data block migration process, mainly the cold spot data block and focus number to being identified in the cold and hot identification process of data block
According to block, determination data block should store which layer in data hierarchy storage system, and hot spot data block can migrate to data hierarchy
The high-performance level of storage system, cold spot data block can migrate to the low performance level in data hierarchy storage system.
Data block migration is carried out in current data hierarchy storage system, hot spot data block is moved into high-performance level, it is cold
Point data block moves to low performance level, typically using following process：The access frequency of the data block in each storage medium is obtained,
And the access frequency to obtaining carries out ranking, deposits according to the capacity of each hierarchical storage medium in data hierarchy storage system and respectively
The access frequency ranking of the data block in storage media, determines the access of data on the adjacent storage medium border of performance rate frequently
Rate, using the access frequency at adjacent storage medium boundary position of the determination as adjacent storage medium storage thresholding
Value.It is determined that after storage threshold value, judging whether the access frequency of data block reaches corresponding storage threshold value, if reaching, enter
Row data block migration, in the storage medium of data block migration to the corresponding level being consistent to access frequency and will store.
At present, carry out in the fast transition process of data, be located between two neighboring hierarchical storage medium for access frequency and deposited
Data block near storage threshold value, can as the minor variations of access frequency are so as to fit in moving to another storage medium,
And frequently moved between two kinds of storage mediums.
For above-mentioned access frequency occur minor variations, cause data block frequently moved between two kinds of storage mediums show
As, the system resource of data hierarchy storage system, such as committed memory, bandwidth etc. can be taken, the business of storage system will be influenceed
Performance.
The content of the invention
The embodiment of the present invention provides a kind of data block migration method and device, and minor variations occur to solve access frequency,
The problem of caused storage system service feature reduction.
A kind of first aspect, there is provided data block migration method, is applied to storage system, and the storage system is including performance etc.
At least two different storage mediums of level, methods described includes：
Count the access frequency of the data block；
Judge whether the access frequency reaches the storage threshold value for carrying out data block migration；
If the access frequency reaches the storage threshold value for carrying out data block migration, judge the access frequency whether
In the stabilization regional extent value of the storage threshold value, the stabilization regional extent value is to prevent data block in different storage mediums
Between the excursion interval value of storage threshold value that is migrated；
If the access frequency is not in the stabilization regional extent value of the storage threshold value, by the data block migration
Into the storage medium for meeting data block access frequency；
If the access frequency does not migrate the data block in the stabilization regional extent value of the storage threshold value.
With reference in a first aspect, in the first implementation, methods described also includes：
Determine the stabilization region model of the storage threshold value in the storage system between the adjacent storage medium of performance rate
Enclose value.
It is described to determine the data hierarchy in second implementation with reference to the first implementation of first aspect
The stabilization regional extent value of the storage threshold value in storage system between the adjacent storage medium of performance rate, including：
Obtain the stabilization factor-beta of the stabilization regional extent value for determining the storage threshold value；
By [TH* (1- β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium；
Wherein, TH is storage threshold value, and β is the stabilization factor, β ∈ (0,1).
With reference to second implementation of first aspect, in the third implementation, obtain for determining the storage
The stabilization factor-beta of the stabilization regional extent value of threshold value, including：
By default fixed value, as the stabilization factor of the stabilization regional extent value for determining the storage threshold value.
With reference to second implementation of first aspect, in the 4th kind of implementation, obtain for determining the storage
The stabilization factor-beta of the stabilization regional extent value of threshold value, including：
According to the traffic pressure of data hierarchy storage system, the stabilization region model for determining the storage threshold value is obtained
Enclose the stabilization factor-beta of value；
Wherein, the numerical value of the corresponding stabilization factor of the big business of traffic pressure, the business small less than traffic pressure is corresponding
The numerical value of the stabilization factor.
A kind of second aspect, there is provided data block migration device, is applied to storage system, and the storage system is including performance etc.
At least two different storage mediums of level, including：Statistic unit, judging unit and migration units, wherein：
The statistic unit, the access frequency for counting the data block；
Whether the judging unit, the access frequency for judging the statistic unit statistics reaches and carries out data block
The storage threshold value of migration, if the access frequency reaches the storage threshold value for carrying out data block migration, judges the access
Whether in the stabilization regional extent value of the storage threshold value, the stabilization regional extent value is to prevent data block not to frequency
With the excursion interval value of the storage threshold value migrated between storage medium；
The migration units, if for the judging unit judged result for the access frequency not in the storage door
In the stabilization regional extent value of limit value, then by the data block migration to the storage medium for meeting data block access frequency；If
The judged result of the judging unit is the access frequency in the stabilization regional extent value of the storage threshold value, then do not move
Move the data block.
With reference to second aspect, in the first implementation, described device also includes determining unit, wherein,
The determining unit, for determining the storage door in the storage system between the adjacent storage medium of performance rate
The stabilization regional extent value of limit value.
With reference to the first implementation of second aspect, in second implementation, described device also includes obtaining single
Unit, wherein,
The acquiring unit, the stabilization factor for obtaining the stabilization regional extent value for determining the storage threshold value
β；
The determining unit, specifically for determining the data hierarchy storage system as follows in performance rate it is adjacent
Storage medium between storage threshold value stabilization regional extent value：
By [TH* (1- β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium；
Wherein, TH is storage threshold value, and β is the stabilization factor, β ∈ (0,1).
With reference to second implementation of second aspect, in the third implementation, the acquiring unit, specifically for
The stabilization factor-beta of the stabilization regional extent value for determining the storage threshold value is obtained as follows：
By default fixed value, as the stabilization factor of the stabilization regional extent value for determining the storage threshold value.
With reference to second implementation of second aspect, in the 4th kind of implementation, the acquiring unit, specifically for
The stabilization factor-beta of the stabilization regional extent value for determining the storage threshold value is obtained as follows：
According to the traffic pressure of data hierarchy storage system, the stabilization region model for determining the storage threshold value is obtained
Enclose the stabilization factor-beta of value；
Wherein, the numerical value of the corresponding stabilization factor of the big business of traffic pressure, the business small less than traffic pressure is corresponding
The numerical value of the stabilization factor.
Data block migration method and device provided in an embodiment of the present invention, is carried out during data block migration, will access frequency
After rate compares with storage threshold value, also determine whether the access frequency whether in the stabilization region model for storing threshold value
Enclose in value, if the access frequency of data block it is determined that storage threshold value stabilization regional extent value in, not migrating data block,
Therefore can avoid access frequency that the data block of minor variations frequent migration between different storage mediums occurs, and then improve storage
The service feature of system.
Brief description of the drawings
Fig. 1 realizes flow chart for data block migration method provided in an embodiment of the present invention；
Fig. 2 is not for data migrate schematic diagram in storage threshold value stabilization regional extent value in the embodiment of the present invention；
Fig. 3 is the aggregated structure schematic diagram of embodiment of the present invention application；
Fig. 4 be aggregated structure provided in an embodiment of the present invention in data block migration control process realize flow chart；
Fig. 5 A- Fig. 5 D are that data block migration device provided in an embodiment of the present invention constitutes schematic diagram；
Fig. 6 constitutes schematic diagram for another data block migration device provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, is not whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
Data block migration method provided in an embodiment of the present invention, is applied in storage system, inclusive in the storage system
Can the different storage medium of grade, the access frequency difference of the data block stored in each layer of storage medium.The embodiment of the present invention
In be adjacent level storage medium between the excursion of storage threshold settings one, the data block in the excursion is not
Migrated, below the embodiment of the present invention for convenience of description, will be prevented what data block from being migrated between different storage mediums
The excursion interval value for storing threshold value is referred to as storing the stabilization regional extent value of threshold value.For visit in the embodiment of the present invention
The data that frequency ranking is located near storage threshold value are asked, if access frequency ranking is in storage threshold value stabilization regional extent value
It is interior, data block migration is not carried out, data block of the access frequency ranking in storage threshold value stabilization regional extent value is currently deposited
The storage medium of storage is constant, and the data block that can avoid access frequency that minor variations occur frequently is moved between different storage mediums
Move, and then improve the service feature of storage system.
Fig. 1 show data block migration method provided in an embodiment of the present invention and realizes flow chart, the executive agent of the method
Can be the data block migration device in storage system, the data block migration device can be one and be arranged on physical host
Controller with management and control function.Certain data block migration device can also be integrated in controller and be provided with execution phase
Answer the part of the software program of function.The embodiment of the present invention is not regarded it as and is limited, and can also be that other have management and control function, and energy
Enough perform the control device of corresponding function.As shown in figure 1, the method includes：
S101：The access frequency of statistics block.
In the embodiment of the present invention, the different data block of the access frequency that is stored with each storage medium in storage system, number
The access temperature of data block is embodied according to the access frequency of block.The access temperature of data block can use various determination modes, for example may be used
Using the data block access frequency in setting time as module, also have and weighted by different weights using many indexes
The method of value, is eventually converted into count value, the count value after this is converted as access temperature.
S102：Judge whether the access frequency of data block reaches the storage threshold value for carrying out Data Migration.
Access frequency ranking can be arranged according to access frequency order from high to low in the embodiment of the present invention, can also be pressed
According to access frequency order arrangement from low to high, the embodiment of the present invention is not limited.
Carry out data block migration, it is necessary first to it is determined that carrying out the storage threshold value of data block migration.General, by ranking position
The access frequency of the data block between the adjacent storage medium of performance rate, at stored boundary position, is defined as adjacent storage
Storage threshold value between medium.
The capacity of the storage medium of different performance is different, and the data number of blocks of storage is also different, therefore by each storage
Access frequency after the capacity and ranking of medium, it may be determined that storage threshold value.Can be by being located at property of ranking in the embodiment of the present invention
The access frequency of the data block between the adjacent storage medium of energy grade, at stored boundary position, is defined as adjacent storage medium
Between storage threshold value.For example there are three kinds of storage mediums, respectively low performance layer, secondary high-performance in data hierarchy storage system
Layer and peak performance layer, and be able to store M, N and P data block, then ranking is low property in the temperature of the data block of M
The storage threshold value of ergosphere, ranking the data block of M+1 access frequency and ranking the data block of M+N access frequently
Rate is the storage threshold value of time high-performance layer, and ranking is the storage of peak performance layer in the access frequency of the data block of M+N+1
Threshold value.
It should be noted that storage threshold value used in the embodiment of the present invention refers to the storage between adjacent storage medium
Threshold value, the lower threshold and the upper threshold of performance highest storage medium of the storage medium minimum for performance, can
Take into account.
When carrying out data block migration, judge whether access frequency reaches the storage threshold value for carrying out data block migration, if reaching
Arrive, then perform S103, if not up to, migration storage is carried out according to original storage mode.
S103：Judge access frequency whether in the stabilization regional extent value of storage threshold value.
To avoid access frequency that minor variations occur in the embodiment of the present invention, cause data fast frequently in two kinds of storage mediums
Between the phenomenon that moves, for storage threshold value determines a stabilization regional extent value, stabilization regional extent value is to prevent data block from existing
The excursion interval value of the storage threshold value migrated between different storage mediums.
During carrying out data block in the embodiment of the present invention, if access frequency reaches the storage thresholding for carrying out data block migration
Whether value, then determine whether access frequency in the stabilization regional extent value of storage threshold value.If access frequency is in storage door
In limit value stabilization regional extent value, then S104 is carried out, do not carry out data block migration, moved with eliminating unnecessary data.If visiting
Ask that frequency not in the stabilization regional extent value of storage threshold value, then carries out S105, data block migration is visited to data block is met
In asking the storage medium of frequency.
S104：Not migrating data block.
In the embodiment of the present invention, if the access frequency of data block reaches the storage threshold value for being migrated, but in storage door
In the stabilization regional extent value of limit value, then data block migration is not carried out, moved with eliminating unnecessary data.Such as access frequency
【1, M】In the range of data block, storage in low performance layer, the data block near storage threshold value M be easy to because
There are minor variations in access frequency, and reach the storage threshold value M for carrying out data block migration, if according to legacy migration method,
Storage access frequency can be moved to exist【M+1, M+N】In the range of data block secondary high-performance layer in store, the embodiment of the present invention
In after data block access frequency reaches the storage threshold value M for carrying out data block migration, determine whether the access of data block frequently
Rate whether in the stabilization regional extent value of storage threshold value M, if in stabilization regional extent value, data block not being carried out and being moved
Move, will data block storage in low performance storage medium, without migrating into the storage medium of secondary high-performance layer, prevent data
Block is frequently moved.
S105：By in the storage medium of data block migration to the access frequency for meeting data block.
Data block migration method provided in an embodiment of the present invention, during carrying out data block migration, by access frequency with deposit
After storing up threshold value relatively, also determine whether the access frequency whether in the stabilization regional extent value for storing threshold value
It is interior, if the access frequency of data block it is determined that storage threshold value stabilization regional extent value in, not migrating data block, therefore energy
Enough avoid access frequency that the data block of minor variations frequent migration between different storage mediums occurs, and then improve storage system
Service feature.
Carried out in the embodiment of the present invention during data block migration, by access frequency and storage threshold value, or will accessed
Frequency is compared with the stabilization regional extent value of storage threshold value, primarily directed between the adjacent storage medium of performance rate
Storage threshold value, and the storage threshold value between the adjacent storage medium of performance rate stabilization regional extent value, therefore this
Need to predefine preventing for the storage threshold value in storage system between the adjacent storage medium of performance rate in inventive embodiments
Tremble regional extent value.
The embodiment of the present invention below with reference to practical application to it is above-mentioned carry out data block migration during, it is determined that storage door
The stabilization regional extent value of limit value, to realize the nonmigratory process of data in the stabilization regional extent value of storage threshold value,
It is described in detail.
In the embodiment of the present invention when it is determined that storing the stabilization regional extent value of threshold value, can be by a stabilization factor come really
It is fixed.Get the stabilization factor-beta of the stabilization regional extent value for determining storage threshold value, and the storage threshold value for determining
TH, by [TH* (1- β), TH* (1+ β)], used as the stabilization regional extent value of the storage threshold value of storage medium, wherein TH is to deposit
In the access frequency of the data block on storage medium border, β is the stabilization factor, β ∈ (0,1) to storage threshold value, i.e. ranking.Such as Fig. 2
It is shown, there are storage medium 1 and storage medium 2 in data hierarchy storage system, storage medium 1 can store M data block, access
The access frequency that frequency ranking is located at the data block at M is TH, then the storage threshold value of storage medium 1 is TH, if the stabilization factor
It is β, then when data (model dotted line between in Fig. 2 of the access frequency in the range of [TH* (1- β), TH* (1+ β)] of data block
In enclosing), can all keep the storage medium of former storage constant.
The access frequency TH of above-mentioned data is determined by data actual access situation in the embodiment of the present invention, the present invention
The above-mentioned preferable following manner of stabilization factor-beta in embodiment：
A：By default fixed value, as the stabilization factor of the stabilization regional extent value for determining storage threshold value.
The embodiment of the present invention can according to actual conditions, to hierarchical stor in the storage threshold value of each storage medium set
A fixed fixed value as the stabilization regional extent value for determining storage threshold value the stabilization factor, the default fixed value can be with
It is empirical value.
The implementation of the stabilization factor is determined in the embodiment of the present invention by the way of above-mentioned predetermined fixed value, by stabilization because
Son is set as fixed value, then when it is determined that storing the stabilization regional extent value of threshold value, the storage that directly can be obtained according to monitoring
Threshold value, carries out the determination of the stabilization regional extent value of storage threshold value, and implementation is simple.If the access frequency of data block exists
In the stabilization regional extent value, then keep the currently stored storage medium of data constant, do not carry out data block migration, prevent data
The frequent migration of the data block in Bedding storage system, reduces influence of the data block frequent migration to host service.
B：According to different traffic pressures, it is determined that the stabilization regional extent value of the storage threshold value for determining storage medium
The stabilization factor.
The current business pressure of Bedding storage system can be obtained in the embodiment of the present invention, is determined to use according to current business pressure
In it is determined that the stabilization factor of the stabilization regional extent value of storage threshold value.By different traffic pressures, the stabilization factor is determined
Process, can the Dynamic Recognition different business pressure corresponding stabilization factor, in real time according to traffic pressure adjustment storage threshold value
Stabilization regional extent value, there is provided the service feature of system.
The numerical value of the corresponding stabilization factor of the big business of traffic pressure is preferably provided with the embodiment of the present invention, less than business pressure
The numerical value of the corresponding stabilization factor of the small business of power, tries one's best so as to the hot spot data for making traffic pressure big and moves to high performance depositing
In storage media, the small data of traffic pressure are maintained in the storage medium of former low performance as far as possible, further improve data hierarchy and deposit
Storage system service feature.
It should be noted that determining that the implementation of the stabilization factor can be not limited to above two side in the embodiment of the present invention
Formula, can also be other implementations, and the embodiment of the present invention is not limited.
Data block migration method provided in an embodiment of the present invention, according to threshold value and the default stabilization factor is stored, really
Surely the stabilization regional extent value of threshold value is stored, if the access frequency hair of data block is located at the stabilization regional extent of storage threshold value
In value, keep the currently stored storage medium of data block constant, the data block of access frequency generation minor variations can be avoided to exist
Frequent migration between different storage mediums, and then improve data hierarchy storage system service feature.
The data block migration method provided in the embodiment of the present invention can be applied to single memory node, can also be applied to have
In the aggregated structure of multiple memory nodes.Be applied to the application scenarios of single memory node, then can the single storage section of direct access
The access frequency of the data in each storage medium in point, and carry out the storage threshold value stabilization of each storage medium on memory node
The determination of regional extent value.When being applied in aggregated structure, the cold and hot standard of the determination data block on each memory node is not
Equally, i.e., the data block for thinking that temperature is higher for being stored on memory node A, can be higher than not necessarily to be stored on memory node B
Think to be the relatively low data block of temperature.Therefore to prevent the frequent migration of the data block in aggregated structure in the embodiment of the present invention,
The access frequency of the data stored in each storage medium on each memory node in aggregated structure can be obtained；Storage to obtaining exists
The access frequency of the data on each memory node in each storage medium, again ranking obtains total data in aggregated structure
Access frequency ranking.Then further according to aggregated structure in each storage medium capacity carry out store threshold value stabilization region model
Enclose the determination of value.
Fig. 3 show the aggregated structure schematic diagram for including multiple memory nodes, and the control centre in aggregated structure can be right
Each memory node is monitored management, for example, can obtain the access frequency of the data block stored on each memory node, and controls
Making each memory node carries out migration storage of data etc..
Fig. 4 is, using data block migration method provided in an embodiment of the present invention, data block migration to be carried out in aggregated structure
Control process method realize flow chart, the executive agent of the method can be the control centre in aggregated structure, also may be used certainly
To be independently of the control unit with corresponding function of control centre, the embodiment of the present invention is not limited.As shown in figure 3, should
Method includes：
S201：The access frequency of the data block stored in each storage medium on each memory node in acquisition aggregated structure.
S202：The access frequency of data block of the storage in each storage medium on each memory node to obtaining, again
Ranking, obtains the access frequency ranking of all data blocks in aggregated structure.
S203：According to whole numbers in the capacity and aggregated structure of each storage medium on each memory node in aggregated structure
According to the access frequency ranking of block, it is determined that storage threshold value.
Storage medium in the embodiment of the present invention on each memory node may be identical, it is also possible to different, therefore the present invention is implemented
For storage media types identical storage medium in example, when determining the capacity of storage medium, type identical can be stored and be situated between
The capacity of matter and the capacity as such storage medium.The storage medium different for storage media types, then can directly will be every
Itself capacity of the storage medium of one type is used as the memory capacity for corresponding to storage media types.
After the capacity of whole storage mediums in aggregated structure is determined, then can be by the visit of all data blocks in aggregated structure
Frequency ranking is asked, data block access frequency of the ranking at the storage medium boundary position between adjacent storage medium is determined, made
It is storage threshold value.
S204：It is determined that the stabilization regional extent value of storage threshold value.
It is determined that the stabilization regional extent value of storage threshold value see the associated description in above-described embodiment, no longer go to live in the household of one's in-laws on getting married herein
State.
S205：The stabilization regional extent value of the storage threshold value that will be determined, is distributed to each memory node.
In the embodiment of the present invention, to reduce the load of control centre, the stabilization region model of the storage threshold value that will can be determined
Enclose value and be distributed to each memory node, the control of data block migration storage is carried out by each memory node.
S206：Control each memory node according to the stabilization regional extent value of the storage threshold value for determining, carry out data block and move
Move past process control.
What each memory node can not consider the data of storage itself in the embodiment of the present invention is cold spot data or focus number
According to, can determine whether data block access frequency ranking whether storage threshold value stabilization regional extent value in；If so, not entering line number then
Migrated according to block, keep the currently stored storage medium of data block constant；If it is not, then moving to data block and meeting data block
Stored in the storage medium of access frequency ranking.
In the embodiment of the present invention, in aggregated structure, storage medium that each memory node is issued using control centre is deposited
Storage threshold value stabilization regional extent value carry out data migration control, it is not intended that data this node be hot spot data or
Cold spot data, can carry out preventing access frequency from the data of minor variations occurring between different storage mediums in aggregated structure
Frequent migration, and then improve data hierarchy storage system service feature.
It should be noted that the implementation process in the embodiment of the present invention shown in Fig. 4 is carried out only as preferred embodiment
For example, concrete implementation mode is not limited thereto, the storage threshold value that for example be able to also will not be determined using control centre
Stabilization regional extent value be issued to each memory node, but after the stabilization regional extent value that storage threshold value is determined, directly
The step of tapping into row access frequency and whether judge in the stabilization regional extent value for storing threshold value, and according to judged result control
The migration storing process of the data block stored in each memory node.
Based on the data block migration method that above-described embodiment is provided, the embodiment of the present invention also provides a kind of data migration device
500, as shown in Figure 5A, the device 500 includes statistic unit 501, judging unit 502 and migration units 503, wherein：
Statistic unit 501, for the access frequency of statistics block.
Whether judging unit 502, the access frequency for judging the statistics of statistic unit 501 reaches and carries out data block migration
Whether storage threshold value, if access frequency reaches the storage threshold value for carrying out data block migration, judge access frequency in storage
In the stabilization regional extent value of threshold value, stabilization regional extent value is to prevent data block from being migrated between different storage mediums
Storage threshold value excursion interval value.
Migration units 503, if being that access frequency is not storing the stabilization of threshold value for the judged result of judging unit 502
In regional extent value, then by data block migration to the storage medium for meeting data block access frequency；If judging unit 502 is sentenced
Disconnected result is the access frequency in the stabilization regional extent value of the storage threshold value, then not migrating data block.
In the first implementation, device 500 also includes determining unit 504, as shown in Figure 5 B, wherein,
Determining unit 504, for determining the storage threshold value in storage system between the adjacent storage medium of performance rate
Stabilization regional extent value.
With reference to the first implementation, in second implementation, device 500 also includes acquiring unit 505, such as Fig. 5 C
It is shown, wherein,
Acquiring unit 505, the stabilization factor-beta for obtaining the stabilization regional extent value for determining storage threshold value.
Determining unit 504, deposits specifically for determining in data hierarchy storage system that performance rate is adjacent as follows
The stabilization regional extent value of the storage threshold value between storage media：
By [TH* (1- β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium.
Wherein, TH is storage threshold value, and β is the stabilization factor, β ∈ (0,1).
In the third implementation, acquiring unit 505, specifically for obtaining as follows for determining storage thresholding
The stabilization factor-beta of the stabilization regional extent value of value：
By default fixed value, as the stabilization factor of the stabilization regional extent value for determining storage threshold value.
In the 4th kind of implementation, acquiring unit 505, specifically for obtaining as follows for determining storage thresholding
The stabilization factor-beta of the stabilization regional extent value of value：
According to the traffic pressure of data hierarchy storage system, the stabilization regional extent value for determining storage threshold value is obtained
Stabilization factor-beta.
Wherein, the numerical value of the corresponding stabilization factor of the big business of traffic pressure, the business small less than traffic pressure is corresponding
The numerical value of the stabilization factor.
In the 5th kind of implementation, acquiring unit 505 is additionally operable to：
The access frequency of the data block stored in each storage medium on each memory node in acquisition aggregated structure.
According to the access frequency of the storage each data block on each memory node for obtaining, to number whole in aggregated structure
Ranking is carried out according to block.
In the 6th kind of implementation, device 500 also includes issuance unit 506 and control unit 507, as shown in Figure 5 D,
Wherein：
Issuance unit 506, after the stabilization regional extent value for storing threshold value is determined in determining unit 504, to
Each memory node in aggregated structure, issues the stabilization regional extent value of the storage threshold value of determination.
Control unit 507, the judging unit 502 for controlling each memory node in aggregated structure judges each respectively
Storage medium in the access frequency of data block that stores in the adjacent storage medium of performance rate, if adjacent deposited corresponding
In the stabilization regional extent value of the storage threshold value between storage media.
Data storage device provided in an embodiment of the present invention, in carrying out data storage procedure, it is determined that after storage threshold value, also
The stabilization regional extent value of storage threshold value is determined, by judging that the adjacent storage of performance rate is situated between in each storage medium respectively
The access frequency of the data block stored in matter, if the stabilization region of the storage threshold value between corresponding adjacent storage medium
In value range, if the access frequency of data block it is determined that storage threshold value stabilization regional extent value in, keep data block
Currently stored storage medium is constant, thus can avoid access frequency occur minor variations data block different storage mediums it
Between frequent migration, and then improve data hierarchy storage system service feature.
Above-mentioned data storage device in the embodiment of the present invention, can be independent part, it is also possible to be integrated with other portions
In part, such as said apparatus provided in an embodiment of the present invention can be controller in data sense of propriety storage system, or
It is integrated in the new part in controller.
It should be noted that in the embodiment of the present invention in data storage device the functional realiey of modules/unit and
Interactive mode can be with further reference to the description of related method embodiment.
Based on the data block migration method and apparatus that above-described embodiment is provided, the embodiment of the present invention also provides a kind of data block
Moving apparatus 600, as shown in fig. 6, the data block migration device 600 includes processor 601, memory 602 and bus 603, its
Middle processor 601 and memory 602 are connected with bus 603.
Processor 601 can be a general central processor (CPU) in the embodiment of the present invention, and microprocessor is specific to answer
With integrated circuit (application-specific integrated circuit, ASIC), or one or more are used to control
The integrated circuit that the present invention program program is performed.
Memory 602 can be read-only storage (read-only memory, ROM) or can store static information and refer to
The other kinds of static storage device of order, random access memory (random access memory, RAM) or can store
Information and the other kinds of dynamic memory, or EEPROM of instruction
(Electrically Erasable Programmable Read-Only Memory, EEPROM), read-only optical disc (Compact
Disc Read-Only Memory, CD-ROM) or other optical disc storages, laser disc storage (including compression laser disc, laser disc, light
Dish, Digital Versatile Disc, Blu-ray Disc etc.), magnetic disk storage medium or other magnetic storage apparatus or can be used in carry or
Storage have instruction or data structure form desired program code and can by any other medium of computer access, but
Not limited to this.These memories are connected by bus with processor.
Bus 603 may include a path, for being communicated between processor 601 and memory 602.
Memory 602 in the embodiment of the present invention, the program code for storing the execution of processor 601.
Processor 601, for the program code for calling memory 602 to store, implements function such as：
The access frequency of statistics block.
Judge whether access frequency reaches the storage threshold value for carrying out data block migration.
If access frequency reaches the storage threshold value for carrying out data block migration, judge access frequency whether in storage thresholding
In the stabilization regional extent value of value, stabilization regional extent value is depositing of preventing data block from being migrated between different storage mediums
Store up the excursion interval value of threshold value.
If access frequency is not in the stabilization regional extent value of storage threshold value, by data block migration to meeting data block
In the storage medium of access frequency.
If access frequency is in the stabilization regional extent value of storage threshold value, not migrating data block.
In the first implementation, processor 601 is additionally operable to：
Determine the stabilization regional extent value of the storage threshold value in storage system between the adjacent storage medium of performance rate.
In second implementation, processor 601 specifically for determining performance rate in storage system as follows
The stabilization regional extent value of the storage threshold value between adjacent storage medium：
Obtain the stabilization factor-beta of the stabilization regional extent value for determining the storage threshold value；
By [TH* (1- β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium；
Wherein, TH is storage threshold value, and β is the stabilization factor, β ∈ (0,1).
In the third implementation, processor 601 specifically for obtaining for determining the storage door as follows
The stabilization factor-beta of the stabilization regional extent value of limit value：
By default fixed value, as the stabilization factor of the stabilization regional extent value for determining the storage threshold value.
In the 4th kind of implementation, processor 601 specifically for obtaining for determining the storage door as follows
The stabilization factor-beta of the stabilization regional extent value of limit value：
According to the traffic pressure of data hierarchy storage system, the stabilization region model for determining the storage threshold value is obtained
Enclose the stabilization factor-beta of value；
Wherein, the numerical value of the corresponding stabilization factor of the big business of traffic pressure, the business small less than traffic pressure is corresponding
The numerical value of the stabilization factor.
In the 5th kind of implementation, processor 601 is used to obtain in aggregated structure that each storage to be situated between on each memory node
The access frequency of the data block stored in matter；
Processor 601 is carried out specifically for access frequency as follows according to each data block for obtaining to data block
Ranking：
According to the access frequency of the storage each data block on each memory node for obtaining, to number whole in aggregated structure
Ranking is carried out according to block.
In the 6th kind of implementation, processor 601 is additionally operable to：
It is determined that after the stabilization regional extent value of storage threshold value, to each memory node in aggregated structure, issuing really
The stabilization regional extent value of the fixed storage threshold value；
Each memory node in control aggregated structure judges the visit of the database stored in respective storage medium respectively
Ask frequency, if in the stabilization regional extent value of the storage threshold value.
It should be noted that in the embodiment of the present invention in data storage device the functional realiey of modules/unit and
Interactive mode can be with further reference to the description of related method embodiment.
Data block migration device provided in an embodiment of the present invention, during carrying out data block migration, it is determined that storage threshold value
Afterwards, further define storage threshold value stabilization regional extent value, by judging each storage medium respectively in performance rate it is adjacent
The access frequency of the data block stored in storage medium, if storage threshold value between corresponding adjacent storage medium is prevented
Tremble in regional extent value, if the access frequency of data block it is determined that storage threshold value stabilization regional extent value in, keep
The currently stored storage medium of data block is constant, therefore can avoid access frequency that the data block of minor variations occurs in different storages
Frequent migration between medium, and then improve data hierarchy storage system service feature.
Obviously, those skilled in the art can carry out various changes and modification without deviating from essence of the invention to the present invention
God and scope.So, if these modifications of the invention and modification belong to the scope of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to comprising these changes and modification.
Claims (10)
1. a kind of data block migration method, is applied to storage system, and the storage system includes different at least two of performance rate
Plant storage medium, it is characterised in that methods described includes：
Count the access frequency of the data block；
Judge whether the access frequency reaches the storage threshold value for carrying out data block migration；
If the access frequency reaches the storage threshold value for carrying out data block migration, judge the access frequency whether described
Store in the stabilization regional extent value of threshold value, the stabilization regional extent value is to prevent data block between different storage mediums
The excursion interval value of the storage threshold value for being migrated；
If the access frequency is not in the stabilization regional extent value of the storage threshold value, by the data block migration to symbol
In the storage medium of conjunction data block access frequency；
If the access frequency does not migrate the data block in the stabilization regional extent value of the storage threshold value.
2. the method for claim 1, it is characterised in that methods described also includes：
Determine the stabilization regional extent value of the storage threshold value in the storage system between the adjacent storage medium of performance rate.
3. method as claimed in claim 2, it is characterised in that performance rate is adjacent in the determination storage system deposits
The stabilization regional extent value of the storage threshold value between storage media, including：
Obtain the stabilization factor-beta of the stabilization regional extent value for determining the storage threshold value；
By [TH* (1- β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium；
Wherein, TH is storage threshold value, and β is the stabilization factor, β ∈ (0,1).
4. method as claimed in claim 3, it is characterised in that obtain the stabilization region model for determining the storage threshold value
The stabilization factor-beta of value is enclosed, including：
By default fixed value, as the stabilization factor of the stabilization regional extent value for determining the storage threshold value.
5. method as claimed in claim 3, it is characterised in that obtain the stabilization region model for determining the storage threshold value
The stabilization factor-beta of value is enclosed, including：
According to the traffic pressure of storage system, obtain the stabilization of stabilization regional extent value for determining the storage threshold value because
Sub- β；
Wherein, the numerical value of the corresponding stabilization factor of the big business of traffic pressure, the business corresponding stabilization small less than traffic pressure
The numerical value of the factor.
6. a kind of data block migration device, is applied to storage system, and the storage system includes different at least two of performance rate
Plant storage medium, it is characterised in that including：Statistic unit, judging unit and migration units, wherein：
The statistic unit, the access frequency for counting the data block；
Whether the judging unit, the access frequency for judging the statistic unit statistics reaches and carries out data block migration
Storage threshold value, if the access frequency reaches the storage threshold value for carrying out data block migration, judge the access frequency
Whether in the stabilization regional extent value of the storage threshold value, the stabilization regional extent value is to prevent data block from being deposited in difference
The excursion interval value of the storage threshold value migrated between storage media；
The migration units, if for the judging unit judged result for the access frequency not in the storage threshold value
Stabilization regional extent value in, then by the data block migration to the storage medium for meeting data block access frequency；If described
The judged result of judging unit is the access frequency in the stabilization regional extent value of the storage threshold value, then do not migrate institute
State data block.
7. device as claimed in claim 6, it is characterised in that described device also includes determining unit, wherein,
The determining unit, for determining the storage threshold value in the storage system between the adjacent storage medium of performance rate
Stabilization regional extent value.
8. device as claimed in claim 7, it is characterised in that described device also includes acquiring unit, wherein,
The acquiring unit, the stabilization factor-beta for obtaining the stabilization regional extent value for determining the storage threshold value；
The determining unit, specifically for determine as follows in the storage system the adjacent storage medium of performance rate it
Between storage threshold value stabilization regional extent value：
By [TH* (1- β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium；
Wherein, TH is storage threshold value, and β is the stabilization factor, β ∈ (0,1).
9. device as claimed in claim 8, it is characterised in that the acquiring unit, specifically for obtaining use as follows
In it is determined that the stabilization factor-beta of the stabilization regional extent value of the storage threshold value：
By default fixed value, as the stabilization factor of the stabilization regional extent value for determining the storage threshold value.
10. device as claimed in claim 8, it is characterised in that the acquiring unit, specifically for obtaining use as follows
In it is determined that the stabilization factor-beta of the stabilization regional extent value of the storage threshold value：
According to the traffic pressure of storage system, obtain the stabilization of stabilization regional extent value for determining the storage threshold value because
Sub- β；
Wherein, the numerical value of the corresponding stabilization factor of the big business of traffic pressure, the business corresponding stabilization small less than traffic pressure
The numerical value of the factor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410431442.1A CN104239230B (en) | 2014-08-28 | 2014-08-28 | A kind of data block migration method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410431442.1A CN104239230B (en) | 2014-08-28 | 2014-08-28 | A kind of data block migration method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104239230A CN104239230A (en) | 2014-12-24 |
| CN104239230B true CN104239230B (en) | 2017-06-09 |
Family
ID=52227344
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410431442.1A Active CN104239230B (en) | 2014-08-28 | 2014-08-28 | A kind of data block migration method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104239230B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9760310B2 (en) | 2015-08-06 | 2017-09-12 | International Business Machines Corporation | High performance data storage management using dynamic compression |
| CN107870735B (en) * | 2016-09-28 | 2021-01-05 | 华为技术有限公司 | Data management method, device and equipment |
| CN110674086A (en) * | 2019-09-29 | 2020-01-10 | 广州华多网络科技有限公司 | Data merging method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6035377A (en) * | 1997-12-17 | 2000-03-07 | Ncr Corporation | Method and apparatus for determining memory pages having greatest frequency of access in a non-uniform memory access computer system |
| CN102117248A (en) * | 2011-03-09 | 2011-07-06 | 浪潮(北京)电子信息产业有限公司 | Caching system and method for caching data in caching system |
| CN102156738A (en) * | 2011-04-13 | 2011-08-17 | 成都市华为赛门铁克科技有限公司 | Method for processing data blocks, and data block storage equipment and system |
| CN103336670A (en) * | 2013-06-04 | 2013-10-02 | 华为技术有限公司 | Method and device for automatic distribution of data blocks based on data temperature |
-
2014
- 2014-08-28 CN CN201410431442.1A patent/CN104239230B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6035377A (en) * | 1997-12-17 | 2000-03-07 | Ncr Corporation | Method and apparatus for determining memory pages having greatest frequency of access in a non-uniform memory access computer system |
| CN102117248A (en) * | 2011-03-09 | 2011-07-06 | 浪潮(北京)电子信息产业有限公司 | Caching system and method for caching data in caching system |
| CN102156738A (en) * | 2011-04-13 | 2011-08-17 | 成都市华为赛门铁克科技有限公司 | Method for processing data blocks, and data block storage equipment and system |
| CN103336670A (en) * | 2013-06-04 | 2013-10-02 | 华为技术有限公司 | Method and device for automatic distribution of data blocks based on data temperature |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104239230A (en) | 2014-12-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2016165441A1 (en) | Migration policy adjustment method, capacity-change suggestion method and device | |
| CN104462240A (en) | Method and system for realizing hierarchical storage and management in cloud storage | |
| CN104536909B (en) | A kind of memory management method, memory management unit and storage device | |
| CN110825324B (en) | Hybrid storage control method and hybrid storage system | |
| EP3367251A1 (en) | Storage system and solid state hard disk | |
| CN105786401A (en) | Data management method and device in server cluster system | |
| CN103399713B (en) | The data buffering method of balance dynamic data attemper performance and solid-state disk service life | |
| CN103747047A (en) | CDN file storage method, file distribution control center and system thereof | |
| WO2017036428A2 (en) | Capacity change suggestion method and device | |
| CN104239230B (en) | A kind of data block migration method and device | |
| EP2846266B1 (en) | Buffering management method and apparatus for non-volatile storage device | |
| CN104268099A (en) | Management data reading and writing method and device | |
| CN102156738A (en) | Method for processing data blocks, and data block storage equipment and system | |
| CN106484330A (en) | A kind of hybrid magnetic disc individual-layer data optimization method and device | |
| CN104881369B (en) | Towards the low memory cost hotspot data identification method of mixing storage system | |
| CN103078933A (en) | Method and device for determining data migration time | |
| US20190220231A1 (en) | Method, apparatus and computer program product for managing storage system | |
| US9612746B1 (en) | Allocation method for meeting system performance and application service level objective (SLO) | |
| CN103617007A (en) | Method and system for achieving multilevel intelligent storage | |
| CN104641355A (en) | Adaptive service timeouts | |
| CN106021492B (en) | Method and device for unloading form data | |
| CN102082701A (en) | Method for storing network element positional information and apparatus for same | |
| CN111506425B (en) | Method and device for processing quality of service data | |
| CN110018797B (en) | Data migration method, device and equipment and readable storage medium | |
| CN105808150A (en) | Solid state disk caching system for hybrid storage device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |