CN102096558A - Data storage method and device - Google Patents

Data storage method and device Download PDF

Info

Publication number
CN102096558A
CN102096558A CN 201110022762 CN201110022762A CN102096558A CN 102096558 A CN102096558 A CN 102096558A CN 201110022762 CN201110022762 CN 201110022762 CN 201110022762 A CN201110022762 A CN 201110022762A CN 102096558 A CN102096558 A CN 102096558A
Authority
CN
China
Prior art keywords
data
written
band
verification
writing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 201110022762
Other languages
Chinese (zh)
Inventor
邓兴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou H3C Technologies Co Ltd
Original Assignee
Hangzhou H3C Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou H3C Technologies Co Ltd filed Critical Hangzhou H3C Technologies Co Ltd
Priority to CN 201110022762 priority Critical patent/CN102096558A/en
Publication of CN102096558A publication Critical patent/CN102096558A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a data storage method and a data storage device, which are applied to a system comprising storage equipment and monitoring equipment. Data, which is to be written into a redundant array of inexpensive disc 5 (RAID5), of each monitoring equipment is stored in the write cache of the storage equipment. The method comprises the following steps of: when first data to be written in the write cache meets a writing condition and if the first data to be written cannot fill an entire strip outside a check sum in the RAID5, calculating a first check sum according to the first data to be written, writing the first data to be written into the strip of the RAID5 and recording the position information and the first check sum of the strip; and when second data to be written in the write cache meets a writing condition and if the second data to be written and the first data to be written fill the entire strip outside the check sum in the RAID5, calculating a second check sum according to the second data to be written and the first data to be written and writing the second check sum and the second data to be written into a corresponding strip according to the position information of the strip. By the method and the device, the writing performance of the RAID5 is enhanced.

Description

A kind of storage means of data and device
Technical field
The present invention relates to field of data storage, particularly relate to a kind of storage means and device of data.
Background technology
RAID (Redundant Array of Inexpensive Disks, redundant arrays of inexpensive disks) is the memory technology of a kind of high-performance, high reliability, by a series of independent disks are combined by different way, for application terminal or terminal cluster provide in logic disk.Wherein, the RAID technology has been widely used in the various occasions of data storage, and the RAID5 in the RAID technology is made up of the polylith disk, and with mode disk write data in array of band, and parity data is left on each disk in the array.
In the monitoring field,,, can store the general RAID5 algorithm that uses in the practical application in order to improve the reliability of system by the RAID5 array for the monitor data (as the video recording resource of record) of watch-dog (as monitoring camera).
Concrete, in order to store monitor data, need on the RAID5 array, to mark off in advance logical resource.And, can become digitized Media Stream, and be written in the logical resource of RAID5 array partition through encoding compression at the video recording resource that monitoring camera writes down.
In the practical application, how many road monitoring cameras the RAID5 array can support use simultaneously, determined monitor system performance, the monitoring way of this support is determined by following parameter: the available capacity A of (1) RAID5 array (data hard disk number among capacity A=single hard disk capacity * RAID5); The capacity B that (2) one road monitoring cameras need (time of the code stream bandwidth of this monitoring camera of capacity B=* needs storage); (3) the performance P of RAID5 array, performance P can bear IO (the Input Output of how many monitoring cameras simultaneously for the RAID5 array, input and output) order, the P value is taken advantage of " the hard disk number of forming the RAID5 array " for " performance of forming a hard disk of RAID5 array " in theory, and in fact owing to soft, the hardware loss of RAID5 algorithm, actual performance P lacks than theoretical performance.
Based on above-mentioned parameter, the supported monitoring way of RAID5 array L=A/B; Becoming the bottleneck that monitoring is used if the performance P of RAID5 array during less than L, then represents the performance of RAID5 array, therefore, by optimizing soft, the hardware algorithm of RAID5, improve the performance of RAID5 array, avoid performance bottleneck, is the key in the supervisory system.
As shown in Figure 1, be a kind of process synoptic diagram at RAID5 array stores data, the RAID5 array is made up of 7 hard disks, and horizontal line, left oblique line and right oblique line are represented the data that 3 road monitoring cameras produce, and vertical line is represented at the verification of monitoring camera and data.
The needs that monitoring camera is produced are written to the data in the RAID5 array, from Logic Volume (logical volume, the virtual disk that is formed by logic magnetic disc) entering Write Cache (writes buffer memory, generally realize by the high-speed internal memory in the RAID5 array), data concerning monitoring camera write and finished this moment.
Afterwards, with the data among the Write Cache generate verification and, and according to dispatching algorithm with data among the Write Cache and verification be written in the hard disk of RAID5 array; Wherein, each horizontal stripe is called band in the hard disk, and each band corresponding data block on single hard disk is called the band piece.
In the prior art, the process that the data among the Write Cache are write the RAID5 array can be divided into the whole piece band and write with the part band and write (reading to rewrite).Prepare when complete at each band blocks of data of whole band, adopt the whole piece band to write, only need finish write operation one time for each band.
When whole band has only the data of part band piece, adopt the part band to write, the band piece of corresponding band is read out, calculate new verification and, the band piece that will need then to upgrade writes corresponding data hard disk, with new verification with write on the verification hard disk.
For example, the data block of P is a parity data, is calculated by the data XOR in each band, has stored data A1, B1, C1, D1, E1, F1, P1 in the band 1; There are data A2, B2 and C2 to be written to band 1 among the Write Cache with part band WriteMode, then at first from band 1, read D1, E1, F1, calculate new verification and P2 according to A2, B2, C2, D1, E1, F1, and A2, B2, C2, P2 are write the position of A1, B1, C1, P1 correspondence in band 1.
Afterwards, when data D2, E2 are arranged among the Write Cache, when F2 need be written to band 1, then from band 1, read A2, B2, C2, calculate new verification and P2 ' according to A2, B2, C2, D2, E2, F2, and D2, E2, F2, P2 ' are write the position of D1, E1, F1, P2 correspondence in band 1.
To sum up can find out,, then can know the performance of RAID5 array, mainly data be write the performance decision of hard disk by Write Cache among the RAID5 because the data of monitoring are the continual RAID5 of writing arrays.And when adopting the part band to write, increased the read operation (as the read operation of D1, E1, F1, A2, B2, C2 etc.) of data disks, and further because the read or write number of times (performance of hard disk) that can finish of hard disk per second is certain, so the operation write of the part band performance of having wasted hard disk.And be subjected to the influence of the monitoring way that the size of Write Cache and RAID5 array support, the size of band piece etc. in the practical application, when data write the band of RAID5 array in each Write Cache, can not guarantee that the whole piece band writes, and reduce hard disk performance when adopting the part band to write.
For example, the RAID5 array of 9 blocks of data hard disks (8 blocks of data dishes, one block check dish), each band block size 128KB, each stripe size be 128KB * 8=1MB (in the check disk storage verification and, do not store data), the Write Cache that 10MB is arranged, support the data of 10 road monitoring cameras to write,, will take 10MB Write Cache when 10 road monitoring cameras gather together enough the whole piece band when writing.
Take the RAID5 array for fear of Write Cache and can not respond write order, need under the situation that WriteCache is not taken, start the operation of writing dish, therefore there are some data (is example with data A) in band, to write with part band WriteMode, and after the data of this band remainder (is example with data B) are received, also will in band, write with part band WriteMode, thereby make data A and data B write band at twice, and write at every turn the process that reads data in this band is all arranged, promptly write fashionablely this band being carried out data, 2 read operations and 2 write operations are arranged.Compare with write-once, significantly reduced the performance of RAID5 array, thereby reduce the supported monitoring camera way of RAID5 array.
Summary of the invention
The invention provides a kind of storage means and device of data, to improve the performance of RAID5 array.
In order to achieve the above object, the invention provides a kind of storage means of data, be applied to comprise in the system of memory device and watch-dog, described memory device adopts RAID5 array stores data, and the data of writing the RAID5 array to be written of having stored each watch-dog in the buffer memory of described memory device, this method may further comprise the steps:
First of the same band data to be written arrive Writing condition in writing buffer memory, if described first data to be written can not take verification in the RAID5 array and outside whole band the time, according to described first data computation first verification to be written and, described first data to be written are written in the band of RAID5 array, and write down the positional information of described band and described first verification and;
Second of the same band data to be written arrive Writing condition in writing buffer memory, and described second data to be written and described first data to be written take verification in the RAID5 array and outside whole band the time, according to described second data to be written and described first verification and calculate second verification and, and according to the positional information of described band will described second verification and, described second data to be written are written in the band of correspondence.
Wherein, described first data to be written are written in the band of RAID5 array, also comprise afterwards: the storage space in the buffer memory write that discharges described first data occupancy to be written;
Described second data to be written are written in the corresponding band, also comprise afterwards: the storage space in the buffer memory write that discharges described second data occupancy to be written.
Wherein, according to the positional information of described band with described second verification and, described second data to be written are written in the corresponding band, also comprise afterwards: remove the positional information of described band of record and described first verification and.
Wherein, the data that are stored on each hard disk of RAID5 array are the band piece; Write down the positional information of described band and described first verification and, also comprise afterwards:, lose the band piece by other band pieces in described first data to be written and described first verification and recovery if when in described first data to be written a band lost block being arranged.
Wherein, data are for being written to the data in the RAID5 array in proper order according to constant stream rate.
The invention provides a kind of memory storage of data, be applied to comprise in the system of described memory device and watch-dog as memory device, described device adopts RAID5 array stores data, and the data of writing the RAID5 array to be written of having stored each watch-dog in the buffer memory of described device, this device comprises:
First computing module, be used for arriving Writing condition when first data to be written of writing the same band of buffer memory, if described first data to be written can not take verification in the RAID5 array and outside whole band the time, according to described first data computation first verification to be written and;
First writing module is used for described first data to be written are written to the band of RAID5 array;
Logging modle is connected respectively with first writing module with described first computing module, be used to write down the positional information of described band and described first verification and;
Second computing module, be connected with described logging modle, be used for arriving Writing condition when second data to be written of writing the same band of buffer memory, and described second data to be written and described first data to be written take verification in the RAID5 array and outside whole band the time, according to described second data to be written and described first verification and calculate second verification and;
Second writing module is connected respectively with described second computing module with described logging modle, be used for according to the positional information of described band with described second verification and, described second data to be written are written to corresponding band.
Wherein, this device also comprises:
The space release module is used for discharging the storage space of writing buffer memory of described first data occupancy to be written; And the storage space in the buffer memory write that discharges described second data occupancy to be written.
Wherein, this device also comprises:
The record purge module is connected with described logging modle, be used to remove the positional information of described band of record and described first verification and.
Wherein, the data that are stored on each hard disk of RAID5 array are the band piece; This device also comprises:
Data recovery module is connected with described logging modle, if when being used for described first data to be written a band lost block being arranged, loses the band piece by other band pieces in described first data to be written and described first verification and recovery.
Data are for being written to the data in the RAID5 array in proper order according to constant stream rate.
Compared with prior art, the present invention has the following advantages at least:
Owing to write the cache resources deficiency, can not with whole piece band WriteMode under band storage data conditions, improve the write performance of RAID5 array at the RAID5 array, improve the monitoring way that the RAID5 array is supported.
Description of drawings
Fig. 1 is at the synoptic diagram of RAID5 array stores data in the prior art;
Fig. 2 is a kind of application scenarios synoptic diagram of the present invention;
Fig. 3 is at the storage means process flow diagram of a kind of data that application scenarios proposed of Fig. 2 among the present invention;
Fig. 4 is the memory device structure figure of a kind of data of proposing of the present invention.
Embodiment
Among the present invention, the data of the RAID5 array to be written of same band in writing buffer memory (first data to be written) arrive Writing condition, and can not take verification in the RAID5 array and outside whole band the time, can according to first data computation first verification to be written and, and earlier first data to be written are written in the band of RAID5 array, and write down positional information (as address number etc.) and first verification and (can in internal memory, write down) of this band.
Afterwards, first data to be written in the buffer memory are write in removing, and can be by writing the data (second data to be written) that buffer memory continues storage RAID5 array to be written, when second data to be written of same band arrive Writing condition once more, and second data to be written and first data to be written take verification in the RAID5 array and outside whole band the time, can according to second data to be written and before record first verification and calculate second verification and, and according to the positional information of the band of record before with this second verification and, and second data to be written be written in the corresponding band.Afterwards, remove second data to be written write in the buffer memory, first verification and and the positional information of band of record before.
Describe the present invention below in conjunction with accompanying drawing.
The present invention proposes a kind of storage means of data, be applied to comprise in the system of memory device and watch-dog (a plurality of watch-dog), this memory device adopts RAID5 array stores data, and the data of writing the RAID5 array to be written of having stored each watch-dog in the buffer memory of memory device, application scenarios synoptic diagram as shown in Figure 2, horizontal line, left side oblique line and right oblique line are represented the data that No. 3 watch-dogs (as monitoring camera) produce, these data are the data of RAID5 array to be written, process Logic Volume enters into and writes buffer memory (Write Cache), and vertical line is represented at the verification of watch-dog and data.Among the present invention, the data that watch-dog produces are for being written to the data in the RAID5 array in proper order according to constant stream rate.
At application scenarios shown in Figure 2, as shown in Figure 3, the storage means of data provided by the invention may further comprise the steps:
Step 301, when the data to be written of same band arrive Writing condition in writing buffer memory, judge data to be written whether can take verification in the RAID5 array and outside whole band, if, execution in step 302; Otherwise execution in step 303.
At writing buffer memory and can set in advance Writing condition in the RAID5 array, for example, write when the data to be written of storing in the buffer memory arrive 10M be Writing condition or write data occupancy to be written space in the buffer memory be write 90% o'clock of buffer memory gross space be Writing condition or every 5 minutes for Writing condition etc.In writing buffer memory, store in the process of data at each watch-dog, can arrive the Writing condition that sets in advance.
Write data to be written in the buffer memory at the RAID5 array, need be written in the band of RAID5 array, for convenience of description, in the band of RAID5 array, write data instance with a watch-dog among the present invention.As shown in Figure 2, band piece (data block of each band correspondence on single hard disk) A, B, C, D, E, F and checking data P are bands; If data to be written can take band piece A, B, C, D, E, F, then determine to take verification in the RAID5 array and outside whole band; If data to be written can not take band piece A, B, C, D, E, F, then determine to take verification in the RAID5 array and outside whole band.
Step 302 writes with whole piece band WriteMode the data of writing in the buffer memory to be written in the band of RAID5 array.For example, when data to be written are A1, B1, C1, D1, E1, during F1, can take verification in the RAID5 array and outside whole band, then at first calculation check and
Figure BSA00000422925500071
Figure BSA00000422925500081
Afterwards with A1, B1, C1, D1, E1, F1, P1 is written in the band of RAID5 array with whole piece band WriteMode.
Among the present invention, with A1, B1, C1, D1, E1, F1 also need to discharge A1 after being written in the band of RAID5 array, B1, and C1, D1, E1, F1 take writes storage space in the buffer memory.
Step 303, (convenient according to the data of writing in the buffer memory to be written for distinguishing, with first data instance to be written) calculation check and (with first verification and be example), first data to be written are written in the band of RAID5 array, and write down the positional information of this band and this first verification and.
For example, when first data to be written are A2, B2, C2, during D2, can not take verification in the RAID5 array and outside whole band, then at first calculate first verification and With A2, B2, C2, D2 are written in the band (is example with band X) of RAID5 array afterwards, and positional information (as the address number of band X) and first verification and the X2 of record (as writing down in internal memory) band X.
Among the present invention, first data to be written are written in the band of RAID5 array after, also need to discharge the storage space in the buffer memory write of first data occupancy to be written, as discharging A2, B2, C2, D2 take writes space in the buffer memory.
In the practical application, because the data that watch-dog produces are for constantly being written to the data in the RAID5 array in proper order according to constant stream rate, therefore after writing storage space in the buffer memory and being released, also can continue to store data to be written from watch-dog, and can arrive Writing condition once more, carry out subsequent step.
Step 304, data to be written in writing buffer memory are (convenient for distinguishing, with second data instance to be written) arrive Writing condition once more, and second data to be written and first data to be written take verification in the RAID5 array and outside whole band the time, according to second data to be written and first verification and calculate second verification and.
Among the present invention, at the data to be written of same watch-dog, the second data E2 to be written is arranged, during F2 in writing buffer memory, because A2, B2, C2, D2, E2, F2 take verification in the RAID5 array and outside whole band, then according to E2, F2 and first verification of record before and X2 calculate second verification and
Figure BSA00000422925500091
Step 305, according to the positional information of the band of record before with second verification and, second data to be written are written in the corresponding band.Should be with under the scene, for according to the address number of band X with P2, E2, F2 is written among the band X (A2, B2, C2, the position outside the D2).
Among the present invention, be written to second data to be written in the corresponding band after, also need to discharge the storage space in the buffer memory write of second data occupancy to be written, as discharging E2, F2 takies writes space in the buffer memory.
Among the present invention, with second verification and, after second data to be written are written in the corresponding band, before can also removing the positional information of the band of record and first verification and; As remove address number, first verification and the X2 of the band X that writes down in the internal memory.
Need to prove, in the step 304, second data to be written in writing buffer memory arrive Writing condition once more, and second data to be written and first data to be written still can not take verification in the RAID5 array and outside whole band the time, according to second data to be written and first verification and calculate second verification and.For example, when in writing buffer memory, E2 being arranged, then according to E2 and before the record X2 calculate second verification and.Afterwards, the positional information according to the band that writes down before is written to the second data E2 to be written in the corresponding band; What discharge that E2 takies writes space in the buffer memory, before removing first verification of record and, and write down second verification and.
Afterwards, the 3rd data to be written in writing buffer memory arrive Writing condition once more, and the 3rd data to be written and second data to be written, first data to be written take verification in the RAID5 array and outside whole band the time, execution in step 304 and subsequent step, use second verification in the correlation computations and replace first verification and; By that analogy, taken up to whole band.In actual applications, consider implementation complexity, can be by configuration Write Cache size and band block size, make second data to be written and first data to be written take verification in the RAID5 array with outside whole band.
In addition, it should be noted that, by technical scheme provided by the invention, the situation that influences to RAID5 array data integrality comprises: writing down first verification and afterwards, if when in first data to be written a band lost block being arranged, then can lose the band piece by other band pieces in first data to be written and first verification and recovery.For example, A2, B2, C2 loses a band piece B2 among the D2, then can recover by first verification and the X2 of record,
Figure BSA00000422925500101
With second verification and, after second data to be written are written in the corresponding band,, then can test and the band piece is lost in recovery by other band pieces and second if when in first data to be written, second data to be written a band lost block being arranged.
In sum, because the data of watch-dog are constantly to write the RAID5 array in proper order according to constant stream rate, each band remaining data can be received within a certain period of time, then by adopting technical scheme provided by the invention, has the following advantages:
When data to be written write each band of RAID5 array in writing buffer memory, only take the operation of writing, can not carry out the operation of from band, reading related data, thereby improve the performance of RAID5 array.Under the prerequisite of writing buffer memory capacity and band block size on an equal basis, when the RAID5 array owing to write the cache resources deficiency, can not write under the data conditions with whole piece band WriteMode, improving the write performance of RAID5 array (compares with part band WriteMode, the RAID5 array performance doubles, consider the problem of each hard disk of RAID5 array IO ordering, extra read operation is higher than 1 times to the performance impact of RAID5 array), thereby make when the RAID5 array performance is system bottleneck, the monitoring way of RAID5 array support can increase exponentially, and has reduced the cost that the single channel monitoring is used.And the RAID5 array performance descends can avoid the part band to write the time, causes the delay jitter of the visit RAID5 of system array, and too high delay jitter causes the problem of supervisory system packet loss.
In the realistic simulation test, under the identical situation of Write Cache capacity, RAID5 array hardware condition, 15 RAID5 arrays that (14 blocks of data dishes, 1 block check dish) SATA hard disk is formed, under the situation that has the part band to write, test can be supported the monitor data of the simulation of the about 80 tunnel 4Mbps; And the RAID5 arrays that 9 (8 blocks of data dishes, 1 block check dish) SATA hard disks are formed are not write into the part band under the situation that line data writes each the guarantee, and test can be supported to significantly improve the RAID5 array performance by the monitor data of 200 road 4Mbps simulation.
Based on the inventive concept same with said method, the invention allows for a kind of memory storage of data, be applied to comprise in the system of memory device and watch-dog (a plurality of watch-dog) as memory device, this memory device adopts RAID5 array stores data, and the data of writing the RAID5 array to be written of having stored each watch-dog in the buffer memory of memory device.Wherein, the data that watch-dog produces enter into through Logic Volume and write buffer memory (Write Cache), and for be written to the data in the RAID5 array in proper order according to constant stream rate, as shown in Figure 4, this device comprises:
First computing module 11, be used for arriving Writing condition when first data to be written of writing the same band of buffer memory, and first data to be written can not take verification in the RAID5 array and outside whole band the time, according to described first data computation first verification to be written and.
Wherein, at writing buffer memory and can set in advance Writing condition in the RAID5 array, for example, write when the data to be written of storing in the buffer memory arrive 10M be Writing condition or write data occupancy to be written space in the buffer memory be write 90% o'clock of buffer memory gross space be Writing condition or every 5 minutes for Writing condition etc.In writing buffer memory, store in the process of data at each watch-dog, can arrive the Writing condition that sets in advance.
First writing module 12 is used for described first data to be written are written to the band of RAID5 array.
Logging modle 13 is connected respectively with first writing module 12 with described first computing module 11, be used to write down described band positional information (as the address number of band X) and as described in first verification and.
Space release module 14 is used for after first data to be written are written to the band of RAID5 array, discharges the storage space in the buffer memory write of described first data occupancy to be written; And with second verification and, after second data to be written are written to corresponding band, discharge the storage space in the buffer memory write of second data occupancy to be written.
In the practical application, because the data that watch-dog produces are for being written to the data in the RAID5 array in proper order according to constant stream rate, therefore after writing storage space in the buffer memory and being discharged by space release module 14, also can continue to store data to be written, and can arrive Writing condition once more from watch-dog; Therefore, this device also comprises:
Second computing module 15, be connected with described logging modle 13, be used for arriving Writing condition when second data to be written of writing the same band of buffer memory, and described second data to be written and described first data to be written take verification in the RAID5 array and outside whole band the time, according to described second data to be written and described first verification and calculate second verification and.
Second writing module 16 is connected respectively with described second computing module 15 with described logging modle 13, be used for according to before the positional information of described band of record will described second verification and, described second data to be written are written to the band of correspondence.
Record purge module 17 is connected with described logging modle 13, be used for second verification and, after second data to be written are written to corresponding band, remove the positional information of described band of record and described first verification and.
In addition, the data that are stored among the present invention on each hard disk of RAID5 array are the band piece; The situation that influences at data integrity, data recovery module 18, be connected with described logging modle 13, if when being used for described first data to be written a band lost block being arranged, lose the band piece by other band pieces in described first data to be written and described first verification and recovery.With second verification and, after second data to be written are written in the corresponding band,, then test and the band piece is lost in recovery by other band pieces and second if when in first data to be written, second data to be written a band lost block being arranged.
Wherein, each module of apparatus of the present invention can be integrated in one, and also can separate deployment.Above-mentioned module can be merged into a module, also can further split into a plurality of submodules.
Through the above description of the embodiments, those skilled in the art can be well understood to the present invention and can realize by hardware, also can realize by the mode that software adds necessary general hardware platform.Based on such understanding, technical scheme of the present invention can embody with the form of software product, it (can be CD-ROM that this software product can be stored in a non-volatile memory medium, USB flash disk, portable hard drive etc.) in, comprise some instructions with so that computer equipment (can be personal computer, server, the perhaps network equipment etc.) carry out the described method of each embodiment of the present invention.
It will be appreciated by those skilled in the art that accompanying drawing is the synoptic diagram of a preferred embodiment, module in the accompanying drawing or flow process might not be that enforcement the present invention is necessary.
It will be appreciated by those skilled in the art that the module in the device among the embodiment can be distributed in the device of embodiment according to the embodiment description, also can carry out respective change and be arranged in the one or more devices that are different from present embodiment.The module of the foregoing description can be merged into a module, also can further split into a plurality of submodules.
The invention described above sequence number is not represented the quality of embodiment just to description.
More than disclosed only be several specific embodiment of the present invention, still, the present invention is not limited thereto, any those skilled in the art can think variation all should fall into protection scope of the present invention.

Claims (10)

1. the storage means of data, be applied to comprise in the system of memory device and watch-dog, described memory device adopts RAID5 array stores data, and the data of writing the RAID5 array to be written of having stored each watch-dog in the buffer memory of described memory device, it is characterized in that this method may further comprise the steps:
First of the same band data to be written arrive Writing condition in writing buffer memory, if described first data to be written can not take verification in the RAID5 array and outside whole band the time, according to described first data computation first verification to be written and, described first data to be written are written in the band of RAID5 array, and write down the positional information of described band and described first verification and;
Second of the same band data to be written arrive Writing condition in writing buffer memory, and described second data to be written and described first data to be written take verification in the RAID5 array and outside whole band the time, according to described second data to be written and described first verification and calculate second verification and, and according to the positional information of described band will described second verification and, described second data to be written are written in the band of correspondence.
2. the method for claim 1 is characterized in that, described first data to be written are written in the band of RAID5 array, also comprises afterwards: the storage space in the buffer memory write that discharges described first data occupancy to be written;
Described second data to be written are written in the corresponding band, also comprise afterwards: the storage space in the buffer memory write that discharges described second data occupancy to be written.
3. the method for claim 1, it is characterized in that, according to the positional information of described band with described second verification and, described second data to be written are written in the corresponding band, also comprise afterwards: remove the positional information of described band of record and described first verification and.
4. the method for claim 1 is characterized in that, the data that are stored on each hard disk of RAID5 array are the band piece; Write down the positional information of described band and described first verification and, also comprise afterwards:, lose the band piece by other band pieces in described first data to be written and described first verification and recovery if when in described first data to be written a band lost block being arranged.
5. as each described method of claim 1-4, it is characterized in that data are for being written to the data in the RAID5 array in proper order according to constant stream rate.
6. the memory storage of data, be applied to comprise in the system of described memory device and watch-dog as memory device, described device adopts RAID5 array stores data, and the data of writing the RAID5 array to be written of having stored each watch-dog in the buffer memory of described device, it is characterized in that this device comprises:
First computing module, be used for arriving Writing condition when first data to be written of writing the same band of buffer memory, if described first data to be written can not take verification in the RAID5 array and outside whole band the time, according to described first data computation first verification to be written and;
First writing module is used for described first data to be written are written to the band of RAID5 array;
Logging modle is connected respectively with first writing module with described first computing module, be used to write down the positional information of described band and described first verification and;
Second computing module, be connected with described logging modle, be used for arriving Writing condition when second data to be written of writing the same band of buffer memory, and described second data to be written and described first data to be written take verification in the RAID5 array and outside whole band the time, according to described second data to be written and described first verification and calculate second verification and;
Second writing module is connected respectively with described second computing module with described logging modle, be used for according to the positional information of described band with described second verification and, described second data to be written are written to corresponding band.
7. device as claimed in claim 6 is characterized in that, also comprises:
The space release module is used for discharging the storage space of writing buffer memory of described first data occupancy to be written; And the storage space in the buffer memory write that discharges described second data occupancy to be written.
8. device as claimed in claim 6 is characterized in that, also comprises:
The record purge module is connected with described logging modle, be used to remove the positional information of described band of record and described first verification and.
9. device as claimed in claim 6 is characterized in that, the data that are stored on each hard disk of RAID5 array are the band piece; This device also comprises:
Data recovery module is connected with described logging modle, if when being used for described first data to be written a band lost block being arranged, loses the band piece by other band pieces in described first data to be written and described first verification and recovery.
10. as each described device of claim 6-9, it is characterized in that data are for being written to the data in the RAID5 array in proper order according to constant stream rate.
CN 201110022762 2011-01-20 2011-01-20 Data storage method and device Pending CN102096558A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201110022762 CN102096558A (en) 2011-01-20 2011-01-20 Data storage method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201110022762 CN102096558A (en) 2011-01-20 2011-01-20 Data storage method and device

Publications (1)

Publication Number Publication Date
CN102096558A true CN102096558A (en) 2011-06-15

Family

ID=44129668

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201110022762 Pending CN102096558A (en) 2011-01-20 2011-01-20 Data storage method and device

Country Status (1)

Country Link
CN (1) CN102096558A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102520888A (en) * 2011-12-23 2012-06-27 深圳市创新科信息技术有限公司 Data processing method for RAID5 band and RAID5 processing system
CN102722340A (en) * 2012-04-27 2012-10-10 华为技术有限公司 Data processing method, apparatus and system
CN103870352A (en) * 2012-12-10 2014-06-18 财团法人工业技术研究院 Method and system for data storage and reconstruction
CN104102724A (en) * 2014-07-22 2014-10-15 浪潮电子信息产业股份有限公司 Video monitoring data based write-in method
CN104881244A (en) * 2014-05-28 2015-09-02 陈杰 Storage system and data protection method thereof
CN106547484A (en) * 2016-10-20 2017-03-29 华中科技大学 It is a kind of that internal storage data reliability method and system realized based on RAID5
CN112749039A (en) * 2019-10-31 2021-05-04 伊姆西Ip控股有限责任公司 Method, apparatus and program product for data writing and data recovery
CN112783689A (en) * 2021-02-08 2021-05-11 上海交通大学 Partial stripe write optimization method and device based on LRC coding

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5860090A (en) * 1995-10-20 1999-01-12 Informix Software, Inc. Append-only storage in a disk array using striping and parity caching
CN101650675A (en) * 2009-08-28 2010-02-17 中兴通讯股份有限公司 Method and device for writing data by utilizing exclusive or check disk array
CN101727299A (en) * 2010-02-08 2010-06-09 北京同有飞骥科技有限公司 RAID5-orientated optimal design method for writing operation in continuous data storage

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5860090A (en) * 1995-10-20 1999-01-12 Informix Software, Inc. Append-only storage in a disk array using striping and parity caching
CN101650675A (en) * 2009-08-28 2010-02-17 中兴通讯股份有限公司 Method and device for writing data by utilizing exclusive or check disk array
CN101727299A (en) * 2010-02-08 2010-06-09 北京同有飞骥科技有限公司 RAID5-orientated optimal design method for writing operation in continuous data storage

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102520888A (en) * 2011-12-23 2012-06-27 深圳市创新科信息技术有限公司 Data processing method for RAID5 band and RAID5 processing system
CN102722340A (en) * 2012-04-27 2012-10-10 华为技术有限公司 Data processing method, apparatus and system
CN103870352A (en) * 2012-12-10 2014-06-18 财团法人工业技术研究院 Method and system for data storage and reconstruction
CN103870352B (en) * 2012-12-10 2017-07-14 财团法人工业技术研究院 Method and system for data storage and reconstruction
CN104881244A (en) * 2014-05-28 2015-09-02 陈杰 Storage system and data protection method thereof
CN104881244B (en) * 2014-05-28 2018-02-09 陈杰 Storage system and its data guard method
CN104102724A (en) * 2014-07-22 2014-10-15 浪潮电子信息产业股份有限公司 Video monitoring data based write-in method
CN106547484A (en) * 2016-10-20 2017-03-29 华中科技大学 It is a kind of that internal storage data reliability method and system realized based on RAID5
CN106547484B (en) * 2016-10-20 2019-05-14 华中科技大学 A kind of reliability method of realization internal storage data and system based on RAID5
CN112749039A (en) * 2019-10-31 2021-05-04 伊姆西Ip控股有限责任公司 Method, apparatus and program product for data writing and data recovery
CN112783689A (en) * 2021-02-08 2021-05-11 上海交通大学 Partial stripe write optimization method and device based on LRC coding

Similar Documents

Publication Publication Date Title
CN102096558A (en) Data storage method and device
CN105573681B (en) Method and system for establishing RAID in SSD
KR101905280B1 (en) High performance system providing selective merging of dataframe segments in hardware
US9798620B2 (en) Systems and methods for non-blocking solid-state memory
JP6125087B2 (en) Redundant storage configuration selection based on available memory space
CN107484427B (en) Method for processing stripes in a storage device and storage device
US20070294565A1 (en) Simplified parity disk generation in a redundant array of inexpensive disks
CN103699337B (en) Writing control method and system based on independent redundant array of independent disks (RAID)
US9304713B2 (en) Storage system and a method for allocating disk drives to redundancy array of independent disks
CN101916173B (en) RAID (Redundant Array of Independent Disks) based data reading and writing method and system thereof
US20180203765A1 (en) Raid systems and methods for improved data recovery performance
CN107220148A (en) For the method for reconstructing and equipment of RAID
CN103488583A (en) High-performance reliable solid-state disk realizing method
CN109358809B (en) RAID data storage system and method
US20130173972A1 (en) System and method for solid state disk flash plane failure detection
CN102981927A (en) Distribution type independent redundant disk array storage method and distribution type cluster storage system
JP2004227560A (en) Parity storage method and error block restoration method in external storage subsystem
CN101620518B (en) Method and apparatus for creating redundancy array in disc RAID
CN103699457A (en) Method and device for restoring disk arrays based on stripping
CN103034458A (en) Method and device for realizing redundant array of independent disks in solid-state drive
CN101729421B (en) Storage method and device based on time division multiplex
CN110597655A (en) Fast predictive restoration method for coupling migration and erasure code-based reconstruction and implementation
CN107678690A (en) A kind of implementation method of solid state hard disc and its RAID array
CN104699577A (en) Counter to locate faulty die in a distributed codeword storage system
US7653829B2 (en) Method of data placement and control in block-divided distributed parity disk array

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20110615