CN109753224A - Storage structure and storage structure configuration method - Google Patents

Storage structure and storage structure configuration method Download PDF

Info

Publication number
CN109753224A
CN109753224A CN201711072321.2A CN201711072321A CN109753224A CN 109753224 A CN109753224 A CN 109753224A CN 201711072321 A CN201711072321 A CN 201711072321A CN 109753224 A CN109753224 A CN 109753224A
Authority
CN
China
Prior art keywords
area
root
index area
index
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201711072321.2A
Other languages
Chinese (zh)
Other versions
CN109753224B (en
Inventor
吕志明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Uniview Technologies Co Ltd
Original Assignee
Zhejiang Uniview Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Uniview Technologies Co Ltd filed Critical Zhejiang Uniview Technologies Co Ltd
Priority to CN201711072321.2A priority Critical patent/CN109753224B/en
Publication of CN109753224A publication Critical patent/CN109753224A/en
Application granted granted Critical
Publication of CN109753224B publication Critical patent/CN109753224B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a storage structure and a storage structure configuration method. The storage structure includes: a data area, a static index area and a dynamic index area. The data area, the static index area and the dynamic index area respectively adopt independent storage resources to store data, so that cross-resource storage of a plurality of storage resources is realized through the data area, the static index area and the dynamic index area. Therefore, the index area and the data area can be stored separately, and the index area can be expanded according to requirements. The index area is divided into a static index area and a dynamic index area, different data index requirements can be met, independent storage resources are configured for each area, and cross-resource application of a plurality of storage resources can be realized.

Description

Storage organization and storage organization configuration method
Technical field
The present invention relates to technical field of data storage, in particular to a kind of storage organization and storage organization configuration side Method.
Background technique
Existing piece of storage organization generallys use storage organization as shown in the accompanying drawings 1, and main includes formatting letter Cease area, index area and data field.The storage organization index area and data field are divided in same storage resource, it can be achieved that The independent management of index area and the concurrent reading and writing of data field.
However, the shortcomings that this kind of storage organization, is: single storage resource can only be described, do not support multiple storage resources Across resource application.Index area memory space is fixed, if increasing storage resource, to may cause index area not enough.
Summary of the invention
In order to overcome above-mentioned deficiency in the prior art, the present invention provides a kind of storage organization and storage organization configuration side Method carries out separation storage to index area and data field, configures independent storage resource for each area, to realize multiple storage moneys Across the resource application in source.
The first of present pre-ferred embodiments is designed to provide a kind of storage organization, and the storage organization includes: data Area, static index area and dynamic index area;
Storage resource storing data independent is respectively adopted in the data field, static index area and dynamic index area, To realize across the resource storage of multiple storage resources by the data field, static index area and dynamic index area.
The second of present pre-ferred embodiments is designed to provide a kind of storage organization configuration method, sets applied to storage Standby, the method is for configuring above-mentioned storage organization, which comprises
Establish data field, static index area and dynamic index area, the respectively described data field, static index area and dynamic rope Draw area and configure corresponding storage resource, to realize multiple storage moneys by the data field, static index area and dynamic index area Across the resource storage in source;
The data field is divided into the identical multiple data blocks of memory space;
Configure volume index area and the first root index area in the static index area;
Configure object indexing area and the second root index area in the dynamic index area.
In terms of existing technologies, the invention has the following advantages:
Present pre-ferred embodiments provide a kind of storage organization and storage organization configuration method.The storage organization includes: Data field, static index area and dynamic index area.The data field, static index area and dynamic index area are respectively adopted respectively solely Vertical storage resource storing data, to realize multiple storage resources by the data field, static index area and dynamic index area Across resource storage.Separation storage can be carried out to index area and data field as a result, index area can be extended according to demand.It will Index divides into static index area and dynamic index area, can meet different data directory demands, configures for each area independent Storage resource, it can be achieved that multiple storage resources across resource application.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this A little attached drawings obtain other relevant attached drawings.
Fig. 1 is the structural schematic diagram of storage organization in the prior art.
Fig. 2 is the composition schematic diagram for the storage organization that present pre-ferred embodiments provide.
Fig. 3 is the structural schematic diagram for the data field that present pre-ferred embodiments provide.
Fig. 4 is the structural schematic diagram in the static index area that present pre-ferred embodiments provide.
Fig. 5 is the structural schematic diagram in the dynamic index area that present pre-ferred embodiments provide.
Fig. 6 is the step flow chart for the storage organization configuration method that present pre-ferred embodiments provide.
Fig. 7 is the sub-step flow chart for the step S130 shown in fig. 6 that present pre-ferred embodiments provide.
Fig. 8 is the sub-step flow chart for the step S140 shown in fig. 6 that present pre-ferred embodiments provide.
Icon: 10- storage organization;The data field 100-;110- data block;120- reserved area;200- static index area; 210- volume index area;The 212- volume index head information area;214- level-one bitmap index area;2140- level-one bitmap unit;216- second level Bitmap index area;2160- second level bitmap unit;The first root of 220- index area;The first root of 222- indexes Head Section;224- Root directory information index area;2240- root directory information unit;226- root occupies block index area;2260- root occupies block Unit;The first root of 228- bit map area;2280- root bitmap unit;300- dynamic index area;310- the second root rope Draw area;The second root of 312- indexes Head Section;The second root of 314- bit map area;320- object indexing area;322- first is stored Area;3220- object information unit;The first bit map area 324-;3240- object information bitmap unit;The second memory block 326-; 3260- object occupies module unit;The second bit map area 328-;3280- object occupies bitmap block unit;329- object indexing Head Section.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the present invention, instead of all the embodiments.The present invention being usually described and illustrated herein in the accompanying drawings is implemented The component of example can be arranged and be designed with a variety of different configurations.
Therefore, the detailed description of the embodiment of the present invention provided in the accompanying drawings is not intended to limit below claimed The scope of the present invention, but be merely representative of selected embodiment of the invention.Based on the embodiments of the present invention, this field is common Technical staff's every other embodiment obtained without creative efforts belongs to the model that the present invention protects It encloses.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi It is defined in a attached drawing, does not then need that it is further defined and explained in subsequent attached drawing.
In the description of the present invention, it should be noted that term " first ", " second " etc. are only used for distinguishing description, without It can be interpreted as indication or suggestion relative importance.
Present pre-ferred embodiments provide a kind of storage organization 10.Referring to figure 2., Fig. 2 is that present pre-ferred embodiments mention The composition schematic diagram of the storage organization 10 of confession.The storage organization 10 includes: data field 100, static index area 200 and dynamic rope Draw area 300.
In the present embodiment, the data field 100, static index area 200 and dynamic index area 300 are respectively adopted respectively solely Vertical storage resource storing data, it is multiple to be realized by the data field 100, static index area 200 and dynamic index area 300 Across the resource storage of storage resource.
In the present embodiment, the data field 100 is the region for storage service data.The static index area 200 It is responsible for resource, the index region that business configuration updates.The dynamic index area 300 is born during storage service carries out Blame the index region that business datum dynamic updates.
It in the present embodiment, can be according to actual needs to each memory block by carrying out separation storage to storage organization 10 The memory space in domain is amplified and is reduced.Particularly with index area, independent static index area 200 is divided by that will index And dynamic index area 300, the memory space in region can be adjusted flexibly, avoid causing due to the fixation of index area memory space The not enough situation in index area.
In the present embodiment, corresponding storage resource can be selected according to different reading and writing data types.For example, static index The data information stored in area 200 has the characteristics that reading times are more, erasable number is few, data cannot lose, and preferably uses SSD hard disk (Solid State Drives, solid state hard disk) is used as storage resource, while carrying out raid1 redundancy processing.Dynamic rope Draw the data information stored in area 300 have the characteristics that reading times it is more, it is erasable often, data cannot lose, preferably adopt It uses enterprise-level disk as storage resource, while carrying out raid1 redundancy processing.The storage resource that data field 100 uses can basis The setting of data service actual conditions, preferably uses SMR (Shingled Magneting Recording, stacked tile type magnetic recording) Hard disk.
Referring to figure 3., Fig. 3 is the structural schematic diagram for the data field 100 that present pre-ferred embodiments provide.The data field 100 include the identical multiple data blocks 110 of memory space.
In the present embodiment, the data field 100 is divided into the fixed data block 110 of multiple storage sizes.Its In, the divided storage size of each data block 110 can be according to the total memory space and data block of entire data field 100 110 quantity is set.For example, each data block 110 may be set to 2G size.
In the present embodiment, when the data field 100 uses SMR hard disk as storage resource, each data block 110 The reserved area 120 for preventing the data cover of write-in to next data block 110 is provided at ending.
In the present embodiment, SMR hard disk is made of many Track (track), and weight mutually is allowed between different Track It is folded, storage density can be greatlyd improve under the premise of not reducing magnetic head.Since the read-write head width of SMR is different, magnetic is read The width of head is consistent with Track, and write magnetic head width is big, when being sequentially written in, can cover the data in magnetic disk of further part.As a result, In design a reserved area 120 is arranged, at the ending of each data block 110 to guarantee write head current in this programme The data that data block 110 is written for the last time will not cover the data of next data block 110.
In the present embodiment, the space size that the reserved area 120 is set can be according to the width of SMR hard disc magnetic head come really It is fixed, for example, may be set to the reserved area 120 of 4MB (being greater than head width).Wherein, take up space can for the reserved area 120 It is included in 110 space of data block (2G), a zonule can also be individually divided after 110 space of data block as described pre- Stay region 120.
Referring to figure 4., Fig. 4 is the structural schematic diagram in the static index area 200 that present pre-ferred embodiments provide.
In the present embodiment, the static index area 200 includes: to occupy feelings for describing data block 110 in data field 100 The volume index area 210 of condition.The volume index area 210 includes the volume index head information area 212, level-one bitmap index area 214 and second level Bitmap index area 216.
In the present embodiment, second level bitmap index area 216 includes multiple second level bitmap units 2160, each data block 110 have a corresponding second level bitmap unit 2160, the second level bitmap unit 2,160 110 occupancy situation of block for storing data. For example, the information that the second level bitmap unit 2160 stores can be 0/1 flag information, when some data block 110 is occupied, When being stored with data information in the data block 110, the mark that is stored in the corresponding second level bitmap unit 2160 of data block 110 Information is 1.Conversely, the flag information stored in second level bitmap unit 2160 is 0 when data block 110 is unoccupied.
In the present embodiment, level-one bitmap index area 214 includes several for storing level-one group occupancy situation Level-one bitmap unit 2140, wherein each level-one group is stored with the occupied information of several second level bitmap units 2160.
In the present embodiment, the multiple second level bitmap unit 2160 can be divided into multiple level-one groups, each level-one group There is corresponding level-one bitmap unit 2140.Wherein, 0/1 mark letter can also be used in the information that the level-one bitmap unit 2140 stores Breath.For example, when the corresponding data block 110 of all second-order bitmap unit 2160 for including in some level-one group is occupied, it should The flag information that level-one bitmap unit 2140 stores is 1, otherwise is 0.For example, including four second level bitmap units in level-one group 2160, if the flag information of four second level bitmaps unit 2160 is 1 (i.e. data block 110 is occupied), the level-one The corresponding level-one bitmap unit 2140 of group is identified as 1, otherwise is 0.
In this embodiment, it is preferred that can be by the quantity of level-one bitmap unit 2140 and second level bitmap in a level-one group The quantity of unit 2160 is set as identical quantity, so that search efficiency is optimal.For example, a shared 1024*1024 data block 110, least lookup number is 1024+1024 under worst case.
In the present embodiment, the volume index head information area 212 for storing data area 100 110 information of data block (ratio Such as, 110 quantity of data block, storage size of each data block 110 etc.), 2140 information of level-one bitmap unit is (for example, one The quantity of grade bitmap unit 2140, the storage size of each level-one bitmap unit 2140), 2160 information of second level bitmap unit (for example, the quantity of second level bitmap unit 2160, storage size of each second level bitmap unit 2160) and check information.
In the present embodiment, by the way that volume index area 210 is arranged, data block can carried out using the design of two-stage bitmap index When 110 distribution, quick-searching can effectively promote index efficiency to not used data block 110.
Referring once again to Fig. 4, the static index area 200 further include: for describing each data block 110 in root directory area First root index area 220 of occupancy situation.
In the present embodiment, the root directory area refers to be each root assignment of allocation in the data field 100 Data storage areas, wherein each root directory area includes multiple data blocks 110.For example, in video monitoring system, institute The data directory that root is often referred to an image capture device (for example, video camera) is stated, using depositing for the storage organization 10 Storage equipment can allocate independent data storage areas, i.e. root directory area in advance for each image capture device.
In the present embodiment, first root index area 220 includes: the first root index Head Section 222, root Information index area 224, root occupy block index area 226 and the first root bit map area 228.
In the present embodiment, the root directory information index area 224 include multiple root directory information units 2240, described Directory information unit 2240 is for storing root directory information, for example, root title, the storage size of root directory area Deng.
In the present embodiment, it includes that multiple roots occupy module unit 2260, institute that the root, which occupies block index area 226, It states root and occupies the address information that module unit 2260 is used to store occupied data block 110 in root directory area.
In the present embodiment, first root bit map area 228 include multiple root bitmap units 2280, described Catalogue bitmap unit 2280 occupies 2260 occupancy situation of module unit for storing the root.
In the present embodiment, root directory information index area 224 and root occupancy block index area 226 can be according to fixed sizes Memory space be split, after segmentation, the quantity of root directory information unit 2240 and root occupy the number of module unit 2260 Amount is consistent, and corresponds from front to back according to putting in order.
In the present embodiment, 0/1 flag information can also be used in the information that the root bitmap unit 2280 stores.When certain When being stored with data information in a root occupancy module unit 2260, then corresponding root bitmap unit 2280 is identified as 1, Reactionary slogan, anti-communist poster knowledge is 0.
In the present embodiment, the first root index Head Section 222 is for storing root quantity, root directory information list First 2240 information are (for example, the storage size of 2240 quantity of root directory information unit, each root directory information unit 2240 Deng), root occupy 2260 information of module unit (for example, root occupy 2260 quantity of module unit, each root occupy block list The storage size etc. of member 2260), 2280 information of root bitmap unit is (for example, 2280 quantity of root bitmap unit, every The storage size etc. of a root bitmap unit 2280) and check information.
In the present embodiment, by the way that the first root index area 220 is arranged, it is corresponding current root can quickly to be found Which data block 110 is occupied in root directory area, indexes out not used data block 110 with this.
Referring to figure 5., Fig. 5 is the structural schematic diagram in the dynamic index area 300 that present pre-ferred embodiments provide.
In the present embodiment, the dynamic index area 300 includes: the second root index area 310, second root Index area 310 is corresponding with the first root index area 220 in above-mentioned static index area 200.Second root index area 310 Can include: the second root indexes Head Section 312 and the second root bit map area 314.
In the present embodiment, the dynamic index area 300 further include: the data block used for describing to distribute to object The object indexing area 320 of 110 occupancy situation.The object indexing area 320 includes: the first memory block 322, the first bit map area 324, the second memory block 326, the second bit map area 328 and object indexing Head Section 329.
In the present embodiment, object is the subdirectory for belonging to root.In video monitoring system, the object can be with Refer to, but be not limited to, some image capture device is to be the period in one day or be the data directory acquired in the period with one week.
In the present embodiment, first memory block 322 includes multiple for storage object information (for example, object oriented) Object information unit 3220.First bit map area 324 includes multiple for storing the occupancy of object information unit 3220 The object information bitmap unit 3240 of situation.
In the present embodiment, second memory block 326 includes multiple addresses that data block 110 is occupied for storage object The object of information occupies module unit 3260.Second bit map area 328 includes multiple for storing the object occupancy module unit The object of 3260 occupancy situations occupies bitmap block unit 3280.
In the present embodiment, the object information bitmap unit 3240 and/or object occupy bitmap block unit 3280 and store Information 0/1 flag information can also be used.Identification means are similar to the above, and details are not described herein.
In the present embodiment, the object indexing Head Section 329 is believed for storage object quantity, object information unit 3220 Breath, object occupy 3260 information of module unit, 3240 information of object information bitmap unit, object and occupy bitmap block unit 3280 and school Test information.
In the present embodiment, when being pre-configured with to root directory area, if data field 100 is provided using multiple storages Source can be selected multiple data blocks 110 in different storage resources as root directory area, realize the discrete distribution of data.Root mesh After record region distributes, the distribution of data block 110 of object can be limited in the specified root directory area, can quickly search To data block 110 needed for object distribution.Also, when expanding to index area, root directory area can be effectively ensured will not Due to memory space expansion and increase additional expense, influence the performance of storage organization 10.
In the present embodiment, the memory space as needed for different objects may be different, using convenient for repeatedly wiping The dynamic index area 300 write can meet the needs of data storage dynamic change.When carrying out delete processing to data, made with object Granularity can be deleted for minimum, is not related to the data service of entire root, simplifies the complexity of system itself, while also avoiding There is file fragmentation.
Present pre-ferred embodiments also provide a kind of storage organization configuration method.The method is applied to storage equipment, institute Method is stated for configuring to above-mentioned storage organization 10.
In the present embodiment, the storage equipment can be applied to, but be not limited to, video monitoring system, the video prison Control system includes acquiring equipment (for example, video camera) to multiple images, and the storage equipment is used to acquire image capture device Data information stored.
Fig. 6 is please referred to, Fig. 6 is the step flow chart for the storage organization configuration method that present pre-ferred embodiments provide.Under It is described in detail in face of storage organization configuration method detailed process.
Step S110 establishes data field 100, static index area 200 and dynamic index area 300, the respectively described data field 100, static index area 200 and dynamic index area 300 configure corresponding storage resource, to pass through the data field 100, static rope Draw area 200 and dynamic index area 300 realizes across the resource storage of multiple storage resources.
In the present embodiment, storage equipment may respectively be static index area 200 and dynamic index area 300 and respectively be separately configured one A corresponding storage resource can be that data field 100 configures one or more storage resource according to actual data storage requirement.
The data field 100 is divided into the identical multiple data blocks 110 of memory space by step S120.
In the present embodiment, storage equipment is by the corresponding one or more storage resources in data field 100 row of carrying out in order Data field 100 is divided into sequence arrangement and storage size is fixed according to 100 memory space total capacity of data field by column Data block 110.
Step S130 configures volume index area 210 and the first root index area 220 in the static index area 200.
Fig. 7 is please referred to, Fig. 7 is the sub-step flow chart for the step S130 shown in fig. 6 that present pre-ferred embodiments provide. The step S130 includes: sub-step S131, sub-step S132, sub-step S133 and sub-step S134.
Sub-step S131 establishes volume index area 210 and the first root index area 220.
Sub-step S132 configures the volume index head information area 212, level-one bitmap index area 214 in the volume index area 210 And second level bitmap index area 216, it is described with the occupancy situation to each data block 110 in the data field 100.
In the present embodiment, level-one bitmap index area 214 is divided into multiple level-one bitmap lists by the storage equipment Member 2140, is divided into multiple second level bitmap units 2160 for second level bitmap index area 216.
In the present embodiment, after configuring the good static index area 200, the storage equipment is data in data field 100 The volume index head information area 212 is written in quantity, sequencing information and the corresponding address information of each data block 110 of block 110.Together When, it is described storage equipment by level-one bitmap index area 214 level-one bitmap unit 2140 and second level bitmap index area 216 Middle second level bitmap unit 2160 is disposed as idle state (flag information is identified as 0).Finally volume index area 210 is carried out Whole verification, and volume index head is written into 2140 information of level-one bitmap unit, 2160 information of second level bitmap unit and check information The information area 212.
Sub-step S133 is the specified root directory area of each root distribution in the data field 100.
In the present embodiment, each root directory area includes multiple data blocks 110.
Sub-step S134 configures the first root index Head Section 222, first in first root index area 220 Root bit map area 228, root directory information index area 224 and root occupy block index area 226, to the root directory area In the occupancy situation of each data block 110 be described.
In the present embodiment, root directory information index area 224 is divided into multiple root directory information lists by the storage equipment Root occupancy block index area 226 is divided into multiple roots and occupies module unit 2260, by the first root bitmap by member 2240 Area 228 is divided into multiple root bitmap units 2280.
In the present embodiment, when to give a root (for example, a video camera) configuration storage space, first dividing should The corresponding root directory area of root is reconfigured the root corresponding first root index area 220.It is deposited for example, to distribute Store up the root directory area that space is 2TB, the storage size of each data block 110 is 2GB, and the storage equipment is from volume index area Available data block 110 is found in 210, then the storage of the corresponding address information of available block 110 is indexed to the first root Area 220.Storing process includes: first to find available position according to the first root bit map area 228.Root directory information is write root Bibliography information area 224.The address information of data block 110 is write root and occupies block index area 226.Then at first Corresponding root bitmap unit 2280 is identified as occupied state (that is, flag information is 1) in catalogue bit map area 228.Finally The second level bitmap index area 216 of corresponding position in volume index area 210 is identified as occupied state.
In the present embodiment, it specifically introduces and can refer to about to volume index area 210 and the first root index area 220 State the associated description to Fig. 4.
Step S140 configures object indexing area 320 and the second root index area 310 in the dynamic index area 300.
Fig. 8 is please referred to, Fig. 8 is the sub-step flow chart for the step S140 shown in fig. 6 that present pre-ferred embodiments provide. The step S140 includes: sub-step S141, sub-step S142 and sub-step S143.
Sub-step S141 establishes object indexing area 320 and the second root index area 310.
Sub-step S142 is configured in the dynamic index area 300 corresponding according to first root index area 220 Second root index area 310.
In the present embodiment, the first root index area of second root index area 310 and static index area 200 220 is corresponding.Second root index area 310 includes: the second root index Head Section 312 and the second root bit map area 314。
Sub-step S143 configures object indexing Head Section 329, the first bit map area 324, the in the object indexing area 320 One memory block 322, the second bit map area 328 and the second memory block 326, to the occupancy for distributing to the data block 110 that object uses Situation is described.
In the present embodiment, business datum table can be generated according to object indexing area 320, for recording the relevant data of object Information.
In the present embodiment, to the configuration operation and 220 class of above-mentioned the first root of configuration index area in object indexing area 320 Seemingly, details are not described herein.It can refer to about the specific introduction to object indexing area 320 and the second root index area 310 above-mentioned To the associated description of Fig. 5.
In the present embodiment, when needing to delete the relevant data of object, correspondence can be found according to object indexing area 320 Data block 110, delete the data information that stores in data block 110, the object indexing area 320 discharged, then by first Corresponding root bitmap unit 2280 is set as idle state in catalogue bit map area 228.
In the present embodiment, it when needing to delete the total data of a root, is first found according to object indexing area 320 Corresponding address information removes the object information in dynamic index area 300.Then corresponding is found in static index area 200 The first root index area 220 is removed in one root index area 220, and discharges the data block 110 of root occupancy, and Idle state is set by corresponding second level bitmap unit 2160 in volume index area 210.
In conclusion present pre-ferred embodiments provide a kind of storage organization and storage organization configuration method.The storage Structure includes: data field, static index area and dynamic index area.The data field, static index area and dynamic index area difference It is more to be realized by the data field, static index area and dynamic index area using storage resource storing data independent Across the resource storage of a storage resource.
Separation storage can be carried out to index area and data field as a result, index is divided into static index area and dynamic index Area meets different data directory demands.Configure independent storage resource for each area, it can be achieved that multiple storage resources across money Source application.
And, it can be achieved that the discrete distribution of data storage, data directory are high-efficient.With the amplification of data field memory space Or reduce, it is dynamically adapted the memory capacity of index area and will not influence the performance of storage organization.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.

Claims (10)

1. a kind of storage organization, which is characterized in that the storage organization includes: data field, static index area and dynamic index area;
Storage resource storing data independent is respectively adopted in the data field, static index area and dynamic index area, with logical Cross across the resource storage that the data field, static index area and dynamic index area realize multiple storage resources.
2. storage organization according to claim 1, which is characterized in that the data field includes that memory space is identical multiple Data block.
3. storage organization according to claim 2, which is characterized in that when the data field is used as storage using SMR hard disk When resource, the reserved area for preventing the data cover of write-in to next data block is provided at the ending of each data block.
4. storage organization according to claim 2, which is characterized in that the static index area includes: for describing data The volume index area of data block occupancy situation in area;
The volume index area includes the volume index head information area, level-one bitmap index area and second level bitmap index area;
Second level bitmap index area includes the second level bitmap unit of multiple occupancy situations of block for storing data, a level Index of the picture area includes the level-one bitmap unit that several are used to store level-one group occupancy situation, wherein each level-one group is stored with The occupied information of several second level bitmap units;
The volume index head information area data block information in area, level-one bitmap unit information, second level bitmap list for storing data Metamessage and check information.
5. according to storage organization described in claim 2-4 any one, which is characterized in that the static index area further include: For describing the first root index area of each data block occupancy situation in root directory area;
First root index area includes: the first root index Head Section, the first root bit map area, root directory information rope Draw area and root occupies block index area;
The root directory information index area includes multiple for storing the root directory information unit of root directory information;
It includes multiple for storing the address information of occupied data block in root directory area that the root, which occupies block index area, Root occupy module unit;
First root bit map area includes multiple roots that module unit occupancy situation is occupied for storing the root Bitmap unit;
The first root index Head Section occupies block for storing root quantity, root directory information unit information, root Unit information, root bitmap unit information and check information.
6. storage organization according to claim 5, which is characterized in that the dynamic index area includes: the second root rope Draw area, second root index area is corresponding with first root index area;
Second root index area includes: the second root index Head Section and the second root bit map area.
7. storage organization according to claim 2, which is characterized in that the dynamic index area further include: divide for describing The object indexing area of the occupancy situation for the data block that dispensing object uses;
The object indexing area includes: object indexing Head Section, the first bit map area, the first memory block, the second bit map area and second deposits Storage area;
First memory block includes multiple object information units for storage object information;
First bit map area includes multiple for storing the object information bitmap unit of the object information unit occupancy situation;
Second memory block includes that the object of multiple address informations that data block is occupied for storage object occupies module unit;
Second bit map area includes that multiple objects that module unit occupancy situation is occupied for storing the object occupy bitmap block Unit;
The object indexing Head Section occupies module unit information, object for storage object quantity, object information unit information, object Information bitmap unit information, object occupy bitmap block unit and check information.
8. a kind of storage organization configuration method is applied to storage equipment, which is characterized in that the method is used for claim 1- Storage organization described in any one of 7 is configured, which comprises
Establish data field, static index area and dynamic index area, the respectively described data field, static index area and dynamic index area Corresponding storage resource is configured, to realize multiple storage resources by the data field, static index area and dynamic index area Across resource storage;
The data field is divided into the identical multiple data blocks of memory space;
Configure volume index area and the first root index area in the static index area;
Configure object indexing area and the second root index area in the dynamic index area.
9. according to the method described in claim 8, it is characterized in that, the volume index area in the configuration static index area and the One root index area, comprising:
Establish volume index area and the first root index area;
The volume index head information area, level-one bitmap index area and second level bitmap index area are configured in the volume index area, to institute The occupancy situation for stating each data block in data field is described;
It is the specified root directory area of each root distribution in the data field, wherein each root directory area includes more A data block;
The first root index Head Section, the first root bit map area, root letter are configured in first root index area It ceases index area and root occupies block index area, retouched with the occupancy situation to each data block in the root directory area It states.
10. according to the method described in claim 9, it is characterized in that, the object indexing area in the configuration dynamic index area And the second root index area, comprising:
Establish object indexing area and the second root index area;
Corresponding second root index area is configured in the dynamic index area according to first root index area, In, second root index area includes: the second root index Head Section and the second root bit map area;
Object indexing Head Section, the first bit map area, the first memory block, the second bit map area and second are configured in the object indexing area Memory block, the occupancy situation for distributing to the data block that object uses to be described.
CN201711072321.2A 2017-11-03 2017-11-03 Storage structure and storage structure configuration method Active CN109753224B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711072321.2A CN109753224B (en) 2017-11-03 2017-11-03 Storage structure and storage structure configuration method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711072321.2A CN109753224B (en) 2017-11-03 2017-11-03 Storage structure and storage structure configuration method

Publications (2)

Publication Number Publication Date
CN109753224A true CN109753224A (en) 2019-05-14
CN109753224B CN109753224B (en) 2022-05-13

Family

ID=66398565

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711072321.2A Active CN109753224B (en) 2017-11-03 2017-11-03 Storage structure and storage structure configuration method

Country Status (1)

Country Link
CN (1) CN109753224B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111459412A (en) * 2020-03-30 2020-07-28 北京百度网讯科技有限公司 Disk management method and device and electronic equipment
CN111651127A (en) * 2020-06-10 2020-09-11 杭州海康威视数字技术股份有限公司 Monitoring data storage method and device based on shingled magnetic recording disk
CN112380416A (en) * 2020-11-25 2021-02-19 北京慕华信息科技有限公司 Method for updating course index, course searching method and device

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080183777A1 (en) * 2007-01-31 2008-07-31 Agency For Science, Technology And Research File system for a storage device, methods of allocating storage, searching data and optimising performance of a storage device file system
US20100030999A1 (en) * 2008-08-01 2010-02-04 Torsten Hinz Process and Method for Logical-to-Physical Address Mapping in Solid Sate Disks
CN102982182A (en) * 2012-12-21 2013-03-20 浙江宇视科技有限公司 Data storage planning method and device
CN103593477A (en) * 2013-11-29 2014-02-19 华为技术有限公司 Collocation method and device of Hash database
US20150193350A1 (en) * 2012-07-27 2015-07-09 Tencent Technology (Shezhen) Comany Limited Data storage space processing method and processing system, and data storage server
CN105138286A (en) * 2015-08-11 2015-12-09 智云创新(北京)科技有限公司 Method for mixed utilization of SSD and SMR hard disks in disk file system
CN105653720A (en) * 2016-01-07 2016-06-08 北京人大金仓信息技术股份有限公司 Database hierarchical storage optimization method capable of achieving flexible configuration
CN106933516A (en) * 2017-03-16 2017-07-07 郑州云海信息技术有限公司 A kind of storage controlling method and device of the storage system of blending agent
CN107122136A (en) * 2017-04-25 2017-09-01 浙江宇视科技有限公司 A kind of capacity acquiring method and device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080183777A1 (en) * 2007-01-31 2008-07-31 Agency For Science, Technology And Research File system for a storage device, methods of allocating storage, searching data and optimising performance of a storage device file system
US20100030999A1 (en) * 2008-08-01 2010-02-04 Torsten Hinz Process and Method for Logical-to-Physical Address Mapping in Solid Sate Disks
US20150193350A1 (en) * 2012-07-27 2015-07-09 Tencent Technology (Shezhen) Comany Limited Data storage space processing method and processing system, and data storage server
CN102982182A (en) * 2012-12-21 2013-03-20 浙江宇视科技有限公司 Data storage planning method and device
CN103593477A (en) * 2013-11-29 2014-02-19 华为技术有限公司 Collocation method and device of Hash database
CN105138286A (en) * 2015-08-11 2015-12-09 智云创新(北京)科技有限公司 Method for mixed utilization of SSD and SMR hard disks in disk file system
CN105653720A (en) * 2016-01-07 2016-06-08 北京人大金仓信息技术股份有限公司 Database hierarchical storage optimization method capable of achieving flexible configuration
CN106933516A (en) * 2017-03-16 2017-07-07 郑州云海信息技术有限公司 A kind of storage controlling method and device of the storage system of blending agent
CN107122136A (en) * 2017-04-25 2017-09-01 浙江宇视科技有限公司 A kind of capacity acquiring method and device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
HUANG BIN等: "An Efficient Two-Level Bitmap Index for Cloud Data Management", 《INTERNATIONAL CONFERENCE ON COMMUNICATION SOFTWARE AND NETWORKS》 *
冯睿: "基于位图索引的FITS文件分布式存储与索引技术研究", 《中国优秀硕士学位论文全文数据库 (信息科技辑)》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111459412A (en) * 2020-03-30 2020-07-28 北京百度网讯科技有限公司 Disk management method and device and electronic equipment
US11681444B2 (en) 2020-03-30 2023-06-20 Beijing Baidu Netcom Science Technology Co., Ltd. Shingled magnetic disk management method for data isolation by space files, apparatus, and electronic device
CN111459412B (en) * 2020-03-30 2023-07-04 北京百度网讯科技有限公司 Disk management method and device and electronic equipment
CN111651127A (en) * 2020-06-10 2020-09-11 杭州海康威视数字技术股份有限公司 Monitoring data storage method and device based on shingled magnetic recording disk
WO2021249201A1 (en) * 2020-06-10 2021-12-16 杭州海康威视数字技术股份有限公司 Monitoring data storage method and apparatus based on shingled magnetic recording disk
CN112380416A (en) * 2020-11-25 2021-02-19 北京慕华信息科技有限公司 Method for updating course index, course searching method and device

Also Published As

Publication number Publication date
CN109753224B (en) 2022-05-13

Similar Documents

Publication Publication Date Title
CN101510145B (en) Storage system management method and apparatus
CN106201355B (en) Data processing method and device and storage system
CN104699416B (en) A kind of data-storage system and a kind of date storage method
CN103761190B (en) Data processing method and apparatus
CN110226157A (en) Dynamic memory for reducing row buffering conflict remaps
US8627024B2 (en) Snapshot based replication
KR100834574B1 (en) File storage system and file storage and file search method in file storage system
CN101916290B (en) Managing method of internal memory database and device
CN109753224A (en) Storage structure and storage structure configuration method
CN106708427A (en) Storage method suitable for key value pair data
CN104820575A (en) Method for realizing thin provisioning of storage system
CN102096557B (en) Capacity expansion method, device and system for independent redundant array of inexpensive disc (RAID)
US8386707B2 (en) Virtual disk management program, storage device management program, multinode storage system, and virtual disk managing method
CN102650931A (en) Method and system for writing data
CN102982182A (en) Data storage planning method and device
CN105897859A (en) Storage system
US8386741B2 (en) Method and apparatus for optimizing data allocation
JP2007079787A (en) Logical disk management method and virtualization device
CN111309245A (en) Layered storage writing method and device, reading method and device and system
US20080201525A1 (en) RAID capacity expansion handling method and system with concurrent data access capability
CN113434470B (en) Data distribution method and device and electronic equipment
CN109669621A (en) A kind of file management method, file management system, electronic equipment and storage medium
US8880794B2 (en) Populating a sparsely allocated memory in a storage array
CN109582235B (en) Management metadata storage method and device
CN114840148B (en) Method for realizing disk acceleration based on linux kernel bcache technology in Kubernets

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant