CN109254731A - A kind of method and apparatus of memory space processing - Google Patents
A kind of method and apparatus of memory space processing Download PDFInfo
- Publication number
- CN109254731A CN109254731A CN201810996283.8A CN201810996283A CN109254731A CN 109254731 A CN109254731 A CN 109254731A CN 201810996283 A CN201810996283 A CN 201810996283A CN 109254731 A CN109254731 A CN 109254731A
- Authority
- CN
- China
- Prior art keywords
- data
- disk
- file
- memory space
- mode
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0652—Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0689—Disk arrays, e.g. RAID, JBOD
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application discloses a kind of method and apparatus of data space processing, this method comprises: firstly, determining the data disk collection that disk is concentrated, the data disk collection is as composed by the data disk in the disc-pack in addition to system disk；Then, according to predetermined software memory space processing mode, the data disk that the data disk is concentrated is handled, the predetermined software memory space processing mode is for increasing data space.It can be seen that, a large amount of hardware coordination work are not needed, the increase of the data space of the data disk of data disk concentration only can be realized by predetermined software memory space processing mode, embodiment is simple and easy, cost is relatively low, to effectively solve the problems, such as that storage data quantity increases brought memory space inadequate, storage space utilization is improved, storage energy consumption is reduced.
Description
Technical field
This application involves the method and apparatus that computer software technical field more particularly to a kind of memory space are handled.
Background technique
In recent years, as the fast development of information technology and nanotechnology are applied on a large scale in computer systems,
Data are caused to be exponentially increased, to require data storage performance higher and higher.Especially data volume explosive increase causes
Data space utilization rate is lower.
In the prior art, usually the static knowledge of file system and dynamic knowledge are embedded into disk driver,
The operation that upper layer file system is speculated using the intrinsic computing function of disk system, develops new interface on disk to improve
Lower layer's interaction, solves the problems, such as disk space usage.
But inventor has found that mode in the prior art, it is necessary to a large amount of software and hardware be needed to coordinate
Consistent work is just able to achieve, and cost of implementation is higher, realizes the complex difficulty of process.
Summary of the invention
The method and apparatus that technical problems to be solved in this application are to provide a kind of data space processing, are not required to
It wants a large amount of hardware coordinations to work, the data magnetic of data disk concentration only can be realized by predetermined software memory space processing mode
The increase of the data space of disk, embodiment is simple and easy, cost is relatively low, so that effectively solving storage data quantity increases institute
The problem of bring memory space inadequate, improves storage space utilization, reduces storage energy consumption.
In a first aspect, the embodiment of the present application provides a kind of method of data space processing, this method comprises:
Determine disk concentrate data disk collection, the data disk collection be by the disc-pack remove system disk it
Composed by outer data disk；
According to predetermined software memory space processing mode, the data disk that the data disk is concentrated is handled, it is described default
Software memory space processing mode is for increasing data space.
Optionally, the predetermined software memory space processing mode includes setting software RAID mode, simplifies data configuration
Mode, deleting duplicated data mode and/or compressed data mode.
Optionally, described according to pre- if the predetermined software memory space processing mode includes setting software RAID mode
If software memory space processing mode, the data disk that the data disk is concentrated is handled, specifically:
Same software RAID mode is set by the data disk that the data disk is concentrated.
Optionally, the data configuration mode of simplifying includes deleting empty file mode, deleting empty list mode and/or simplification
Extra list mode.
Optionally, described according to default if the predetermined software memory space processing mode includes deleting empty file mode
Software memory space processing mode handles the data disk that the data disk is concentrated, comprising:
It obtains and deletes empty file instruction, the empty file of deleting instructs the first default mesh carried in the data disk
Record；
It is instructed according to the deletion empty file, deletes the empty file under first predetermined directory.
Optionally, described according to default if the predetermined software memory space processing mode includes deleting empty list mode
Software memory space processing mode handles the data disk that the data disk is concentrated, comprising:
It obtains and deletes empty list instruction, the empty file of deleting instructs the second default mesh carried in the data disk
Record；
It is instructed according to the deletion empty file, deletes the empty list under second predetermined directory.
Optionally, described according to pre- if the predetermined software memory space processing mode includes simplifying extra list mode
If software memory space processing mode, the data disk that the data disk is concentrated is handled, comprising:
Determine the extra catalogue in the data disk under third predetermined directory, the quantity of documents that the extra catalogue includes
Less than preset value；
File included by the extra catalogue is moved to the parent directory of the extra catalogue, and deletes the extra mesh
Record.
Optionally, described to press if the predetermined software memory space processing mode includes deleting duplicated data mode
According to predetermined software memory space processing mode, the data disk that the data disk is concentrated is handled, comprising:
Determine the same file in the data disk under the 4th catalogue, the same file refers to that size is identical and file
The identical file of name, and/or, the same file refers to that size is identical and the identical file of constant offset amount；
Alternative document in the same file is deleted, the alternative document refers to any one file in the same file
Except file.
Optionally, described soft according to presetting if the predetermined software memory space processing mode includes compressed data mode
Part memory space processing mode handles the data disk that the data disk is concentrated, comprising:
Determine the non-multimedia data file in the data disk；
The non-multimedia data file is compressed using tar compress technique.
Second aspect, the embodiment of the present application provide a kind of device of data space processing, which includes:
Determination unit, the data disk collection concentrated for determining disk, the data disk collection is by the disc-pack
In composed by data disk in addition to system disk；
Processing unit, for handling the data that the data disk is concentrated according to predetermined software memory space processing mode
Disk, the predetermined software memory space processing mode is for increasing data space.
Compared with prior art, the application has at least the following advantages:
Using the technical solution of the embodiment of the present application, firstly, determine the data disk collection that disk is concentrated, the data disk
Collection is as composed by the data disk in the disc-pack in addition to system disk；Then, it is stored according to predetermined software empty
Between processing mode, handle the data disk that the data disk is concentrated, the predetermined software memory space processing mode is for increasing
Add data space.It can be seen that not needing a large amount of hardware coordination work, only pass through predetermined software memory space processing mode
The increase of the data space of the data disk of data disk concentration can be realized, embodiment is simple and easy, cost is relatively low,
To effectively solve the problems, such as that storage data quantity increases brought memory space inadequate, storage space utilization is improved, is reduced
Store energy consumption.
Detailed description of the invention
Technical solution in ord to more clearly illustrate embodiments of the present application, below will be to required in the embodiment of the present application description
Attached drawing to be used is briefly described, it should be apparent that, the accompanying drawings in the following description is only more as described in this application
Embodiment for those of ordinary skill in the art without creative efforts, can also be attached according to these
Figure obtains other attached drawings.
Fig. 1 is system framework schematic diagram involved in application scenarios a kind of in the embodiment of the present application；
Fig. 2 is a kind of flow diagram of the method for data space processing provided by the embodiments of the present application；
Fig. 3 is the flow diagram of the method for another data space processing provided by the embodiments of the present application；
Fig. 4 is a kind of flow diagram of the device of data space processing provided by the embodiments of the present application.
Specific embodiment
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application
Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is only this
Apply for a part of the embodiment, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art exist
Every other embodiment obtained under the premise of creative work is not made, shall fall in the protection scope of this application.
With the fast development of information technology, data are exponentially increased, and cause data space utilization rate lower.It is existing
In technology, usually the static knowledge of file system and dynamic knowledge are embedded into disk driver, utilize disk system
Intrinsic computing function speculates the operation of upper layer file system, develops new interface on disk to improve upper and lower level interaction, solution
Certainly the problem of disk space usage.But inventor has found that mode in the prior art, it is necessary to need a large amount of
The harmonious work of software and hardware be just able to achieve, and cost of implementation is higher, realizes the complex difficulty of process.
In order to solve this problem, in the embodiment of the present application, described firstly, determining the data disk collection that disk is concentrated
Data disk collection is as composed by the data disk in the disc-pack in addition to system disk；Then, soft according to presetting
Part memory space processing mode handles the data disk that the data disk is concentrated, predetermined software memory space processing side
Formula is for increasing data space.It can be seen that not needing a large amount of hardware coordination work, only pass through predetermined software memory space
The increase of the data space of the data disk of data disk concentration can be realized in processing mode, embodiment is simple and easy,
Cost is relatively low, to effectively solve the problems, such as that storage data quantity increases brought memory space inadequate, improves memory space benefit
With rate, storage energy consumption is reduced.
For example, one of the scene of the embodiment of the present application, can be applied in scene as shown in Figure 1, the scene
Including client 101 and processor 102, wherein interacted between client 101 and processor 102.In response to user in visitor
The operation at family end 101, processor 102 determine the data disk collection that disk is concentrated, and the data disk collection is by the disk collection
Composed by data disk in conjunction in addition to system disk；Processor 102 is according to predetermined software memory space processing mode, place
The data disk that the data disk is concentrated is managed, the predetermined software memory space processing mode is empty for increasing data storage
Between.
It is understood that in above-mentioned application scenarios, although by the action description of the application embodiment by processor
102 execute, and still, the application is unrestricted in terms of executing subject, move disclosed in the application embodiment as long as performing
Work.
It is understood that above-mentioned scene is only a Sample Scenario provided by the embodiments of the present application, the embodiment of the present application
It is not limited to this scene.
With reference to the accompanying drawing, the method that data space is handled in the embodiment of the present application is described in detail by embodiment
With the specific implementation of device.
Illustrative methods
Referring to fig. 2, a kind of flow diagram of the method for data space processing in the embodiment of the present application is shown.?
In the present embodiment, the method for example be may comprise steps of:
Step 201: determining that the data disk collection that disk is concentrated, the data disk collection are to be by removing in the disc-pack
Composed by data disk except system disk.
It is understood that disk collection includes system disk and data disk, wherein system disk is for installing operation system
System, therefore, for data storage, memory space is primarily referred to as data disk, then when handling data space, first
It should determine that disk concentrates the data disk collection of the data disk composition in addition to system disk.
Step 202: according to predetermined software memory space processing mode, the data disk that the data disk is concentrated is handled,
The predetermined software memory space processing mode is for increasing data space.
It should be noted that being necessarily required to greatly to solve to optimize in the prior art the data space utilization rate of mass data
The hardware of amount is consistent with software coordinates to work, and existing cost of implementation is higher, realizes the problem of the complex difficulty of process, this reality
Example is applied using not needing the software memory space processing modes of a large amount of hardware, for example, setting software RAID mode, simplifying data and matching
Set the efficiently software memory space processing mode such as mode, deleting duplicated data mode and compressed data mode, above-mentioned four kinds of modes
One or more of mode can be preset, so as to subsequent use.Therefore, some implementations in the present embodiment
In mode, the predetermined software memory space processing mode includes setting software RAID mode, simplifies data configuration mode, deletes
Repeated data mode and/or compressed data mode.
It should be noted that since RAID function is that the parallel read/write of the continuous Ground Split of data is stored in multiple disks, when
There are multiple data disks for data disk concentration, it is contemplated that the memory space of growth data can be mounted with Linux
(Ubuntu) after operating system, same software RAID mode is set by multiple data disks present in data disk collection,
To which the memory space of data is extended to multiple data disks that data disk is concentrated from any one data disk, and can mention
The I/O speed of high data storage.Therefore, in the present embodiment in some embodiments, if at the predetermined software memory space
Reason mode includes setting software RAID mode, and the step 202 is for example specifically as follows: the data that the data disk is concentrated
Disk is set as same software RAID mode, specifically, is set as same Software RAID0 mode.Realize software RAID mode only
It needs Linux (Ubuntu) operating system and processor that can complete, does not need independent RAID control chip and I/O core
Piece, for hardware RAID, the realization process of software RAID mode is simple, does not need a large amount of hardware, cost is relatively low.
It should be noted that due to various, for example, it may be possible to be to forget to delete text after deleting file data
Part, it is also possible to which there is no write-ins in time for data after unexpected power down, it is also possible to which the setting of bibliographic structure level is unreasonable etc., causes
It may store that a large amount of contents are empty file, content is the less extra mesh of empty file directory or content in data disk
Record although the content of file or catalogue is sky, but occupies memory space；Unreasonable extra catalogue is set also occupies and deposits
Store up space.At this point it is possible in the way of deleting empty file, in the way of deleting empty list and one of simplify extra list mode or
Person's various ways are set in advance as predetermined software memory space processing mode, and the data simplified in processing data disk automatically are matched
It sets, increases memory space to improve storage space utilization.Therefore, described to simplify in the present embodiment in some embodiments
Data configuration mode includes deleting empty file mode, delete empty list mode and/or simplifying extra list mode.
Wherein, it when using empty file mode is deleted, actually executes and deletes empty file instruction, which refers to
It enables and can show that the empty file deleted under specified directory, corresponding catalogue in data disk is found based on specified directory, traversal should
Each file under catalogue determines empty file therein and executes delete operation.Therefore, some embodiments in the present embodiment
In, if the predetermined software memory space processing mode includes deleting empty file mode, the step 202 for example may include:
Step A: empty file instruction is deleted in acquisition, and first in the deletion empty file instruction carrying data disk is pre-
If catalogue；
Step B: instructing according to the deletion empty file, deletes the empty file under first predetermined directory.
Similarly, it when using empty list mode is deleted, actually executes and deletes empty list instruction, which refers to
It enables and can show that the empty list deleted under specified directory, corresponding catalogue in data disk is found based on specified directory, traversal should
Each catalogue under catalogue determines empty list therein and executes delete operation.Therefore, some embodiments in the present embodiment
In, if the predetermined software memory space processing mode includes deleting empty list mode, the step 202 for example may include:
Step C: empty list instruction is deleted in acquisition, and second in the deletion empty file instruction carrying data disk is pre-
If catalogue；
Step D: instructing according to the deletion empty file, deletes the empty list under second predetermined directory.
Similarly, when using extra list mode is simplified, the extra catalogue under specified directory will be simplified by actually executing
Operation.Specifically, corresponding catalogue in data disk is found based on specified directory, traverses each catalogue under the catalogue, really
Fixed wherein quantity of documents is less than the extra catalogue of preset value, and the content included by it is moved to its parent directory, and delete it is extra
Catalogue.Therefore, in the present embodiment in some embodiments, if the predetermined software memory space processing mode includes that simplification is more
Remaining list mode, the step 202 for example may include:
Step E: the extra catalogue in the data disk under third predetermined directory, the text that the extra catalogue includes are determined
Number of packages amount is less than preset value；
Step F: file included by the extra catalogue is moved to the parent directory of the extra catalogue, and described in deletion
Extra catalogue.
It should be noted that may store based on technologies such as common data backup, Data Migrations, in data disk big
Measure replicate data, that is, data disk not only stores source file, also stores wave file identical with source file, these copies
File occupies a large amount of memory space.At this point it is possible to each file under traversing specified directory, same file is found in judgement,
Only retain a file in same file by delete operation, increases memory space to improve storage space utilization.Wherein,
Particular size, particular file name and the specific constant offset amount being had based on file, judge whether any two file is identical
File is there are two types of mode, and a kind of mode is that the size of two files is identical and filename is identical, then it is assumed that both of these documents are phases
Same file；Another way is that the identical constant offset amount of size of two files is identical, then it is assumed that both of these documents are phase identical texts
Part.Therefore, in the present embodiment in some embodiments, if the predetermined software memory space processing mode includes deleting
Repeated data mode, the step 202 for example may include:
Step G: determine that the same file in the data disk under the 4th catalogue, the same file refer to that size is identical
And the identical file of filename, and/or, the same file refers to that size is identical and the identical file of constant offset amount；
Step H: deleting alternative document in the same file, and the alternative document refers to any one in the same file
File except a file.
It should be noted that the data of data disk storage are largely data not through overcompression, these data are deposited
In certain compression space, at this point it is possible to increase memory space using certain data in compress technique compressed data disk to mention
High storage space utilization.Specifically, for the multimedia data file of data disk storage, compression ratio is not high, and
And decompression needs big quantity space, compression has little significance, therefore, firstly, the higher non-multimedia of compression ratio in explicit data disk
Then data file carries out compression to it and greatly increases memory space.Wherein, under a linux operating system, general using pressure
The tar compress technique more lossless than high compression that contract carries out squeeze operation.That is, in the present embodiment in some embodiments, if described
Predetermined software memory space processing mode includes compressed data mode, and the step 202 for example may include:
Step I: the non-multimedia data file in the data disk is determined；
Step J: the non-multimedia data file is compressed using tar compress technique.
The various embodiments provided through this embodiment, firstly, determine the data disk collection that disk is concentrated, the data
Disk collection is as composed by the data disk in the disc-pack in addition to system disk；Then, it is deposited according to predetermined software
Spatial manipulation mode is stored up, the data disk that the data disk is concentrated is handled, the predetermined software memory space processing mode is used
In increase data space.It can be seen that not needing a large amount of hardware coordination work, only handled by predetermined software memory space
The increase of the data space of the data disk of data disk concentration can be realized in mode, and embodiment is simple and easy, cost
It is lower, to effectively solve the problems, such as that storage data quantity increases brought memory space inadequate, storage space utilization is improved,
Reduce storage energy consumption.
Referring to Fig. 3, the flow diagram of the method for another data space processing in the embodiment of the present application is shown.
In the present embodiment, the method for example may comprise steps of:
Step 301: determining that the data disk collection that disk is concentrated, the data disk collection are to be by removing in the disc-pack
Composed by data disk except system disk.
Step 302: setting same software RAID mode for the data disk that the data disk is concentrated.
Step 303: obtaining and delete empty file instruction, the empty file of deleting instructs first carried in the data disk
Predetermined directory.
Step 304: being instructed according to the deletion empty file, delete the empty file under first predetermined directory.
Step 305: obtaining and delete empty list instruction, the empty file of deleting instructs second carried in the data disk
Predetermined directory.
Step 306: being instructed according to the deletion empty file, delete the empty list under second predetermined directory.
Step 307: determining that the extra catalogue in the data disk under third predetermined directory, the extra catalogue include
Quantity of documents is less than preset value.
Step 308: file included by the extra catalogue being moved to the parent directory of the extra catalogue, and deletes institute
State extra catalogue.
Step 309: determining that the same file in the data disk under the 4th catalogue, the same file refer to size phase
With and the identical file of filename, and/or, the same file refers to that size is identical and the identical file of constant offset amount.
Step 310: deleting alternative document in the same file, the alternative document refers to any in the same file
File except one file.
It should be noted that the first predetermined directory, the step 305- step 306 in the step 303- step 304
In the second predetermined directory, the 4th predetermined directory in the third predetermined directory in the step 307 and the step 309 this four
A catalogue can be partly or entirely identical, can also be partly or entirely different.
Step 311: determining the non-multimedia data file in the data disk.
Step 312: the non-multimedia data file is compressed using tar compress technique.
It should be noted that in some embodiments of this fact Example, do not limit the step 303- step 304,
The step 305- step 306, the step 307- step 308, the step 309- step 310 and the step 311- step
312 execute sequence, both can to it, arbitrarily sequence is executed, also may be performed simultaneously.
The various embodiments provided through this embodiment, firstly, determine the data disk collection that disk is concentrated, the data
Disk collection is as composed by the data disk in the disc-pack in addition to system disk；Then, according to setting software
RAID mode simplifies the predetermined software storage sky that data configuration mode, deleting duplicated data mode and compressed data mode combine
Between processing mode, handle the data disk that the data disk is concentrated.It can be seen that not needing a large amount of hardware coordination work, only
By setting software RAID mode, simplify data configuration mode, deleting duplicated data mode and compressed data mode combine it is pre-
If the increase of the data space of the data disk of data disk concentration can be realized in software memory space processing mode, implement
Mode is simple and easy, cost is relatively low, to effectively solve the problems, such as that storage data quantity increases brought memory space inadequate, mentions
High storage space utilization reduces storage energy consumption.
Example devices
Referring to fig. 4, a kind of structural schematic diagram of the device of data space processing in the embodiment of the present application is shown.?
In the present embodiment, described device for example be can specifically include:
Determination unit 401, the data disk collection concentrated for determining disk, the data disk collection is by the disk collection
Composed by data disk in conjunction in addition to system disk；
Processing unit 402, for handling the number that the data disk is concentrated according to predetermined software memory space processing mode
According to disk, the predetermined software memory space processing mode is for increasing data space.
Optionally, the predetermined software memory space processing mode includes setting software RAID mode, simplifies data configuration
Mode, deleting duplicated data mode and/or compressed data mode.
Optionally, if the predetermined software memory space processing mode includes setting software RAID mode, the processing is single
Member 402 is specifically used for:
Same software RAID mode is set by the data disk that the data disk is concentrated.
Optionally, the data configuration mode of simplifying includes deleting empty file mode, deleting empty list mode and/or simplification
Extra list mode.
Optionally, if the predetermined software memory space processing mode includes deleting empty file mode, the processing unit
402 include:
First obtains subelement, deletes empty file instruction for obtaining, the deletion empty file instruction carries the data
The first predetermined directory in disk；
First deletes subelement, for instructing according to the deletion empty file, deletes the sky under first predetermined directory
File.
Optionally, if the predetermined software memory space processing mode includes deleting empty list mode, the processing unit
402 include:
Second obtains subelement, deletes empty list instruction for obtaining, the deletion empty file instruction carries the data
The second predetermined directory in disk；
Second deletes subelement, for instructing according to the deletion empty file, deletes the sky under second predetermined directory
Catalogue.
Optionally, if the predetermined software memory space processing mode includes simplifying extra list mode, the processing is single
First 402 include:
First determines subelement, described more for determining the extra catalogue in the data disk under third predetermined directory
The quantity of documents that remaining catalogue includes is less than preset value；
Third deletes subelement, for file included by the extra catalogue to be moved to father's mesh of the extra catalogue
Record, and delete the extra catalogue.
Optionally, if the predetermined software memory space processing mode includes deleting duplicated data mode, the place
Managing unit 402 includes:
Second determines subelement, for determining the same file in the data disk under the 4th catalogue, the phase identical text
Part refers to that size is identical and the identical file of filename, and/or, the same file refers to that size is identical and constant offset amount phase
Same file；
4th deletes subelement, and for deleting alternative document in the same file, the alternative document refers to the phase
With the file except any one file in file.
Optionally, if the predetermined software memory space processing mode includes compressed data mode, the processing unit 402
Include:
Third determines subelement, for determining the non-multimedia data file in the data disk；
Subelement is compressed, for compressing the non-multimedia data file using tar compress technique.
The device of the various embodiments provided through this embodiment, data space processing includes determination unit and place
Manage unit, wherein determination unit is used to determine the data disk collection of disk concentration, and the data disk collection is by the disk collection
Composed by data disk in conjunction in addition to system disk；Processing unit is used for according to predetermined software memory space processing side
Formula, handles the data disk that the data disk is concentrated, and the predetermined software memory space processing mode is deposited for increasing data
Store up space.It can be seen that not needing a large amount of hardware coordination work, only can be realized by predetermined software memory space processing mode
The increase of the data space for the data disk that data disk is concentrated, embodiment is simple and easy, cost is relatively low, thus effectively
It solves the problems, such as that storage data quantity increases brought memory space inadequate, improves storage space utilization, reduce storage energy consumption.
Each embodiment in this specification is described in a progressive manner, the highlights of each of the examples are with other
The difference of embodiment, the same or similar parts in each embodiment may refer to each other.For device disclosed in embodiment
For, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is said referring to method part
It is bright.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond scope of the present application.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.The terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or equipment for including a series of elements not only includes those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or equipment institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including institute
State in the process, method, article or equipment of element that there is also other identical elements.
The above is only the preferred embodiment of the application, not makes any form of restriction to the application.Though
Right the application has been disclosed in a preferred embodiment above, however is not limited to the application.It is any to be familiar with those skilled in the art
Member, in the case where not departing from technical scheme ambit, all using the methods and technical content of the disclosure above to the application
Technical solution makes many possible changes and modifications or equivalent example modified to equivalent change.Therefore, it is all without departing from
The content of technical scheme, any simple modification made to the above embodiment of the technical spirit of foundation the application are equal
Variation and modification, still fall within technical scheme protection in the range of.
Claims (10)
1. a kind of method of data space processing characterized by comprising
Determine disk concentrate data disk collection, the data disk collection be by the disc-pack in addition to system disk
Composed by data disk；
According to predetermined software memory space processing mode, the data disk that the data disk is concentrated, the predetermined software are handled
Memory space processing mode is for increasing data space.
2. the method according to claim 1, wherein the predetermined software memory space processing mode includes setting
Software RAID mode simplifies data configuration mode, deleting duplicated data mode and/or compressed data mode.
3. according to the method described in claim 2, it is characterized in that, if the predetermined software memory space processing mode includes setting
Software RAID mode is set, it is described according to predetermined software memory space processing mode, handle the data magnetic that the data disk is concentrated
Disk, specifically:
Same software RAID mode is set by the data disk that the data disk is concentrated.
4. according to the method described in claim 2, it is characterized in that, the data configuration mode of simplifying includes deleting empty file side
Formula deletes empty list mode and/or simplifies extra list mode.
5. according to the method described in claim 4, it is characterized in that, if the predetermined software memory space processing mode includes deleting
It is described to handle the data disk that the data disk is concentrated according to predetermined software memory space processing mode except empty file mode,
Include:
It obtains and deletes empty file instruction, the empty file of deleting instructs the first predetermined directory carried in the data disk；
It is instructed according to the deletion empty file, deletes the empty file under first predetermined directory.
6. according to the method described in claim 4, it is characterized in that, if the predetermined software memory space processing mode includes deleting
It is described to handle the data disk that the data disk is concentrated according to predetermined software memory space processing mode except empty list mode,
Include:
It obtains and deletes empty list instruction, the empty file of deleting instructs the second predetermined directory carried in the data disk；
It is instructed according to the deletion empty file, deletes the empty list under second predetermined directory.
7. the method according to claim 1, wherein if the predetermined software memory space processing mode includes letter
Change extra list mode, it is described according to predetermined software memory space processing mode, handle the data magnetic that the data disk is concentrated
Disk, comprising:
Determine the extra catalogue in the data disk under third predetermined directory, the quantity of documents that the extra catalogue includes is less than
Preset value；
File included by the extra catalogue is moved to the parent directory of the extra catalogue, and deletes the extra catalogue.
8. if the method according to claim 1, wherein the predetermined software memory space processing mode packet
Deleting duplicated data mode is included, it is described according to predetermined software memory space processing mode, handle the number that the data disk is concentrated
According to disk, comprising:
Determine the same file in the data disk under the 4th catalogue, the same file refers to that size is identical and file famous prime minister
With file, and/or, the same file refers to that size is identical and the identical file of constant offset amount；
Alternative document in the same file is deleted, the alternative document refers in the same file except any one file
File.
9. the method according to claim 1, wherein if the predetermined software memory space processing mode includes pressure
Contracting data mode, described to handle the data disk that the data disk is concentrated according to predetermined software memory space processing mode, packet
It includes:
Determine the non-multimedia data file in the data disk；
The non-multimedia data file is compressed using tar compress technique.
10. a kind of device of data space processing characterized by comprising
Determination unit, the data disk collection concentrated for determining disk, the data disk collection is by removing in the disc-pack
Composed by data disk except system disk；
Processing unit, for handling the data disk that the data disk is concentrated according to predetermined software memory space processing mode,
The predetermined software memory space processing mode is for increasing data space.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810996283.8A CN109254731A (en) | 2018-08-29 | 2018-08-29 | A kind of method and apparatus of memory space processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810996283.8A CN109254731A (en) | 2018-08-29 | 2018-08-29 | A kind of method and apparatus of memory space processing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109254731A true CN109254731A (en) | 2019-01-22 |
Family
ID=65050369
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810996283.8A Pending CN109254731A (en) | 2018-08-29 | 2018-08-29 | A kind of method and apparatus of memory space processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109254731A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103984507A (en) * | 2014-05-15 | 2014-08-13 | 浪潮电子信息产业股份有限公司 | Storage configuration and optimizing strategy for bioinformatics high-performance computing platform |
| CN105573677A (en) * | 2015-12-16 | 2016-05-11 | 浪潮(北京)电子信息产业有限公司 | Implementation method of efficient storage |
| CN106066770A (en) * | 2016-05-25 | 2016-11-02 | 北京小米移动软件有限公司 | Memory space management and device |
| CN106855790A (en) * | 2016-12-20 | 2017-06-16 | 北京小米移动软件有限公司 | Document handling method, device and equipment |
-
2018
- 2018-08-29 CN CN201810996283.8A patent/CN109254731A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103984507A (en) * | 2014-05-15 | 2014-08-13 | 浪潮电子信息产业股份有限公司 | Storage configuration and optimizing strategy for bioinformatics high-performance computing platform |
| CN105573677A (en) * | 2015-12-16 | 2016-05-11 | 浪潮(北京)电子信息产业有限公司 | Implementation method of efficient storage |
| CN106066770A (en) * | 2016-05-25 | 2016-11-02 | 北京小米移动软件有限公司 | Memory space management and device |
| CN106855790A (en) * | 2016-12-20 | 2017-06-16 | 北京小米移动软件有限公司 | Document handling method, device and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11640338B2 (en) | Data recovery operations, such as recovery from modified network data management protocol data | |
| US10762038B2 (en) | System and method for virtual machine conversion | |
| US10108543B1 (en) | Efficient physical garbage collection using a perfect hash vector | |
| US10635634B2 (en) | Data storage system for analysis of data across heterogeneous information management systems | |
| US10216449B1 (en) | Extended snapshot using backup and microservice | |
| US11016858B2 (en) | Systems and methods for managing single instancing data | |
| US9633065B2 (en) | Efficient data rehydration | |
| US8639665B2 (en) | Hybrid backup and restore of very large file system using metadata image backup and traditional backup | |
| JP4706342B2 (en) | Data management method and apparatus | |
| US9449007B1 (en) | Controlling access to XAM metadata | |
| EP1176523A2 (en) | System for providing extended file attributes | |
| US10467197B2 (en) | Creating a universally deduplicatable archive volume | |
| US20180113876A1 (en) | Storing Data in a File System | |
| US9298733B1 (en) | Storing files in a parallel computing system based on user or application specification | |
| US8738669B1 (en) | Method and apparatus for providing access to data objects within another data object | |
| US9652479B2 (en) | Recovering from a pending uncompleted reorganization of a data set | |
| Zheng et al. | Software-defined storage for fast trajectory queries using a deltafs indexed massive directory | |
| CN109254731A (en) | A kind of method and apparatus of memory space processing | |
| US9483199B1 (en) | Data deduplication using multiple devices | |
| US10733142B1 (en) | Method and apparatus to have snapshots for the files in a tier in a de-duplication file system | |
| US10769116B2 (en) | System and method for performing operations on a hierarchy of content | |
| Tate et al. | IBM Real-time Compression in IBM SAN Volume Controller and IBM Storwize V7000 | |
| Murugesan et al. | Analyzing Integral Components of SQL Server Databases | |
| Uehara | Split file model for big data in low throughput storage | |
| Uehara | 3 Tiers Storage Model for Low Throughput Off-Line Storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190122 |