CN106293518A - A kind of efficient security protection industry media data storage file system - Google Patents
A kind of efficient security protection industry media data storage file system Download PDFInfo
- Publication number
- CN106293518A CN106293518A CN201610610776.4A CN201610610776A CN106293518A CN 106293518 A CN106293518 A CN 106293518A CN 201610610776 A CN201610610776 A CN 201610610776A CN 106293518 A CN106293518 A CN 106293518A
- Authority
- CN
- China
- Prior art keywords
- file
- data
- file format
- information
- write
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0652—Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Storage Device Security (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of efficient security protection industry media data storage file system, it includes that interface object layer provides the user interface, and user uses these interfaces to obtain the information of file, completes retrieval and the reading of data；File format level, for different use environment, uses the file format of Standard of Monitoring file format and the big file format of standard to realize Document encapsulation in monitoring file；Cultural element layer defines the particular content of file internal.Three level division of labor are distinct, and every layer of handled thing is had nothing in common with each other, and wherein interface object layer is changeless, provides the user an interface facilitating operation file；File format is variable, it is stipulated that the form that file uses, the compound mode of file data, the read-write mode of file data；Cultural element is basically unchanged, and some universal things in its definition file internal, in use, although form is different, but their Internal Elements is identical, can bring the biggest convenience to file operation.
Description
Technical field
The present invention relates to a kind of efficient security protection industry media data storage file system.
Background technology
The storage of file needs to consider the efficiency of storage, in monitoring system, the most all may have substantial amounts of file
Generation.File not of uniform size, may produce substantial amounts of small documents inside hard disk, along with ceaselessly deleting file, and wound
Building file, can produce substantial amounts of disk fragments in a hard disk, these can badly influence the read-write efficiency of disk.Single-threaded write
The speed of hard disk is the fastest, substantially can reach the highest actual speed of disk read-write.Along with increasing of thread, the read-write of hard disk
Efficiency decrease on the contrary, this is because hard disk read-write pointer moving range expand, cause the more time flower tracking
Caused above.So for headend equipment, it is assumed that a DVR has 16 passages writing data simultaneously, and each passage is opened
That one thread writes data and generate file, its efficiency will be significantly lower than simultaneously by 16 channel datas one files of write
In.The operation of disk is most important to written document, and rational file format can effectively improve file read-write speed, and makes literary composition
Part is more conducive to use.
Summary of the invention
It is an object of the invention to overcome the deficiencies in the prior art, it is provided that a kind of efficient security protection industry media data storage
File system, three level division of labor are distinct, and every layer of handled thing is had nothing in common with each other, and wherein interface object layer is to immobilize
, it provides the user an interface facilitating operation file；File format is variable, it is stipulated that the form that file uses, literary composition
The compound mode of number of packages evidence, the read-write mode of file data；Cultural element is basically unchanged, and it defines some in file internal
Universal thing, although file format is different, they internal data structures are likely to identical, the most in use, to the greatest extent
Pipe form is different, but their Internal Elements is identical, can bring the biggest convenience to file operation.
It is an object of the invention to be achieved through the following technical solutions: a kind of efficient security protection industry media data storage
File system, it includes interface object layer, file format level and cultural element layer, and interface object layer provides the user interface, uses
Family uses these interfaces to obtain the information of file, completes retrieval and the reading of data；File format level is for different uses
Environment, uses the file format of Standard of Monitoring file format and the big file format of standard to realize file envelope in monitoring file
Dress；Cultural element layer defines the particular content of file internal.
Described cultural element includes file header structure objects, data object, stream information object and data index object；
Described file header structure objects belongs to the Part I of file, is positioned at the initial of file, comprises the essential information of file；
Described data object comprises all of flow data；
Described stream information object comprises the information of all flow datas in file；
Described data directory object has been used for the retrieval of paired data, and the index of each stream forms a chained list, is used for protecting
Deposit corresponding flow data in the position of file.
The number of the data stream of described Standard of Monitoring file format initially determines that at written document, when write, first writes
Entering traffic flow information object, data write on after traffic flow information.
The described data stream number monitoring big file format is uncertain, when write, first writes data, then writes data
Stream information.
The invention has the beneficial effects as follows: the invention provides a kind of efficient security protection industry media data storage files system
System, three level division of labor are distinct, and every layer of handled thing is had nothing in common with each other, and wherein interface object layer is changeless, and it is
User provides an interface facilitating operation file；File format is variable, it is stipulated that the form that file uses, file data
Compound mode, the read-write mode of file data；Cultural element is basically unchanged, some universal east in its definition file internal
West, although file format is different, they internal data structures are likely to identical, the most in use, although form is not
With, but their Internal Elements is identical, can bring the biggest convenience to file operation.
Accompanying drawing explanation
Fig. 1 is system structure schematic diagram.
Detailed description of the invention
Technical scheme is described in further detail below in conjunction with the accompanying drawings, but protection scope of the present invention is not limited to
The following stated.
As it is shown in figure 1, a kind of efficient security protection industry media data storage file system, it includes interface object layer, literary composition
Part format layer and cultural element layer, interface object layer provides the user interface, and user uses these interfaces to obtain the letter of file
Breath, completes retrieval and the reading of data；File format level, for different use environment, uses Standard of Monitoring in monitoring file
The file format of file format and the big file format of standard realizes Document encapsulation；Cultural element layer defines the tool of file internal
Internal appearance.
Described cultural element includes file header structure objects, data object, stream information object and data index object；
Described file header structure objects belongs to the Part I of file, is positioned at the initial of file, comprises the essential information of file；
Described data object comprises all of flow data；
Described stream information object comprises the information of all flow datas in file；
Described data directory object has been used for the retrieval of paired data, and the index of each stream forms a chained list, is used for protecting
Deposit corresponding flow data in the position of file.
The number of the data stream of described Standard of Monitoring file format initially determines that at written document, when write, first writes
Entering traffic flow information object, data write on after traffic flow information.Due to file random length, its use is made to seem the cleverest
Living, user may select a part of stream interested to generate a normative document at any time, and this file data size is not fix
, the time span write determine, in other words, it is a complete file.In order to prevent during written document
Occur unexpected, cause a part of data write not index and cannot read, so needing during written document
Produce an index backup file.This file is initially generated at written document, preserves current index information, it is assumed that be normally written
After all data, destroy this file, otherwise retain, open this file carrying out to having been written into next time and repair.To Standard of Monitoring
File format, uses index backup file ID X to preserve index information.It is indexed backup to single file write, and
Do not consider the efficiency of disk operating.It is suitable for the occasion that need not heap file operation with some, backs up file for index below
Some rule:
(1) creating IDX file while creating data file, filename is of the same name with data file, and suffix is .idx,
(2) acquiescence writes file once when total packet is newly added the when that index reaching 100,
(3) when repairing, search index file, according to the ID of stream, all indexes belonging to same stream are formed an index chain,
Then all of index chained list is write end of file successively,
(4) structure write is identical with the index structure of data file,
(5) data file writes successfully, then delete index file,
(6) data write unsuccessfully, delete index file after repairing successfully.
The described data stream number monitoring big file format is uncertain, may real-time adding during written document
Add, it is therefore desirable to adapting to the adding procedure of real-time streams, its stream information is after data, and additionally file is also fixed length, in write
Time, first write data, then write traffic flow information.
Functionally for face, monitor the storage of big file format very convenient substantial amounts of data, in such as headend equipment,
NVR carries out the collection of the data of multichannel simultaneously, is at this time more suitable for using big file format to preserve, can during writing
To add flow data easily, additionally data block according to fixed length neat write in disk, be also convenient for the use of user in the future.Cause
It can also be seen that this is for one section of video data the most complete, and it is also possible to be dispersed in several file.
Claims (4)
1. an efficient security protection industry media data storage file system, it is characterised in that: it includes interface object layer, file
Format layer and cultural element layer, interface object layer provides the user interface, user use these interfaces to obtain the information of file,
Complete retrieval and the reading of data；File format level, for different use environment, uses Standard of Monitoring literary composition in monitoring file
The file format of part form and the big file format of standard realizes Document encapsulation；Cultural element layer defines the concrete of file internal
Content.
One the most according to claim 1 efficient security protection industry media data storage file system, it is characterised in that: institute
The cultural element stated includes file header structure objects, data object, stream information object and data index object；
Described file header structure objects belongs to the Part I of file, is positioned at the initial of file, comprises the essential information of file；
Described data object comprises all of flow data；
Described stream information object comprises the information of all flow datas in file；
Described data directory object has been used for the retrieval of paired data, and the index of each stream forms a chained list, is used for protecting
Deposit corresponding flow data in the position of file.
One the most according to claim 1 efficient security protection industry media data storage file system, it is characterised in that: institute
The number of the data stream of the Standard of Monitoring file format stated initially determines that at written document, when write, and first write data stream letter
Breath object, data write on after traffic flow information.
One the most according to claim 1 efficient security protection industry media data storage file system, it is characterised in that: institute
The data stream number monitoring big file format stated is uncertain, when write, first writes data, then writes traffic flow information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610610776.4A CN106293518B (en) | 2016-07-29 | 2016-07-29 | A kind of efficient security industry media data storage file system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610610776.4A CN106293518B (en) | 2016-07-29 | 2016-07-29 | A kind of efficient security industry media data storage file system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106293518A true CN106293518A (en) | 2017-01-04 |
| CN106293518B CN106293518B (en) | 2019-09-10 |
Family
ID=57662926
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610610776.4A Active CN106293518B (en) | 2016-07-29 | 2016-07-29 | A kind of efficient security industry media data storage file system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106293518B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108763235A (en) * | 2018-02-13 | 2018-11-06 | 阿里巴巴集团控股有限公司 | A kind of document handling method, device and equipment |
| CN111858494A (en) * | 2020-07-23 | 2020-10-30 | 珠海豹趣科技有限公司 | File acquisition method and device, storage medium and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110313789A1 (en) * | 2010-01-22 | 2011-12-22 | Deka Products Limited Partnership | Electronic patient monitoring system |
| CN102760136A (en) * | 2011-04-29 | 2012-10-31 | 苏州科达科技有限公司 | File system control method based on rapid video data storage |
| CN103279511A (en) * | 2013-05-16 | 2013-09-04 | 杭州巨峰科技有限公司 | File system for security and protection video monitoring equipment |
| CN103279474A (en) * | 2013-04-10 | 2013-09-04 | 深圳康佳通信科技有限公司 | Video file index method and system |
| CN103702057A (en) * | 2013-09-03 | 2014-04-02 | 成都竣泰科技有限公司 | Block storage algorithm applicable to multiple paths of concurrent-written stream media data |
| CN104811645A (en) * | 2015-04-30 | 2015-07-29 | 安徽清新互联信息科技有限公司 | Embedded video-recording data storage method |
-
2016
- 2016-07-29 CN CN201610610776.4A patent/CN106293518B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110313789A1 (en) * | 2010-01-22 | 2011-12-22 | Deka Products Limited Partnership | Electronic patient monitoring system |
| CN102760136A (en) * | 2011-04-29 | 2012-10-31 | 苏州科达科技有限公司 | File system control method based on rapid video data storage |
| CN103279474A (en) * | 2013-04-10 | 2013-09-04 | 深圳康佳通信科技有限公司 | Video file index method and system |
| CN103279511A (en) * | 2013-05-16 | 2013-09-04 | 杭州巨峰科技有限公司 | File system for security and protection video monitoring equipment |
| CN103702057A (en) * | 2013-09-03 | 2014-04-02 | 成都竣泰科技有限公司 | Block storage algorithm applicable to multiple paths of concurrent-written stream media data |
| CN104811645A (en) * | 2015-04-30 | 2015-07-29 | 安徽清新互联信息科技有限公司 | Embedded video-recording data storage method |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108763235A (en) * | 2018-02-13 | 2018-11-06 | 阿里巴巴集团控股有限公司 | A kind of document handling method, device and equipment |
| CN111858494A (en) * | 2020-07-23 | 2020-10-30 | 珠海豹趣科技有限公司 | File acquisition method and device, storage medium and electronic equipment |
| CN111858494B (en) * | 2020-07-23 | 2024-05-17 | 珠海豹趣科技有限公司 | File acquisition method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106293518B (en) | 2019-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104731921B (en) | Storage and processing method of the Hadoop distributed file systems for log type small documents | |
| CN104504105B (en) | A kind of storage method of real-time data base | |
| CN101446984B (en) | Method and device for storing files and method and device for deleting files | |
| CN101908073B (en) | Method for deleting duplicated data in file system in real time | |
| CN103226965B (en) | Based on the audio/video data access method of time bitmap | |
| CN102024034B (en) | Fragment processing method for high-definition media-oriented embedded file system | |
| US20110276578A1 (en) | Obtaining file system view in block-level data storage systems | |
| CN102053880B (en) | Rar file carving recovery method based on contents | |
| US8472449B2 (en) | Packet file system | |
| CN102136290A (en) | Method for storing embedded real-time video files | |
| US20160055189A1 (en) | Database Storage System based on Optical Disk Library, and Method Using Same | |
| CN103793475B (en) | A kind of method of Distributed File System Data migration | |
| CN101539884B (en) | Method and device for data storage | |
| CN101324898A (en) | Rapid search and recovery method based on file attribute | |
| CN106293518A (en) | A kind of efficient security protection industry media data storage file system | |
| CN102722450B (en) | Storage method for redundancy deletion block device based on location-sensitive hash | |
| CN102541982B (en) | Method for organizing and accessing metadata file log | |
| WO2014025097A1 (en) | Method for databasing non-volatile ram-based b+ tree | |
| CN108595589A (en) | A kind of efficient access method of magnanimity science data picture | |
| US20210141775A1 (en) | Metadata reduction in a distributed storage system | |
| BRPI0414975A (en) | device and file management method, program for performing a file management method, and recording medium | |
| CN100359592C (en) | Data storage method for hard disk for camera-shooting and recording device | |
| CN102693315A (en) | Method and device for removing URL (uniform resource locator) duplicate on basis of shared memory mapping | |
| CN104156327A (en) | Method for recognizing object power failure in write back mode in distributed file system | |
| CN111897675A (en) | Method for recovering recently deleted files of F2FS file system of mobile phone terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |