CN1567238A - Mirror method for files based on Internet - Google Patents
Mirror method for files based on Internet Download PDFInfo
- Publication number
- CN1567238A CN1567238A CN 03135150 CN03135150A CN1567238A CN 1567238 A CN1567238 A CN 1567238A CN 03135150 CN03135150 CN 03135150 CN 03135150 A CN03135150 A CN 03135150A CN 1567238 A CN1567238 A CN 1567238A
- Authority
- CN
- China
- Prior art keywords
- file
- formation
- mirror
- record
- internet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 14
- 230000015572 biosynthetic process Effects 0.000 claims description 34
- 238000012544 monitoring process Methods 0.000 claims description 8
- 238000012217 deletion Methods 0.000 claims description 2
- 230000037430 deletion Effects 0.000 claims description 2
- 238000011017 operating method Methods 0.000 claims 6
- 238000011084 recovery Methods 0.000 abstract description 3
- 238000005516 engineering process Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000000052 comparative effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This invention puts forward a kind of file mirror method that based on Internet, which belongs to data backup and disaster recovery realm. It features that when executing write operation to the file in local server, it records the file name, file path, file offset and written data. Then it sends them to remote mirror server through Internet. On the remote mirror server, it executes the same write operation to the corresponding file so to reach the purpose of mirror. For the file variation recording queue in local server, it can tolerant the bandwidth limitation, speed variation and interruption of network. This invention can be widely used for remote data backup and disaster recovery that based on Internet, and with very low cost, and wide prospect.
Description
Technical field
The present invention proposes a kind of file mirror method, belong to data backup and disaster recovery field, on two computing machines that connect by Internet, realize the synchronous of file based on Internet.
Background technology
In disaster tolerance system, mirror image technology is the basis, is whole disaster tolerance system key of success.At present the mirror image technology of comparative maturity has disk array technology, and storage area network, network are directly stored etc.These technology respectively have its relative merits, but distance all is subjected to strict restriction.The mirror image of storage area network is apart from maximum, and in 10 kms, maximum is no more than 100 kms usually.Other several technology only are suitable for local storage, are unsuitable for the foundation of remote strange land mirror-image system.These technical price costlinesses, range of application is narrower, and it is convenient inadequately to use, the maintenance cost height.
The Chinese patent publication number is the remote backup that the application case of CN1179219A can be realized file, but the time interval is long, and real-time is not high.The Chinese patent publication number is that the application case of CN1371058A is the file synchronisation method at an application-specific, when the user end to server write data, simultaneously writing same data to mirror image server makes master server and mirror image server synchronous, need be on each client the installing bottom layer backup driver, the scope of application, distance all have very big restriction.
The present invention is a general file mirror method, need not do any configuration in client, range of application and mirror image distance unrestricted (as long as can insert Internet) are supported several operation systems, and be low to the bandwidth and the stability of network requirement of network.Can support user's file mirror-image system with minimum cost structure oneself on Internet, have broad application prospects.
Summary of the invention
Definition 1: listed files L, be used for registering the file that needs mirror image, each element among the L comprises following two parts:
1) filename: character string, the title of the file that need monitor.
2) file path: character string, the path at the file place that need monitor.
Definition 2: file change formation Q is a fifo queue, is used for writing down which file and has produced write operation.Each element of formation Q comprises following four parts:
1) filename: character string indicates the file that produces write operation.
2) file path: character string indicates the path of the file that produces write operation.
3) side-play amount: integer, the position of file write pointer.
4) write data: binary string, expression writes the content of file.
In order to raise the efficiency, formation Q is designed to two-stage: one-level formation Q1 and secondary formation Q2.Because the read or write speed of disk and the read or write speed of RAM differ several magnitude.Therefore, Q1 is placed among the RAM, and Q2 is placed on the disk.Thereby the tail end of Q1 links to each other with the head end of Q2 and logically forms a formation Q.Get when record and always carry out at the head end of Q, when inserting record always the tail end at Q carry out.
When getting record, if the head pointer of formation Q has pointed to Q2, then earlier the partial record among the Q2 is moved to Q1, revise head pointer and the tail pointer (being similar to the interruption processing method that skips leaf of operating system) of Q simultaneously, and then take out record from the head end of Q.
The size of formation Q can be set flexibly.Q is big more, and variation that can log file is many more, just can tolerate the unfavorable factor such as bandwidth constraints, velocity variations, network interruption of Internet better with designed system of the present invention.In actual the use, the size of Q can be according to the capacity of internal memory, the capacity of disk, and the operating position of file, the connection speed of network allows that the maximum time of network interruption is waited to determine.Advise that generally speaking Q1 is 128M, Q2 is 1G.
Before carrying out mirror image, guarantee that at first home server needs the file of mirror image and the corresponding file of Remote Switched Port Analyzer server identical.
Describe concrete grammar of the present invention in detail below in conjunction with accompanying drawing.
Fig. 1 is a fundamental diagram of the present invention.
The present invention is divided into local and remote two parts in realization, and local part comprises file monitoring module FMON, local mirror image module LMM and two data structures, tabulation L and formation Q; Remote portion includes only Remote Switched Port Analyzer module RMM.
The write operation of file monitoring module FMON snoop-operations system, if operated file F in tabulation L, then the filename of F, file path, side-play amount, write data etc. and be packaged into a record R and be inserted among the formation Q.Local mirror image module LMM constantly takes out record R from Q, send to the Remote Switched Port Analyzer server, and Remote Switched Port Analyzer module RMM carries out the mirror image work that write operation is finished file according to the record R that receives to corresponding file.
Before program run, at first to empty formation Q, and the file that needs mirror image is registered among the tabulation L.
Fig. 2 is the process flow diagram of file monitoring module FMON
The file monitoring module FMON operation W that the snoop-operations system carries out certain file F on home server, if W be a write operation and F in tabulation L, then W is recorded among the formation Q.Concrete steps are as follows:
1. listen to operating system certain file F has been carried out the W operation
2. whether decision operation W is write operation, if not forwarding to 1..
3. judge that file F is whether in tabulation L, if do not forwarding to 1..
4. judge whether formation Q is full, if completely forward to 10..
5. operation W is packaged into record R.
6. obtain the read-write power of formation Q.
7. record R is inserted into the tail end of formation Q.
8. discharge the read-write power of formation Q.
9. finish.
10. report an error.
Fig. 3 is the process flow diagram of local mirror image module LMM
Local mirror image module LMM takes out record R from the head end of formation Q, sends to the Remote Switched Port Analyzer server then and finishes synchronously.
Concrete steps are as follows:
1. judge whether formation Q is empty, if for idling up to 1..
2. obtain the read-write power of formation Q.
3. the head end from formation Q takes out a record R.
4. discharge the read-write power of formation Q.
5. record R is packaged into mirror request T.
6. request T is sent to the Remote Switched Port Analyzer server and carry out mirror image.
7. wait for the complement mark of Remote Switched Port Analyzer server.
8. judge whether overtime, if overtime forwarding to 6..
9. obtain the read-write power of formation Q.
10. deletion record R from formation Q.
discharges the read-write power of formation Q.
1. forwards to.
The process flow diagram of Fig. 4 Remote Switched Port Analyzer module RMM
Telefile synchronization module monitoring file synchronization request when a synchronization request arrives, is carried out same operation to corresponding file on mirror image server, concrete steps are as follows:
1. listen to file mirror request T.
2. from T, parse record R.
3. according to the content of record R corresponding file is carried out write operation.
4. be sent completely sign to local mirror image module.
5. forward to 1..
Claims (5)
1. file mirror method based on Internet, its feature may further comprise the steps: the structure of the formation that log file changes; The operating procedure of file monitoring module; The operating procedure of local mirror image module; The operating procedure of Remote Switched Port Analyzer module.
2. the described file mirror method based on Internet of claim 1 is characterized in that the structure of the formation Q that log file changes comprises following content:
Formation Q is designed to two-stage: one-level formation Q1 and secondary formation Q2;
Thereby the tail end of Q1 links to each other with the head end of Q2 and logically forms a formation Q;
Each element of Q comprises filename, file path, side-play amount, writes four parts of data.
3. the described file mirror method based on Internet of claim 1 is characterized in that the operating procedure of file monitoring module may further comprise the steps:
1. the snoop-operations system carries out the step of write operation to certain file F;
2. judge the step of F in tabulation L (forming) by the file that needs mirror image;
3. the filename of F, file path, side-play amount, write data and form a record R, be inserted into the step of a formation Q;
4. return 1., continue the step of the next write operation of snoop-operations system.
4. the described file mirror method based on Internet of claim 1 is characterized in that the operating procedure of local mirror image module may further comprise the steps:
As long as among the formation Q record is arranged, just carries out following steps always:
1. from formation Q, take out the step of a record R;
2. record R is packaged into the step of mirror request T;
3. request T is sent to the step of remote back-up server;
4. the step of deletion record R from formation Q;
5. the described file mirror method based on Internet of claim 1 is characterized in that the operating procedure of Remote Switched Port Analyzer module may further comprise the steps:
1. the step of monitoring file mirror request;
2. when a mirror request arrives, parse the step of record R;
3. according to the content of record R corresponding file is carried out the step of write operation;
4. be sent completely the step of sign to local mirror image module;
5. return 1., continue to monitor the step of next file mirror request.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 03135150 CN1234074C (en) | 2003-06-09 | 2003-06-09 | Mirror method for files based on Internet |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 03135150 CN1234074C (en) | 2003-06-09 | 2003-06-09 | Mirror method for files based on Internet |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1567238A true CN1567238A (en) | 2005-01-19 |
| CN1234074C CN1234074C (en) | 2005-12-28 |
Family
ID=34470201
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 03135150 Expired - Fee Related CN1234074C (en) | 2003-06-09 | 2003-06-09 | Mirror method for files based on Internet |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1234074C (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101414915B (en) * | 2007-10-19 | 2011-02-16 | 英业达股份有限公司 | System and method for processing remote copied send request |
| CN101984634A (en) * | 2010-11-22 | 2011-03-09 | 北京酷我科技有限公司 | Server-side automatic steering method and system adapting to resource synchronous mechanism |
| CN101989084B (en) * | 2009-07-29 | 2012-05-23 | 中国铝业股份有限公司 | Data release system for thermal power station and matched system |
| CN101410822B (en) * | 2006-03-30 | 2012-07-04 | Nhn公司 | Server mirroring method and system |
| CN111506587A (en) * | 2020-03-31 | 2020-08-07 | 紫光云技术有限公司 | Remote double-living method based on Redis |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100405312C (en) * | 2006-03-10 | 2008-07-23 | 四川大学 | Fault controlling method in long-distance data backup |
| CN100385407C (en) * | 2006-03-10 | 2008-04-30 | 四川大学 | Allopatric data image method of network information system |
-
2003
- 2003-06-09 CN CN 03135150 patent/CN1234074C/en not_active Expired - Fee Related
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101410822B (en) * | 2006-03-30 | 2012-07-04 | Nhn公司 | Server mirroring method and system |
| CN101414915B (en) * | 2007-10-19 | 2011-02-16 | 英业达股份有限公司 | System and method for processing remote copied send request |
| CN101989084B (en) * | 2009-07-29 | 2012-05-23 | 中国铝业股份有限公司 | Data release system for thermal power station and matched system |
| CN101984634A (en) * | 2010-11-22 | 2011-03-09 | 北京酷我科技有限公司 | Server-side automatic steering method and system adapting to resource synchronous mechanism |
| CN101984634B (en) * | 2010-11-22 | 2013-06-26 | 北京酷我科技有限公司 | Server-side automatic steering method and system adapting to resource synchronous mechanism |
| CN111506587A (en) * | 2020-03-31 | 2020-08-07 | 紫光云技术有限公司 | Remote double-living method based on Redis |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1234074C (en) | 2005-12-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100345143C (en) | Method and apparatus for data processing | |
| CA2652111C (en) | Apparatus and method for forming a homogenous transaction data store from heterogeneous sources | |
| CN101079034A (en) | System and method for eliminating redundancy file of file storage system | |
| CN1945571A (en) | Method for re-setting up catalogue structure and restoring data in FAI volume | |
| CN113626431A (en) | LSM tree-based key value separation storage method and system for delaying garbage recovery | |
| CN1858710A (en) | Method and system for synchronizing data | |
| CN1286288C (en) | Method of internal data base main-spare synchronous | |
| CN102779138A (en) | Hard disk access method of real time data | |
| CN100347705C (en) | Method for file merge | |
| CN1859505A (en) | Bill checking system and method | |
| CN1234074C (en) | Mirror method for files based on Internet | |
| CN1633080A (en) | Method for implementing log in network management system | |
| CN1851691A (en) | Database back-up data compression and search method | |
| US8880478B2 (en) | Scan-free archiving | |
| CN112131214A (en) | Method, system, equipment and storage medium for data writing and data query | |
| CN101034416A (en) | Method for file seek track using file allocation table and system frame thereof | |
| CN117473021A (en) | Incremental synchronization realization method for dream database based on CDC mode | |
| CN100342374C (en) | A data storage method and apparatus | |
| CN1889459A (en) | Journal formatting unit and method in safety management center system | |
| CN1351299A (en) | Method and device for accessing database | |
| CN101056204A (en) | A method and system for computing the reliability index of the single board | |
| CN112650453A (en) | Method and system for storing and inquiring traffic data | |
| CN1975717A (en) | Search system index switching method and search system | |
| CN109800233A (en) | A kind of big data fusion searching method | |
| CN1808433A (en) | Quick and safe real-time database access method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| ASS | Succession or assignment of patent right |
Owner name: SICHUAN GREAT TECHNOLOGY CO., LTD. Free format text: FORMER OWNER: SICHUAN UNIVERSITY Effective date: 20100513 |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: 610065 NO.24, SOUTH 1ST SECTION, 1ST RING ROAD, CHENGDU CITY, SICHUAN PROVINCE TO: 610041 2/F, COMPLEX BUILDING (FACING THE STREET), CHENGDU KEHUA MIDDLE ROAD PRIMARY SCHOOL, NO.2, CHANGSHOU ROAD, WUHOU DISTRICT, CHENGDU CITY |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20100513 Address after: 610041, Wuhou District, Changshou Road, Chengdu No. 2 Chengdu KELONG Road Primary School Street building two floor Patentee after: Sichuan Gerite Technology Co., Ltd. Address before: 610065 Sichuan, Chengdu, South Ring Road, No. 1, No. 24 Patentee before: Sichuan University |
|
| ASS | Succession or assignment of patent right |
Owner name: CHENGDU GLOBAL CAPSHEAF TECHNOLOGY CO., LTD. Free format text: FORMER OWNER: SICHUAN GREAT TECHNOLOGY CO., LTD. Effective date: 20130401 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20130401 Address after: 610000 C-411 Asia Pacific Plaza, KELONG North Road, Sichuan, Chengdu Patentee after: Chengdu century summit Technology Co., Ltd. Address before: 610000, Sichuan, Wuhou District, Changshou Road, Chengdu No. 2 Chengdu KELONG Road Primary School Street building two floor Patentee before: Sichuan Gerite Technology Co., Ltd. |
|
| DD01 | Delivery of document by public notice |
Addressee: Wang Zhengtao Document name: Notification of Passing Examination on Formalities |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20051228 Termination date: 20180609 |