CN100518132C - Distributing traffic information storage file system - Google Patents

Distributing traffic information storage file system Download PDF

Info

Publication number
CN100518132C
CN100518132C CNB200710038073XA CN200710038073A CN100518132C CN 100518132 C CN100518132 C CN 100518132C CN B200710038073X A CNB200710038073X A CN B200710038073XA CN 200710038073 A CN200710038073 A CN 200710038073A CN 100518132 C CN100518132 C CN 100518132C
Authority
CN
China
Prior art keywords
server
data storage
file
terminal
management server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB200710038073XA
Other languages
Chinese (zh)
Other versions
CN101022397A (en
Inventor
黄林鹏
杨欢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiaotong University
Original Assignee
Shanghai Jiaotong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiaotong University filed Critical Shanghai Jiaotong University
Priority to CNB200710038073XA priority Critical patent/CN100518132C/en
Publication of CN101022397A publication Critical patent/CN101022397A/en
Application granted granted Critical
Publication of CN100518132C publication Critical patent/CN100518132C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

A distributed storage system of traffic information comprises management server of stored resource, data storage server, meta-data management server of stored resource, data storage server, meta-data management server, transmission management server, copy management server, information monitoring server, history analysis and policy expansion server, virtual file view terminal and relevant interactive units. Its storing method is also disclosed.

Description

Distributing traffic information storage file system
Technical field
What the present invention relates to is a kind of system of electronic information technical field data grids, specifically a kind of distributing traffic information storage file system.
Background technology
Increasing along with grid application, being not limited to initial application background----science calculates, grid stretches to all trades and professions with its feeler, grid computing is placed on the aspect of network service to use, and existing social public service resource consolidation is got up to become development trend.Traffic information grid promptly is the product that grid combines with public service.The versatility of use network service the raising greatly grid enables to agree with more the demand of traffic-information service.Data module from the basic-level support module of original grid gradually by independent.Data grids become same resource with it and provide the technology of general-purpose interface independent from whole grid system gradually as a kind of heterogeneous resource that merges.The development trend of data grids is for not only supporting other grid assembly but also the system of function can own independent operating being provided.
In order to agree with the trend that grid computing is drawn close to the network service, data grids need a kind of traditional tightly coupled distributed file system, the distributed file system that can carry out the loose coupling of far call by the network service of being different from.The requirement of using data grids for the user like this or visiting this distributed file system has just reduced, and the user can be by any terminal access system.
Find Chinese patent application number by prior art documents: 02120971.5, denomination of invention: based on the document storage system and the file access method thereof of distributed file system, publication number: CN1464453.The file system of this patent is based on distributed file system, for the user who uses memory space provides efficiently, access interface efficiently, makes the user can visit all shared resources whenever and wherever possible.The deficiency of this document system: (1) system does not make up based on a kind of united frame, makes the communication of server of internal system different model not possess uniformity and versatility.(2) system does not carry out the burst storage to file, makes that storage is odd higher when the big file of storage, and waste of storage space is more.(3) system does not duplicate file, and when back end broke down, file system was unavailable, has reduced the availability of system.(4) system does not provide the support to banded transmission of file and parallel transmission, uses the performance of this document system lower.
Summary of the invention
The present invention is directed to the deficiencies in the prior art and defective, a kind of distributing traffic information storage file system is provided, make its between different servers, cooperate and system outside the visit of native system all is based on same rule, and the sane degree and the efficient of storage system are increased. meet transport information storage transmission requirements more, versatility and operation ability (memory data output have been taken into account, transmission speed), for mesh services provides reliable data support, promoted the development of data grids as standalone module.
The present invention is achieved by the following technical solutions, the present invention includes: data storage server, SRM server, metadata management server, transport management server, replica management server, information monitoring server, historical analysis and tactful expansion servers, virtual file view terminal, reliable transmission are kept terminal.Virtual file view terminal is kept terminal with metadata management server, replica management server, SRM server and reliable transmission and is linked to each other, replica management server and historical analysis and tactful expansion servers, SRM server, transport management server link to each other, transport management server and reliable transmission are kept terminal and are all linked to each other with information monitoring server, data storage server, the information monitoring server links to each other with historical analysis and tactful expansion servers, and the SRM server links to each other with data storage server.Virtual file view terminal is accepted the access request from user or system's external application, and keeps terminal interaction to handle request according to different requests with metadata management server, replica management server, SRM server or reliable transmission; The reliable file transmission terminal is in the request that receives virtual file view terminal and make response, is connected to the terminal clientsaconnect at data storage server and user place, initiates the transfer of data between data storage server and the terminal clientsaconnect; The performance of transfer of data is caught by the information monitoring server, is sent to historical analysis and tactful expansion servers afterwards; The replica management server is in the request that receives virtual file view terminal and make response, promptly be connected to historical analysis and tactful expansion servers is obtained the copy maintenance strategy, be connected to the SRM server and obtain data storage information, be connected to the transfer of data between the transport management server initiation internal system data storage server; The SRM server is periodic and data storage server is mutual, collects every index to data storage server, and the legitimate files information of assigning data storage server; Data storage server is except the communicating by letter of above-mentioned and SRM server, also keep the data transfer request that terminal is sent according to transport management server and reliable transmission, between log-on data storage server and the user place client computer or data storage server and data storage server between transfer of data.
Described data storage server comprises: Ftp server unit, SRM client unit.The Ftp server unit is kept terminal with reliable transmission and is connected, and the Ftp server unit in each data storage server interconnects.Specific file transfer protocol (FTP) (as File Transfer Protocol, GridFTP agreement) and Ftp server end code have been realized in the Ftp server unit, as the transmission server in the file transfer.The SRM client unit is connected with the SRM server, it periodically starts a thread, be used for and the SRM server communication, report the every index of this machine to the SRM server, obtain the legitimate files information of this machine from the SRM server.
Described SRM server is connected to one or more data storage servers, manages the life cycle of connected data storage server, monitors the basic index of all these data storage servers and in the visit accessibility of present stage.All data storage servers of SRM server and management thereof constitute an independently territory.
Described metadata management server comprises: logical file map unit and burst address mapping unit two parts.The logical file map unit is created logical file (also can deposit the actual content of this file in data storage server simultaneously) the user, divide burst time-division partition sheet ID, when obtaining file by consulting of user's space logical file obtained the ID of the burst that file is divided in system, the burst address mapping unit is determined the physical address of burst according to the result of last transmission when the user creates logical file, increase the copy address that burst can be linked to when copy spreads.
Described transport management server and reliable transmission are kept terminal, and they comprise a common transmission control bag, contain transmission thread scheduling unit, failed tasks recovery unit, dynamic task updating block in the son bag.Transmission thread scheduling unit is used for starting, stops, suspends the transfer of data thread.The failed tasks recovery unit is used to restart the data transfer task of having failed, and guarantees that the new transfer of data that starts starts from transformation task failure last time.The real-time condition that the dynamic task updating block is finished according to task dynamically updates data transfer task, adjusts the start-stop position of data transfer task.Transport management server links to each other with data storage server, and the reliable file that it uses this son bag to finish between each data storage server of internal system transmits.The terminal clientsaconnect that reliable transmission is kept terminal and data storage server, use native system links to each other, and the reliable file that it uses this son bag to finish between the terminal clientsaconnect of internal system data storage server and use native system transmits.
Described replica management server, be mainly used in the diffusion of copy, the i.e. strategy customization copy diffusion plan that the replica management server returns according to historical analysis and tactful expansion servers when need set up copy, this task is finished by calling transport management server in this unit, and by the metadata management server address of burst is upgraded.
Described information monitoring server comprises: information monitoring unit, historical information computing unit.The information monitoring unit links to each other with the SRM server, and each moment is collected by this machine information that each data storage server sends to the SRM server.The historical information computing unit links to each other with information monitoring unit, historical analysis and tactful expansion servers, not only the essential information of each data storage server of historical juncture to be added up, also need the performance of each data storage server to be made statistics according to transmission situation before.Though specifically as a data node current have very high speed because the average transmission rate in its in the past ten hour is very low, and often make mistakes, the evaluation during historical analysis that such back end will be mentioned below and tactful expansion servers link to each other might not be lower than it than present rate but have the back end height of a stable historical transmission rate.
Described historical analysis and tactful expansion servers are collected the useful data that calculates to the information monitoring server and are analyzed.The strategy that uses in the analytic process is customization, specifically transmit or the data storage server of historical transmission rate the best transmits by the data storage server of current transmission rate the best, or be present rate and historical speed to be integrated consideration give two speed certain weight respectively, the weighted sum of calculating them is as last evaluation.Historical analysis and tactful expansion servers are exactly a marking system, increase strategy in the policy library by the user, revise the employed strategy of configuration, and the modification of strategy just becomes very flexible.Use adaptive strategy in addition, according to the data that the information monitoring module obtains the use of strategy is selected, system can adjust employed strategy along with the variation of indexs such as number of network node, network congestion degree.The actual service efficiency of system will be approached ideal value like this.
Described virtual file view terminal is the main entrance end of system, is the window with user interactions.The user is being seen as same local system in this terminal, and it can send various instructions to Virtual File System.According to these instructions, virtual file view terminal is called different management servers.These task executions flow processs of virtual file view terminal self maintained.
The present invention is based on current WSRF (network service resource framework) technology and XML (extensible markup language) technology combines, so that between the server of different model, can use a kind of unique standard to communicate.The present invention is based on system's constituted mode of burst, file no longer is present on the data storage server with the form of whole file, but has the total storage capacity that makes the storage equivalent may equal even surpass some data storage servers with the form of file fragmentation.Not only can make those resources that can't hold big file obtain utilizing according to certain threshold value section big file, it is odd also can to reduce storage, integrates more storage resources, and the storage capacity that has increased data field has also reduced load pressure.Be unit storage data in addition with the burst, under identical memory capacity operating position, increase the quantity of transport tape in the banded transmission.So-called banded transmission is that same client and a plurality of server transmit, and each group server client is a transport tape.Same with on a plurality of transmission processes be called parallel transmission.Banded transmission has improved the service efficiency of client bandwidth.Three-tier Architecture Model of the present invention, it is terminal (client)-management server-resource, by using Three-tier Architecture Model, terminal and resource are thoroughly isolated from administration module, and it is mutual to allow terminal and resource pass through network service and management module, administration module can be expanded very flexibly, and can not influence the visit of terminal and the qualification of resource.Management server also can expand more complicated function.This model has reduced the degree of coupling of intermodule.
The present invention is for the characteristics of prior art:
1) versatility:, make that the degree of coupling between terminal and management server, management server and the resource drops to minimum owing to used the WSRF agreement to be used as the method for far call.Terminal is visited easily, and resource joins resource set easily.
2) stability: because each transmission all has the control that makes mistakes, system can capture the transformation task that do not have success easily and it is recovered; The SRM server is not initiatively to go to seek resource on the other hand, join in certain resource collection by resource but set up a framework, node in this set generally all is available, select the most healthy and the strongest data storage server to transmit by selection strategy again, further improved availability.
3) high efficiency: owing to used historical information analysis and the adaptive method of dynamic strategy, it is intelligent more that system becomes, it always tends to select the most stable node storage data, the fastest node data download, and the system that makes has so also taken into account efficient when improving versatility.
4) flexibility: tactful expansion module just adds system as merge module when design, each calls the interface that module all has and specific strategy has nothing to do of historical analysis and tactful expansion servers on the one hand, each strategy also needs to meet certain masterplate and describes self on the other hand, and the user can customize update strategy flexibly and makes system become more intelligent like this.
Description of drawings
Fig. 1 system block diagram of the present invention
Fig. 2 management server communication of the present invention schematic diagram
Fig. 3 memory file system sequential chart of the present invention
Fig. 4 the present invention obtains the file system sequential chart
Fig. 5 duplicate of the document diffusion of the present invention sequential chart
Embodiment
Below one embodiment of the invention are elaborated: present embodiment has provided detailed execution mode and process being to implement under the prerequisite with the technical solution of the present invention, but protection scope of the present invention is not limited to following embodiment.
As shown in Figure 1, present embodiment comprises: data storage server, SRM server, metadata management server, transport management server, replica management server, information monitoring server, historical analysis and tactful expansion servers, virtual file view terminal, reliable transmission are kept terminal.Virtual file view terminal is kept terminal with metadata management server, replica management server, SRM server and reliable transmission and is linked to each other, replica management server and historical analysis and tactful expansion servers, SRM server, transport management server link to each other, transport management server and reliable transmission are kept terminal and are all linked to each other with information monitoring server, data storage server, the information monitoring server links to each other with historical analysis and tactful expansion servers, and the SRM server links to each other with data storage server.Virtual file view terminal is accepted the access request from user or system's external application, and keeps terminal interaction to handle request according to different requests with metadata management server, replica management server, SRM server or reliable transmission; The reliable file transmission terminal is in the request that receives virtual file view terminal and make when corresponding, is connected to the terminal clientsaconnect at data storage server and user place, initiates the transfer of data between data storage server and the terminal clientsaconnect; The performance of transfer of data is caught by the information monitoring server, is sent to historical analysis and tactful expansion servers afterwards; The replica management server is in the request that receives virtual file view terminal and make when corresponding, be connected to historical analysis and tactful expansion servers is obtained the copy maintenance strategy, be connected to the SRM server and obtain data storage information, be connected to the transfer of data between the transport management server initiation internal system data storage server; The SRM server is periodic and data storage server is mutual, collects every index to data storage server, and the legitimate files information of assigning data storage server; Data storage server is except the communicating by letter of above-mentioned and SRM server, also keep the data transfer request that terminal is sent according to transport management server and reliable transmission, between log-on data storage server and the user place client computer or data storage server and data storage server between transfer of data.
Described data storage server comprises: Ftp server unit, SRM client unit.The Ftp server unit is kept terminal with reliable transmission and is connected, and the Ftp server unit in each data storage server interconnects.Specific file transfer protocol (FTP) (as File Transfer Protocol, GridFTP agreement) and Ftp server end code have been realized in the Ftp server unit, as the transmission server in the file transfer.The SRM client unit is connected with the SRM server, it periodically starts a thread, be used for and the SRM server communication, report the every index of this machine to the SRM server, obtain the legitimate files information of this machine from the SRM server.
Described metadata management server comprises logical file map unit and burst address mapping unit, the logical file map unit is created logical file the user, simultaneously also can deposit the actual content of this file in data storage server, divide burst time-division partition sheet ID, when obtaining file by consulting of user's space logical file obtained the ID of the burst that file is divided in system, the burst address mapping unit is determined the physical address of burst according to the result of last transmission when the user creates logical file, increase the copy address that burst is linked to when copy spreads.
Described transport management server and reliable transmission are kept terminal, and they comprise a common transmission control bag, contain transmission thread scheduling unit, failed tasks recovery unit, dynamic task updating block in the son bag.Transmission thread scheduling unit is used for starting, stops, suspends the transfer of data thread.The failed tasks recovery unit is used to restart the data transfer task of having failed, and guarantees that the new transfer of data that starts starts from transformation task failure last time.The real-time condition that the dynamic task updating block is finished according to task dynamically updates data transfer task, adjusts the start-stop position of data transfer task.Transport management server links to each other with data storage server, and the reliable file that it uses this son bag to finish between each data storage server of internal system transmits.The terminal clientsaconnect that reliable transmission is kept terminal and data storage server, use native system links to each other, and the reliable file that it uses this son bag to finish between the terminal clientsaconnect of internal system data storage server and use native system transmits.
Described replica management server, be used for the diffusion of copy: the strategy customization copy diffusion plan that the replica management server returns according to historical analysis and tactful expansion servers when needs are set up copy, finish this task by calling transport management server, and the address of burst is upgraded by the metadata management server.
Described information monitoring server comprises: current information monitoring unit, historical information computing unit, the current information monitoring unit is collected present moment by this machine information that each data storage server sends to the data storage resource management server, the historical information computing unit not only will be added up the essential information of each data storage server of historical juncture, also need the performance of each data storage server to be made statistics according to transmission situation before.
Described historical analysis and tactful expansion servers are collected the useful data that calculates to the information monitoring server and are analyzed, the strategy that uses in the analytic process is customization, the data storage server of concrete current transmission rate the best transmits or the data storage server of historical transmission rate the best transmits, or be present rate and historical speed to be integrated consideration give two speed certain weight respectively, the weighted sum of calculating them is as last evaluation.
Described virtual file view terminal is the main entrance end of system, is and the window of user interactions, and the user sends various instructions to Virtual File System in this terminal, and according to these instructions, terminal is called different management servers.
As shown in Figure 2, described SRM server, be connected to one or more data storage servers, manage the life cycle of connected data storage server, monitor the basic index of all these data storage servers and in the visit accessibility of present stage.
As shown in Figure 3, file storage to the virtual file system detailed process with the user comprises:
(1) virtual file view terminal sends the request of creating file to metadata management server logical File mapping unit, the logical file map unit accepts request, create this file and corresponding catalogue relation thereof, and the state of this file is labeled as " in the transmission ", the logical file map unit is returned confirmation to virtual file view terminal afterwards;
(2) after virtual file view terminal obtains affirmation information from the metadata management server, send the request of returning resource to the SRM server, the SRM server is according to the information of the file size of being asked, concentrate the selection available resources in available resources, and distribute the storage resources that matches with it for each file fragmentation.Afterwards, the SRM server returns allocation result to virtual file view terminal;
(3) virtual file view terminal is according to the allocation result structure transmission plan file that returns, and the transmission plan file is sent to the transmission thread scheduling unit that reliable transmission is kept terminal, transmission thread scheduling unit is log-on data transmission thread in view of the above, according to transmission plan burst transmitted and to be stored on the data storage server.In transmission course, take place if any fault, then by transmission thread scheduling unit malloc failure malloc task recovery unit, from fault, to recover.Behind the end of transmission, the transmission thread scheduling unit that reliable transmission is kept terminal returns to virtual file view terminal with the actual transmissions result.
(4) virtual file view terminal receives after reliable transmission keeps the actual transmissions result that the transmission thread scheduling unit of terminal sends, send message to metadata management server logical File mapping unit, it be " available " that the logical file map unit changes file status, and the burst address mapping unit that calls the metadata management server is with interpolation burst map addresses information.
As shown in Figure 4, the file detailed process of obtaining the user from Virtual File System comprises:
(1) virtual file view terminal sends request to metadata management server logical File mapping unit, the logical file map unit accepts request, inquiry obtains the burst information of file, burst information with file is sent to the burst address mapping unit again, with the positional information of all bursts of obtaining file.Afterwards, the logical file map unit returns to virtual file view terminal with the positional information that is obtained.
(2) after virtual file view terminal receives the file fragmentation positional information that the metadata management server sends, generate the transmission plan file according to positional information information, and the transmission plan file is sent to the transmission thread scheduling unit that reliable transmission is kept terminal, transmission thread scheduling unit is log-on data transmission thread in view of the above, to transfer on the client computer at user place according to transmission plan all bursts with file.In transmission course, take place if any fault, then by transmission thread scheduling unit malloc failure malloc task recovery unit, from fault, to recover.Behind the end of transmission, the transmission thread scheduling unit that reliable transmission is kept terminal sends a confirmation message to virtual file view terminal.
As shown in Figure 5, carrying out copy diffusion detailed process in system comprises:
(1) virtual file view terminal sends copy diffusion request to the replica management server;
(2) the replica management server sends request to historical analysis and tactful expansion servers, and historical analysis and tactful expansion servers are returned the burst tabulation that needs diffusion to the replica management server;
(3) after the replica management server receives the diffusion burst tabulation that historical analysis and tactful expansion servers return, generate the transmission plan file in view of the above, and the transmission plan file is sent to the transmission thread scheduling unit of transport management server, transmission thread scheduling unit is log-on data transmission thread in view of the above, and carries out transfer of data according to transmission plan.In transmission course, take place if any fault, then by transmission thread scheduling unit malloc failure malloc task recovery unit, from fault, to recover.Behind the end of transmission, the transmission thread scheduling unit of transport management server returns the actual transmissions result to the replica management server.
(4) after the replica management server receives the actual transmissions result that transport management server returns, the actual transmissions result is sent to virtual file view terminal.
(5) after virtual file view terminal receives the actual transmissions result that the replica management system returns, send a request to metadata management server logical File mapping unit, logical file map unit transaction file burst mapping relations, call the burst address mapping unit and add the burst address mapping relation, last logical file map unit is returned and is confirmed message to virtual file view terminal.

Claims (9)

1, a kind of distributing traffic information storage file system, comprise: data storage server, the SRM server, the metadata management server, transport management server, the replica management server, the information monitoring server, historical analysis and tactful expansion servers, virtual file view terminal and reliable transmission are kept terminal, it is characterized in that, virtual file view terminal and metadata management server, the replica management server, SRM server and reliable transmission are kept terminal and are linked to each other, replica management server and historical analysis and tactful expansion servers, the SRM server, transport management server links to each other, transport management server and reliable transmission keep terminal all with the information monitoring server, data storage server links to each other, the information monitoring server links to each other with historical analysis and tactful expansion servers, and the SRM server links to each other with data storage server; Virtual file view terminal receives the access request from user or system's external application, and keeps terminal interaction to handle request according to different requests with metadata management server, replica management server, SRM server or reliable transmission; The reliable file transmission terminal is in the request that receives virtual file view terminal and make when response, be connected to the terminal clientsaconnect at data storage server and user place, initiate the transfer of data between data storage server and the terminal clientsaconnect, the performance of transfer of data is caught by the information monitoring server, is sent to historical analysis and tactful expansion servers afterwards; The replica management server is in the request that receives virtual file view terminal and make response, promptly be connected to historical analysis and tactful expansion servers is obtained the copy maintenance strategy, be connected to the SRM server and obtain data storage information, be connected to the transfer of data between the transport management server initiation internal system data storage server; The SRM server is periodic and data storage server is mutual, collects every index to data storage server, and the legitimate files information of assigning data storage server; Data storage server is except the communicating by letter of above-mentioned and SRM server, also keep the data transfer request that terminal is sent according to transport management server and reliable transmission, between log-on data storage server and the user place client computer or data storage server and data storage server between transfer of data.
2, distributing traffic information storage file system according to claim 1, it is characterized in that, described data storage server comprises: Ftp server unit, SRM client unit, wherein: the Ftp server unit is kept terminal with reliable transmission and is connected, Ftp server unit in each data storage server interconnects, file transfer protocol (FTP) and Ftp server end code have been realized in the Ftp server unit, as the transmission server in the file transfer; The SRM client unit is connected with the SRM server, it periodically starts a thread, be used for and the SRM server communication, report the every index of this machine to the SRM server, obtain the legitimate files information of this machine from the SRM server.
3, distributing traffic information storage file system according to claim 1, it is characterized in that, described SRM server, be connected to one or more data storage servers, manage the life cycle of connected data storage server, monitor the basic index of all these data storage servers and in the visit accessibility of present stage.
4, distributing traffic information storage file system according to claim 1, it is characterized in that, described metadata management server comprises logical file map unit and burst address mapping unit, the logical file map unit is created logical file the user, simultaneously also can deposit the actual content of this file in data storage server, divide burst time-division partition sheet ID, when obtaining file by consulting of user's space logical file obtained the ID of the burst that file is divided in system, the burst address mapping unit is determined the physical address of burst according to the result of last transmission when the user creates logical file, increase the copy address that burst is linked to when copy spreads.
5, distributing traffic information storage file system according to claim 1, it is characterized in that, described transport management server and reliable transmission are kept terminal, they comprise a common transmission control bag, transport management server links to each other with data storage server, and the reliable file that it uses this son bag to finish between each data storage server of internal system transmits; The terminal clientsaconnect that reliable transmission is kept terminal and data storage server, use native system links to each other, and the reliable file that it uses this son bag to finish between the terminal clientsaconnect of internal system data storage server and use native system transmits.
6, distributing traffic information storage file system according to claim 5, it is characterized in that, contain transmission thread scheduling unit, failed tasks recovery unit, dynamic task updating block in the described transmission control bag, wherein: transmission thread scheduling unit is used for starting, stops, suspends the transfer of data thread; The failed tasks recovery unit is used to restart the data transfer task of having failed, and guarantees that the new transfer of data that starts starts from transformation task failure last time; The real-time condition that the dynamic task updating block is finished according to task dynamically updates data transfer task, adjusts the start-stop position of data transfer task.
7, distributing traffic information storage file system according to claim 1, it is characterized in that, described replica management server, be used for the diffusion of copy: the strategy customization copy diffusion plan that the replica management server returns according to historical analysis and tactful expansion servers when needs are set up copy, finish this task by calling transport management server, and the address of burst is upgraded by the metadata management server.
8, distributing traffic information storage file system according to claim 1, it is characterized in that, described historical analysis and tactful expansion servers, the information monitoring server is collected the useful data that calculates to be analyzed, the strategy that uses in the analytic process is customization, specifically transmit or the data storage server of historical transmission rate the best transmits by the data storage server of current transmission rate the best, or be present rate and historical speed to be integrated consideration give two speed certain weight respectively, the weighted sum of calculating them is as last evaluation.
9, distributing traffic information storage file system according to claim 1, it is characterized in that, described virtual file view terminal is the main entrance end of system, it is window with user interactions, the user sends various instructions to Virtual File System in this terminal, according to these instructions, terminal is called different management servers.
CNB200710038073XA 2007-03-15 2007-03-15 Distributing traffic information storage file system Expired - Fee Related CN100518132C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB200710038073XA CN100518132C (en) 2007-03-15 2007-03-15 Distributing traffic information storage file system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB200710038073XA CN100518132C (en) 2007-03-15 2007-03-15 Distributing traffic information storage file system

Publications (2)

Publication Number Publication Date
CN101022397A CN101022397A (en) 2007-08-22
CN100518132C true CN100518132C (en) 2009-07-22

Family

ID=38710053

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB200710038073XA Expired - Fee Related CN100518132C (en) 2007-03-15 2007-03-15 Distributing traffic information storage file system

Country Status (1)

Country Link
CN (1) CN100518132C (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101729582B (en) * 2008-10-27 2012-08-08 华为技术有限公司 Management method of distributed storage, device and system thereof
CN101873576B (en) * 2009-04-24 2014-04-16 电信科学技术研究院 Relay node capability report method, system and device
CN102801690B (en) * 2011-05-25 2015-09-30 华为技术有限公司 The processing method of Streaming Media, Distributor, client and system
CN102855239B (en) * 2011-06-28 2016-04-20 清华大学 A kind of distributed geographical file system
CN102314480B (en) * 2011-07-05 2013-04-10 万达信息股份有限公司 Distributed data storage method specific to mass data
CN105072201B (en) * 2015-08-28 2018-04-13 北京奇艺世纪科技有限公司 A kind of distributed memory system and its storage method of quality control and device
CN106341474B (en) * 2016-09-06 2019-11-05 上海海事大学 It is a kind of that center and its contents management method are managed based on the data of ICN and SDN network
US11061609B2 (en) * 2018-08-02 2021-07-13 MemVerge, Inc Distributed memory object method and system enabling memory-speed data access in a distributed environment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Data Management and TransferinHigh-PerformanceComputational Grid Environments. Bill Allcock, Joe Bester etc.Parallel Computing,Vol.28 No.5. 2002
Data Management and TransferinHigh-PerformanceComputational Grid Environments. Bill Allcock, Joe Bester etc.Parallel Computing,Vol.28 No.5. 2002 *

Also Published As

Publication number Publication date
CN101022397A (en) 2007-08-22

Similar Documents

Publication Publication Date Title
CN100518132C (en) Distributing traffic information storage file system
CN102130938B (en) Resource supply method oriented to Web application host platform
CN102546256B (en) System and method used for monitoring cloud computation service
CN101667034B (en) Scalable monitoring system supporting hybrid clusters
CN100407152C (en) Methods and systems for multi-policy resource scheduling
CN100394726C (en) Method for raising reliability of software system based on strucural member
CN102882909B (en) Cloud computing service monitoring system and method thereof
US6907406B2 (en) On-demand service expanding system and method for providing services
CN106936899B (en) Configuration method of distributed statistical analysis system and distributed statistical analysis system
CN105357296A (en) Elastic caching system based on Docker cloud platform
CN104699736B (en) A kind of distributed larger scale data acquisition system and method based on movable equipment
CN107787490A (en) Function is directly connected in distributed data base grid
CN101252588A (en) Apparatus, system and method for distributing stream medium content
CN106407011A (en) A routing table-based search system cluster service management method and system
CN110087250A (en) A kind of network slice layout scheme and its method based on multiple target combined optimization model
CN101562804A (en) Region management server system based on mobile P2P and deploying method thereof
CN112416969B (en) Parallel task scheduling system in distributed database
CN109739640A (en) A kind of container resource management system based on Shen prestige framework
CN111460031A (en) Data synchronization method, device, equipment and medium
CN110287266A (en) A kind of distributed system and data processing method
CN105138691A (en) Method and system for analyzing user traffic
CN109002249A (en) Method, storage medium, equipment and the system of present double hit are realized by long-pressing gesture
CN1326035C (en) Mobile application environment
CN1625109A (en) Method and apparatus for virtualizing network resources
CN113766004A (en) Disaster recovery system, method and storage medium based on multi-cloud platform

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090722

Termination date: 20120315