US20130067038A1 - Data access and management system as well as a method for data access and data management for a computer system - Google Patents
Data access and management system as well as a method for data access and data management for a computer system Download PDFInfo
- Publication number
- US20130067038A1 US20130067038A1 US13/609,065 US201213609065A US2013067038A1 US 20130067038 A1 US20130067038 A1 US 20130067038A1 US 201213609065 A US201213609065 A US 201213609065A US 2013067038 A1 US2013067038 A1 US 2013067038A1
- Authority
- US
- United States
- Prior art keywords
- data
- mirror
- mirrors
- computer
- cells
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
- G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
- G06F11/2094—Redundant storage or storage space
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Definitions
- the invention generally relates to a data access and management system as well as to a method for data access and data management for a computer system.
- the present invention relates to a system and a method for optimising the access to data and their processing in distributed and networked computer structures.
- the transmission times from the server to individual clients differ greatly in part because the connection quality to the clients varies e.g. due to various distances between the server and the clients as well as different transmission performances in various areas of the network.
- the connection quality to the clients varies e.g. due to various distances between the server and the clients as well as different transmission performances in various areas of the network.
- lags must be mentioned which affect the communication between the server and the clients.
- the invention is to enable an as rapid as possible supply with data/functionalities, whereby it is additionally to be ensured that the transmissions are effected as fault-tolerantly as possible.
- the present invention secures the operability of a distributed networked computer system in the case of the failure of data providing means of the computer structure.
- the invention is also to secure the operability of a distributed networked computer system in the case of the failure of individual areas of the networks via which the data providing means and clients are connected with each other.
- the invention is to enable that clients are only provided with current data.
- the invention also intends to reduce the required transmission capacities of a networked distributed computer system.
- the data provided in a computer system is stored in a redundant manner in the data storage means, depending on prespecified parameters of the data transmission between data storage means and computer units, and the computer units access one of the data storage means as a function of the determined prespecified parameters.
- optimise data transmissions between the data storage means and the computer units in the desired application-specific manner in order to be carried out more rapidly and in a manner involving fewer faults.
- the data storage means comprise control unit for controlling the data access and the data management in order to work independent of other means of the computer system. This reduces the quantity of the data to be transmitted in the inventive system and increases the fault tolerance of the inventive system because the data are not processed centrally.
- the data storage means copy redundantly stored data in the system among each other as a function of the determined parameters of data transmissions between the individual data storage means and the computer unit and delete the data in the data storage means in which it had been stored beforehand. Data can thus be shifted in the inventive system from one data storage means to other data storage means, whose parameters of the data transmission enable a higher degree of optimisation of the data access and the data management for the respective application case of the invention.
- the data storage means process the stored data independently from the computer unit. In this manner data can be processed in a decentralised way whereby increased data integrity and an increased fault tolerance as well as a relief of individual system components is achieved.
- the data in the system is divided into data subsets, and the data storage means are divided into cells in such a manner that each of the data subsets to be stored in a redundant manner is stored in one of the cells each of the corresponding data storage means in order to only store that data in a redundant manner which is currently required.
- the data storage means are divided into cells depending on data transmission parameters in order to further optimise the data transmissions within the inventive system.
- each cell may comprise additional data which relates to parameters to data transmissions between the individual data storage means and the computer unit, and/or neighbouring cells, and/or cells which comprise data which is stored in the system in a redundant manner.
- the cells in special data storage means can be designed in such a manner that the parameters of data transmission between the individual data storage means and the computer unit are identical for the cells of a data storage means in order to achieve a consistent data access for the individual data storage means.
- the computer units can also be connected with one or several users in order to transmit the data from the data storage means and/or to be controlled by the user.
- a user is preferably a personal computer, and/or a central processing unit of a computer and/or another data storage means.
- the computer unit can also be a system which provides Internet services such as e.g. data base access operation and computer games.
- the computer unit can also be suited to immediately access individual cells of the data storage means, which relieves the individual data storage means of data access and data management tasks.
- the prespecified parameters of data transmissions between the individual data storage means and the computer unit can comprise the duration of the transmission, and/or the fault rate, and/or the duration of data processing operations of the individual data storage means prior to the transmission of the data. In this manner, data can be accessed more rapidly and data is provided which is less faulty.
- the individual components of the inventive system according to an embodiment of the present invention are connected with each other via data transmission means, which can comprise electrically conductive connections, and/or bus systems, and/or computer networks, and/or wired or wireless (mobile) telephone networks, and/or the Internet.
- data transmission means can comprise electrically conductive connections, and/or bus systems, and/or computer networks, and/or wired or wireless (mobile) telephone networks, and/or the Internet.
- the present invention is thus suited for each computer structure and arrangement as well as for each computer system which utilises distributed and networked means.
- the present invention can be used in a system for a computer game which is provided via the Internet.
- at least one computer unit is an Internet service provider in order to integrate the present invention into existing computer structures of the Internet and in order to enable Internet users an inventive access to the data.
- the invention is suited for interactive computer games for use by at least two users in order to ensure an optimised supply of the individual user with data required for the computer game, whereby each user can be connected with one computer unit.
- data for executing the computer game is transmitted from the computer units to the users so that the computer game can also be carried out—at least partially—independent of the computer units.
- Another relief of the computer units and the data storage means can be obtained if the users process the received data for executing the computer game and transmit it back to the corresponding computer units.
- inventive system for a computer game can comprise additional means for the detection of prespecified parameters of the data transmission between the computer units and the respectively connected users in order to additionally optimise the data access and the data management.
- these prespecified parameters comprise the duration of the transmission, and/or the fault rate, and/or the duration of data processing operations of the individual computer units and/or the individual users prior to the transmission of the data.
- the computer units can receive control data for executing the computer game from the respective users in order to enable improved interactions of the individual users.
- This control data or equivalent data can then be output by the computer units to the data storage means.
- the computer units process data for executing the computer game, depending on the control data
- the data storage means process data for executing the computer game, depending on the control data or on data equivalent to the control data, whereby a more efficient data access and a more efficient data management is achieved.
- data is stored in a redundant manner in at least two of at least two data storage means depending on determined parameters of the data transmission between the data storage means and computer units, with the access to the stored data by the computer units being effected as a function of the determined parameters of the data transmission.
- the data access and the data management are preferably controlled by the data storage means.
- the redundantly stored data are copied among each other by the data storage means as a function of the determined parameters of data transmissions between the individual data storage means and the computer unit and deleted in the data storage means in which the copied data has been stored beforehand.
- optimised storage of the data can be divided into data subsets, with the data subsets to be stored in a redundant manner being stored in cells of the individual data storage means.
- the division into data subsets and the storage in cells is carried out as a function of the data transmission parameters.
- a further optimisation can be obtained if additional data for data access and data management is stored in the cells, which relate to the parameters of data transmissions between the individual data storage means and the computer unit, and/or neighbouring cells, and/or cells which comprise the data redundantly stored in the system.
- the access to data of cells of a data storage means has identical data transmission parameters in order to ensure a consistent data access for the individual data storage means.
- the computer unit outputs data for storage in the data storage means and/or the data stored in the data storage means is processed by the computer unit.
- the data is preferably transmitted by the computer unit to a user and/or the computer unit is controlled by the user in order to process data independent of the execution of the inventive method and to additionally control the sequence of the inventive method.
- the inventive method is thus capable of providing Internet services.
- the access can also be made directly to the data of individual cells of the data storage means.
- the determination of the prespecified parameters of data transmissions between the individual data storage means and the computer unit comprises the determination of the duration of the transmission, and/or the fault rate, and/or the duration of data processing operations of the individual data storage means prior to the transmission of the data in order to access data more rapidly and/or reliably.
- the method can enable at least two users to access the computer game, with the computer game being an interactive computer game.
- the data for executing the computer game from the computer units can be transmitted to the respective users.
- the data received by the users are processed by the users and transmitted back to the corresponding computer units in order to relieve the computer units and the data storage means and to optimise the execution of the computer game.
- prespecified parameters of the data transmission between the computer units and the respective users connected therewith are determined in addition, in order to carry out the data access and the data management with the inventive method also under consideration of these parameters.
- the determination of the prespecified parameters of data transmissions between the computer units and the users which are connected therewith comprises the determination of the duration of the transmission, and/or the fault rate, and/or the duration of data processing operations of the individual computer units and/or the individual users prior to the transmission of the data.
- the redundant storage of the data for the execution of the computer game can also be carried out as a function of the determined prespecified parameters of the data transmission between the computer units and the respective users connected therewith.
- control data for the execution of the computer game is additionally transmitted by the users to the corresponding computer units.
- control data or equivalent data from the computer units is also transmitted to the data storage means.
- the use of the present invention automatically optimises the connection quality between clients and data providing means of a computer structure so that poor transmission qualities (e.g. low transmission rate, lags, . . . ) are automatically compensated.
- poor transmission qualities e.g. low transmission rate, lags, . . .
- individual area of a distributed networked computer system e.g. individual memory areas
- the present invention also enables to replace individual failed areas of a distributed networked computer system by other areas without interruption of the operation. This is possible because the invention does not require a central connection between individual areas of the computer system, which prevents limitations of the functionality of the inventive system due to failures (e.g. technical defects). In addition, the invention ensures a higher data integrity because the data is not stored centrally.
- FIG. 1 is a schematic representation of a preferred embodiment of a computer structure according to the present invention
- FIG. 2 shows a schematic representation of a data structure as well as its division and assignment to cells according to the present invention
- FIG. 3 is a schematic representation of another preferred embodiment of a computer structure according to the present invention.
- FIG. 4 is a schematic representation of a section of the preferred embodiment of FIG. 1 for the explanation of operations, which are used for executing the invention.
- the entire data quantity GD which is used in the context of the invention is divided into individual data subsets which are referred to as field F.
- each field F in the entire data quantity GD is described by a unique field position or identification FeldIF (fieldID), with the entire data quantity GD being capable of being divided one or multi-dimensionally. If, for example, the entire data quantity GD is divided three-dimensionally, each field position FeldID can be described by x, y, z.
- a cell Z is the smallest unit for data storage which stores exactly one field F.
- a cell Z also contains other information which will be covered in detail later.
- a cluster C comprises one cell Z or is an accumulation of several cells Z.
- a cluster C can, for example, be formed by an individual computer or an integrated circuit which manages individual or several cells Z. Moreover, a cluster C an operate as a higher-level control unit for the cells Z contained in it.
- All clusters C which are combined for the representation of the entire data stock GD form a cluster pool or a cluster compound CV.
- the individual clusters C are connected via a network N, with each cluster C having a unique address.
- a cluster compound CV can thus be formed by networking individual computers forming clusters and/or by connecting individual integrated circuits forming clusters.
- each cluster is identified by a unique identification ClusterID which can be a single number or a triple.
- Individual clusters in the compound contain a table of the neighbours (neighbour table) in order to be able to relay certain messages to certain clusters.
- a neighbour is another cluster with a next higher or lower identification ClusterID.
- the number of cells Z which belong to a cluster can vary between 0 and an upper limit maxcc, where maxcc can be different for each cluster C in the cluster compound CV.
- the number of cells Z which are actually included in a cluster C is indicated as ncc.
- each cell Z has a unique identification ZellID (cellID) within a cluster C.
- cells Z of a cluster C can exchange information among each other without sending messages via the network N, which enables a reliable message transmission within a cluster C.
- all cells Z of a cluster C are provided with the same connection quality, i.e. though the connection to the connection to network N can be different between the individual clusters C, it is the same for all cells Z of a cluster C.
- a cluster C comprises between 0 and maxcc cells Z.
- Each memory location of a cluster C which can store a cell Z is referred to as slot S.
- a slot S can be full, i.e. it stores the data of a cell Z, or empty, i.e. it represents no cell Z. Therefore, the clusters C from FIG. 2 comprise only one full slot S. each.
- the identification SlotID of each slot S corresponds to the identification ZellID which a cell Z would be assigned in this memory location.
- a client CL e.g. Internet provider, personal computer, network computer, and the like
- a client CL is a unit communicating via the network N which requests data, processes data and/or orders to store the modified data.
- no assumption whatsoever concerning the actual realisation of the network N is made.
- network N any means which transmit data can be employed, such as e.g. proprietary busses, local networks, or the Internet.
- the invention does also not assume that the network N ensures the transmission of all data, so that acknowledgements concerning a data transmission tot he respective sender are not required, and that the network N transmits data according to its sending time.
- the invention is based, among other things, on a distribution of the entire data GD or the fields F, respectively, to several cells Z of identical contents, i.e. a single field F is stored in several cells Z in a redundant manner.
- the Number of cells Z which store and manage a certain field F is specified as nm and is the same throughout the entire cluster compound CV, with each of the nm cells Z being referred to as mirror SP for the field F which is stored in the nm cells Z.
- a response AK is the response to a request RQ.
- the contents and function of the individual requests RQ and responses AK depends on the transmitted data.
- a message MSG is a data quantity which is exchanged between cells Z, clusters C and clients CL. It is the task of the network N to transmit the messages MSG. Due to the fact that the sender of a message MSG does not receive an acknowledgement of a successful transmission, messages MSG can get lost. It is also possible that two messages MSG arrive at a destination after different times. Now the principal procedure with the present invention and individual actions or operations, respectively, for carrying out the invention will be described.
- the entire data quantity is divided into the individual fields F.
- Such a division can, or example, be effected two-dimensionally or three-dimensionally.
- a chessboard could be divided into 8*8 fields F, with each field F containing the information on the respective chessboard square, e.g. which chess piece is located there.
- a three-dimensional space can be represented by fields F. It is also possible, however, to divide an image into individual image areas or a text into individual words or character(s) (strings) which are assigned to individual fields F.
- the contents of the fields F is application-specific and is not relevant in the present invention.
- each cell Z storing a corresponding field F, i.e. the actual data, as well as further information which preferably relates to references to neighbouring fields F.
- This information permits a data reduction because in this manner, “empty” fields F need not be stored and not each field F must be assigned a cell Z.
- each cell in the cluster compound CV is available in a redundant manner, i.e. nm times in nm clusters C.
- each field F is nm times stored in these cells Z, and each of these cells Z is referred to as mirror SP with respect to the field F stored therein.
- each cell Z contains information in which clusters C and/or in which cells Z of the corresponding clusters C the other nm ⁇ 1 cells Z are located.
- each cell Z contains further information which preferably comprises indications on the data transmission quality in the cluster compound CV and with respect to the clients CL, e.g. transmission quality, transmission rate, and the like. This information is updated when the cells Z are accessed.
- a client CL In order to receive the contents of a field F, a client CL sends a request via the network N to all cells Z and/or clusters C, which include the desired field F, i.e. to all cells Z which are mirrors SP of the desired field F. It depends on the parameters of the data transmissions to the individual cells Z and/or clusters C as well as back to the clients CL, from which cell Z of which cluster C the requesting client CL will receive a response.
- the requesting client CL receives a response from the cell Z and/or the cluster C, which realise the fastest data transmission at the respective time and/or which are capable of carrying out a processing of the data more rapidly prior to its sending to the requesting client CL.
- All cells Z and/or clusters C and/or clients CL periodically check their applicable parameters for data transmissions. In periodic intervals or subsequently to specified actions, all cells Z and/or clusters C and/or clients CL check the parameters for data transmissions, which are applicable to the used cells Z. If the checked parameters do not meet specified limits, or if other cells Z and/or clusters C comprise better data transmission parameters, the checking cells Z will try to shift its data to these other cells Z and/or clusters C in order to improve the data transmission parameters applicable for this data. In this manner, the inventive cluster compound CV optimises itself automatically during operation with respect to data transmissions.
- Certain requests of a client CL such as e.g. a write request WriteRQ as described below are synchronised between all mirrors SP of the respective field F. In this manner, failed mirrors SP are identified. In addition, extra checks are carried out at periodic intervals and/or by clients CL after the receipt of responses AK. This, too, identifies failed mirrors SP and/or mirrors which are no longer relevant. These mirrors SP are either replaced by other mirrors SP, or a cell Z or a cluster C or a client CL substitutionally generates new mirrors SP, or the present defects are remedied by means of methods described below. In this manner, the cluster compound CV is fault tolerant against the failure of individual cells Z and/or whole clusters C.
- requesting clients CL can assign individual cells Z and/or clusters C special processing functions which are executed independent of the mode of operation of the clients CL.
- a client CL for example, can instruct a cell Z or a cluster C to change the data of a field F in certain intervals. This characteristic is of particular importance if the present invention is employed in connection with computer games which are executed under real-time conditions via a network, e.g. the Internet, in order to reduce the data quantities to be transmitted and to optimise the interactive operations in the execution of a computer game.
- Data between the individual clients CL, clusters C, and cells Z are transmitted by using a certain protocol. This means that in addition to the transmitted data, further prespecified data are sent and received by the individual clients CL, clusters C, and cells Z in order to initiate desired operations or to react in a desired manner as described below. All clients CL, clusters C, and cells Z carry out the necessary operations in order to achieve the desired functionality of the corresponding cluster compound CV. If the invention is employed as shown in FIG. 1 for providing computer games via the Internet, then the network N is the Internet and the client CL is the computer system which operates as Internet provider.
- the individual clusters C comprise memory units of the client CL and storage means of other computer systems which are distributed over the computer system.
- the user B and the client CL form a system to be regarded as consistent at that time. For this reason, the user B from FIG. 1 is not shown in FIG. 4 .
- An inventive optimisation of the data transmission to the users B were possible only if the user B had a simultaneous access to different Internet providers.
- the present invention permits an optimisation of the data management and transmission for clients CL operating as Internet providers if these access e.g. the data required for an interactive computer game, with several players via the Internet in accessing other computer systems operating as clusters. As shown in FIG.
- the invention can also be employed in a consistent computer structure such as in a personal computer PC.
- the central processing unit CPU operates as client and the various data managing means MEM 1 , MEM 2 , MEM 3 operate as clusters.
- the data managing means MEM 1 , MEM 2 , MEM 3 can be conventional storage means, e.g. non-volatile memories or random access memories, but also special means which e.g. do not only store but also process data and which can therefore not provide the central processing unit CPU with data without restrictions and at any time.
- a cell Z can assume five states, with each status being always possible because the cells Z are not fault tolerant and the network N does not ensure and check data transmissions.
- Active status The contents of the cell Z are valid and the cell Z is ready for operation.
- Invalid status (invalid): The cell Z is ready for operation but its contents are no longer current and valid. This can occur, for example, if the cell Z has not carried out data operations because of a technical defect or because of not received information.
- Inactive status (inactive): The cell Z is not available, e.g. because data transmissions to it are permanently lost or because the cell Z has permanently failed.
- Blocked status (blocked): The cell Z processes only certain data transmissions, such as e.g. the write requests WriteRQ or read requests ReadRQ described below.
- Idle status (idle): The cell Z is ready for operation, but is currently not used in the cluster compound CV.
- a cell Z contains a certain field F, i.e. a field F with a certain field position FeldID (fieldID) and has a unique position ZellID (cellID) within the corresponding cluster C.
- the cluster c in turn is identified by a unique identification with the form ClusterID:ZellID.
- Each cluster C and each client CL is uniquely identified in the cluster compound CV by an identification ClusterID, ClientID, respectively. No particular requirement are placed on these identifications, they only have to provide for a unique identification of the cluster C and the clients CL.
- each message MSG is given a ticket number TNr which is generated upon sending.
- a ticket number TNr can, for example, be combined by the sending time of the message (or from a continuous counter generated in the cell) and the sender's identification. Due to the fact that the sender's identification is unique and the sending times of two messages MSG are different, each message MSG can be assigned the respective operation in a unique manner.
- Unique ticket numbers TNr can be generated depending on the most different applications of the invention in other ways.
- a cluster C receives a message MSG which is destined for another cluster C, i.e. the ClusterID of the destination address of the message MSG does not correspond to the address of the receiving cluster C, then the receiving cluster C relays the message MSG to the cluster C for which the message MSG is intended.
- the way in which the message MSG is relayed depends on the actual realisation of the network N, and/or the clusters C, and/or the clients CL, and/or the data transmission protocol, and/or corresponding data included in the message MSG.
- a message MSG is also relayed if a cell Z receives the message MSG which is intended for another cell Z.
- Each cell Z contains information on neighbouring cells Z and, on the basis of this information, checks whether a desired cell Z is located within the current cluster C. If this is not the case, preferably the cell Z is selected from all neighbouring cells Z of the current cluster C which is the most neighbouring cell with respect to the cell Z. If several cells Z meet this requirement, a cell Z can be selected at random.
- a step counter may be incremented by one step.
- the respective cluster C sends a holding response GarAK (holdingAK) to the sender of the message MSG in order to inform same that his request RQ is still being processed. If the sender does not receive such a holding response GarAK in this case, then the sender can assume that is message MSG has been lost. The sender can then direct its message MSG e.g. to the last cluster C which has sent the last received holding response GarAK.
- a pseudoreliable message PSM can be used.
- the pseudoreliable message PSM is sent repeatedly until a loss of the message is improbable. Only then it is assumed that the transmission has failed.
- Pseudocode for sending a pseudoreliable message PSM Pseudocode for sending a pseudoreliable message
- the corresponding cell Z must check whether all responses AK have been received when it executes its update procedure.
- the corresponding status (cs_psm_waiting) must be processed there. It must then be decided whether all responses AK have been received and, if not, if waiting is to be continued:
- the self check is the central operation in order to ensure the consistency of all mirrors SP of a compound for a field F.
- a self check is initiated by a requesting third party, e.g. a client CL or a cluster C.
- a mirror SP which carries out a self check causes that the other mirrors SP of the compound also carry out a self check.
- a self check by a mirror SP can result in a fault correction by this mirror or another mirror SP.
- the individual operations (such as adding a new mirror, etc.) should be fault tolerated to a certain degree. The case that a message, though classified as not delivered, is delivered nevertheless is very improbable with PMS but not impossible. Therefore corresponding fault corrections must be provided.
- a mirrors SP receives a self check request ditestRQ (self checkRQ), it begins a self check under the same ticket number TNr, provided it is not just carrying out a self check which has been initialised by another self check request ditestRQ and if the ticket number TNr of the currently received self check request ditestRQ differs from the last received check request ditestRQ.
- a requesting third part sends a read request LeseRQ (readRQ) described below, the execution of a self check is necessary only if the requesting third party receives inconsistent responses AK from the corresponding mirrors SP of a field F which the requesting third party intends to read.
- readRQ read request LeseRQ
- the requesting third party compares the responses AK received from the mirrors SP and—under the assumption of the above described three mirrors SP for one field F—with three responses AK accepts the result. With two response AK it initiates a self check and accepts the result. With only one response AK it initiates a self check and rejects the result.
- the corresponding mirror SP must check its own validity and is either responsible for the fault correction itself or instructs another mirror SP to perform the fault correction. In the selection of a mirror SP for the fault correction it is to be attempted that always only one mirror SP carries out the fault correction, even if several mirrors SP perform a self check quasi simultaneously, in order to avoid inconsistent conditions.
- the mirror SP sends a validation request ValidierRQ (validationRQ) to all other mirrors SP.
- ValidierRQ validationRQ
- the exchange of the corresponding data is done by using pseudoreliable messages PSM. If no response AK is received, the destination is declared unavailable. The failed mirror SP is then replaced by a new one.
- a mirror starts a self check if it receives a corresponding message:
- rq_start_selfCheck begin if not used then exit; if (status ⁇ >cs_idle) then begin return_msg(m,ak_busy); exit; end; start_selfcheck; exit; end;
- the self check can also be carried out automatically at certain intervals.
- the checking mirror SP sends a corresponding request to all other mirrors SP:
- Each cell Z must be capable of responding to validation requests:
- the checking cell Z After the checking cell Z has either received all responses AK or the time has elapsed, it reviews the result of the self check:
- V (valid): The sending mirror SP accepts the receiving cell Z as mirror SP, and the life counters of the sender and the recipient have the same value.
- the sending mirror SP accepts the receiving cell Z as mirror SP, but the life counter of the sender has a lower value than the life counter of the recipient.
- V I a) The requested mirror SP sending a “V” receives an “I” from the requested mirror SP sending an “I”: The requesting mirror SP and the requested mirror SP sending a “V” are valid, the requested mirror sending an “I” is invalid and is to be removed from the compound. The mirror SP with the lowest index must find a new mirror SP. b) The requested mirror SP sending a “V” receives a “V” from the requested mirror SP sending an “I”: The requested mirror SP sending an “I” is inconsistent and must be removed from the group (see detailed explanation in the following). The mirror SP with the lowest index must find a new mirror SP. 5) D I The requesting mirror SP takes over the data of the mirror SP sending a “D”. Otherwise the procedure corresponds to case (4).
- V- A requested mirror cannot transmit data The mirrors SP of the two working mirrors SP with the lower index must find a new mirror SP. The failed mirror SP is treated like to mirror SP sending an “I” in cases (4) and (5).
- a new mirror SP is found by one of the remaining mirrors SP, with only one mirror being allowed to do this task.
- a mirror must be selected, e.g. the one with the lower index.
- the other mirror SP with the higher index does not execute any operations, but will receive messages MSG after some time which indicate the integration of a new mirror SP into the compound.
- a mirror SP If a mirror SP has physically failed, it is either possible that no requests RQ were made to the mirror compound in the meantime, i.e. that its failure has not been noticed and has not brought about any impacts, or that the two other mirrors SP have declared it invalid in the meantime and found a replacement mirror. If a restart operation is carried out, such a condition can be determined. For this purpose, the starting mirror SP carries out a self check as previously described.
- the life counter is a counter which is incremented by integer values.
- the life counter of all clients CL, cells Z, and clusters C is periodically adjusted, i.e. set to a lower common value.
- the adjustment is initiated from any mirror SP, e.g. from the mirror SP with the lowest life counter value.
- All mn mirrors SP of a field F wait for the receipt of all nm ⁇ 1 responses AK (PSM). Only if all nm ⁇ 1 responses AK are received, the respective mirror SP carries out an adjustment of the life counter.
- the interval between two adjustments is selected in such a manner that mirrors SP which have been replaced in the meantime do not become valid again upon a restart.
- an additional memory is used for this purpose in which the value of the last life counter is stored where a mirror SP has been replaced.
- pseudoreliable messages PSM In the case of pseudoreliable messages PSM, too, faults can occur. It is true that the parameters for pseudoreliable messages PSM can be selected in such a manner that faults are improbable to such an extent that they virtually do not occur in the selected application. This can, however, lead to the result that the application is actually no longer practicable. With respect to the parameters for pseudoreliable messages PSM it might be necessary to make compromises so that faults occur due to faulty pseudoreliable messages PSM, which must be corrected.
- DoubleFieldCheck serves to correct faults which have been caused by communication errors with pseudoreliable messages PSM. Such faults cause mirror compounds to duplicate, i.e. that more than nm mirrors exist for one field.
- the operation DoubleFieldCheck can be carried by one or more mirrors SP in an interval t_DoubleFieldCheck.
- Each client CL can initiate an operation DoubleFieldCheck if it receives responses AK from mirrors SP whose references to other mirrors SP are not consistent.
- the operation DoubleFieldCheck removes additionally generated mirror compounds in order to restore the desired condition of nm mirrors SP per one field F.
- a manager for the operation DoubleFieldCheck is selected. This can be any cell Z (also of the mirror compound) or a client CL (e.g. the client which detected the error situation).
- the manager sends a request RQ to the network to which all cells Z respond which are responsible for a certain field F, whereby also additional mirror compounds are detected.
- the manager decides which cells Z belong to the valid mirror compound and sends a delete request DeleteRQ to all other cells Z.
- the manager sends a request rq_updateTable to all remaining mirrors SP for updating their mirror tables.
- One possibility is to introduce a generation counter which is incremented each time a new mirror SP is added to the compound.
- the mirror SP with the higher/lower generation counter will be removed. It is also possible to declare the mirror compound valid which was last write-accessed.
- the validity of a mirror compound can also be decided as a function of any other properties (e.g. geographic position of mirrors SP). If only one single mirror SP is detected as working properly e.g. by a client CL, it is possible that the error is with this mirror SP and not with the nm ⁇ 1 other mirrors SP. In order to exclude this possibility, an additional safety check should be carried out for ensuring the correct function of the single mirror SP before same replaces the other mirrors SP. It is thereby prevented that the single operating mirror SP erroneously activates additional mirrors SP.
- nm ⁇ 1 new mirrors SP are to be added.
- the working mirror SP must check or ensure, respectively, the function of its own data transmissions.
- nm ⁇ 1 new mirrors SP are requested by a request rq_needNewCells. All nm ⁇ 1 new mirrors SP are sent a request to become mirrors. It is thereby not necessary to evaluate the responses AK immediately, because any faults will be corrected by later self checks SelfChecks (this sequence approximately corresponds to the addition of a new field F, with the difference that only nm ⁇ 1 cells Z are found and that the mirror manager is this case is identical with a mirror SP).
- Read operation A client CL reads the contents of a field F from a mirror SP.
- Write operation A client modifies the contents of a field F in all associated mirrors SP.
- Delete operation Deletion of a field F in the cluster compound CV.
- a client CL determines the position of the cells Z which include a desired field F and are thus mirrors SP for the desired field F.
- the addresses of these cells Z include both the identifications ClusterID of the corresponding clusters C as well as the identifications ZellID of the cells Z themselves.
- the client CL requests any cluster C, e.g. cluster C 6 , whether one of its cells Z includes the desired field F 8 . If this is the case than the cluster C 6 sends the corresponding cell identification ZellID as well as the cluster identifications ClusterID of all nm ⁇ 1 cluster C which include mirrors SP of the desired field F 8 . As shown in FIG. 4 , in this case these are the cell C 4 in cluster C 1 and the cell Z 6 in cluster C 3 , i.e. in total the cells with the identifications ZellID C 1 Z 4 , C 3 Z 6 , and C 6 Z 2 .
- the requested cluster C finds the cell Z among the cells Z included therein whose field position FeldID comes closest to the field position FeldID of the desired field F 8 .
- the cluster C can, for example, determine the sum of the absolute values of the difference between the cell position ZellID and all other neighbouring cell positions ZellID in order to select the cell Z where the absolute value of such a difference is minimal.
- a cluster C can be found in this manner which comprises a cell Z with the desired field F 8 .
- the cluster C 4 requested by the client CL relays the find request FindRQ to the cluster C found in this manner, e.g. to cluster C 6 .
- This operation is repeated until a desired cell Z has been found or until cells Z are not longer found which are neighbouring cells of the desired cell Z.
- a step counter in incremented upon the relay of a find request FindRQ. With each increase of the step counter, the respective current cluster C sends a holding response GarAK (holdingAK) to the client CL in order to inform same that his request FindRQ is still be processed.
- the requesting client CL does not receive such a holding response GarAK in this case, then it is to be assumed that its request FindRQ has been lost. In this case it is to be preferred that the requesting client CL directs the request FindRQ to the cluster C again from which it has received the latest holding response GarAK.
- the find request FindRQ is successfully completed if the requesting client CL receives a destination identification ZielID (destinationID) for nm mirrors SP of the field F 8 .
- the destination identification ZielID would comprise the cells C 1 Z 4 , C 3 Z 6 , and C 6 Z 2 . If the client CL does not receive a response AK, the find operation has failed.
- a client CL executes a find operation and notices the received positions of the mirrors SP which include the desired field F.
- a mirror SP If a mirror SP includes read and write requests ReadRQ, WriteRQ with a field position FeldID for the desired field F, which does not correspond to the field position FeldID for the desired field F in the mirror SP, it informs the client CL accordingly. Furthermore, each mirror SP always or alternatively on request returns the positions of the other nm ⁇ 1 mirrors SP to the requesting client CL. In this manner, a mirror SP can correct the identifications ID stored in it and, if required, send a new find request FindRQ.
- the request of a client CL is always directed to all nm mirrors SP:
- the client CL buffers its own requests in order to be able to execute further actions (e.g. other requests) in the meantime, until the 1 . . . nm corresponding responses ak_read or a timeout arrives.
- TWLese TWLRead
- the read requests ReadRQ and the write requests WriteRQ are sent via the network N to all clusters C in parallel, but depending on the network N used any other type of sending is possible.
- Each mirror SP e.g. the cell C 1 Z 4 , optionally relays a read request ReadRQ from a client CL to all other mirrors SP, i.e. to the cells C 3 Z 6 and C 6 Z 2 in this case, and each mirror SP then sends a response AK to the client CL.
- a mirror SP receives a further read request ReadRQ and because this has the same ticket number TNr as the previously received read request ReadRQ it will be ignored because this mirror SP has already sent a response AK to the requesting client CL.
- the client CL When a read operation is executed the client CL requires the data of a certain field F, e.g. F 8 . For receiving this data the client CL must know the positions of the mirrors SP which are responsible for this field F 8 . This can be enabled by a previously executed find operation in order to determine the cells C 1 Z 4 , C 3 Z 6 , and C 6 Z 2 operating as mirrors SP.
- F 8 a certain field
- the client CL For receiving this data the client CL must know the positions of the mirrors SP which are responsible for this field F 8 . This can be enabled by a previously executed find operation in order to determine the cells C 1 Z 4 , C 3 Z 6 , and C 6 Z 2 operating as mirrors SP.
- the client CL sends a corresponding read request ReadRQ with a unique ticket number TNr to all 3 clusters C 1 , C 3 , and C 6 which include the mirrors SP which are responsible for the desired field F 8 .
- the client CL waits for a predetermined application-specific time interval TWLese (TWRead) for responses AK of the requested mirrors SP which include the desired data.
- TWRead application-specific time interval
- Each mirror SP acknowledges the read request ReadRQ with a response AK so than nm (i.e. 3 in this case) responses AK arrive at the requesting client CL.
- the client CL responds as a function of the type and/or number of the incoming responses AK. With three mirrors SP assumed which are responsible for the field F of the desired data the following different states result. If the client CL receives two or three identical responses AK, the result is used. If it receives two different responses AK or only one response AK the client CL sends a request for a self check to the corresponding mirrors SP. If the client CL receives different responses AK that response AK is used whose life counter has the highest value.
- a read request ReadRQ is successful if the client CL receives at least one response AK and cannot be completed successfully if the client CL does not receive a response AK within the predetermined time interval TWLese or if one or several clusters C signal that they did not find the desired cell Z.
- find requests FindRQ and read requests ReadRQ in a combined manner.
- the client CL directs and find/read request Find/ReadRQ to any cluster C and receives a response AK from same as in the execution of an individual find request FindRQ.
- the response AK does not include the address ID of the desired field F but the data of the desired field F.
- the client CL In order to change the data of a field F, e.g. field F 8 , the client CL sends a write request WriteRQ. As in the case of a read request ReadRQ, the client CL must know the positions of the 3 mirrors SP which are responsible for the desired field F 8 .
- the client CL sends a write request WriteRQ to all 3 mirrors SP of the desired field F 8 .
- the data of the desired field F 8 or of the associated cells C 1 Z 4 , C 3 Z 6 , and C 6 Z 2 operating as mirrors SP is modified in that all mirror SP update their data correspondingly.
- each of the mirrors SP returns a response AK to the requesting client CL.
- the write operation is successfully completed.
- the client CL If at the time at which the client CL sends it write request WriteRQ another write request WriteRQ to the desired cells C 1 Z 4 , C 3 C 6 , and C 6 Z 2 is already being executed the client CL receives a corresponding response AK which indicates that the write request WriteRQ has failed and the desired cells C 1 Z 4 , C 3 C 6 , and C 6 Z 2 are in a locked state.
- a write request WriteRQ has also not been completely successfully if the requesting client CL receives less than nm responses AK, i.e. in the present case less than 3 responses AK.
- the synchronisation which is required for a write request WriteRQ is carried out by the involved mirrors SP in order to ensure that all nm mirrors SP are updated with the same data. If a mirror SP receives a write request WriteRQ, it sends this write request WriteRQ to all other nm ⁇ 1 mirrors SP. Only if the sending mirror SP receives a response AK from all the other nm ⁇ 1 mirrors SP the write request WriteRQ is executed. Thereby the write request WriteRQ received by the mirror SP can be sent either from a client CL or from another mirror SP of the same compound.
- a mirror SP receives another write request WriteRQ from a mirror SP with a lower index, previously arrived write requests WriteRQ are overwritten in all mirrors. Moreover, a mirror SP does not accept further write requests WriteRQ from a client CL if already a not fully executed write request WriteRQ has arrived from another mirror SP or client CL.
- find requests FindRQ and write request WriteRQ in a combined manner as find/write requests Find/WriteRQ, but it is to be checked whether the additional time requirement is reasonable.
- An add request AddRQ serves to integrate a field F which is not yet included in the cluster compound CV into the cluster compound CV.
- Such an add request AddRQ can be sent from a cluster C or a client CL.
- An individual cell receives an add request AddRQ from the client CL to work as a mirror manager and to integrate nm ⁇ 1 (i.e. 2) new mirrors SP into the cluster compound CV.
- nm ⁇ 1 i.e. 2 new mirrors SP into the cluster compound CV.
- one cell Z is always selected a mirror manager which itself is no mirror SP.
- the mirror manager itself is also a mirror.
- the cell C 2 Z 6 working as the mirror manager sends an add request AddRQ for 2 mirrors into the network N.
- the add request AddRQ is related from cluster C to cluster C in the cluster compound CV, e.g. from cluster C 2 to cluster C 3 , with the number of the mirrors SP to be added being decremented upon relay of the add request AddRQ, when the last requested cluster C has provided a cell Z.
- the last requested cluster C sends the identifications ZellID of the cells Z which are considered as mirrors SP to the cell C 2 Z 6 working as the mirror manager.
- the cell C 2 Z 6 working as the mirror manager then sends a corresponding response AK to all cells C 3 Z 1 and C 1 Z 2 which are possible as mirrors SP, preferably a pseudoreliable message PSM which instructs them to become mirrors SP.
- the cell C 2 Z 6 working as the mirror manager returns a corresponding response AK to the requesting client CL.
- An add request AddRQ is not completed successfully if no response AK or a negative response AK is returned from the cell C 2 Z 6 working as the mirror manager.
- an add request AddRQ does not guarantee that nm mirrors SP are available for a desired field F, but that either nm mirrors SP are available or after the elapse of a predetermined time t no mirrors SP at all are available for the desired field F.
- a mirror request SpiegelRQ (MirrorRQ) is a special case of an add request AddRQ, wherein a cell Z which will be referred to a manager in the following requests a single mirror SP. The manager sends the request to the cells Z which are possible as mirrors SP to become new mirrors SP.
- a waiting time WT is recorded from this moment on until responses AK of the cells Z possible as mirrors SP arrive in the manager.
- Each cluster C which receives the mirror request SpiegelRQ and can provide storage space sends a corresponding response AK to the manager and provides storage space which is kept free to be integrated into the cluster compound CV in the form of a cell Z or a mirror SP, respectively. If a cluster C cannot provide a mirror SP, it relays the mirror request SpiegelRQ to other clusters C. When the manager has received a corresponding response AK of a new mirror SP it will enter this in a mirror table. If a cell Z which is possible as a mirror SP received a message MSG from the manager prior to the elapse of the time interval wt that no more mirrors SP are required, it is released again and the mirror request SpiegelRQ is rejected.
- a timeout occurs in one of the requested cells Z, i.e. the time interval wt of the mirror request SpiegelRQ for this cell Z has elapsed, then a new cell Z which is possible as a mirror is found. This operation is repeated several times or until cells Z possible as mirrors have responded. Cells Z which have made themselves available as possible mirrors SP and whose responses AK arrive at the manager after the assigned time interval wt will be ignored by same.
- the still not used mirror SP receives the mirror request SpiegelRQ to become a mirror which it processes with the following pseudocode:
- rq_singlebecomeMirror begin if ⁇ request from same mirrorl> and ⁇ ticket in agreement> then begin ⁇ return acknowledgement> exit; end; if used then exit; ⁇ return acknowledgement> ⁇ notice MirrorManager and ticket> ⁇ Send rq_addMirror to all old mirrors> exit; end;
- this mirror candidate sends a request to all nm ⁇ 1 old mirrors SP to be accepted as a mirror (rq_addMirror). Because the old mirrors SP must certify this mutually the cell might have to wait longer than normal for a response to the message. A mirror SP which has received this request enquires all other nm ⁇ 2 mirrors SP whether these have received this request, too (rq_certify). Only if this is the case, the mirror SP replies with a corresponding response ak_addmirror and updates its own mirror table:
- rq_addMirror begin ⁇ set flags, if req'd to accept messages > if ⁇ request is from mirror l> then begin ⁇ update message with data corr. to LifeCount> ⁇ send acknowledgement ak_akkMirror> exit; end; if ⁇ message is from mirror candidate (anew)> then exit; if ⁇ Status is not correct> then exit; if not ⁇ mirror to be replaced is known> then exit; ⁇ further plausibility checks, if req'd.> ⁇ Send request to all nm ⁇ 2 mirrors whether message received, too> end;
- a client CL or a cluster C sends a delete request DeleteRQ to all nm mirrors SP associated with the field F.
- a delete request DeleteRQ ensures that either all nm mirrors SP are removed or, in the case of a not successful execution of the delete request DeleteRQ, that no mirror SP is removed in order to ensure consistent data in the cluster compound CV.
- each mirror SP which receives a delete request DeleteRQ relays it to the other nm ⁇ 1 mirrors SP.
- a delete request DeleteRQ is executed successfully if the sender receives nm responses AK according to the which nm mirrors SP of the field F have deleted themselves. If the sender does not receive a response AK after the elapse of a predetermined time interval, according to which the nm mirrors SP of the field F have deleted themselves, the delete request DeleteRQ has failed.
- Shift operations are used for assigning individual mirrors SP of a mirror compound to other cells Z which then replace the previous mirrors SP accordingly. There are various reasons which necessitate shift operations:
- a cluster C is to be removed from the cluster compound CV, for example, when a cluster C is to be shut down or to be used for other tasks in the network N, the data of its active cells Z, i.e. of the cells Z which operate as mirrors SP, must be shifted to other clusters C.
- the cluster C to be removed initiates the shifting of the data or of the mirrors SP, respectively, of the individual mirror compounds (as described above).
- the data transmission performance of the clusters C and/or the cells Z is checked during operation.
- the preferred embodiment of the present invention uses a counter for each mirror SP and/or each cell Z which determines the transmission duration with pseudoreliable messages PSM.
- a timer is implemented which determines the average data transmission duration, with a common time basis being required in this case.
- each cluster C determines the data transmission performances of its cells Z.
- Mirrors SP or cells Z, respectively, whose data transmission durations exceed certain limits are shifted.
- the evaluation of the data transmission performance with respect to the data transmission duration is to be understood as an example only, and any desired parameter of data transmission performances which is suitable for the application of the invention can be checked for an initiation of shift operations by means of known methods.
- the computing performance of individual cells Z and/or clusters C, or the performance of individual areas of the network N could be checked.
- a single mirror SP from the corresponding compound becomes the manager, e.g. cell C 1 Z 4 .
- the manager C 1 Z 4 sends a request RQ, preferably with a pseudoreliable message PSM, to all other two cells C 3 Z 6 and C 6 Z 2 of the compound operating as mirrors SP to remove the corresponding mirror SP (C 6 Z 2 ). This makes itself invalid or is declared invalid by the corresponding cluster C 6 .
- the manager C 1 Z 4 requests a new mirror SP in the cluster compound CV, whereby contrary to the above described replacement for a mirror SP additional requirements can be placed on the new mirror SP, preferably requirements with respect to the data transmission performance.
- the new mirror SP is integrated into the mirror compound in the above described manner.
- the manager sends a request RQ (preferably with a pseudoreliable message PSM) for cancelling the shift operation if it has not received a corresponding response AK from all nm ⁇ 1 mirrors SP. In this case, the shift operation could not be completed successfully.
- RQ preferably with a pseudoreliable message PSM
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Computer And Data Communications (AREA)
- Multi Processors (AREA)
- Communication Control (AREA)
- Mobile Radio Communication Systems (AREA)
- Information Transfer Between Computers (AREA)
- Hardware Redundancy (AREA)
Abstract
The present invention permits improved data access and improved data management in a computer system. Data are divided into individual partial data (F) and stored in cells (Z) of storage devices (C) such that the partial data (F) being accessed and managed are present in the computer system in a redundant manner. Computer units (CL) are able to access the redundantly stored data. The fact that they are stored in the storage device (C) ensures that the computer units (CL) accessing said data are supplied more rapidly. This is achieved in particular owing to the fact that the redundantly stored data are accessed in accordance with parameters of data transmissions between the computer units (CL) and the data storage devices (C) and that, in accordance with said data transmission parameters, the redundantly stored data are moved to and from the data storage devices (C) by corresponding copy and delete operations.
Description
- This application claims priority to our previously-filed German patent application number 199 00 636.9, filed on Jan. 11, 1999 and entitled “DATA ACCESS AND MANAGEMENT SYSTEM AS WELL AS A METHOD FOR DATA ACCESS AND DATA MANAGEMENT FOR A COMPUTER SYSTEM”.
- 1. Field of the Invention
- The invention generally relates to a data access and management system as well as to a method for data access and data management for a computer system. In particular, the present invention relates to a system and a method for optimising the access to data and their processing in distributed and networked computer structures.
- 2. Description of the Prior Art
- The ever increasing use of distributed and networked computer structures and arrangements has the consequence that data and functionalities for data management purposes are no longer provided or utilised, respectively, by consistent computer systems, but by various distributes computer systems which are internetworked. In conventional distributed and networked computer structures and arrangements data and functionalities are generally provided by a central computer system, a so-called server, or an accumulation of central computer systems, so-called server clusters. Other computer systems, so-called clients, such as for example, personal computers are connected e.g. via networks or busses with the central computer system in order to access data and functionalities. In this context, various problems occur which limit the supply of clients with data and/or functionalities, in particular, if the access to a central computer system is done by several clients in a short period of time or even simultaneously. An example for this is computer games, which are supplied to several players via the Internet.
- Due to the fact that only one central computer system (server) is used, its failure results in that the clients can no longer access provided data and functionalities. The failure of network areas, too, which connect the server with the clients, also leads to a total failure of the entire computer structure.
- Moreover, the transmission times from the server to individual clients differ greatly in part because the connection quality to the clients varies e.g. due to various distances between the server and the clients as well as different transmission performances in various areas of the network. In particular, with interactive operations of several clients in connection with the server, such an inadequate transmission characteristic often leads to an unsatisfactory supply of individual clients with data/functionalities. In this context, the so-called “lags” must be mentioned which affect the communication between the server and the clients.
- It is an object of the present invention to eliminate the above mentioned problems of the known state of the art. In particular, it is an object of the invention to optimise the transmission quality between clients and means of a networked distributed computer structure which provide data in such a manner that each client is provided with the respectively requested data in a desired application-specific manner. Preferably, the invention is to enable an as rapid as possible supply with data/functionalities, whereby it is additionally to be ensured that the transmissions are effected as fault-tolerantly as possible.
- In addition, the present invention secures the operability of a distributed networked computer system in the case of the failure of data providing means of the computer structure. The invention is also to secure the operability of a distributed networked computer system in the case of the failure of individual areas of the networks via which the data providing means and clients are connected with each other.
- Furthermore, the invention is to enable that clients are only provided with current data. The invention also intends to reduce the required transmission capacities of a networked distributed computer system.
- In the inventive system according to the present invention, the data provided in a computer system is stored in a redundant manner in the data storage means, depending on prespecified parameters of the data transmission between data storage means and computer units, and the computer units access one of the data storage means as a function of the determined prespecified parameters. In this manner it is made possible to optimise data transmissions between the data storage means and the computer units in the desired application-specific manner in order to be carried out more rapidly and in a manner involving fewer faults.
- In addition, the data storage means comprise control unit for controlling the data access and the data management in order to work independent of other means of the computer system. This reduces the quantity of the data to be transmitted in the inventive system and increases the fault tolerance of the inventive system because the data are not processed centrally.
- For achieving an additional optimisation it is to be preferred that the data storage means copy redundantly stored data in the system among each other as a function of the determined parameters of data transmissions between the individual data storage means and the computer unit and delete the data in the data storage means in which it had been stored beforehand. Data can thus be shifted in the inventive system from one data storage means to other data storage means, whose parameters of the data transmission enable a higher degree of optimisation of the data access and the data management for the respective application case of the invention.
- Moreover, it is to be preferred that the data storage means process the stored data independently from the computer unit. In this manner data can be processed in a decentralised way whereby increased data integrity and an increased fault tolerance as well as a relief of individual system components is achieved. In another embodiment the data in the system is divided into data subsets, and the data storage means are divided into cells in such a manner that each of the data subsets to be stored in a redundant manner is stored in one of the cells each of the corresponding data storage means in order to only store that data in a redundant manner which is currently required.
- In addition, it is advantageous that the data storage means are divided into cells depending on data transmission parameters in order to further optimise the data transmissions within the inventive system.
- In order to carry out the data access and the data management in a more efficient manner each cell may comprise additional data which relates to parameters to data transmissions between the individual data storage means and the computer unit, and/or neighbouring cells, and/or cells which comprise data which is stored in the system in a redundant manner.
- In addition, it is possible to use cells which can interchange additional data which is used for the data access and the data management. Thus, the information for data access the data management to be transmitted in the inventive system is reduced further.
- The cells in special data storage means can be designed in such a manner that the parameters of data transmission between the individual data storage means and the computer unit are identical for the cells of a data storage means in order to achieve a consistent data access for the individual data storage means.
- It is also possible to use computer units which output data for storage in the data storage means and/or process data stored in the data storage means in order to relieve the data storage means.
- For processing the data independent of the inventive system, the computer units can also be connected with one or several users in order to transmit the data from the data storage means and/or to be controlled by the user. Such a user is preferably a personal computer, and/or a central processing unit of a computer and/or another data storage means.
- In this manner, the computer unit can also be a system which provides Internet services such as e.g. data base access operation and computer games. The computer unit can also be suited to immediately access individual cells of the data storage means, which relieves the individual data storage means of data access and data management tasks.
- In particular, the prespecified parameters of data transmissions between the individual data storage means and the computer unit can comprise the duration of the transmission, and/or the fault rate, and/or the duration of data processing operations of the individual data storage means prior to the transmission of the data. In this manner, data can be accessed more rapidly and data is provided which is less faulty.
- The individual components of the inventive system according to an embodiment of the present invention are connected with each other via data transmission means, which can comprise electrically conductive connections, and/or bus systems, and/or computer networks, and/or wired or wireless (mobile) telephone networks, and/or the Internet. The present invention is thus suited for each computer structure and arrangement as well as for each computer system which utilises distributed and networked means.
- When using the present invention, it is therefore possible to build a database system or a computer structure for data access and data management with an inventive database system or an inventive computer structure being able to be built from components which are arranged locally in a neighbouring relation.
- Moreover, the present invention can be used in a system for a computer game which is provided via the Internet. In this case, it is to be preferred that at least one computer unit is an Internet service provider in order to integrate the present invention into existing computer structures of the Internet and in order to enable Internet users an inventive access to the data.
- In particular, the invention is suited for interactive computer games for use by at least two users in order to ensure an optimised supply of the individual user with data required for the computer game, whereby each user can be connected with one computer unit.
- Preferably, data for executing the computer game is transmitted from the computer units to the users so that the computer game can also be carried out—at least partially—independent of the computer units. Another relief of the computer units and the data storage means can be obtained if the users process the received data for executing the computer game and transmit it back to the corresponding computer units.
- Moreover, the inventive system for a computer game can comprise additional means for the detection of prespecified parameters of the data transmission between the computer units and the respectively connected users in order to additionally optimise the data access and the data management. Preferably, these prespecified parameters comprise the duration of the transmission, and/or the fault rate, and/or the duration of data processing operations of the individual computer units and/or the individual users prior to the transmission of the data.
- It is thus possible to store the data for executing the computer game in a redundant manner also as a function of the determined prespecified parameters of the data transmission between the computer units and the users which are connected therewith.
- Furthermore, the computer units can receive control data for executing the computer game from the respective users in order to enable improved interactions of the individual users.
- This control data or equivalent data can then be output by the computer units to the data storage means. In this manner it becomes possible that the computer units process data for executing the computer game, depending on the control data, and/or the data storage means process data for executing the computer game, depending on the control data or on data equivalent to the control data, whereby a more efficient data access and a more efficient data management is achieved.
- Similarly, with a method of the present invention, data is stored in a redundant manner in at least two of at least two data storage means depending on determined parameters of the data transmission between the data storage means and computer units, with the access to the stored data by the computer units being effected as a function of the determined parameters of the data transmission.
- The data access and the data management are preferably controlled by the data storage means.
- In an embodiment of the inventive method the redundantly stored data are copied among each other by the data storage means as a function of the determined parameters of data transmissions between the individual data storage means and the computer unit and deleted in the data storage means in which the copied data has been stored beforehand.
- In addition, it is possible to process the stored data by the data storage means independent of the computer unit in order to relieve individual means and to achieve a higher reliability of the inventive method.
- In order to achieve an application-specific and thus optimised storage of the data can be divided into data subsets, with the data subsets to be stored in a redundant manner being stored in cells of the individual data storage means. Preferably, the division into data subsets and the storage in cells is carried out as a function of the data transmission parameters.
- A further optimisation can be obtained if additional data for data access and data management is stored in the cells, which relate to the parameters of data transmissions between the individual data storage means and the computer unit, and/or neighbouring cells, and/or cells which comprise the data redundantly stored in the system.
- Moreover, additional data for data access and data management can be exchanged between the cells of the data storage means. Preferably, the access to data of cells of a data storage means has identical data transmission parameters in order to ensure a consistent data access for the individual data storage means.
- For the relief of the entire system it is also possible that the computer unit outputs data for storage in the data storage means and/or the data stored in the data storage means is processed by the computer unit.
- The data is preferably transmitted by the computer unit to a user and/or the computer unit is controlled by the user in order to process data independent of the execution of the inventive method and to additionally control the sequence of the inventive method. The inventive method is thus capable of providing Internet services.
- In order to achieve a more efficient data access and a more efficient data management, the access can also be made directly to the data of individual cells of the data storage means.
- Further it is to be preferred that the determination of the prespecified parameters of data transmissions between the individual data storage means and the computer unit comprises the determination of the duration of the transmission, and/or the fault rate, and/or the duration of data processing operations of the individual data storage means prior to the transmission of the data in order to access data more rapidly and/or reliably.
- In this manner it is possible to provide a method for a database system or a computer structure as well as a method for an Internet computer game wherein in the latter case the access to data in the data storage means preferably comprises the employment of an Internet service provider.
- Moreover, the method can enable at least two users to access the computer game, with the computer game being an interactive computer game.
- The data for executing the computer game from the computer units can be transmitted to the respective users. Preferably, the data received by the users are processed by the users and transmitted back to the corresponding computer units in order to relieve the computer units and the data storage means and to optimise the execution of the computer game.
- In another embodiment, prespecified parameters of the data transmission between the computer units and the respective users connected therewith are determined in addition, in order to carry out the data access and the data management with the inventive method also under consideration of these parameters.
- It is further to be preferred, that the determination of the prespecified parameters of data transmissions between the computer units and the users which are connected therewith comprises the determination of the duration of the transmission, and/or the fault rate, and/or the duration of data processing operations of the individual computer units and/or the individual users prior to the transmission of the data.
- In this manner the redundant storage of the data for the execution of the computer game can also be carried out as a function of the determined prespecified parameters of the data transmission between the computer units and the respective users connected therewith.
- A more efficient execution of interactive operations of the computer game can be achieved if control data for the execution of the computer game is additionally transmitted by the users to the corresponding computer units. Preferably, the control data or equivalent data from the computer units is also transmitted to the data storage means.
- Finally, it is possible to process the data for executing the computer game as a function of the control data from the computer units and/or to process the data for executing the computer game as a function of the control data or the data equivalent to the control data from the data storage means. In this manner, the individual users are relieved and the redundantly stored data is processed by the data storage means which ensure a desired data transmission.
- By an inventive replacement of individual failed cells it is possible to compensate for connection errors and in the case of a failure of individual areas of a distributed networked computer structure to utilise areas witch retain the functionality of the entire computer structure, in the data is present in the computer system in a redundant manner. Due to the fact that the invention allows for monitoring the used data, the consistency of the available data is also ensured in this manner.
- Furthermore, the use of the present invention automatically optimises the connection quality between clients and data providing means of a computer structure so that poor transmission qualities (e.g. low transmission rate, lags, . . . ) are automatically compensated.
- For this purpose, individual area of a distributed networked computer system, e.g. individual memory areas, are scaled without interruption of the operation. This means that such individual area of the inventive system can be added or removed at any time.
- The present invention also enables to replace individual failed areas of a distributed networked computer system by other areas without interruption of the operation. This is possible because the invention does not require a central connection between individual areas of the computer system, which prevents limitations of the functionality of the inventive system due to failures (e.g. technical defects). In addition, the invention ensures a higher data integrity because the data is not stored centrally.
- It is also possible to reduce the quantity of the data to be managed by individual areas of a networked distributed computer system in this manner. The consequence of this is that the required transmission capacities between individual areas of the inventive system can be reduced, too.
- Moreover, further components can be added to the inventive system without having to modify its principal structure.
- The inventive approach did in fact originate in particular in the solution of the above mentioned problems in the realisation of (interactive) computer games for the Internet. However, it must explicitly be emphasised that the present invention is not limited to such applications, but can be employed for any computer system and any computer structure utilising distributed networked means which provide data.
-
FIG. 1 is a schematic representation of a preferred embodiment of a computer structure according to the present invention; -
FIG. 2 shows a schematic representation of a data structure as well as its division and assignment to cells according to the present invention; -
FIG. 3 is a schematic representation of another preferred embodiment of a computer structure according to the present invention; and -
FIG. 4 is a schematic representation of a section of the preferred embodiment ofFIG. 1 for the explanation of operations, which are used for executing the invention. - The terms used in the following text will now be explained with reference to
FIGS. 1 and 2 . - The entire data quantity GD which is used in the context of the invention is divided into individual data subsets which are referred to as field F.
- The position of each field F in the entire data quantity GD is described by a unique field position or identification FeldIF (fieldID), with the entire data quantity GD being capable of being divided one or multi-dimensionally. If, for example, the entire data quantity GD is divided three-dimensionally, each field position FeldID can be described by x, y, z.
- A cell Z is the smallest unit for data storage which stores exactly one field F. A cell Z also contains other information which will be covered in detail later.
- A cluster C comprises one cell Z or is an accumulation of several cells Z. A cluster C can, for example, be formed by an individual computer or an integrated circuit which manages individual or several cells Z. Moreover, a cluster C an operate as a higher-level control unit for the cells Z contained in it.
- All clusters C which are combined for the representation of the entire data stock GD form a cluster pool or a cluster compound CV. The individual clusters C are connected via a network N, with each cluster C having a unique address. A cluster compound CV can thus be formed by networking individual computers forming clusters and/or by connecting individual integrated circuits forming clusters.
- Within the cluster compound each cluster is identified by a unique identification ClusterID which can be a single number or a triple. Individual clusters in the compound contain a table of the neighbours (neighbour table) in order to be able to relay certain messages to certain clusters. In this context, a neighbour is another cluster with a next higher or lower identification ClusterID. The number of cells Z which belong to a cluster can vary between 0 and an upper limit maxcc, where maxcc can be different for each cluster C in the cluster compound CV. The number of cells Z which are actually included in a cluster C is indicated as ncc. In addition, each cell Z has a unique identification ZellID (cellID) within a cluster C.
- Moreover, cells Z of a cluster C can exchange information among each other without sending messages via the network N, which enables a reliable message transmission within a cluster C. In addition, it is to be preferred that all cells Z of a cluster C are provided with the same connection quality, i.e. though the connection to the connection to network N can be different between the individual clusters C, it is the same for all cells Z of a cluster C.
- As described, a cluster C comprises between 0 and maxcc cells Z. Each memory location of a cluster C which can store a cell Z is referred to as slot S. A slot S can be full, i.e. it stores the data of a cell Z, or empty, i.e. it represents no cell Z. Therefore, the clusters C from
FIG. 2 comprise only one full slot S. each. The identification SlotID of each slot S corresponds to the identification ZellID which a cell Z would be assigned in this memory location. - A client CL (e.g. Internet provider, personal computer, network computer, and the like) is a unit communicating via the network N which requests data, processes data and/or orders to store the modified data. In the present invention, no assumption whatsoever concerning the actual realisation of the network N is made. As network N any means which transmit data can be employed, such as e.g. proprietary busses, local networks, or the Internet. The invention does also not assume that the network N ensures the transmission of all data, so that acknowledgements concerning a data transmission tot he respective sender are not required, and that the network N transmits data according to its sending time.
- As will be presented in the following and is shown in
FIG. 2 , the invention is based, among other things, on a distribution of the entire data GD or the fields F, respectively, to several cells Z of identical contents, i.e. a single field F is stored in several cells Z in a redundant manner. The Number of cells Z which store and manage a certain field F is specified as nm and is the same throughout the entire cluster compound CV, with each of the nm cells Z being referred to as mirror SP for the field F which is stored in the nm cells Z. In the following explanation of the invention nm=3 is assigned, with this value serving only for illustrating the invention and to be specifically selected for each application case. - A response AK is the response to a request RQ. The contents and function of the individual requests RQ and responses AK depends on the transmitted data.
- A message MSG is a data quantity which is exchanged between cells Z, clusters C and clients CL. It is the task of the network N to transmit the messages MSG. Due to the fact that the sender of a message MSG does not receive an acknowledgement of a successful transmission, messages MSG can get lost. It is also possible that two messages MSG arrive at a destination after different times. Now the principal procedure with the present invention and individual actions or operations, respectively, for carrying out the invention will be described.
- The entire data quantity is divided into the individual fields F. Such a division can, or example, be effected two-dimensionally or three-dimensionally. For example, a chessboard could be divided into 8*8 fields F, with each field F containing the information on the respective chessboard square, e.g. which chess piece is located there. Analogously, a three-dimensional space, too, can be represented by fields F. It is also possible, however, to divide an image into individual image areas or a text into individual words or character(s) (strings) which are assigned to individual fields F. The contents of the fields F is application-specific and is not relevant in the present invention. The individual fields F are then stored in nm cells Z, with each cell Z storing a corresponding field F, i.e. the actual data, as well as further information which preferably relates to references to neighbouring fields F. This information permits a data reduction because in this manner, “empty” fields F need not be stored and not each field F must be assigned a cell Z.
- Several cells Z are then combined to a cluster C, and all clusters C in turn are combined to a cluster compound CV. An essential characteristic of the invention is that each cell in the cluster compound CV is available in a redundant manner, i.e. nm times in nm clusters C. Thus, each field F is nm times stored in these cells Z, and each of these cells Z is referred to as mirror SP with respect to the field F stored therein. In addition, each cell Z contains information in which clusters C and/or in which cells Z of the corresponding clusters C the other nm−1 cells Z are located.
- In addition, each cell Z contains further information which preferably comprises indications on the data transmission quality in the cluster compound CV and with respect to the clients CL, e.g. transmission quality, transmission rate, and the like. This information is updated when the cells Z are accessed.
- In order to receive the contents of a field F, a client CL sends a request via the network N to all cells Z and/or clusters C, which include the desired field F, i.e. to all cells Z which are mirrors SP of the desired field F. It depends on the parameters of the data transmissions to the individual cells Z and/or clusters C as well as back to the clients CL, from which cell Z of which cluster C the requesting client CL will receive a response. Preferably, the requesting client CL receives a response from the cell Z and/or the cluster C, which realise the fastest data transmission at the respective time and/or which are capable of carrying out a processing of the data more rapidly prior to its sending to the requesting client CL.
- All cells Z and/or clusters C and/or clients CL periodically check their applicable parameters for data transmissions. In periodic intervals or subsequently to specified actions, all cells Z and/or clusters C and/or clients CL check the parameters for data transmissions, which are applicable to the used cells Z. If the checked parameters do not meet specified limits, or if other cells Z and/or clusters C comprise better data transmission parameters, the checking cells Z will try to shift its data to these other cells Z and/or clusters C in order to improve the data transmission parameters applicable for this data. In this manner, the inventive cluster compound CV optimises itself automatically during operation with respect to data transmissions.
- Certain requests of a client CL, such as e.g. a write request WriteRQ as described below are synchronised between all mirrors SP of the respective field F. In this manner, failed mirrors SP are identified. In addition, extra checks are carried out at periodic intervals and/or by clients CL after the receipt of responses AK. This, too, identifies failed mirrors SP and/or mirrors which are no longer relevant. These mirrors SP are either replaced by other mirrors SP, or a cell Z or a cluster C or a client CL substitutionally generates new mirrors SP, or the present defects are remedied by means of methods described below. In this manner, the cluster compound CV is fault tolerant against the failure of individual cells Z and/or whole clusters C.
- In addition, requesting clients CL can assign individual cells Z and/or clusters C special processing functions which are executed independent of the mode of operation of the clients CL. A client CL, for example, can instruct a cell Z or a cluster C to change the data of a field F in certain intervals. This characteristic is of particular importance if the present invention is employed in connection with computer games which are executed under real-time conditions via a network, e.g. the Internet, in order to reduce the data quantities to be transmitted and to optimise the interactive operations in the execution of a computer game.
- Data between the individual clients CL, clusters C, and cells Z are transmitted by using a certain protocol. This means that in addition to the transmitted data, further prespecified data are sent and received by the individual clients CL, clusters C, and cells Z in order to initiate desired operations or to react in a desired manner as described below. All clients CL, clusters C, and cells Z carry out the necessary operations in order to achieve the desired functionality of the corresponding cluster compound CV. If the invention is employed as shown in
FIG. 1 for providing computer games via the Internet, then the network N is the Internet and the client CL is the computer system which operates as Internet provider. The individual clusters C comprise memory units of the client CL and storage means of other computer systems which are distributed over the computer system. Due to the fact that generally only one connection exists between a client CL (Internet service provider) and a corresponding user B, usually via a telephone line, the user B and the client CL (Internet provider) form a system to be regarded as consistent at that time. For this reason, the user B fromFIG. 1 is not shown inFIG. 4 . An inventive optimisation of the data transmission to the users B were possible only if the user B had a simultaneous access to different Internet providers. With the current state of the art, the present invention permits an optimisation of the data management and transmission for clients CL operating as Internet providers if these access e.g. the data required for an interactive computer game, with several players via the Internet in accessing other computer systems operating as clusters. As shown inFIG. 3 , the invention can also be employed in a consistent computer structure such as in a personal computer PC. In this case, the central processing unit CPU operates as client and the various data managing means MEM1, MEM2, MEM3 operate as clusters. The data managing means MEM1, MEM2, MEM3 can be conventional storage means, e.g. non-volatile memories or random access memories, but also special means which e.g. do not only store but also process data and which can therefore not provide the central processing unit CPU with data without restrictions and at any time. - A cell Z can assume five states, with each status being always possible because the cells Z are not fault tolerant and the network N does not ensure and check data transmissions.
- Active status (active): The contents of the cell Z are valid and the cell Z is ready for operation.
- Invalid status (invalid): The cell Z is ready for operation but its contents are no longer current and valid. This can occur, for example, if the cell Z has not carried out data operations because of a technical defect or because of not received information.
- Inactive status (inactive): The cell Z is not available, e.g. because data transmissions to it are permanently lost or because the cell Z has permanently failed.
- Blocked status (blocked): The cell Z processes only certain data transmissions, such as e.g. the write requests WriteRQ or read requests ReadRQ described below.
- Idle status (idle): The cell Z is ready for operation, but is currently not used in the cluster compound CV.
- A cell Z contains a certain field F, i.e. a field F with a certain field position FeldID (fieldID) and has a unique position ZellID (cellID) within the corresponding cluster C. The cluster c in turn is identified by a unique identification with the form ClusterID:ZellID. Each cluster C and each client CL is uniquely identified in the cluster compound CV by an identification ClusterID, ClientID, respectively. No particular requirement are placed on these identifications, they only have to provide for a unique identification of the cluster C and the clients CL.
- In the following, a number of algorithms will be described in more detail which are utilised by the functional operations described further below which serve for the execution of the invention. This explanation is supplemented by corresponding pseudocodes which are used in the currently preferred embodiment of the invention.
- In order to be able to assign messages MSG, i.e. data transmissions in a unique manner to individual operations, each message MSG is given a ticket number TNr which is generated upon sending. As long as the respective operation is not completed, all clients CL, cells Z, and clusters C involved can associate the message MSG with the corresponding operation by the ticket number TNr in a unique manner. For obtaining unique ticket numbers TNr, a ticket number TNr can, for example, be combined by the sending time of the message (or from a continuous counter generated in the cell) and the sender's identification. Due to the fact that the sender's identification is unique and the sending times of two messages MSG are different, each message MSG can be assigned the respective operation in a unique manner. Unique ticket numbers TNr, however, can be generated depending on the most different applications of the invention in other ways.
- Pseudocode for the generation of a ticket number TNr:
-
function makeNewTicket:longword; begin a:=laufender_zaehler; (continuous counter) inc(laufender_zaehler); (continuous counter) b:=own_adress; makeNewTicket:=<combination from a and b, e.g. by shifting> end; - If a cluster C receives a message MSG which is destined for another cluster C, i.e. the ClusterID of the destination address of the message MSG does not correspond to the address of the receiving cluster C, then the receiving cluster C relays the message MSG to the cluster C for which the message MSG is intended. The way in which the message MSG is relayed depends on the actual realisation of the network N, and/or the clusters C, and/or the clients CL, and/or the data transmission protocol, and/or corresponding data included in the message MSG. A message MSG is also relayed if a cell Z receives the message MSG which is intended for another cell Z.
- Each cell Z contains information on neighbouring cells Z and, on the basis of this information, checks whether a desired cell Z is located within the current cluster C. If this is not the case, preferably the cell Z is selected from all neighbouring cells Z of the current cluster C which is the most neighbouring cell with respect to the cell Z. If several cells Z meet this requirement, a cell Z can be selected at random.
- Optionally, with each relay of a message MSG a step counter may be incremented by one step. With each step, the respective cluster C sends a holding response HalteAK (holdingAK) to the sender of the message MSG in order to inform same that his request RQ is still being processed. If the sender does not receive such a holding response HalteAK in this case, then the sender can assume that is message MSG has been lost. The sender can then direct its message MSG e.g. to the last cluster C which has sent the last received holding response HalteAK.
- There is no reliable method for transmitting messages MSG and for ensuring that the messages MSG have been received because the network N need not guarantee data transmissions so that messages MSG (e.g. requests RQ and responses AK) can get lost any time.
- In order to ensure a higher degree of reliability of the transmission of certain data, a pseudoreliable message PSM can be used. In this case, the pseudoreliable message PSM is sent repeatedly until a loss of the message is improbable. Only then it is assumed that the transmission has failed.
- If one assumes a probability of 1/n with which any message MSG can get lost, then a pseudoreliable message PSM must be sent x times so that the probability p=(2/n)̂x with which the message has been lost is sufficiently small. With a missing response AK it can then be assumed that the recipient has failed.
- Pseudocode for sending a pseudoreliable message PSM:
-
procedure psm_send(message:TCellMsg; d1,d2,d3:Tadr; next_status:TCellStatus); var i:byte; begin // the psm_ variables are temporary variables of the // respective cell psm_timeout:=false; psm_next_status:=next_status; psm_ticket:=message.ticket; psm_num:=num; psm_dest[1]:=d1; psm_dest[2]:=d2; psm_dest[3]:=d3; for <all present i> do begin psm_received[i]:=false; psm_sendtime[i]:=curr_time; psm_nrSended[i]:=0; end; <complete further fields of the message, if applicable> psm_m:=message; message.dest:=d1; send(message); message.dest:=d2; send(message); message.dest:=d3; send(message); status:=cs_psm_waiting; end; - In order to check whether a cell is waiting for the acknowledgement of a pseudoreliable message PSM, the following pseudocode is used:
-
<process if cell waits for PSM input> begin if (status=cs_psm_waiting) and (message is Aknowledge) then begin if message.ticket<>psm_ticket then exit; sender:=psm_destination(message); // check if ak_hold if (sender<>0) and (message.command=ak_hold) then begin <extend waiting time> exit; end; if sender<>0 then begin // note message in psm_MsgIn[sender] psm_msgIn[sender]:=message; psm_received[sender]:=true; exit; end; //status=cs_psm_waiting end; - The corresponding cell Z must check whether all responses AK have been received when it executes its update procedure. The corresponding status (cs_psm_waiting) must be processed there. It must then be decided whether all responses AK have been received and, if not, if waiting is to be continued:
-
procedure update; ... case status of: <processing of other status values> cs_psm_waiting: begin if <response to all RQs received> begin status:=psm_next_status; exit; end; <check here for timeout, and if required, resend one or several PSM requests> // check for timeout of all cells if <waiting time for addressees elapsed> then begin status:=psm_next_status; psm_timeout:=true; end; end; ... end; - The self check is the central operation in order to ensure the consistency of all mirrors SP of a compound for a field F. A self check is initiated by a requesting third party, e.g. a client CL or a cluster C. A mirror SP which carries out a self check causes that the other mirrors SP of the compound also carry out a self check. A self check by a mirror SP can result in a fault correction by this mirror or another mirror SP. Depending on how unreliable the network actually is (loss of messages, lags), it may be impractical to make the PMS virtually reliable. The individual operations (such as adding a new mirror, etc.) should be fault tolerated to a certain degree. The case that a message, though classified as not delivered, is delivered nevertheless is very improbable with PMS but not impossible. Therefore corresponding fault corrections must be provided.
- If a mirrors SP receives a self check request SelbsttestRQ (self checkRQ), it begins a self check under the same ticket number TNr, provided it is not just carrying out a self check which has been initialised by another self check request SelbsttestRQ and if the ticket number TNr of the currently received self check request SelbsttestRQ differs from the last received check request SelbsttestRQ.
- If a requesting third part sends a read request LeseRQ (readRQ) described below, the execution of a self check is necessary only if the requesting third party receives inconsistent responses AK from the corresponding mirrors SP of a field F which the requesting third party intends to read.
- The requesting third party compares the responses AK received from the mirrors SP and—under the assumption of the above described three mirrors SP for one field F—with three responses AK accepts the result. With two response AK it initiates a self check and accepts the result. With only one response AK it initiates a self check and rejects the result.
- If a self check request SelbsttestRQ has been received or a self check has been initiated by other system-related default, e.g. timeout, the corresponding mirror SP must check its own validity and is either responsible for the fault correction itself or instructs another mirror SP to perform the fault correction. In the selection of a mirror SP for the fault correction it is to be attempted that always only one mirror SP carries out the fault correction, even if several mirrors SP perform a self check quasi simultaneously, in order to avoid inconsistent conditions.
- In this context, the mirror SP sends a validation request ValidierRQ (validationRQ) to all other mirrors SP. The exchange of the corresponding data is done by using pseudoreliable messages PSM. If no response AK is received, the destination is declared unavailable. The failed mirror SP is then replaced by a new one.
- Pseudocode for carrying out a self check SelbsttestRQ:
- A mirror starts a self check if it receives a corresponding message:
-
rq_start_selfCheck: begin if not used then exit; if (status<>cs_idle) then begin return_msg(m,ak_busy); exit; end; start_selfcheck; exit; end; - Alternatively or supplementary the self check can also be carried out automatically at certain intervals. For this purpose, the checking mirror SP sends a corresponding request to all other mirrors SP:
-
procedure start_selfCheck; var m:TCellMsg; begin <Optional: last_intervall_selfcheck:=current_time> m.cmd:=rq_validate; m.lifecount:=lifeCount; m.data:=data; m.ticket:=makeNewTicket; psm_send(m,mirror[1..nm−1],cs_selfCheck_check); end; - Each cell Z must be capable of responding to validation requests:
-
rq_validate: begin if not used then begin if <cell just becomes mirror> and <request from future mirror> then return_msg(m,ak_valid); exit; end; return_msg(m,ak_noMirror); exit; end; if message_is_from_mirror(m) then begin <enter own mirrors in message> if message.lifeCount=lifeCount then return_msg(m,ak_valid) else if m.lifeCount>lifeCount then begin lifeCount:=m.lifeCount; <take data from message> return_msg(m,ak_valid); end else return_msg(m,ak_invalidLC); end else return_msg(m,ak_noMirror); exit; end; - After the checking cell Z has either received all responses AK or the time has elapsed, it reviews the result of the self check:
-
procedure do_final_selfCheck; var i:integer; m:tcellmsg; s:string; begin sc_res:=′ ′; for i:=1 to nm−1 do begin if (not psm_received[i]) then begin sc_res[i]:=′ ′; psm_msgIn[i].cmd:=rq_none; end else begin case psm_msgIn[i].cmd of ak_valid: sc_res[i]:=′V′; ak_invalidLC: sc_res[i]:=′D′; ak_noMirror: sc_res[i]:=′I′; end; end; end; // review result now: if sc_res=′VV' then begin status:=cs_idle; <further initialisations after completed self check> exit; end; if (sc_res=′VD′) or (sc_res=′DV′) then begin <take over data from D sender> status:=cs_idle; < further initialisations after completed self check > exit; end; if (sc_res=′DD′) then begin <take over data from D sender > status:=cs_idle; exit; end; if (sc_res=′VI′) or (sc_res=′IV′) or (sc_res=′DI′) or (sc_res=′ID′) or (sc_res=′V ′) or (sc_res=′ V′) or (sc_res=′D ′) or (sc_res=′ D′) then begin <further checks, if required> if (sc_res[1]=′D′) or (sc_res[2]=′D′) then <take over data from D sender > <Set: no response=‘D‘> if <this mirror is responsible> then <find a new mirror> else <send order to find a new mirror to responsible mirror> exit; end; if (sc_res=′II′) then begin <initialise cell> used:=false; exit; end; if (sc_res=′I ′) or (sc_res=′ I′) then begin status:=cs_idle; exit; end; if (sc_res=′ ′) then begin <optional: find nm−1 new mirrors> status:=cs_idle; exit; end; end; - Assuming a mirror compound of three mirrors SP, the following cases can be distinguished for the receipt of no, one, or two responses AK at the mirror SP which sends the validation requests ValidierRQ (validateRQ) to the two other mirrors SP of the compound, which are listed in the table below, with the incoming responses AK being classified as follows:
- “V” (valid): The sending mirror SP accepts the receiving cell Z as mirror SP, and the life counters of the sender and the recipient have the same value.
- “D” (delayed): The sending mirror SP accepts the receiving cell Z as mirror SP, but the life counter of the sender has a lower value than the life counter of the recipient.
- “I” (invalid): The sending mirror SP does not accept the receiving cell Z as mirror SP.
-
Incoming responses ase AK Status of mirror compound 1) V V Both receiving mirrors SP are valid: The mirrors of the compound have consistent and current data so that no further operations become necessary. 2) V D The requested mirror SP sending a “V” is valid and the requested mirror SP sending a “D” has a higher life counter value. The requesting mirrors SP must take over the data of the requested mirror SP sending a “D”. 3) D D Both receiving mirrors SP have life counters with higher values: The sending mirror SP is invalid and must take over the data of the mirror SP sending a “D”. 4) V I a) The requested mirror SP sending a “V” receives an “I” from the requested mirror SP sending an “I”: The requesting mirror SP and the requested mirror SP sending a “V” are valid, the requested mirror sending an “I” is invalid and is to be removed from the compound. The mirror SP with the lowest index must find a new mirror SP. b) The requested mirror SP sending a “V” receives a “V” from the requested mirror SP sending an “I”: The requested mirror SP sending an “I” is inconsistent and must be removed from the group (see detailed explanation in the following). The mirror SP with the lowest index must find a new mirror SP. 5) D I The requesting mirror SP takes over the data of the mirror SP sending a “D”. Otherwise the procedure corresponds to case (4). 6) I I The requesting mirror SP is in the minority and is declared invalid. 7) V- A requested mirror cannot transmit data: The mirrors SP of the two working mirrors SP with the lower index must find a new mirror SP. The failed mirror SP is treated like to mirror SP sending an “I” in cases (4) and (5). 8) D- One requested mirror cannot transmit data and the other requested mirror SP has a life counter with a higher value: The requesting mirror SP takes over the data from the working requested mirror SP, and the mirror SP with the lower index must find a new mirror SP. The failed mirror SP is treated like to mirror SP sending an “I” in cases (4) and (5). 9) I- One requested mirror SP is invalid and the other requested mirror SP has failed: The requesting mirror SP is in the minority, remains active, but does not find new mirrors SP. 10) — Both requested mirrors SP do not transmit data or the network connection of the requesting mirror has failed: Alternative 1: The requesting mirror SP remains active, but does not find new mirrors SP. Alternative 2: The requesting mirror ensures by additional checks that its connection functions properly and replaces the two mirrors. The two requested mirrors SP do not receive any information to this effect and will later exclude the requesting mirror SP. This case must be compensated by the operation DoubleFieldCheck described below. indicates data missing or illegible when filed - In those cases in which a new mirror SP is to be found, a new mirror SP is found by one of the remaining mirrors SP, with only one mirror being allowed to do this task. A mirror must be selected, e.g. the one with the lower index. The other mirror SP with the higher index does not execute any operations, but will receive messages MSG after some time which indicate the integration of a new mirror SP into the compound.
- If a mirror SP has physically failed, it is either possible that no requests RQ were made to the mirror compound in the meantime, i.e. that its failure has not been noticed and has not brought about any impacts, or that the two other mirrors SP have declared it invalid in the meantime and found a replacement mirror. If a restart operation is carried out, such a condition can be determined. For this purpose, the starting mirror SP carries out a self check as previously described.
- In the present invention the life counter is a counter which is incremented by integer values. In order to prevent an overflow of the life counter the life counter of all clients CL, cells Z, and clusters C is periodically adjusted, i.e. set to a lower common value.
- For this purpose, the adjustment is initiated from any mirror SP, e.g. from the mirror SP with the lowest life counter value. All mn mirrors SP of a field F wait for the receipt of all nm−1 responses AK (PSM). Only if all nm−1 responses AK are received, the respective mirror SP carries out an adjustment of the life counter.
- When adjusting the life counter, attention has to paid that the interval between two adjustments is selected in such a manner that mirrors SP which have been replaced in the meantime do not become valid again upon a restart. Preferably an additional memory is used for this purpose in which the value of the last life counter is stored where a mirror SP has been replaced.
- In the case of pseudoreliable messages PSM, too, faults can occur. It is true that the parameters for pseudoreliable messages PSM can be selected in such a manner that faults are improbable to such an extent that they virtually do not occur in the selected application. This can, however, lead to the result that the application is actually no longer practicable. With respect to the parameters for pseudoreliable messages PSM it might be necessary to make compromises so that faults occur due to faulty pseudoreliable messages PSM, which must be corrected.
- For this reason, the communication of the cells Z or the mirrors SP, respectively, among each other must be designed in such a manner that these faults remain without consequences or are corrected. This is done, e.g. by the use of a self check SelfCheck.
- The operation DoubleFieldCheck described in this section serves to correct faults which have been caused by communication errors with pseudoreliable messages PSM. Such faults cause mirror compounds to duplicate, i.e. that more than nm mirrors exist for one field.
- The operation DoubleFieldCheck can be carried by one or more mirrors SP in an interval t_DoubleFieldCheck. Each client CL can initiate an operation DoubleFieldCheck if it receives responses AK from mirrors SP whose references to other mirrors SP are not consistent.
- The operation DoubleFieldCheck removes additionally generated mirror compounds in order to restore the desired condition of nm mirrors SP per one field F. For this purpose, a manager for the operation DoubleFieldCheck is selected. This can be any cell Z (also of the mirror compound) or a client CL (e.g. the client which detected the error situation). Optionally, the manager sends a request RQ to the network to which all cells Z respond which are responsible for a certain field F, whereby also additional mirror compounds are detected. The manager then decides which cells Z belong to the valid mirror compound and sends a delete request DeleteRQ to all other cells Z. Optionally, the manager sends a request rq_updateTable to all remaining mirrors SP for updating their mirror tables.
- If individual cells Z do not receive the delete request DeleteRQ, they will be deactivated upon the next self check SelfCheck and/or the next operation DoubleFieldCheck.
- In order to decide which cells Z belong to the valid mirror compound various algorithms can be employed. In the following, examples for this are shown which can also be combined.
- One possibility is to introduce a generation counter which is incremented each time a new mirror SP is added to the compound. In the case of mirrors SP with a doubly existing index, the mirror SP with the higher/lower generation counter will be removed. It is also possible to declare the mirror compound valid which was last write-accessed. Furthermore, the validity of a mirror compound can also be decided as a function of any other properties (e.g. geographic position of mirrors SP). If only one single mirror SP is detected as working properly e.g. by a client CL, it is possible that the error is with this mirror SP and not with the nm−1 other mirrors SP. In order to exclude this possibility, an additional safety check should be carried out for ensuring the correct function of the single mirror SP before same replaces the other mirrors SP. It is thereby prevented that the single operating mirror SP erroneously activates additional mirrors SP.
- With actually only one mirror SP still working, nm−1 new mirrors SP are to be added. First, the working mirror SP must check or ensure, respectively, the function of its own data transmissions. Then nm−1 new mirrors SP are requested by a request rq_needNewCells. All nm−1 new mirrors SP are sent a request to become mirrors. It is thereby not necessary to evaluate the responses AK immediately, because any faults will be corrected by later self checks SelfChecks (this sequence approximately corresponds to the addition of a new field F, with the difference that only nm−1 cells Z are found and that the mirror manager is this case is identical with a mirror SP).
- In the following sections the data exchange between clients CL, cells Z, and clusters C is described which is preferred for providing the inventive “active” cells. In particular, the following operations are employed with reference now being made to
FIG. 4 : - Find operation (find): Finding of a cell Z which includes a desired field F.
- Read operation (read): A client CL reads the contents of a field F from a mirror SP.
- Write operation (write): A client modifies the contents of a field F in all associated mirrors SP.
- Add operation (add): Adding of fields F which previously have not been in the cluster compound CV.
- Delete operation (delete): Deletion of a field F in the cluster compound CV.
- By sending a find request FindRQ a client CL determines the position of the cells Z which include a desired field F and are thus mirrors SP for the desired field F. The addresses of these cells Z include both the identifications ClusterID of the corresponding clusters C as well as the identifications ZellID of the cells Z themselves.
- For obtaining the addresses of the cells Z which are mirrors SP for the desired field F (e.g. field F8 from
FIG. 2 ), the client CL requests any cluster C, e.g. cluster C6, whether one of its cells Z includes the desired field F8. If this is the case than the cluster C6 sends the corresponding cell identification ZellID as well as the cluster identifications ClusterID of all nm−1 cluster C which include mirrors SP of the desired field F8. As shown inFIG. 4 , in this case these are the cell C4 in cluster C1 and the cell Z6 in cluster C3, i.e. in total the cells with the identifications ZellID C1Z4, C3Z6, and C6Z2. - If the requested cluster C, e.g. cluster C4, does not contain the desired field F8, the requested cluster C4 finds the cell Z among the cells Z included therein whose field position FeldID comes closest to the field position FeldID of the desired field F8. For this purpose, the cluster C can, for example, determine the sum of the absolute values of the difference between the cell position ZellID and all other neighbouring cell positions ZellID in order to select the cell Z where the absolute value of such a difference is minimal.
- Due to the fact that cells Z contain information on neighbouring cells a cluster C can be found in this manner which comprises a cell Z with the desired field F8. The cluster C4 requested by the client CL relays the find request FindRQ to the cluster C found in this manner, e.g. to cluster C6. This operation is repeated until a desired cell Z has been found or until cells Z are not longer found which are neighbouring cells of the desired cell Z. Preferably, a step counter in incremented upon the relay of a find request FindRQ. With each increase of the step counter, the respective current cluster C sends a holding response HalteAK (holdingAK) to the client CL in order to inform same that his request FindRQ is still be processed. If the requesting client CL does not receive such a holding response HalteAK in this case, then it is to be assumed that its request FindRQ has been lost. In this case it is to be preferred that the requesting client CL directs the request FindRQ to the cluster C again from which it has received the latest holding response HalteAK.
- The find request FindRQ is successfully completed if the requesting client CL receives a destination identification ZielID (destinationID) for nm mirrors SP of the field F8. In the example shown in
FIG. 4 the destination identification ZielID would comprise the cells C1Z4, C3Z6, and C6Z2. If the client CL does not receive a response AK, the find operation has failed. - In the following, the sequence is described which is executed for read requests ReadRQ and write request WriteRQ. With the read and write requests ReadRQ, WriteRQ, shown below it is necessary that the respective client CL knows the identifications of the mirrors SP which include the field F whose data the client CL wants to access. This is critical insofar as the identifications of the desired mirrors SP can change any time due to shifting of the mirrors SP. To prevent this, it would be basically possible to link each find request FindRQ with an operation LockRQ which prevents changes of the respective compound of the desired mirrors SP before the actual read and write requests ReadRQ, WriteRQ have been received by the desired mirrors SP. This would, however, significantly reduce the efficiency of data transmissions between clients CL and clusters C.
- For this reason the approach with the preferred embodiment of the present invention is as follows. A client CL executes a find operation and notices the received positions of the mirrors SP which include the desired field F.
- If a mirror SP includes read and write requests ReadRQ, WriteRQ with a field position FeldID for the desired field F, which does not correspond to the field position FeldID for the desired field F in the mirror SP, it informs the client CL accordingly. Furthermore, each mirror SP always or alternatively on request returns the positions of the other nm−1 mirrors SP to the requesting client CL. In this manner, a mirror SP can correct the identifications ID stored in it and, if required, send a new find request FindRQ.
-
rq_read: begin if not used then begin <Optional: Return fault message to client> exit; end; message.data:=data; // Write own mirrors into the message for i:=1 to nm−1 do message.mirror[i]:=mirror[i]; <complete further field> <storage of specifications for performance measurement> return_msg(m,ak_read); end; - The request of a client CL is always directed to all nm mirrors SP:
-
message.command:=rq_read; for i:=1 to nm do begin message.destination:=spiegel[i]; <informationen für performance measurement in message, if req'd.> send(message); end; - Ideally the client CL buffers its own requests in order to be able to execute further actions (e.g. other requests) in the meantime, until the 1 . . . nm corresponding responses ak_read or a timeout arrives. After the elapse of the waiting time TWLese (TWRead) the client CL must check how many responses have been received and whether the mirror tables of the responses are consistent:
-
if nr_al>nm then begin <send request for DoubleFieldCheck to all senders> exit; end; if nr_ak=nm then begin if <Mirror tables consistent> then <use result from any response message[i] > else <send request for SelfCheck to all senders> exit; end; if nr_ak> nm div 2 then beginif <Mirror tables consistent> then <use result from any response message[i] > <send request for SelfCheck to all senders> exit; end; if nr_ak>0 then <send request for SelfCheck to all senders> - Preferably, the read requests ReadRQ and the write requests WriteRQ are sent via the network N to all clusters C in parallel, but depending on the network N used any other type of sending is possible.
- Each mirror SP, e.g. the cell C1Z4, optionally relays a read request ReadRQ from a client CL to all other mirrors SP, i.e. to the cells C3Z6 and C6Z2 in this case, and each mirror SP then sends a response AK to the client CL. In this case, a mirror SP receives a further read request ReadRQ and because this has the same ticket number TNr as the previously received read request ReadRQ it will be ignored because this mirror SP has already sent a response AK to the requesting client CL.
- When a read operation is executed the client CL requires the data of a certain field F, e.g. F8. For receiving this data the client CL must know the positions of the mirrors SP which are responsible for this field F8. This can be enabled by a previously executed find operation in order to determine the cells C1Z4, C3Z6, and C6Z2 operating as mirrors SP.
- The client CL sends a corresponding read request ReadRQ with a unique ticket number TNr to all 3 clusters C1, C3, and C6 which include the mirrors SP which are responsible for the desired field F8.
- The client CL waits for a predetermined application-specific time interval TWLese (TWRead) for responses AK of the requested mirrors SP which include the desired data. Each mirror SP acknowledges the read request ReadRQ with a response AK so than nm (i.e. 3 in this case) responses AK arrive at the requesting client CL.
- The client CL responds as a function of the type and/or number of the incoming responses AK. With three mirrors SP assumed which are responsible for the field F of the desired data the following different states result. If the client CL receives two or three identical responses AK, the result is used. If it receives two different responses AK or only one response AK the client CL sends a request for a self check to the corresponding mirrors SP. If the client CL receives different responses AK that response AK is used whose life counter has the highest value.
- A read request ReadRQ is successful if the client CL receives at least one response AK and cannot be completed successfully if the client CL does not receive a response AK within the predetermined time interval TWLese or if one or several clusters C signal that they did not find the desired cell Z. In order to avoid the above problems in sending a read request ReadRQ it is to be preferred to execute find requests FindRQ and read requests ReadRQ in a combined manner. In this case the client CL directs and find/read request Find/ReadRQ to any cluster C and receives a response AK from same as in the execution of an individual find request FindRQ. Here, the response AK does not include the address ID of the desired field F but the data of the desired field F.
- It is to be considered, however, that a combined find/read request Find/ReadRQ compared to an initial find request FindRQ for finding the desired mirrors SP and a subsequent read request RearRQ to the desired mirrors requires more time, because now all clusters C must process the combined and thus more extensive find/read request Find/ReadRQ.
- In order to change the data of a field F, e.g. field F8, the client CL sends a write request WriteRQ. As in the case of a read request ReadRQ, the client CL must know the positions of the 3 mirrors SP which are responsible for the desired field F8.
- The client CL sends a write request WriteRQ to all 3 mirrors SP of the desired field F8. Thereupon the data of the desired field F8 or of the associated cells C1Z4, C3Z6, and C6Z2 operating as mirrors SP is modified in that all mirror SP update their data correspondingly. Then each of the mirrors SP returns a response AK to the requesting client CL. As soon as all responses AK of the mirrors SP have arrived at the client CL the write operation is successfully completed.
- If at the time at which the client CL sends it write request WriteRQ another write request WriteRQ to the desired cells C1Z4, C3C6, and C6Z2 is already being executed the client CL receives a corresponding response AK which indicates that the write request WriteRQ has failed and the desired cells C1Z4, C3C6, and C6Z2 are in a locked state. A write request WriteRQ has also not been completely successfully if the requesting client CL receives less than nm responses AK, i.e. in the present case less than 3 responses AK.
- The synchronisation which is required for a write request WriteRQ is carried out by the involved mirrors SP in order to ensure that all nm mirrors SP are updated with the same data. If a mirror SP receives a write request WriteRQ, it sends this write request WriteRQ to all other nm−1 mirrors SP. Only if the sending mirror SP receives a response AK from all the other nm−1 mirrors SP the write request WriteRQ is executed. Thereby the write request WriteRQ received by the mirror SP can be sent either from a client CL or from another mirror SP of the same compound.
- If a mirror SP receives another write request WriteRQ from a mirror SP with a lower index, previously arrived write requests WriteRQ are overwritten in all mirrors. Moreover, a mirror SP does not accept further write requests WriteRQ from a client CL if already a not fully executed write request WriteRQ has arrived from another mirror SP or client CL.
- It is possible to execute find requests FindRQ and write request WriteRQ in a combined manner as find/write requests Find/WriteRQ, but it is to be checked whether the additional time requirement is reasonable.
- An add request AddRQ serves to integrate a field F which is not yet included in the cluster compound CV into the cluster compound CV. Such an add request AddRQ can be sent from a cluster C or a client CL.
- An individual cell, e.g. the cell C2Z6 from
FIG. 4 , receives an add request AddRQ from the client CL to work as a mirror manager and to integrate nm−1 (i.e. 2) new mirrors SP into the cluster compound CV. In the currently preferred embodiment of the invention, one cell Z is always selected a mirror manager which itself is no mirror SP. However, embodiments of the invention are possible where the mirror manager itself is also a mirror. The cell C2Z6 working as the mirror manager sends an add request AddRQ for 2 mirrors into the network N. The add request AddRQ is related from cluster C to cluster C in the cluster compound CV, e.g. from cluster C2 to cluster C3, with the number of the mirrors SP to be added being decremented upon relay of the add request AddRQ, when the last requested cluster C has provided a cell Z. - The last requested cluster C sends the identifications ZellID of the cells Z which are considered as mirrors SP to the cell C2Z6 working as the mirror manager. The cell C2Z6 working as the mirror manager then sends a corresponding response AK to all cells C3Z1 and C1Z2 which are possible as mirrors SP, preferably a pseudoreliable message PSM which instructs them to become mirrors SP. Then the cell C2Z6 working as the mirror manager returns a corresponding response AK to the requesting client CL. An add request AddRQ is not completed successfully if no response AK or a negative response AK is returned from the cell C2Z6 working as the mirror manager.
- Pseudocode for the execution of an add request AddRQ:
-
rq_addField: begin if (status<>cs_idle) or (used) then exit; message.command:=ak_addField; <store additional values for request, e.g. data, field position, etc. for later relay to the mirrors SP> fieldpos:=message.dataFieldPos; data:=message.data; mirManClient:=message.sender; repeat_rq_emptycells:=c_repeat_rq_emptycells; psm_send(message,message.sender,cs_mirrorManager1); exit; end; - The execution of an add request AddRQ does not guarantee that nm mirrors SP are available for a desired field F, but that either nm mirrors SP are available or after the elapse of a predetermined time t no mirrors SP at all are available for the desired field F.
- If less than nm new mirrors SP exist after the execution of an add request AddRQ this can only occur if the pseudoreliable messages PMSM used in the add request AddRQ provide wrong results. Such faults are corrected by later self checks of the mirror SP.
- A mirror request SpiegelRQ (MirrorRQ) is a special case of an add request AddRQ, wherein a cell Z which will be referred to a manager in the following requests a single mirror SP. The manager sends the request to the cells Z which are possible as mirrors SP to become new mirrors SP.
- If the manager sends a mirror request SpiegelRQ into the network N, a waiting time WT is recorded from this moment on until responses AK of the cells Z possible as mirrors SP arrive in the manager. Each cluster C which receives the mirror request SpiegelRQ and can provide storage space sends a corresponding response AK to the manager and provides storage space which is kept free to be integrated into the cluster compound CV in the form of a cell Z or a mirror SP, respectively. If a cluster C cannot provide a mirror SP, it relays the mirror request SpiegelRQ to other clusters C. When the manager has received a corresponding response AK of a new mirror SP it will enter this in a mirror table. If a cell Z which is possible as a mirror SP received a message MSG from the manager prior to the elapse of the time interval wt that no more mirrors SP are required, it is released again and the mirror request SpiegelRQ is rejected.
- If a timeout occurs in one of the requested cells Z, i.e. the time interval wt of the mirror request SpiegelRQ for this cell Z has elapsed, then a new cell Z which is possible as a mirror is found. This operation is repeated several times or until cells Z possible as mirrors have responded. Cells Z which have made themselves available as possible mirrors SP and whose responses AK arrive at the manager after the assigned time interval wt will be ignored by same.
- Pseudocode for carrying out a mirror request SpiegelRQ;
-
cs_getOneNewMirror0: begin message.command:=rq_needEmptyCells; <select destination cluster> message.ticket:=makeNewTicket; psm_send(r,r.dest,cs_getOneNewMirror1); exit; end; - Either the mirror SP receives a response AK or the mirror request SpiegelRQ becomes invalid:
-
cs_getOneNewMirror1: begin if psm_timeout then begin status:=cs_idle; exit; end; possibleMirror:=<received address> message.command:=rq_singlebecomeMirror; <write own address and addr. of the other valid mirror into the message> psm_send(r,possibleMirror[1],cs_getOneNewMirror2); exit; end; - The still not used mirror SP receives the mirror request SpiegelRQ to become a mirror which it processes with the following pseudocode:
-
rq_singlebecomeMirror: begin if <request from same mirrorl> and <ticket in agreement> then begin <return acknowledgement> exit; end; if used then exit; < return acknowledgement> <notice MirrorManager and ticket> <Send rq_addMirror to all old mirrors> exit; end; - Now this mirror candidate sends a request to all nm−1 old mirrors SP to be accepted as a mirror (rq_addMirror). Because the old mirrors SP must certify this mutually the cell might have to wait longer than normal for a response to the message. A mirror SP which has received this request enquires all other nm−2 mirrors SP whether these have received this request, too (rq_certify). Only if this is the case, the mirror SP replies with a corresponding response ak_addmirror and updates its own mirror table:
-
rq_addMirror: begin <set flags, if req'd to accept messages > if <request is from mirror l> then begin <update message with data corr. to LifeCount> <send acknowledgement ak_akkMirror> exit; end; if <message is from mirror candidate (anew)> then exit; if <Status is not correct> then exit; if not <mirror to be replaced is known> then exit; <further plausibility checks, if req'd.> <Send request to all nm−2 mirrors whether message received, too> end; - Finally, the mirror candidate updates its data:
-
cs_becomeSingleNewMirror1: begin if not <all nm−1 old mirrors have sent ak_addMirror> then begin status:=cs_idle; exit; end; <take over mirror data> <take over data (field value etc.)> <establish own index> used:=true; status:=cs_idle; exit; end; - In order to remove a field F from the cluster compound CV, a client CL or a cluster C, for example, sends a delete request DeleteRQ to all nm mirrors SP associated with the field F. A delete request DeleteRQ ensures that either all nm mirrors SP are removed or, in the case of a not successful execution of the delete request DeleteRQ, that no mirror SP is removed in order to ensure consistent data in the cluster compound CV.
- Optionally, each mirror SP which receives a delete request DeleteRQ relays it to the other nm−1 mirrors SP. A mirror which receives a delete request DeleteRQ “deletes” itself, i.e. the respective cell Z changes into an idle state and informs the sender of the delete request DeleteRQ about this with a corresponding response AK.
- A delete request DeleteRQ is executed successfully if the sender receives nm responses AK according to the which nm mirrors SP of the field F have deleted themselves. If the sender does not receive a response AK after the elapse of a predetermined time interval, according to which the nm mirrors SP of the field F have deleted themselves, the delete request DeleteRQ has failed.
- Pseudocode for the execution of a delete request DeleteRQ:
-
rq_delete: begin if status<>cs_idle then exit; if used and (message.ticket=lmticket) and (message.sender=lmAdr) then begin return_msg(message,ak_delete); exit; end; return_msg(m,ak_delete); lmTicket:=message.ticket; lmAdr:=message.sender; <Initialise cell in the initial state> used:=false; status:=cs_idle; exit; end; - Shift operations are used for assigning individual mirrors SP of a mirror compound to other cells Z which then replace the previous mirrors SP accordingly. There are various reasons which necessitate shift operations:
- Failure of a cluster C or individual cells Z
- Removal of a cluster C from a cluster compound
- Inadequate data transmission performance of a cluster C
- Application-specific causes/reasons.
- The shifting of mirrors SP upon the request of new mirrors SP has already been described above. If a cluster C is to be removed from the cluster compound CV, for example, when a cluster C is to be shut down or to be used for other tasks in the network N, the data of its active cells Z, i.e. of the cells Z which operate as mirrors SP, must be shifted to other clusters C. In this case the cluster C to be removed initiates the shifting of the data or of the mirrors SP, respectively, of the individual mirror compounds (as described above).
- For initiating shift operations due to an inadequate data transmission performance, the data transmission performance of the clusters C and/or the cells Z is checked during operation. For this purpose, the preferred embodiment of the present invention uses a counter for each mirror SP and/or each cell Z which determines the transmission duration with pseudoreliable messages PSM. Optionally, a timer is implemented which determines the average data transmission duration, with a common time basis being required in this case. Preferably, each cluster C determines the data transmission performances of its cells Z. Mirrors SP or cells Z, respectively, whose data transmission durations exceed certain limits are shifted.
- The evaluation of the data transmission performance with respect to the data transmission duration, however, is to be understood as an example only, and any desired parameter of data transmission performances which is suitable for the application of the invention can be checked for an initiation of shift operations by means of known methods. For example, the computing performance of individual cells Z and/or clusters C, or the performance of individual areas of the network N could be checked.
- If such an inadequate data transmission performance has been determined for a mirror SP, e.g. cell C6Z2 from
FIG. 2 , a single mirror SP from the corresponding compound becomes the manager, e.g. cell C1Z4. The manager C1Z4 sends a request RQ, preferably with a pseudoreliable message PSM, to all other two cells C3Z6 and C6Z2 of the compound operating as mirrors SP to remove the corresponding mirror SP (C6Z2). This makes itself invalid or is declared invalid by the corresponding cluster C6. - Thereupon the manager C1Z4 requests a new mirror SP in the cluster compound CV, whereby contrary to the above described replacement for a mirror SP additional requirements can be placed on the new mirror SP, preferably requirements with respect to the data transmission performance. The new mirror SP is integrated into the mirror compound in the above described manner.
- In order to ensure that all mirrors SP have received information on the shift operation the manager sends a request RQ (preferably with a pseudoreliable message PSM) for cancelling the shift operation if it has not received a corresponding response AK from all nm−1 mirrors SP. In this case, the shift operation could not be completed successfully.
- The operations described above in conjunction with cells Z and mirrors SP are also applicable to operations with respect to the inventive clusters C. For this reason, a detailed description of the operations for adding, removing, shifting, and deactivating of individual clusters C is dispensed with.
- Although the present invention has been described in terms of specific embodiments, it is anticipated that alterations and modifications thereof will no doubt become apparent to those skilled in the art. It is therefore intended that the following claims to be interpreted as covering all such alterations and modification as fall within the true spirit and scope of the invention.
Claims (11)
1. A data management system comprising:
at least one seeder that stores a plurality of file parts of a complete file;
at least one peer for downloading at least one file part from the seeder based on at least one of upload and download rates; and
wherein the seeder and one of the at least one peer stores at least one same file part.
2. The data management system of claim 1 , wherein the at least one seeder and at least one peer are connected over a wireless network.
3. A data management system comprising:
at least one seeder that stores a plurality of file parts of a complete file;
at least one leecher for downloading at least one file part from the seeder based on at least one of upload and download rates; and
wherein the seeder and one of the at least one leecher stores at least one same file part.
4. The data management system of claim 3 , wherein the at least one seeder and at least one leecher are connected over a wireless network.
5. A data management system comprising:
at least one complete downloader that stores a plurality of file parts of a complete file;
at least one incomplete downloader for downloading at least one file part from the complete downloader based on at least one of upload and download rates; and
wherein the complete downloader and one of the at least one incomplete downloader stores at least one same file part.
6. The data management system of claim 5 , wherein the at least one complete downloader and the at least one incomplete downloader are connected over a wireless network.
7. A computer unit comprising:
a receiver for receiving or detecting information about an event; and
a transmitter for transmitting the information to a plurality of additional computer units based on predetermined parameters.
8. The computer unit of claim 7 , wherein the computer unit transmits and receives the event over a wireless network.
9. A plurality of computer units distributed over a wireless network, the computer units comprising:
a receiver for receiving information about an event;
a transmitter for transmitting information about the event to a plurality of additional computer units based on a set of parameters; and
wherein at least one of the additional computer units accesses the information about the event.
10. The plurality of computer units of claim 9 , wherein the plurality of computer units further comprise a sensor for detecting an event.
11. A data management system comprising:
a plurality of data storage systems for redundantly storing data;
at least one computer unit for accessing the data of at least one of the plurality of a data storage systems;
a sensor for detecting prespecified parameters of data transmissions between the plurality of data storage systems and the at least one computer unit, wherein the data is redundantly stored as a function of the prespecified parameters; and
wherein the plurality of data storage systems shift data independent of an access of the at least one computer unit as a function of the detected prespecified parameters of the data transmissions between the plurality of data storage systems.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/609,065 US20130067038A1 (en) | 1999-01-11 | 2012-09-10 | Data access and management system as well as a method for data access and data management for a computer system |
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE19900636A DE19900636B8 (en) | 1999-01-11 | 1999-01-11 | Data access and management system and method for data access and data management for a computer system and their use |
DE19900636.9 | 1999-01-11 | ||
PCT/EP2000/000141 WO2000041471A2 (en) | 1999-01-11 | 2000-01-11 | Data access and management system and data access and management method for a computer system |
US09/903,431 US7000084B2 (en) | 1999-01-11 | 2001-07-10 | Data access and management system as well as a method for data access and data management for a computer system |
US11/188,025 US7904680B2 (en) | 1999-01-11 | 2005-07-23 | Data access management system as well as a method for data access and data management for a computer system |
US13/029,267 US8656125B2 (en) | 1999-01-11 | 2011-02-17 | Data access and management system as well as a method for data access and data management for a computer system |
US13/609,065 US20130067038A1 (en) | 1999-01-11 | 2012-09-10 | Data access and management system as well as a method for data access and data management for a computer system |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/029,267 Continuation US8656125B2 (en) | 1999-01-11 | 2011-02-17 | Data access and management system as well as a method for data access and data management for a computer system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20130067038A1 true US20130067038A1 (en) | 2013-03-14 |
Family
ID=7893896
Family Applications (8)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/903,431 Ceased US7000084B2 (en) | 1999-01-11 | 2001-07-10 | Data access and management system as well as a method for data access and data management for a computer system |
US11/188,025 Expired - Fee Related US7904680B2 (en) | 1999-01-11 | 2005-07-23 | Data access management system as well as a method for data access and data management for a computer system |
US11/515,507 Expired - Lifetime USRE40521E1 (en) | 1999-01-11 | 2006-09-05 | Data access and management system as well as a method for data access and data management for a computer system |
US13/029,267 Expired - Lifetime US8656125B2 (en) | 1999-01-11 | 2011-02-17 | Data access and management system as well as a method for data access and data management for a computer system |
US13/609,065 Abandoned US20130067038A1 (en) | 1999-01-11 | 2012-09-10 | Data access and management system as well as a method for data access and data management for a computer system |
US14/106,636 Abandoned US20140201484A1 (en) | 1999-01-11 | 2013-12-13 | Data access and management system as well as a method for data access and data management for a computer system |
US14/858,723 Expired - Fee Related US9787771B2 (en) | 1999-01-11 | 2015-09-18 | Data access and management system as well as a method for data access and data management for a computer system |
US15/719,160 Abandoned US20180034907A1 (en) | 1999-01-11 | 2017-09-28 | Data access and management system as well as a method for data access and data management for a computer system |
Family Applications Before (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/903,431 Ceased US7000084B2 (en) | 1999-01-11 | 2001-07-10 | Data access and management system as well as a method for data access and data management for a computer system |
US11/188,025 Expired - Fee Related US7904680B2 (en) | 1999-01-11 | 2005-07-23 | Data access management system as well as a method for data access and data management for a computer system |
US11/515,507 Expired - Lifetime USRE40521E1 (en) | 1999-01-11 | 2006-09-05 | Data access and management system as well as a method for data access and data management for a computer system |
US13/029,267 Expired - Lifetime US8656125B2 (en) | 1999-01-11 | 2011-02-17 | Data access and management system as well as a method for data access and data management for a computer system |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/106,636 Abandoned US20140201484A1 (en) | 1999-01-11 | 2013-12-13 | Data access and management system as well as a method for data access and data management for a computer system |
US14/858,723 Expired - Fee Related US9787771B2 (en) | 1999-01-11 | 2015-09-18 | Data access and management system as well as a method for data access and data management for a computer system |
US15/719,160 Abandoned US20180034907A1 (en) | 1999-01-11 | 2017-09-28 | Data access and management system as well as a method for data access and data management for a computer system |
Country Status (8)
Country | Link |
---|---|
US (8) | US7000084B2 (en) |
EP (1) | EP1151591B1 (en) |
AT (1) | ATE277474T1 (en) |
DE (2) | DE19900636B8 (en) |
DK (1) | DK1151591T3 (en) |
ES (1) | ES2230059T3 (en) |
PT (1) | PT1151591E (en) |
WO (1) | WO2000041471A2 (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19900636B8 (en) | 1999-01-11 | 2005-04-07 | Gailer, Peter | Data access and management system and method for data access and data management for a computer system and their use |
US8560691B2 (en) * | 2007-06-19 | 2013-10-15 | Microsoft Corporation | Relocating item in distributed storage system |
US8825743B2 (en) * | 2007-07-12 | 2014-09-02 | Cornell University | Semantic transactions in online applications |
US8380960B2 (en) * | 2008-11-04 | 2013-02-19 | Microsoft Corporation | Data allocation and replication across distributed storage system |
KR20130087810A (en) * | 2012-01-30 | 2013-08-07 | 삼성전자주식회사 | Method and apparatus for cooperative caching in mobile communication system |
US9436842B2 (en) * | 2013-08-16 | 2016-09-06 | Vinay Purohit | Distributed fragments file system |
US10430217B2 (en) * | 2013-09-16 | 2019-10-01 | Vmware, Inc. | High availability using dynamic quorum-based arbitration |
US10146455B2 (en) * | 2014-07-08 | 2018-12-04 | Osr Enterprises Ag | Device, system and method for storing data |
US9785473B2 (en) | 2014-07-14 | 2017-10-10 | Nxp Usa, Inc. | Configurable per-task state counters for processing cores in multi-tasking processing systems |
Family Cites Families (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5668986A (en) * | 1991-10-02 | 1997-09-16 | International Business Machines Corporation | Method and apparatus for handling data storage requests in a distributed data base environment |
US5548724A (en) | 1993-03-22 | 1996-08-20 | Hitachi, Ltd. | File server system and file access control method of the same |
US5459837A (en) * | 1993-04-21 | 1995-10-17 | Digital Equipment Corporation | System to facilitate efficient utilization of network resources in a computer network |
JPH06332623A (en) * | 1993-05-24 | 1994-12-02 | Mitsubishi Electric Corp | Array type recorder and recorder |
US5634125A (en) * | 1993-09-02 | 1997-05-27 | International Business Machines Corporation | Selecting buckets for redistributing data between nodes in a parallel database in the quiescent mode |
US6185619B1 (en) * | 1996-12-09 | 2001-02-06 | Genuity Inc. | Method and apparatus for balancing the process load on network servers according to network and serve based policies |
US5881051A (en) | 1995-07-10 | 1999-03-09 | International Business Machines | Management of route testing in packet communications networks |
US6047309A (en) * | 1995-10-02 | 2000-04-04 | International Business Machines Corporation | Recording observed and reported response characteristics at server and/or client nodes in a replicated data environment, and selecting a server to provide data based on the observed and/or reported response characteristics |
JPH09179820A (en) | 1995-12-26 | 1997-07-11 | Mitsubishi Electric Corp | Load distributing system and its method |
AU2343097A (en) | 1996-03-21 | 1997-10-10 | Mpath Interactive, Inc. | Network match maker for selecting clients based on attributes of servers and communication links |
US5838909A (en) | 1996-05-23 | 1998-11-17 | Sandcastle, Inc. | Reducing latency when synchronizing access to a multi-user database over a network |
JPH1069358A (en) * | 1996-08-28 | 1998-03-10 | Mitsubishi Electric Corp | Data arranging device |
WO1998018076A1 (en) * | 1996-10-18 | 1998-04-30 | Intervu, Inc. | System and method for optimized storage and retrieval of data on a distributed computer network |
US5802106A (en) | 1996-12-06 | 1998-09-01 | Packeteer, Inc. | Method for rapid data rate detection in a packet communication environment without data rate supervision |
US6052718A (en) | 1997-01-07 | 2000-04-18 | Sightpath, Inc | Replica routing |
GB9702458D0 (en) | 1997-02-06 | 1997-03-26 | British Telecomm | Adaptive distributed information network |
US6152824A (en) | 1997-03-06 | 2000-11-28 | Mpath Interactive, Inc. | Online gaming architecture |
US6073209A (en) | 1997-03-31 | 2000-06-06 | Ark Research Corporation | Data storage controller providing multiple hosts with access to multiple storage subsystems |
US6038599A (en) | 1997-04-23 | 2000-03-14 | Mpath Interactive, Inc. | Latency server and matchmaker |
US6256675B1 (en) | 1997-05-06 | 2001-07-03 | At&T Corp. | System and method for allocating requests for objects and managing replicas of objects on a network |
JP4151991B2 (en) * | 1997-05-26 | 2008-09-17 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | System for retrieving data in a video server |
US6081907A (en) | 1997-06-09 | 2000-06-27 | Microsoft Corporation | Data delivery system and method for delivering data and redundant information over a unidirectional network |
US6189043B1 (en) * | 1997-06-09 | 2001-02-13 | At&T Corp | Dynamic cache replication in a internet environment through routers and servers utilizing a reverse tree generation |
US6112239A (en) | 1997-06-18 | 2000-08-29 | Intervu, Inc | System and method for server-side optimization of data delivery on a distributed computer network |
US6088766A (en) | 1997-10-06 | 2000-07-11 | Emc Corporation | Method for exchanging data blocks on disk storage devices utilizing disk access statistics and testing for the effect of a change |
US7301944B1 (en) | 1997-10-24 | 2007-11-27 | Tranz-Send Broadcasting Network, Inc. | Media file distribution with adaptive transmission protocols |
US6215772B1 (en) | 1997-11-26 | 2001-04-10 | International Business Machines Corporation | Dynamic parameter estimation for efficient transport of HPR data on IP |
US6178160B1 (en) | 1997-12-23 | 2001-01-23 | Cisco Technology, Inc. | Load balancing of client connections across a network using server based algorithms |
US6415373B1 (en) | 1997-12-24 | 2002-07-02 | Avid Technology, Inc. | Computer system and process for transferring multiple high bandwidth streams of data between multiple storage units and multiple applications in a scalable and reliable manner |
US6185598B1 (en) | 1998-02-10 | 2001-02-06 | Digital Island, Inc. | Optimized network resource location |
US6085251A (en) | 1998-04-02 | 2000-07-04 | The United States Of America As Represented By The Secretary Of The Air Force | Implementing a parallel file transfer protocol |
US6115752A (en) | 1998-05-21 | 2000-09-05 | Sun Microsystems, Inc. | System and method for server selection for mirrored sites |
DE19900636B8 (en) | 1999-01-11 | 2005-04-07 | Gailer, Peter | Data access and management system and method for data access and data management for a computer system and their use |
US6339785B1 (en) | 1999-11-24 | 2002-01-15 | Idan Feigenbaum | Multi-server file download |
-
1999
- 1999-01-11 DE DE19900636A patent/DE19900636B8/en not_active Expired - Fee Related
-
2000
- 2000-01-11 DK DK00903572T patent/DK1151591T3/en active
- 2000-01-11 DE DE50007896T patent/DE50007896D1/en not_active Expired - Lifetime
- 2000-01-11 AT AT00903572T patent/ATE277474T1/en active
- 2000-01-11 WO PCT/EP2000/000141 patent/WO2000041471A2/en active Search and Examination
- 2000-01-11 PT PT00903572T patent/PT1151591E/en unknown
- 2000-01-11 EP EP00903572A patent/EP1151591B1/en not_active Expired - Lifetime
- 2000-01-11 ES ES00903572T patent/ES2230059T3/en not_active Expired - Lifetime
-
2001
- 2001-07-10 US US09/903,431 patent/US7000084B2/en not_active Ceased
-
2005
- 2005-07-23 US US11/188,025 patent/US7904680B2/en not_active Expired - Fee Related
-
2006
- 2006-09-05 US US11/515,507 patent/USRE40521E1/en not_active Expired - Lifetime
-
2011
- 2011-02-17 US US13/029,267 patent/US8656125B2/en not_active Expired - Lifetime
-
2012
- 2012-09-10 US US13/609,065 patent/US20130067038A1/en not_active Abandoned
-
2013
- 2013-12-13 US US14/106,636 patent/US20140201484A1/en not_active Abandoned
-
2015
- 2015-09-18 US US14/858,723 patent/US9787771B2/en not_active Expired - Fee Related
-
2017
- 2017-09-28 US US15/719,160 patent/US20180034907A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
US20160248854A1 (en) | 2016-08-25 |
US7904680B2 (en) | 2011-03-08 |
ATE277474T1 (en) | 2004-10-15 |
DE19900636A1 (en) | 2000-07-13 |
WO2000041471A3 (en) | 2000-11-02 |
US20070244992A9 (en) | 2007-10-18 |
US9787771B2 (en) | 2017-10-10 |
DE19900636B8 (en) | 2005-04-07 |
WO2000041471A8 (en) | 2001-04-05 |
US7000084B2 (en) | 2006-02-14 |
EP1151591A2 (en) | 2001-11-07 |
WO2000041471A2 (en) | 2000-07-20 |
US20050273504A1 (en) | 2005-12-08 |
US20140201484A1 (en) | 2014-07-17 |
ES2230059T3 (en) | 2005-05-01 |
US20110258396A1 (en) | 2011-10-20 |
US8656125B2 (en) | 2014-02-18 |
DE50007896D1 (en) | 2004-10-28 |
USRE40521E1 (en) | 2008-09-23 |
DK1151591T3 (en) | 2005-01-24 |
DE19900636B4 (en) | 2004-01-15 |
US20020152363A1 (en) | 2002-10-17 |
US20180034907A1 (en) | 2018-02-01 |
EP1151591B1 (en) | 2004-09-22 |
PT1151591E (en) | 2005-02-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9787771B2 (en) | Data access and management system as well as a method for data access and data management for a computer system | |
US11349949B2 (en) | Method of using path signatures to facilitate the recovery from network link failures | |
US7894335B2 (en) | Redundant routing capabilities for a network node cluster | |
US7177951B1 (en) | Address management in PNNI hierarchical networks | |
US6590868B2 (en) | Method and apparatus for restart communication between network elements | |
US8375001B2 (en) | Master monitoring mechanism for a geographical distributed database | |
US7975016B2 (en) | Method to manage high availability equipments | |
US7640253B2 (en) | Method and system for managing data records on a computer network | |
US7818408B1 (en) | Automated virtual interface failover in a mass storage cluster | |
US20060206611A1 (en) | Method and system for managing programs with network address | |
US7917578B1 (en) | Managing state information in a computing environment | |
JP2010519630A (en) | Consistent fault-tolerant distributed hash table (DHT) overlay network | |
US7095857B2 (en) | Key distribution system for protection of route-update notification in micromobility networks | |
JPH103440A (en) | Computer system | |
CN113204424A (en) | Method and device for optimizing Raft cluster and storage medium | |
CN111917870A (en) | Request processing method, system, device, electronic equipment and storage medium | |
WO2016181462A1 (en) | Information processing system and cluster management method | |
US7184394B2 (en) | Routing system providing continuity of service for the interfaces associated with neighboring networks | |
US20230188419A1 (en) | Redundant storage of configuration of network devices | |
CN110958182B (en) | Communication method and related equipment | |
KR100798997B1 (en) | Restarting Method of Dual Processor | |
JPH08265314A (en) | Communication network system and network resource reflection method on routing | |
JPH08137778A (en) | Server client system | |
JP2003244733A (en) | Distributed database access processing method for service control node system and network system for executing the same | |
JP2009271733A (en) | Database synchronization method between machine |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |