CN109992219A - Distributed storage method, device, equipment and computer readable storage medium - Google Patents
Distributed storage method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN109992219A CN109992219A CN201910291510.1A CN201910291510A CN109992219A CN 109992219 A CN109992219 A CN 109992219A CN 201910291510 A CN201910291510 A CN 201910291510A CN 109992219 A CN109992219 A CN 109992219A
- Authority
- CN
- China
- Prior art keywords
- data
- information
- written
- distributed storage
- write
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of distributed storage methods, this method comprises: obtaining data to be written when receiving the data write request of client transmission and the data to be written being written in preset different copy memory nodes；Judge whether that receiving the write operation that the different copy memory nodes return completes information；When receiving the write operation completion information that all different copy memory nodes return, successful information is written in Xiang Suoshu client returned data.The invention also discloses a kind of distributed storage devices, equipment and a kind of computer readable storage mediums.It includes the not high technical problem of distributed memory system performance for arbitrating copy that the present invention, which is able to solve existing,.
Description
Technical field
The present invention relates to Internet technical field more particularly to distributed storage method, device, equipment and computer-readable
Storage medium.
Background technique
With the rapid development of Internet technology, application is more and more abundant, and data are also in that geometry grade increases, mass data
It stores and comes into being to band immense pressure, distributed memory system is locally stored.
For the highly reliable and High Availabitity for guaranteeing distributed memory system, data generally store multiple copies in systems, point
Data are synchronized to multiple memory nodes by replication protocol by cloth storage system, to ensure that the data between multiple copies are consistent
Property, and this process is easy to appear " fissure " problem, that is, when two node communications are broken down, data can not be synchronized, failure
After recovery, two nodes scold mutually other side's error in data, cause system that can not judge the correctness of data.
For this purpose, existing solution is to increase arbitration copy, correct number is determined using majority rule
Data write-in according to, program arbitration copy be with the progress simultaneously of common copy, for convenient for subsequent arbitration, distributed storage system
The accumulation layer of system needs that successfully letter just is written to client returned data when information is completed in the write-in for receiving arbitration copy
Breath.The defect of this scheme is: when executing data write operation every time, accumulation layer must all be communicated with arbitration copy, and
The communication can occupy a part of Internet resources, and increase the time-consuming of entire data writing process, so as to cause distributed storage system
The overall performance of system declines.
Summary of the invention
It is a primary object of the present invention to propose a kind of distributed storage method, device, equipment and computer-readable storage
Medium, it is intended to solve existing to include the not high technical problem of distributed memory system performance for arbitrating copy.
To achieve the above object, the present invention provides a kind of distributed storage method, and the distributed storage method includes such as
Lower step:
When receiving the data write request of client transmission, data to be written are obtained and by the number to be written
According in the preset different copy memory nodes of write-in；
Judge whether that receiving the write operation that the different copy memory nodes return completes information；
When receiving the write operation completion information that all different copy memory nodes return, Xiang Suoshu client is returned
Successful information is written in data.
Preferably, described to judge whether that receiving the write operation that the different copy memory nodes return completes information
After step, further includes:
When not receiving the write operation completion information that any copy memory node returns, generates and be written with the data
Request corresponding operation log；
The operation log is issued to preset arbitration node；
When receiving the operation log write-in completion information that the arbitration node returns, Xiang Suoshu client returned data
Successful information is written.
Preferably, described when not receiving the write operation that any copy memory node returns and completing information, generate with
The step of data write request corresponding operation log includes:
When not receiving the write operation completion information that any copy memory node returns, acquisition does not return to write operation
The identification information of the copy memory node of information is completed, and obtains the metadata information and operation history of the data to be written
Record；
It is generated and the data according to the identification information, the metadata information of data to be written and operation historical record
The corresponding operation log of write request.
Preferably, before the described the step of operation log is issued to preset arbitration node, further includes:
Judge in scheduled duration whether to the arbitration node to issue operation day corresponding with the data write request
Will；
It, will if issuing operation log corresponding with the data write request to the arbitration node in scheduled duration
Successful information is written to the client returned data.
Preferably, described to judge whether issued and the data write request pair to the arbitration node in scheduled duration
After the step of operation log answered, further includes:
If not issuing operation log corresponding with the data write request to the arbitration node in scheduled duration,
It executes and the operation log is issued to preset arbitration node, be written when receiving the operation log that the arbitration node returns
Complete information when, Xiang Suoshu client returned data be written successful information the step of.
In addition, to achieve the above object, the present invention also provides a kind of distributed storage devices, the distributed storage devices
Include:
Writing module, for obtaining data to be written and inciting somebody to action when receiving the data write request of client transmission
In the preset different copy memory nodes of data write-in to be written；
Judgment module, for judging whether that receiving the write operation that the different copy memory nodes return completes letter
Breath；
First return module, for completing information when the write operation for receiving all different copy memory nodes returns
When, successful information is written in Xiang Suoshu client returned data.
Preferably, the distributed storage devices further include:
Generation module, for generating when not receiving the write operation completion information that any copy memory node returns
Operation log corresponding with the data write request；
Module is issued, for the operation log to be issued to preset arbitration node；
Second return module, for when receiving the operation log write-in that the arbitration node returns and completing information, to
Successful information is written in the client returned data.
Preferably, the generation module is also used to:
When not receiving the write operation completion information that any copy memory node returns, acquisition does not return to write operation
The identification information of the copy memory node of information is completed, and obtains the metadata information and operation history of the data to be written
Record；
It is generated and the data according to the identification information, the metadata information of data to be written and operation historical record
The corresponding operation log of write request.
In addition, to achieve the above object, the present invention also provides a kind of distributed storage device, the distributed storage device
Include: memory, processor and be stored in the distributed storage program that can be run on the memory and on the processor,
The step of distributed storage program realizes distributed storage method as described above when being executed by the processor.
In addition, to achieve the above object, it is described computer-readable the present invention also provides a kind of computer readable storage medium
It is stored with distributed storage program on storage medium, is realized when the distributed storage program is executed by processor as described above
The step of distributed storage method.
Distributed storage method proposed by the present invention, when distributed memory system receives the data write-in of client transmission
When request, obtains data to be written and the data to be written are written in preset different copy memory nodes；Judgement
Whether receive the write operation that the different copy memory nodes return and completes information；It is stored when receiving all different copies
When information is completed in the write operation that node returns, successful information is written in Xiang Suoshu client returned data.This mode pass through to
Data are written in different copy memory nodes, if receiving the write operation that all different copy memory nodes return completes letter
Breath does not then issue data to arbitration node, but successful information directly is written to client returned data, realizes and is guaranteeing system
Unite under the premise of highly reliable and High Availabitity, reduce the communication between arbitration node, thus reduce Internet resources occupancy and
The time-consuming of entire data writing process, improves the overall performance of distributed memory system.
Detailed description of the invention
Fig. 1 is the device structure schematic diagram for the hardware running environment that the embodiment of the present invention is related to；
Fig. 2 is the flow diagram of distributed storage method first embodiment of the present invention；
Fig. 3 is the module diagram of one embodiment of distributed storage devices of the present invention.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The primary solutions of the embodiment of the present invention are: when receiving the data write request of client transmission, obtaining
Data to be written simultaneously will be in the preset different copy memory nodes of data write-in to be written；Judge whether to receive institute
It states the write operation that different copy memory nodes return and completes information；When receive that all different copy memory nodes return writes
When entering operation completion information, successful information is written in Xiang Suoshu client returned data.
In the prior art, distributed memory system arbitration copy data write-in be with common copy simultaneously progress, be
Convenient for subsequent arbitration, the accumulation layer of distributed memory system is needed when information is completed in the write-in for receiving arbitration copy, just to
Successful information is written in client returned data.The defect of this scheme is: when executing data write operation every time, storage
Layer must all be communicated with arbitration copy, and the communication can occupy a part of Internet resources, and increase entire data writing process
Time-consuming declines so as to cause the overall performance of distributed memory system.
The present invention is returned by the way that data are written to different copy memory nodes if receiving all different copy memory nodes
Information is completed in the write operation returned, then does not issue data to arbitration node, but be directly written successfully to client returned data
Information realizes under the premise of guarantee system is highly reliable and High Availabitity, the communication between arbitration node is reduced, to reduce
The occupancy of Internet resources and the time-consuming of entire data writing process, improve the overall performance of distributed memory system.
As shown in Figure 1, Fig. 1 is the device structure schematic diagram for the hardware running environment that the embodiment of the present invention is related to.
Distributed storage device of the embodiment of the present invention can be PC machine equipped with distributed memory system or server (such as
X86 server) etc. terminal devices.
As shown in Figure 1, the distributed storage device may include: processor 1001, such as CPU, network interface 1004 is used
Family interface 1003, memory 1005, communication bus 1002.Wherein, communication bus 1002 is for realizing the company between these components
Connect letter.User interface 1003 may include display screen (Display), input unit such as keyboard (Keyboard), can be selected
Family interface 1003 can also include standard wireline interface and wireless interface.Network interface 1004 optionally may include standard
Wireline interface, wireless interface (such as WI-FI interface).Memory 1005 can be high speed RAM memory, be also possible to stable deposit
Reservoir (non-volatile memory), such as magnetic disk storage.Memory 1005 optionally can also be independently of aforementioned place
Manage the storage device of device 1001.
It will be understood by those skilled in the art that device structure shown in Fig. 1 does not constitute the restriction to equipment, can wrap
It includes than illustrating more or fewer components, perhaps combines certain components or different component layouts.
As shown in Figure 1, as may include that operating system, network are logical in a kind of memory 1005 of computer storage medium
Believe module, Subscriber Interface Module SIM and distributed storage program.
In equipment shown in Fig. 1, network interface 1004 is mainly used for connecting background server, carries out with background server
Data communication；User interface 1003 is mainly used for connecting client (user terminal), carries out data communication with client；And processor
1001 can be used for calling the distributed storage program stored in memory 1005, and execute following operation:
When receiving the data write request of client transmission, data to be written are obtained and by the number to be written
According in the preset different copy memory nodes of write-in；
Judge whether that receiving the write operation that the different copy memory nodes return completes information；
When receiving the write operation completion information that all different copy memory nodes return, Xiang Suoshu client is returned
Successful information is written in data.
Further, processor 1001 can call the distributed storage program stored in memory 1005, also execute with
Lower operation:
When not receiving the write operation completion information that any copy memory node returns, generates and be written with the data
Request corresponding operation log；
The operation log is issued to preset arbitration node；
When receiving the operation log write-in completion information that the arbitration node returns, Xiang Suoshu client returned data
Successful information is written.
Further, processor 1001 can call the distributed storage program stored in memory 1005, also execute with
Lower operation:
When not receiving the write operation completion information that any copy memory node returns, acquisition does not return to write operation
The identification information of the copy memory node of information is completed, and obtains the metadata information and operation history of the data to be written
Record；
It is generated and the data according to the identification information, the metadata information of data to be written and operation historical record
The corresponding operation log of write request.
Further, processor 1001 can call the distributed storage program stored in memory 1005, also execute with
Lower operation:
Judge in scheduled duration whether to the arbitration node to issue operation day corresponding with the data write request
Will；
It, will if issuing operation log corresponding with the data write request to the arbitration node in scheduled duration
Successful information is written to the client returned data.
Further, processor 1001 can call the distributed storage program stored in memory 1005, also execute with
Lower operation:
If not issuing operation log corresponding with the data write request to the arbitration node in scheduled duration,
It executes and the operation log is issued to preset arbitration node, be written when receiving the operation log that the arbitration node returns
Complete information when, Xiang Suoshu client returned data be written successful information the step of.
The specific embodiment of distributed storage device of the present invention and following each embodiments of distributed storage method of the present invention
It is essentially identical, it is not repeated herein.
Based on above-mentioned hardware configuration, distributed storage method embodiment of the present invention is proposed.
It is the flow diagram of distributed storage method first embodiment of the present invention referring to Fig. 2, Fig. 2, which comprises
Step S10, when receiving the data write request of client transmission, obtain data to be written and will it is described to
In the preset different copy memory nodes of the data write-in of write-in；
The present embodiment distributed storage method is applied to distributed memory system, in distributed memory system, to guarantee
The highly reliable and High Availabitity of system, data generally store multiple copies in systems, and distributed memory system passes through replication protocol
Data are synchronized to multiple copy memory nodes, to ensure the data consistency between multiple copy memory nodes.When some is deposited
When storing up node appearance exception, service can be switched to other copies automatically by system, to realize automatic fault tolerant.
In the present embodiment, distributed memory system includes copy memory node and arbitration node, wherein arbitration node from
Body not storing data, and only when the data of multiple copy memory nodes storage are inconsistent, arbitration is initiated to determine correctly number
According to one or more arbitration nodes can be set in distributed memory system according to the difference of the quantity of copy memory node.
Firstly, obtaining number to be written when distributed memory system receives the data write request of client transmission
According to the data to be written are operation data caused by operation client application；Then, distributed memory system executes data
Operation is issued, to be stored in the preset different copy memory nodes of the data write-in being written into.
Step S20 judges whether that receiving the write operation that the different copy memory nodes return completes information；
After distributed memory system executes data distributing operation to copy memory node, each copy memory node is waited
Return information, and judge whether to receive the write operation that above-mentioned different copy memory nodes return and complete information.
When receiving the write operation completion information that all different copy memory nodes return, step S30 is executed, to institute
State client returned data write-in successful information.
When receiving the write operation completion information that all different copy memory nodes return, illustrate current all copies
Abnormal conditions are not present in memory node, at this point, successful information is written to client returned data in distributed memory system, show
This data is written successfully.
The present embodiment distributed memory system by different copy memory nodes be written data, if receive it is all not
Information is completed with the write operation that copy memory node returns, then does not issue data to arbitration node, but directly to client
Successful information is written in returned data, realizes under the premise of guarantee system is highly reliable and High Availabitity, reduce with arbitration node it
Between communication, thus reduce Internet resources occupancy and entire data writing process time-consuming, improve distributed storage system
The overall performance of system.
Further, it is based on distributed storage method first embodiment of the present invention, proposes distributed storage method of the present invention
Second embodiment.
It in the present embodiment, can also include: that ought not receive any copy memory node to return after above-mentioned steps S20
When information is completed in the write operation returned, operation log corresponding with the data write request is generated；It will be under the operation log
It is sent to preset arbitration node；When receiving the operation log write-in completion information that the arbitration node returns, to the visitor
Successful information is written in family end returned data.
Specifically, information is completed when distributed file system does not receive the write operation that any copy memory node returns
When, illustrate that there is currently copy memory node failure or the abnormal conditions such as offline, at this point, distributed file system generates and client
The operation log is simultaneously issued to preset arbitration node and saved by the corresponding operation log of the data write request at end；When connecing
When receiving the operation log write-in completion information of arbitration node return, distributed file system is written to client returned data
Function information.
Further, described when not receiving the write operation completion information that any copy memory node returns, it generates
The step of operation log corresponding with the data write request may include: that ought not receive any copy memory node to return
Write operation when completing information, obtain the identification information for not returning to the copy memory node that information is completed in write operation, and obtain
Take the metadata information and operation historical record of the data to be written；According to the identification information, data to be written
Metadata information and operation historical record generate operation log corresponding with the data write request.
Specifically, it is assumed that there are two copy memory nodes 1 and 2, if having received writing for the return of copy memory node 1
Enter the write operation that operation completes information and do not receive the return of copy memory node 2 and complete information, then obtains copy storage section
The identification information of point 2, and the metadata information and operation historical record of current data to be written, according to identification information, to
The metadata information and operation historical record of the data of write-in generate operation log corresponding with client data write request,
In, identification information can be number, title etc., and metadata information is for describing the data to be written, operation historical record
For recording the operation history to data.
In the present embodiment, it there are copy memory node exception, by generating operation log, realizes pair
The operation log is issued to arbitration node by the record of abnormal conditions, so that subsequent arbitration node can be according to the operation log
Judge the correctness of data, provides guarantee for the highly reliable and high availability of system.
Further, it is based on distributed storage method second embodiment of the present invention, proposes distributed storage method of the present invention
3rd embodiment.
In the present embodiment, it before the step of operation log is issued to preset arbitration node, can also wrap
It includes: judging in scheduled duration whether to the arbitration node to issue operation log corresponding with the data write request；If
Issued operation log corresponding with the data write request to the arbitration node in scheduled duration, then it will be to the client
Hold returned data that successful information is written.
Specifically, before operation log is issued to preset arbitration node by distributed memory system, it can be determined that pre-
Whether to arbitration node operation log corresponding with the data write request was issued in timing is long, if so, illustrating arbitration section
Point has been recorded with the operation log, no longer issues operation log to arbitration node at this time, but directly returns to number to client
According to write-in successful information.
In this way, the communication between arbitration node is further reduced, to reduce accounting for for Internet resources
With the time-consuming with entire data writing process, the overall performance of distributed memory system is further improved.
Conversely, if not issuing operation day corresponding with the data write request to the arbitration node in scheduled duration
Will then executes the operation log being issued to preset arbitration node, when the operation day for receiving the arbitration node return
Will write-in complete information when, Xiang Suoshu client returned data be written successful information the step of.Such subsequent arbitration node can be with
The correctness of data is judged according to the operation log, provides guarantee for the highly reliable and high availability of system.
The present invention also provides a kind of distributed storage devices.Referring to Fig. 3, Fig. 3 is that distributed storage devices one of the present invention are real
Apply the module diagram of example.In the present embodiment, the distributed storage devices include:
Writing module 10, for obtaining data to be written simultaneously when receiving the data write request of client transmission
It will be in the preset different copy memory nodes of data write-in to be written；
Judgment module 20, for judging whether that receiving the write operation that the different copy memory nodes return completes letter
Breath；
First return module 30, for completing information when the write operation for receiving all different copy memory nodes returns
When, successful information is written in Xiang Suoshu client returned data.
Further, the distributed storage devices further include:
Generation module, for generating when not receiving the write operation completion information that any copy memory node returns
Operation log corresponding with the data write request；
Module is issued, for the operation log to be issued to preset arbitration node；
Second return module, for when receiving the operation log write-in that the arbitration node returns and completing information, to
Successful information is written in the client returned data.
Further, the generation module is also used to:
When not receiving the write operation completion information that any copy memory node returns, acquisition does not return to write operation
The identification information of the copy memory node of information is completed, and obtains the metadata information and operation history of the data to be written
Record；
It is generated and the data according to the identification information, the metadata information of data to be written and operation historical record
The corresponding operation log of write request.
The method of above-mentioned each Implement of Function Module can refer to distributed storage method embodiment of the present invention, no longer superfluous herein
It states.
The present embodiment distributed memory system by different copy memory nodes be written data, if receive it is all not
Information is completed with the write operation that copy memory node returns, then does not issue data to arbitration node, but directly to client
Successful information is written in returned data, realizes under the premise of guarantee system is highly reliable and High Availabitity, reduce with arbitration node it
Between communication, thus reduce Internet resources occupancy and entire data writing process time-consuming, improve distributed storage system
The overall performance of system.
The present invention also provides a kind of computer readable storage mediums.
Distributed storage program is stored on computer readable storage medium of the present invention, the distributed storage program is located
The step of reason device realizes distributed storage method as described above when executing.
Wherein, the distributed storage program run on the processor, which is performed realized method, can refer to this hair
The bright each embodiment of distributed storage method, details are not described herein again.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the system that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or system institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or system.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in one as described above
In storage medium (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that terminal device (it can be mobile phone,
Computer, server, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of distributed storage method, which is characterized in that the distributed storage method includes the following steps:
When receiving the data write request of client transmission, obtains data to be written and write the data to be written
Enter in preset different copy memory nodes；
Judge whether that receiving the write operation that the different copy memory nodes return completes information；
When receiving the write operation completion information that all different copy memory nodes return, Xiang Suoshu client returned data
Successful information is written.
2. distributed storage method as described in claim 1, which is characterized in that described to judge whether to receive the different pairs
The write operation that this memory node returns was completed after the step of information, further includes:
When not receiving the write operation completion information that any copy memory node returns, generate and the data write request
Corresponding operation log；
The operation log is issued to preset arbitration node；
When receiving the operation log write-in completion information that the arbitration node returns, the write-in of Xiang Suoshu client returned data
Successful information.
3. distributed storage method as claimed in claim 2, which is characterized in that described not receive any copy storage section
Point return write operation complete information when, generate operation log corresponding with the data write request the step of include:
When not receiving the write operation completion information that any copy memory node returns, acquisition does not return to write operation completion
The identification information of the copy memory node of information, and obtain the metadata information and operation history note of the data to be written
Record；
It is generated according to the identification information, the metadata information of data to be written and operation historical record and is written with the data
Request corresponding operation log.
4. distributed storage method as claimed in claim 2 or claim 3, which is characterized in that described to be issued to the operation log
Before the step of preset arbitration node, further includes:
Judge in scheduled duration whether to the arbitration node to issue operation log corresponding with the data write request；
It, will be to institute if issuing operation log corresponding with the data write request to the arbitration node in scheduled duration
State client returned data write-in successful information.
5. distributed storage method as claimed in claim 4, which is characterized in that described whether to judge in scheduled duration to described
Arbitration node issued after the step of operation log corresponding with the data write request, further includes:
If not issuing operation log corresponding with the data write request to the arbitration node in scheduled duration, execute
The operation log is issued to preset arbitration node, is completed when receiving the operation log write-in that the arbitration node returns
When information, Xiang Suoshu client returned data be written successful information the step of.
6. a kind of distributed storage devices, which is characterized in that the distributed storage devices include:
Writing module, for when receiving the data write request of client transmission, obtaining data to be written and will be described
In the preset different copy memory nodes of data write-in to be written；
Judgment module, for judging whether that receiving the write operation that the different copy memory nodes return completes information；
First return module, for when receiving the write operation that all different copy memory nodes return and completing information, to
Successful information is written in the client returned data.
7. distributed storage devices as claimed in claim 6, which is characterized in that the distributed storage devices further include:
Generation module, for when not receiving the write operation that any copy memory node returns and completing information, generating and institute
State the corresponding operation log of data write request；
Module is issued, for the operation log to be issued to preset arbitration node；
Second return module, for when receiving the operation log write-in that the arbitration node returns and completing information, Xiang Suoshu
Successful information is written in client returned data.
8. distributed storage devices as claimed in claim 7, which is characterized in that the generation module is also used to:
When not receiving the write operation completion information that any copy memory node returns, acquisition does not return to write operation completion
The identification information of the copy memory node of information, and obtain the metadata information and operation history note of the data to be written
Record；
It is generated according to the identification information, the metadata information of data to be written and operation historical record and is written with the data
Request corresponding operation log.
9. a kind of distributed storage device, which is characterized in that the distributed storage device includes: memory, processor and deposits
The distributed storage program that can be run on the memory and on the processor is stored up, the distributed storage program is by institute
State the step of realizing the distributed storage method as described in any one of claims 1 to 5 when processor executes.
10. a kind of computer readable storage medium, which is characterized in that be stored with distribution on the computer readable storage medium
Program is stored, the distribution as described in any one of claims 1 to 5 is realized when the distributed storage program is executed by processor
The step of formula storage method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910291510.1A CN109992219A (en) | 2019-04-11 | 2019-04-11 | Distributed storage method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910291510.1A CN109992219A (en) | 2019-04-11 | 2019-04-11 | Distributed storage method, device, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109992219A true CN109992219A (en) | 2019-07-09 |
Family
ID=67133338
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910291510.1A Pending CN109992219A (en) | 2019-04-11 | 2019-04-11 | Distributed storage method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109992219A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110535969A (en) * | 2019-09-16 | 2019-12-03 | 腾讯科技（深圳）有限公司 | Date storage method, device, storage medium and equipment based on block chain network |
| CN112486942A (en) * | 2020-12-09 | 2021-03-12 | 北京金山云网络技术有限公司 | Multi-copy storage method and multi-copy storage system for file data |
| CN113360079A (en) * | 2020-03-05 | 2021-09-07 | 努比亚技术有限公司 | Disk data writing method, terminal and storage medium |
| CN114637475A (en) * | 2022-04-13 | 2022-06-17 | 苏州浪潮智能科技有限公司 | Distributed storage system control method and device and readable storage medium |
| CN115599316A (en) * | 2022-12-15 | 2023-01-13 | 南京鹏云网络科技有限公司（Cn） | Distributed data processing method, apparatus, device, medium, and computer program product |
| CN116561221A (en) * | 2023-04-21 | 2023-08-08 | 清华大学 | Distributed time sequence database copy consensus protocol method supporting Internet of things scene |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100131468A1 (en) * | 2008-11-25 | 2010-05-27 | International Business Machines Corporation | Arbitration Token for Managing Data Integrity and Data Accuracy of Information Services that Utilize Distributed Data Replicas |
| CN105577776A (en) * | 2015-12-17 | 2016-05-11 | 上海爱数信息技术股份有限公司 | Distributed storage system and method based on data arbiter copy |
| CN107403003A (en) * | 2017-07-21 | 2017-11-28 | 南京智网云联信息科技有限公司 | A kind of distributed copies file referee method |
| CN108572793A (en) * | 2017-10-18 | 2018-09-25 | 北京金山云网络技术有限公司 | Data are written and data reconstruction method, device, electronic equipment and storage medium |
-
2019
- 2019-04-11 CN CN201910291510.1A patent/CN109992219A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100131468A1 (en) * | 2008-11-25 | 2010-05-27 | International Business Machines Corporation | Arbitration Token for Managing Data Integrity and Data Accuracy of Information Services that Utilize Distributed Data Replicas |
| CN105577776A (en) * | 2015-12-17 | 2016-05-11 | 上海爱数信息技术股份有限公司 | Distributed storage system and method based on data arbiter copy |
| CN107403003A (en) * | 2017-07-21 | 2017-11-28 | 南京智网云联信息科技有限公司 | A kind of distributed copies file referee method |
| CN108572793A (en) * | 2017-10-18 | 2018-09-25 | 北京金山云网络技术有限公司 | Data are written and data reconstruction method, device, electronic equipment and storage medium |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110535969A (en) * | 2019-09-16 | 2019-12-03 | 腾讯科技（深圳）有限公司 | Date storage method, device, storage medium and equipment based on block chain network |
| CN113360079A (en) * | 2020-03-05 | 2021-09-07 | 努比亚技术有限公司 | Disk data writing method, terminal and storage medium |
| CN112486942A (en) * | 2020-12-09 | 2021-03-12 | 北京金山云网络技术有限公司 | Multi-copy storage method and multi-copy storage system for file data |
| CN114637475A (en) * | 2022-04-13 | 2022-06-17 | 苏州浪潮智能科技有限公司 | Distributed storage system control method and device and readable storage medium |
| CN114637475B (en) * | 2022-04-13 | 2024-06-25 | 苏州浪潮智能科技有限公司 | Distributed storage system control method and device and readable storage medium |
| CN115599316A (en) * | 2022-12-15 | 2023-01-13 | 南京鹏云网络科技有限公司（Cn） | Distributed data processing method, apparatus, device, medium, and computer program product |
| CN115599316B (en) * | 2022-12-15 | 2023-03-21 | 南京鹏云网络科技有限公司 | Distributed data processing method, apparatus, device, medium, and computer program product |
| CN116561221A (en) * | 2023-04-21 | 2023-08-08 | 清华大学 | Distributed time sequence database copy consensus protocol method supporting Internet of things scene |
| CN116561221B (en) * | 2023-04-21 | 2024-03-19 | 清华大学 | Method for supporting distributed time sequence database copy consensus protocol of Internet of things scene |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109992219A (en) | Distributed storage method, device, equipment and computer readable storage medium | |
| CN102426594B (en) | Method and system for operating database | |
| CN109558215A (en) | Backup method, restoration methods, device and the backup server cluster of virtual machine | |
| US7043504B1 (en) | System and method for parallel primary and secondary backup reading in recovery of multiple shared database data sets | |
| CN109660356A (en) | Data cochain method, apparatus, equipment and computer readable storage medium | |
| CN106528224A (en) | Content updating method and system for Docker container, and server | |
| CN102088490B (en) | Data storage method, device and system | |
| CN103870977A (en) | Method and system thereof for data synchronizing of mobile advertising platform | |
| CN103765423A (en) | Gathering transaction data associated with locally stored data files | |
| CN103780638A (en) | Data synchronization method and system | |
| CN110099084B (en) | Method, system and computer readable medium for ensuring storage service availability | |
| CN109977127A (en) | Data-updating method and device | |
| CN110287151A (en) | Distributed memory system, method for writing data, device and storage medium | |
| CN101594256A (en) | Disaster recovery method, device and system | |
| CN113438275B (en) | Data migration method and device, storage medium and data migration equipment | |
| CN104793981B (en) | A kind of online snapshot management method and device of cluster virtual machine | |
| CN107729515A (en) | Data synchronization method, device and storage medium | |
| WO2020238860A1 (en) | Distributed file batch processing method and apparatus, and readable storage medium | |
| CN102025758B (en) | Method, device and system for recovering data copy in distributed system | |
| CN110737504A (en) | deep learning model training fault-tolerant method, system, terminal and storage medium | |
| CN109886690A (en) | A kind of method that block chain synchronizes account book | |
| CN116955225A (en) | Data caching method, device, electronic equipment and readable medium | |
| CN110286852A (en) | Dual control framework distributed memory system, method for reading data, device and storage medium | |
| CN110119388A (en) | File read/write method, device, system, equipment and computer readable storage medium | |
| CN108924096A (en) | A kind of information synchronization method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190709 |