CN107888666B - Cross-region data storage system and data synchronization method and device - Google Patents

Cross-region data storage system and data synchronization method and device Download PDF

Info

Publication number
CN107888666B
CN107888666B CN201711023750.0A CN201711023750A CN107888666B CN 107888666 B CN107888666 B CN 107888666B CN 201711023750 A CN201711023750 A CN 201711023750A CN 107888666 B CN107888666 B CN 107888666B
Authority
CN
China
Prior art keywords
data
redis
updated
service
layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711023750.0A
Other languages
Chinese (zh)
Other versions
CN107888666A (en
Inventor
牟盖东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201711023750.0A priority Critical patent/CN107888666B/en
Publication of CN107888666A publication Critical patent/CN107888666A/en
Application granted granted Critical
Publication of CN107888666B publication Critical patent/CN107888666B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the invention provides a cross-region data storage system, a data synchronization method and a data synchronization device, wherein the storage system comprises a data storage layer and a service agent layer, wherein: the data storage layer comprises a plurality of rediss in a cluster mode, and the rediss are respectively arranged in different regions; the service agent layer comprises a plurality of data distribution agents which are respectively matched with the redis, and the data distribution agents are used for returning data according to the data request of the service layer and respectively distributing the data to be updated of the service layer to the redis corresponding to the service layer and other redis. Compared with the prior art that data storage and bidirectional synchronization are carried out by using the corechbase, the real-time bidirectional synchronization service can be more stable when cross-region storage is carried out due to the stronger stability of the redis, so that the problem of request timeout of a service layer is avoided, and the cluster service system can provide more stable service for users.

Description

Cross-region data storage system and data synchronization method and device
Technical Field
The invention relates to the technical field of databases, in particular to a cross-region data storage system and a data synchronization method and device.
Background
A cluster service system is a parallel system or a distributed system of interconnected computers. These computers work together and run a common set of applications, while providing a single system map for both the user and the applications. From the external view, they are just one system, and provide uniform service to the outside. Computers within a cluster service system are physically connected by cables and programmatically connected by cluster software, and these connections allow computers to use fail-safe and load balancing functions that are not possible on a stand-alone basis, thus providing more consistent services to users.
At present, in a cluster service system, a memory database for storing TB-level data generally selects a touchbase, but the efficiency is poor when data is bidirectionally synchronized in the touchbase, so that a large number of requests of a service layer are overtime when data of multiple rooms are bidirectionally synchronized, thereby reducing the working efficiency of the cluster service system.
Disclosure of Invention
In view of this, the present invention provides a cross-region data storage system, a data synchronization method and an apparatus, so as to solve the problem of request timeout of a service layer.
In order to solve the above problems, the present invention discloses a cross-region data storage system, which comprises a data storage layer and a service agent layer, wherein:
the data storage layer comprises a plurality of rediss in a cluster mode, and the rediss are respectively arranged in different regions;
the service agent layer comprises a plurality of data distribution agents respectively corresponding to the redis, and the data distribution agents are used for returning data according to the data request of the service layer and respectively distributing the data to be updated sent by the service layer to the redis corresponding to the service layer and other redis.
Optionally, the data distribution agent is a cerberus agent.
Optionally, the redis is configured to receive the data to be updated in a synchronous manner.
Optionally, the data distribution agent is configured to distribute data to corresponding redis and other redis using the kafka message queue.
In addition, the present invention also provides a data synchronization method, which is applied to the data distribution agent of the cross-region data storage system, and the data synchronization method comprises:
responding to a data request of a service layer, acquiring data from a corresponding redis, and returning the acquired data to the service layer;
responding to a data updating request of a service layer, and distributing data to be updated to corresponding redis and other redis co-located in the same data storage layer.
Optionally, the distributing the data to be updated to the corresponding redis and other rediss co-located in the same data storage layer includes:
and distributing the data to be updated to a redis by utilizing a kafka message queue, wherein the redis is used for receiving the data to be updated in a synchronous mode.
In response, in order to ensure the implementation of the method, the present invention further provides a data synchronization apparatus applied to the data distribution agent of the cross-region data storage system, where the data synchronization apparatus includes:
the first response module is used for responding to a data request of a service layer, acquiring data from the corresponding redis and returning the acquired data to the service layer;
and the second response module is used for responding to the data updating request of the service layer and distributing the data to be updated to the corresponding redis and other redis which are co-located in the same data storage layer.
Optionally, the second response module includes:
the first distribution unit is used for sending the data to be updated to the corresponding redis;
and the second distribution unit is used for distributing the data to be updated to other rediss by using the kafka message queue, and the other rediss are used for receiving the data to be updated by using a synchronous mode.
It can be seen from the above technical solutions that the present invention provides a cross-region data storage system, a data synchronization method and an apparatus, where the storage system includes a data storage layer and a service agent layer, where: the data storage layer comprises a plurality of rediss in a cluster mode, and the rediss are respectively arranged in different regions; the service agent layer comprises a plurality of data distribution agents which are respectively matched with the redis, and the data distribution agents are used for returning data according to the data request of the service layer and respectively distributing the data to be updated of the service layer to the redis corresponding to the service layer and other redis. Compared with the prior art that data storage and bidirectional synchronization are carried out by using the corechbase, the real-time bidirectional synchronization service can be more stable when cross-region storage is carried out due to the stronger stability of the redis, so that the problem of request timeout of a service layer is avoided, and the cluster service system can provide more stable service for users.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a block diagram of a cross-region data storage system according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating steps of a data synchronization method according to an embodiment of the present invention;
fig. 3 is a block diagram of an embodiment of a data synchronization apparatus according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
Fig. 1 is a block diagram of a cross-region data storage system according to an embodiment of the present invention.
Referring to fig. 1, the cross-regional data storage system provided in this embodiment may be applied to an advertisement delivery system, and specifically is used for recording a user frequency of the advertisement delivery system, and specifically includes a data storage layer 100 and a service broker layer 200.
The data storage layer comprises a plurality of rediss 101, each disposed in a different geographic region. redis is a high-performance key-value storage system, and like Memcached, it supports relatively more stored value types, including string, list, set, zset, and hash. These data types all support push/pop, add/remove, and intersect union and difference, and richer operations, and these operations are all atomic. On this basis, redis supports various different ways of ordering.
Like memcached, data of redis is cached in the memory in order to ensure efficiency. The difference is that the redis can periodically write updated data into a disk or write modification operation into an additional recording file, and master-slave synchronization is realized on the basis of the update. The occurrence of redis greatly compensates the shortage of key/value storage such as memcached, and can play a good role in supplementing the relational database in some occasions. It provides Java, C/C + +, C #, PHP, JavaScript, Perl, Object-C, Python, Ruby, Erlang and other business layers, and is convenient to use.
Redis supports master-slave synchronization, where data may be synchronized from a master server to any number of slave servers, which may be master servers associated with other slave servers. This allows redis to perform single-level tree replication, and the disk storage can write data intentionally or unintentionally. Since the redis fully implements a publish/subscribe mechanism, when the slave database synchronizes the tree anywhere, it can subscribe to one channel and receive the complete message publishing record of the master server. Synchronization is helpful for scalability of read operations and data redundancy.
Due to the characteristics of small redis and stable operation, the users of the advertisement delivery system can be safely recorded frequently. Since redis cannot store large amounts of data, each node does not exceed 30G of data. When a large amount of data needs to be stored, a single redis node can be used as one data slice, and the requirement for storing the TB byte can be easily met by means of arranging a plurality of data slices.
The service agent layer comprises a plurality of data distribution agents 201, each corresponding to a respective redis, which are preferably cerberus agents. The cerberus is FTP server software, and the characteristics of simplicity and easiness in use are kept while professional-level safe SSL/TLS encryption standards and strong FTP server performance are provided for users.
The cerberus occupies a small amount of CPU and memory, has a friendly user interface and can be quickly accessed through a system tray icon. The method comprises the following steps that the cerberus supports a multi-network card environment, also supports integration with system user accounts and active directories, supports continuous transmission, user authority control, connection number limitation, overtime setting, automatic IP address blocking, blacklist and other functions, and supports installation as system service to provide service without logging in a system; the system also provides a real-time monitoring function, and can check the operation state of the user in real time or disconnect and prevent the user; providing traffic statistics. The cerberus also provides a function of automatically acquiring a public network IP address, facilitates an intranet user to issue a server, is internally provided with a Web remote management interface, and supports checking and managing server connection.
In the invention, each data distribution agent in the service agent layer is used for providing read-write service for the service layer providing service for users. Specifically, when a service layer needs data support, the required data is returned to the service layer according to the data request of the service layer; when the service layer needs to store data to the redis, the data distribution agent sends the data to be updated provided by the service layer to the redis corresponding to the service layer, and simultaneously distributes the data to be updated to other redis of a data storage layer at the same position as the redis corresponding to the service layer. When any redis receives data to be updated distributed by the corresponding data distribution agent or other data distribution agents, the data to be updated is received through a corresponding data synchronization method, and the data to be updated is stored or old data is updated.
In addition, when the cerberus agent serving as the data distribution agent distributes data to the redis, in order to avoid data loss, the application does not adopt a replica protocol carried by the redis itself, but adopts a kafka message queue to perform data synchronization, namely, the kafka message queue is used for distributing the data to the corresponding redis.
kafka is a distributed publish-subscribe messaging system with high data throughput speed that can handle all the flow data of actions in a consumer-scale web site, including the flow data that a user generates when performing web browsing, searching, etc. This flow data is a key factor for many social functions on modern networks. These data are typically addressed by handling logs and log aggregations due to throughput requirements. Due to the high data throughput speed of kafka, data can be transmitted quickly and effectively, and data loss can be avoided when data distribution is carried out.
As can be seen from the foregoing technical solutions, the present embodiment provides a cross-region data storage system, including a data storage layer and a service agent layer, wherein: the data storage layer comprises a plurality of rediss in a cluster mode, and the rediss are respectively arranged in different regions; the service agent layer comprises a plurality of data distribution agents which are respectively matched with the redis, and the data distribution agents are used for returning data according to the data request of the service layer and respectively distributing the data to be updated of the service layer to the redis corresponding to the service layer and other redis. Compared with the prior art that data storage and bidirectional synchronization are carried out by using the corechbase, the real-time bidirectional synchronization service can be more stable when cross-region storage is carried out due to the stronger stability of the redis, so that the problem of request timeout of a service layer is avoided, and the cluster service system can provide more stable service for users.
Example two
Fig. 2 is a flowchart illustrating steps of a data synchronization method according to an embodiment of the present invention.
Referring to fig. 2, the data synchronization method provided in this embodiment is applied to the cross-region data storage system provided in the previous embodiment, and in particular, is applied to a data distribution agent of the system, and includes the following steps:
s101: and acquiring data from the redis according to the data request of the service layer.
When the service layer needs to acquire data and send a data request, acquiring data corresponding to the request from the corresponding redis according to the data request, and returning the data to the service layer.
S102: and distributing the data to be updated to the redis according to the data updating request of the service layer.
When a service layer needs to store generated data or update old data, the data to be stored or updated is sent to a redis, wherein the distribution to the redis comprises that a certain data distribution agent sends data to a corresponding redis; meanwhile, the data transceiving agent also sends the data to other redis which are in a data storage layer together with the corresponding redis through the kafka message queue.
The data distribution agent of the cross-region data storage system acquires data from the corresponding redis by responding to the data request of the service layer and returns the acquired data to the service layer; responding to a data updating request of a service layer, and distributing data to be updated to corresponding redis and other redis co-located in the same data storage layer. Due to the fact that the redis has strong stability, stable real-time bidirectional synchronous service can be provided when cross-region storage is conducted, therefore, the server cluster provides stable service for users, the problem of overtime of requests of a service layer cannot occur, and the problem of overtime of the requests of the service layer is solved.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
EXAMPLE III
Fig. 3 is a block diagram of an embodiment of a data synchronization apparatus according to the present invention.
Referring to fig. 3, the data synchronization apparatus provided in this embodiment is applied to the cross-region data storage system provided in the first embodiment, and in particular, to the data distribution agent of the system, and includes a first response module 10 and a second response module 20.
The first response module is used for acquiring data from the redis according to the data request of the service layer.
When the service layer needs to acquire data and send a data request, the module is used for acquiring data corresponding to the request from the corresponding redis according to the data request and returning the data to the service layer.
And the second response module is used for distributing the data to be updated to the redis according to the data updating request of the service layer.
When the service layer needs to store the generated data or update the old data, the second response module sends the data to be stored or updated to the redis, and the module includes the first distribution unit 21 and the second distribution unit 22. The first distribution unit is used for sending data to a redis corresponding to the data distribution agent; the second distribution unit is used for sending the data to other redis which are in a data storage layer and corresponding to the data distribution agent through the kafka message queue.
The data distribution agent of the cross-region data storage system acquires data from the corresponding redis by responding to the data request of the service layer and returns the acquired data to the service layer; responding to a data updating request of a service layer, and distributing data to be updated to corresponding redis and other redis co-located in the same data storage layer. Due to the strong stability of the redis, stable real-time bidirectional synchronous service can be provided when cross-region storage is carried out, so that the problem of request timeout of a service layer is avoided, and the cluster service system can provide stable service for users.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The technical solutions provided by the present invention are described in detail above, and the principle and the implementation of the present invention are explained in this document by applying specific examples, and the descriptions of the above examples are only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (7)

1. A cross-regional data storage system comprising a data storage layer and a service broker layer, wherein:
the data storage layer comprises a plurality of redis, and the plurality of redis are respectively arranged in different regions;
the service agent layer comprises a plurality of data distribution agents respectively corresponding to the redis, and the data distribution agents are used for returning data acquired from the corresponding redis according to the data request of the service layer and respectively distributing the data to be updated sent by the service layer to the redis corresponding to the service layer and other redis;
when any of the redis receives data to be updated distributed by the corresponding data distribution agent or other data distribution agents, the redis is used for storing the data to be updated or updating old data;
the data distribution agent is used for sending data to the corresponding redis and distributing the data to other redis of one data storage layer where the corresponding redis is located by using the kafka message queue.
2. The cross-domain data storage system of claim 1, wherein the data distribution agent is a cerberus agent.
3. The cross-regional data storage system of claim 1, wherein the redis to receive the data to be updated by a data synchronization method.
4. A data synchronization method applied to the data distribution agent of the cross-regional data storage system according to any one of claims 1 to 3, wherein the data synchronization method comprises:
responding to a data request of a service layer, acquiring data from a corresponding redis, and returning the acquired data to the service layer;
responding to a data updating request of a service layer, and distributing data to be updated to a corresponding redis and other rediss which are located in the same data storage layer, wherein any one of the rediss is used for storing the data to be updated or updating old data when receiving the data to be updated distributed by a data distribution agent corresponding to the redis or other data distribution agents;
the data distribution agent is used for sending data to the corresponding redis and distributing the data to other redis of one data storage layer where the corresponding redis is located by using the kafka message queue.
5. The data synchronization method of claim 4, wherein the distributing the data to be updated to the corresponding redis and other rediss co-located in the same data storage tier comprises:
and distributing the data to be updated to a redis by utilizing a kafka message queue, wherein the redis is used for receiving the data to be updated in a synchronous mode.
6. A data synchronization device applied to the data distribution agent of the cross-regional data storage system according to any one of claims 1 to 3, wherein the data synchronization device comprises:
the first response module is used for responding to a data request of a service layer, acquiring data from the corresponding redis and returning the acquired data to the service layer;
the second response module is used for responding to a data updating request of a service layer and distributing data to be updated to a corresponding redis and other rediss which are located in the same data storage layer, wherein any one of the rediss is used for storing the data to be updated or updating old data when receiving the data to be updated distributed by a data distribution agent corresponding to the redis or other data distribution agents;
the data distribution agent is used for sending data to the corresponding redis and distributing the data to other redis of one data storage layer where the corresponding redis is located by using the kafka message queue.
7. The data synchronization apparatus of claim 6, wherein the second response module comprises:
the first distribution unit is used for sending the data to be updated to the corresponding redis;
and the second distribution unit is used for distributing the data to be updated to other rediss by using the kafka message queue, and the other rediss are used for receiving the data to be updated by using a synchronous mode.
CN201711023750.0A 2017-10-27 2017-10-27 Cross-region data storage system and data synchronization method and device Active CN107888666B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711023750.0A CN107888666B (en) 2017-10-27 2017-10-27 Cross-region data storage system and data synchronization method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711023750.0A CN107888666B (en) 2017-10-27 2017-10-27 Cross-region data storage system and data synchronization method and device

Publications (2)

Publication Number Publication Date
CN107888666A CN107888666A (en) 2018-04-06
CN107888666B true CN107888666B (en) 2021-02-12

Family

ID=61782790

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711023750.0A Active CN107888666B (en) 2017-10-27 2017-10-27 Cross-region data storage system and data synchronization method and device

Country Status (1)

Country Link
CN (1) CN107888666B (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108833479B (en) * 2018-05-18 2021-02-09 吉林亿联银行股份有限公司 Data synchronization method and device
CN108898448A (en) * 2018-07-25 2018-11-27 北京木瓜移动科技股份有限公司 A kind of ad data synchronous method and device
CN109521971A (en) * 2018-11-26 2019-03-26 广东小天才科技有限公司 It is a kind of based on reading and writing data separation method and system across computer room
CN111435942B (en) * 2019-01-14 2023-04-18 北京京东尚科信息技术有限公司 Redis cluster access method, system, middleware, medium and device
CN109618005B (en) * 2019-01-18 2020-12-08 华为终端有限公司 Method for calling server and proxy server
US10901819B1 (en) * 2019-08-11 2021-01-26 Paypal, Inc. Distributed queueing over a Redis cluster
CN111049898A (en) * 2019-12-10 2020-04-21 杭州东方通信软件技术有限公司 Method and system for realizing cross-domain architecture of computing cluster resources
CN111367997B (en) * 2020-02-26 2021-06-18 杭州云缔盟科技有限公司 Method for realizing cross-region data synchronization
CN111740872A (en) * 2020-05-06 2020-10-02 北京百度网讯科技有限公司 Message passing test method and device, electronic equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102158540A (en) * 2011-02-18 2011-08-17 广州从兴电子开发有限公司 System and method for realizing distributed database
CN104202375B (en) * 2014-08-22 2017-10-24 广州华多网络科技有限公司 The method and system of synchrodata
CN106095977A (en) * 2016-06-20 2016-11-09 环球大数据科技有限公司 The distributed approach of a kind of data base and system
CN106303428B (en) * 2016-08-18 2019-06-28 杭州蛮牛科技有限公司 A kind of security protection cloud platform
CN107220375B (en) * 2017-06-20 2020-02-11 北京星选科技有限公司 Data reading and writing method and server

Also Published As

Publication number Publication date
CN107888666A (en) 2018-04-06

Similar Documents

Publication Publication Date Title
CN107888666B (en) Cross-region data storage system and data synchronization method and device
CN107566533B (en) Internal and external network file sharing system based on NAS (network attached storage)
JP2019032903A (en) Systems, methods and computer-readable storage media for customizable event-triggered computation at edge locations
CN102333029B (en) Routing method in server cluster system
CN105025053A (en) Distributed file upload method based on cloud storage technology and system
JP2017037666A (en) Sending category information
CN103631820B (en) The metadata management method and equipment of distributed file system
CN102779185A (en) High-availability distribution type full-text index method
CN103581245A (en) Content delivery method and system of content delivery network
US10579597B1 (en) Data-tiering service with multiple cold tier quality of service levels
CN110019104B (en) File resource exchange method, file resource server and file exchange system
TW201405324A (en) Cloud storage system and data storage and sharing method based on the system
CN103067488A (en) Implement method of unified storage
CN103731507A (en) Data processing method and device of distributed data storage device
WO2019231645A1 (en) Change notifications for object storage
CN109391487A (en) A kind of configuration update method and system
CN108205468A (en) A kind of distributed system and implementation method towards massive video image
CN111225003B (en) NFS node configuration method and device
CN103595960A (en) Interesting information monitoring and pushing method and device
CN109873855A (en) A kind of resource acquiring method and system based on block chain network
US20140181258A1 (en) Communicating large amounts of data over a network with improved efficiency
CN112910796B (en) Traffic management method, apparatus, device, storage medium, and program product
CN111835570B (en) Global state persistence decentralized blockchain network node device and working method
CN111294231B (en) Resource management method and system
US11157454B2 (en) Event-based synchronization in a file sharing environment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant