CN112804313A - Data synchronization method, device, equipment and medium based on cross-domain edge node - Google Patents
Data synchronization method, device, equipment and medium based on cross-domain edge node Download PDFInfo
- Publication number
- CN112804313A CN112804313A CN202011642170.1A CN202011642170A CN112804313A CN 112804313 A CN112804313 A CN 112804313A CN 202011642170 A CN202011642170 A CN 202011642170A CN 112804313 A CN112804313 A CN 112804313A
- Authority
- CN
- China
- Prior art keywords
- data
- hot spot
- edge node
- spot data
- synchronization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a data synchronization method, a device, equipment and a medium based on cross-domain edge nodes, wherein the method comprises the following steps: determining a hot spot data tag set to be synchronized according to the existing hot spot data of the target edge node and the global hot spot data of each edge node; acquiring a required hot spot data label according to the login condition of a target user at each edge node, and instantly synchronizing required hot spot data corresponding to the required hot spot data label from the edge node; and determining a periodic synchronization hot spot data tag according to the hot spot data tag set to be synchronized and the required hot spot data tag, and acquiring periodic synchronization hot spot data corresponding to the periodic synchronization hot spot data tag from the edge node according to a preset time period. The method can reduce the data volume of the data information needing to be synchronized, save bandwidth resources and storage resources and improve the data synchronization efficiency; in addition, the target user can utilize the required hotspot data to perform business operation in time, and the use experience of the user is improved.
Description
Technical Field
The present invention relates to the field of data synchronization, and in particular, to a method, an apparatus, a device, and a computer-readable storage medium for data synchronization based on cross-domain edge nodes.
Background
With the rapid development of communication technology and edge computing technology, one or more edge nodes need to be deployed in a single edge region, data information in each edge node in the same edge region is the same, the edge nodes in different edge regions are isolated from each other and connected with each other, and a unified complete function is guaranteed to be provided to the outside through mutual cooperation; therefore, it is important to ensure data consistency between edge nodes in different regions.
In order to solve the problem of data synchronization between cross-domain edge nodes, there are two main types of synchronization schemes at present: full data synchronization and incremental data synchronization; the full data synchronization has the advantages that the processing logic is simple, the data consistency of two synchronous parties can be effectively ensured, but the full data synchronization is not suitable for the synchronization of a large amount of data; the incremental data synchronization mode is to synchronize all incremental data in a preset time period, so that the defect of full data synchronization can be effectively overcome, but for some services which generate a large amount of data information in a short time, such as a large-scale game, even if incremental data synchronization is performed, long time needs to be consumed, transmission delay is large, and the service operation of a user is influenced due to untimely data synchronization, so that the use experience of the user is reduced.
Therefore, how to improve the efficiency of data synchronization between edge nodes and improve the user experience is a technical problem that needs to be solved by those skilled in the art.
Disclosure of Invention
In view of this, the present invention provides a data synchronization method based on cross-domain edge nodes, which can improve the efficiency of data synchronization between edge nodes and improve the user experience; another object of the present invention is to provide a data synchronization device, a data synchronization apparatus and a computer-readable storage medium based on cross-domain edge nodes, all of which have the above advantages.
In order to solve the above technical problem, the present invention provides a data synchronization method based on cross-domain edge nodes, which is applied to a target edge node, and comprises:
determining a hot spot data tag set to be synchronized according to the existing hot spot data of the target edge node and the global hot spot data of each edge node;
acquiring a required hot spot data label according to the login condition of a target user at each edge node, and instantly synchronizing required hot spot data corresponding to the required hot spot data label from the edge node;
and determining a periodic synchronization hot spot data tag according to the hot spot data tag set to be synchronized and the required hot spot data tag, and acquiring periodic synchronization hot spot data corresponding to the periodic synchronization hot spot data tag from the edge node according to a preset time period.
Preferably, the process of acquiring the required hotspot data tags according to the login conditions of the target user at each edge node and immediately synchronizing the required hotspot data corresponding to the required hotspot data tags from the edge nodes specifically includes:
setting the edge node with the latest user data updating time as a first edge node according to the login condition of the target user in each edge node;
acquiring user basic data of the target user from the first edge node in real time; the user basic data comprises user directory data and the required hotspot data label;
and determining a second edge node according to the hot spot data label set to be synchronized, and instantly acquiring the required hot spot data corresponding to the required hot spot data label from the second edge node.
Preferably, when the required hotspot data is set with a priority, the process of determining a second edge node according to the hotspot data tag set to be synchronized, and acquiring the required hotspot data corresponding to the required hotspot data tag in real time from the second edge node specifically includes:
determining the second edge node according to the hot spot data tag set needing to be synchronized;
respectively setting corresponding data synchronization requests according to the required hotspot data tags;
and sequentially placing the data synchronization requests in a synchronization queue according to the sequence of the priorities of the required hotspot data corresponding to the required hotspot data labels from high to low, executing the data synchronization requests, and instantly acquiring the required hotspot data corresponding to the data synchronization requests from the second edge node.
Preferably, further comprising:
and reconstructing data by using the user directory data, the required hotspot data and the periodic synchronous hotspot data.
Preferably, the process of determining a second edge node according to the hot spot data tag set to be synchronized and obtaining the required hot spot data corresponding to the required hot spot data tag in real time from the second edge node specifically includes:
and when a plurality of candidate edge nodes containing all elements of the hotspot data tag set needing to be synchronized exist, determining the second edge node from the candidate edge nodes according to the geographic position and/or the synchronization cost.
Preferably, the process of determining a second edge node according to the hot spot data tag set to be synchronized and obtaining the required hot spot data corresponding to the required hot spot data tag in real time from the second edge node specifically includes:
when the candidate edge nodes containing all elements of the hot spot data tag set to be synchronized do not exist, splitting the hot spot data tag set to be synchronized into a plurality of subsets, and setting the edge nodes corresponding to all elements in the subsets as the second edge nodes respectively.
Preferably, further comprising:
determining a hot spot data table, a domain hot spot data table and a domain user table in advance according to a setting rule of hot spot data;
correspondingly, the process of determining the hot spot data tag set to be synchronized according to the existing hot spot data of the target edge node and the global hot spot data of each edge node specifically includes:
determining the hot spot data tag set to be synchronized according to the existing hot spot data tag set of the target edge node in the domain hot spot data table and the global hot spot data tag set of each edge node in the hot spot data table;
correspondingly, the process of acquiring the required hotspot data labels according to the login conditions of the target users at each edge node and immediately synchronizing the required hotspot data corresponding to the required hotspot data labels from the edge nodes specifically comprises the following steps:
determining the login condition of the target user at each edge node according to the domain user table, and acquiring the required hotspot data label;
and determining an edge node serving as a data synchronization object according to the hot spot data tag set to be synchronized and the domain hot spot data table, and immediately synchronizing the required hot spot data corresponding to the required hot spot data tag from the edge node serving as the data synchronization object.
In order to solve the above technical problem, the present invention further provides a data synchronization apparatus based on a cross-domain edge node, which is applied to a target edge node, and includes:
the determining module is used for determining a hot spot data tag set to be synchronized according to the existing hot spot data of the target edge node and the global hot spot data of each edge node;
the first synchronization module is used for acquiring the required hotspot data labels according to the login conditions of the target users at each edge node and instantly synchronizing the required hotspot data corresponding to the required hotspot data labels from the edge nodes;
and the second synchronization module is used for determining a periodic synchronization hot spot data tag according to the hot spot data tag set to be synchronized and the required hot spot data tag, and acquiring periodic synchronization hot spot data corresponding to the periodic synchronization hot spot data tag from the edge node according to a preset time period.
In order to solve the above technical problem, the present invention further provides a data synchronization device based on a cross-domain edge node, including:
a memory for storing a computer program;
a processor for implementing the steps of any of the above-mentioned data synchronization methods based on cross-domain edge nodes when executing the computer program.
To solve the above technical problem, the present invention further provides a computer-readable storage medium, having a computer program stored thereon, where the computer program is executed by a processor to implement any of the above steps of the data synchronization method based on cross-domain edge nodes.
According to the data synchronization method based on the cross-domain edge nodes, when data synchronization is carried out based on the cross-domain edge nodes, a hot data label set needing to be synchronized is determined according to existing hot data of a target edge node and global hot data of each edge node, only data information corresponding to the hot data label set needing to be synchronized needs to be synchronized, and compared with a method for synchronizing all incremental data in a preset time period in the prior art, the method can reduce the data volume of the data information needing to be synchronized, save bandwidth resources and storage resources, and improve the data synchronization efficiency; in addition, in the method, the required hot spot data is synchronized instantly, and the periodic synchronization hot spot data is synchronized periodically, so that the target user can utilize the required hot spot data to perform service operation in time, and the use experience of the user is improved.
In order to solve the technical problem, the invention also provides a data synchronization device, equipment and a computer readable storage medium based on the cross-domain edge node, which have the beneficial effects.
Drawings
In order to more clearly illustrate the embodiments or technical solutions of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a data synchronization method based on cross-domain edge nodes according to an embodiment of the present invention;
fig. 2 is a system architecture diagram of a data synchronization method based on cross-domain edge nodes according to an embodiment of the present invention;
fig. 3 is a schematic process diagram of determining a first edge node and a second edge node in a data synchronization method based on cross-domain edge nodes according to an embodiment of the present invention;
fig. 4 is a schematic process diagram of a data synchronization method based on cross-domain edge nodes according to an embodiment of the present invention;
fig. 5 is a structural diagram of a data synchronization apparatus based on a cross-domain edge node according to an embodiment of the present invention;
fig. 6 is a structural diagram of a data synchronization device based on a cross-domain edge node according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The core of the embodiment of the invention is to provide a data synchronization method based on cross-domain edge nodes, which can improve the efficiency of data synchronization between the edge nodes and improve the use experience of users; another core of the present invention is to provide a data synchronization apparatus, a device and a computer-readable storage medium based on cross-domain edge nodes, all having the above beneficial effects.
In order that those skilled in the art will better understand the disclosure, the invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
Fig. 1 is a flowchart of a data synchronization method based on cross-domain edge nodes according to an embodiment of the present invention. As shown in fig. 1, a data synchronization method based on cross-domain edge nodes is applied to a target edge node, and includes:
s10: and determining a hot spot data tag set needing to be synchronized according to the existing hot spot data of the target edge node and the global hot spot data of each edge node.
It should be noted that the target edge node in the embodiment of the present invention refers to an edge node that a target user currently logs in and needs to perform data synchronization, and the data synchronization refers to synchronizing hotspot data in edge nodes in different areas from the target edge node to the target edge node.
When a target user logs in on a target edge node, firstly, a hot spot data tag set needing to be synchronized is determined according to existing hot spot data of the target edge node and global hot spot data of each edge node. The existing hot spot data of the target edge node refers to hot spot data existing on the target edge node, and the global hot spot data refers to hot spot data determined according to a preset hot spot data screening rule; for example, a specific hot spot data screening rule is to set data, whose access times exceed a preset threshold value in a preset time period, as global hot spot data, or set data, whose access times are a preset percentage before ranking, as global hot spot data after obtaining all data of all edge nodes.
It can be understood that, in actual operation, if the existing hotspot data of the target edge node is equal to the global hotspot data of each edge node, it indicates that all hotspot data are stored on the target edge node, that is, there is no hotspot data to be synchronized, and therefore, synchronization operation of the hotspot data is not required. And if the existing hot spot data of the target edge node is not equal to the global hot spot data of each edge node, determining a hot spot data tag to be synchronized according to the global hot spot data of each edge node and the existing hot spot data of the target edge node, and further determining a hot spot data tag set to be synchronized. It should be noted that the tag is used to uniquely identify each different hot spot data, so that the corresponding hot spot data can be obtained according to the hot spot data tag to be synchronized in the following. In addition, the hot spot data tag set to be synchronized may include one or more hot spot data tags to be synchronized, which is not limited in this embodiment.
S20: and acquiring the required hot spot data labels according to the login condition of the target user at each edge node, and immediately synchronizing the required hot spot data corresponding to the required hot spot data labels from the edge nodes.
It should be noted that the required hotspot data tag refers to a data information tag that is required when the target user logs in at the target edge node and performs subsequent service operations. The number of the required hotspot data tags may be one or more, which is not limited in this embodiment. Generally, the required hotspot data tags are obtained according to the login conditions of the target user at each edge node, and specifically, the required hotspot data tags can be obtained from the edge nodes with the latest user data update time, that is, the required hotspot data tags are obtained from the edge nodes of the last login operation of the target user.
After the required hotspot data tag is acquired, the target edge node sets a hotspot data synchronization request packet according to the required hotspot data tag, sends the hotspot data synchronization request packet to the designated edge node, extracts required hotspot data corresponding to the required hotspot data tag after the designated edge node receives the hotspot data synchronization request packet, packs and compresses the extracted required hotspot data, and finally pushes the extracted required hotspot data to the target edge node, so that the target edge node can immediately synchronize the required hotspot data corresponding to the required hotspot data tag.
S30: and determining a periodic synchronization hot spot data tag according to the hot spot data tag set to be synchronized and the required hot spot data tag, and acquiring periodic synchronization hot spot data corresponding to the periodic synchronization hot spot data tag from the edge node according to a preset time period.
Specifically, the hot spot data tag set to be synchronized refers to all tags of data to be synchronized, the required hot spot data tag refers to a tag of data to be synchronized in an instant synchronization manner, and the periodic synchronization hot spot data tag refers to a tag of data to be synchronized in a periodic synchronization manner. In the step, firstly, a periodic synchronization hot spot data tag is determined according to a hot spot data tag set needing to be synchronized and a difference set of the hot spot data tags needing to be synchronized; by setting the preset time period, the cycle synchronization hotspot data corresponding to the cycle synchronization hotspot data label are acquired from the edge node according to the preset time period, so that data synchronization is realized.
Compared with the prior art that all incremental data in a preset time period need to be synchronized, the method for synchronizing the data based on the cross-domain edge nodes can reduce the data volume of the data information needing to be synchronized, save bandwidth resources and storage resources, and improve the data synchronization efficiency; in addition, in the method, the required hot spot data is synchronized instantly, and the periodic synchronization hot spot data is synchronized periodically, so that the target user can utilize the required hot spot data to perform service operation in time, and the use experience of the user is improved.
On the basis of the above embodiments, the present embodiment further describes and optimizes the technical solution, and specifically, the present embodiment further includes:
determining a hot spot data table, a domain hot spot data table and a domain user table in advance according to a setting rule of hot spot data;
correspondingly, the process of determining the hot spot data tag set to be synchronized according to the existing hot spot data of the target edge node and the global hot spot data of each edge node specifically comprises the following steps:
determining a hot spot data label set to be synchronized according to an existing hot spot data label set of a target edge node in a domain hot spot data table and a global hot spot data label set of each edge node in the hot spot data table;
correspondingly, the process of acquiring the required hotspot data labels according to the login condition of the target user at each edge node and immediately synchronizing the required hotspot data corresponding to the required hotspot data labels from the edge nodes specifically comprises the following steps:
determining the login condition of a target user at each edge node according to the domain user table, and acquiring a required hot spot data tag;
and determining an edge node serving as a data synchronization object according to the hot spot data tag set and the domain hot spot data table to be synchronized, and immediately synchronizing the required hot spot data corresponding to the required hot spot data tag from the edge node serving as the data synchronization object.
Specifically, in this embodiment, hot data in all edge nodes is determined according to a preset hot data screening rule, and then a hot data table, a domain hot data table, and a domain user table are set according to the screened hot data. The hot spot data table stores information such as tags and names of global hot spot data determined by preset hot spot data screening rules. The domain hot spot data table stores hot spot data labels, node identifications and other information respectively and correspondingly contained by different edge nodes; and the hot data tags of the domain hot data table are a subset of the tags of the global hot data of the hot data table. The domain user table stores the latest update time of the user data of the target user at the corresponding edge node, the node identification, the hot point data label owned by the target user and the like.
Specifically, when the target user logs out after logging in each edge node, updating the latest updating time of the user data of the target user at the corresponding edge node in the domain user table; when the target user logs in at the edge node, whether the target user logs in at the edge node can be judged according to the domain user table. Updating the hot spot data table when the global hot spot data is updated; when the hot spot data contained in each edge node is updated, the related information in the domain hot spot data table also needs to be updated.
In addition, because the same edge region includes one or more edge nodes with the same data information, the domain hot spot data table may also be information such as hot spot data labels, domain identifiers, and the like, which are respectively and correspondingly included in different edge regions; the domain user table can also store the last data update time of the user in the corresponding edge area, the domain identification, the hot point data label owned by the user in the corresponding edge area, and the like; this embodiment is not limited to this.
Specifically, in this embodiment, when determining a hot spot data tag set that needs to be synchronized, a hot spot data tag set M that needs to be synchronized is determined according to a global hot spot data tag set included in a hot spot data table and a hot spot data tag set of a target edge node in a domain hot spot data table, that is, a difference set of existing hot spot data tag sets.
When the required hotspot data label is determined, determining the login condition of a target user at each edge node according to the domain user table, and determining the edge node with the latest user data updating time; and then determining the required hot spot data label of the target edge node according to the hot spot data label corresponding to the edge node in the domain hot spot data table.
Then, according to the hotspot data tag set M and the domain hotspot data table which need to be synchronized, selecting edge nodes containing all elements of the hotspot data tag set M which need to be synchronized as data synchronization objects, wherein the edge nodes serving as the data synchronization objects also comprise the needed hotspot data corresponding to the needed hotspot data tags; and then instantly synchronizing the required hot spot data corresponding to the required hot spot data label from the edge node serving as a data synchronization object.
Therefore, according to the method of the embodiment, the hotspot data tag set to be synchronized and the hotspot data tag to be synchronized can be determined more conveniently, and the efficiency of data synchronization can be improved.
On the basis of the foregoing embodiment, this embodiment further describes and optimizes the technical solution, and specifically, in this embodiment, a process of acquiring a required hotspot data tag according to a login condition of a target user at each edge node and immediately synchronizing required hotspot data corresponding to the required hotspot data tag from the edge node specifically includes:
setting the edge node with the latest user data updating time as a first edge node according to the login condition of a target user at each edge node;
acquiring user basic data of a target user from a first edge node in real time; the user basic data comprises user directory data and a required hotspot data tag;
and determining a second edge node according to the hot spot data label set to be synchronized, and instantly acquiring the required hot spot data corresponding to the required hot spot data label from the second edge node.
Fig. 2 is a system architecture diagram of a data synchronization method based on cross-domain edge nodes according to an embodiment of the present invention; fig. 3 is a schematic process diagram of determining a first edge node and a second edge node in a data synchronization method based on cross-domain edge nodes according to an embodiment of the present invention; as shown in fig. 2 and fig. 3, since the target user may log in the personal account at the edge nodes of a plurality of different edge areas, and user data exists at each edge node, the user data of the target user may exist at a plurality of different edge nodes; in addition, different edge nodes all have more or less hot spot data, so that a plurality of selectable data synchronization objects also exist in the data synchronization of the target edge node, and therefore a first edge node for synchronizing the user basic data and a second edge node for synchronizing the hot spot data to be synchronized corresponding to the hot spot data tag set to be synchronized need to be determined.
It should be noted that the user data of all edge nodes are stored in the central database, the user data includes user basic data and hotspot data, and the whole data interaction process between the target edge node and the first edge node/the second edge node is completed in a public network environment.
Specifically, when a target user logs in at a target edge node, the target edge node first needs to determine whether user data of the target edge node is the latest user data, or whether user data corresponding to the target user exists in other edge nodes; if the current user directory data does not exist, the user directory data of the target user is represented as user data with the latest update time, namely the user directory data of the target user and the required hot spot data do not exist on the target edge node, and the user directory data and the required hot spot data do not need to be synchronized; if not, determining the edge node with the latest user data updating time, namely determining the first edge node. Then, local hot data verification is carried out, and if the existing hot data target edge nodes of the target edge nodes contain all required hot data, data synchronization tasks do not need to be executed at this time; otherwise, the required hot spot data corresponding to the required hot spot data label is synchronized in real time from the edge node according to the required hot spot data label.
Specifically, a second edge node including all elements in the hot spot data tag set to be synchronized is determined according to the hot spot data tag set to be synchronized, and the required hot spot data corresponding to the required hot spot data tag is immediately acquired from the second edge node.
Fig. 4 is a schematic process diagram of a data synchronization method based on cross-domain edge nodes according to an embodiment of the present invention, as shown in fig. 4, after a first edge node and a second edge node are determined, a target edge node first obtains address information and user identification information of the first edge node, then sets a user data synchronization request packet, and sends the user data synchronization request packet to the first edge node; after receiving the user data synchronization request packet, the first edge node unpacks the packet, matches the user data in the edge node, extracts the user directory data and the required hot spot data tag, packs and compresses the user directory data and the required hot spot data tag to obtain a response packet, and finally pushes the response packet to a target edge node; therefore, the user basic data of the target user can be obtained in real time from the first edge node. It should be noted that, here, the first edge node user basic data may also include other types of data information, and is not limited specifically here.
After the synchronization of the user basic data is completed, the target edge node sets a hot spot data synchronization request packet according to the required hot spot data tag and sends the hot spot data synchronization request packet to a specified second edge node, the second edge node unpacks the hot spot data synchronization request packet after receiving the hot spot data synchronization request packet, matches the hot spot data in the edge node, extracts the required hot spot data corresponding to the required hot spot data tag, packs and compresses the required hot spot data, and finally pushes the required hot spot data to the target edge node.
It should be noted that, if the hot spot data tag set to be synchronized is equal to the required hot spot data tag, that is, when there is no periodic synchronization hot spot data, the first edge node and the second edge node may be the same edge node, that is, the user directory data and the required hot spot data are directly obtained from the same edge node.
As a preferred embodiment, the process of determining a second edge node according to a hot spot data tag set to be synchronized, and obtaining required hot spot data corresponding to a required hot spot data tag in real time from the second edge node specifically includes:
and when a plurality of candidate edge nodes containing all elements of the hotspot data tag set needing synchronization exist, determining a second edge node from the plurality of candidate edge nodes according to the geographic position and/or the synchronization cost.
In actual operation, edge nodes including all elements of a hotspot data tag set to be synchronized are generally set as second edge nodes serving as data synchronization objects; however, when there are multiple candidate edge nodes that can be used as data synchronization objects, it is necessary to filter the candidate edge nodes according to the transmission efficiency and/or the transmission cost to determine a second edge node that is a data synchronization object. Specifically, the second edge node serving as the data synchronization object may be determined from the plurality of candidate edge nodes according to the geographic location and/or the synchronization cost of each candidate edge node and the target edge node.
As a preferred embodiment, the process of determining a second edge node according to a hot spot data tag set to be synchronized, and obtaining required hot spot data corresponding to a required hot spot data tag in real time from the second edge node specifically includes:
when the candidate edge nodes containing all elements of the hot spot data tag set to be synchronized do not exist, the hot spot data tag set to be synchronized is divided into a plurality of subsets, and the edge nodes corresponding to all the elements in the subsets are set as second edge nodes respectively.
In actual operation, if there are no candidate edge nodes containing all elements of the hot spot data tag set to be synchronized, splitting the hot spot data tag set to be synchronized into a plurality of subsets, respectively setting corresponding data synchronization objects according to the subsets, respectively setting the edge nodes corresponding to all elements in the subsets as second edge nodes, and respectively performing data synchronization by using the plurality of second edge nodes.
Therefore, the first edge node and the second edge node are screened out according to the method of the embodiment for data synchronization, so that the efficiency of data synchronization can be further improved, the cost of data synchronization can be reduced, and the use experience of a user can be further improved.
On the basis of the foregoing embodiment, this embodiment further describes and optimizes the technical solution, and specifically, in this embodiment, when the required hotspot data is set with a priority, a process of determining a second edge node according to a hotspot data tag set to be synchronized, and obtaining the required hotspot data corresponding to the required hotspot data tag in real time from the second edge node specifically includes:
determining a second edge node according to the hot spot data label set needing to be synchronized;
respectively setting corresponding data synchronization requests according to the labels of the data needing to be hot-point data;
and sequentially placing the data synchronization requests in a synchronization queue according to the sequence of the priority of the required hot data corresponding to the required hot data label from high to low, executing the data synchronization requests, and instantly acquiring the required hot data corresponding to the data synchronization requests from the second edge node.
It is understood that, in actual operation, if the required hotspot data is set with priority, each required hotspot data may be further synchronized from the second edge node in order of priority. Specifically, after a second edge node is determined according to a hot spot data tag set needing synchronization, corresponding data synchronization requests are set according to each hot spot data tag needing synchronization respectively; and then sequentially placing the data synchronization requests in a synchronization queue according to the sequence of the priority of the required hot data corresponding to the required hot data label from high to low, executing the data synchronization requests, and instantly acquiring the required hot data corresponding to the data synchronization requests from the second edge node.
It should be noted that, in actual operation, the priority of each hot-point data needed may be determined according to the hot degree of each hot-point data needed, that is, the number of times of access/the probability of being accessed again, and of course, the priority of each hot-point data needed may also be determined in other embodiments, which is not limited in this embodiment.
Therefore, according to the method of the embodiment, the data of each hot spot required is synchronized according to the sequence from high priority to low priority, so that the use experience of a user can be further improved.
In addition, when data synchronization is performed on the periodic synchronization hot spot data, data synchronization may be performed on each periodic synchronization hot spot data in sequence from high priority to low priority, so as to further improve the user experience of the user.
On the basis of the above embodiments, the present embodiment further describes and optimizes the technical solution, and specifically, the present embodiment further includes:
and reconstructing data by using the user directory data, the required hotspot data and the periodic synchronous hotspot data.
Specifically, after receiving the synchronized user directory data, the required hotspot data and the periodic synchronization hotspot data, the destination domain edge node locally executes first data reconstruction, namely user basic data reconstruction, through the bottom operation of the operating system, and fills the user directory data synchronized from the edge node into the user directory of the destination edge node; the purpose of the user basic data reconstruction is to construct a user directory structure which is the same as the data synchronization object at the target edge node. When a user accesses the hot data at the target edge node, second data reconstruction, namely hot data reconstruction, is performed at the target edge node according to the hot data label, the hot data is mounted to the user directory, and the operability of all user data is guaranteed.
In the embodiment, data synchronization is realized through data reconstruction, and hot spot data reconstruction is performed on the target edge node only when the target user accesses the hot spot data, so that the construction delay and the utilization rate of computer resources are reduced.
The above detailed description is made on an embodiment of a data synchronization method based on a cross-domain edge node provided by the present invention, and the present invention also provides a data synchronization apparatus, a device and a computer-readable storage medium based on a cross-domain edge node corresponding to the method.
Fig. 5 is a structural diagram of a data synchronization apparatus based on a cross-domain edge node according to an embodiment of the present invention, and as shown in fig. 5, the data synchronization apparatus based on a cross-domain edge node is applied to a target edge node, and includes:
the determining module 51 is configured to determine a hot spot data tag set to be synchronized according to existing hot spot data of a target edge node and global hot spot data of each edge node;
the first synchronization module 52 is configured to obtain a required hotspot data tag according to a login condition of a target user at each edge node, and immediately synchronize required hotspot data corresponding to the required hotspot data tag from the edge node;
the second synchronization module 53 is configured to determine a periodic synchronization hot spot data tag according to the hot spot data tag set to be synchronized and the required hot spot data tag, and acquire periodic synchronization hot spot data corresponding to the periodic synchronization hot spot data tag from the edge node according to a preset time period.
The data synchronization device based on the cross-domain edge nodes provided by the embodiment of the invention has the beneficial effects of the data synchronization method based on the cross-domain edge nodes.
As a preferred embodiment, the first synchronization module specifically includes:
the setting submodule is used for setting the edge node with the latest user data updating time as a first edge node according to the login condition of a target user at each edge node;
the acquisition submodule is used for acquiring the user basic data of the target user from the first edge node in real time; the user basic data comprises user directory data and a required hotspot data tag;
and the synchronization submodule is used for determining a second edge node according to the hot spot data label set required to be synchronized and instantly acquiring the required hot spot data corresponding to the required hot spot data label from the second edge node.
As a preferred embodiment, when the required hotspot data is set with a priority, the synchronization sub-module specifically includes:
the determining unit is used for determining a second edge node according to the hot spot data tag set needing to be synchronized;
the setting unit is used for setting corresponding data synchronization requests according to the hot spot data labels;
and the synchronization unit is used for sequentially placing the data synchronization requests in a synchronization queue according to the sequence from high to low of the priority of the required hotspot data corresponding to the required hotspot data label, executing the data synchronization requests, and instantly acquiring the required hotspot data corresponding to the data synchronization requests from the second edge node.
As a preferred embodiment, a data synchronization apparatus based on cross-domain edge nodes further includes:
and the data reconstruction module is used for reconstructing data by utilizing the user directory data, the required hot spot data and the periodic synchronous hot spot data.
As a preferred embodiment, a data synchronization apparatus based on cross-domain edge nodes further includes:
the data table setting module is used for determining a hot spot data table, a domain hot spot data table and a domain user table in advance according to a setting rule of hot spot data;
correspondingly, the determining module specifically includes:
the determining submodule is used for determining a hot spot data tag set to be synchronized according to an existing hot spot data tag set of a target edge node in a domain hot spot data table and a global hot spot data tag set of each edge node in the hot spot data table;
correspondingly, the root first synchronization module specifically comprises:
the label obtaining submodule is used for determining the login condition of a target user at each edge node according to the domain user table and obtaining the required hotspot data label;
and the data synchronization submodule is used for determining an edge node serving as a data synchronization object according to the hot spot data tag set and the domain hot spot data table which need to be synchronized, and immediately synchronizing the required hot spot data corresponding to the required hot spot data tag from the edge node serving as the data synchronization object.
Fig. 6 is a structural diagram of a data synchronization device based on a cross-domain edge node according to an embodiment of the present invention, and as shown in fig. 6, the data synchronization device based on the cross-domain edge node includes:
a memory 61 for storing a computer program;
a processor 62 for implementing the steps of the cross-domain edge node based data synchronization method as described above when executing the computer program.
The data synchronization equipment based on the cross-domain edge nodes provided by the embodiment of the invention has the beneficial effects of the data synchronization method based on the cross-domain edge nodes.
In order to solve the above technical problem, the present invention further provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the data synchronization method based on the cross-domain edge node.
The computer-readable storage medium provided by the embodiment of the invention has the beneficial effects of the data synchronization method based on the cross-domain edge node.
The present invention provides a method, an apparatus, a device and a computer readable storage medium for data synchronization based on cross-domain edge nodes. The principles and embodiments of the present invention are explained herein using specific examples, which are set forth only to help understand the method and its core ideas of the present invention. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
Claims (10)
1. A data synchronization method based on cross-domain edge nodes is applied to target edge nodes and comprises the following steps:
determining a hot spot data tag set to be synchronized according to the existing hot spot data of the target edge node and the global hot spot data of each edge node;
acquiring a required hot spot data label according to the login condition of a target user at each edge node, and instantly synchronizing required hot spot data corresponding to the required hot spot data label from the edge node;
and determining a periodic synchronization hot spot data tag according to the hot spot data tag set to be synchronized and the required hot spot data tag, and acquiring periodic synchronization hot spot data corresponding to the periodic synchronization hot spot data tag from the edge node according to a preset time period.
2. The method according to claim 1, wherein the process of obtaining the required hotspot data tags according to the login conditions of the target users at each of the edge nodes, and immediately synchronizing the required hotspot data corresponding to the required hotspot data tags from the edge nodes specifically comprises:
setting the edge node with the latest user data updating time as a first edge node according to the login condition of the target user in each edge node;
acquiring user basic data of the target user from the first edge node in real time; the user basic data comprises user directory data and the required hotspot data label;
and determining a second edge node according to the hot spot data label set to be synchronized, and instantly acquiring the required hot spot data corresponding to the required hot spot data label from the second edge node.
3. The method according to claim 2, wherein when the required hotspot data is set with a priority, the process of determining a second edge node according to the set of hotspot data tags to be synchronized and obtaining the required hotspot data corresponding to the required hotspot data tags from the second edge node in real time specifically comprises:
determining the second edge node according to the hot spot data tag set needing to be synchronized;
respectively setting corresponding data synchronization requests according to the required hotspot data tags;
and sequentially placing the data synchronization requests in a synchronization queue according to the sequence of the priorities of the required hotspot data corresponding to the required hotspot data labels from high to low, executing the data synchronization requests, and instantly acquiring the required hotspot data corresponding to the data synchronization requests from the second edge node.
4. The method of claim 2, further comprising:
and reconstructing data by using the user directory data, the required hotspot data and the periodic synchronous hotspot data.
5. The method according to claim 2, wherein the process of determining a second edge node according to the hot spot data tag set to be synchronized and obtaining the required hot spot data corresponding to the required hot spot data tag in real time from the second edge node specifically comprises:
and when a plurality of candidate edge nodes containing all elements of the hotspot data tag set needing to be synchronized exist, determining the second edge node from the candidate edge nodes according to the geographic position and/or the synchronization cost.
6. The method according to claim 2, wherein the process of determining a second edge node according to the hot spot data tag set to be synchronized and obtaining the required hot spot data corresponding to the required hot spot data tag in real time from the second edge node specifically comprises:
when the candidate edge nodes containing all elements of the hot spot data tag set to be synchronized do not exist, splitting the hot spot data tag set to be synchronized into a plurality of subsets, and setting the edge nodes corresponding to all elements in the subsets as the second edge nodes respectively.
7. The method of any one of claims 1 to 6, further comprising:
determining a hot spot data table, a domain hot spot data table and a domain user table in advance according to a setting rule of hot spot data;
correspondingly, the process of determining the hot spot data tag set to be synchronized according to the existing hot spot data of the target edge node and the global hot spot data of each edge node specifically includes:
determining the hot spot data tag set to be synchronized according to the existing hot spot data tag set of the target edge node in the domain hot spot data table and the global hot spot data tag set of each edge node in the hot spot data table;
correspondingly, the process of acquiring the required hotspot data labels according to the login conditions of the target users at each edge node and immediately synchronizing the required hotspot data corresponding to the required hotspot data labels from the edge nodes specifically comprises the following steps:
determining the login condition of the target user at each edge node according to the domain user table, and acquiring the required hotspot data label;
and determining an edge node serving as a data synchronization object according to the hot spot data tag set to be synchronized and the domain hot spot data table, and immediately synchronizing the required hot spot data corresponding to the required hot spot data tag from the edge node serving as the data synchronization object.
8. A data synchronization device based on cross-domain edge nodes is applied to a target edge node and comprises the following components:
the determining module is used for determining a hot spot data tag set to be synchronized according to the existing hot spot data of the target edge node and the global hot spot data of each edge node;
the first synchronization module is used for acquiring the required hotspot data labels according to the login conditions of the target users at each edge node and instantly synchronizing the required hotspot data corresponding to the required hotspot data labels from the edge nodes;
and the second synchronization module is used for determining a periodic synchronization hot spot data tag according to the hot spot data tag set to be synchronized and the required hot spot data tag, and acquiring periodic synchronization hot spot data corresponding to the periodic synchronization hot spot data tag from the edge node according to a preset time period.
9. A data synchronization device based on a cross-domain edge node, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the cross-domain edge node based data synchronization method according to any one of claims 1 to 7 when executing said computer program.
10. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the cross-domain edge node-based data synchronization method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011642170.1A CN112804313B (en) | 2020-12-31 | 2020-12-31 | Data synchronization method, device, equipment and medium based on cross-domain edge node |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011642170.1A CN112804313B (en) | 2020-12-31 | 2020-12-31 | Data synchronization method, device, equipment and medium based on cross-domain edge node |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112804313A true CN112804313A (en) | 2021-05-14 |
| CN112804313B CN112804313B (en) | 2022-08-09 |
Family
ID=75809314
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011642170.1A Active CN112804313B (en) | 2020-12-31 | 2020-12-31 | Data synchronization method, device, equipment and medium based on cross-domain edge node |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112804313B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117834656A (en) * | 2024-03-06 | 2024-04-05 | 广州优刻谷科技有限公司 | Edge computing cross-domain synchronization method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140013051A1 (en) * | 2012-03-12 | 2014-01-09 | Huawei Technologies Co., Ltd | Data Storage Method and Data Storage Apparatus |
| US20140185606A1 (en) * | 2011-07-15 | 2014-07-03 | Huawei Technologies Co., Ltd. | Method and apparatus for synchronizing popularity value of cache data and method, apparatus, and system for distributed caching |
| CN109995840A (en) * | 2018-01-02 | 2019-07-09 | ***通信有限公司研究院 | CDN method of data synchronization, device, equipment and computer storage medium |
| CN110535897A (en) * | 2018-05-25 | 2019-12-03 | 北京邮电大学 | The data cache method and device of Incorporate network |
-
2020
- 2020-12-31 CN CN202011642170.1A patent/CN112804313B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140185606A1 (en) * | 2011-07-15 | 2014-07-03 | Huawei Technologies Co., Ltd. | Method and apparatus for synchronizing popularity value of cache data and method, apparatus, and system for distributed caching |
| US20140013051A1 (en) * | 2012-03-12 | 2014-01-09 | Huawei Technologies Co., Ltd | Data Storage Method and Data Storage Apparatus |
| CN109995840A (en) * | 2018-01-02 | 2019-07-09 | ***通信有限公司研究院 | CDN method of data synchronization, device, equipment and computer storage medium |
| CN110535897A (en) * | 2018-05-25 | 2019-12-03 | 北京邮电大学 | The data cache method and device of Incorporate network |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117834656A (en) * | 2024-03-06 | 2024-04-05 | 广州优刻谷科技有限公司 | Edge computing cross-domain synchronization method and system |
| CN117834656B (en) * | 2024-03-06 | 2024-06-11 | 广州优刻谷科技有限公司 | Edge computing cross-domain synchronization method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112804313B (en) | 2022-08-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104486445B (en) | Distributed extendable resource monitoring system based on cloud platform | |
| CN104536899B (en) | A kind of software deployment and its maintaining method based on Intelligent cluster | |
| CN111478820A (en) | Network equipment configuration system and method for large-scale network environment of network target range | |
| CN113590576A (en) | Database parameter adjusting method and device, storage medium and electronic equipment | |
| CN103607424A (en) | Server connection method and server system | |
| CN107707616A (en) | A kind of data transmission method and system | |
| CN102026228B (en) | Statistical method and equipment for communication network performance data | |
| CN114791846A (en) | Method for realizing observability aiming at cloud native chaos engineering experiment | |
| CN108737586B (en) | Disaster recovery switching method and device for domain name query service | |
| CN112804313B (en) | Data synchronization method, device, equipment and medium based on cross-domain edge node | |
| CN117389830A (en) | Cluster log acquisition method and device, computer equipment and storage medium | |
| CN115048188A (en) | Network isolation control system and method for container, electronic device and storage medium | |
| CN114866617A (en) | Micro-service request processing method, device, equipment and medium | |
| CN114553867A (en) | Cloud-native cross-cloud network monitoring method and device and storage medium | |
| CN111147585B (en) | Equipment upgrading method, device, storage medium and system | |
| CN108923963B (en) | Method for realizing automatic topology measurement by using Looking Glass measurement points | |
| CN106815053A (en) | A kind of data-updating method, device, data call end and data update system | |
| CN109962834B (en) | Information processing method, system, terminal and computer storage medium | |
| CN107968798A (en) | A kind of network management resources label acquisition method, cache synchronization method, apparatus and system | |
| CN112702441B (en) | Container-based access data processing method, device, system and storage medium | |
| CN115189931A (en) | Distributed key management method, device, equipment and storage medium | |
| CN107547607B (en) | Cluster migration method and device | |
| CN115408569A (en) | Process traceability tree simplification method, device, equipment and medium | |
| CN115293365A (en) | Management method, device, management platform and storage medium of machine learning model | |
| CN109167826B (en) | Method, device and system for putting WEB application on shelf |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |