CN107819891B - Data processing method, data processing device, computer equipment and storage medium - Google Patents
Data processing method, data processing device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN107819891B CN107819891B CN201710959500.1A CN201710959500A CN107819891B CN 107819891 B CN107819891 B CN 107819891B CN 201710959500 A CN201710959500 A CN 201710959500A CN 107819891 B CN107819891 B CN 107819891B
- Authority
- CN
- China
- Prior art keywords
- data
- identifier
- host
- backup
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/50—Address allocation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45562—Creating, deleting, cloning virtual machine instances
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a data processing method, a data processing device, computer equipment and a storage medium, wherein the method comprises the following steps: receiving a first data backup request sent by the management node, wherein the first data backup request carries a first data identifier; acquiring a first host identifier corresponding to the first data identifier; sending a first data acquisition request to a first host corresponding to the first host identifier, wherein the first data acquisition request carries the first data identifier; receiving backup data returned by the first host according to the first data identifier, wherein the backup data comprises first data corresponding to the first data identifier or change information of the first data corresponding to the first data identifier; and sending the backup data to a preset storage node to backup the first data. The method has high backup speed and saves computer network resources.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a data processing method and apparatus, a computer device, and a storage medium.
Background
With the development of information technology, more and more enterprises and individuals perform services such as network storage and computation by purchasing or renting hosts, so as to meet the increasing demand for host equipment and save the maintenance cost of IT equipment.
In the prior art, in order to avoid the loss caused by the damage and loss of the stored data, the stored data is generally required to be backed up. However, the hosts are typically arranged in zones, e.g., two host zones located in Beijing and Shanghai, respectively. Because the hosts between the regions cannot directly access the data for security and cost reasons, if the data stored in the host in one region is to be stored in the host in another region, the user is required to download the data and send the data to the host in another region, which is slow and wastes computer network resources.
Disclosure of Invention
In view of the above, it is necessary to provide a data processing method, apparatus, computer device and storage medium for addressing the above problems.
A data processing method is applied to a transit node, the transit node is distributed with a first network address and a second network address, the first network address is used for communicating with a management node, and the second network address is used for communicating with a host corresponding to the transit node, and the method comprises the following steps: receiving a first data backup request sent by the management node, wherein the first data backup request carries a first data identifier; acquiring a first host identifier corresponding to the first data identifier; sending a first data acquisition request to a first host corresponding to the first host identifier, wherein the first data acquisition request carries the first data identifier; receiving backup data returned by the first host according to the first data identifier, wherein the backup data comprises first data corresponding to the first data identifier or change information of the first data corresponding to the first data identifier; and sending the backup data to a preset storage node to backup the first data.
In one embodiment, the method further comprises: receiving first user attribute information sent by the management node; the step of sending the backup data to a preset storage node to backup the first data includes: sending a data storage request to the storage node, where the data storage request carries the backup data, the first user attribute information, and the first data identifier, so that the storage node performs hash calculation according to the first user attribute information and the first data identifier to obtain a first hash value, and stores the backup data according to the first hash value.
In one embodiment, the method further comprises: receiving second user attribute information sent by the management node; receiving a data restoration request sent by the management node, wherein the data restoration request carries a second data identifier; acquiring a second host identifier corresponding to the second data identifier; sending a second data acquisition request to the storage node, wherein the second data acquisition request carries a second data identifier and second user attribute information, so that the storage node performs hash calculation according to the second user attribute information and the second data identifier to obtain a second hash value, and acquires second data corresponding to the second data identifier according to the second hash value; and receiving the second data returned by the storage node, and sending the second data to a second host corresponding to the second host identifier.
In one embodiment, a first virtual machine and a second virtual machine are created on the transit node, and the method further includes: receiving a network address configuration request of a virtual machine, wherein the network address configuration request carries the first network address and the second network address; the first network address is allocated to the first virtual machine, and a second network address is allocated to the second virtual machine.
In one embodiment, the first backup request carries the first host identifier and the first data identifier, and the step of obtaining the first host identifier corresponding to the first data identifier includes: and analyzing the first data backup request to obtain the first data identifier and the first host identifier.
A data processing apparatus applied to a transit node, where the transit node is allocated with a first network address and a second network address, the first network address is used for communicating with a management node, and the second network address is used for communicating with a host corresponding to the transit node, the apparatus comprising: a first backup request receiving module, configured to receive a first data backup request sent by the management node, where the first data backup request carries a first data identifier; the first identifier acquisition module is used for acquiring a first host identifier corresponding to the first data identifier; a first obtaining request sending module, configured to send a first data obtaining request to a first host corresponding to the first host identifier, where the first data obtaining request carries the first data identifier; a data receiving module, configured to receive backup data returned by the first host according to the first data identifier, where the backup data includes first data corresponding to the first data identifier or change information of the first data corresponding to the first data identifier; and the backup module is used for sending the backup data to a preset storage node so as to backup the first data.
In one embodiment, the apparatus further comprises: the first attribute information acquisition module is used for receiving first user attribute information sent by the management node; the backup module is configured to: sending a data storage request to the storage node, where the data storage request carries the backup data, the first user attribute information, and the first data identifier, so that the storage node performs hash calculation according to the first user attribute information and the first data identifier to obtain a first hash value, and stores the backup data according to the first hash value.
A data processing system, the data processing system comprising: a management node to: receiving a second data backup request, wherein the second data backup request carries a first data identifier, acquiring a transfer node corresponding to the first data identifier, and sending a first data backup request to the transfer node, wherein the first data backup request carries the first data identifier; the transit node, to which a first network address and a second network address are allocated, the first network address being used for communicating with the management node, the second network address being used for communicating with a host corresponding to the transit node, and the transit node being configured to perform the steps of the data processing method according to any one of claims 1 to 5.
A computer device comprising a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, causes the processor to carry out the steps of the data processing method described above.
A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, causes the processor to carry out the steps of the above-mentioned data processing method.
According to the data processing method, the data processing device, the computer equipment and the storage medium, the corresponding transfer nodes are configured for the host areas, the transfer nodes are distributed with the first network address and the second network address, the first network address is used for communicating with the management node, the second network address is used for communicating with the hosts of the host areas corresponding to the transfer nodes, therefore, the transfer nodes can receive the data backup request sent by the management nodes, obtain the first host identifications corresponding to the first data identifications carried by the data backup request, further send the first data acquisition request to the first hosts corresponding to the first host identifications, and backup the first data to the preset storage nodes after receiving the first data sent by the first hosts. Therefore, when the data is stored in the host of another host area, the transfer node corresponding to the host area can acquire the data from the preset storage node, the backup speed is high, and the computer network resources are saved.
Drawings
FIG. 1 is a diagram of an implementation environment of a data processing method provided in one embodiment;
FIG. 2 is a flow diagram of a data processing method in one embodiment;
FIG. 3 is a flow diagram of a data processing method in one embodiment;
FIG. 4 is a flow diagram of a data processing method in one embodiment;
FIG. 5 is a flow diagram of a data processing method in one embodiment;
FIG. 6 is a block diagram showing the structure of a data processing apparatus according to an embodiment;
FIG. 7 is a block diagram showing the structure of a data processing apparatus according to an embodiment;
FIG. 8 is a block diagram showing the structure of a data processing apparatus according to an embodiment;
FIG. 9 is a block diagram showing the structure of a data processing apparatus according to an embodiment;
FIG. 10 is a block diagram of a data processing system in one embodiment;
FIG. 11 is a block diagram showing an internal configuration of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms unless otherwise specified. These terms are only used to distinguish one element from another. For example, a first data identity may be referred to as a second data identity, and similarly, a second data identity may be referred to as a first data identity, without departing from the scope of the present application.
Fig. 1 is a diagram of an implementation environment of a data processing method according to an embodiment, as shown in fig. 1, the implementation environment includes a backup request sending node 110, a management node 120, a transit node 130, and a storage node 140, and one or more hosts, for example, hosts 1 to n, are disposed in a host area corresponding to the transit node 130. The transit node 130 is assigned a first network address for communicating with the management node 120 and a second network address for communicating with a host on a host area corresponding to the transit node 130. When backup is needed, the backup request sending node 110 sends a second backup request to the management node 120, where the second backup request carries the first data identifier and the first host identifier, the management node 120 obtains the corresponding transfer node 130 according to the first host identifier or the first data identifier, and sends the first data backup request to the transfer node 130, where the first backup request carries the first host identifier and the first data identifier, after receiving the first backup request, the transfer node 130 sends the first data obtaining request to the first host corresponding to the first host identifier, such as the host 1, where the first data obtaining request carries the first data identifier, the host 1 obtains the first data according to the first data identifier, returns the first data to the transfer node 130, and the transfer node 130 sends the first data to the storage node 140 for storage.
In one embodiment, there are one or more host areas, the number of hosts in each host area is set according to actual needs, and each host area may be correspondingly set with one or more transit nodes. For example, a cloud host region is respectively arranged in Shanghai, Chengdu and Shenzhen and used for storing cloud hosts.
In an embodiment, the second data backup request and/or the first data backup request may not carry the first host identifier, the transfer node 130 may set a corresponding relationship between the data identifier and the host identifier, and after receiving the first data backup request, the transfer node 130 finds the corresponding first host identifier according to the first data identifier.
In an embodiment, the management node 120 may also set a corresponding relationship between the data identifier and the transit node, and after receiving the first data identifier carried in the data backup instruction, obtain the transit node corresponding to the first host according to the first data identifier, and send the first backup request to the transit node.
In an embodiment, the backup request sending node 140 may be a user terminal or a server, for example, a user may send a data backup instruction on a web page of a cloud portal, where the instruction carries a first data identifier and a first host identifier, and after receiving the data backup instruction, the server corresponding to the cloud portal sends a second backup request to the management node 130. The cloud portal refers to an entrance for accessing and managing cloud platform resources based on a network mode, and integrates interfaces and software under a cloud platform.
In one embodiment, the first host identification may include a network address of the first host.
In an embodiment, the backup instruction may further carry a host area identifier of an area where the first host is located. The second backup request carries a host area identifier, and the management node stores a corresponding relationship between the host area identifier and the network address of the transfer node. After receiving the host area identifier, the management node 120 acquires the first network address of the corresponding transfer node, and then sends a first backup request to the transfer node 130 according to the first network address.
For example, when the user selects to backup a folder on the terminal, the sent data identifier may be a folder identifier or identifiers of multiple files under the folder, after the data identifier is obtained, the terminal sends an information obtaining request to a server storing a correspondence between the data identifier and a host IP address and a correspondence between the data identifier and a host area, the server obtains a network address of a first host and a host area identifier where the first host is located corresponding to the data identifier according to the data identifier, and then returns the network address of the first host and the host area identifier to the user terminal, and the user terminal sends the data identifier, the network address of the first host, and the host area identifier to the management node 120.
In one embodiment, the management node 120, the transit node 130, and the storage node 140 belong to the same lan, and the transit node 130 and the corresponding hosts belong to another lan, that is, the first network address may be an IP address belonging to the same lan as the network address of the management node 120, and the second network address may be an IP address belonging to the same lan as the IP address of the host corresponding to the transit node 130.
In one embodiment, the transit node and the corresponding host communicate through a socket (socket), and the socket mode has short data transmission time and high performance, so that the efficiency of data backup can be improved by adopting the socket mode for communication. In one embodiment, the communication may also be performed using HTTP.
The backup request sending node 110, the management node 120, the relay node 130, and the storage node 140 may be independent physical servers, may also be a server cluster formed by a plurality of physical servers, and may be cloud servers providing basic cloud computing services such as a cloud server, a cloud database, a cloud storage, and a CDN.
As shown in fig. 2, in an embodiment, a data processing method is provided, where the data processing method may be applied to the transit node 130, where the transit node is allocated with a first network address and a second network address, the first network address is used for communicating with a management node, and the second network address is used for communicating with a host corresponding to the transit node, and specifically includes the following steps:
step 202, receiving a first data backup request sent by a management node, where the first data backup request carries a first data identifier.
Specifically, the network address refers to a logical address that a node on the internet has in the network, and may be determined according to a protocol of communication. Such as an IP address. The first data identifier may be one or more than one, the first data identifier is used for identifying first data to be backed up, when data backup is required, a user selects or inputs a corresponding first data identifier according to the first data to be backed up, the user terminal receives the first data identifier and sends the first data identifier to the management node, and when the management node sends a first data backup request to the relay node, the management node sends the first data backup request to the relay node according to the first network address, and the first data identifier is carried in the first data backup request.
In an embodiment, the first data backup request carries a first host identifier, for example, a data backup instruction received by the management node may carry the first host identifier, and the management node carries the first host identifier when sending the first backup request to the transit node. Or the management node may also set a corresponding relationship between the data identifier and the host identifier, and after receiving the first data identifier carried in the data backup instruction, obtain the first host identifier corresponding to the first data identifier, and carry the first host identifier when sending the first backup request to the transit node.
Step 204, a first host identifier corresponding to the first data identifier is obtained.
Specifically, the first host identifier is used to identify the first host, the transfer node may preset a correspondence between the data identifier and the host identifier, and after receiving the first data identifier carried in the first backup request, obtain the first host identifier corresponding to the first data identifier.
In one embodiment, the first data backup request carries the first data identifier and the first host identifier corresponding to the first data identifier, so that the transit node may analyze the first data backup request to obtain the first data identifier and the corresponding first host identifier.
Step 206, sending a first data obtaining request to the first host corresponding to the first host identifier, where the first data obtaining request carries the first data identifier.
Specifically, the first host is one or more of the hosts corresponding to the transfer node. After the first host identity is obtained, a first data acquisition request is sent to a first host corresponding to the first host identity, and the first data acquisition request carries the first data identity.
In one embodiment, the transit node is preset with a correspondence between the host identifier and the network address of the host. And when the first host identification is not the network address of the first host, acquiring the corresponding network address of the first host according to the first host identification. And then sending a first data acquisition request to the first host according to the network address corresponding to the first host.
In one embodiment, the first host identification may include a network address of the first host. Therefore, after the first host identity is obtained, the network address of the first host does not need to be searched, so that the data backup speed is improved.
Step 208, receiving backup data returned by the first host according to the first data identifier, where the backup data includes first data corresponding to the first data identifier or change information of the first data corresponding to the first data identifier.
Specifically, the first data refers to complete data corresponding to the first data identifier, the change information of the first data refers to changed data in the first data or operation information obtained according to an operation record for changing the first data, and the backed-up data can be changed by operating according to the operation information to obtain data consistent with the changed first data in the first host.
Step 210, sending the backup data to a preset storage node to backup the first data.
Specifically, after the backup data is obtained, the backup data is sent to a preset storage node, so that the storage node stores the backup data.
In an embodiment, the first data includes environment parameters for environment construction of the host, such as firewall policy parameters, security gateway parameters, and the like, and the environment parameters may be set according to specific requirements, which is not limited herein.
In the data processing method, the corresponding transfer node is configured for each host area, the transfer node is allocated with a first network address and a second network address, the first network address is used for communicating with the management node, and the second network address is used for communicating with each host in the host area corresponding to the transfer node, so that the transfer node can receive a data backup request sent by the management node, acquire a first host identifier corresponding to a first data identifier carried in the data backup request, further send a first data acquisition request to a first host corresponding to the first host identifier, and backup the first data to a preset storage node after receiving the first data sent by the first host. Therefore, when the data is stored in the host of another host area, the transfer node corresponding to the host area can acquire the data from the preset storage node, so that the speed is high, and the computer network resources are saved.
In one embodiment, as shown in fig. 3, the storage node includes an object storage node, and the information processing method may further include step S302: and receiving the first user attribute information sent by the management node. Step 210, sending the backup data to a preset storage node to backup the first data, where the step includes: and sending a data storage request to the storage node, wherein the data storage request carries the backup data, the first user attribute information and the first data identifier, so that the storage node performs hash calculation according to the first user attribute information and the first data identifier to obtain a first hash value, and stores the backup data according to the first hash value.
Specifically, object storage refers to storing data as an object, the object identifier is used for describing an attribute of the object, and when the object is accessed or stored, the object identifier is first obtained, and then the object is accessed or stored according to the object identifier. The first user attribute information includes a user name, and in some embodiments, may further include at least one of a user password and user authority. The first user attribute information may be user attribute information of the management node or user attribute information of the backup request sending node. The first user attribute information may be carried in the first backup request. Or may be received before receiving the first backup request, and after receiving the first user attribute information, the transit node may store the first user attribute information. Of course, the first user attribute information sent by the management node may be received after the first backup request is received.
The hash calculation is a calculation method for converting an input with an arbitrary length into an output with a certain length through a hash algorithm, and the hash algorithm may be an MD5(Message-digest algorithm5, information digest algorithm 5) algorithm, an SHA (secure hash Standard) algorithm, and the like, and is not particularly limited. When the hash calculation is performed, a hash value is obtained, and the storage node stores data according to the hash value.
Since the user attribute information sent by the management node is sent to the storage node during storage, if the stored data is to be restored to another host, even if the corresponding restoration relay node is different from the backup relay node that backs up the data to the storage node, the restoration relay node may receive the first user attribute information sent by the management node and send the first user attribute information and the first data identifier to the storage node to obtain the first data, so that the storage node performs hash calculation according to the first user attribute information and the first data identifier to obtain the first data, and returns the first data to the corresponding restoration relay node. Therefore, the data can be conveniently restored to the host computer in other areas.
It should be noted that, in the embodiment of the present invention, restoring may refer to not only returning the backed-up data to the original backed-up host, but also sending the backed-up data to another host.
In one embodiment, as shown in fig. 4, the storage node includes an object storage node, and the data processing method may further include the steps of:
step S402, receiving the second user attribute information sent by the management node.
Specifically, the second user attribute information may be user attribute information of the management node or user attribute information of the backup request sending node.
Step S404, receiving a data restoring request sent by the management node, where the data restoring request carries the second data identifier.
Specifically, the second data identifier is used to identify second data that needs to be restored, and the second data identifier may be one or more. When the data is to be restored, the management node sends a data restoration request to the transit node, and the transit node receives the data restoration request. For example, when a user needs to restore data stored in the storage node to a certain host under the transit node, a data restoration instruction may be sent to the management node, where the data restoration instruction carries the second data identifier, and after receiving the data restoration instruction, the management node sends a data restoration request to the transit node.
In an embodiment, the data restoring request further carries a second host identifier, where the second host identifier is used to identify a host to be subjected to data restoration. For example, the backup instruction sent by the user may carry the second host identifier, and after receiving the second host identifier, the management node carries the second host identifier in the data restoration request.
In an embodiment, the second user attribute information may be carried in the data restoring request, or may be received before the data restoring request is received, and after the second user attribute information is received, the second user attribute information is stored in the transit node. Of course, the second user attribute information sent by the management node may be received after the data restoring request is received.
Step S406, a second host identifier corresponding to the second data identifier is obtained.
Specifically, the number of the second host identifiers may be one or more, the relay node may preset a correspondence between the data identifier and the host identifier, and when the second data identifier carried in the data restoring request is received, the second host identifier corresponding to the second data identifier is obtained.
In one embodiment, the data reduction request carries the second data identifier and the second host identifier corresponding to the second data identifier, so that the data reduction request can be analyzed to obtain the second data identifier and the corresponding second host identifier.
Step S408, sending a second data obtaining request to the storage node, where the second data obtaining request carries a second data identifier and second user attribute information, so that the storage node performs hash calculation according to the second user attribute information and the second data identifier to obtain a second hash value, and obtains second data corresponding to the second data identifier according to the second hash value.
Specifically, the second data is already stored in the storage node, and when the transfer node that backs up the data backs up the second data to the storage system, the second user attribute information and the second data identifier are sent to the storage node, so that the storage node performs hash calculation according to the second user attribute information and the second data identifier to obtain a second hash value, and the storage node stores the second data according to the second hash value. Therefore, when the second data is to be restored, the second data identification and the second user attribute information are carried in the second data acquisition request, so that the storage node calculates a second hash value consistent with the backup according to the second data identification and the second user attribute information, and obtains corresponding second data according to the second hash value. It can be understood that the transit node performing the data backup may be the same as or different from the transit node performing the data restoration.
And step S410, receiving second data returned by the storage node, and sending the second data to a second host corresponding to the second host identifier.
Specifically, after the storage node acquires the second data, the storage node returns the second data to the transit node, and the transit node receives the second data and then sends the second data to a second host corresponding to the second host identifier, so as to restore the second data on the second host.
In an embodiment, the second data includes environment parameters for environment construction of the host, such as firewall policy parameters, security gateway parameters, and the like, and the environment parameters may be set according to specific requirements, which is not limited herein. The environment parameters are restored to the second host, so that the purpose of quickly building the same environment or recovering the environment data of the host can be achieved.
In an embodiment, as shown in fig. 5, a first virtual machine and a second virtual machine are created on the transit node, and the information processing method further includes:
step S502, a network address configuration request of the virtual machine is received, wherein the network address configuration request carries a first network address and a second network address.
Specifically, the virtual machine is a computer system that is simulated by software, has complete hardware system functions, and runs in an isolated environment. The first network address is used for communicating with the management node, and the second network address is used for communicating with a host on a host area corresponding to the transit node. The first network address may be different from the second network address, and in one embodiment, the first network address may be an IP address belonging to the same local area network as the network address of the management node, and the second network address may be an IP address belonging to the same local area network as the corresponding host.
Step S502, a first network address is allocated to the first virtual machine, and a second network address is allocated to the second virtual machine.
Specifically, after the first network address and the second network address are acquired, the first network address is allocated to the first virtual machine and the second network address is allocated to the second virtual machine, so that the management node can communicate with the transit node according to the first network address and communicate with the host by using the second network address, for example, receive a first data backup request sent by the management node, and then send a first data acquisition request to the first host.
As shown in fig. 6, in an embodiment, a data processing apparatus is provided, which may be integrated in the transit node 130, where the transit node is allocated with a first network address and a second network address, the first network address is used for communicating with a management node, and the second network address is used for communicating with a host corresponding to the transit node, and specifically may include:
a first backup request receiving module 602, configured to receive a first data backup request sent by a management node, where the first data backup request carries a first data identifier.
The first identifier obtaining module 604 is configured to obtain a first host identifier corresponding to the first data identifier.
In an embodiment, the first backup request carries a first host identifier and a first data identifier, and the first identifier obtaining module 604 is configured to: and analyzing the first data backup request to obtain a first data identifier and a first host identifier.
A first obtaining request sending module 606, configured to send a first data obtaining request to a first host corresponding to the first host identifier, where the first data obtaining request carries the first data identifier.
The data receiving module 608 is configured to receive backup data returned by the first host according to the first data identifier, where the backup data includes first data corresponding to the first data identifier or change information of the first data corresponding to the first data identifier.
The backup module 610 is configured to send the backup data to a preset storage node to backup the first data.
In one embodiment, as shown in fig. 7, the storage node comprises a storage node, and the apparatus further comprises: a first attribute information obtaining module 702, configured to receive first user attribute information sent by a management node.
The backup module 610 is configured to: and sending a data storage request to the storage node, wherein the data storage request carries the backup data, the first user attribute information and the first data identifier, so that the storage node performs hash calculation according to the first user attribute information and the first data identifier to obtain a first hash value, and stores the backup data according to the first hash value.
In one embodiment, as shown in FIG. 8, the storage nodes comprise object storage nodes, and the apparatus further comprises:
a first attribute information obtaining module 802, configured to receive second user attribute information sent by the management node.
A restoring request receiving module 804, configured to receive a data restoring request sent by the management node, where the data restoring request carries the second data identifier.
A second identifier obtaining module 806, configured to obtain a second host identifier corresponding to the second data identifier.
A second obtaining request sending module 808, configured to send a second data obtaining request to the storage node, where the second data obtaining request carries a second data identifier and second user attribute information, so that the storage node performs hash calculation according to the second user attribute information and the second data identifier to obtain a second hash value, and obtains second data corresponding to the second data identifier according to the second hash value.
And the data restoring module 810 is configured to receive the second data returned by the storage node, and send the second data to the second host corresponding to the second host identifier, so as to restore the second data.
In an embodiment, as shown in fig. 9, a first virtual machine and a second virtual machine are created on a transit node, and the apparatus further includes:
a configuration request receiving module 902, configured to receive a network address configuration request of a virtual machine, where the network address configuration request carries a first network address and a second network address.
An allocating module 904, configured to allocate a first network address for the first virtual machine and allocate a second network address for the second virtual machine.
In one embodiment, as shown in fig. 10, there is also provided a data processing system, the data backup comprising:
a management node 120 configured to: receiving a second data backup request, wherein the second data backup request requests a first data identifier, acquiring and storing the first data identifier, acquiring a transfer node corresponding to the first data identifier, and sending a first data backup request to the transfer node, wherein the first data backup request carries the first data identifier.
The transit node 130 is configured to be allocated with a first network address and a second network address, where the first network address is used for communicating with the management node, the second network address is used for communicating with a host corresponding to the transit node, and the transit node is configured to execute the steps of the data processing method provided in the foregoing embodiment. The transit node may be one or more.
As shown in fig. 11, which is an internal structure diagram of a computer device in an embodiment, the computer device may be the transit node, and the computer device is connected to the processor, the nonvolatile storage medium, the internal memory, and the network interface through the system connection bus. Wherein the non-volatile storage medium of the computer device may store an operating system and a computer program that, when executed, may cause the processor to perform a data processing method. The processor of the computer device is used for providing calculation and control capability and supporting the operation of the whole computer device. The internal memory may have stored therein a computer program which, when executed by the processor, causes the processor to perform a data processing method. The network interface of the computer device is used for network communication, such as data backup requests and the like. Those skilled in the art will appreciate that the architecture shown in fig. 11 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, the data processing apparatus provided in the present application may be implemented in a form of a computer program, the computer program may be executed on a computer device as shown in fig. 11, and a nonvolatile storage medium of the computer device may store various program modules constituting the data processing apparatus, such as the first backup request receiving module 602, the first identifier obtaining module 604, the first obtaining request sending module 606, the data receiving module 608, and the backup module 610 in fig. 6. Each program module includes a computer program, where the computer program is configured to enable a computer device to execute the steps in the data processing method according to each embodiment of the present application described in this specification, for example, the computer device may be configured to receive, by using a first backup request receiving module 602 shown in fig. 6, a first data backup request sent by a management node, where the first data backup request carries a first data identifier. The first host identifier corresponding to the first data identifier is obtained through the first identifier obtaining module 604. A first data obtaining request is sent to a first host corresponding to the first host identifier through a first obtaining request sending module 606, where the first data obtaining request carries the first data identifier. The data receiving module 608 receives backup data returned by the first host according to the first data identifier, where the backup data includes first data corresponding to the first data identifier or change information of the first data corresponding to the first data identifier. The backup data is sent to a preset storage node through the backup module 610 to backup the first data.
In one embodiment, a computer device is provided, which may be the transit node described above, where the transit node is allocated with a first network address and a second network address, the first network address is used for communicating with a management node, and the second network address is used for communicating with a host corresponding to the transit node, where the computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the following steps when executing the computer program: receiving a first data backup request sent by the management node, wherein the first data backup request carries a first data identifier; acquiring a first host identifier corresponding to the first data identifier; sending a first data acquisition request to a first host corresponding to the first host identifier, wherein the first data acquisition request carries the first data identifier; receiving backup data returned by the first host according to the first data identifier, wherein the backup data comprises first data corresponding to the first data identifier or change information of the first data corresponding to the first data identifier; and sending the backup data to a preset storage node to backup the first data.
In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving first user attribute information sent by the management node; the step of sending the backup data to a preset storage node to backup the first data includes: sending a data storage request to the storage node, where the data storage request carries the backup data, the first user attribute information, and the first data identifier, so that the storage node performs hash calculation according to the first user attribute information and the first data identifier to obtain a first hash value, and stores the backup data according to the first hash value.
In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving second user attribute information sent by the management node; receiving a data restoration request sent by the management node, wherein the data restoration request carries a second data identifier; acquiring a second host identifier corresponding to the second data identifier; sending a second data acquisition request to the storage node, wherein the second data acquisition request carries a second data identifier and second user attribute information, so that the storage node performs hash calculation according to the second user attribute information and the second data identifier to obtain a second hash value, and acquires second data corresponding to the second data identifier according to the second hash value; and receiving the second data returned by the storage node, and sending the second data to a second host corresponding to the second host identifier.
In one embodiment, a first virtual machine and a second virtual machine are created on the transit node, and the method further includes: receiving a network address configuration request of a virtual machine, wherein the network address configuration request carries the first network address and the second network address; the first network address is allocated to the first virtual machine, and a second network address is allocated to the second virtual machine.
In one embodiment, the first backup request carries the first host identifier and the first data identifier, and the step of obtaining the first host identifier corresponding to the first data identifier includes: and analyzing the first data backup request to obtain the first data identifier and the first host identifier.
In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when executed by a processor, the computer program causes the processor to receive a first data backup request sent by the management node, where the first data backup request carries a first data identifier; acquiring a first host identifier corresponding to the first data identifier; sending a first data acquisition request to a first host corresponding to the first host identifier, wherein the first data acquisition request carries the first data identifier; receiving backup data returned by the first host according to the first data identifier, wherein the backup data comprises first data corresponding to the first data identifier or change information of the first data corresponding to the first data identifier; and sending the backup data to a preset storage node to backup the first data.
In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving first user attribute information sent by the management node; the step of sending the backup data to a preset storage node to backup the first data includes: sending a data storage request to the storage node, where the data storage request carries the backup data, the first user attribute information, and the first data identifier, so that the storage node performs hash calculation according to the first user attribute information and the first data identifier to obtain a first hash value, and stores the backup data according to the first hash value.
In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving second user attribute information sent by the management node; receiving a data restoration request sent by the management node, wherein the data restoration request carries a second data identifier; acquiring a second host identifier corresponding to the second data identifier; sending a second data acquisition request to the storage node, wherein the second data acquisition request carries a second data identifier and second user attribute information, so that the storage node performs hash calculation according to the second user attribute information and the second data identifier to obtain a second hash value, and acquires second data corresponding to the second data identifier according to the second hash value; and receiving the second data returned by the storage node, and sending the second data to a second host corresponding to the second host identifier.
In one embodiment, a first virtual machine and a second virtual machine are created on the transit node, and the method further includes: receiving a network address configuration request of a virtual machine, wherein the network address configuration request carries the first network address and the second network address; the first network address is allocated to the first virtual machine, and a second network address is allocated to the second virtual machine.
In one embodiment, the first backup request carries the first host identifier and the first data identifier, and the step of obtaining the first host identifier corresponding to the first data identifier includes: and analyzing the first data backup request to obtain the first data identifier and the first host identifier.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, or a Read-Only Memory (ROM).
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A data processing method applied to a transit node, where the transit node is allocated with a first network address and a second network address, the first network address is used for communicating with a management node, the second network address is used for communicating with a host corresponding to the transit node, and a host area corresponding to the transit node is provided with multiple hosts, the method comprising:
receiving a first data backup request sent by the management node, where the first data backup request carries a first data identifier, the first data backup request is triggered by the management node in response to a second data backup request, the second data backup request carries the first data identifier and a corresponding host area identifier, and the management node obtains a transit node corresponding to the first data identifier according to the host area identifier and sends the first data backup request to the transit node;
acquiring a first host identifier corresponding to the first data identifier;
sending a first data acquisition request to a first host corresponding to the first host identifier, wherein the first data acquisition request carries the first data identifier;
receiving backup data returned by the first host according to the first data identifier, wherein the backup data comprises first data corresponding to the first data identifier or change information of the first data corresponding to the first data identifier;
and sending the backup data to a preset storage node to backup the first data.
2. The method of claim 1, further comprising:
receiving first user attribute information sent by the management node;
the step of sending the backup data to a preset storage node to backup the first data includes:
sending a data storage request to the storage node, where the data storage request carries the backup data, the first user attribute information, and the first data identifier, so that the storage node performs hash calculation according to the first user attribute information and the first data identifier to obtain a first hash value, and stores the backup data according to the first hash value.
3. The method of claim 1, further comprising:
receiving second user attribute information sent by the management node;
receiving a data restoration request sent by the management node, wherein the data restoration request carries a second data identifier;
acquiring a second host identifier corresponding to the second data identifier;
sending a second data acquisition request to the storage node, wherein the second data acquisition request carries a second data identifier and second user attribute information, so that the storage node performs hash calculation according to the second user attribute information and the second data identifier to obtain a second hash value, and acquires second data corresponding to the second data identifier according to the second hash value;
and receiving the second data returned by the storage node, and sending the second data to a second host corresponding to the second host identifier.
4. The method of claim 1, wherein a first virtual machine and a second virtual machine are created on the transit node, and wherein the method further comprises:
receiving a network address configuration request of a virtual machine, wherein the network address configuration request carries the first network address and the second network address;
the first network address is allocated to the first virtual machine, and a second network address is allocated to the second virtual machine.
5. The method according to claim 1, wherein the first data backup request carries the first host identifier and the first data identifier, and the step of obtaining the first host identifier corresponding to the first data identifier includes:
and analyzing the first data backup request to obtain the first data identifier and the first host identifier.
6. A data processing apparatus, applied to a transit node, where the transit node is allocated with a first network address and a second network address, the first network address is used for communicating with a management node, the second network address is used for communicating with a host corresponding to the transit node, a host area corresponding to the transit node is provided with a plurality of hosts, the apparatus includes:
a first data backup request receiving module, configured to receive a first data backup request sent by the management node, where the first data backup request carries a first data identifier, the first data backup request is triggered by the management node in response to a second data backup request, the second data backup request carries the first data identifier and a corresponding host area identifier, and the management node obtains a transit node corresponding to the first data identifier according to the host area identifier and sends the first data backup request to the transit node;
the first identifier acquisition module is used for acquiring a first host identifier corresponding to the first data identifier;
a first obtaining request sending module, configured to send a first data obtaining request to a first host corresponding to the first host identifier, where the first data obtaining request carries the first data identifier;
a data receiving module, configured to receive backup data returned by the first host according to the first data identifier, where the backup data includes first data corresponding to the first data identifier or change information of the first data corresponding to the first data identifier;
and the backup module is used for sending the backup data to a preset storage node so as to backup the first data.
7. The apparatus of claim 6, further comprising:
the first attribute information acquisition module is used for receiving first user attribute information sent by the management node;
the backup module is configured to:
sending a data storage request to the storage node, where the data storage request carries the backup data, the first user attribute information, and the first data identifier, so that the storage node performs hash calculation according to the first user attribute information and the first data identifier to obtain a first hash value, and stores the backup data according to the first hash value.
8. A data processing system, characterized in that the data processing system comprises:
a management node to: receiving a second data backup request, wherein the second data backup request carries a first data identifier and a corresponding host area identifier, acquiring a transfer node corresponding to the first data identifier according to the host area identifier, and sending a first data backup request to the transfer node, wherein the first data backup request carries the first data identifier;
the transit node is allocated with a first network address and a second network address, the first network address is used for communicating with the management node, the second network address is used for communicating with a host corresponding to the transit node, a host area corresponding to the transit node is provided with a plurality of hosts, and the transit node is used for executing the steps of the data processing method according to any one of claims 1 to 5.
9. A computer arrangement, comprising a memory and a processor, the memory having stored therein a computer program that, when executed by the processor, causes the processor to carry out the steps of the data processing method of any one of claims 1 to 5.
10. A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, causes the processor to carry out the steps of the data processing method of any one of claims 1 to 5.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710959500.1A CN107819891B (en) | 2017-10-16 | 2017-10-16 | Data processing method, data processing device, computer equipment and storage medium |
| PCT/CN2017/108291 WO2019075773A1 (en) | 2017-10-16 | 2017-10-30 | Data processing method and apparatus, computer device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710959500.1A CN107819891B (en) | 2017-10-16 | 2017-10-16 | Data processing method, data processing device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107819891A CN107819891A (en) | 2018-03-20 |
| CN107819891B true CN107819891B (en) | 2020-01-24 |
Family
ID=61607279
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710959500.1A Active CN107819891B (en) | 2017-10-16 | 2017-10-16 | Data processing method, data processing device, computer equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107819891B (en) |
| WO (1) | WO2019075773A1 (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111291000B (en) * | 2018-05-18 | 2023-11-03 | 腾讯科技（深圳）有限公司 | File acquisition method, equipment and storage medium based on block chain |
| CN109032837A (en) | 2018-06-15 | 2018-12-18 | 华为技术有限公司 | The method and apparatus of data backup |
| CN111352767B (en) * | 2018-12-24 | 2023-07-18 | 中国电信股份有限公司 | Network function virtualization platform resource management method, backup platform and system |
| CN109885424B (en) * | 2019-01-16 | 2024-05-31 | 平安科技（深圳）有限公司 | Data backup method and device and computer equipment |
| CN109885431B (en) * | 2019-03-06 | 2022-02-25 | 北京百度网讯科技有限公司 | Method and apparatus for backing up data |
| CN111835808B (en) * | 2019-08-01 | 2023-11-14 | 北京骑胜科技有限公司 | Data storage method and device, data reading method and device, and storage medium |
| CN111274066B (en) * | 2020-02-03 | 2023-04-07 | 北京淳中科技股份有限公司 | Data backup method, device and system |
| CN111382012B (en) * | 2020-03-03 | 2020-12-29 | 广州鼎甲计算机科技有限公司 | Backup method and device for MySQL cloud database, computer equipment and storage medium |
| CN113342579A (en) * | 2021-07-05 | 2021-09-03 | 湖南快乐阳光互动娱乐传媒有限公司 | Data restoration method and device |
| CN113691520B (en) * | 2021-08-18 | 2023-07-14 | 浙江大华技术股份有限公司 | Method and device for acquiring streaming media information, storage medium and electronic device |
| CN113986620B (en) * | 2021-12-28 | 2022-04-12 | 国网浙江省电力有限公司 | Multi-region information backup verification recovery method and device suitable for middle station |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105159943A (en) * | 2015-08-07 | 2015-12-16 | 北京思特奇信息技术股份有限公司 | Automatic backup method and system for distributed database |
| CN105912422A (en) * | 2016-04-05 | 2016-08-31 | 广州杰赛科技股份有限公司 | Data backup method, backup client and data backup system |
| CN107094167A (en) * | 2016-12-28 | 2017-08-25 | 北京小度信息科技有限公司 | A kind of data conversion storage method and device |
| CN107231396A (en) * | 2016-03-25 | 2017-10-03 | 阿里巴巴集团控股有限公司 | Data manipulation method, device, transferring equipment and client |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101197754B (en) * | 2007-12-27 | 2011-11-16 | 腾讯科技（深圳）有限公司 | Distributed system, distributed service processing method and correlated device |
| CN102571968B (en) * | 2012-01-17 | 2014-09-24 | 华中科技大学 | Directional data forwarding method in cloud backup system |
| CN103336730B (en) * | 2013-06-05 | 2016-02-10 | 中国人民解放军国防科学技术大学 | A kind of data back up method based on cloud storage and system |
| CN103905526A (en) * | 2014-03-05 | 2014-07-02 | 深圳市同洲电子股份有限公司 | Dispatching method and server |
-
2017
- 2017-10-16 CN CN201710959500.1A patent/CN107819891B/en active Active
- 2017-10-30 WO PCT/CN2017/108291 patent/WO2019075773A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105159943A (en) * | 2015-08-07 | 2015-12-16 | 北京思特奇信息技术股份有限公司 | Automatic backup method and system for distributed database |
| CN107231396A (en) * | 2016-03-25 | 2017-10-03 | 阿里巴巴集团控股有限公司 | Data manipulation method, device, transferring equipment and client |
| CN105912422A (en) * | 2016-04-05 | 2016-08-31 | 广州杰赛科技股份有限公司 | Data backup method, backup client and data backup system |
| CN107094167A (en) * | 2016-12-28 | 2017-08-25 | 北京小度信息科技有限公司 | A kind of data conversion storage method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107819891A (en) | 2018-03-20 |
| WO2019075773A1 (en) | 2019-04-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107819891B (en) | Data processing method, data processing device, computer equipment and storage medium | |
| US11088903B2 (en) | Hybrid cloud network configuration management | |
| US9501345B1 (en) | Method and system for creating enriched log data | |
| US9313281B1 (en) | Method and system for creating and dynamically deploying resource specific discovery agents for determining the state of a cloud computing environment | |
| WO2015167595A1 (en) | Network infrastructure management | |
| CA2937813C (en) | Method and system for providing a robust and efficient virtual asset vulnerability management and verification service | |
| US20150128130A1 (en) | Method and system for providing and dynamically deploying hardened task specific virtual hosts | |
| US10425475B2 (en) | Distributed data management | |
| CN111459749A (en) | Prometous-based private cloud monitoring method and device, computer equipment and storage medium | |
| US20190253458A1 (en) | System and method for configuration of a connected device connection | |
| CN111818081A (en) | Virtual encryption machine management method and device, computer equipment and storage medium | |
| US9847927B2 (en) | Information processing device, method, and medium | |
| CN113067824B (en) | Data scheduling method, system, virtual host and computer readable storage medium | |
| CN111600755B (en) | Internet access behavior management system and method | |
| CN108829340B (en) | Storage processing method, device, storage medium and processor | |
| CN111259376A (en) | Authority configuration method, device, server and storage medium | |
| CN106936643B (en) | Equipment linkage method and terminal equipment | |
| CN116489123A (en) | Industrial Internet identification-based processing method and device | |
| CN111447080B (en) | Private network decentralization control method, device and computer readable storage medium | |
| US11487570B1 (en) | Efficient creation of endpoints for accessing services directly within a cloud-based system | |
| CN105939278B (en) | Traffic processing method and device | |
| CN110324826B (en) | Intranet access method and related device | |
| CN112217770B (en) | Security detection method, security detection device, computer equipment and storage medium | |
| CN111884837A (en) | Migration method and device of virtual encryption machine and computer storage medium | |
| CN112631996A (en) | Log searching method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |