CN116225832A

CN116225832A - Automatic detection method, storage medium and equipment for automatic deployment of database cluster

Info

Publication number: CN116225832A
Application number: CN202211666622.9A
Authority: CN
Inventors: 高杨; 李翔
Original assignee: Beijing Kingbase Information Technologies Co Ltd
Current assignee: Beijing Kingbase Information Technologies Co Ltd
Priority date: 2022-12-23
Filing date: 2022-12-23
Publication date: 2023-06-06

Abstract

The invention provides an automatic detection method, a storage medium and equipment for automatic deployment of a database cluster, wherein the automatic detection method comprises the steps of attempting to acquire a deployment process log generated by the automatic deployment; if the trial result is successful, determining that the automated deployment is executed; judging whether the automatic deployment is successful or not according to the deployment process log; if not, attempting to acquire a failure position of automatic deployment; if the result of the attempt is successful, executing partial automatic deployment according to the failure position; if the result of the attempt is failure, a fully automated deployment is performed. According to the automatic detection method for the automatic deployment of the database cluster, the automatic deployment can be continued or restarted under the condition that the automatic deployment fails.

Description

Automatic detection method, storage medium and equipment for automatic deployment of database cluster

Technical Field

The present invention relates to the field of databases, and in particular, to an automatic detection method, a storage medium, and an apparatus for automatic deployment of a database cluster.

Background

With the rapid development of informatization technology, the application of databases is becoming more and more widespread, and in particular, higher requirements are put on the high availability and high reliability of databases. Aiming at the cluster installation and deployment of a large number of database nodes, automatic deployment is needed, and the installation and deployment work of the database clusters can be completed through simple configuration.

However, a problem is also brought about, in the automatic deployment process, the database cluster suddenly collapses, so that the automatic deployment fails, and the environment abnormality cannot be automatically deployed again because the deployment is not known to be performed, so that the problem that the professional is required to process the database cluster to meet the installation requirement and then the automatic deployment can be continuously performed is brought about, and the problems of higher operation complexity, stronger technical performance, easiness in error, long time consumption and the like are brought.

Disclosure of Invention

It is an object of the present invention to provide an automatic detection method, a storage medium and a device for automated deployment of a database cluster, which can solve any of the above problems.

It is a further object of the present invention to enable a database cluster to resume or continue an automated deployment after an automated deployment failure.

In particular, the invention provides an automatic detection method for automatic deployment of database clusters, which comprises the following steps:

attempting to acquire a deployment process log generated by automated deployment;

if the trial result is successful, determining that the automated deployment is executed;

judging whether the automatic deployment is successful or not according to the deployment process log;

if not, attempting to acquire a failure position of automatic deployment;

if the result of the attempt is successful, executing partial automatic deployment according to the failure position;

if the result of the attempt is failure, a fully automated deployment is performed.

Further, the step of performing a partially automated deployment based on the failure location comprises:

recording the step number of the failure position and the corresponding error code;

outputting corresponding error detailed information according to the error code;

transmitting the error detailed information to a first preset terminal;

acquiring an error repair completion instruction;

rolling back the automatic deployment process to the step corresponding to the step number so that the automatic deployment process returns to a correct state;

starting from the corresponding position of the step number until the automatic deployment process is successful.

Further, the step of performing a fully automated deployment comprises:

initializing a system environment and acquiring configuration parameters;

judging whether the system environment meets the installation requirement of automatic deployment;

if yes, creating and completing a node to be installed, wherein the node to be installed comprises a master node and a plurality of slave nodes;

performing encryption-free certificate authentication among all nodes to be installed;

performing related file exchange of the copy operation and the search operation;

reading the configuration parameters and analyzing to obtain corresponding configuration information;

and completing configuration installation of the master node and the plurality of slave nodes according to the configuration information.

Further, the step of performing secret-certificate-free authentication between the nodes to be installed includes:

generating a public key and a secret key;

filling the public key of each node into the key storage files of all nodes, and setting file attributes.

Further, the step of determining whether the system environment meets the installation requirement of the automated deployment includes:

detecting whether a user configuration and a host are started or not;

if yes, determining that the system environment meets the installation requirement.

Further, the step of completing configuration installation of the master node and the plurality of slave nodes according to the configuration information includes:

automatically remotely logging in a master node, creating all node configuration files to be installed according to configuration information and giving weight;

creating a master node database;

distributing the configuration file from the master node database to each slave node of the database cluster;

automatic remote login is performed to each slave node to create a slave node database.

Further, the first preset terminal is a staff terminal for executing the repair operation.

Further, the step of attempting to obtain a deployment process log generated by the automated deployment may further comprise:

if the result of the attempt is failure, determining that the automatic deployment process is not executed, and executing the fully-automatic deployment.

According to another aspect of the present invention, there is also provided a machine-readable storage medium having stored thereon a machine-executable program which, when executed by a processor, implements an automatic detection method for automated deployment of any one of the database clusters described above.

According to another aspect of the present invention, there is also provided a computer device including a memory, a processor, and a machine executable program stored on the memory and running on the processor, and the processor implementing any one of the above automatic detection methods for automated deployment of database clusters when executing the machine executable program.

The automatic detection method for automatic deployment of the database cluster comprises the following steps: attempting to acquire a deployment process log generated by the automated deployment; if the result of the attempt is successful, determining that the automated deployment has been executed; judging whether the automatic deployment is successful or not according to the deployment process log; if not, attempting to acquire the failure position of the automatic deployment; if the result of the attempt is successful, executing partial automatic deployment according to the failure position; if the result of the attempt is failure, a fully automated deployment is performed. According to the automatic detection method for the automatic deployment of the database cluster, the automatic deployment can be continued under the condition that the automatic deployment fails.

The above, as well as additional objectives, advantages, and features of the present invention will become apparent to those skilled in the art from the following detailed description of a specific embodiment of the present invention when read in conjunction with the accompanying drawings.

Drawings

Some specific embodiments of the invention will be described in detail hereinafter by way of example and not by way of limitation with reference to the accompanying drawings. The same reference numbers will be used throughout the drawings to refer to the same or like parts or portions. It will be appreciated by those skilled in the art that the drawings are not necessarily drawn to scale. In the accompanying drawings:

FIG. 1 is a schematic diagram of a database cluster according to one embodiment of the invention;

FIG. 2 is a schematic side view of an automated inspection method of automated deployment of database clusters according to one embodiment of the invention;

FIG. 3 is a schematic side view of an automated inspection method of automated deployment of database clusters according to one embodiment of the invention;

FIG. 4 is a schematic side view of an automated inspection method of automated deployment of database clusters according to one embodiment of the invention;

FIG. 5 is a schematic side view of an automated inspection method of automated deployment of database clusters according to one embodiment of the invention;

FIG. 6 is a schematic diagram of a machine-readable storage medium according to one embodiment of the invention; and

FIG. 7 is a schematic diagram of a computer device according to one embodiment of the invention.

Detailed Description

FIG. 1 is a schematic diagram of a database cluster according to one embodiment of the invention. The database cluster 100 of the present embodiment includes cluster management software 110. Cluster management software 110 includes an auto-deployment module 112 and an auto-detection module 111. The automatic detection module 111 may detect the deployment situation, know how far the deployment proceeds, etc., so that the automatic deployment may be performed again after the automatic deployment fails.

FIG. 2 is a schematic side view of an automated inspection method of automated deployment of database clusters according to one embodiment of the invention. The automatic detection method for automatic deployment of the database cluster in the embodiment comprises the following steps:

step S202, attempting to acquire a deployment process log generated by automated deployment. If the result of the attempt is successful, step S204 is performed. If the result of the attempt is failure, determining that the automatic deployment process is not executed, and executing the fully-automatic deployment.

Step S204, determining that automated deployment has been performed. Searching logs generated by automatic deployment, and recording the whole deployment process in detail by the deployment process logs. The automatic deployment can be judged whether to be performed or not through the deployment process log, if the deployment process log is found, the automatic deployment operation is indicated, and if the automatic deployment operation is not found, the automatic deployment is not performed.

Step S206. And judging whether the automatic deployment is successful or not according to the deployment process log. If yes, go to step S208.

Step S208, an attempt is made to obtain a failure location for the automated deployment. If the result of the attempt is successful, step S210 is executed; if the result of the attempt is failure, step 212 is performed. After finding the log, checking the log information of the deployment process to show whether the deployment is successful. If the result is successfully displayed, the next automatic deployment can be directly carried out; if the result shows failure, searching for the deployment failure caused by the steps.

Step S210, performing partial automatic deployment according to the failure position. If the number of steps of the deployment failure is found, the correct state before the failure step is rolled back, and when the automatic deployment is executed again, the deployment is continued from the step without restarting, and the deployment can be defined as partial automatic deployment.

Step S212, a fully automated deployment is performed. If the deployment failure caused by the steps is not found, the initialization environment is directly carried out, and the automatic deployment is restarted, which can be defined as the fully-automatic deployment.

According to the automatic detection method for the automatic deployment of the database cluster, the automatic deployment can be continued under the condition that the automatic deployment fails.

FIG. 3 is a schematic side view of an automated inspection method of automated deployment of database clusters according to one embodiment of the invention. The step of performing a partially automated deployment according to the failure location of the present embodiment includes:

step S302, recording the step number of the failure position and the corresponding error code. In the deployment process, when the n-th step is executed, the database suddenly crashes, so that the deployment cannot be continuously executed. The automatic detection module records the execution step sequence number n and the error code deployed at the time.

Step S304, outputting corresponding error detailed information according to the error code. And outputting corresponding error detailed information according to the error code.

Step S306, the error detailed information is sent to the first preset terminal. The first preset terminal may be a worker terminal that performs a repair operation. That is, error detailed information may be provided to the operator. After the operator repairs the error according to the error detailed information, the operator sends the repaired instruction to inform the automatic detection module, and the automatic detection module starts to roll back to the correct state before executing the nth step after receiving the instruction.

Step S308, obtaining an error repair completion instruction.

Step S310, rollback the automatic deployment process to the step corresponding to the step number, so that the automatic deployment process returns to the correct state. After the rollback is successful, the automatic detection module informs the automatic deployment module that the error has been repaired, and the deployment is required to be continuously executed from the nth step.

Step S312, starting from the position corresponding to the step number until the automatic deployment process is successful. After the automatic deployment module receives the notification, the automatic deployment module continues to execute according to the nth step of the fully-automatic deployment execution flow until the deployment is successful.

FIG. 4 is a schematic side view of an automated inspection method of automated deployment of database clusters according to one embodiment of the invention. The steps of the present embodiment for performing fully automated deployment include:

step S402, initializing a system environment and acquiring configuration parameters. The automatic detection module informs the automatic deployment module to initialize the environment, and the user sets parameters.

Step S404, judging whether the system environment meets the installation requirement of automatic deployment. The automatic detection module detects whether the user configuration and the host are started or not, and whether the system environment meets the installation requirement or not. If yes, go to step S406.

In step S406, the node to be installed is created. The automatic deployment module creates a user who completes the node to be installed. The node to be installed comprises a master node and a plurality of slave nodes.

And step S408, performing encryption-free certificate authentication on each node to be installed. The automatic deployment module completes the authentication of the secret-free certificates among all the installation nodes, and comprises the steps of generating ssh public keys and secret keys, filling the public keys of all the nodes into keys files of all the nodes, and setting file attributes.

In step S410, the related files of the copy operation and the related files of the search operation are exchanged. The automatic deployment module performs copy and fetch related file exchange.

Step S412, reading the configuration parameters and analyzing to obtain the corresponding configuration information. The automatic deployment module reads configuration information to be realized in the configuration file.

Step S414, the configuration installation of the master node and the plurality of slave nodes is completed according to the configuration information.

In some embodiments, the step of performing the certificate-free authentication between the nodes to be installed includes: generating a public key and a secret key, filling the public key of each node into the secret key storage files of all nodes, and setting file attributes.

In some embodiments, the step of determining whether the system environment meets the installation requirements of the automated deployment comprises: detecting whether a user configuration and a host are started or not; if yes, determining that the system environment meets the installation requirement.

FIG. 5 is a schematic side view of an automated inspection method of automated deployment of database clusters according to one embodiment of the invention. The step of completing configuration installation of the master node and the plurality of slave nodes according to the configuration information in this embodiment includes:

step S502, automatically remotely logging in the master node, creating all node configuration files to be installed according to the configuration information and giving weight. The automatic deployment module automatically remotely logs in the main node to create all node configuration files and assign weight to finish the operation of initializing the main node.

Step S504, a master node database is created.

Step S506, distributing the configuration file from the master node database to each slave node of the database cluster.

Step S508, automatically remotely logging in each slave node to perform the operation of creating a slave node database. The automatic deployment module creates a master node database, distributes configuration files from the master node to each slave node, and finally automatically remotely logs in each slave node to create a standby node operation.

The database cluster management software of the embodiment is additionally provided with an automatic detection module, which is used for detecting whether the log and the environment generated by the database cluster meet the installation and deployment conditions, recording the steps of automatic deployment failure, error detailed information and other operations, so that the function of automatic deployment can be continuously carried out under the condition of automatic deployment failure.

The effect of the scheme (scheme 3) of the present embodiment is reflected by comparison of the following three schemes. Scheme 1: and the main and standby database clusters are deployed by manual operation. Scheme 2: the main and standby database clusters and the automatic deployment module have an automatic deployment function. Scheme 3: the main and standby database clusters, the automatic deployment module and the automatic detection module have an automatic deployment function.

TABLE 1

As shown in table 1, compared with the main and standby database clusters in scheme 1, the automatic detection method for automatic deployment of the database clusters of the embodiment can perform automatic deployment, and compared with scheme 2, an automatic detection module is added, and under the condition that the automatic deployment fails, the automatic deployment can be continued as the case may be.

The present embodiment also provides a machine-readable storage medium and a computer device. Fig. 6 is a schematic diagram of a machine-readable storage medium according to one embodiment of the invention, and fig. 7 is a schematic diagram of a computer device according to one embodiment of the invention.

The machine-readable storage medium 40 has stored thereon a machine-executable program 41, which when executed by a processor implements the database data synchronization method of any of the embodiments described above.

The computer device 50 may include a memory 520, a processor 510, and a machine executable program 41 stored on the memory 520 and running on the processor 510, and the processor 510 implements the database data synchronization method of any of the embodiments described above when executing the machine executable program 41.

It should be noted that the logic and/or steps represented in the flow diagrams or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any machine-readable storage medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.

For the purposes of this description of embodiments, a machine-readable storage medium 40 can be any apparatus that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). In addition, the computer-readable medium 40 may even be paper or other suitable medium on which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.

It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.

The computer device 50 may be, for example, a server, a desktop computer, a notebook computer, a tablet computer, or a smart phone. In some examples, computer device 50 may be a cloud computing node. Computer device 50 may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, etc. that perform particular tasks or implement particular abstract data types. Computer device 50 may be implemented in a distributed cloud computing environment where remote processing devices coupled via a communications network perform tasks. In a distributed cloud computing environment, program modules may be located in both local and remote computing system storage media including memory storage devices.

Computer device 50 may include a processor 510 adapted to execute stored instructions, a memory 520 providing temporary storage for the operation of the instructions during operation. Processor 510 may be a single core processor, a multi-core processor, a computing cluster, or any number of other configurations. Memory 520 may include Random Access Memory (RAM), read only memory, flash memory, or any other suitable storage system.

The processor 510 may also be linked through a system interconnect to a display interface suitable for connecting the computer device 50 to a display device. The display device may include a display screen as a built-in component of the computer device 50. The display device may also include a computer monitor, television, projector, or the like, that is externally connected to the computer device 50. Further, a network interface controller (network interface controller, NIC) may be adapted to connect the computer device 50 to a network through a system interconnect. In some embodiments, the NIC may use any suitable interface or protocol (such as an internet small computer system interface, etc.) to transfer data. The network may be a cellular network, a radio network, a Wide Area Network (WAN), a Local Area Network (LAN), or the internet, among others. The remote device may be connected to the computing device through a network.

The flowcharts provided by this embodiment are not intended to indicate that the operations of the method are to be performed in any particular order, or that all of the operations of the method are included in all of each case. Furthermore, the method may include additional operations. Additional variations may be made to the above-described methods within the scope of the technical ideas provided by the methods of the present embodiments.

By now it should be appreciated by those skilled in the art that while a number of exemplary embodiments of the invention have been shown and described herein in detail, many other variations or modifications of the invention consistent with the principles of the invention may be directly ascertained or inferred from the present disclosure without departing from the spirit and scope of the invention. Accordingly, the scope of the present invention should be understood and deemed to cover all such other variations or modifications.

Claims

1. An automatic detection method for automatic deployment of a database cluster, comprising the following steps:

attempting to acquire a deployment process log generated by the automated deployment;

if the result of the attempt is successful, determining that the automated deployment has been executed;

if not, attempting to acquire the failure position of the automatic deployment;

2. The method for automatically detecting a database cluster automation deployment of claim 1, wherein the step of performing a partial automation deployment based on the failure location comprises:

the error detailed information is sent to a first preset terminal;

acquiring an error repair completion instruction;

starting from the position corresponding to the step number until the automatic deployment process is successful.

3. The method for automated inspection of a database cluster automation deployment of claim 1, wherein the step of performing a fully automated deployment comprises:

initializing a system environment and acquiring configuration parameters;

judging whether the system environment meets the installation requirement of the automatic deployment or not;

performing secret-free certificate authentication among the nodes to be installed;

reading the configuration parameters, and analyzing to obtain corresponding configuration information;

4. The method for automatically detecting automatic deployment of database clusters according to claim 3, wherein said step of performing certificate-free authentication between said nodes to be installed comprises:

generating a public key and a secret key;

filling the public key of each node into key storage files of all nodes, and setting file attributes.

5. The method for automatically detecting a database cluster automation deployment of claim 3, wherein the step of determining whether the system environment meets the installation requirements of the automation deployment comprises:

detecting whether a user configuration and a host are started or not;

6. The method for automatically detecting a database cluster automation deployment of claim 3, wherein the step of completing configuration installation of the master node and the plurality of slave nodes according to the configuration information comprises:

automatically remotely logging in the master node, creating all the node configuration files to be installed according to the configuration information, and giving weight;

creating a master node database;

and automatically remotely logging in each slave node to perform the operation of creating a slave node database.

7. The method for automated inspection of a database cluster automation deployment of claim 2, wherein,

the first preset terminal is a staff terminal for executing repair operation.

8. The method for automatically detecting a database cluster automation deployment of claim 1, wherein the step of attempting to obtain a deployment process log generated by the automation deployment further comprises, after:

9. A machine-readable storage medium having stored thereon a machine-executable program which when executed by a processor implements the method for automated detection of automated deployment of database clusters according to any one of claims 1 to 8.

10. A computer device comprising a memory, a processor and a machine executable program stored on the memory and running on the processor, and the processor when executing the machine executable program implements the method for automatically detecting an automated deployment of a database cluster according to any of claims 1 to 8.