CN110221868B - Host system deployment method and device, electronic equipment and storage medium - Google Patents

Host system deployment method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN110221868B
CN110221868B CN201910475611.4A CN201910475611A CN110221868B CN 110221868 B CN110221868 B CN 110221868B CN 201910475611 A CN201910475611 A CN 201910475611A CN 110221868 B CN110221868 B CN 110221868B
Authority
CN
China
Prior art keywords
host
data
mirror image
image data
volume
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910475611.4A
Other languages
Chinese (zh)
Other versions
CN110221868A (en
Inventor
钟晋明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
New H3C Cloud Technologies Co Ltd
Original Assignee
New H3C Cloud Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by New H3C Cloud Technologies Co Ltd filed Critical New H3C Cloud Technologies Co Ltd
Priority to CN201910475611.4A priority Critical patent/CN110221868B/en
Publication of CN110221868A publication Critical patent/CN110221868A/en
Application granted granted Critical
Publication of CN110221868B publication Critical patent/CN110221868B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/4401Bootstrapping
    • G06F9/4411Configuring for operating with peripheral devices; Loading of device drivers

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The disclosure provides a host system deployment method and device, electronic equipment and a storage medium, and relates to the technical field of computers. The method is applied to any host of a super-fusion system, the super-fusion system comprises a plurality of hosts, and each host comprises: the method comprises the steps of generating differential mirror image data corresponding to a host based on system data and reference mirror image data of the local system disk of the host, storing the reference mirror image data and the differential mirror image data to the storage cluster to obtain a network system disk of the host, and establishing a copy binding relationship between the network system disk and the local system disk. The method and the device can improve the utilization rate of the storage resources in the super-fusion system.

Description

Host system deployment method and device, electronic equipment and storage medium
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a method and an apparatus for deploying a host system, an electronic device, and a storage medium.
Background
The hyper-convergence system is characterized in that resources and technologies such as computing, network, storage and server virtualization and the like are provided in the same set of host (for example, an X86 server), elements such as cache acceleration, data de-duplication, online data compression, backup software, snapshot technology and the like are included, and the hosts can be aggregated through the network to realize modular seamless horizontal expansion and form a uniform resource pool.
In the prior art, a super-fusion system may include a plurality of hosts, each host includes a plurality of physical Disks, two of the physical Disks form a RAID (Redundant Array of Independent Disks) 1, a local system disk of the host is formed, other physical Disks are used as data Disks, and the data Disks of the plurality of hosts form a storage cluster of the fusion system.
However, in the prior art, the local system disk of the host needs to occupy two physical disks, thereby reducing the utilization rate of storage resources in the super-fusion system.
Disclosure of Invention
The present disclosure provides a host system deployment method, device, electronic device, and storage medium, so as to improve the utilization rate of storage resources in a super-fusion system.
In order to achieve the purpose, the technical scheme adopted by the disclosure is as follows:
in a first aspect, the present disclosure provides a host system deployment method, applied to any host of a super-fusion system, where the super-fusion system includes a plurality of hosts, and each host includes: a local system disk and a plurality of data disks, the data disks of a plurality of said hosts comprising a storage cluster, said method comprising:
generating difference mirror image data corresponding to the host based on the system data and the reference mirror image data of the local system disk of the host;
storing the reference mirror image data and the difference mirror image data to the storage cluster to obtain a network system disk of the host;
and establishing a copy binding relationship between the network system disk and the local system disk.
Optionally, after the establishing of the copy binding relationship between the network system disk and the local system disk, the method further includes:
configuring a system startup item of the host based on preset host system configuration information, wherein the system startup item comprises a first startup item and/or a second startup item, the first startup item represents that the host is started from the local system disk, and the second startup item represents that the host is started from the network system disk;
when the system startup items comprise a first startup item and a second startup item, configuring the priority of the first startup item and the second startup item.
Optionally, the storing the reference mirror image data and the differential mirror image data to the storage cluster to obtain a network system disk of the host includes:
creating a basic data volume for storing the reference mirror image data in the storage cluster, and creating an extended data volume for storing the difference mirror image data corresponding to the host in the storage cluster;
storing the reference mirror image data to the basic data volume, and storing the difference mirror image data corresponding to the host to the extended data volume;
and taking the basic data volume and the expansion data as network system disks of the host, wherein the basic data volume is associated with the expansion data volume.
Optionally, the method further comprises:
creating a shared storage volume in the storage cluster, determining the reference mirror image data, and storing the reference mirror image data to the shared storage volume;
generating differential mirror image data corresponding to the host based on the system data and the reference mirror image data of the local system disk of the host, including:
generating corresponding virtual mirror image data based on the system data of the local system disk of the host;
generating differential mirror image data corresponding to the host based on the virtual mirror image data and reference mirror image data stored in the shared storage volume;
storing the differential mirrored data in the shared storage volume.
Optionally, the storing the reference mirror data to the basic data volume and storing the difference mirror data corresponding to the host to the extended data volume includes:
storing the reference mirror image data stored in the shared storage volume to the basic data volume, and storing the difference mirror image data corresponding to the host stored in the shared storage volume to the extended data volume;
the method further comprises the following steps:
and deleting the difference mirror image data corresponding to the host stored in the shared storage volume.
In a second aspect, the present disclosure further provides a deployment apparatus of a host system, which is applied to any host of a super-convergence system, where the super-convergence system includes a plurality of hosts, and each host includes: a local system disk and a plurality of data disks, the data disks of a plurality of said hosts forming a storage cluster, said apparatus comprising:
the generating module is used for generating difference mirror image data corresponding to the host based on the system data and the reference mirror image data of the local system disk of the host;
the first storage module is used for storing the reference mirror image data and the difference mirror image data to the storage cluster to obtain a network system disk of the host;
and the establishing module is used for establishing a copy binding relationship between the network system disk and the local system disk.
Optionally, the apparatus further comprises:
the system comprises a first configuration module, a second configuration module and a control module, wherein the first configuration module is used for configuring a system startup item of the host based on preset host system configuration information, the system startup item comprises a first startup item and/or a second startup item, the first startup item represents that the host is started from the local system disk, and the second startup item represents that the host is started from the network system disk;
and the second configuration module is used for configuring the priority of the first startup item and the second startup item when the system startup item comprises the first startup item and the second startup item.
Optionally, the first storage module is specifically configured to:
creating a basic data volume for storing the reference mirror image data in the storage cluster, and creating an extended data volume for storing the difference mirror image data corresponding to the host in the storage cluster;
storing the reference mirror image data to the basic data volume, and storing the difference mirror image data corresponding to the host to the extended data volume;
and taking the basic data volume and the extension data as network system disks of the host, wherein the basic data volume is associated with the extension data volume.
Optionally, the apparatus further comprises:
the second storage module is used for creating a shared storage volume in the storage cluster, determining the reference mirror image data and storing the reference mirror image data to the shared storage volume;
the generation module is specifically configured to:
generating corresponding virtual mirror image data based on the system data of the local system disk of the host;
generating differential mirror image data corresponding to the host based on the virtual mirror image data and reference mirror image data stored in the shared storage volume;
storing the differential mirrored data in the shared storage volume.
Optionally, the first storage module is further configured to:
storing the reference mirror image data stored in the shared storage volume to the basic data volume, and storing the difference mirror image data corresponding to the host stored in the shared storage volume to the extended data volume;
the device further comprises:
and the deleting module is used for deleting the difference mirror image data corresponding to the host stored in the shared storage volume.
In a third aspect, the present disclosure also provides an electronic device, including a computer-readable storage medium storing a computer program and a processor, where the computer program is read by the processor and executed to implement the method in the first aspect.
In a fourth aspect, the present disclosure also proposes a computer-readable storage medium, on which a computer program is stored, which, when read and executed by a processor, implements the method of the first aspect.
In the embodiment of the present disclosure, the host may generate difference mirror image data corresponding to the host based on system data and reference mirror image data of a local system disk of the host, and store the reference mirror image data and the difference mirror image data in the storage cluster, so as to construct a network system disk of the host in a secondary mirror image manner, and further establish a copy binding relationship between the network system disk and the local system disk, that is, data synchronization between the network system disk and the local system disk may be ensured, thereby implementing deployment of the system disk on a physical disk and a partial storage resource of the storage system. Because the corresponding storage resources can be accurately allocated according to the actual size of the operating system when the virtual storage space in the storage cluster is used for storage, compared with a mode of deploying the system disks on two physical disks for the host, the host system deployment mode provided by the embodiment of the disclosure can enable the storage resources occupied by the system disks to be smaller than the two physical disks, and increase the utilization rate of the storage resources of the storage cluster in the fusion system.
Additional features and advantages of the disclosure will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the disclosure. The objectives and other advantages of the disclosure may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
To more clearly illustrate the technical solutions of the present disclosure, the drawings needed for the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present disclosure, and therefore should not be considered as limiting the scope, and those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
FIG. 1 illustrates a schematic structural diagram of a hyper-fusion system provided by the present disclosure;
FIG. 2 is a flow chart illustrating a method for deploying a host according to the present disclosure;
FIG. 3 is a flow chart illustrating another host deployment method provided by the present disclosure;
FIG. 4 illustrates a schematic structural diagram of another hyper-fusion system provided by the present disclosure;
FIG. 5 is a flow chart illustrating another host deployment method provided by the present disclosure;
FIG. 6 is a functional block diagram of a deployment apparatus of a host according to the present disclosure;
FIG. 7 illustrates a functional block diagram of another host deployment apparatus provided by the present disclosure;
FIG. 8 illustrates a functional block diagram of another host deployment apparatus provided by the present disclosure;
FIG. 9 shows a functional block diagram of another host deployment apparatus provided by the present disclosure;
fig. 10 shows a functional module diagram of an electronic device provided by the present disclosure.
Detailed Description
The technical solutions in the present disclosure will be clearly and completely described below with reference to the drawings in the present disclosure.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
Fig. 1 is a schematic structural diagram of a super-fusion system according to the present disclosure. In the embodiment of the present disclosure, in order to improve utilization of the physical disks, only one physical disk may be occupied as a local system disk (e.g., disk 1 in each host shown in fig. 1), and the remaining physical disks are all used as data disks (e.g., disk 2-disk 5 in each host shown in fig. 1), so as to increase storage space in a storage cluster formed by the data disks of the multiple hosts, and in order to ensure reliability of an operating system in the host, a network system disk of each host is deployed in the storage cluster, and the network system disk and the local system disk form a DRBD (Distributed replicated Block Device).
The storage cluster may be a storage System based on distributed block storage, and each host may access the storage cluster through an ISCSI (Internet Small Computer System Interface) _ TGT, where ISCSI _ TGT is an access method supporting an ISCSI protocol.
When the storage is performed through the virtual storage space in the storage cluster, the corresponding storage resources can be accurately allocated according to the actual size of the operating system, so the present disclosure provides a host system deployment method, which can generate a shared data volume, basic data and an extended data volume corresponding to each host in the storage cluster, wherein the basic data volume and the extended data volume constitute a secondary storage. And acquiring reference mirror image data to be stored in the shared data volume, comparing system data of a local system disk of the host with the reference mirror image data to obtain difference mirror image data of the host, wherein the reference mirror image data, the difference mirror image data and a secondary mirror image forming the host are stored in a secondary storage corresponding to the host. The basic data volume may store the reference mirror data, and the extended data volume may store the differential mirror data, so as to obtain the network system disk of the host through deployment, and further establish a copy binding relationship between the local system disk of the host and the network system disk, that is, the deployment of the host system may be completed, so that the host may be started from the local system disk or the network system disk.
Because the system disk can be deployed on one physical disk and part of the storage resources of the storage system, compared with the case that the system disk is deployed on two physical disks aiming at a host, the storage resources occupied by the system disk are smaller than the two physical disks, and the utilization rate of the storage resources of the storage cluster in the fusion system can be increased.
The local system disk is a system disk of a physical disk deployed at the host local end, and correspondingly, the network system disk is a system disk deployed at the network end, and both the local system disk and the network system disk can be used for starting the host operating system.
The system data may be data of an operating system in the host, which may be called by the host at startup.
The operating system may be installed and started by a relevant technician at a host, and of course, in an actual application, at least one application, service, or plug-in may also be installed and deployed in the operating system, for example, a distributed block storage service system for accessing a storage cluster may be installed in the operating system by a host. That is, the operating system in the present disclosure may include an operating system in an initial state of installation, or may include an operating system after being configured by a person skilled in the art.
It should be noted that the system data of the network system disk may be the same as the system data in the local system disk.
The reference mirror data is a reference for generating difference mirror data by comparing virtual disk mirror data corresponding to each host. Correspondingly, the difference mirror image data is mirror image data which shows the difference between the virtual disk mirror image data of the host and the reference mirror image data, so that the virtual disk mirror image data corresponding to the host can be obtained based on the difference mirror image data and the reference mirror image data.
The system data in the host local system disk can be copied to obtain the virtual mirror image data of the host.
For example, the system data of the local system disk may be exported from the Physical disk as virtual mirror data in a preset format by executing a P2V (Physical to virtual) instruction.
It should be noted that the preset format may be determined in advance, for example, the preset format may be a Qcow2 format.
The shared storage volume may be a data volume in a storage cluster, and the shared storage volume may be accessible by various hosts in the super-converged system.
The base data volume may store the base mirror data as a first level of storage and the extended data volume may store the differential mirror data as a second level of storage. Additionally, the base data volume may be associated with and pointed to by the base data volume to the expansion data volume.
It should be noted that the shared storage volume, the base data volume, and the extended data volume may be created in the form of a thin volume.
It should also be noted that the size of the shared storage volume, the base data volume, and the expansion data volume may be 3 times the size of a single physical disk. Of course, in practical applications, the sizes of the shared storage volume, the basic data volume, and the extended data volume may be set in other manners, and this disclosure is not limited in this respect.
And the copying binding relationship between the network system disk and the local system disk is used for regularly synchronizing data between the network system disk and the local system disk.
The following will specifically describe a deployment method of the host system provided by the present disclosure.
Fig. 2 is a schematic flow chart illustrating a method for deploying a host system according to the present disclosure. The method may be applied to any host of the super-converged system shown in fig. 1, the super-converged system including a plurality of hosts, each host including: the system comprises a local system disk and a plurality of data disks, wherein the data disks of a plurality of hosts form a storage cluster. It should be noted that the deployment method of the host system according to the present disclosure is not limited by the specific sequence shown in fig. 2 and described below, and it should be understood that, in other embodiments, the sequence of some steps in the deployment method of the host system according to the present disclosure may be interchanged according to actual needs, or some steps may be omitted or deleted. The flow shown in fig. 2 will be explained in detail below.
Step 201, generating differential mirror image data corresponding to the host based on the system data and the reference mirror image data of the local system disk of the host.
In order to generate a secondary mirror image corresponding to the host, a network system disk is constructed in a mode of a reference mirror image and a differential mirror image so as to further reduce the data volume included in the network system disk, thereby further saving the storage resources in the storage cluster and improving the utilization rate of the physical disk.
Specifically, the host may obtain the reference mirror data, and compare the reference mirror data with system data in a local system of the host, thereby determining a data difference between the system data of the host and the system data in the reference mirror data, and if the difference exists, may generate difference mirror data of the host based on the determined data difference.
The host may obtain the reference mirror image data from a preset storage location.
It should be noted that the preset storage location may be determined in advance, for example, the preset storage location may include the aforementioned storage location set in the shared storage volume of the storage cluster or in the host.
It should be further noted that, when the preset storage location includes a shared storage volume of the storage cluster, each host may share the reference mirror data, so that only one reference mirror data needs to be stored, which further saves storage resources and improves the utilization rate of the storage cluster.
Step 202, storing the reference mirror image data and the difference mirror image data to a storage cluster to obtain a network system disk of the host.
In order to reduce the number of physical disks occupied as local system disks and thereby increase the utilization of the physical disks in the storage cluster, the reference mirror data and the differential mirror data may be stored to the storage cluster.
Specifically, a corresponding storage area may be allocated to the host in the storage cluster, so that the reference mirror image data and the difference mirror image data corresponding to the host are stored in the storage area, and the network system disk of the host is deployed and obtained. For example, the base data volume may store the base mirrored data as a first level of storage and the extension data volume may store the differential mirrored data as a second level of storage.
Alternatively, the host may send a first creation notification to the storage cluster, the first creation notification being used to instruct to create the base data volume and the extended data volume corresponding to the host, and to establish an association between the extended data volume and the base data volume. Accordingly, the storage cluster may create a base data volume and an extended data volume corresponding to the host upon receiving the first creation notification, and determine LUNs (Logical Unit numbers) of the base data volume and the extended data volume.
Step 203, establishing a copy binding relationship between the network system disk and the local system disk.
Therefore, in order to ensure that the host can have the same or similar application environment and state after being started through the local system disk and the network system disk, a copy binding relationship between the network system disk and the local system disk can be established, so that the network system disk and the local system disk regularly perform data synchronization.
The DRBD can bind the local system disk and the network system disk, so as to establish a copy binding relationship between the local system disk and the network system disk.
In the embodiment of the disclosure, the host can generate the difference mirror image data corresponding to the host based on the system data and the reference mirror image data of the local system disk of the host, and store the reference mirror image data and the difference mirror image data to the storage cluster, so as to construct the network system disk of the host in a secondary mirror image manner, and further establish the copy binding relationship between the network system disk and the local system disk, that is, data synchronization between the network system disk and the local system disk can be realized as much as possible, thereby realizing deployment of the system disk on a physical disk and a part of storage resources of the storage system. Because the corresponding storage resources can be accurately allocated according to the actual size of the operating system when the virtual storage space in the storage cluster is used for storage, compared with a method for deploying the system disks on two physical disks by a host, the host deployment method provided by the embodiment of the disclosure can enable the storage resources occupied by the system disks to be smaller than the two physical disks, and increase the utilization rate of the storage resources of the storage cluster in the fusion system.
Fig. 3 is a schematic flow chart illustrating a host system deployment method according to the present disclosure. The method may be applied to any host of the super-converged system shown in fig. 1, the super-converged system comprising a plurality of hosts, each host comprising: the system comprises a local system disk and a plurality of data disks, wherein the data disks of a plurality of hosts form a storage cluster. It should be noted that the deployment method of the host system according to the present disclosure is not limited by the specific sequence shown in fig. 3 and described below, and it should be understood that, in other embodiments, the sequence of some steps in the deployment method of the host system according to the present disclosure may be interchanged according to actual needs, or some steps in the deployment method of the host system may also be omitted or deleted. The flow shown in fig. 3 will be explained in detail below:
step 301, creating a shared storage volume in a storage cluster, determining reference mirror data, and storing the reference mirror data to the shared storage volume.
In order to ensure that each subsequent host can acquire reference mirror image data to complete deployment, improve the reliability of a deployed host system and save storage resources, a shared storage volume which can be shared by each host can be created in a storage cluster, the reference mirror image data can be determined, and the reference mirror image data can be stored in the shared storage volume.
Optionally, the host may send a second create notification to the storage cluster, the second create notification indicating creation of the shared storage volume. Correspondingly, the storage cluster may create and generate the shared storage volume according to the second creation notification, and after the shared storage volume is created, a creation success feedback may be returned to the host, where the creation success feedback is used to indicate that the creation of the shared storage volume is successful, and the creation success feedback may also indicate attribute information such as address information of the shared storage volume and the size of the storage space.
Specifically, the host may determine that the reference mirror data is obtained in any one of the following manners. In a first mode, virtual mirror image data of any host (or a specific host) is determined as the reference mirror image data; in the second mode, acquiring preset virtual mirror image data as the reference mirror image data; in a third mode, the virtual mirror image data of the multiple hosts in the super-fusion system are compared, so that the reference mirror image data is generated based on the common data among the virtual mirror image data of the multiple hosts. Of course, in practical applications, the reference mirror image data may be determined in other manners.
In practical applications, the creation of the shared storage volume in the storage cluster and the determination of the reference mirror data to be stored in the shared storage volume may not be performed in the same step, and for example, the shared storage volume may be created at any time before the reference mirror data is stored.
Step 302, based on the system data of the local system disk of the host and the reference mirror image data, generating difference mirror image data corresponding to the host.
Optionally, as can be seen from the foregoing description, the creating a shared storage volume in a storage cluster, and determining that the reference mirror data is stored in the shared storage volume, and accordingly, the generating differential mirror data corresponding to the host based on the system data of the local system disk of the host and the reference mirror data may include: the method comprises the steps of generating corresponding virtual mirror image data based on system data of a local system disk of a host, generating differential mirror image data corresponding to the host based on the virtual mirror image data and reference mirror image data stored in a shared storage volume, and storing the differential mirror image data in the shared storage volume.
Because the shared storage volume can be in the storage cluster and shared by a plurality of hosts, on one hand, each host can quickly acquire the reference mirror image data from the shared storage volume, on the other hand, the differential mirror image data is also stored in the shared storage volume, and the reference mirror image data and the differential mirror image data can be conveniently and directly acquired from the shared storage volume to deploy a network system disk, so that the efficiency of deploying the host system is improved.
Specifically, the host may generate corresponding virtual mirror data according to system data in a local system disk of the host in a manner of a P2V command or the like, and obtain reference mirror data from the shared storage volume, so as to compare the virtual mirror data with the reference mirror data, thereby obtaining difference mirror data corresponding to the host.
It should be noted that, as can be seen from the foregoing, the reference mirror data may be stored in another preset storage location, and therefore, in practical applications, the host may also obtain the reference mirror data from another preset storage location. Correspondingly, when the difference image data is generated, the virtual image data can also be stored in the other preset storage position.
It should be further noted that, if the host does not acquire the reference mirror data from the shared storage volume, the reference mirror data may be determined and stored to the shared storage volume in any manner of determining the reference mirror data, so that the reference mirror data can be acquired from the shared storage volume when the host system is subsequently deployed.
And 303, storing the reference mirror image data and the difference mirror image data to a storage cluster to obtain a network system disk of the host.
Optionally, the step of storing the reference mirror data and the differential mirror data in the storage cluster to obtain a network system disk of the host may include: and creating a basic data volume for storing the reference mirror data in the storage cluster, creating an extended data volume for storing the differential mirror data corresponding to the host in the storage cluster, storing the reference mirror data to the basic data volume, storing the differential mirror data corresponding to the host to the extended data volume, and taking the basic data volume and the extended data as network system disks of the host, wherein the basic data volume is associated with the extended data volume.
As can be seen from the foregoing, for each host, a network system disk may be deployed through the reference mirror image data and the differential mirror image, so that it is convenient to store the reference mirror image data and the differential mirror image data corresponding to each host, respectively, and ensure that the host can accurately and reliably obtain the reference mirror image data and the differential mirror image data, a base data volume and an extended data volume associated with each host may be created, respectively, and the reference mirror image data is stored in the base data volume, and the differential mirror image data is stored in the extended data volume.
The LUN of the basic data volume may be associated with the LUN of the extended data volume, and the LUN of the basic data volume may point to the LUN of the extended data volume.
Optionally, the step of storing the reference mirror data to the basic data volume and storing the difference mirror data corresponding to the host to the extended data volume may include: and storing the reference mirror image data stored in the shared storage volume to the basic data volume, and storing the difference mirror image data corresponding to the host stored in the shared storage volume to the extended data volume.
Because the shared storage volume, the basic data volume and the extended data volume are all deployed in the storage cluster, the reference mirror image data and the differential mirror image data can be directly acquired from the shared storage volume, and the reference mirror image data and the differential mirror image data are respectively stored in the basic data volume and the extended data volume, so that the storage efficiency is improved.
After the reference mirror data is stored in the basic data volume, the basic data volume may be set to be read-only, and the extended data volume may be set to be read-write.
It should be noted that, since the reference mirror image data and the difference mirror image data may also be stored in other preset storage locations, the host may also acquire the reference mirror image data and the difference mirror image data from the preset storage locations for storage.
In addition, in another optional embodiment of the present disclosure, the super-fusion system may include only 1 base data volume and a plurality of extension data volumes corresponding to the respective hosts, where the base data volume may be accessed by the respective hosts, the base data volume is associated with the extension data volume corresponding to the respective hosts, and the base data volume points to the respective extension data volumes. Accordingly, the reference mirror image may be stored in the basic data volume, and each host may store the differential mirror image corresponding to the host in the extended data volume corresponding to the host.
As can be seen from the foregoing, each host obtains difference mirror image data by comparing with the reference mirror image data, and therefore, the reference mirror image data can be shared by each host, so that only 1 basic data volume shared by each host can be provided in order to further save the storage resources occupied by the system disk and improve the utilization rate of the storage resources in the storage cluster.
For example, after deploying a host system for a hyper-converged system as shown in FIG. 1, the resulting hyper-converged system may be as shown in FIG. 4. As can be seen from fig. 4, the storage cluster in the super-fusion system is provided with 1 base data volume as the first-level storage and 4 extension data volumes as the second-level storage. The base data volume is read-only, with the reference mirror data stored therein. The 4 expansion data volumes are readable and writable, respectively correspond to the hosts 1, 2, 3, and 4, and respectively store the difference mirror data corresponding to the hosts 1, 2, 3, and 4.
Step 304, establishing a copy binding relationship between the network system disk and the local system disk.
As can be seen from the above, after the copy binding relationship between the network system disk and the local system disk of one host is established, after the system data in the local system disk corresponding to the subsequent host is updated, the differential mirror data in the extended data volume corresponding to the one host may be modified.
For the step of establishing the copy binding relationship between the network system disk and the local system disk, reference may be made to the related description in step 203, which is not described in detail here.
Step 305, configuring a system start item of the host based on preset host system configuration information.
The system starting items comprise a first starting item and/or a second starting item, the first starting item represents that the host is started from a local system disk, and the second starting item represents that the host is started from a network system disk. When the system startup items comprise a first startup item and a second startup item, the priority of the first startup item and the second startup item is configured.
Because the network system disk is deployed for the host, in order to ensure that the host can be reliably started when the host comprises the local system disk and the network system disk, and improve the reliability of the host, the system starting item of the host can be configured.
The host system configuration information may include a local boot menu and an iLO boot menu, each of which may include a first start item and/or a second start item.
The local Boot menu may include a GRUB (a multi-operating system Boot program from GNU project) menu in the local system disk Boot partition; the iLO boot menu is the boot menu in the physical machine.
The system boot item is used to explain the manner in which the host boots.
The second starting item may include an IP (Internet Protocol) address and a LUN of the network system disk.
The priority is used to describe the priority of the initiating item. When the host computer starts, the starting can be carried out based on the starting item with the highest priority.
For example, the priority of the first startup item may be set as the master, and the priority of the second startup item may be set as the slave, and since the priority of the first startup item is higher than the priority of the second startup item, it can be ensured that the host performs boot startup preferentially through the local system disk, and if the startup fails, the host performs boot startup through the network system disk in the distributed storage. Of course, in practical applications, the priority of the first startup item may also be higher than that of the second startup item, and the priority order of the second startup item and the first startup item is not specifically limited in the embodiment of the present disclosure.
It should be noted that, in the starting process, the local boot menu first guides the host to start the local system disk, and if the starting fails, then guides the host to start the network system disk; and possibly because the local boot menu cannot boot the host to start the network system disk due to some faults of the local system disk, the host is booted to start the network system disk by adopting the iLO boot menu.
Step 306, deleting the differential mirror data corresponding to the host stored in the shared storage volume.
In order to further save the storage resources and thus improve the utilization rate of the storage resources, the stored difference image data may be deleted after the host system is deployed.
Each host in the super-fusion system can be deployed sequentially in the host deployment mode provided by the present disclosure, and therefore, when the host system completes deployment, the differential mirror data corresponding to the host can be deleted, so that it is ensured that the shared storage volume can only include 1 reference mirror and 1 differential mirror.
Alternatively, in another optional embodiment of the present disclosure, the difference image data corresponding to the host may not be deleted when the host system completes the deployment, but the difference image data corresponding to the previous host is deleted before the next host generates the difference image data corresponding to the host.
Of course, in practical application, the differential mirror data may not be deleted, and accordingly, the shared storage volume may include 1 reference mirror data and N differential mirror data at most, where N is the number of hosts included in the super-fusion system.
In addition, after all the host systems in the super-fusion system are deployed, the data in the shared storage volume can be cleared, so that the storage resources in the shared storage volume are recovered.
In the embodiment of the present disclosure, the host may generate the difference mirror data corresponding to the host based on the system data and the reference mirror data of the local system disk of the host, and store the reference mirror data and the difference mirror data in the storage cluster, so as to construct the network system disk of the host in a secondary mirror manner, and further establish the copy binding relationship between the network system disk and the local system disk, that is, to ensure data synchronization between the network system disk and the local system disk, thereby implementing deployment of the system disk on a physical disk and a partial storage resource of the storage system. Because the corresponding storage resources can be accurately allocated according to the actual size of the operating system when the virtual storage space in the storage cluster is used for storage, compared with a mode of deploying the system disks on two physical disks for the host, the host system deployment mode provided by the embodiment of the disclosure can enable the storage resources occupied by the system disks to be smaller than the two physical disks, and increase the utilization rate of the storage resources of the storage cluster in the fusion system.
Secondly, a shared storage volume shared by the hosts can be created in the storage cluster in advance, and the reference mirror image data is determined to be stored in the shared storage volume, so that the hosts can acquire the reference mirror image data from the shared storage volume, the storage resources are saved, and the reliability of host system deployment is improved.
In addition, the basic data volume and the extended data volume can be respectively set for each host in the storage cluster, so that the basic data volume is used for storing the basic mirror image data, the extended data volume is used for storing the differential mirror image data, namely, the secondary mirror image of the host is stored by creating the secondary storage, the host can be ensured to accurately acquire the basic mirror image data and the differential mirror image data from the basic data volume and the extended data volume, and the reliability of the host is improved.
Fig. 5 is a flowchart illustrating a method for deploying a host system according to the present disclosure. The method can be applied to any host of the super-fusion system shown in fig. 1. It should be noted that the deployment method of the host system according to the present disclosure is not limited by the specific sequence shown in fig. 5 and described below, and it should be understood that, in other embodiments, the sequence of some steps in the deployment method of the host system according to the present disclosure may be interchanged according to actual needs, or some steps may be omitted or deleted. The flow shown in fig. 5 will be explained in detail below.
Step 501, generating a system disk data source.
S1, a system administrator can install and start an operating system on a local physical disk of each host and deploy distributed block storage for providing network storage services in the operating system.
S2, informing the distributed block storage configuration shared storage volume (any host), wherein the size of the shared storage volume is 3 times of the size of a physical disk.
And S2, connecting each host (including the host 1 to the host N) to the shared storage volume.
Wherein N is a positive integer, and the maximum value is the number of hosts.
Step 502, a network system disk is generated.
S1, any host exports the physical disk where the system disk is located into Qcow 2-format virtual mirror image data by executing a P2V command, and stores the virtual mirror image data serving as reference mirror image data Q to a shared storage volume.
And S2, generating virtual mirror image data by each host, comparing the virtual mirror image data with the Q, taking out the different data blocks, and generating the different mirror image data qN.
Step 503, migrating the network system disk.
S1, each host informs distributed storage to create a corresponding basic data volume LUN _0 \\ N and an extended data volume LUN _ N, wherein the LUN _0 \ N points to the LUN _ N.
S2, each host mounts LUN _0_N + LUN _N.
S3, each host writes Q into LUN _0_N, and configures LUN _0 _Nas read-only after the writing is completed.
S4, writing qN into LUN _ N by each host, and establishing the incidence relation between LUN _0 _Nand LUN _ N.
And step 504, binding the local system disk and the network system disk.
S1, each host acquires the current boot cmdlene (command line parser).
S2, each host determines whether the IP address is included according to the boot cmdlene, if yes, the network system disk is started, and if not, the local system disk is started.
And S3, if the local system disk is started, binding the local system disk with the network system disk through the DRBD, and configuring the local system disk as a master and the network system disk as a slave.
And S4, if the network system disk is started, not starting the DRBD.
Step 505, modify the boot menu.
S1, each host modifies GRUB menus of boot partitions of local system disks, and adds the network system disks as second starting items, wherein the second starting items comprise IP addresses and LUNs of the network system disks, and the first starting items are the local system disks.
And S2, each host modifies the iLO menu and adds a network system disk as a second starting item.
Step 506, the shared storage volume is released.
S1, deleting Q and qN.
The implementation principle and technical effect of the method provided in the embodiments of the present disclosure are similar to those of the foregoing method, and are not described herein again.
Referring to fig. 6, a functional module diagram of a deployment apparatus 600 of a host system according to the present disclosure is shown. The deployment apparatus 600 of the host is applied to any host of a super-fusion system, the super-fusion system including a plurality of hosts, each of the hosts including: a local system disk and a plurality of data disks, the data disks of a plurality of the hosts forming a storage cluster. It should be noted that the basic principle and the technical effect of the deployment apparatus 600 of the host system provided in the present embodiment are the same as those of the corresponding method embodiments described above, and for a brief description, reference may be made to corresponding contents in the method embodiments for a part not mentioned in the present embodiment. The deployment apparatus 600 of the host system includes a generation module 601, a first storage module 602, and an establishment module 603.
A generating module 601, configured to generate difference mirror image data corresponding to the host based on system data and reference mirror image data of a local system disk of the host;
a first storage module 602, configured to store the reference mirror data and the differential mirror data in the storage cluster, so as to obtain a network system disk of the host;
an establishing module 603, configured to establish a copy binding relationship between the network system disk and the local system disk.
Optionally, referring to fig. 7, the apparatus further includes:
a first configuration module 604, configured to configure a system boot entry of the host based on preset host system configuration information, where the system boot entry includes a first boot entry and/or a second boot entry, the first boot entry represents that the host boots from the local system disk, and the second boot entry represents that the host boots from the network system disk;
a second configuring module 605, configured to configure priorities of the first startup item and the second startup item when the system startup item includes the first startup item and the second startup item.
Optionally, the first storage module 602 is specifically configured to:
creating a basic data volume for storing the reference mirror data in the storage cluster, and creating an extended data volume for storing the differential mirror data corresponding to the host in the storage cluster;
storing the reference mirror image data to the basic data volume, and storing the difference mirror image data corresponding to the host to the extended data volume;
and taking the basic data volume and the expansion data as network system disks of the host, wherein the basic data volume is associated with the expansion data volume.
Optionally, referring to fig. 8, the apparatus further includes:
a second storage module 606 configured to create a shared storage volume in the storage cluster, determine the reference mirror data, and store the reference mirror data to the shared storage volume;
the generating module 601 is specifically configured to:
generating corresponding virtual mirror image data based on the system data of the local system disk of the host;
generating differential mirror image data corresponding to the host based on the virtual mirror image data and reference mirror image data stored in the shared storage volume;
the differential mirror data is stored in the shared storage volume.
Optionally, the first storage module 602 is further configured to:
storing the reference mirror image data stored in the shared storage volume to the basic data volume, and storing the difference mirror image data corresponding to the host stored in the shared storage volume to the extended data volume;
referring to fig. 9, the apparatus further includes:
a deleting module 607, configured to delete the difference mirror data corresponding to the host stored in the shared storage volume.
The above-mentioned apparatus is used for executing the method provided by the foregoing embodiment, and the implementation principle and technical effect are similar, which are not described herein again.
These above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more microprocessors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), among others. For another example, when one of the above modules is implemented in the form of a Processing element scheduler code, the Processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
Please refer to fig. 10, which is a schematic diagram of a functional module of an electronic device according to the present disclosure. The electronic device may include a computer-readable storage medium 1001 storing a computer program and a processor 1002, and the processor 1002 may call the computer program stored by the computer-readable storage medium 1001. When read and executed by the processor 1002, the computer program may implement the above-described method embodiments. The specific implementation and technical effects are similar, and are not described herein again.
Optionally, the present disclosure also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is read and executed by a processor, the above method embodiments may be implemented.
In the several embodiments provided in the present disclosure, it should be understood that the above-described apparatus embodiments are merely illustrative, and the disclosed apparatus and method may be implemented in other ways. For example, the division of the unit is only a logical function division, and in actual implementation, there may be another division manner, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or may not be executed, for example, each unit may be integrated into one processing unit, each unit may exist alone physically, or two or more units may be integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
The above description is only a preferred embodiment of the present disclosure and is not intended to limit the present disclosure, and various modifications and changes may be made to the present disclosure by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present disclosure should be included in the protection scope of the present disclosure.

Claims (12)

1. A host system deployment method is applied to any host of a super-fusion system, the super-fusion system comprises a plurality of hosts, and each host comprises: the system comprises a local system disk and a plurality of data disks, wherein the data disks of a plurality of hosts form a storage cluster, and the local system disk only comprises a physical disk; the storage cluster comprises: a shared data volume, a basic data volume corresponding to a plurality of hosts and an expansion data volume; the method comprises the following steps:
generating differential mirror image data corresponding to the host based on the system data and the reference mirror image data of the local system disk of the host;
storing the reference mirror image data and the difference mirror image data to the basic data volume and the extended data volume in a storage area corresponding to the host in the storage cluster respectively to obtain a network system disk of the host;
and establishing a copy binding relationship between the network system disk and the local system disk.
2. The method of claim 1, wherein after the establishing the copy binding relationship between the network system disk and the local system disk, the method further comprises:
configuring a system startup item of the host based on preset host system configuration information, wherein the system startup item comprises a first startup item and/or a second startup item, the first startup item represents that the host is started from the local system disk, and the second startup item represents that the host is started from the network system disk;
when the system startup items comprise a first startup item and a second startup item, configuring the priority of the first startup item and the second startup item.
3. The method of claim 1 or 2, wherein storing the reference mirrored data and the differential mirrored data to the storage cluster to obtain a network system disk of the host comprises:
creating a basic data volume for storing the reference mirror image data in the storage cluster, and creating an extended data volume for storing the difference mirror image data corresponding to the host in the storage cluster;
storing the reference mirror image data to the basic data volume, and storing the difference mirror image data corresponding to the host to the extended data volume;
and taking the basic data volume and the extension data as network system disks of the host, wherein the basic data volume is associated with the extension data volume.
4. The method of claim 3, wherein the method further comprises:
creating a shared storage volume in the storage cluster, determining the reference mirror data, and storing the reference mirror data to the shared storage volume;
generating differential mirror image data corresponding to the host based on the system data and the reference mirror image data of the local system disk of the host, including:
generating corresponding virtual mirror image data based on the system data of the local system disk of the host;
generating difference mirror image data corresponding to the host based on the virtual mirror image data and reference mirror image data stored in the shared storage volume;
storing the differential mirrored data in the shared storage volume.
5. The method of claim 4, wherein storing the reference mirrored data to the base data volume and storing the host corresponding differential mirrored data to the extended data volume comprises:
storing the reference mirror image data stored in the shared storage volume to the basic data volume, and storing the difference mirror image data corresponding to the host stored in the shared storage volume to the extended data volume;
the method further comprises the following steps:
and deleting the difference mirror image data corresponding to the host stored in the shared storage volume.
6. A host system deployment device is applied to any host of a super-fusion system, wherein the super-fusion system comprises a plurality of hosts, and each host comprises: the system comprises a local system disk and a plurality of data disks, wherein the data disks of a plurality of hosts form a storage cluster, and the local system disk only comprises a physical disk; the storage cluster comprises: a shared data volume, a basic data volume corresponding to a plurality of hosts and an expansion data volume; the device comprises:
the generating module is used for generating difference mirror image data corresponding to the host based on the system data and the reference mirror image data of the local system disk of the host;
the first storage module is configured to store the reference mirror image data and the difference mirror image data in the storage area corresponding to the host in the storage cluster, respectively, to obtain a network system disk of the host;
and the establishing module is used for establishing a copy binding relationship between the network system disk and the local system disk.
7. The apparatus of claim 6, wherein the apparatus further comprises:
the system comprises a first configuration module, a second configuration module and a control module, wherein the first configuration module is used for configuring a system startup item of the host based on preset host system configuration information, the system startup item comprises a first startup item and/or a second startup item, the first startup item represents that the host is started from the local system disk, and the second startup item represents that the host is started from the network system disk;
and the second configuration module is used for configuring the priority of the first startup item and the second startup item when the system startup item comprises the first startup item and the second startup item.
8. The apparatus according to claim 6 or 7, wherein the first storage module is specifically configured to:
creating a basic data volume for storing the reference mirror image data in the storage cluster, and creating an extended data volume for storing the difference mirror image data corresponding to the host in the storage cluster;
storing the reference mirror image data to the basic data volume, and storing the difference mirror image data corresponding to the host to the extended data volume;
and taking the basic data volume and the expansion data as network system disks of the host, wherein the basic data volume is associated with the expansion data volume.
9. The apparatus of claim 8, wherein the apparatus further comprises:
the second storage module is used for creating a shared storage volume in the storage cluster, determining the reference mirror image data and storing the reference mirror image data to the shared storage volume;
the generation module is specifically configured to:
generating corresponding virtual mirror image data based on the system data of the local system disk of the host;
generating differential mirror image data corresponding to the host based on the virtual mirror image data and reference mirror image data stored in the shared storage volume;
storing the differential mirrored data in the shared storage volume.
10. The apparatus of claim 9, wherein the first storage module is further to:
storing the reference mirror image data stored in the shared storage volume to the basic data volume, and storing the difference mirror image data corresponding to the host stored in the shared storage volume to the extended data volume;
the device further comprises:
and the deleting module is used for deleting the difference mirror image data corresponding to the host computer stored in the shared storage volume.
11. An electronic device, comprising a computer-readable storage medium storing a computer program and a processor, the computer program, when read and executed by the processor, implementing the method according to any one of claims 1-5.
12. A computer-readable storage medium, on which a computer program is stored which, when read and executed by a processor, implements the method of any one of claims 1-5.
CN201910475611.4A 2019-05-31 2019-05-31 Host system deployment method and device, electronic equipment and storage medium Active CN110221868B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910475611.4A CN110221868B (en) 2019-05-31 2019-05-31 Host system deployment method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910475611.4A CN110221868B (en) 2019-05-31 2019-05-31 Host system deployment method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110221868A CN110221868A (en) 2019-09-10
CN110221868B true CN110221868B (en) 2022-11-08

Family

ID=67819035

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910475611.4A Active CN110221868B (en) 2019-05-31 2019-05-31 Host system deployment method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110221868B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111488198B (en) * 2020-04-16 2023-05-23 湖南麒麟信安科技股份有限公司 Virtual machine scheduling method, system and medium in super fusion environment

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105068836A (en) * 2015-08-06 2015-11-18 北京百度网讯科技有限公司 SAS (serial attached SCSI) network based remotely-shareable start-up system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5221157B2 (en) * 2008-02-04 2013-06-26 株式会社日立製作所 Computer system and physical disk recovery method
CN102185928B (en) * 2011-06-01 2013-07-17 广州杰赛科技股份有限公司 Method for creating virtual machine in cloud computing system and cloud computing system
CN108073352B (en) * 2016-11-15 2021-01-01 华为技术有限公司 Virtual disk processing method and device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105068836A (en) * 2015-08-06 2015-11-18 北京百度网讯科技有限公司 SAS (serial attached SCSI) network based remotely-shareable start-up system

Also Published As

Publication number Publication date
CN110221868A (en) 2019-09-10

Similar Documents

Publication Publication Date Title
US11675746B2 (en) Virtualized server systems and methods including domain joining techniques
US10838829B2 (en) Method and apparatus for loading data from a mirror server and a non-transitory computer readable storage medium
CN110088733B (en) Storage layer-based orchestration of virtual machine migration
EP3686739B1 (en) Method and system for enabling agentless backup and restore operations on a container orchestration platform
US9870288B2 (en) Container-based processing method, apparatus, and system
EP2731013B1 (en) Backing up method, device, and system for virtual machine
CN110377395B (en) Pod migration method in Kubernetes cluster
US8307363B2 (en) Virtual machine system, restarting method of virtual machine and system
EP3227783B1 (en) Live rollback for a computing environment
US20180157677A1 (en) Cloning virtualized file servers
US8498997B2 (en) Server image migration
US8752039B1 (en) Dynamic upgrade of operating system in a network device
CN102200921A (en) Intelligent boot device selection and recovery
US8082406B1 (en) Techniques for reducing data storage needs using CDP/R
JP2021515299A (en) A system for chronological out-of-place updates, a method for chronological out-of-place updates, and a computer program for chronological out-of-place updates.
TWI428744B (en) System, method and computer program product for storing transient state information
CN110221868B (en) Host system deployment method and device, electronic equipment and storage medium
US10896201B2 (en) Synchronization of block based volumes
JP6219514B2 (en) Computing device that provides virtual multipath state access, remote computing device for virtual multipath, method for providing virtual multipath state access, method for virtual multipath, computing device, multiple methods for computing device And a machine-readable recording medium
JP6146092B2 (en) Virtualization system, virtual server, virtual machine control method, and virtual machine control program
US11983081B1 (en) Orchestration of container failover between nodes of a cluster
EP4102350A1 (en) Distributed file system that provides scalability and resiliency
US10585601B2 (en) Information processing apparatus, storage apparatus, and information processing system wherein virtual volume to physical volume mapping is updated from management machine responsive to storage indicating said physical volume is not present
CN116301624A (en) Storage area creation method, system, electronic device and computer storage medium
CN117311627A (en) Container rolling thermal expansion system, method and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant