CN104090992A - Method for high-availability configuration between conversion nodes in cluster storage system - Google Patents
Method for high-availability configuration between conversion nodes in cluster storage system Download PDFInfo
- Publication number
- CN104090992A CN104090992A CN201410383015.0A CN201410383015A CN104090992A CN 104090992 A CN104090992 A CN 104090992A CN 201410383015 A CN201410383015 A CN 201410383015A CN 104090992 A CN104090992 A CN 104090992A
- Authority
- CN
- China
- Prior art keywords
- storage system
- cluster
- glusterfs
- ctdb
- nodes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 238000006243 chemical reaction Methods 0.000 title abstract description 11
- 230000008569 process Effects 0.000 claims abstract description 4
- 238000004891 communication Methods 0.000 claims description 3
- 230000008859 change Effects 0.000 claims description 2
- 230000007246 mechanism Effects 0.000 abstract description 14
- 230000005856 abnormality Effects 0.000 abstract 1
- 230000009286 beneficial effect Effects 0.000 abstract 1
- 238000000926 separation method Methods 0.000 abstract 1
- 239000000523 sample Substances 0.000 description 6
- 239000011449 brick Substances 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 241001522296 Erithacus rubecula Species 0.000 description 1
- 241001362551 Samba Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Hardware Redundancy (AREA)
Abstract
The invention discloses a method for high-availability configuration between conversion nodes in a cluster storage system, and belongs to the field of computer system storage. The method is characterized by comprising the steps of introducing the GlusterFS (freestanding system) cluster storage system, which is independent of cluster primary storage and has a copy function, gradually adding all the conversion nodes into a uniform storage pool of the GlusterFS, constructing the independent GlusterFS cluster storage system for the conversion nodes of a cluster primary storage system, and arranging a CTDB (clustering temporary database) on the cluster system to realize an IP (internet protocol) high-availability mechanism between system nodes, namely the conversion nodes of the cluster primary storage system. The method for high-availability configuration between the conversion nodes in the cluster storage system has the beneficial effects that complete separation of the high-availability mechanism between the conversion nodes from a multi-protocol conversion mechanism is realized; the abnormality of a certain protocol of multiple protocols, namely a service such as a CIFS (common internet file system), an NFS (network file system) and an FTP (file transfer protocol), cannot affect a file access of other protocols any more, so that the process for eliminating a system fault is greatly simplified.
Description
Technical field
The present invention relates to a kind of collocation method of cluster storage system, belong to computer system stores field, specifically a kind of high available configuration method between switching node in cluster storage system.
Background technology
At first, CTDB (Clustering TDB) is a kind of cluster implementation of TDB database, and this database is used for storing Samba service ephemeral data; Except CIFS, CTDB supports the active file access protocals such as NFS, FTP at present.For the switching node that file access function is externally provided in cluster storage system, CTDB can realize the IP Takeover between them, the high available mechanism of IP that namely we often say, when a certain or some switching node is broken down, client still can use original IP address to carry out file access.But, because current high available configuration depends on switching node multi-protocols, it is the normal operation of the functions such as CIFS, NFS, FTP and cluster storage system, arbitrary multi-protocols are the services such as CIFS, NFS, FTP, for example CIFS service is abnormal, can cause between switching node high available mechanism in down state, CTDB is the IP address failure that malfunctioning node distributes in advance, and NFS, the FTP service that can simultaneously affect is used the normal access of client to cluster storage system.The present invention is a kind of high available configuration method between switching node in cluster storage system, be applicable in distributed cluster storage system, the system failure that can avoid the high available mechanism of switching node and multiprotocol conversion Mechanism coupling to bring, thereby reduce cluster storage system failure rate, overcome the above problems well.
Summary of the invention
The present invention is directed to deficiency and problem that prior art exists, high available configuration method between switching node is provided in a kind of cluster storage system, the concrete scheme of proposition is:
A kind of high available configuration method between switching node in cluster storage system, introducing is independent of the GlusterFS cluster storage system with copy function of cluster main storage system, for each switching node of cluster main storage system is built an independently GlusterFS cluster storage system, by at GlusterFS cluster storage system deploy CTDB, realize the high available configuration of IP of system node; Concrete steps are as follows:
1. according to number of nodes, GlusterFS is installed respectively, confirms to install correct; Start GlusterFS service, starting up is set;
2. change on node and configure glusterfs file system storage pool, all switching nodes join in storage pool, and verify member condition;
3. TDB configuration: two networks, for the communication between CTDB process, public network offers client the service such as Samba, NFS,
4. establishment/etc/ctdb/nodes file write the internal network IP address of all clustered nodes, the public address file that the CTDB_PUBLIC_ADDRESSES in pass through/etc/sysconfig/ctdb specifies arranges public address; Start CTDB service, starting up is set.
Whether the described step 1. middle #GlusterFS of use – V detection installs correct.
Described step is being configured to of middle establishment/etc/ctdb/nodes file 4.: 192.168.0.108; 192.168.0.106; 192.168.0.111; 192.168.0.112.
Described step 4. public address arranges as follows: 172.16.248.219/24 eth0; 172.16.248.214/24 eth0; 172.16.248.217/24 eth0; 172.16.248.218/24 eth0.
Usefulness of the present invention is: the small-sized cluster storage system with copy function that the present invention's introducing is independent of cluster primary storage completes the high available mechanism configuration between switching node, by peeling off completely the implementation of high available mechanism between switching node and multiprotocol conversion mechanism, avoid the generation of high available mechanism and multi-protocols Mechanism coupling fault, make high available mechanism be no longer dependent on the normal operation of multiprotocol conversion function and cluster storage system, in strengthening system configuration dirigibility, reduce cluster storage system failure rate.
Brief description of the drawings
Fig. 1 is high available mechanism schematic diagram between traditional cluster storage system switching node;
Fig. 2 is high available configuration method schematic diagram between switching node in cluster storage system of the present invention.
Embodiment
Content of the present invention is specifically described in conjunction with shown in Fig. 2, and switching node number is 4, can be according to the expansion of system deployment scenario, and layoutprocedure is set and is divided into GlusterFS and CTDB configuration two parts.
GlusterFS configuration:
1. GlusterFS is installed: first GlusterFS:#yum-y install wget fuse fuse-libs openssh-server is installed respectively on all switching nodes and enters gluster-rpms catalogue, #rpm – Uvh *
After to be installed, whether correctly use #GlusterFS – V to detect installation, if there is following information, prove that GlusterFS installs correct.
GlusterFS?3.2.0?built?on?Apr?22?2011?18:35:40
Repository?revision:?v3.2.0
Copyright?(c)?2006-2010?Gluster?Inc.?<http://www.gluster.com>
GlusterFS?comes?with?ABSOLUTELY?NO?WARRANTY.
You?may?redistribute?copies?of?GlusterFS?under?the?terms?of?the?GNU?Affero?General?Public?License.
#service glusterd start // startup GlusterFS service
#chkconfig glusterd on // arrange starting up
2. configuration: on switching node, configure GlusterFS file system, below in layoutprocedure, host name can be replaced with to IP address.
Create storage pool, all switching nodes joined in storage pool, on interface1, carry out following operation:
#gluster peer probe interface2 // interpolation server is to storage pool
Probe?successful
#gluster?peer?probe?interface3
Probe?successful
#gluster?peer?probe?interface4
Probe?successful
……
#gluster peer status // checking member condition
Number?of?Peers:?3
Hostname:interface2
Uuid:?e4cd4e2f-e316-4167-8280-ce8b3840f817
State:?Peer?in?Cluster?(Connected)
…?…?…
If need remove certain node from storage pool, can use #gluster peer detach xx//xx for host name or IP address.
Create GlusterFS server volume, be used for depositing the lock file of CTDB.
#?gluster?volume?create?NEW-VOLNAME?[stripe?COUNT?|?replica?COUNT]?[transport?<tcp?|?rdma?|?tcp,rdma>]?NEW-BRICK1?NEW-BRICK2?NEW-BRICK3...
For our system, shared storage is mainly used in storing recovery lock, extremely important for whole CTDB cluster, therefore consider to use the copy pattern of GlusterFS, data are distributed to the upper safety that ensures data of all switching nodes (the COUNT value in replica COUNT is switching node number), example:
#gluster?volume?create?test-volume?replica?4?transport?tcp?interface1:
/home/gluster?interface2:/home/gluster?interface3:
/home/gluster?interface4:/home/gluster
# gluster volume info//check GlusterFS volume information
Volume?Name:?test-volume
Type:?Replicate
Status:?Created
Number?of?Bricks:4
Transport-type:?tcp
Bricks:
Brick1:?interface1:/home/gluster
Brick2:?interface2:/home/gluster
Brick3:?interface3:/home/gluster
Brick4:?interface4:/home/gluster
Start volume: #gluster volume start test-volume
Carry volume: #mount-t GlusterFS interface1:/test-volume/mnt/test-volume
CTDB configuration
CTDB cluster needs at least two independently networks, and an internal network is for the communication between CTDB process, and a public network offers client the service such as Samba, NFS.Internal network can use the network of cluster file system to communicate.
The master file of CTDB is /etc/sysconfig/CTDB that it comprises detailed configuration parameter explanation.The parameter that must arrange is CTDB_RECOVERY_LOCK, it has specified the fullpath of CTDB lock file in cluster file system, this file must be under the mount directory of GlusterFS manual creation, as CTDB_RECOVERY_LOCK=/mnt/test-volume/storage.In addition, need establishment/etc/CTDB/nodes file and write the internal network IP address of all clustered nodes, the deposit position of file can arrange by the CTDB_NODES parameter in amendment/etc/sysconfig/CTDB.This file must be in full accord on all nodes, and Typical Disposition is as follows:
192.168.0.108
192.168.0.106
192.168.0.111
192.168.0.112
CTDB safeguards one group of IP address that dynamically distributes to the public network of all nodes, and IP number of addresses should be no less than switching node quantity.In the time that a node is delayed machine, CTDB can move to the public ip address of this node on other healthy nodes.By being combined with round robin DNS, can make CTDB realize the load balancing of cluster service and high available.The public address file that uses the CTDB_PUBLIC_ADDRESSES in need to pass through/etc/sysconfig/CTDB of this pattern configurations CTDB to specify arranges public address, and public address arranges as follows:
172.16.248.219/24?eth0
172.16.248.214/24?eth0
172.16.248.217/24?eth0
172.16.248.218/24?eth0
#service CTDB start // startup CTDB service
#chkconfig CTDB on // arrange starting up
The each node state of #CTDB status // be used for checking
#CTDB ip // be used for the checking virtual ip address that node is assigned to
So far, the high available configuration of switching node completes.
Claims (4)
1. high available configuration method between switching node in a cluster storage system, it is characterized in that introducing the GlusterFS cluster storage system with copy function that is independent of cluster main storage system, for each switching node of cluster main storage system is built an independently GlusterFS cluster storage system, by at GlusterFS cluster storage system deploy CTDB, realize the high available configuration of IP of system node; Concrete steps are as follows:
1. according to number of nodes, GlusterFS is installed respectively, confirms to install correct; Start GlusterFS service, starting up is set;
2. change on node and configure glusterfs file system storage pool, all switching nodes join in storage pool, and verify member condition;
3. TDB configuration: two networks, for the communication between CTDB process, public network offers client the service such as Samba, NFS,
4. establishment/etc/ctdb/nodes file write the internal network IP address of all clustered nodes, the public address file that the CTDB_PUBLIC_ADDRESSES in pass through/etc/sysconfig/ctdb specifies arranges public address; Start CTDB service, starting up is set.
2. whether high available configuration method between switching node in a kind of cluster storage system according to claim 1, is characterized in that using #GlusterFS – V to detect during described step 1. and install correct.
3. high available configuration method between switching node in a kind of cluster storage system according to claim 2, is characterized in that being configured to of establishment/etc/ctdb/nodes file during described step 4.: 192.168.0.108; 192.168.0.106; 192.168.0.111; 192.168.0.112.
4. high available configuration method between switching node in a kind of cluster storage system according to claim 2, it is characterized in that described step 4. public address arrange as follows: 172.16.248.219/24 eth0; 172.16.248.214/24 eth0; 172.16.248.217/24 eth0; 172.16.248.218/24 eth0.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410383015.0A CN104090992A (en) | 2014-08-06 | 2014-08-06 | Method for high-availability configuration between conversion nodes in cluster storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410383015.0A CN104090992A (en) | 2014-08-06 | 2014-08-06 | Method for high-availability configuration between conversion nodes in cluster storage system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104090992A true CN104090992A (en) | 2014-10-08 |
Family
ID=51638708
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410383015.0A Pending CN104090992A (en) | 2014-08-06 | 2014-08-06 | Method for high-availability configuration between conversion nodes in cluster storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104090992A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105262820A (en) * | 2015-10-29 | 2016-01-20 | 浪潮电子信息产业股份有限公司 | Cluster multi-computer mutual backup method based on Linux operating system |
| CN107104844A (en) * | 2017-05-27 | 2017-08-29 | 郑州云海信息技术有限公司 | A kind of CTDB migrates the method and device of public ip address |
| CN107302600A (en) * | 2017-08-25 | 2017-10-27 | 郑州云海信息技术有限公司 | The implementation method and device of a kind of distributed FTP service |
| CN107395416A (en) * | 2017-07-20 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of data transmission method for uplink and server cluster |
| CN107404524A (en) * | 2017-07-24 | 2017-11-28 | 郑州云海信息技术有限公司 | A kind of method and device of distributed type assemblies node visit |
| CN107454165A (en) * | 2017-08-04 | 2017-12-08 | 郑州云海信息技术有限公司 | Access method and device of a kind of hadoop cluster to ceph clusters |
| CN107766152A (en) * | 2017-10-19 | 2018-03-06 | 郑州云海信息技术有限公司 | Management method, system, device and the readable storage medium storing program for executing of load balancing service |
| CN107800695A (en) * | 2017-10-17 | 2018-03-13 | 郑州云海信息技术有限公司 | File access method, device based on Samba agreements, system |
| CN108989476A (en) * | 2018-06-12 | 2018-12-11 | 新华三技术有限公司 | A kind of address distribution method and device |
| CN109032871A (en) * | 2018-08-10 | 2018-12-18 | 郑州云海信息技术有限公司 | A kind of test method, device, equipment and the storage medium of pond specification |
| CN109032830A (en) * | 2018-07-25 | 2018-12-18 | 广东浪潮大数据研究有限公司 | A kind of fault recovery method of distributed memory system, system and associated component |
-
2014
- 2014-08-06 CN CN201410383015.0A patent/CN104090992A/en active Pending
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105262820A (en) * | 2015-10-29 | 2016-01-20 | 浪潮电子信息产业股份有限公司 | Cluster multi-computer mutual backup method based on Linux operating system |
| CN107104844B (en) * | 2017-05-27 | 2020-05-26 | 苏州浪潮智能科技有限公司 | Method and device for migrating public IP address by CTDB |
| CN107104844A (en) * | 2017-05-27 | 2017-08-29 | 郑州云海信息技术有限公司 | A kind of CTDB migrates the method and device of public ip address |
| CN107395416A (en) * | 2017-07-20 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of data transmission method for uplink and server cluster |
| CN107404524A (en) * | 2017-07-24 | 2017-11-28 | 郑州云海信息技术有限公司 | A kind of method and device of distributed type assemblies node visit |
| CN107404524B (en) * | 2017-07-24 | 2020-07-07 | 郑州云海信息技术有限公司 | Distributed cluster node access method and device |
| CN107454165A (en) * | 2017-08-04 | 2017-12-08 | 郑州云海信息技术有限公司 | Access method and device of a kind of hadoop cluster to ceph clusters |
| CN107302600A (en) * | 2017-08-25 | 2017-10-27 | 郑州云海信息技术有限公司 | The implementation method and device of a kind of distributed FTP service |
| CN107800695A (en) * | 2017-10-17 | 2018-03-13 | 郑州云海信息技术有限公司 | File access method, device based on Samba agreements, system |
| CN107766152A (en) * | 2017-10-19 | 2018-03-06 | 郑州云海信息技术有限公司 | Management method, system, device and the readable storage medium storing program for executing of load balancing service |
| CN108989476A (en) * | 2018-06-12 | 2018-12-11 | 新华三技术有限公司 | A kind of address distribution method and device |
| CN108989476B (en) * | 2018-06-12 | 2021-09-07 | 新华三技术有限公司 | Address allocation method and device |
| CN109032830A (en) * | 2018-07-25 | 2018-12-18 | 广东浪潮大数据研究有限公司 | A kind of fault recovery method of distributed memory system, system and associated component |
| CN109032871A (en) * | 2018-08-10 | 2018-12-18 | 郑州云海信息技术有限公司 | A kind of test method, device, equipment and the storage medium of pond specification |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104090992A (en) | Method for high-availability configuration between conversion nodes in cluster storage system | |
| US11575769B2 (en) | Redundancy in a network centric process control system | |
| CN105511805B (en) | The data processing method and device of cluster file system | |
| US9906429B2 (en) | Performing partial subnet initialization in a middleware machine environment | |
| CN102404390B (en) | Intelligent dynamic load balancing method for high-speed real-time database | |
| CN108234306A (en) | Network equipment, network method and computer readable storage medium | |
| CN105262820A (en) | Cluster multi-computer mutual backup method based on Linux operating system | |
| US20090122724A1 (en) | Peer-to-Peer Network including Routing Protocol Enhancement | |
| CN102467508A (en) | Method for providing database service and database system | |
| CN106407214A (en) | Distributed storage method and system | |
| US11403319B2 (en) | High-availability network device database synchronization | |
| CN102523118A (en) | Redundancy control system consisting of multiple control computers in local area network and method for redundancy control system | |
| JP3954617B2 (en) | Method for providing resources in a communication network | |
| EP2069934B1 (en) | Fault-tolerant medium access control (mac) address assignment in network elements | |
| CN107800737A (en) | The determination method, apparatus and server cluster of host node in a kind of server cluster | |
| CN101009593A (en) | A method, device and system for binding the terminal with the pseudo terminal device | |
| CN104506353A (en) | Authentication management method, equipment and system | |
| US20090132716A1 (en) | Fault-tolerant distributed services methods and systems | |
| CN107819619A (en) | A kind of continual method of access for realizing NFS | |
| CN210927676U (en) | Reverse domain name resolution system based on IPv6 technology | |
| Aelmans et al. | Day One: Routing in Fat Trees (RIFT) | |
| US9083618B2 (en) | Centralized backup system and backup method for an homogeneous real-time system at different locations | |
| CN114915545B (en) | Application scheduling deployment management method based on DHCP network cluster | |
| JP6084366B2 (en) | Redundant construction system and redundant construction program | |
| CN112860276B (en) | Distributed file system deployment method, device, server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20141008 |
|
| WD01 | Invention patent application deemed withdrawn after publication |