GPFS Cluster Setup : Easy steps for setting up GPFS cluster
*********************************************************************
Renaming a one node cluster, requires atleast 4 steps.
1) Add new IP/name entry in /etc/hosts of the new name, don’t delete the old one
2) mmchnode --admin-interface=newname-gpf -N oldname-gpf
3) mmchnode --daemon-interface=newname-gpf -N newname-gpf
mmgetstate -mmdsh: Node oldname-gpf is not available to run the command.
mmchnode: Command was unable to obtain the lock for the GPFS system data.
Unable to reach the holder of the lock oldname-gpf.
Check the preceding messages, if any. Follow the procedure outlined
in the GPFS Problem Determination Guide.
mmchnode: GPFS was unable to obtain a lock from node newname-gpf.
mmchnode: Command failed. Examine previous error messages to determine cause.
Reboot and then run the command again and it work.
4) Rename the cluster and delete old IP address/name from /etc/hosts
mmchcluster -C <new_name>
*********************************************************************
Inode.
[root@hostname1] # mmdf /dev/fs_name -F
Inode Information
-----------------
Number of used inodes: 136927
Number of free inodes: 82209
Number of allocated inodes: 219136
Maximum number of inodes: 4252672
Path to GPFS commands.
/usr/lpp/mmfs/bin/mmlscluster
/usr/lpp/mmfs/bin/mmmount all -a
/usr/lpp/mmfs/bin/mmlsfs /gtest
Setting up TieBreaker disks (Stop the cluster before proceeding)
[root@hostname] # mmchconfig tieBreakerDisks="Vd10DbGA1;Vd10DbA01;Vd10DbD01"
[root@hostname] # mmshutdown -a
Tue Jul 9 10:20:05 PDT 2013: mmshutdown: Starting force unmount of GPFS file systems
Adding Node to GPFS clusterDisks should be zoned to all hosts
Check for ssh keys authenitcaiton between nodesCheck for rsh keys authentication$HOME/.rhosts or the /etc/hosts.equiv. The permissions should be 600 and entry for other nodes
Install GPFS: (Install GPFS 3.4.0.23 and Filesets for 3.4.5)
Verify if GPFS is installed
Hostname# /usr/lpp/mmfs/bin/mmlscluster
mmlscluster: 6027-1382 This node does not belong to a GPFS cluster.mmlscluster: 6027-1639 Command failed. Examine previous error messages to determine cause.
Add node to Cluster
mmaddnode -N hostname
1Tue Dec 6 13:30:07 PST 2011: 6027-1664 mmaddnode: Processing node hostname1rshd: 0826-813 Permission is denied.rshd: 0826-813 Permission is denied.
mmchcluster command to set hostname as the secondary configuration server#
mmchcluster -s hostname
Set the license mode for the node using the mmchlicense command.
mmchlicense server --accept -N hostname
Start cluster on hostname
mmstartup -N hostname
Verify that both nodes are in the active state
mmgetstate -a
Mount on all systems
mmmount all –a
Changing quorum and manager
mmchnode --quorum --manager -N hostname1,hostname
2Tue Dec 6 14:50:27 PST 2011: 6027-1664 mmchnode: Processing node hostname1.comTue Dec 6 14:50:27 PST 2011: 6027-1664 mmchnode: Processing node hostname2.commmchnode: 6027-1371 Propagating the cluster configuration data to all affected nodes. This is an asynchronous process.
GPFS WIKI.
*********************************************************************
Renaming a one node cluster, requires atleast 4 steps.
1) Add new IP/name entry in /etc/hosts of the new name, don’t delete the old one
2) mmchnode --admin-interface=newname-gpf -N oldname-gpf
3) mmchnode --daemon-interface=newname-gpf -N newname-gpf
mmgetstate -mmdsh: Node oldname-gpf is not available to run the command.
mmchnode: Command was unable to obtain the lock for the GPFS system data.
Unable to reach the holder of the lock oldname-gpf.
Check the preceding messages, if any. Follow the procedure outlined
in the GPFS Problem Determination Guide.
mmchnode: GPFS was unable to obtain a lock from node newname-gpf.
mmchnode: Command failed. Examine previous error messages to determine cause.
Reboot and then run the command again and it work.
4) Rename the cluster and delete old IP address/name from /etc/hosts
mmchcluster -C <new_name>
*********************************************************************
Inode.
[root@hostname1] # mmdf /dev/fs_name -F
Inode Information
-----------------
Number of used inodes: 136927
Number of free inodes: 82209
Number of allocated inodes: 219136
Maximum number of inodes: 4252672
Path to GPFS commands.
/usr/lpp/mmfs/bin/mmlscluster
/usr/lpp/mmfs/bin/mmmount all -a
/usr/lpp/mmfs/bin/mmlsfs /gtest
Setting up TieBreaker disks (Stop the cluster before proceeding)
[root@hostname] # mmchconfig tieBreakerDisks="Vd10DbGA1;Vd10DbA01;Vd10DbD01"
[root@hostname] # mmshutdown -a
Tue Jul 9 10:20:05 PDT 2013: mmshutdown: Starting force unmount of GPFS file systems
Adding Node to GPFS clusterDisks should be zoned to all hosts
Check for ssh keys authenitcaiton between nodesCheck for rsh keys authentication$HOME/.rhosts or the /etc/hosts.equiv. The permissions should be 600 and entry for other nodes
Install GPFS: (Install GPFS 3.4.0.23 and Filesets for 3.4.5)
Verify if GPFS is installed
Hostname# /usr/lpp/mmfs/bin/mmlscluster
mmlscluster: 6027-1382 This node does not belong to a GPFS cluster.mmlscluster: 6027-1639 Command failed. Examine previous error messages to determine cause.
Add node to Cluster
mmaddnode -N hostname
1Tue Dec 6 13:30:07 PST 2011: 6027-1664 mmaddnode: Processing node hostname1rshd: 0826-813 Permission is denied.rshd: 0826-813 Permission is denied.
mmchcluster command to set hostname as the secondary configuration server#
mmchcluster -s hostname
Set the license mode for the node using the mmchlicense command.
mmchlicense server --accept -N hostname
Start cluster on hostname
mmstartup -N hostname
Verify that both nodes are in the active state
mmgetstate -a
Mount on all systems
mmmount all –a
Changing quorum and manager
mmchnode --quorum --manager -N hostname1,hostname
2Tue Dec 6 14:50:27 PST 2011: 6027-1664 mmchnode: Processing node hostname1.comTue Dec 6 14:50:27 PST 2011: 6027-1664 mmchnode: Processing node hostname2.commmchnode: 6027-1371 Propagating the cluster configuration data to all affected nodes. This is an asynchronous process.
GPFS WIKI.
No comments:
Post a Comment