AIX 5.3 HACMP/POWERHA 6.1.0.2 Installation
id : jmqas4usqy
category : computer
blog : unix
created : 09/30/10 - 12:52:38

Fileset requierment
  • On each node check all this requierement
  • First of all check your AIX TL
# oslevel -s
5300-12-01-1016

  • POWERHA 6.1.0.2 :
# lslpp -l | grep cluster
  cluster.adt.es.client.include
  cluster.adt.es.client.samples.clinfo
  cluster.adt.es.client.samples.clstat
  cluster.adt.es.client.samples.libcl
  cluster.adt.es.java.demo.monitor
  cluster.es.cfs.rte         6.1.0.0  COMMITTED  ES Cluster File System Support
  cluster.es.client.clcomd   6.1.0.2  COMMITTED  ES Cluster Communication
  cluster.es.client.lib      6.1.0.1  COMMITTED  ES Client Libraries
  cluster.es.client.rte      6.1.0.2  COMMITTED  ES Client Runtime
  cluster.es.client.utils    6.1.0.1  COMMITTED  ES Client Utilities
  cluster.es.client.wsm      6.1.0.1  COMMITTED  Web based Smit
  cluster.es.cspoc.cmds      6.1.0.2  COMMITTED  ES CSPOC Commands
  cluster.es.cspoc.dsh       6.1.0.0  COMMITTED  ES CSPOC dsh
  cluster.es.cspoc.rte       6.1.0.2  COMMITTED  ES CSPOC Runtime Commands
  cluster.es.server.cfgast   6.1.0.0  COMMITTED  ES Two-Node Configuration
  cluster.es.server.diag     6.1.0.2  COMMITTED  ES Server Diags
  cluster.es.server.events   6.1.0.2  COMMITTED  ES Server Events
  cluster.es.server.rte      6.1.0.2  COMMITTED  ES Base Server Runtime
  cluster.es.server.testtool
  cluster.es.server.utils    6.1.0.2  COMMITTED  ES Server Utilities
  cluster.license            6.1.0.0  COMMITTED  HACMP Electronic License
  cluster.es.client.clcomd   6.1.0.2  COMMITTED  ES Cluster Communication
  cluster.es.client.lib      6.1.0.1  COMMITTED  ES Client Libraries
  cluster.es.client.rte      6.1.0.2  COMMITTED  ES Client Runtime
  cluster.es.client.wsm      6.1.0.0  COMMITTED  Web based Smit
  cluster.es.cspoc.rte       6.1.0.0  COMMITTED  ES CSPOC Runtime Commands
  cluster.es.server.diag     6.1.0.0  COMMITTED  ES Server Diags
  cluster.es.server.events   6.1.0.0  COMMITTED  ES Server Events
  cluster.es.server.rte      6.1.0.2  COMMITTED  ES Base Server Runtime
  cluster.es.server.utils    6.1.0.2  COMMITTED  ES Server Utilities
  cluster.man.en_US.es.data  6.1.0.0  COMMITTED  ES Man Pages - U.S. English

  • rcst :
# lslpp -l | grep rsct
  rsct.basic.hacmp          2.4.13.0  COMMITTED  RSCT Basic Function (HACMP/ES
  rsct.basic.rte            2.4.13.0  COMMITTED  RSCT Basic Function
  rsct.basic.sp             2.4.13.0  COMMITTED  RSCT Basic Function (PSSP
  rsct.clients.rte     99.99.999.999  COMMITTED  Supersede Entry - Not really
  rsct.compat.basic.hacmp   2.4.13.0  COMMITTED  RSCT Event Management Basic
  rsct.compat.basic.rte     2.4.13.0  COMMITTED  RSCT Event Management Basic
  rsct.compat.basic.sp      2.4.13.0  COMMITTED  RSCT Event Management Basic
  rsct.compat.clients.hacmp
  rsct.compat.clients.rte   2.4.13.0  COMMITTED  RSCT Event Management Client
  rsct.compat.clients.sp    2.4.13.0  COMMITTED  RSCT Event Management Client
  rsct.core.auditrm         2.4.13.0  COMMITTED  RSCT Audit Log Resource
  rsct.core.errm            2.4.13.0  COMMITTED  RSCT Event Response Resource
  rsct.core.fsrm            2.4.13.0  COMMITTED  RSCT File System Resource
  rsct.core.gui             2.4.13.0  COMMITTED  RSCT Graphical User Interface
  rsct.core.hostrm          2.4.13.0  COMMITTED  RSCT Host Resource Manager
  rsct.core.lprm            2.4.13.0  COMMITTED  RSCT Least Privilege Resource
  rsct.core.microsensor     2.4.13.0  COMMITTED  RSCT MicroSensor Resource
  rsct.core.rmc             2.4.13.0  COMMITTED  RSCT Resource Monitoring and
  rsct.core.sec             2.4.13.0  COMMITTED  RSCT Security
  rsct.core.sensorrm        2.4.13.0  COMMITTED  RSCT Sensor Resource Manager
  rsct.core.sr              2.4.13.0  COMMITTED  RSCT Registry
  rsct.core.utils           2.4.13.0  COMMITTED  RSCT Utilities
  rsct.basic.rte            2.4.13.0  COMMITTED  RSCT Basic Function
  rsct.compat.basic.rte     2.4.13.0  COMMITTED  RSCT Event Management Basic
  rsct.core.auditrm         2.4.13.0  COMMITTED  RSCT Audit Log Resource
  rsct.core.errm            2.4.13.0  COMMITTED  RSCT Event Response Resource
  rsct.core.fsrm            2.4.13.0  COMMITTED  RSCT File System Resource
  rsct.core.gui             2.4.13.0  COMMITTED  RSCT Graphical User Interface
  rsct.core.hostrm          2.4.13.0  COMMITTED  RSCT Host Resource Manager
  rsct.core.lprm            2.4.13.0  COMMITTED  RSCT Least Privilege Resource
  rsct.core.microsensor     2.4.13.0  COMMITTED  RSCT MicroSensor Resource
  rsct.core.rmc             2.4.13.0  COMMITTED  RSCT Resource Monitoring and
  rsct.core.sec             2.4.13.0  COMMITTED  RSCT Security
  rsct.core.sensorrm        2.4.13.0  COMMITTED  RSCT Sensor Resource Manager
  rsct.core.sr              2.4.13.0  COMMITTED  RSCT Registry
  rsct.core.utils           2.4.13.0  COMMITTED  RSCT Utilities

  • clvm (required for heartbeat disk configuration)
# lslpp -l | grep clvm
  bos.clvm.enh              5.3.12.0  COMMITTED  Enhanced Concurrent Logical
  bos.clvm.enh               5.3.0.0  COMMITTED  Enhanced Concurrent Logical

  • If there is a prerequisite problem while installing bos.clvm.enh, copy both filesets (I) and (U), inutoc, and use smit install_all.
# ls -l
total 592
-rw-r--r--    1 root     system         4295 Oct 27 12:12 .toc
-rwxr-xr--    1 root     system       102400 Oct 27 10:13 bos.clvm.5.3.0.0.I
-rw-r--r--    1 root     system       190464 Oct 27 12:12 bos.clvm.enh.5.3.12.0.U
# inutoc .
# smit install_all

  • After PowerHA installation (without configuration), subsystem clstrmgrES must be running :
# lssrc -g cluster
Subsystem         Group            PID          Status
 clstrmgrES       cluster          557206       active

  • Change SNMP to V1 (default V3)
# /usr/sbin/snmpv3_ssw -1

System network
  • Modify your /etc/hosts on each node and add :
    • Primary address for node 1 (non-routable) (ex : 8.0.0.3)
    • Secondary address for node 1 (non-routable) (ex : 9.0.0.3)
    • Persistant address for node 1 (routable) (ex : 10.247.168.17)
    • Primary address for node 2 (non-routable) (ex : 8.0.0.4)
    • Secondary address for node 2 (non-routable) (ex : 9.0.0.4)
    • Persistant address for node 2 (routable) (ex : 10.247.168.19)
    • Service address (floating) for your fist ressource group (ex : 10.247.168.18)
# vi /etc/hosts
#PRIMARY IP
8.0.0.3         node1
8.0.0.4         node2
#SECONDARY IP
9.0.0.4         node1s
9.0.0.3         node2s
#PERSISTANTS IP
10.247.168.17   node1p
10.247.168.19   node2p
#SERVICE IP
10.247.168.18   service_ip

  • On each node edit /usr/es/sbin/cluster/etc/rhosts file and add, all used ip addresses :
# vi /usr/es/sbin/cluster/etc/rhosts
10.247.168.17
10.247.168.19
8.0.0.3
8.0.0.4
9.0.0.3
9.0.0.4

  • On each node
    • Configure primary address on primary adapter (ex: en0)
    • Configure secondary address on secondary adapter (ex: en1)
    • Add persistant ip as alias on primary adapter.
  • Node 1 :
# ifconfig -a
en0: flags=5e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),PSEG,LARGESEND,CHAIN>
        inet 8.0.0.3 netmask 0xfffffe00 broadcast 8.0.1.255
        inet 10.247.168.17 netmask 0xfffffe00 broadcast 10.247.169.255
         tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
en1: flags=5e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),PSEG,LARGESEND,CHAIN>
        inet 9.0.0.3 netmask 0xfffffe00 broadcast 9.0.1.255
         tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
lo0: flags=e08084b<UP,BROADCAST,LOOPBACK,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT>
        inet 127.0.0.1 netmask 0xff000000 broadcast 127.255.255.255
        inet6 ::1/0
         tcp_sendspace 131072 tcp_recvspace 131072 rfc1323 1

  • Node 2 :
# ifconfig -a 
en0: flags=5e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),PSEG,LARGESEND,CHAIN>
        inet 8.0.0.4 netmask 0xfffffe00 broadcast 8.0.1.255
        inet 10.247.168.19 netmask 0xfffffe00 broadcast 10.247.169.255
         tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
en1: flags=5e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),PSEG,LARGESEND,CHAIN>
        inet 9.0.0.4 netmask 0xfffffe00 broadcast 9.0.1.255
         tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
lo0: flags=e08084b<UP,BROADCAST,LOOPBACK,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT>
        inet 127.0.0.1 netmask 0xff000000 broadcast 127.255.255.255
        inet6 ::1/0
         tcp_sendspace 131072 tcp_recvspace 131072 rfc1323 1

  • !!!!!!!!!!!!!! WARNING !!!!!!!!!!!!!!
  • use smit mktcpip and smit inet to setup ip configuration
  • !!!!!!!!!!!!!! WARNING !!!!!!!!!!!!!!
PowerHA base configuration
  • This instructions do not tell how to setup a ressource group.
  • Run command on one node only and synchronize cluster at the end.
Naming
  • Name your cluster :
# smit hacmp
Initialization and Standard Configuration|Extended Topology Configuration|Configure an HACMP Cluster|Add/Change/Show an HACMP Cluster

				Add/Change/Show an HACMP Cluster
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* Cluster Name                                       [<cluster_name>]

  NOTE: HACMP must be RESTARTED
  on all nodes in order for change to take effect

  • Create your nodes :
    • First node :
# smit hacmp
Extended Configuration|Extended Topology Configuration|Add a Node to the HACMP Cluster
                Add a Node to the HACMP Cluster

Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* Node Name                                          [<node1>] 
  Communication Path to Node                    [<node1>]

  • Choose primary ip (see below) for communication path to node
    • Second node :
# smit hacmp
Extended Configuration|Extended Topology Configuration|Add a Node to the HACMP Cluster
                Add a Node to the HACMP Cluster

Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* Node Name                                          [<node2>] 
  Communication Path to Node                    [<node2>]

Cluster Network
  • Add a network to your cluster :
# smit hacmp
Initialization and Standard Configuration|Extended Configuration|Extended Topology Configuration|Configure HACMP Networks|Add a Network to the HACMP Cluster
		Add an IP-Based Network to the HACMP Cluster
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* Network Name                                       [<network_name>]
* Network Type                                        ether
* Netmask(IPv4)/Prefix Length(IPv6)                  [<network_mask>]
* Enable IP Address Takeover via IP Aliases          [Yes]
  IP Address Offset for Heartbeating over IP Aliases []

Addresses
  • Communications interfaces :
    • node1 primary ip on en0 for node1.
    • node1 secondary ip on en1 for node1.
    • node2 primary ip on en0 for node2.
    • node2 secondary ip on en1 for node2.
# smit hacmp
Extended Configuration|Extended Topology Configuration|Configure HACMP Communication Interfaces/Devices|Add Communication Interfaces/Devices|Add Pre-defined Communication Interfaces and Devices|Communication Interfaces
|Choose your defined network
		Add a Communication Interface
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* IP Label/Address                                   [node1]
* Network Type                                        ether
* Network Name                                        <network_name>
* Node Name                                          [node1]
  Network Interface                                  [en0]

  • Repeat this operation with right information for each communication ip/interface :
# smit hacmp
Extended Configuration|Extended Topology Configuration|Configure HACMP Communication Interfaces/Devices|Add Communication Interfaces/Devices|Add Pre-defined Communication Interfaces and Devices|Communication Interfaces
|Choose your defined network
		Add a Communication Interface
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* IP Label/Address                                   [node1s]
* Network Type                                        ether
* Network Name                                        <network_name>
* Node Name                                          [node1]
  Network Interface                                  [en1]

# smit hacmp
Extended Configuration|Extended Topology Configuration|Configure HACMP Communication Interfaces/Devices|Add Communication Interfaces/Devices|Add Pre-defined Communication Interfaces and Devices|Communication Interfaces
|Choose your defined network
		Add a Communication Interface
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* IP Label/Address                                   [node2]
* Network Type                                        ether
* Network Name                                        <network_name>
* Node Name                                          [node2]
  Network Interface                                  [en0]

# smit hacmp
Extended Configuration|Extended Topology Configuration|Configure HACMP Communication Interfaces/Devices|Add Communication Interfaces/Devices|Add Pre-defined Communication Interfaces and Devices|Communication Interfaces
|Choose your defined network
		Add a Communication Interface
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* IP Label/Address                                   [node2s]
* Network Type                                        ether
* Network Name                                        <network_name>
* Node Name                                          [node2]
  Network Interface                                  [en1]

  • Check your configuration with cllsif command :
# cllsif
cllsif
Adapter              Type       Network    Net Type   Attribute  Node       IP Address       Hardware Address Interface Name   Global Name      Netmask          Alias for HB Prefix Length

node1         boot       ether_xx ether      public     node1 8.0.0.3                           en0                         255.255.254.0               23
node1s        boot       ether_xx ether      public     node1 9.0.0.3                           en1                         255.255.254.0               23
node2         boot       ether_xx ether      public     node2 8.0.0.4                           en0                         255.255.254.0               23
node2s        boot       ether_xx ether      public     node2 9.0.0.4                           en1                         255.255.254.0               23

  • Persistant IP :
    • node1p persistant ip on node1.
    • node2p persistant ip on node2.
# smit hacmp
Extended Configuration|Extended Topology Configuration|Configure HACMP Persistent Node IP Label/Addresses|Add a Persistent Node IP Label/Address|Choose node1
		Add a Persistent Node IP Label/Address
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* Node Name                                            node1
* Network Name                                       [<network_name>]
* Node IP Label/Address                              [node1p]
  Netmask(IPv4)/Prefix Length(IPv6)                  []

# smit hacmp
Extended Configuration|Extended Topology Configuration|Configure HACMP Persistent Node IP Label/Addresses|Add a Persistent Node IP Label/Address|Choose node2
		Add a Persistent Node IP Label/Address
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* Node Name                                            node2
* Network Name                                       [<network_name>]
* Node IP Label/Address                              [node2p]
  Netmask(IPv4)/Prefix Length(IPv6)                  []

  • Check your configuration with cllsif -p command :
# cllsif -p
cllsif
Adapter              Type       Network    Net Type   Attribute  Node       IP Address       Hardware Address Interface Name   Global Name      Netmask          Alias for HB Prefix Length

node1         boot       ether_xx ether      public     node1 8.0.0.3                           en0                         255.255.254.0               23
node1s        boot       ether_xx ether      public     node1 9.0.0.3                           en1                         255.255.254.0               23
node1p        persistent ether_xx ether      public     node1 10.247.168.17                                                 255.255.254.0               23
node2         boot       ether_xx ether      public     node2 8.0.0.4                           en0                         255.255.254.0               23
node2s        boot       ether_xx ether      public     node2 9.0.0.4                           en1                         255.255.254.0               23
node2p        persistent ether_xx ether      public     node2 10.247.168.17                                                 255.255.254.0               23

Synchronization
  • Before synchronization launch cllsclstr -N, if there is no output, verify your ip configuration :
# cllsclstr -N
clustername

  • Synchronize your cluster for the first time :
# smit hacmp
Extended Configuration|Extended Verification and Synchronization
		HACMP Verification and Synchronization (Active Cluster Nodes Exist)
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* Verify changes only?                               [No]
* Logging                                            [Standard]        

Starting cluster
  • On each node start cluster services :
# smit clstart

Add a ressource group
  • Create a VG on first node
# mkvg -s 128 -y testvg hdisk<X> hdisk<Y>

  • Get major number :
# ls -l /dev/testvg
crw-rw----    1 root     system       38,  0 Sep 24 10:31 /dev/testvg

  • Major number is 38
  • Get a PVID :
# lsvg -p testvg
testvg:
PV_NAME           PV STATE          TOTAL PPs   FREE PPs    FREE DISTRIBUTION
hdisk3            active            255         86          02..00..00..33..51
# lspv | grep hdisk3
hdisk3          00c26d2f3def77e5                    testvg            active

  • Import VG on seconde node with PVID :
# cfgmgr
# importvg -V 38 -y testvg 00c26d2f3def77e5

  • Add service ip
# smit hacmp
Initialization and Standard Configuration|Initialization and Standard Configuration|Configure Resources to Make Highly Available|Configure Service IP Labels/Addresses|Add a Service IP Label/Address
		Add a Service IP Label/Address (standard)
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* IP Label/Address                                   [service_ip]
  Netmask(IPv4)/Prefix Length(IPv6)                  []
* Network Name                                       [ether_xx]    

  • Check your configuration with cllsif command :
# cllsif
cllsif
Adapter              Type       Network    Net Type   Attribute  Node       IP Address       Hardware Address Interface Name   Global Name      Netmask          Alias for HB Prefix Length

node1         boot       ether_xx ether      public     node1 8.0.0.3                           en0                         255.255.254.0               23
node1s        boot       ether_xx ether      public     node1 9.0.0.3                           en1                         255.255.254.0               23
service_ip    service    ether_xx ether      public     node1 10.247.168.18                                                 255.255.254.0               23
node2         boot       ether_xx ether      public     node2 8.0.0.4                           en0                         255.255.254.0               23
node2s        boot       ether_xx ether      public     node2 9.0.0.4                           en1                         255.255.254.0               23
service_ip    service    ether_xx ether      public     node1 10.247.168.18                                                 255.255.254.0               23

  • Add an application server :
# smit hacmp
Initialization and Standard Configuration|Initialization and Standard Configuration|Configure Resources to Make Highly Available|Configure Application Servers|Add an Application Server
 Add Application Server

Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* Server Name                                        [testas]
* Start Script                                       [/usr/HACMP_TOOLS/scripts/start_test.ksh]
* Stop Script                                        [/usr/HACMP_TOOLS/scripts/stop_test.ksh]

  • Add a ressource group
# smit hacmp
Initialization and Standard Configuration|Initialization and Standard Configuration|Configure HACMP Resource Groups|Add a Resource Group
	Add a Resource Group
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* Resource Group Name                                [testrg]
* Participating Nodes (Default Node Priority)        [node1 node2]

  Startup Policy                                      Online On Home Node Only
  Fallover Policy                                     Fallover To Next Priority Node In The List
  Fallback Policy                                     Never Fallback

  • Configure new ressource group :
# smit hacmp
Extended Configuration|Extended Resource Configuration|HACMP Extended Resources Group Configuration|Change/Show Resources and Attributes for a Resource Group|Choose testrg
		Change/Show All Resources and Attributes for a Custom Resource Group
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
  Resource Group Name                                 testrg
  Participating Nodes (Default Node Priority)         node1 node2

  Startup Policy                                      Online On Home Node Only
  Fallover Policy                                     Fallover To Next Priority Node In The List
  Fallback Policy                                     Never Fallback

  Service IP Labels/Addresses                        [service_ip]
  Application Servers                                [testas]

  Volume Groups                                      [testvg]
  Use forced varyon of volume groups, if necessary    false
  Automatically Import Volume Groups                  false

  Filesystems (empty is ALL for VGs specified)       [ ]
  Filesystems Consistency Check                       fsck
  Filesystems Recovery Method                         parallel
  Filesystems mounted before IP configured            false
  Filesystems/Directories to Export (NFSv2/3)        []

  Filesystems/Directories to NFS Mount               []
  Network For NFS Mount                              []

  Tape Resources                                     []
  Raw Disk PVIDs                                     []

  Fast Connect Services                              []
  Communication Links                                []

  Primary Workload Manager Class                     []
  Secondary Workload Manager Class                   []

  Miscellaneous Data                                 []
  WPAR Name                                          []

Run your ressource group
  • Run your new created ressource group :
# smit hacmp
System Management (C-SPOC)|Resource Groups and Applications|Bring a Resource Group Online|Choose testrg|Choose node1
		Bring a Resource Group Online
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
  Resource Group to Bring Online                     testrg
  Node On Which to Bring Resource Group Online       node1

  • Check cluster state with clstat :
# clstat
                clstat - HACMP Cluster Status Monitor
                -------------------------------------

Cluster: test     (1667885961)
Thu Sep 30 12:42:36 2010
                State: UP               Nodes: 2
                SubState: STABLE


        Node: node1              State: UP
           Interface: node1 (0)          Address: 8.0.0.3
                                                State:   UP
           Interface: node1s (0)         Address: 9.0.0.3
                                                State:   UP
           Interface: service_ip (0)              Address: 10.247.168.18
                                                State:   UP
           Resource Group: testrg                 State:  On line

        Node: node2              State: UP
           Interface: node2 (0)          Address: 8.0.0.4
                                                State:   UP
           Interface: node2s (0)         Address: 9.0.0.4
                                                State:   UP

Add a heartbeat disk
  • On node1 :
# chdev -l hdisk<Z> -a pv=yes

  • On node2 :
# rmdev -dl hdisk<Z>
# cfgmgr

  • Check PVID are the same.
  • Then on node one :
# smit hacmp
System Management (C-SPOC)|Storage|Volume Groups|Create a Volume Group|Choose node1 and node2|Select your disk
		Create a Volume Group
Type or select values in entry fields.
Press Enter AFTER making all desired changes.
  Node Names                                          node1,nodec2
  PVID                                                00cd6b1faeca758f
  VOLUME GROUP name                                  [heartbeatvg]
  Physical partition SIZE in megabytes                4
  Volume group MAJOR NUMBER                          [42]
  Enhanced Concurrent Mode                            true
  Enable Cross-Site LVM Mirroring Verification        false
  
  Warning:                                                                    
  Changing the volume group major number may result                           
  in the command being unable to execute
  successfully on a node that does not have the                               
  major number currently available.  Please check
for a commonly available major number on all nodes
  before changing this setting.

  • Create heartbeak disk network :
# smit hacmp
Extended Configuration|Discover HACMP-related Information from Configured Nodes
# smit hacmp
Extended Configuration|Extended Topology Configuration|Configure HACMP Communication Interfaces/Devices|Add Communication Interfaces/Devices|Add Discovered Communication Interface and Devices|Communication Devices|Choose node1 and node2

  • Synchronize cluster.
  • Change heartbeat network name :
# smit hacmp
Extended Configuration|Extended Topology Configuration|Configure HACMP Networks|Change/Show a Network in the HACMP Cluster
                                                                                             Change/Show a Serial Network in the HACMP Cluster

Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
* Network Name                                        heart_<cluster_name>
  New Network Name                                   []
* Network Type                                       [diskhb] 

  • Rename disk interfaces :
# smit hacmp
Extended Configuration|Extended Topology Configuration|Configure HACMP Communication Interfaces/Devices|Change/Show Communication Interfaces/Devices|Choose your disk
		Change/Show a Communication Interface
Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
  Device Name                                         disk_name
  New Device Name                                    [<new_disk_name>]
* Node Name                                           node1
* Device Path                                         /dev/hdisk2
  Network Type                                        diskhb
* Network Name                                       [heart_<cluster_name>]

  • Repeat the operation for second disk.
  • Synchronize cluster.
  • Refresh topsvcs :
# refresh -s topsvcs

  • Test heartbeat disk
    • On node1 :
# cd /usr/sbin/rcst/bin
# ./dhb_read -p /dev/rhdisk2 -r
Receive Mode:
Waiting for response . . .
Magic number = -2023406815
Magic number = -2023406815
Magic number = -2023406815
. . .
Link operating normally

    • On node2 :
# cd /usr/sbin/rcst/bin
# ./dhb_read -p /dev/rhdisk2 -t
Transmit Mode:
Magic number = -2023406815
Detected remote utility in receive mode.  Waiting for response . . .
Magic number = -2023406815
Magic number = -2023406815
Link operating normally

  • If it work you'll see Link operating normally
  • Check heartbeat state with :
# lssrc -ls topsvcs

HDLM Specifications
  • On HLDM run the following commands (only on one node) :
# smit cldisktype_custom_dialog_add
* Disk Type (PdDvLn field from CuDv)                 [disk/fcp/Hitachi]
* Method to identify ghost disks                     [SCSI3]
* Method to determine if a reserve is held           [/usr/DynamicLinkManager/cluster/dlm_hacmp_gdisk_reserve_check]
* Method to break a reserve                          [TARGET]
  Break reserves in parallel                          false
* Method to make the disk available                  [MKDEV]
# smit cm_ver_and_sync.select