Clearing down a failed 11.2.0.3 Grid Infrastructure Install

Posted: August 7, 2013 in ASM, RAC

The following is the steps needed to clear down a failed 11.2.0.3 RAC install, the root.sh part of the install can cause numerious issue so these steps have been used on several occasions

Run the rootcrs.pl to deconfig the cluster

Run on the first node

root@testnode1)$ ./rootcrs.pl -deconfig -verbose -force
Using configuration parameter file: ./crsconfig_params
Network exists: 1/172.23.72.0/255.255.248.0/bond0, type static
VIP exists: /testnode1-vip/172.23.72.23/172.23.72.0/255.255.248.0/bond0, hosting node testnode1
GSD exists
ONS exists: Local port 6100, remote port 6200, EM port 2016
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘testnode1’
CRS-2673: Attempting to stop ‘ora.crsd’ on ‘testnode1’
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘testnode1’
CRS-2673: Attempting to stop ‘ora.oc4j’ on ‘testnode1’
CRS-2673: Attempting to stop ‘ora.DATA.dg’ on ‘testnode1’
CRS-2677: Stop of ‘ora.oc4j’ on ‘testnode1’ succeeded
CRS-2677: Stop of ‘ora.DATA.dg’ on ‘testnode1’ succeeded
CRS-2673: Attempting to stop ‘ora.asm’ on ‘testnode1’
CRS-2677: Stop of ‘ora.asm’ on ‘testnode1’ succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘testnode1’ has completed
CRS-2677: Stop of ‘ora.crsd’ on ‘testnode1’ succeeded
CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘testnode1’
CRS-2673: Attempting to stop ‘ora.crf’ on ‘testnode1’
CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘testnode1’
CRS-2673: Attempting to stop ‘ora.evmd’ on ‘testnode1’
CRS-2673: Attempting to stop ‘ora.asm’ on ‘testnode1’
CRS-2677: Stop of ‘ora.mdnsd’ on ‘testnode1’ succeeded
CRS-2677: Stop of ‘ora.crf’ on ‘testnode1’ succeeded
CRS-2677: Stop of ‘ora.evmd’ on ‘testnode1’ succeeded
CRS-2677: Stop of ‘ora.asm’ on ‘testnode1’ succeeded
CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘testnode1’
CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘testnode1’ succeeded
CRS-2677: Stop of ‘ora.ctssd’ on ‘testnode1’ succeeded
CRS-2673: Attempting to stop ‘ora.cssd’ on ‘testnode1’
CRS-2677: Stop of ‘ora.cssd’ on ‘testnode1’ succeeded
CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘testnode1’
CRS-2677: Stop of ‘ora.gipcd’ on ‘testnode1’ succeeded
CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘testnode1’
CRS-2677: Stop of ‘ora.gpnpd’ on ‘testnode1’ succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘testnode1’ has completed
CRS-4133: Oracle High Availability Services has been stopped.
Successfully deconfigured Oracle clusterware stack on this node

Run on the last node

root@testnode2)$ ./rootcrs.pl -deconfig -verbose -force -lastnode
Using configuration parameter file: ./crsconfig_params
CRS-2672: Attempting to start ‘ora.mdnsd’ on ‘testnode2’
CRS-5017: The resource action “ora.mdnsd start” encountered the following error:
Start action for daemon aborted. For details refer to “(:CLSN00107:)” in “/u01/app/11.2.0.3/grid/log/testnode2/agent/ohasd/oraagent_oracle/oraagent_oracle.log”.
CRS-2674: Start of ‘ora.mdnsd’ on ‘testnode2’ failed
CRS-2679: Attempting to clean ‘ora.mdnsd’ on ‘testnode2’
CRS-2681: Clean of ‘ora.mdnsd’ on ‘testnode2’ succeeded
CRS-2672: Attempting to start ‘ora.gpnpd’ on ‘testnode2’
CRS-5017: The resource action “ora.gpnpd start” encountered the following error:
Start action for daemon aborted. For details refer to “(:CLSN00107:)” in “/u01/app/11.2.0.3/grid/log/testnode2/agent/ohasd/oraagent_oracle/oraagent_oracle.log”.
CRS-2674: Start of ‘ora.gpnpd’ on ‘testnode2’ failed
CRS-2679: Attempting to clean ‘ora.gpnpd’ on ‘testnode2’
CRS-2681: Clean of ‘ora.gpnpd’ on ‘testnode2’ succeeded
CRS-4000: Command Start failed, or completed with errors.
CSS startup failed with return code 1
PRCR-1068 : Failed to query resources
Cannot communicate with crsd
PRCR-1068 : Failed to query resources
Cannot communicate with crsd
PRCR-1068 : Failed to query resources
Cannot communicate with crsd
PRCR-1068 : Failed to query resources
Cannot communicate with crsd
PRCR-1119 : Failed to look up CRS resources of ora.cluster_vip_net1.type type
PRCR-1068 : Failed to query resources
Cannot communicate with crsd
PRCR-1070 : Failed to check if resource ora.gsd is registered
Cannot communicate with crsd
PRCR-1070 : Failed to check if resource ora.ons is registered
Cannot communicate with crsd

CRS-4689: Oracle Clusterware is already stopped
CRS-2672: Attempting to start ‘ora.mdnsd’ on ‘testnode2’
CRS-5017: The resource action “ora.mdnsd start” encountered the following error:
Start action for daemon aborted. For details refer to “(:CLSN00107:)” in “/u01/app/11.2.0.3/grid/log/testnode2/agent/ohasd/oraagent_oracle/oraagent_oracle.log”.
CRS-2674: Start of ‘ora.mdnsd’ on ‘testnode2’ failed
CRS-2679: Attempting to clean ‘ora.mdnsd’ on ‘testnode2’
CRS-2681: Clean of ‘ora.mdnsd’ on ‘testnode2’ succeeded
CRS-2672: Attempting to start ‘ora.gpnpd’ on ‘testnode2’
CRS-5017: The resource action “ora.gpnpd start” encountered the following error:
Start action for daemon aborted. For details refer to “(:CLSN00107:)” in “/u01/app/11.2.0.3/grid/log/testnode2/agent/ohasd/oraagent_oracle/oraagent_oracle.log”.
CRS-2674: Start of ‘ora.gpnpd’ on ‘testnode2’ failed
CRS-2679: Attempting to clean ‘ora.gpnpd’ on ‘testnode2’
CRS-2681: Clean of ‘ora.gpnpd’ on ‘testnode2’ succeeded
CRS-4000: Command Start failed, or completed with errors.
CSS startup failed with return code 1
Unable to communicate with the Cluster Synchronization Services daemon.
CRS-4000: Command Delete failed, or completed with errors.
crsctl delete for vds in DATA … failed
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘testnode2’
CRS-2673: Attempting to stop ‘ora.cssdmonitor’ on ‘testnode2’
CRS-2677: Stop of ‘ora.cssdmonitor’ on ‘testnode2’ succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘testnode2’ has completed
CRS-4133: Oracle High Availability Services has been stopped.
Successfully deconfigured Oracle clusterware stack on this node

Clear down the install files

Node 1

root@testnode1)$ pwd
/u01/app
root@testnode1)$ rm -rf 11.2.0.3 oraInventory oracle
root@testnode1)$ rm -R /etc/oracle
root@testnode1)$ rm /etc/oraInst.loc
root@testnode1)$ rm /etc/oratab
root@testnode1)$ rm /usr/local/bin/dbhome
root@testnode1)$ rm /usr/local/bin/oraenv
root@testnode1)$ rm /usr/local/bin/coraenv
root@testnode1)$ chown oracle:dba /u01/app

Node 2

root@testnode2)$ cd /u01/app
root@testnode2)$ rm -rf 11.2.0.3 oraInventory oracle
root@testnode2)$ rm -R /etc/oracle
root@testnode2)$ rm /etc/oraInst.loc
root@testnode2)$ rm /etc/oratab
root@testnode2)$ rm /usr/local/bin/dbhome
root@testnode2)$ rm /usr/local/bin/oraenv
root@testnode2)$ rm /usr/local/bin/coraenv
root@testnode2)$ chown oracle:dba /u01/app

Clear the header from the disk that was used in the ASM disk group

oracle@testnode2.vcint.com /export/home/oracle $ dd if=/dev/zero of=/dev/asmdisk2_udev bs=1024 count=10000
10000+0 records in
10000+0 records out
10240000 bytes (10 MB) copied, 2.2165 s, 4.6 MB/s

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

w

Connecting to %s