Restore and Recover OCR from export backup (Oracle Cluster Registry) in ORACLE RAC
How to Recover OCR from EXPORT Backup?
1. verify all nodes ocr are good using below command
ocrcheck
cluvfy comp ocr -n all -verbose
2 . Take export backup of OCR from any node using root user
ocrconfig -export /tmp/ocr_cluster_backup_11112017.ocr
3. Stop the Oracle clusterware on all the nodes.
crsctl stop crs -f
4.Start the Oracle Clusterware stack on one node in exclusive mode by running the following command as root:
# crsctl start crs -excl -nocrs
The -nocrs option ensures that the crsd process and OCR do not start with the rest of the Oracle Clusterware stack.
Ignore any errors that display.
Check whether crsd is running. If it is, then stop it by running the following command as root:
# crsctl stop resource ora.crsd -init
Caution:
Do not use the -init flag with any other command.
5. If you want to restore OCR to an Oracle ASM disk group, then you must first create a disk group using SQL*Plus that has the same name as the disk group you want to restore and mount it on the local node.
start clusterware on local node
crsctl start crs -excl -nocrs
6. Restore the OCR backup using ocr export file loction
ocrconfig -import /tmp/ocr_cluster_backup_11112017.ocr (Import metadata of OCR using command)
7. stop clusterware
crsctl stop crs -f
8. Restart the Clusterware on all nodes
Begin to start Oracle Clusterware by running the following command as root on all of the nodes:
# crsctl start crs
9. Verify OCR integrity of all of the cluster nodes that are configured as part of your cluster by running the following CVU command:
cluvfy comp ocr -n all -verbose
=================================================================
[root@rac2 ~]# ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3084
Available space (kbytes) : 259036
ID : 918475055
Device/File Name : +DATA2
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
[root@rac2 ~]#
[root@rac1 rac1]#
[root@rac1 rac1]# ocrconfig -showbackup
rac1 2017/10/23 20:13:00 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup00.ocr
rac2 2017/08/08 01:09:36 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup01.ocr
rac1 2017/07/31 22:15:16 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup02.ocr
rac1 2017/10/23 20:13:00 /u01/app/11.2.0/grid_1/cdata/rac-cluster/day.ocr
rac1 2017/10/23 20:13:00 /u01/app/11.2.0/grid_1/cdata/rac-cluster/week.ocr
rac2 2017/11/11 08:54:18 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup_20171111_085418.ocr
rac2 2017/11/11 08:18:06 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup_20171111_081806.ocr
rac2 2016/09/26 03:04:55 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup_20160926_030455.ocr
rac1 2016/09/26 02:52:42 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup_20160926_025242.ocr
[root@rac1 rac1]#
[root@rac1 rac1]#
[root@rac1 rac1]#
[root@rac1 rac1]#
[root@rac1 rac1]# ocrconfig -showbackup auto
rac1 2017/10/23 20:13:00 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup00.ocr
rac2 2017/08/08 01:09:36 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup01.ocr
rac1 2017/07/31 22:15:16 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup02.ocr
rac1 2017/10/23 20:13:00 /u01/app/11.2.0/grid_1/cdata/rac-cluster/day.ocr
rac1 2017/10/23 20:13:00 /u01/app/11.2.0/grid_1/cdata/rac-cluster/week.ocr
[root@rac1 rac1]#
[root@rac1 rac1]#
[root@rac1 rac1]#
[root@rac1 rac1]# ocrconfig -showbackup manual
rac2 2017/11/11 08:54:18 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup_20171111_085418.ocr
rac2 2017/11/11 08:18:06 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup_20171111_081806.ocr
rac2 2016/09/26 03:04:55 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup_20160926_030455.ocr
rac1 2016/09/26 02:52:42 /u01/app/11.2.0/grid_1/cdata/rac-cluster/backup_20160926_025242.ocr
[root@rac1 rac1]#
[root@rac1 rac1]#
[root@rac1 rac1]# ps -ef | grep d.bin | grep -v grep
root 2677 1 0 07:39 ? 00:00:31 /u01/app/11.2.0/grid_1/bin/ohasd.bin reboot
grid 3011 1 0 07:39 ? 00:00:00 /u01/app/11.2.0/grid_1/bin/mdnsd.bin
grid 3022 1 0 07:40 ? 00:00:03 /u01/app/11.2.0/grid_1/bin/gpnpd.bin
grid 3033 1 0 07:40 ? 00:00:25 /u01/app/11.2.0/grid_1/bin/gipcd.bin
root 3047 1 1 07:40 ? 00:01:18 /u01/app/11.2.0/grid_1/bin/osysmond.bin
grid 3093 1 0 07:40 ? 00:00:29 /u01/app/11.2.0/grid_1/bin/ocssd.bin
root 3258 1 0 07:40 ? 00:00:16 /u01/app/11.2.0/grid_1/bin/octssd.bin reboot
grid 3348 1 0 07:40 ? 00:00:15 /u01/app/11.2.0/grid_1/bin/evmd.bin
root 3616 1 0 07:41 ? 00:00:48 /u01/app/11.2.0/grid_1/bin/crsd.bin reboot
[root@rac1 rac1]#
[root@rac1 rac1]#
[root@rac1 rac1]#
[root@rac1 rac1]#
[root@rac1 rac1]#
[root@rac1 rac1]# cat /etc/oracle/ocr.loc
#Device/file +DATA1 getting replaced by device +DATA2
ocrconfig_loc=+DATA2
local_only=false[root@rac1 rac1]#
[root@rac1 rac1]#
Activity log for reference
=========================
[root@rac1 tmp]#
[root@rac1 tmp]# crsctl check cluster
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]# crsctl check cluster -all
**************************************************************
rac1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
rac2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]# ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3104
Available space (kbytes) : 259016
ID : 918475055
Device/File Name : +DATA2
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
[root@rac1 tmp]#
stop crs on node 2
=======================
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]# crsctl stop crs
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac2'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac2'
CRS-2673: Attempting to stop 'ora.orcl.db' on 'rac2'
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac2'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac2'
CRS-2673: Attempting to stop 'ora.cvu' on 'rac2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac2'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac2'
CRS-2677: Stop of 'ora.cvu' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.cvu' on 'rac1'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.rac2.vip' on 'rac2'
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac2'
CRS-2676: Start of 'ora.cvu' on 'rac1' succeeded
CRS-2677: Stop of 'ora.scan2.vip' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.scan2.vip' on 'rac1'
CRS-2677: Stop of 'ora.orcl.db' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.DATA1.dg' on 'rac2'
CRS-2673: Attempting to stop 'ora.DATA2.dg' on 'rac2'
CRS-2677: Stop of 'ora.rac2.vip' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.rac2.vip' on 'rac1'
CRS-2677: Stop of 'ora.scan3.vip' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.scan3.vip' on 'rac1'
CRS-2676: Start of 'ora.scan2.vip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'rac1'
CRS-2676: Start of 'ora.rac2.vip' on 'rac1' succeeded
CRS-2676: Start of 'ora.scan3.vip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN3.lsnr' on 'rac1'
CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'rac1' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN3.lsnr' on 'rac1' succeeded
CRS-2677: Stop of 'ora.DATA2.dg' on 'rac2' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.oc4j' on 'rac1'
CRS-2676: Start of 'ora.oc4j' on 'rac1' succeeded
CRS-2677: Stop of 'ora.DATA1.dg' on 'rac2' succeeded
CRS-2679: Attempting to clean 'ora.DATA1.dg' on 'rac2'
CRS-2681: Clean of 'ora.DATA1.dg' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac2'
CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac2'
CRS-2677: Stop of 'ora.ons' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac2'
CRS-2677: Stop of 'ora.net1.network' on 'rac2' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac2' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'rac2'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac2'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac2'
CRS-2673: Attempting to stop 'ora.asm' on 'rac2'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac2'
CRS-2677: Stop of 'ora.crf' on 'rac2' succeeded
CRS-2677: Stop of 'ora.evmd' on 'rac2' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac2' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac2' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac2'
CRS-2677: Stop of 'ora.cssd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac2'
CRS-2677: Stop of 'ora.gipcd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac2'
CRS-2677: Stop of 'ora.gpnpd' on 'rac2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]# ps -ef | grep -i d.bin | grep -v grep
root 2688 1 0 07:38 ? 00:00:35 /u01/app/11.2.0/grid_1/bin/ohasd.bin reboot
grid 2997 1 0 07:39 ? 00:00:00 /u01/app/11.2.0/grid_1/bin/mdnsd.bin
grid 3027 1 0 07:39 ? 00:00:03 /u01/app/11.2.0/grid_1/bin/gpnpd.bin
grid 3042 1 0 07:39 ? 00:00:27 /u01/app/11.2.0/grid_1/bin/gipcd.bin
root 3056 1 1 07:39 ? 00:01:23 /u01/app/11.2.0/grid_1/bin/osysmond.bin
grid 3105 1 0 07:39 ? 00:00:33 /u01/app/11.2.0/grid_1/bin/ocssd.bin
root 3322 1 0 07:40 ? 00:00:17 /u01/app/11.2.0/grid_1/bin/octssd.bin reboot
grid 3348 1 0 07:40 ? 00:00:15 /u01/app/11.2.0/grid_1/bin/evmd.bin
root 3626 1 0 07:41 ? 00:00:52 /u01/app/11.2.0/grid_1/bin/crsd.bin reboot
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]# ps -ef | grep -i d.bin | grep -v grep
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]# ocrcheck
PROT-602: Failed to retrieve data from the cluster registry
PROC-26: Error while accessing the physical storage
ORA-29701: unable to connect to Cluster Synchronization Service
[root@rac2 ~]#
Now crs running on me node
================================
[root@rac1 tmp]#
[root@rac1 tmp]# crsctl check cluster -all
**************************************************************
rac1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[root@rac1 tmp]#
[root@rac1 tmp]#
stop crs on first node
[root@rac1 tmp]#
[root@rac1 tmp]# crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.cvu' on 'rac1'
CRS-2673: Attempting to stop 'ora.orcl.db' on 'rac1'
CRS-2673: Attempting to stop 'ora.rac2.vip' on 'rac1'
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac1'
CRS-2677: Stop of 'ora.cvu' on 'rac1' succeeded
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac1' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac1'
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac1'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac1'
CRS-2677: Stop of 'ora.rac2.vip' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.rac1.vip' on 'rac1'
CRS-2677: Stop of 'ora.orcl.db' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.DATA1.dg' on 'rac1'
CRS-2673: Attempting to stop 'ora.DATA2.dg' on 'rac1'
CRS-2677: Stop of 'ora.scan1.vip' on 'rac1' succeeded
CRS-2677: Stop of 'ora.scan2.vip' on 'rac1' succeeded
CRS-2677: Stop of 'ora.scan3.vip' on 'rac1' succeeded
CRS-2677: Stop of 'ora.rac1.vip' on 'rac1' succeeded
CRS-2677: Stop of 'ora.DATA2.dg' on 'rac1' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'rac1' succeeded
CRS-2677: Stop of 'ora.DATA1.dg' on 'rac1' succeeded
CRS-2679: Attempting to clean 'ora.DATA1.dg' on 'rac1'
CRS-2681: Clean of 'ora.DATA1.dg' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac1'
CRS-2677: Stop of 'ora.ons' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac1'
CRS-2677: Stop of 'ora.net1.network' on 'rac1' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac1' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'rac1'
CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]# crsctl start crs -excl -nocrs
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'
CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'
CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'
CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac1'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'
CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded
CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'
CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac1'
CRS-2676: Start of 'ora.asm' on 'rac1' succeeded
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]# ps -ef | grep -i d.bin | grep -v grep
root 19821 1 1 10:46 ? 00:00:02 /u01/app/11.2.0/grid_1/bin/ohasd.bin exclusive
grid 19970 1 0 10:46 ? 00:00:00 /u01/app/11.2.0/grid_1/bin/mdnsd.bin
grid 19981 1 0 10:46 ? 00:00:00 /u01/app/11.2.0/grid_1/bin/gpnpd.bin
grid 20001 1 0 10:46 ? 00:00:00 /u01/app/11.2.0/grid_1/bin/gipcd.bin
grid 20057 1 0 10:46 ? 00:00:00 /u01/app/11.2.0/grid_1/bin/ocssd.bin -X
root 20183 1 0 10:46 ? 00:00:00 /u01/app/11.2.0/grid_1/bin/octssd.bin
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]# ocrconfig -import /tmp/latest_ocr11112017.dmp
[root@rac1 tmp]#
[root@rac1 tmp]# ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3084
Available space (kbytes) : 259036
ID : 2125290321
Device/File Name : +DATA2
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
[root@rac1 tmp]# crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]# ps -ef | grep -i d.bin | grep -v grep
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]# crsctl start crs
CRS-4123: Oracle High Availability Services has been started.
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]# crsctl check cluster -all
**************************************************************
rac1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]#
[root@rac1 tmp]# crsctl check cluster -all
**************************************************************
rac1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
rac2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[root@rac1 tmp]#
[root@rac1 tmp]#
after restore ocr
[grid@rac1 rac1]$
[grid@rac1 rac1]$
[grid@rac1 rac1]$ cluvfy comp ocr -n all -verbose
Verifying OCR integrity
Checking OCR integrity...
Checking the absence of a non-clustered configuration...
All nodes free of non-clustered, local-only configurations
ASM Running check passed. ASM is running on all specified nodes
Checking OCR config file "/etc/oracle/ocr.loc"...
OCR config file "/etc/oracle/ocr.loc" check successful
Disk group for ocr location "+DATA2" available on all the nodes
NOTE:
This check does not verify the integrity of the OCR contents. Execute 'ocrcheck' as a privileged user to verify the contents of OCR.
OCR integrity check passed
Verification of OCR integrity was successful.
[grid@rac1 rac1]$
[root@rac1 tmp]# ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3084
Available space (kbytes) : 259036
ID : 2125290321
Device/File Name : +DATA2
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
[root@rac1 tmp]#
you can also check log
2017-11-11 10:46:41.394:
[ctssd(20183)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac1.
2017-11-11 10:51:10.895:
[client(21540)]CRS-1001:The OCR was formatted using version 3.
2017-11-11 10:51:23.457:
[client(21540)]CRS-1004:The OCR was imported from /tmp/latest_ocr11112017.dmp.
2017-11-11 10:52:24.178:
[mdnsd(19970)]CRS-5602:mDNS service stopping by request.
2017-11-11 10:52:24.191:
http://www.shannura.com/archives/2226261108_ocr_01.html
https://somireddy.wordpress.com/2013/06/21/restoring-ocr-disk-voting-disk-on-asm-disk-in-11gr2/
http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle10gRAC/CLUSTER_65.shtml
