[nazeemodba]

Hi, am trying to install 2 node RAC on Oracle VMs. Before the installation during the -preinst check there were few issues which were resolved (ex user equivalence). After that during the installation process of the Grid it failed at step “Configure Oracle Grid Infrastructure for a cluster”. After it failed at this step, subsequent steps too failed which I asked OUI to ignore and then I ran both the post installation scripts. And then ran post crsinst which failed. Pasting below the output of the root.sh script, post crsinst and other checks.

*************************************

[root@bsfrac01 grid]# sh root.sh

Running Oracle 11g root.sh script…

The following environment variables are set as:

ORACLE_OWNER= oracle

ORACLE_HOME= /u01/app/11.2/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:

Copying dbhome to /usr/local/bin …

Copying oraenv to /usr/local/bin …

Copying coraenv to /usr/local/bin …

Creating /etc/oratab file…

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root.sh script.

Now product-specific root actions will be performed.

2011-02-13 00:11:55: Parsing the host name

2011-02-13 00:11:55: Checking for super user privileges

2011-02-13 00:11:55: User has super user privileges

Using configuration parameter file: /u01/app/11.2/grid/crs/install/crsconfig_params

Creating trace directory

LOCAL ADD MODE

Creating OCR keys for user ‘root’, privgrp ‘root’..

Operation successful.

root wallet

root wallet cert

root cert export

peer wallet

profile reader wallet

pa wallet

peer wallet keys

pa wallet keys

peer cert request

pa cert request

peer cert

pa cert

peer root cert TP

profile reader root cert TP

pa root cert TP

peer pa cert TP

pa peer cert TP

profile reader pa cert TP

profile reader peer cert TP

peer user cert

pa user cert

Adding daemon to inittab

CRS-4123: Oracle High Availability Services has been started.

ohasd is starting

CRS-2672: Attempting to start ‘ora.gipcd’ on ‘bsfrac01’

CRS-2672: Attempting to start ‘ora.mdnsd’ on ‘bsfrac01’

CRS-2676: Start of ‘ora.mdnsd’ on ‘bsfrac01’ succeeded

CRS-2676: Start of ‘ora.gipcd’ on ‘bsfrac01’ succeeded

CRS-2672: Attempting to start ‘ora.gpnpd’ on ‘bsfrac01’

CRS-2676: Start of ‘ora.gpnpd’ on ‘bsfrac01’ succeeded

CRS-2672: Attempting to start ‘ora.cssdmonitor’ on ‘bsfrac01’

CRS-2676: Start of ‘ora.cssdmonitor’ on ‘bsfrac01’ succeeded

CRS-2672: Attempting to start ‘ora.cssd’ on ‘bsfrac01’

CRS-2672: Attempting to start ‘ora.diskmon’ on ‘bsfrac01’

CRS-2676: Start of ‘ora.diskmon’ on ‘bsfrac01’ succeeded

CRS-2676: Start of ‘ora.cssd’ on ‘bsfrac01’ succeeded

CRS-2672: Attempting to start ‘ora.ctssd’ on ‘bsfrac01’

CRS-2676: Start of ‘ora.ctssd’ on ‘bsfrac01’ succeeded

ASM created and started successfully.

DiskGroup DATA1 created successfully.

clscfg: -install mode specified

Successfully accumulated necessary OCR keys.

Creating OCR keys for user ‘root’, privgrp ‘root’..

Operation successful.

CRS-2672: Attempting to start ‘ora.crsd’ on ‘bsfrac01’

CRS-2676: Start of ‘ora.crsd’ on ‘bsfrac01’ succeeded

CRS-4256: Updating the profile

Successful addition of voting disk 0ea2052d8a714fd7bf46d9d5c785483e.

Successfully replaced voting disk group with +DATA1.

CRS-4256: Updating the profile

CRS-4266: Voting file(s) successfully replaced

## STATE File Universal Id File Name Disk group

—

---

---

---

---

1. ONLINE 0ea2052d8a714fd7bf46d9d5c785483e (ORCL:DISK1) [DATA1]

Located 1 voting disk(s).

Failed to rmtcopy “/tmp/filekRIMbG” to “/u01/app/11.2/grid/gpnp/manifest.txt” for nodes {bsfrac01,bsfrac02}, rc=256

Failed to rmtcopy “/u01/app/11.2/grid/gpnp/bsfrac01/profiles/peer/profile.xml” to “/u01/app/11.2/grid/gpnp/profiles/peer/profile.xml” for nodes {bsfrac01,bsfrac02}, rc=256

rmtcopy aborted

Failed to promote local gpnp setup to other cluster nodes

CRS-2673: Attempting to stop ‘ora.crsd’ on ‘bsfrac01’

CRS-2677: Stop of ‘ora.crsd’ on ‘bsfrac01’ succeeded

CRS-2673: Attempting to stop ‘ora.asm’ on ‘bsfrac01’

CRS-2677: Stop of ‘ora.asm’ on ‘bsfrac01’ succeeded

CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘bsfrac01’

CRS-2677: Stop of ‘ora.ctssd’ on ‘bsfrac01’ succeeded

CRS-2673: Attempting to stop ‘ora.cssdmonitor’ on ‘bsfrac01’

CRS-2677: Stop of ‘ora.cssdmonitor’ on ‘bsfrac01’ succeeded

CRS-2673: Attempting to stop ‘ora.cssd’ on ‘bsfrac01’

CRS-2677: Stop of ‘ora.cssd’ on ‘bsfrac01’ succeeded

CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘bsfrac01’

CRS-2677: Stop of ‘ora.gpnpd’ on ‘bsfrac01’ succeeded

CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘bsfrac01’

CRS-2677: Stop of ‘ora.gipcd’ on ‘bsfrac01’ succeeded

CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘bsfrac01’

CRS-2677: Stop of ‘ora.mdnsd’ on ‘bsfrac01’ succeeded

Initial cluster configuration failed. See /u01/app/11.2/grid/cfgtoollogs/crsconfig/rootcrs_bsfrac01.log for details

[root@bsfrac01 grid]#

***************************************

[oracle@bsfrac01 bin]$ ./cluvfy stage -post crsinst -n bsfrac01,bsfrac02 -verbose

Performing post-checks for cluster services setup

Checking node reachability…

Check: Node reachability from node “bsfrac01”

Destination Node Reachable?

---

---

bsfrac01 yes

bsfrac02 yes

Result: Node reachability check passed from node “bsfrac01”

Checking user equivalence…

Check: User equivalence for user “oracle”

Node Name Comment

---

---

bsfrac01 passed

bsfrac02 passed

Result: User equivalence check passed for user “oracle”

ERROR:

PRKC-1094 : Failed to retrieve the active version of crs: {0}

Checking time zone consistency…

Time zone consistency check passed.

ERROR:

PRKC-1093 : Failed to retrieve the version of crs software on node “java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found

” : {1}

ERROR:

Cluster manager integrity check failed

PRVF-5434 : Cannot identify the current CRS software version

UDev attributes check for OCR locations started…

Result: UDev attributes check passed for OCR locations

UDev attributes check for Voting Disk locations started…

ERROR:

PRVF-5197 : Failed to retrieve voting disk locationsPRKC-1092 : Failed to retrieve the location of votedisks: java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found

Result: UDev attributes check failed for Voting Disk locations

Check default user file creation mask

Node Name Available Required Comment

---

---

---

---

bsfrac01 0022 0022 passed

bsfrac02 0022 0022 passed

Result: Default user file creation mask check passed

Checking cluster integrity…

Node Name

---

bsfrac01

Cluster integrity check failed This check did not run on the following node(s):

bsfrac02

Checking OCR integrity…

Checking the absence of a non-clustered configuration…

All nodes free of non-clustered, local-only configurations

ERROR:

PRKC-1094 : Failed to retrieve the active version of crs: {0}

ERROR:

PRVF-5300 : Failed to retrieve active version for CRS on this node

OCR integrity check failed

Checking CRS integrity…

ERROR:

PRKC-1094 : Failed to retrieve the active version of crs: {0}

ERROR:

PRVF-5300 : Failed to retrieve active version for CRS on this node

CRS integrity check failed

OCR detected on ASM. Running ACFS Integrity checks…

Starting check to see if ASM is running on all cluster nodes…

PRVF-5137 : Failure while checking ASM status on node “bsfrac01”

PRVF-5137 : Failure while checking ASM status on node “bsfrac02”

Starting Disk Groups check to see if at least one Disk Group configured…

PRVF-5112 : An Exception occurred while checking for Disk Groups

PRVF-5114 : Disk Group check failed. No Disk Groups configured

Task ACFS Integrity check failed

Checking Oracle Cluster Voting Disk configuration…

ERROR:

PRKC-1093 : Failed to retrieve the version of crs software on node “java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found

” : {1}

ERROR:

PRVF-5434 : Cannot identify the current CRS software version

PRVF-5431 : Oracle Cluster Voting Disk configuration check failed

Checking to make sure user “oracle” is not in “root” group

Node Name Status Comment

---

---

---

bsfrac01 does not exist passed

bsfrac02 does not exist passed

Result: User “oracle” is not part of “root” group. Check passed

Post-check for cluster services setup was unsuccessful on all the nodes.

*******************

[oracle@bsfrac01 bin]$ /u01/app/11.2/grid/bin/ocrcheck

Status of Oracle Cluster Registry is as follows :

Version : 3

Total space (kbytes) : 262120

Used space (kbytes) : 408

Available space (kbytes) : 261712

ID : 1671840043

Device/File Name : +DATA1

Device/File integrity check succeeded

Device/File not configured

Device/File not configured

Device/File not configured

Device/File not configured

Cluster registry integrity check succeeded

Logical corruption check bypassed due to non-privileged user

*******************************

ASM looks to be up and running..

[oracle@bsfrac01 bin]$ /usr/sbin/oracleasm listdisks

DISK1

DISK2

DISK3

DISK4

DISK5

DISK6

[oracle@bsfrac01 bin]$ /usr/sbin/oracleasm status

Checking if ASM is loaded: yes

Checking if /dev/oracleasm is mounted: yes

******************************

Please help.

[Saurabh Sood]

HI ,

From “ORCL:DISK1” it seems that you are using ASMLIB on your server.

I searched from Metalink and found on doc which explains the same issue as you are having. As per doc, this problem occurs if voting disk is not available to the system.

You need to do the following changes:

1. As root run the following command:

#/usr/sbin/oracleasm configure -i -e -u oracle -g dba -o “dm” -x “sd”

2. Restart the asmlib

Then proceed with the step where you left with.

[Author]

Posts