Articles Comments

AskDba.org Weblog » Archive for April 2009

SRVCTL fails to start RAC resources:CRS-0215

April 20th, 2009 | Add a Comment

After upgrading RAC database to 10204 and applying CRS bundle patch-1 for 10204 crs home, srvctl command fails to startup resources on rac nodes. While starting up RAC resources using SRVCTL following error occurs in CRSD.log file: $ srvctl start instance -d rac -i rac2 2009-04-09 13:45:22.091: [ CRSRES][2611477408][ALERT]0`ora...inst` on member `` has experienced an unrecoverable failure. 2009-04-09 13:45:22.091: [ CRSRES][2611477408]0Human intervention required to resume its availability. 2009-04-09 13:46:25.162: [ CRSRES][2611477408]0StopResource: setting CLI values 2009-04-09 13:46:25.174: [ CRSRES][2611477408]0Attempting to stop `ora...inst` on member `` 2009-04-09 13:46:25.206: [ CRSAPP][2611477408]0StopResource error for ora...inst error code = 1 To debug SRVCTL SRVM_TRACE is set to true and a Strace is taken at OS level: $script /tmp/srvm.log $export SRVM_TRACE=TRUE $srvctl start instance -d -i $exit It will genertae a trace file at /tmp/srvm.log. $ strace -aef -o /tmp/strace.log srvctl start instance -d … Read entire article »

Filed under: oracle, rac

ORA-1078 ORA-1565 Errors while starting database with SPFILE on ASM

April 14th, 2009 | 2 Comments

I was getting following error’s while starting a database using spfile on ASM. Actually this was a cloned RAC environment. SQL> create SPFILE='+ASM_GROUP/PORTALDB/spfileportaldb.ora' from pfile; File created. SQL> shut immediate; ORA-01109: database not open Database dismounted. ORACLE instance shut down. SQL> exit SQL> startup mount ORA-01078: failure in processing system parameters ORA-01565: error in identifying file '+ASM_GROUP/PORTALDB/spfileportaldb.ora' ORA-17503: ksfdopn:2 Failed to open file +ASM_GROUP/PORTALDB/spfileportaldb.ora ORA-01000: maximum open cursors exceeded Error first states that it has failed to process the parameter. Second states that it has failed to identify the spfile and is unable to open. But I was able to open the database normally with pfile. Also the spfile was present in ASM diskgroup which I confirmed by listing DG contets on asmcmd prompt. Problem here was that I had started the database with pfile from non-default location and pfile located in $ORACLE_HOME/dbs had … Read entire article »

Filed under: database, oracle

Grid Control Fails to Start

April 13th, 2009 | 2 Comments

The link for Grid Control was not Working and it failed to show the login page. In this situation  checked the following things: 1. The repository database was up and running 2. The listener was up. 3. OMS server was down. Tried to stratup the OMS server using opmnctl startall command, but it showed following error in ons.log file: 09/04/08 06:06:18 [4] ONS server initiated 09/04/08 06:06:18 [2] BIND (Address already in use) 09/04/08 06:06:18 [2] 127.0.0.1:6104 - listener BIND failed 09/04/08 06:06:18 [4] Listener thread 98311: 127.0.0.1:6104 (0x442) terminating 09/04/08 06:06:18 [1] Local listener terminated As it showed that the port is busy, now the obvious choice is to check which application is still holding the port. It can be done by using command: netstat -a|grep <port_number> i.e netstat -a |grep 6104 and the result was, no application was using this … Read entire article »

Filed under: grid, oracle

Connections to DataBase Hang Including “/ as sysdba”

April 7th, 2009 | 2 Comments

Recently I faced one issue where all the connection to database hung and it was also not possible to login to database using “/ as sysdba”. To get access of sqlplus I used the following syntax: $ sqlplus -prelim / as sysdba With “prelim” option we can run some commands which will help in collection useful information about the problem. This will work only in Oracle 10g and higher version. After successfully getting connected run the following commands to generate Hanganalyze and systemstate traces: SQL> oradebug setmypid SQL> oradebug unlimit SQL> oradebug dump systemstate 266 SQL> oradebug tracefile_name – This will give you the name of the tracefile generated. SQL > oradebug dump hanganalyze 2 SQL > oradebug tracefile_name To analyze these trace files one should be aware of Metalink Note: 215858.1. After analyzing these files I found that following event was active and … Read entire article »

Filed under: oracle, performance