Start of ‘ora.crf’ failed after update to 12.1.0.2 DBBP7
This happened to me a month ago right after I applied DBBP7 on 12.1.0.2. For some reason the ora.crf resource didn't start automatically:
CRS-5013: Agent "ORAROOTAGENT" failed to start process "/u01/app/12.1.0.2/grid/bin/osysmond" for action "start": details at "(:CLSN00008:)" in "/u01/app/oracle/diag/crs/exa01db01/crs/trace/ohasd_orarootagent_root.trc"
CRS-2674: Start of 'ora.crf' on 'exa01db01' failed[/plain]
Checking the trace file for more details you can immediately spot where the problem is:
2015-06-04 10:35:51.156513 :CLSDYNAM:3286230784: [ ora.crf]{0:0:8275} [start] (:CLSN00008:)Utils:execCmd scls_process_spawn() failed 1
2015-06-04 10:35:51.156520 :CLSDYNAM:3286230784: [ ora.crf]{0:0:8275} [start] (:CLSN00008:) category: -1, operation: fail, loc: canexec2, OS error: 0, other: no exe permission, file [/u01/app/12.1.0.2/grid/bin/osysmond]
Indeed the osysmond is owned by the oracle user where it should be owned by root:
[root@exa01db01 ~]# ls -al /u01/app/12.1.0.2/grid/bin/osysmond
-rwxr-x--- 1 oracle oinstall 9441 Jun 4 10:42 /u01/app/12.1.0.2/grid/bin/osysmond
The fix for that is simple - you need to unlock and lock the GI:
[root@exa01db01 ~]# /u01/app/12.1.0.2/grid/crs/install/rootcrs.pl -unlock
[root@exa01db01 ~]# /u01/app/12.1.0.2/grid/crs/install/rootcrs.pl -patch
The osysmond has the correct permissions now and the resource ora.crf starts sucessfully:
[root@exa01db01 ~]# ls -al /u01/app/12.1.0.2/grid/bin/osysmond
-rwxr-x--- 1 root oinstall 9533 Jun 4 10:48 /u01/app/12.1.0.2/grid/bin/osysmond[/plain]
For reference:
CRS-2672: Attempting to start 'ora.crf' on CRS-2674: Start of 'ora.crf' on failed CRS-2679: Attempting to clean 'ora.crf' on (Doc ID 1902447.1)