The GI PSU patch 23274134 includes updates for both the Clusterware home and Database home that can be applied in a rolling fashion.
Configuration and PSU Mapping
Configuration : GI Home in conjunction with RAC
GI Version : 11.2.0.4
Database Versions : 11.2.0.4
PSU Patch (to Apply) : GI PSU including rdbms patch
Comments : GI Home and all the Database Homes will be patched
Patch Numbers Getting Installed as Part of this GI PSU Patch
23054359 ---> DB PSU 11.2.0.4.160719 (INCLUDES CPUJUL2016) ---> Both DB and Grid Home
23054319 ---> OCW PSU 11.2.0.4.160719 ---> Both DB Homes and Grid Home
22502505 ----> ACFS PSU 11.2.0.4.160419 ---> Only Grid Home
Download and Unzip the Patch
[grid@node1 PSU_PATCH]# pwd
/data01/PSU_PATCH
[grid@node1 PSU_PATCH]# ls -lrth
total 116K
drwxrwxr-x 5 grid oinstall 4.0K Jul 15 17:50 23274134
-rwxrwxr-x 1 grid oinstall 109K Jul 19 12:50 PatchSearch.xml
[grid@node1 23274134]$ pwd
/data01/PSU_PATCH/23274134
[grid@node1 23274134]$ ls -lrt
total 156
drwxrwxrwx 5 grid oinstall 4096 Feb 17 2016 22502505
drwxrwxrwx 13 grid oinstall 4096 Jun 15 12:10 23054359
drwxrwxrwx 5 grid oinstall 4096 Jul 15 17:38 23054319
-rwxrwxrwx 1 grid oinstall 72207 Jun 28 10:30 PatchSearch.xml
-rwxrwxrwx 1 grid oinstall 549 Jul 15 17:49 bundle.xml
-rwxrwxrwx 1 grid oinstall 64093 Jul 19 10:17 README.html
-rwxrwxrwx 1 grid oinstall 24 Jul 19 10:17 README.txt
Patch Installation Prerequisites
OPatch Utility version should be 11.2.0.3.6 or later to apply this patch . Check on both node1 and node2 under both $GRID_HOME and $ORACLE_HOME:
[grid@node1 OPatch]$ ./opatch version
OPatch Version: 11.2.0.3.15
OPatch succeeded.
[oracle@node1 OPatch]$ ./opatch version
OPatch Version: 11.2.0.3.15
OPatch succeeded.
Validation of Oracle Inventory
Before beginning patch application, check the consistency of inventory information for GI home and each database home to be patched. Run the following command as respective Oracle home owner to check the consistency.
[grid@node1 23274134]$ /data01/app/11.2.0/grid_11204/OPatch/opatch lsinventory -oh /data01/app/11.2.0/grid_11204
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_03-33-01AM_1.log
Lsinventory Output file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/lsinv/lsinventory2016-10-01_03-33-01AM.txt
--------------------------------------------------------------------------------
Local Machine Information::
Hostname: node1.localdomain
ARU platform id: 226
ARU platform description:: Linux x86-64
Installed Top-level Products (1):
Oracle Grid Infrastructure 11g 11.2.0.4.0
There are 1 products installed in this Oracle Home.
There are no Interim patches installed in this Oracle Home.
Rac system comprising of multiple nodes
Local node = node1
Remote node = node2
--------------------------------------------------------------------------------
OPatch succeeded.
[oracle@node1 ~]$ /data01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch lsinventory -oh /data01/app/oracle/product/11.2.0.4/db_1
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_03-34-34AM_1.log
Lsinventory Output file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/lsinv/lsinventory2016-10-01_03-34-34AM.txt
--------------------------------------------------------------------------------
Local Machine Information::
Hostname: node1.localdomain
ARU platform id: 226
ARU platform description:: Linux x86-64
Installed Top-level Products (1):
Oracle Database 11g 11.2.0.4.0
There are 1 products installed in this Oracle Home.
There are no Interim patches installed in this Oracle Home.
Rac system comprising of multiple nodes
Local node = node1
Remote node = node2
--------------------------------------------------------------------------------
OPatch succeeded.
Stop EM Agent Processes Prior to Patching and Prior to Rolling Back the Patch
$ORACLE_HOME/bin/emctl stop dbconsole
One-off Patch Conflict Detection and Resolution
[grid@node1 23054359]$ cd /data01/PSU_PATCH/23274134/22502505
[grid@node1 22502505]$ /data01/app/11.2.0/grid_11204/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_03-47-49AM_1.log
Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.
OPatch succeeded.
[grid@node1 23054359]$ cd /data01/PSU_PATCH/23274134/23054359
[grid@node1 23054359]$ /data01/app/11.2.0/grid_11204/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_03-49-25AM_1.log
Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.
OPatch succeeded.
[grid@node1 23054319]$ cd /data01/PSU_PATCH/23274134/23054319
[grid@node1 23054319]$ /data01/app/11.2.0/grid_11204/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_03-50-07AM_1.log
Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.
OPatch succeeded.
[oracle@node1 23054359]$ cd /data01/PSU_PATCH/23274134/23054359
[oracle@node1 23054359]$ /data01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_03-52-32AM_1.log
Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.
OPatch succeeded.
[oracle@node1 23054319]$ cd /data01/PSU_PATCH/23274134/23054319
[oracle@node1 23054319]$ /data01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_03-54-14AM_1.log
Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.
OPatch succeeded.
Verify Server, Cluster info
[grid@node1 OPatch]$ cemutlo -n
node-cluster
[grid@node1 OPatch]$ ps -ef | grep ora_pmon | grep -v grep | awk -F_ '{ print $3 }' | sort -u
orcl1
[grid@node1 OPatch]$ srvctl status scan_listener
SCAN Listener LISTENER_SCAN1 is enabled
SCAN listener LISTENER_SCAN1 is running on node node2
SCAN Listener LISTENER_SCAN2 is enabled
SCAN listener LISTENER_SCAN2 is running on node node1
SCAN Listener LISTENER_SCAN3 is enabled
SCAN listener LISTENER_SCAN3 is running on node node1
ACFS considerations
Oracle Grid Infra 11.2.0.4.x Patch Set Update SUPPLEMENTAL README (Doc ID 1641136.1)
1494652.1 How to Mount or Unmount ACFS File System While Applying GI Patches?
When patching the GI Home, a shared location on ACFS only needs to be unmounted on the node where the GI Home is being patched.
[grid@node1 grid_11204]$ df -kh
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_node1-lv_root
28G 19G 7.5G 72% /
tmpfs 1004M 394M 610M 40% /dev/shm
/dev/sda1 485M 55M 405M 12% /boot
Softwares 84G 14G 71G 17% /media/sf_Softwares
/dev/sr0 57M 57M 0 100% /media/VBOXADDITIONS_5.1.6_110634
/dev/asm/asmvol-260 4.9G 151M 4.7G 4% /data01/app/grid/acfsmounts/asmvol_asmvol
SQL> SELECT dg.name AS diskgroup, v.volume_name, v.volume_device, v.mountpath,v.state FROM V$ASM_DISKGROUP dg, V$ASM_VOLUME v WHERE dg.group_number = v.group_number;
DISKGROUP VOLUME_NAME VOLUME_DEVICE MOUNTPATH STATE
--------------- -------------------- -----------------------------------------------------------------------
ASMVOL ASMVOL /dev/asm/asmvol-260 /data01/app/grid/acfsmounts/asmvol_asmvol ENABLED
For each node, perform the following steps:
[root@node1 ~]# /sbin/acfsutil registry
Mount Object:
Device: /dev/asm/asmvol-260
Mount Point: /data01/app/grid/acfsmounts/asmvol_asmvol
Disk Group: ASMVOL
Volume: ASMVOL
Options: none
Nodes: all
[grid@node2 ~]$ /sbin/acfsutil info fs
/data01/app/grid/acfsmounts/asmvol_asmvol
ACFS Version: 11.2.0.4.0
flags: MountPoint,Available
mount time: Sat Oct 1 01:05:54 2016
volumes: 1
total size: 5167382528
total free: 5009920000
primary volume: /dev/asm/asmvol-260
label:
flags: Primary,Available,ADVM
on-disk version: 39.0
allocation unit: 4096
major, minor: 251, 133121
size: 5167382528
free: 5009920000
ADVM diskgroup ASMVOL
ADVM resize increment: 33554432
ADVM redundancy: unprotected
ADVM stripe columns: 4
ADVM stripe width: 131072
number of snapshots: 0
snapshot space usage: 0
replication status: DISABLED
[root@node1 ~]# /bin/umount /data01/app/grid/acfsmounts/asmvol_asmvol
[root@node1 ~]# /sbin/acfsutil info fs
acfsutil info fs: ACFS-03036: no mounted ACFS file systems -------> Mount point successfully un-mounted
Perform same step on node2 for acfs :
[root@node2 ~]# /bin/umount /data01/app/grid/acfsmounts/asmvol_asmvol
[root@node2 ~]# /sbin/acfsutil info fs
acfsutil info fs: ACFS-03036: no mounted ACFS file systems
[root@node2 ~]#
** Roll services from Node1 to Node2 and stop oracle on node1 :
[oracle@node1 ~]$ srvctl status service -d orcl
Service node1_app is running on instance(s) orcl1
Service node2_app is running on instance(s) orcl2
[oracle@node1 ~]$ srvctl relocate service -s node1_app -d orcl -i orcl1 -t orcl2
[oracle@node1 ~]$ srvctl status service -d orcl
Service node1_app is running on instance(s) orcl2
Service node2_app is running on instance(s) orcl2
As Oracle you'll need to stop the services running out of the database home. Shutdown all instances :
[oracle@node1 ~]$ srvctl stop instance -d orcl -i orcl1 -o immediate
[oracle@node1 ~]$ srvctl status database -d orcl -v
Instance orcl1 is not running on node node1
Instance orcl2 is running on node node2 with online services node1_app,node2_app. Instance status: Open.
[oracle@node1 ~]$ srvctl stop home -o /data01/app/oracle/product/11.2.0.4/db_1 -s /tmp/db_1_stop -n node1
Unlock Grid home using root :
[root@node1 ~]# ps -ef | grep d.bin
root 2644 1 0 00:58 ? 00:00:44 /data01/app/11.2.0/grid_11204/bin/ohasd.bin reboot
grid 2968 1 0 00:58 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/mdnsd.bin
grid 2979 1 0 00:58 ? 00:00:04 /data01/app/11.2.0/grid_11204/bin/gpnpd.bin
grid 2989 1 0 00:58 ? 00:00:38 /data01/app/11.2.0/grid_11204/bin/gipcd.bin
root 3003 1 1 00:58 ? 00:02:30 /data01/app/11.2.0/grid_11204/bin/osysmond.bin
grid 3047 1 0 00:58 ? 00:00:45 /data01/app/11.2.0/grid_11204/bin/ocssd.bin
root 4051 1 0 01:02 ? 00:00:23 /data01/app/11.2.0/grid_11204/bin/octssd.bin reboot
grid 4074 1 0 01:02 ? 00:00:22 /data01/app/11.2.0/grid_11204/bin/evmd.bin
root 4500 1 0 01:03 ? 00:01:18 /data01/app/11.2.0/grid_11204/bin/crsd.bin reboot
root 15459 15355 0 04:48 pts/0 00:00:00 grep d.bin
[root@node1 ~]# ps -ef | grep pmon
grid 4329 1 0 01:03 ? 00:00:02 asm_pmon_+ASM1
[root@node1 ~]# /data01/app/11.2.0/grid_11204/crs/install/rootcrs.pl -unlock
Using configuration parameter file: /data01/app/11.2.0/grid_11204/crs/install/crsconfig_params
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'node1'
CRS-2673: Attempting to stop 'ora.crsd' on 'node1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'node1'
CRS-2673: Attempting to stop 'ora.cvu' on 'node1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'node1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'node1'
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'node1'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'node1'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'node1'
CRS-2673: Attempting to stop 'ora.oc4j' on 'node1'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'node1'
CRS-2677: Stop of 'ora.cvu' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.cvu' on 'node2'
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'node1'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'node1'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.node1.vip' on 'node1'
CRS-2677: Stop of 'ora.node1.vip' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.node1.vip' on 'node2'
CRS-2677: Stop of 'ora.scan3.vip' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.scan3.vip' on 'node2'
CRS-2677: Stop of 'ora.registry.acfs' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.ASMVOL.dg' on 'node1'
CRS-2677: Stop of 'ora.scan2.vip' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.scan2.vip' on 'node2'
CRS-2676: Start of 'ora.cvu' on 'node2' succeeded
CRS-2676: Start of 'ora.node1.vip' on 'node2' succeeded
CRS-2676: Start of 'ora.scan2.vip' on 'node2' succeeded
CRS-2676: Start of 'ora.scan3.vip' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'node2'
CRS-2672: Attempting to start 'ora.LISTENER_SCAN3.lsnr' on 'node2'
CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'node2' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN3.lsnr' on 'node2' succeeded
CRS-2677: Stop of 'ora.OCR.dg' on 'node1' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'node1' succeeded
CRS-2677: Stop of 'ora.ASMVOL.dg' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'node1'
CRS-2677: Stop of 'ora.asm' on 'node1' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.oc4j' on 'node2'
CRS-2676: Start of 'ora.oc4j' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'node1'
CRS-2677: Stop of 'ora.ons' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'node1'
CRS-2677: Stop of 'ora.net1.network' on 'node1' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'node1' has completed
CRS-2677: Stop of 'ora.crsd' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'node1'
CRS-2673: Attempting to stop 'ora.evmd' on 'node1'
CRS-2673: Attempting to stop 'ora.asm' on 'node1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'node1'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'node1'
CRS-2677: Stop of 'ora.evmd' on 'node1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'node1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'node1' succeeded
CRS-2677: Stop of 'ora.drivers.acfs' on 'node1' succeeded
CRS-2677: Stop of 'ora.asm' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'node1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'node1'
CRS-2677: Stop of 'ora.cssd' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'node1'
CRS-2677: Stop of 'ora.crf' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'node1'
CRS-2677: Stop of 'ora.gipcd' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'node1'
CRS-2677: Stop of 'ora.gpnpd' on 'node1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'node1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
Successfully unlock /data01/app/11.2.0/grid_11204
[root@node1 ~]# ps -ef | grep d.bin
root 16401 15355 0 04:53 pts/0 00:00:00 grep d.bin
[root@node1 ~]# ps -ef | grep pmon
root 16419 15355 0 04:53 pts/0 00:00:00 grep pmon
Switch to grid user and Patch GI Home:
[grid@node1 PSU_PATCH]$ which opatch
/data01/app/11.2.0/grid_11204/OPatch/opatch
[grid@node1 PSU_PATCH]$ whoami
grid
[grid@node1 PSU_PATCH]$
[grid@node1 23274134]$ /data01/app/11.2.0/grid_11204/OPatch/opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/22502505
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_04-59-00AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 22502505
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '22502505' to OH '/data01/app/11.2.0/grid_11204'
Patching component oracle.usm, 11.2.0.4.0...
Patch 22502505 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_04-59-00AM_1.log
OPatch succeeded.
[grid@node1 23274134]$ opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/23054359
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_05-10-40AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 17478514 18031668 18522509 19121551 19769489 20299013 20760982 21352635 21948347 22502456 23054359
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying sub-patch '17478514' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sdo, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.sdo.locator, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18031668' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.ldap.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.crs, 11.2.0.4.0...
Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18522509' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '19121551' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.ordim.client, 11.2.0.4.0...
Patching component oracle.ordim.jai, 11.2.0.4.0...
Applying sub-patch '19769489' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ] , [ oracle.sysman.agent, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.util, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20299013' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] , [ oracle.rdbms.oci, 11.2.0.4.0 ] , [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.sysman.common, 10.2.0.4.5...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sysman.common.core, 10.2.0.4.5...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20760982' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '21352635' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Applying sub-patch '21948347' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] , [ oracle.sysman.oms.core, 10.2.0.4.5 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '22502456' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.rdbms.olap, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.oraolap.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Composite patch 23054359 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_05-10-40AM_1.log
OPatch succeeded.
[grid@node1 23274134]$ opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_05-23-42AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 23054319
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '23054319' to OH '/data01/app/11.2.0/grid_11204'
Patching component oracle.crs, 11.2.0.4.0...
Patch 23054319 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_05-23-42AM_1.log
OPatch succeeded.
Start CRS Services As Root
# whoami
root
[root@node1 ~]# /data01/app/11.2.0/grid_11204/crs/install/rootcrs.pl -patch
Using configuration parameter file: /data01/app/11.2.0/grid_11204/crs/install/crsconfig_params
Installing Trace File Analyzer
CRS-4123: Oracle High Availability Services has been started.
[root@node1 ~]# ps -ef | grep d.bin
root 25999 1 1 05:43 ? 00:00:01 /data01/app/11.2.0/grid_11204/bin/ohasd.bin reboot
grid 26156 1 0 05:44 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/mdnsd.bin
grid 26170 1 0 05:44 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/gpnpd.bin
grid 26180 1 0 05:44 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/gipcd.bin
root 26183 1 1 05:44 ? 00:00:01 /data01/app/11.2.0/grid_11204/bin/osysmond.bin
grid 26267 1 0 05:44 ? 00:00:01 /data01/app/11.2.0/grid_11204/bin/ocssd.bin
root 26419 1 0 05:44 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/octssd.bin reboot
grid 26447 1 0 05:44 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/evmd.bin
root 26702 1 1 05:45 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/crsd.bin reboot
root 27313 23786 0 05:46 pts/0 00:00:00 grep d.bin
[root@node1 ~]# ps -ef | grep pmon
grid 26582 1 0 05:44 ? 00:00:00 asm_pmon_+ASM1
root 27316 23786 0 05:46 pts/0 00:00:00 grep pmon
Switch to Oracle. Patch Oracle Home:
[oracle@node1 23054319]$ which opatch
/data01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch
[oracle@node1 23054319]$ opatch apply -oh /data01/app/oracle/product/11.2.0.4/db_1 -local /data01/PSU_PATCH/23274134/23054359
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_05-49-44AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 17478514 18031668 18522509 19121551 19769489 20299013 20760982 21352635 21948347 22502456 23054359
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/oracle/product/11.2.0.4/db_1')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying sub-patch '17478514' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sdo, 11.2.0.4.0...
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.sdo.locator, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18031668' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.ldap.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.crs, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18522509' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '19121551' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.ordim.client, 11.2.0.4.0...
Patching component oracle.ordim.jai, 11.2.0.4.0...
Applying sub-patch '19769489' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.sysman.agent, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.ovm, 11.2.0.4.0...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms.util, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.oraolap, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20299013' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.dv, 11.2.0.4.0...
Patching component oracle.rdbms.oci, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.sysman.common, 10.2.0.4.5...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sysman.common.core, 10.2.0.4.5...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20760982' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '21352635' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Applying sub-patch '21948347' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.tfa, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.ovm, 11.2.0.4.0...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sysman.oms.core, 10.2.0.4.5...
Applying sub-patch '22502456' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.tfa, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.oraolap.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.olap, 11.2.0.4.0...
Patching component oracle.oraolap, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.dv, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.dv, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Composite patch 23054359 successfully applied.
Log file location: /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_05-49-44AM_1.log
OPatch succeeded.
[oracle@node1 23054319]$ opatch apply -oh /data01/app/oracle/product/11.2.0.4/db_1 -local /data01/PSU_PATCH/23274134/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_06-17-49AM_1.log
Verifying environment and performing prerequisite checks...
UtilSession failed: Patch 23054319 requires component(s) that are not installed in OracleHome. These not-installed components are oracle.crs:11.2.0.4.0,
Log file location: /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_06-17-49AM_1.log
OPatch failed with error code 73
Solution : Above issue is a known bug . Reason is duplicate custom/server folder under the patch directory as shown below .
[oracle@node1 23054319]$ pwd
/data01/PSU_PATCH/23274134/23054319/custom/server/23054319
[oracle@node1 23054319]$ ls -lrth
total 32K
-rwxrwxrwx 1 grid oinstall 17K Jul 15 17:38 README.txt
drwxrwxrwx 11 grid oinstall 4.0K Jul 15 17:38 files
drwxrwxrwx 4 grid oinstall 4.0K Jul 15 17:38 etc
drwxrwxrwx 3 grid oinstall 4.0K Jul 15 17:38 custom
As a workaround run the opatch from folder : /data01/PSU_PATCH/23274134/23054319/custom/server/23054319
[oracle@node1 ~]$ opatch apply -oh /data01/app/oracle/product/11.2.0.4/db_1 -local /data01/PSU_PATCH/23274134/23054319/custom/server/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_06-26-54AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 23054319
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/oracle/product/11.2.0.4/db_1')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '23054319' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patch 23054319 successfully applied.
Log file location: /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_06-26-54AM_1.log
OPatch succeeded.
** Start Oracle home and relocate service to node1 :
[oracle@node1 ~]$ srvctl start home -o /data01/app/oracle/product/11.2.0.4/db_1 -s /tmp/db_1_stop -n node1
[oracle@node1 ~]$ srvctl start instance -d orcl -i orcl1
[oracle@node1 ~]$ srvctl relocate service -s node1_app -d orcl -i orcl2 -t orcl1
[oracle@node1 ~]$ srvctl status database -d orcl -v
Instance orcl1 is running on node node1 with online services node1_app. Instance status: Open.
Instance orcl2 is running on node node2 with online services node2_app. Instance status: Open.
[oracle@node1 ~]$ srvctl relocate service -s node2_app -d orcl -i orcl2 -t orcl1
[oracle@node1 ~]$ srvctl status database -d orcl -v
Instance orcl1 is running on node node1 with online services node1_app,node2_app. Instance status: Open.
Instance orcl2 is running on node node2. Instance status: Open.
Remove /tmp file /tmp/db_1_stop
[oracle@node2 ~]$ srvctl status database -d orcl -v
Instance orcl1 is running on node node1 with online services node1_app,node2_app. Instance status: Open.
Instance orcl2 is not running on node node2
[oracle@node2 ~]$ srvctl stop home -o /data01/app/oracle/product/11.2.0.4/db_1 -s /tmp/db_1_stop -n node2
Unlock Grid home using root :
[root@node2 ~]# /data01/app/11.2.0/grid_11204/crs/install/rootcrs.pl -unlock
Using configuration parameter file: /data01/app/11.2.0/grid_11204/crs/install/crsconfig_params
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'node2'
CRS-2673: Attempting to stop 'ora.crsd' on 'node2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'node2'
CRS-2673: Attempting to stop 'ora.oc4j' on 'node2'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'node2'
CRS-2673: Attempting to stop 'ora.cvu' on 'node2'
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'node2'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'node2'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'node2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'node2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'node2'
CRS-2677: Stop of 'ora.cvu' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.cvu' on 'node1'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'node2'
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'node2'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.node2.vip' on 'node2'
CRS-2677: Stop of 'ora.scan2.vip' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.scan2.vip' on 'node1'
CRS-2676: Start of 'ora.cvu' on 'node1' succeeded
CRS-2677: Stop of 'ora.scan3.vip' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.scan3.vip' on 'node1'
CRS-2677: Stop of 'ora.registry.acfs' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.ASMVOL.dg' on 'node2'
CRS-2677: Stop of 'ora.node2.vip' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.node2.vip' on 'node1'
CRS-2676: Start of 'ora.scan3.vip' on 'node1' succeeded
CRS-2676: Start of 'ora.scan2.vip' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN3.lsnr' on 'node1'
CRS-2676: Start of 'ora.node2.vip' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'node1'
CRS-2676: Start of 'ora.LISTENER_SCAN3.lsnr' on 'node1' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'node1' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'node2' succeeded
CRS-2677: Stop of 'ora.ASMVOL.dg' on 'node2' succeeded
CRS-2677: Stop of 'ora.OCR.dg' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'node2'
CRS-2677: Stop of 'ora.asm' on 'node2' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.oc4j' on 'node1'
CRS-2676: Start of 'ora.oc4j' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'node2'
CRS-2677: Stop of 'ora.ons' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'node2'
CRS-2677: Stop of 'ora.net1.network' on 'node2' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'node2' has completed
CRS-2677: Stop of 'ora.crsd' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'node2'
CRS-2673: Attempting to stop 'ora.crf' on 'node2'
CRS-2673: Attempting to stop 'ora.ctssd' on 'node2'
CRS-2673: Attempting to stop 'ora.evmd' on 'node2'
CRS-2673: Attempting to stop 'ora.asm' on 'node2'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'node2'
CRS-2677: Stop of 'ora.crf' on 'node2' succeeded
CRS-2677: Stop of 'ora.evmd' on 'node2' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'node2' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'node2' succeeded
CRS-2677: Stop of 'ora.drivers.acfs' on 'node2' succeeded
CRS-2677: Stop of 'ora.asm' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'node2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'node2'
CRS-2677: Stop of 'ora.cssd' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'node2'
CRS-2677: Stop of 'ora.gipcd' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'node2'
CRS-2677: Stop of 'ora.gpnpd' on 'node2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'node2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
Successfully unlock /data01/app/11.2.0/grid_11204
Switch to grid user and Patch GI Home:
[grid@node1 PSU_PATCH]$ which opatch
/data01/app/11.2.0/grid_11204/OPatch/opatch
[grid@node1 PSU_PATCH]$ whoami
grid
[grid@node1 PSU_PATCH]$
[grid@node2 ~]$ /data01/app/11.2.0/grid_11204/OPatch/opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/22502505
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-05-20AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 22502505
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '22502505' to OH '/data01/app/11.2.0/grid_11204'
Patching component oracle.usm, 11.2.0.4.0...
Patch 22502505 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-05-20AM_1.log
OPatch succeeded
[grid@node2 ~]$ opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/23054359
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-14-41AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 17478514 18031668 18522509 19121551 19769489 20299013 20760982 21352635 21948347 22502456 23054359
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying sub-patch '17478514' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sdo, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.sdo.locator, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18031668' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.ldap.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.crs, 11.2.0.4.0...
Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18522509' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '19121551' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.ordim.client, 11.2.0.4.0...
Patching component oracle.ordim.jai, 11.2.0.4.0...
Applying sub-patch '19769489' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ] , [ oracle.sysman.agent, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.util, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20299013' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] , [ oracle.rdbms.oci, 11.2.0.4.0 ] , [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.sysman.common, 10.2.0.4.5...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sysman.common.core, 10.2.0.4.5...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20760982' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '21352635' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Applying sub-patch '21948347' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] , [ oracle.sysman.oms.core, 10.2.0.4.5 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '22502456' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.rdbms.olap, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.oraolap.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Composite patch 23054359 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-14-41AM_1.log
OPatch succeeded.
[grid@node2 ~]$ opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-30-57AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 23054319
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '23054319' to OH '/data01/app/11.2.0/grid_11204'
Patching component oracle.crs, 11.2.0.4.0...
Patch 23054319 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-30-57AM_1.log
OPatch succeeded.
** Start CRS Services As Root
----------------------------------
# whoami
root
[root@node2 ~]# /data01/app/11.2.0/grid_11204/crs/install/rootcrs.pl -patch
Using configuration parameter file: /data01/app/11.2.0/grid_11204/crs/install/crsconfig_params
Installing Trace File Analyzer
CRS-4123: Oracle High Availability Services has been started.
** Switch to Oracle. Patch Oracle Home:
--------------------------------------
[oracle@node1 23054319]$ which opatch
/data01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch
[oracle@node2 ~]$ opatch apply -oh /data01/app/oracle/product/11.2.0.4/db_1 -local /data01/PSU_PATCH/23274134/23054359
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_07-51-43AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 17478514 18031668 18522509 19121551 19769489 20299013 20760982 21352635 21948347 22502456 23054359
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/oracle/product/11.2.0.4/db_1')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying sub-patch '17478514' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sdo, 11.2.0.4.0...
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.sdo.locator, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18031668' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.ldap.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.crs, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18522509' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '19121551' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.ordim.client, 11.2.0.4.0...
Patching component oracle.ordim.jai, 11.2.0.4.0...
Applying sub-patch '19769489' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.sysman.agent, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.ovm, 11.2.0.4.0...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms.util, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.oraolap, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20299013' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.dv, 11.2.0.4.0...
Patching component oracle.rdbms.oci, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.sysman.common, 10.2.0.4.5...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component orace.sysman.common.core, 10.2.0.4.5...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20760982' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '21352635' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Applying sub-patch '21948347' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.tfa, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.ovm, 11.2.0.4.0...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching componet oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching componnt oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sysman.oms.core, 10.2.0.4.5...
Applying sub-patch '22502456' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.tfa, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.oraolap.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.olap, 11.2.0.4.0...
Patching component oracle.oraolap, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.dv, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Composite patch 23054359 successfully applied.
Log file location: /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_07-51-43AM_1.log
OPatch succeeded.
[oracle@node2 ~]$ opatch apply -oh /data01/app/oracle/product/11.2.0.4/db_1 -local /data01/PSU_PATCH/23274134/23054319/custom/server/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_08-28-25AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 23054319
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/oracle/product/11.2.0.4/db_1')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '23054319' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patch 23054319 successfully applied.
Log file location: /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_08-28-25AM_1.log
OPatch succeeded.
** Start Oracle home and relocate service node2_app back to node2 :
[oracle@node2 ~]$ srvctl start home -o /data01/app/oracle/product/11.2.0.4/db_1 -s /tmp/db_1_stop -n node2
[oracle@node2 ~]$ srvctl start instance -d orcl -i orcl2
[oracle@node2 ~]$ srvctl relocate service -s node2_app -d orcl -i orcl1 -t orcl2
[oracle@node2 ~]$ srvctl status service -d orcl
Service node1_app is running on instance(s) orcl1
Service node2_app is running on instance(s) orcl2
[oracle@node2 ~]$ srvctl status database -d orcl -v
Instance orcl1 is running on node node1 with online services node1_app. Instance status: Open.
Instance orcl2 is running on node node2 with online services node2_app. Instance status: Open.
Remove /tmp file /tmp/db_1_stop
Relocate Scan listeners to proper node as per the configuration before the patching activity :
srvctl relocate scan_listener -i 1 -n node2
srvctl relocate scan_listener -i 2 -n node1
srvctl relocate scan_listener -i 3 -n node1
[oracle@node2 ~]$ srvctl status scan_listener
SCAN Listener LISTENER_SCAN1 is enabled
SCAN listener LISTENER_SCAN1 is running on node node2
SCAN Listener LISTENER_SCAN2 is enabled
SCAN listener LISTENER_SCAN2 is running on node node1
SCAN Listener LISTENER_SCAN3 is enabled
SCAN listener LISTENER_SCAN3 is running on node node1
Remount ACFS file systems :
[root@node1 ~]# /sbin/acfsutil registry
Mount Object:
Device: /dev/asm/asmvol-260
Mount Point: /data01/app/grid/acfsmounts/asmvol_asmvol
Disk Group: ASMVOL
Volume: ASMVOL
Options: none
Nodes: all
[root@node1 ~]# /bin/mount /data01/app/grid/acfsmounts/asmvol_asmvol
[root@node1 ~]# /sbin/acfsutil info fs
/data01/app/grid/acfsmounts/asmvol_asmvol
ACFS Version: 11.2.0.4.0
flags: MountPoint,Available
mount time: Sat Oct 1 05:45:56 2016
volumes: 1
total size: 5167382528
total free: 5009920000
primary volume: /dev/asm/asmvol-260
label:
flags: Primary,Available,ADVM
on-disk version: 39.0
allocation unit: 4096
major, minor: 251, 133121
size: 5167382528
free: 5009920000
ADVM diskgroup ASMVOL
ADVM resize increment: 33554432
ADVM redundancy: unprotected
ADVM stripe columns: 4
ADVM stripe width: 131072
number of snapshots: 0
snapshot space usage: 0
replication status: DISABLED
Verify the mount status on node2 also :
[root@node2 ~]# /sbin/acfsutil info fs
/data01/app/grid/acfsmounts/asmvol_asmvol
ACFS Version: 11.2.0.4.0
flags: MountPoint,Available
mount time: Sat Oct 1 07:44:35 2016
volumes: 1
total size: 5167382528
total free: 5009920000
primary volume: /dev/asm/asmvol-260
label:
flags: Primary,Available,ADVM
on-disk version: 39.0
allocation unit: 4096
major, minor: 251, 133121
size: 5167382528
free: 5009920000
ADVM diskgroup ASMVOL
ADVM resize increment: 33554432
ADVM redundancy: unprotected
ADVM stripe columns: 4
ADVM stripe width: 131072
number of snapshots: 0
snapshot space usage: 0
replication status: DISABLED
Patch Post-Installation Instructions
For each database instance running on the Oracle home being patched, connect to the database using SQL*Plus. Connect as SYSDBA and run the catbundle.sql script as follows:
cd $ORACLE_HOME/rdbms/admin
sqlplus /nolog
SQL> CONNECT / AS SYSDBA
SQL> STARTUP
SQL> @catbundle.sql psu apply
SQL> QUIT
SQL> select action , version , id , comments from dba_registry_history ;
ACTION VERSION ID COMMENTS
------------------------------ ---------- ---------- --------------------
APPLY 11.2.0.4 0 Patchset 11.2.0.2.0
APPLY 11.2.0.4 0 Patchset 11.2.0.2.0
APPLY 11.2.0.4 160719 PSU 11.2.0.4.160719
SQL> select count(*) from dba_objects where status='INVALID' ;
COUNT(*)
----------
0
--------> upgrade rman catalog for each databas
rman target username/***** CATALOG rman_user/******@ORCL
RMAN> upgrade catalog;
Configuration and PSU Mapping
Configuration : GI Home in conjunction with RAC
GI Version : 11.2.0.4
Database Versions : 11.2.0.4
PSU Patch (to Apply) : GI PSU including rdbms patch
Comments : GI Home and all the Database Homes will be patched
Patch Numbers Getting Installed as Part of this GI PSU Patch
23054359 ---> DB PSU 11.2.0.4.160719 (INCLUDES CPUJUL2016) ---> Both DB and Grid Home
23054319 ---> OCW PSU 11.2.0.4.160719 ---> Both DB Homes and Grid Home
22502505 ----> ACFS PSU 11.2.0.4.160419 ---> Only Grid Home
Download and Unzip the Patch
[grid@node1 PSU_PATCH]# pwd
/data01/PSU_PATCH
[grid@node1 PSU_PATCH]# ls -lrth
total 116K
drwxrwxr-x 5 grid oinstall 4.0K Jul 15 17:50 23274134
-rwxrwxr-x 1 grid oinstall 109K Jul 19 12:50 PatchSearch.xml
[grid@node1 23274134]$ pwd
/data01/PSU_PATCH/23274134
[grid@node1 23274134]$ ls -lrt
total 156
drwxrwxrwx 5 grid oinstall 4096 Feb 17 2016 22502505
drwxrwxrwx 13 grid oinstall 4096 Jun 15 12:10 23054359
drwxrwxrwx 5 grid oinstall 4096 Jul 15 17:38 23054319
-rwxrwxrwx 1 grid oinstall 72207 Jun 28 10:30 PatchSearch.xml
-rwxrwxrwx 1 grid oinstall 549 Jul 15 17:49 bundle.xml
-rwxrwxrwx 1 grid oinstall 64093 Jul 19 10:17 README.html
-rwxrwxrwx 1 grid oinstall 24 Jul 19 10:17 README.txt
Patch Installation Prerequisites
OPatch Utility version should be 11.2.0.3.6 or later to apply this patch . Check on both node1 and node2 under both $GRID_HOME and $ORACLE_HOME:
[grid@node1 OPatch]$ ./opatch version
OPatch Version: 11.2.0.3.15
OPatch succeeded.
[oracle@node1 OPatch]$ ./opatch version
OPatch Version: 11.2.0.3.15
OPatch succeeded.
Validation of Oracle Inventory
Before beginning patch application, check the consistency of inventory information for GI home and each database home to be patched. Run the following command as respective Oracle home owner to check the consistency.
[grid@node1 23274134]$ /data01/app/11.2.0/grid_11204/OPatch/opatch lsinventory -oh /data01/app/11.2.0/grid_11204
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_03-33-01AM_1.log
Lsinventory Output file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/lsinv/lsinventory2016-10-01_03-33-01AM.txt
--------------------------------------------------------------------------------
Local Machine Information::
Hostname: node1.localdomain
ARU platform id: 226
ARU platform description:: Linux x86-64
Installed Top-level Products (1):
Oracle Grid Infrastructure 11g 11.2.0.4.0
There are 1 products installed in this Oracle Home.
There are no Interim patches installed in this Oracle Home.
Rac system comprising of multiple nodes
Local node = node1
Remote node = node2
--------------------------------------------------------------------------------
OPatch succeeded.
[oracle@node1 ~]$ /data01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch lsinventory -oh /data01/app/oracle/product/11.2.0.4/db_1
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_03-34-34AM_1.log
Lsinventory Output file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/lsinv/lsinventory2016-10-01_03-34-34AM.txt
--------------------------------------------------------------------------------
Local Machine Information::
Hostname: node1.localdomain
ARU platform id: 226
ARU platform description:: Linux x86-64
Installed Top-level Products (1):
Oracle Database 11g 11.2.0.4.0
There are 1 products installed in this Oracle Home.
There are no Interim patches installed in this Oracle Home.
Rac system comprising of multiple nodes
Local node = node1
Remote node = node2
--------------------------------------------------------------------------------
OPatch succeeded.
Stop EM Agent Processes Prior to Patching and Prior to Rolling Back the Patch
$ORACLE_HOME/bin/emctl stop dbconsole
One-off Patch Conflict Detection and Resolution
[grid@node1 23054359]$ cd /data01/PSU_PATCH/23274134/22502505
[grid@node1 22502505]$ /data01/app/11.2.0/grid_11204/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_03-47-49AM_1.log
Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.
OPatch succeeded.
[grid@node1 23054359]$ cd /data01/PSU_PATCH/23274134/23054359
[grid@node1 23054359]$ /data01/app/11.2.0/grid_11204/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_03-49-25AM_1.log
Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.
OPatch succeeded.
[grid@node1 23054319]$ cd /data01/PSU_PATCH/23274134/23054319
[grid@node1 23054319]$ /data01/app/11.2.0/grid_11204/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_03-50-07AM_1.log
Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.
OPatch succeeded.
[oracle@node1 23054359]$ cd /data01/PSU_PATCH/23274134/23054359
[oracle@node1 23054359]$ /data01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_03-52-32AM_1.log
Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.
OPatch succeeded.
[oracle@node1 23054319]$ cd /data01/PSU_PATCH/23274134/23054319
[oracle@node1 23054319]$ /data01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_03-54-14AM_1.log
Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.
OPatch succeeded.
Verify Server, Cluster info
[grid@node1 OPatch]$ cemutlo -n
node-cluster
[grid@node1 OPatch]$ ps -ef | grep ora_pmon | grep -v grep | awk -F_ '{ print $3 }' | sort -u
orcl1
[grid@node1 OPatch]$ srvctl status scan_listener
SCAN Listener LISTENER_SCAN1 is enabled
SCAN listener LISTENER_SCAN1 is running on node node2
SCAN Listener LISTENER_SCAN2 is enabled
SCAN listener LISTENER_SCAN2 is running on node node1
SCAN Listener LISTENER_SCAN3 is enabled
SCAN listener LISTENER_SCAN3 is running on node node1
ACFS considerations
Oracle Grid Infra 11.2.0.4.x Patch Set Update SUPPLEMENTAL README (Doc ID 1641136.1)
1494652.1 How to Mount or Unmount ACFS File System While Applying GI Patches?
When patching the GI Home, a shared location on ACFS only needs to be unmounted on the node where the GI Home is being patched.
[grid@node1 grid_11204]$ df -kh
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_node1-lv_root
28G 19G 7.5G 72% /
tmpfs 1004M 394M 610M 40% /dev/shm
/dev/sda1 485M 55M 405M 12% /boot
Softwares 84G 14G 71G 17% /media/sf_Softwares
/dev/sr0 57M 57M 0 100% /media/VBOXADDITIONS_5.1.6_110634
/dev/asm/asmvol-260 4.9G 151M 4.7G 4% /data01/app/grid/acfsmounts/asmvol_asmvol
SQL> SELECT dg.name AS diskgroup, v.volume_name, v.volume_device, v.mountpath,v.state FROM V$ASM_DISKGROUP dg, V$ASM_VOLUME v WHERE dg.group_number = v.group_number;
DISKGROUP VOLUME_NAME VOLUME_DEVICE MOUNTPATH STATE
--------------- -------------------- -----------------------------------------------------------------------
ASMVOL ASMVOL /dev/asm/asmvol-260 /data01/app/grid/acfsmounts/asmvol_asmvol ENABLED
For each node, perform the following steps:
[root@node1 ~]# /sbin/acfsutil registry
Mount Object:
Device: /dev/asm/asmvol-260
Mount Point: /data01/app/grid/acfsmounts/asmvol_asmvol
Disk Group: ASMVOL
Volume: ASMVOL
Options: none
Nodes: all
[grid@node2 ~]$ /sbin/acfsutil info fs
/data01/app/grid/acfsmounts/asmvol_asmvol
ACFS Version: 11.2.0.4.0
flags: MountPoint,Available
mount time: Sat Oct 1 01:05:54 2016
volumes: 1
total size: 5167382528
total free: 5009920000
primary volume: /dev/asm/asmvol-260
label:
flags: Primary,Available,ADVM
on-disk version: 39.0
allocation unit: 4096
major, minor: 251, 133121
size: 5167382528
free: 5009920000
ADVM diskgroup ASMVOL
ADVM resize increment: 33554432
ADVM redundancy: unprotected
ADVM stripe columns: 4
ADVM stripe width: 131072
number of snapshots: 0
snapshot space usage: 0
replication status: DISABLED
[root@node1 ~]# /bin/umount /data01/app/grid/acfsmounts/asmvol_asmvol
[root@node1 ~]# /sbin/acfsutil info fs
acfsutil info fs: ACFS-03036: no mounted ACFS file systems -------> Mount point successfully un-mounted
Perform same step on node2 for acfs :
[root@node2 ~]# /bin/umount /data01/app/grid/acfsmounts/asmvol_asmvol
[root@node2 ~]# /sbin/acfsutil info fs
acfsutil info fs: ACFS-03036: no mounted ACFS file systems
[root@node2 ~]#
** Roll services from Node1 to Node2 and stop oracle on node1 :
[oracle@node1 ~]$ srvctl status service -d orcl
Service node1_app is running on instance(s) orcl1
Service node2_app is running on instance(s) orcl2
[oracle@node1 ~]$ srvctl relocate service -s node1_app -d orcl -i orcl1 -t orcl2
[oracle@node1 ~]$ srvctl status service -d orcl
Service node1_app is running on instance(s) orcl2
Service node2_app is running on instance(s) orcl2
As Oracle you'll need to stop the services running out of the database home. Shutdown all instances :
[oracle@node1 ~]$ srvctl stop instance -d orcl -i orcl1 -o immediate
[oracle@node1 ~]$ srvctl status database -d orcl -v
Instance orcl1 is not running on node node1
Instance orcl2 is running on node node2 with online services node1_app,node2_app. Instance status: Open.
[oracle@node1 ~]$ srvctl stop home -o /data01/app/oracle/product/11.2.0.4/db_1 -s /tmp/db_1_stop -n node1
Unlock Grid home using root :
[root@node1 ~]# ps -ef | grep d.bin
root 2644 1 0 00:58 ? 00:00:44 /data01/app/11.2.0/grid_11204/bin/ohasd.bin reboot
grid 2968 1 0 00:58 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/mdnsd.bin
grid 2979 1 0 00:58 ? 00:00:04 /data01/app/11.2.0/grid_11204/bin/gpnpd.bin
grid 2989 1 0 00:58 ? 00:00:38 /data01/app/11.2.0/grid_11204/bin/gipcd.bin
root 3003 1 1 00:58 ? 00:02:30 /data01/app/11.2.0/grid_11204/bin/osysmond.bin
grid 3047 1 0 00:58 ? 00:00:45 /data01/app/11.2.0/grid_11204/bin/ocssd.bin
root 4051 1 0 01:02 ? 00:00:23 /data01/app/11.2.0/grid_11204/bin/octssd.bin reboot
grid 4074 1 0 01:02 ? 00:00:22 /data01/app/11.2.0/grid_11204/bin/evmd.bin
root 4500 1 0 01:03 ? 00:01:18 /data01/app/11.2.0/grid_11204/bin/crsd.bin reboot
root 15459 15355 0 04:48 pts/0 00:00:00 grep d.bin
[root@node1 ~]# ps -ef | grep pmon
grid 4329 1 0 01:03 ? 00:00:02 asm_pmon_+ASM1
[root@node1 ~]# /data01/app/11.2.0/grid_11204/crs/install/rootcrs.pl -unlock
Using configuration parameter file: /data01/app/11.2.0/grid_11204/crs/install/crsconfig_params
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'node1'
CRS-2673: Attempting to stop 'ora.crsd' on 'node1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'node1'
CRS-2673: Attempting to stop 'ora.cvu' on 'node1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'node1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'node1'
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'node1'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'node1'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'node1'
CRS-2673: Attempting to stop 'ora.oc4j' on 'node1'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'node1'
CRS-2677: Stop of 'ora.cvu' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.cvu' on 'node2'
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'node1'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'node1'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.node1.vip' on 'node1'
CRS-2677: Stop of 'ora.node1.vip' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.node1.vip' on 'node2'
CRS-2677: Stop of 'ora.scan3.vip' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.scan3.vip' on 'node2'
CRS-2677: Stop of 'ora.registry.acfs' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.ASMVOL.dg' on 'node1'
CRS-2677: Stop of 'ora.scan2.vip' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.scan2.vip' on 'node2'
CRS-2676: Start of 'ora.cvu' on 'node2' succeeded
CRS-2676: Start of 'ora.node1.vip' on 'node2' succeeded
CRS-2676: Start of 'ora.scan2.vip' on 'node2' succeeded
CRS-2676: Start of 'ora.scan3.vip' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'node2'
CRS-2672: Attempting to start 'ora.LISTENER_SCAN3.lsnr' on 'node2'
CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'node2' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN3.lsnr' on 'node2' succeeded
CRS-2677: Stop of 'ora.OCR.dg' on 'node1' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'node1' succeeded
CRS-2677: Stop of 'ora.ASMVOL.dg' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'node1'
CRS-2677: Stop of 'ora.asm' on 'node1' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.oc4j' on 'node2'
CRS-2676: Start of 'ora.oc4j' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'node1'
CRS-2677: Stop of 'ora.ons' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'node1'
CRS-2677: Stop of 'ora.net1.network' on 'node1' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'node1' has completed
CRS-2677: Stop of 'ora.crsd' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'node1'
CRS-2673: Attempting to stop 'ora.evmd' on 'node1'
CRS-2673: Attempting to stop 'ora.asm' on 'node1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'node1'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'node1'
CRS-2677: Stop of 'ora.evmd' on 'node1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'node1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'node1' succeeded
CRS-2677: Stop of 'ora.drivers.acfs' on 'node1' succeeded
CRS-2677: Stop of 'ora.asm' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'node1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'node1'
CRS-2677: Stop of 'ora.cssd' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'node1'
CRS-2677: Stop of 'ora.crf' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'node1'
CRS-2677: Stop of 'ora.gipcd' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'node1'
CRS-2677: Stop of 'ora.gpnpd' on 'node1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'node1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
Successfully unlock /data01/app/11.2.0/grid_11204
[root@node1 ~]# ps -ef | grep d.bin
root 16401 15355 0 04:53 pts/0 00:00:00 grep d.bin
[root@node1 ~]# ps -ef | grep pmon
root 16419 15355 0 04:53 pts/0 00:00:00 grep pmon
Switch to grid user and Patch GI Home:
[grid@node1 PSU_PATCH]$ which opatch
/data01/app/11.2.0/grid_11204/OPatch/opatch
[grid@node1 PSU_PATCH]$ whoami
grid
[grid@node1 PSU_PATCH]$
[grid@node1 23274134]$ /data01/app/11.2.0/grid_11204/OPatch/opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/22502505
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_04-59-00AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 22502505
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '22502505' to OH '/data01/app/11.2.0/grid_11204'
Patching component oracle.usm, 11.2.0.4.0...
Patch 22502505 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_04-59-00AM_1.log
OPatch succeeded.
[grid@node1 23274134]$ opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/23054359
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_05-10-40AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 17478514 18031668 18522509 19121551 19769489 20299013 20760982 21352635 21948347 22502456 23054359
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying sub-patch '17478514' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sdo, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.sdo.locator, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18031668' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.ldap.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.crs, 11.2.0.4.0...
Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18522509' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '19121551' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.ordim.client, 11.2.0.4.0...
Patching component oracle.ordim.jai, 11.2.0.4.0...
Applying sub-patch '19769489' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ] , [ oracle.sysman.agent, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.util, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20299013' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] , [ oracle.rdbms.oci, 11.2.0.4.0 ] , [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.sysman.common, 10.2.0.4.5...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sysman.common.core, 10.2.0.4.5...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20760982' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '21352635' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Applying sub-patch '21948347' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] , [ oracle.sysman.oms.core, 10.2.0.4.5 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '22502456' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.rdbms.olap, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.oraolap.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Composite patch 23054359 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_05-10-40AM_1.log
OPatch succeeded.
[grid@node1 23274134]$ opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_05-23-42AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 23054319
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '23054319' to OH '/data01/app/11.2.0/grid_11204'
Patching component oracle.crs, 11.2.0.4.0...
Patch 23054319 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_05-23-42AM_1.log
OPatch succeeded.
Start CRS Services As Root
# whoami
root
[root@node1 ~]# /data01/app/11.2.0/grid_11204/crs/install/rootcrs.pl -patch
Using configuration parameter file: /data01/app/11.2.0/grid_11204/crs/install/crsconfig_params
Installing Trace File Analyzer
CRS-4123: Oracle High Availability Services has been started.
[root@node1 ~]# ps -ef | grep d.bin
root 25999 1 1 05:43 ? 00:00:01 /data01/app/11.2.0/grid_11204/bin/ohasd.bin reboot
grid 26156 1 0 05:44 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/mdnsd.bin
grid 26170 1 0 05:44 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/gpnpd.bin
grid 26180 1 0 05:44 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/gipcd.bin
root 26183 1 1 05:44 ? 00:00:01 /data01/app/11.2.0/grid_11204/bin/osysmond.bin
grid 26267 1 0 05:44 ? 00:00:01 /data01/app/11.2.0/grid_11204/bin/ocssd.bin
root 26419 1 0 05:44 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/octssd.bin reboot
grid 26447 1 0 05:44 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/evmd.bin
root 26702 1 1 05:45 ? 00:00:00 /data01/app/11.2.0/grid_11204/bin/crsd.bin reboot
root 27313 23786 0 05:46 pts/0 00:00:00 grep d.bin
[root@node1 ~]# ps -ef | grep pmon
grid 26582 1 0 05:44 ? 00:00:00 asm_pmon_+ASM1
root 27316 23786 0 05:46 pts/0 00:00:00 grep pmon
Switch to Oracle. Patch Oracle Home:
[oracle@node1 23054319]$ which opatch
/data01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch
[oracle@node1 23054319]$ opatch apply -oh /data01/app/oracle/product/11.2.0.4/db_1 -local /data01/PSU_PATCH/23274134/23054359
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_05-49-44AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 17478514 18031668 18522509 19121551 19769489 20299013 20760982 21352635 21948347 22502456 23054359
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/oracle/product/11.2.0.4/db_1')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying sub-patch '17478514' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sdo, 11.2.0.4.0...
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.sdo.locator, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18031668' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.ldap.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.crs, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18522509' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '19121551' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.ordim.client, 11.2.0.4.0...
Patching component oracle.ordim.jai, 11.2.0.4.0...
Applying sub-patch '19769489' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.sysman.agent, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.ovm, 11.2.0.4.0...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms.util, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.oraolap, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20299013' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.dv, 11.2.0.4.0...
Patching component oracle.rdbms.oci, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.sysman.common, 10.2.0.4.5...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sysman.common.core, 10.2.0.4.5...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20760982' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '21352635' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Applying sub-patch '21948347' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.tfa, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.ovm, 11.2.0.4.0...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sysman.oms.core, 10.2.0.4.5...
Applying sub-patch '22502456' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.tfa, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.oraolap.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.olap, 11.2.0.4.0...
Patching component oracle.oraolap, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.dv, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.dv, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Composite patch 23054359 successfully applied.
Log file location: /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_05-49-44AM_1.log
OPatch succeeded.
[oracle@node1 23054319]$ opatch apply -oh /data01/app/oracle/product/11.2.0.4/db_1 -local /data01/PSU_PATCH/23274134/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_06-17-49AM_1.log
Verifying environment and performing prerequisite checks...
UtilSession failed: Patch 23054319 requires component(s) that are not installed in OracleHome. These not-installed components are oracle.crs:11.2.0.4.0,
Log file location: /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_06-17-49AM_1.log
OPatch failed with error code 73
Solution : Above issue is a known bug . Reason is duplicate custom/server folder under the patch directory as shown below .
[oracle@node1 23054319]$ pwd
/data01/PSU_PATCH/23274134/23054319/custom/server/23054319
[oracle@node1 23054319]$ ls -lrth
total 32K
-rwxrwxrwx 1 grid oinstall 17K Jul 15 17:38 README.txt
drwxrwxrwx 11 grid oinstall 4.0K Jul 15 17:38 files
drwxrwxrwx 4 grid oinstall 4.0K Jul 15 17:38 etc
drwxrwxrwx 3 grid oinstall 4.0K Jul 15 17:38 custom
As a workaround run the opatch from folder : /data01/PSU_PATCH/23274134/23054319/custom/server/23054319
[oracle@node1 ~]$ opatch apply -oh /data01/app/oracle/product/11.2.0.4/db_1 -local /data01/PSU_PATCH/23274134/23054319/custom/server/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_06-26-54AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 23054319
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/oracle/product/11.2.0.4/db_1')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '23054319' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patch 23054319 successfully applied.
Log file location: /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_06-26-54AM_1.log
OPatch succeeded.
** Start Oracle home and relocate service to node1 :
[oracle@node1 ~]$ srvctl start home -o /data01/app/oracle/product/11.2.0.4/db_1 -s /tmp/db_1_stop -n node1
[oracle@node1 ~]$ srvctl start instance -d orcl -i orcl1
[oracle@node1 ~]$ srvctl relocate service -s node1_app -d orcl -i orcl2 -t orcl1
[oracle@node1 ~]$ srvctl status database -d orcl -v
Instance orcl1 is running on node node1 with online services node1_app. Instance status: Open.
Instance orcl2 is running on node node2 with online services node2_app. Instance status: Open.
[oracle@node1 ~]$ srvctl relocate service -s node2_app -d orcl -i orcl2 -t orcl1
[oracle@node1 ~]$ srvctl status database -d orcl -v
Instance orcl1 is running on node node1 with online services node1_app,node2_app. Instance status: Open.
Instance orcl2 is running on node node2. Instance status: Open.
Remove /tmp file /tmp/db_1_stop
==== Start Steps for node2 ========
[oracle@node1 ~]$ srvctl stop instance -d orcl -i orcl2 -o immediate[oracle@node2 ~]$ srvctl status database -d orcl -v
Instance orcl1 is running on node node1 with online services node1_app,node2_app. Instance status: Open.
Instance orcl2 is not running on node node2
[oracle@node2 ~]$ srvctl stop home -o /data01/app/oracle/product/11.2.0.4/db_1 -s /tmp/db_1_stop -n node2
Unlock Grid home using root :
[root@node2 ~]# /data01/app/11.2.0/grid_11204/crs/install/rootcrs.pl -unlock
Using configuration parameter file: /data01/app/11.2.0/grid_11204/crs/install/crsconfig_params
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'node2'
CRS-2673: Attempting to stop 'ora.crsd' on 'node2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'node2'
CRS-2673: Attempting to stop 'ora.oc4j' on 'node2'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'node2'
CRS-2673: Attempting to stop 'ora.cvu' on 'node2'
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'node2'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'node2'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'node2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'node2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'node2'
CRS-2677: Stop of 'ora.cvu' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.cvu' on 'node1'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'node2'
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'node2'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.node2.vip' on 'node2'
CRS-2677: Stop of 'ora.scan2.vip' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.scan2.vip' on 'node1'
CRS-2676: Start of 'ora.cvu' on 'node1' succeeded
CRS-2677: Stop of 'ora.scan3.vip' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.scan3.vip' on 'node1'
CRS-2677: Stop of 'ora.registry.acfs' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.ASMVOL.dg' on 'node2'
CRS-2677: Stop of 'ora.node2.vip' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.node2.vip' on 'node1'
CRS-2676: Start of 'ora.scan3.vip' on 'node1' succeeded
CRS-2676: Start of 'ora.scan2.vip' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN3.lsnr' on 'node1'
CRS-2676: Start of 'ora.node2.vip' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'node1'
CRS-2676: Start of 'ora.LISTENER_SCAN3.lsnr' on 'node1' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'node1' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'node2' succeeded
CRS-2677: Stop of 'ora.ASMVOL.dg' on 'node2' succeeded
CRS-2677: Stop of 'ora.OCR.dg' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'node2'
CRS-2677: Stop of 'ora.asm' on 'node2' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'node2' succeeded
CRS-2672: Attempting to start 'ora.oc4j' on 'node1'
CRS-2676: Start of 'ora.oc4j' on 'node1' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'node2'
CRS-2677: Stop of 'ora.ons' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'node2'
CRS-2677: Stop of 'ora.net1.network' on 'node2' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'node2' has completed
CRS-2677: Stop of 'ora.crsd' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'node2'
CRS-2673: Attempting to stop 'ora.crf' on 'node2'
CRS-2673: Attempting to stop 'ora.ctssd' on 'node2'
CRS-2673: Attempting to stop 'ora.evmd' on 'node2'
CRS-2673: Attempting to stop 'ora.asm' on 'node2'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'node2'
CRS-2677: Stop of 'ora.crf' on 'node2' succeeded
CRS-2677: Stop of 'ora.evmd' on 'node2' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'node2' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'node2' succeeded
CRS-2677: Stop of 'ora.drivers.acfs' on 'node2' succeeded
CRS-2677: Stop of 'ora.asm' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'node2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'node2'
CRS-2677: Stop of 'ora.cssd' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'node2'
CRS-2677: Stop of 'ora.gipcd' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'node2'
CRS-2677: Stop of 'ora.gpnpd' on 'node2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'node2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
Successfully unlock /data01/app/11.2.0/grid_11204
Switch to grid user and Patch GI Home:
[grid@node1 PSU_PATCH]$ which opatch
/data01/app/11.2.0/grid_11204/OPatch/opatch
[grid@node1 PSU_PATCH]$ whoami
grid
[grid@node1 PSU_PATCH]$
[grid@node2 ~]$ /data01/app/11.2.0/grid_11204/OPatch/opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/22502505
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-05-20AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 22502505
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '22502505' to OH '/data01/app/11.2.0/grid_11204'
Patching component oracle.usm, 11.2.0.4.0...
Patch 22502505 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-05-20AM_1.log
OPatch succeeded
[grid@node2 ~]$ opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/23054359
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-14-41AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 17478514 18031668 18522509 19121551 19769489 20299013 20760982 21352635 21948347 22502456 23054359
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying sub-patch '17478514' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sdo, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.sdo.locator, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18031668' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.ldap.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.crs, 11.2.0.4.0...
Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18522509' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '19121551' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.ordim.client, 11.2.0.4.0...
Patching component oracle.ordim.jai, 11.2.0.4.0...
Applying sub-patch '19769489' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ] , [ oracle.sysman.agent, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.util, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20299013' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] , [ oracle.rdbms.oci, 11.2.0.4.0 ] , [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.sysman.common, 10.2.0.4.5...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sysman.common.core, 10.2.0.4.5...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20760982' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.console.db, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '21352635' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Applying sub-patch '21948347' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] , [ oracle.sysman.oms.core, 10.2.0.4.5 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '22502456' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.rdbms.olap, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.oraolap.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/data01/app/11.2.0/grid_11204'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Composite patch 23054359 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-14-41AM_1.log
OPatch succeeded.
[grid@node2 ~]$ opatch apply -oh /data01/app/11.2.0/grid_11204 -local /data01/PSU_PATCH/23274134/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/11.2.0/grid_11204
Central Inventory : /data01/app/oraInventory
from : /data01/app/11.2.0/grid_11204/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-30-57AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 23054319
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/11.2.0/grid_11204')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '23054319' to OH '/data01/app/11.2.0/grid_11204'
Patching component oracle.crs, 11.2.0.4.0...
Patch 23054319 successfully applied.
Log file location: /data01/app/11.2.0/grid_11204/cfgtoollogs/opatch/opatch2016-10-01_07-30-57AM_1.log
OPatch succeeded.
** Start CRS Services As Root
----------------------------------
# whoami
root
[root@node2 ~]# /data01/app/11.2.0/grid_11204/crs/install/rootcrs.pl -patch
Using configuration parameter file: /data01/app/11.2.0/grid_11204/crs/install/crsconfig_params
Installing Trace File Analyzer
CRS-4123: Oracle High Availability Services has been started.
** Switch to Oracle. Patch Oracle Home:
--------------------------------------
[oracle@node1 23054319]$ which opatch
/data01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch
[oracle@node2 ~]$ opatch apply -oh /data01/app/oracle/product/11.2.0.4/db_1 -local /data01/PSU_PATCH/23274134/23054359
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_07-51-43AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 17478514 18031668 18522509 19121551 19769489 20299013 20760982 21352635 21948347 22502456 23054359
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/oracle/product/11.2.0.4/db_1')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying sub-patch '17478514' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sdo, 11.2.0.4.0...
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.sdo.locator, 11.2.0.4.0...
Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18031668' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.ldap.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.crs, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18522509' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '19121551' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.ordim.client, 11.2.0.4.0...
Patching component oracle.ordim.jai, 11.2.0.4.0...
Applying sub-patch '19769489' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.sysman.agent, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.ovm, 11.2.0.4.0...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms.util, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.oraolap, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20299013' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.dv, 11.2.0.4.0...
Patching component oracle.rdbms.oci, 11.2.0.4.0...
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.sysman.common, 10.2.0.4.5...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component orace.sysman.common.core, 10.2.0.4.5...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20760982' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '21352635' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Applying sub-patch '21948347' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.tfa, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.sysman.agent, 10.2.0.4.5...
Patching component oracle.ovm, 11.2.0.4.0...
Patching component oracle.xdk, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching componet oracle.nlsrtl.rsf, 11.2.0.4.0...
Patching componnt oracle.xdk.parser.java, 11.2.0.4.0...
Patching component oracle.sysman.console.db, 11.2.0.4.0...
Patching component oracle.xdk.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.sysman.oms.core, 10.2.0.4.5...
Applying sub-patch '22502456' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
ApplySession: Optional component(s) [ oracle.tfa, 11.2.0.4.0 ] not present in the Oracle Home or a higher version is found.
Patching component oracle.precomp.common, 11.2.0.4.0...
Patching component oracle.oraolap.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.olap, 11.2.0.4.0...
Patching component oracle.oraolap, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Patching component oracle.rdbms.rman, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms.dv, 11.2.0.4.0...
Patching component oracle.rdbms, 11.2.0.4.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Composite patch 23054359 successfully applied.
Log file location: /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_07-51-43AM_1.log
OPatch succeeded.
[oracle@node2 ~]$ opatch apply -oh /data01/app/oracle/product/11.2.0.4/db_1 -local /data01/PSU_PATCH/23274134/23054319/custom/server/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2016, Oracle Corporation. All rights reserved.
Oracle Home : /data01/app/oracle/product/11.2.0.4/db_1
Central Inventory : /data01/app/oraInventory
from : /data01/app/oracle/product/11.2.0.4/db_1/oraInst.loc
OPatch version : 11.2.0.3.15
OUI version : 11.2.0.4.0
Log file location : /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_08-28-25AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches: 23054319
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/data01/app/oracle/product/11.2.0.4/db_1')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '23054319' to OH '/data01/app/oracle/product/11.2.0.4/db_1'
Patching component oracle.rdbms, 11.2.0.4.0...
Patch 23054319 successfully applied.
Log file location: /data01/app/oracle/product/11.2.0.4/db_1/cfgtoollogs/opatch/opatch2016-10-01_08-28-25AM_1.log
OPatch succeeded.
** Start Oracle home and relocate service node2_app back to node2 :
[oracle@node2 ~]$ srvctl start home -o /data01/app/oracle/product/11.2.0.4/db_1 -s /tmp/db_1_stop -n node2
[oracle@node2 ~]$ srvctl start instance -d orcl -i orcl2
[oracle@node2 ~]$ srvctl relocate service -s node2_app -d orcl -i orcl1 -t orcl2
[oracle@node2 ~]$ srvctl status service -d orcl
Service node1_app is running on instance(s) orcl1
Service node2_app is running on instance(s) orcl2
[oracle@node2 ~]$ srvctl status database -d orcl -v
Instance orcl1 is running on node node1 with online services node1_app. Instance status: Open.
Instance orcl2 is running on node node2 with online services node2_app. Instance status: Open.
Remove /tmp file /tmp/db_1_stop
Relocate Scan listeners to proper node as per the configuration before the patching activity :
srvctl relocate scan_listener -i 1 -n node2
srvctl relocate scan_listener -i 2 -n node1
srvctl relocate scan_listener -i 3 -n node1
[oracle@node2 ~]$ srvctl status scan_listener
SCAN Listener LISTENER_SCAN1 is enabled
SCAN listener LISTENER_SCAN1 is running on node node2
SCAN Listener LISTENER_SCAN2 is enabled
SCAN listener LISTENER_SCAN2 is running on node node1
SCAN Listener LISTENER_SCAN3 is enabled
SCAN listener LISTENER_SCAN3 is running on node node1
Remount ACFS file systems :
[root@node1 ~]# /sbin/acfsutil registry
Mount Object:
Device: /dev/asm/asmvol-260
Mount Point: /data01/app/grid/acfsmounts/asmvol_asmvol
Disk Group: ASMVOL
Volume: ASMVOL
Options: none
Nodes: all
[root@node1 ~]# /bin/mount /data01/app/grid/acfsmounts/asmvol_asmvol
[root@node1 ~]# /sbin/acfsutil info fs
/data01/app/grid/acfsmounts/asmvol_asmvol
ACFS Version: 11.2.0.4.0
flags: MountPoint,Available
mount time: Sat Oct 1 05:45:56 2016
volumes: 1
total size: 5167382528
total free: 5009920000
primary volume: /dev/asm/asmvol-260
label:
flags: Primary,Available,ADVM
on-disk version: 39.0
allocation unit: 4096
major, minor: 251, 133121
size: 5167382528
free: 5009920000
ADVM diskgroup ASMVOL
ADVM resize increment: 33554432
ADVM redundancy: unprotected
ADVM stripe columns: 4
ADVM stripe width: 131072
number of snapshots: 0
snapshot space usage: 0
replication status: DISABLED
Verify the mount status on node2 also :
[root@node2 ~]# /sbin/acfsutil info fs
/data01/app/grid/acfsmounts/asmvol_asmvol
ACFS Version: 11.2.0.4.0
flags: MountPoint,Available
mount time: Sat Oct 1 07:44:35 2016
volumes: 1
total size: 5167382528
total free: 5009920000
primary volume: /dev/asm/asmvol-260
label:
flags: Primary,Available,ADVM
on-disk version: 39.0
allocation unit: 4096
major, minor: 251, 133121
size: 5167382528
free: 5009920000
ADVM diskgroup ASMVOL
ADVM resize increment: 33554432
ADVM redundancy: unprotected
ADVM stripe columns: 4
ADVM stripe width: 131072
number of snapshots: 0
snapshot space usage: 0
replication status: DISABLED
Patch Post-Installation Instructions
For each database instance running on the Oracle home being patched, connect to the database using SQL*Plus. Connect as SYSDBA and run the catbundle.sql script as follows:
cd $ORACLE_HOME/rdbms/admin
sqlplus /nolog
SQL> CONNECT / AS SYSDBA
SQL> STARTUP
SQL> @catbundle.sql psu apply
SQL> QUIT
SQL> select action , version , id , comments from dba_registry_history ;
ACTION VERSION ID COMMENTS
------------------------------ ---------- ---------- --------------------
APPLY 11.2.0.4 0 Patchset 11.2.0.2.0
APPLY 11.2.0.4 0 Patchset 11.2.0.2.0
APPLY 11.2.0.4 160719 PSU 11.2.0.4.160719
SQL> select count(*) from dba_objects where status='INVALID' ;
COUNT(*)
----------
0
--------> upgrade rman catalog for each databas
rman target username/***** CATALOG rman_user/******@ORCL
RMAN> upgrade catalog;
Jadwal Sabung Ayam Online SV388 11 Februari 2019 - Senin, 11 Februari 2019 – Pada Hari Tersebut Akan Di Laksanakan Berbagai Pertandingan Sabung Ayam Secara Live di Arena Sabung Ayam Thailand.
ReplyDeleteSitus Judi Sabung Ayam Online SV388 Merupakan Situs Judi Asal Thailand Yang Sangat Terkenal Dengan Permainan Sabung Ayam Yang Fair dan Menghibur Para Penonton Judi Sabung Ayam.
Untuk Info Lebih Lanjut Bisa Hub kami Di :
wechat : bolavita
line : cs_bolavita
whatsapp : +628122222995
BBM: BOLAVITA