Oracle20200714GI_PSU补丁流程及问题收集
1、准备工作
1.1停止集群并备份
停止集群
[root@db1 bin]# pwd
/u01/app/11.2.0/grid/bin
[root@db1 bin]# ./crsctl stop cluster -all
[root@db1 bin]# ./crsctl stop has
[root@db2 bin]# ./crsctl stop has
CRS-2673: Attempting to stop 'ora.crsd' on 'db1'
CRS-2673: Attempting to stop 'ora.crsd' on 'db2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'db1'
CRS-2673: Attempting to stop 'ora.oc4j' on 'db1'
CRS-2673: Attempting to stop 'ora.OCR_NEW.dg' on 'db1'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'db1'
CRS-2673: Attempting to stop 'ora.prod.db' on 'db1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'db1'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'db1'
CRS-2673: Attempting to stop 'ora.cvu' on 'db1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'db2'
CRS-2673: Attempting to stop 'ora.db2.vip' on 'db2'
CRS-2673: Attempting to stop 'ora.OCR_NEW.dg' on 'db2'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'db2'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'db2'
CRS-2673: Attempting to stop 'ora.FRA.dg' on 'db2'
CRS-2677: Stop of 'ora.db2.vip' on 'db2' succeeded
CRS-2677: Stop of 'ora.cvu' on 'db1' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'db2' succeeded
CRS-2677: Stop of 'ora.FRA.dg' on 'db2' succeeded
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'db1' succeeded
CRS-2673: Attempting to stop 'ora.db1.vip' on 'db1'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'db1' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'db1'
CRS-2677: Stop of 'ora.registry.acfs' on 'db2' succeeded
CRS-2677: Stop of 'ora.db1.vip' on 'db1' succeeded
CRS-2677: Stop of 'ora.scan1.vip' on 'db1' succeeded
CRS-2677: Stop of 'ora.registry.acfs' on 'db1' succeeded
CRS-2677: Stop of 'ora.OCR_NEW.dg' on 'db2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'db2'
CRS-2677: Stop of 'ora.asm' on 'db2' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'db2'
CRS-2677: Stop of 'ora.ons' on 'db2' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'db2'
CRS-2677: Stop of 'ora.net1.network' on 'db2' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'db2' has completed
CRS-2677: Stop of 'ora.prod.db' on 'db1' succeeded
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'db1'
CRS-2673: Attempting to stop 'ora.FRA.dg' on 'db1'
CRS-2677: Stop of 'ora.crsd' on 'db2' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'db2'
CRS-2673: Attempting to stop 'ora.evmd' on 'db2'
CRS-2673: Attempting to stop 'ora.asm' on 'db2'
CRS-2677: Stop of 'ora.evmd' on 'db2' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'db2' succeeded
CRS-2677: Stop of 'ora.asm' on 'db2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'db2'
CRS-2677: Stop of 'ora.DATA.dg' on 'db1' succeeded
CRS-2677: Stop of 'ora.FRA.dg' on 'db1' succeeded
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'db2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'db2'
CRS-2677: Stop of 'ora.cssd' on 'db2' succeeded
CRS-2677: Stop of 'ora.OCR_NEW.dg' on 'db1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'db1'
CRS-2677: Stop of 'ora.asm' on 'db1' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'db1' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'db1'
CRS-2677: Stop of 'ora.ons' on 'db1' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'db1'
CRS-2677: Stop of 'ora.net1.network' on 'db1' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'db1' has completed
CRS-2677: Stop of 'ora.crsd' on 'db1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'db1'
CRS-2673: Attempting to stop 'ora.evmd' on 'db1'
CRS-2673: Attempting to stop 'ora.asm' on 'db1'
CRS-2677: Stop of 'ora.evmd' on 'db1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'db1' succeeded
CRS-2677: Stop of 'ora.asm' on 'db1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'db1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'db1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'db1'
CRS-2677: Stop of 'ora.cssd' on 'db1' succeeded
备份GI和ORACLE家目录
这里直接使用Oracle Vbox快照功能
1.2查看Opatch要求
根据文档要求如下
查看本机版本
#grid
[grid@db1 OPatch]$ pwd
/u01/app/11.2.0/grid/OPatch
[grid@db1 OPatch]$ ./opatch lsinventory
Oracle 中间补丁程序安装程序版本 11.2.0.3.4
版权所有 (c) 2012, Oracle Corporation。保留所有权利。
#oracle
[oracle@db1 OPatch]$ pwd
/u01/app/oracle/product/11.2.0/db_home_1/OPatch
[oracle@db1 OPatch]$ ./opatch
Oracle 中间补丁程序安装程序版本 11.2.0.3.4
版权所有 (c) 2012, Oracle Corporation。保留所有权利。
双节点四用户均不符合要求，需要替换
1.3替换Opatch
上传文件如下
p6880880_112000_Linux-x86-64.zip Opatch补丁
p31326410_112040_Linux-x86-64.zip GI_PSU
[root@db1 ~]# cp p6880880_112000_Linux-x86-64.zip /u01/app/11.2.0/grid/
[root@db1 ~]# mv /u01/app/11.2.0/grid/OPatch /u01/app/11.2.0/grid/OPatch_pre
[root@db1 grid]# unzip p6880880_112000_Linux-x86-64.zip
[root@db1 grid]# chown -R grid:oinstall /u01/app/11.2.0/grid/OPatch
[root@db1 ~]# su - grid
[grid@db1 ~]$ cd $ORACLE_HOME/OPatch
[grid@db1 OPatch]$ ./opatch
Oracle 临时补丁程序安装程序版本 11.2.0.3.25
#二节点同理
[root@db1 ~]# mv p6880880_112000_Linux-x86-64.zip /u01/app/oracle/product/11.2.0/db_home_1/
[root@db1 ~]# cd /u01/app/oracle/product/11.2.0/db_home_1
[root@db1 db_home_1]# mv OPatch OPatch_pre
[root@db1 db_home_1]# unzip p6880880_112000_Linux-x86-64.zip
[root@db1 db_home_1]# chown -R oracle:oinstall OPatch
[root@db1 db_home_1]# su - oracle
[oracle@db1 ~]$ cd /u01/app/oracle/product/11.2.0/db_home_1/OPatch
[oracle@db1 OPatch]$ ./opatch
Oracle 临时补丁程序安装程序版本 11.2.0.3.25
#二节点同理
2.开始补丁安装
2.1解压补丁包
按照ReadMe要求解压补丁包为grid用户权限，并最终使用root用户进行OPatch
[root@db1 ~]# mkdir /backup/psu
[root@db1 ~]# chown grid:oinstall /backup/psu
[root@db1 ~]# chown grid:oinstall p31326410_112040_Linux-x86-64.zip
[root@db1 ~]# mv p31326410_112040_Linux-x86-64.zip /backup/psu
[root@db1 ~]# su - grid
[grid@db1 ~]$ cd /backup/psu
[grid@db1 psu]$ unzip p31326410_112040_Linux-x86-64.zip
二节点同理
2.2开始应用
先启动集群
[root@db1 bin]# cd /u01/app/11.2.0/grid/bin
[root@db1 bin]# ./crsctl start has
[root@db2 bin]# cd /u01/app/11.2.0/grid/bin
[root@db2 bin]# ./crsctl start has
使用root用户opatch apply 即可
[root@db1 31326410]# /u01/app/11.2.0/grid/OPatch/opatch auto /backup/psu/31326410/31305209/
2.2.1二节点开始打
#先relocate scan监听
[grid@qcdb2 ~]$ srvctl stop scan_listener
[grid@qcdb2 ~]$ crs_relocate ora.scan1.vip -c qcdb1
尝试停止 `ora.scan1.vip` (在成员 `qcdb2` 上)
停止 `ora.scan1.vip` (在成员 `qcdb2` 上) 成功。
尝试启动 `ora.scan1.vip` (在成员 `qcdb1` 上)
启动 `ora.scan1.vip` (在成员 `qcdb1` 上) 成功。
[grid@qcdb2 ~]$ srvctl strt scan_listener
使用root进行OPatch apply
/u01/app/11.2.0/grid/OPatch/opatch auto /backup/psu/31326410/31305209/
Stopping RAC /u01/app/oracle/product/11.2.0/dbhome_1 ...
Stopped RAC /u01/app/oracle/product/11.2.0/dbhome_1 successfully
patch /u01/sj/31326410/31305209/29938455/custom/server/29938455 apply successful for home /u01/app/oracle/product/11.2.0/dbhome_1
patch /u01/sj/31326410/31305209/31103343 apply successful for home /u01/app/oracle/product/11.2.0/dbhome_1
Stopping CRS...
Stopped CRS successfully
patch /u01/sj/31326410/31305209/29938455 apply successful for home /u01/app/11.2.0/grid
patch /u01/sj/31326410/31305209/31103343 apply successful for home /u01/app/11.2.0/grid
patch /u01/sj/31326410/31305209/29509309 apply successful for home /u01/app/11.2.0/grid
Starting CRS...
Installing Trace File Analyzer
CRS-4123: Oracle High Availability Services has been started.
Starting RAC /u01/app/oracle/product/11.2.0/dbhome_1 ...
Started RAC /u01/app/oracle/product/11.2.0/dbhome_1 successfully
opatch auto succeeded.
2.3跑oracle升级脚本--任意节点
#刷新数据字典
sqlplus /nolog
sql> connect / as sysdba
sql> startup
sql> @?/rdbms/admin/catbundle.sql psu apply
#无效对象修复
SQL> @?/rdbms/admin/utlrp.sql
sql> quit
SQL> col COMMENTS for a30
select version ,BUNDLE_SERIES,COMMENTS from DBA_REGISTRY_history;SQL>
VERSION BUNDLE_SERIES COMMENTS
------------------------------ ------------------------------ ------------------------------
11.2.0.4 PSU Patchset 11.2.0.2.0
11.2.0.4 PSU Patchset 11.2.0.2.0
11.2.0.4 PSU PSU 11.2.0.4.180717
11.2.0.4 PSU PSU 11.2.0.4.200714
col comp_name format a35
col version format a15
col status format a15
select comp_name,version,status from DBA_REGISTRY;
OWB 11.2.0.4.0 VALID
Oracle Application Express 3.2.1.00.12 VALID
Oracle Enterprise Manager 11.2.0.4.0 VALID
OLAP Catalog 11.2.0.4.0 VALID
Spatial 11.2.0.4.0 VALID
Oracle Multimedia 11.2.0.4.0 VALID
Oracle XML Database 11.2.0.4.0 VALID
Oracle Text 11.2.0.4.0 VALID
Oracle Expression Filter 11.2.0.4.0 VALID
Oracle Rules Manager 11.2.0.4.0 VALID
Oracle Workspace Manager 11.2.0.4.0 VALID
COMP_NAME VERSION STATUS
----------------------------------- --------------- ---------------
Oracle Database Catalog Views 11.2.0.4.0 VALID
Oracle Database Packages and Types 11.2.0.4.0 VALID
JServer JAVA Virtual Machine 11.2.0.4.0 VALID
Oracle XDK 11.2.0.4.0 VALID
Oracle Database Java Packages 11.2.0.4.0 VALID
OLAP Analytic Workspace 11.2.0.4.0 VALID
Oracle OLAP API 11.2.0.4.0 VALID
Oracle Real Application Clusters 11.2.0.4.0 VALID
3.问题
3.1无法获得oracle目录
[root@qcdb1 ~]# /u01/app/11.2.0/grid/OPatch/opatch auto /u01/sj/31326410/31305209/
Executing /u01/app/11.2.0/grid/perl/bin/perl /u01/app/11.2.0/grid/OPatch/crs/patch11203.pl -patchdir /u01/sj/31326410 -patchn 31305209 -paramfile /u01/app/11.2.0/grid/crs/install/crsconfig_params
This is the main log file: /u01/app/11.2.0/grid/cfgtoollogs/opatchauto2020-10-13_11-58-44.log
This file will show your detected configuration and all the steps that opatchauto attempted to do on your system:
/u01/app/11.2.0/grid/cfgtoollogs/opatchauto2020-10-13_11-58-44.report.log
2020-10-13 11:58:44: Starting Clusterware Patch Setup
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
unable to get oracle owner for
解决 export LANG=C
[root@qcdb1 ~]# locale
LANG=zh_CN.UTF-8
LC_CTYPE="zh_CN.UTF-8"
LC_NUMERIC="zh_CN.UTF-8"
LC_TIME="zh_CN.UTF-8"
LC_COLLATE="zh_CN.UTF-8"
LC_MONETARY="zh_CN.UTF-8"
LC_MESSAGES="zh_CN.UTF-8"
LC_PAPER="zh_CN.UTF-8"
LC_NAME="zh_CN.UTF-8"
LC_ADDRESS="zh_CN.UTF-8"
LC_TELEPHONE="zh_CN.UTF-8"
LC_MEASUREMENT="zh_CN.UTF-8"
LC_IDENTIFICATION="zh_CN.UTF-8"
LC_ALL=
[root@qcdb1 ~]# export LANG=C
[root@qcdb1 ~]# /u01/app/11.2.0/grid/OPatch/opatch auto /u01/sj/31326410/31305209/
3.2应用子补丁失败
patch /u01/sj/31326410/31305209/29938455/custom/server/29938455 apply failed for home /u01/app/oracle/product/11.2.0/dbhome_1
查看日志得
Patching component oracle.rdbms, 11.2.0.4.0...
Patch 29938455 successfully applied.
Sub-set patch [27441052] has become inactive due to the application of a super-set patch [29938455].
Please refer to Doc ID 2161861.1 for any possible further required actions.
UtilSession failed: null
Log file location: /u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/opatch2020-10-13_12-02-38PM_1.log
OPatch failed with error code 73
再接着查看
目录/u01/app/oracle/product/11.2.0/dbhome_1/.patch_storage/NRollback
出现中文
先把目录下的中文文件名移除
打完补丁后，集群启动失败
[grid@qcdb1 qcdb1]$ crsctl status res -t -init
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE OFFLINE Instance Shutdown
ora.cluster_interconnect.haip
1 ONLINE OFFLINE
ora.crf
1 ONLINE ONLINE qcdb1
ora.crsd
1 ONLINE OFFLINE
ora.cssd
1 ONLINE OFFLINE STARTING
ora.cssdmonitor
1 ONLINE ONLINE qcdb1
ora.ctssd
1 ONLINE OFFLINE
ora.diskmon
1 OFFLINE OFFLINE
ora.drivers.acfs
1 ONLINE ONLINE qcdb1
ora.evmd
1 ONLINE OFFLINE
ora.gipcd
1 ONLINE ONLINE qcdb1
ora.gpnpd
1 ONLINE OFFLINE
ora.mdnsd
1 ONLINE ONLINE qcdb1
3.2.1集群诊断
查看关键进程
很显然，gpnpd.bin进程并没有启动，包括集群告警日志也出现关于gpnpd报警。
gpnpd负责集群概要文件信息，冲裁判，asm等等关键信息的管理。
此进程失败导致css及其相关进程相继失败
查看gpnpd日志发现如下
#详细报错信息
undefined symbol: ztpk_SetKeyInfo
Mos上搜索
作出验证
这俩个补丁我们都没有应用成功，但结合症状来看，可能是由于打补丁过程中这俩补丁都失败。
准备使用Mos提示，手动将28204707打入
3.2.2手动应用集群补丁
手动应用集群补丁适用于集群故障情况
#先备份
[root@qcdb1 11.2.0]# ls
grid
[root@qcdb1 11.2.0]# tar -pcf grid_patch_20201013.bak grid
[root@qcdb1 ~]# cd /u01/app/oracle/product/11.2.0/
[root@qcdb1 11.2.0]# ls
dbhome_1
[root@qcdb1 11.2.0]#
[root@qcdb1 11.2.0]# tar -pcf db_patch_20201013.bak dbhome_1/
根据readme查询相关集群补丁号如下
#1停止所有集群crs资源
crsctl stop has -f
#2检查进程
ps -ef|grep d.bin
#unlock集群
[root@qcdb1 11.2.0]# /u01/app/11.2.0/grid/crs/install/rootcrs.pl -unlock
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
CRS-4544: Unable to connect to OHAS
CRS-4000: Command Stop failed, or completed with errors.
Successfully unlock /u01/app/11.2.0/grid
#应用grid补丁--使用grid用户
1 GI_PSU_NUMNER-OCW --已经应用过
2 GI_PSU_NUMNER-ACFS
/u01/app/11.2.0/grid/OPatch/opatch napply -oh /u01/app/11.2.0/grid -local /u01/sj/31326410/31305209/29509309
Patch 29509309 successfully applied.
Sub-set patch [27959254] has become inactive due to the application of a super-set patch [29509309].
Please refer to Doc ID 2161861.1 for any possible further required actions.
Log file location: /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2020-10-13_13-04-30下午_1.log
OPatch succeeded.
3 GI_PSU_NUMNER-ACFS-DB_PSU
/u01/app/11.2.0/grid/OPatch/opatch apply -oh /u01/app/11.2.0/grid -local /u01/sj/31326410/31305209/31103343
Composite patch 31103343 successfully applied.
Log file location: /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2020-10-13_13-07-53下午_1.log
OPatch succeeded.
#运行DB component pre scripts --使用oracle用户
/u01/sj/31326410/31305209/29938455/custom/scripts/prepatch.sh -dbhome /u01/app/oracle/product/11.2.0/dbhome_1
/u01/sj/31326410/31305209/29938455/custom/scripts/prepatch.sh completed successfully.
#应用DB补丁--使用oracle用户
1 OSW补丁
You have already installed same patch(es) with same UPI(s) or same version(s).
These patch(es) will be skipped.
提示已安装
2 DB_PSU补丁
/u01/app/oracle/product/11.2.0/dbhome_1/OPatch/opatch apply -oh /u01/app/oracle/product/11.2.0/dbhome_1 -local /u01/sj/31326410/31305209/31103343
Composite patch 31103343 successfully applied.
Log file location: /u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/opatch2020-10-13_13-17-44下午_1.log
OPatch succeeded.
#执行DB component post script --使用oracle用户
/u01/sj/31326410/31305209/29938455/custom/server/29938455/custom/scripts/postpatch.sh -dbhome /u01/app/oracle/product/11.2.0/dbhome_1
Reading /u01/app/oracle/product/11.2.0/dbhome_1/install/params.ora..
Reading /u01/app/oracle/product/11.2.0/dbhome_1/install/params.ora..
Parsing file /u01/app/oracle/product/11.2.0/dbhome_1/bin/racgwrap
Parsing file /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvctl
Parsing file /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvconfig
Parsing file /u01/app/oracle/product/11.2.0/dbhome_1/bin/cluvfy
Verifying file /u01/app/oracle/product/11.2.0/dbhome_1/bin/racgwrap
Verifying file /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvctl
Verifying file /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvconfig
Verifying file /u01/app/oracle/product/11.2.0/dbhome_1/bin/cluvfy
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/racgwrap
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvctl
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/srvconfig
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/cluvfy
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/diskmon.bin
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/lsnodes
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/osdbagrp
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/rawutl
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/srvm/admin/ractrans
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/srvm/admin/getcrshome
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/gnsd
Reapplying file permissions on /u01/app/oracle/product/11.2.0/dbhome_1/bin/crsdiag.pl
Postpatch completed successfully
#执行集群post脚本 --使用root用户
[root@qcdb1 29938455]# /u01/app/11.2.0/grid/rdbms/install/rootadd_rdbms.sh
[root@qcdb1 29938455]#/u01/app/11.2.0/grid/crs/install/rootcrs.pl -patch
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
Installing Trace File Analyzer
CRS-4123: Oracle High Availability Services has been started.
再次查看集群恢复正常
查看当前节点Opatch
已经安装成功
3.3打完补丁后数据库不能启动
Linux-x86_64 Error: 13: Permission denied
Additional information: 9
ORA-15025: ?????? "/dev/mapper/fradisk5"
ORA-27041: ??????
Linux-x86_64 Error: 13: Permission denied
Additional information: 9
ORA-15025: ?????? "/dev/mapper/fradisk6"
ORA-27041: ??????
Linux-x86_64 Error: 13: Permission denied
Additional information: 9
SUCCESS: diskgroup FRA was dismounted
ERROR: diskgroup FRA was not mounted
ORA-00210: ???????????
ORA-00202: ????: ''+FRA/qcdb/controlfile/current.256.982946831''
ORA-17503: ksfdopn: 2 ?????? +FRA/qcdb/controlfile/current.256.982946831
ORA-15001: ??? "FRA" ????????
提示不能访问控制文件
重新向asm注册oracle即可
[grid@qcdb1 ~]$ /u01/app/11.2.0/grid/bin/setasmgidwrap -o /u01/app/oracle/product/11.2.0/dbhome_1/bin/oracle
[grid@qcdb1 ~]$ ls -l /u01/app/oracle/product/11.2.0/dbhome_1/bin/oracle
-rwsr-s--x 1 oracle asmadmin 239989650 10月 13 13:18 /u01/app/oracle/product/11.2.0/dbhome_1/bin/oracle*
重启验证
参考文档：Mos-Readme for 31305209
Mos-1641136.1
Mos-2477177.1