记一次cssd无法启动故障处理
故障状态
Oracle 11G RAC环境
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm1 ONLINE OFFLINE Instance Shutdown
ora.cluster_interconnect.haip1 ONLINE OFFLINE
ora.crf1 OFFLINE OFFLINE
ora.crsd1 ONLINE OFFLINE
ora.cssd1 ONLINE OFFLINE STARTING
ora.cssdmonitor1 ONLINE ONLINE teset01
ora.ctssd1 ONLINE OFFLINE
ora.diskmon1 OFFLINE OFFLINE
ora.evmd1 ONLINE OFFLINE
ora.gipcd1 ONLINE ONLINE teset01
ora.gpnpd1 ONLINE ONLINE teset01
ora.mdnsd1 ONLINE ONLINE teset01
cssd一直处理starting状态,ccsd日志无新增内容
检查
grid用户
观察两个节点的本地的gpnp profile目录,均存在pending.xml,正常状态下会自动删除pending.xml文件
[grid@testrac01:/home/grid]$$ oclumon manage -get master replica
CRS-9011-Error manage: Failed to initialize connection to the Cluster Logger Service
[grid@testrac01:/home/grid]
[grid@testrac01:/home/grid]
[grid@testrac01:/home/grid]
[grid@testrac01:/home/grid]$ cd $ORACLE_HOME/gpnp/$(hostname)/profiles/peer
[grid@testrac01:/app/11.2.0/grid/gpnp/testrac01/profiles/peer]$
[grid@testrac01:/app/11.2.0/grid/gpnp/testrac01/profiles/peer]$
[grid@testrac01:/app/11.2.0/grid/gpnp/testrac01/profiles/peer]$ ll
total 12
-rw-r--r-- 1 grid oinstall 1873 Apr 13 2017 profile.old
-rw-r--r--. 1 grid oinstall 1828 Apr 11 2017 profile_orig.xml
-rw-r--r-- 1 grid oinstall 1889 Mar 28 2022 profile.xml
-rw-r--r-- 1 grid oinstall 564 Nov 11 2025 pending.xml
故障处理
将两个节点的pending.xml文件mv走,然后再次尝试重启crs集群,集群竟然很顺利的成功启动到正常状态。
处理过程参考:
ORACLE 11.2.0.4 RAC Cluster not starting cssd with Cannot get GPnP profile
以下为正常状态
1、gpnptool get
2、oclumon manage -get master replica
[grid@testrac01:/home/grid]$ gpnptool get
Warning: some command line parameters were defaulted. Resulting command line: /app/11.2.0/grid/bin/gpnptool.bin get -o-<?xml version="1.0" encoding="UTF-8"?><gpnp:GPnP-Profile Version="1.0" xmlns="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:gpnp="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:orcl="http://www.oracle.com/gpnp/2005/11/gpnp-profile" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.grid-pnp.org/2005/11/gpnp-profile gpnp-profile.xsd" ProfileSequence="4" ClusterUId="23f4760d509dff96ff824cb0a137d52c" ClusterName="testrac-scan" PALocation=""><gpnp:Network-Profile><gpnp:HostNetwork id="gen" HostName="*"><gpnp:Network id="net1" IP="10.239.165.0" Adapter="eth0" Use="public"/><gpnp:Network id="net2" IP="192.168.254.0" Adapter="eth1" Use="cluster_interconnect"/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profile id="css" DiscoveryString="+asm" LeaseDuration="400"/><orcl:ASM-Profile id="asm" DiscoveryString="/dev/asm*" SPFile="+OCR/testrac-scan/asmparameterfile/registry.253.1207716687"/><ds:Signature xmlns:ds="http://www.w3.org/2000/09/xmldsig#"><ds:SignedInfo><ds:CanonicalizationMethod Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/><ds:SignatureMethod Algorithm="http://www.w3.org/2000/09/xmldsig#rsa-sha1"/><ds:Reference URI=""><ds:Transforms><ds:Transform Algorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/><ds:Transform Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"> <InclusiveNamespaces xmlns="http://www.w3.org/2001/10/xml-exc-c14n#" PrefixList="gpnp orcl xsi"/></ds:Transform></ds:Transforms><ds:DigestMethod Algorithm="http://www.w3.org/2000/09/xmldsig#sha1"/><ds:DigestValue>ryKR58burT761l55mdDePF+fq4s=</ds:DigestValue></ds:Reference></ds:SignedInfo><ds:SignatureValue>Fa0NApPz3EuXZe0YsisObQze3JSwY7U35j2QYUX+fX1aJaPLKIyjx7GfL/eRU4G9zg7kb55WGppQKud7/jJgzQbJuiAuZvgf1qVzcbB/R2GansUmEGcy+WutoGNjD0IFhaAVM/plPmUNcaivtX7Gt30RUVSOlHI84yxIPBnIRsg=</ds:SignatureValue></ds:Signature></gpnp:GPnP-Profile>
Success.
[grid@testrac01:/home/grid]$
[grid@testrac01:/home/grid]$
[grid@testrac01:/home/grid]$ oclumon manage -get master replicaMaster = testrac01
Replica = testrac02Done
