今天維護人員告知有個9i的rac例項無法正常啟動，一直處於mount狀態，也沒有報錯資訊，一直hang在lmon registered with nm - instance id 2 (internal mem no 1)這裡不動。
sat sep 10 14:00:33 2011
cluster interconnect ipc version:oracle udp/ip
ipc vendor 1 proto 2 version 1.0
pmon started with pid=2
diag started with pid=3
lmon started with pid=4
lmd0 started with pid=5
lms0 started with pid=6
lms1 started with pid=7
dbw0 started with pid=8
lgwr started with pid=9
ckpt started with pid=10
smon started with pid=11
reco started with pid=12
cjq0 started with pid=13
sat sep 10 14:00:36 2011
arch: starting arch processes
arc0 started with pid=14
arc0: archival started
arc1 started with pid=15
arc1: archival started
sat sep 10 14:00:37 2011
arch: starting arch processes complete
sat sep 10 14:00:37 2011
arc1: thread not mounted
sat sep 10 14:00:37 2011
arc0: thread not mounted
sat sep 10 14:00:51 2011
alter database mount
sat sep 10 14:00:51 2011
lmon registered with nm - instance id 2 (internal mem no 1)
開始懷疑是ha有問題，導致無法讀取共享資源hang住，檢視兩邊的pv屬性，發現都是正常的concurrent狀態，重啟了ha後故障依舊。
後通過檢視集群狀態發現有兩個心跳ip狀態是down，兩個節點無相ping果然無法ping通，通過詢問維護人員知道因換過電源，初步懷疑是換電源的時候把網線給碰松或者碰掉了導致，去機房檢視狀態發現果然兩塊網絡卡指示燈都不亮，接實所有網線後狀態指示燈呈正常綠色閃爍狀態，再次啟動資料庫後正常啟動。
clstat - hacmp cluster status monitor
-------------------------------------
cluster: kkdb_cluster (1149099876)
sat sep 10 16:49:01 beist 2011
state: up nodes: 2
substate: stable
node: kkdb1 state: up
inte***ce: kkdb1_boot1 (1) address: 192.168.0.21
state: up
inte***ce: kkdb1_boot2 (1) address: 192.168.1.21
state: up
inte***ce: kkdb1_hb (0) address: 192.168.3.21
state: down
inte***ce: kkdb1_svc (1) address: 10.10.13.62
state: up
inte***ce: kkdb1_rac (2) address: 192.168.2.21
state: down
resource group: kkdb1_rg state: on line
resource group: kkdb_share_rg state: on line
node: kkdb2 state: up
inte***ce: kkdb2_boot1 (1) address: 192.168.0.23
state: up
inte***ce: kkdb2_boot2 (1) address: 192.168.1.23
state: up
inte***ce: kkdb2_hb (0) address: 192.168.3.23
state: down
inte***ce: kkdb2_svc (1) address: 10.10.13.64
state: up
inte***ce: kkdb2_rac (2) address: 192.168.2.23
state: down
resource group: kkdb2_rg state: on line
resource group: kkdb_share_rg state: on line
RAC起單例項make
本文主要描述oracle rac啟單例項的操作。blog 如有疑問，歡迎聯絡。關閉rac元件就 ok了。1.shutdown the database completely.2.relink with rac off cd oracle home rdbms lib make f ins rdbms...
Exchange資料庫不能Mount了
昨天下午,外地分公司同事反應,當地的exchange郵件不能用了.把伺服器重啟了,也不行.我通過pcanywhere連上伺服器進行檢查,檢視服務狀態,發現exchange正常啟動,能telnet到110和25埠上.我開啟e 發現資料庫不能mount了,這時檢視事件日誌,發現有大量的事件記錄9175,...
RAC不能啟動的修復過程
一 在每個節點上殺掉所有crs相關程序 1.ps ef grep crs 2.按照顯示程序號殺掉所有程序 3.重複第一步和第二步保證所有程序都被殺掉 二 在每個節點上清除crs rm f etc init.d init.cssd rm f etc init.d init.crs rm f etc i...