【華為】環(huán)路引起交換機(jī)CPU占用率高的業(yè)務(wù)時(shí)通時(shí)不通問題
發(fā)布作者:微思網(wǎng)絡(luò) 發(fā)布時(shí)間:2025-04-18 瀏覽量:0次
現(xiàn)象描述 某網(wǎng)絡(luò)遷移改造,將原網(wǎng)中的核心層設(shè)備部署為接入層設(shè)備,即從三層變?yōu)槎?。?/span>圖所示,網(wǎng)絡(luò)遷移完成后,從核心層設(shè)備向接入層設(shè)備的管理IP地址發(fā)起Ping測(cè)試,發(fā)現(xiàn)時(shí)通時(shí)不通,并且核心層設(shè)備輸出VRRP主備狀態(tài)頻繁切換的告警。 故障組網(wǎng)圖 在Switch_1上出現(xiàn)如下告警信息: 原因分析 網(wǎng)絡(luò)中存在環(huán)路。 問題判斷 發(fā)現(xiàn)Switch_1在該備份組中作為Backup,且狀態(tài)都為正常。 發(fā)現(xiàn)Switch_1的4號(hào)接口板上有大量丟包。 2. 查看端口狀態(tài)統(tǒng)計(jì)信息。 發(fā)現(xiàn)GigabitEthernet4/0/19端口出方向的平均帶寬利用率達(dá)到80%以上,應(yīng)該存在環(huán)路,并且GigabitEthernet4/0/18和GigabitEthernet4/0/19端口的入方向流量統(tǒng)計(jì)也到達(dá)80%以上,初步判斷是這兩個(gè)端口下掛的設(shè)備引起環(huán)路導(dǎo)致。 3. 手工shutdown端口利用率超限的端口GigabitEthernet4/0/18和GigabitEthernet4/0/19,再查看上送CPU的VRRP協(xié)議報(bào)文統(tǒng)計(jì)信息,發(fā)現(xiàn)VRRP協(xié)議報(bào)文Drop統(tǒng)計(jì)數(shù)不再增加。同時(shí)Ping其他接入層設(shè)備的管理地址發(fā)現(xiàn)可以Ping通。 4. 檢查Switch_1的GigabitEthernet4/0/18和GigabitEthernet4/0/19兩個(gè)端口下接的接入層設(shè)備,這兩臺(tái)交換機(jī)都是其他廠商設(shè)備,排查后發(fā)現(xiàn),由于這兩臺(tái)設(shè)備都是三層設(shè)備,沒有開啟STP協(xié)議,部署成二層設(shè)備時(shí),未添加開啟STP的命令,導(dǎo)致環(huán)路。 解決方案 在Switch_1的GigabitEthernet4/0/18和GigabitEthernet4/0/19兩個(gè)端口下接的接入層設(shè)備上開啟STP。 從Switch_1上undo shutdown端口GigabitEthernet4/0/18和GigabitEthernet4/0/19,查看STP狀態(tài)和接口流量,業(yè)務(wù)恢復(fù)正常。 建議與總結(jié) 在網(wǎng)絡(luò)流量不穩(wěn)定時(shí),可以通過接口流量狀態(tài)查看是否有環(huán)路,并根據(jù)收發(fā)狀態(tài)猜測(cè)環(huán)路的源頭,盡快關(guān)閉端口來臨時(shí)解決問題,分析出根因后,再實(shí)施解決方案。 END 1微思網(wǎng)絡(luò),始于2002年 專業(yè)IT認(rèn)證培訓(xùn)23年,面向全國(guó)招生! 點(diǎn)擊查看更多【培訓(xùn)課程目錄】 微思-主要課程有: *網(wǎng)絡(luò)技術(shù):華為HCIA/ HCIP/HCIE;思科CCNA/CCNP/CCIE *Linux技術(shù):紅帽 RHCE/RHCA *K8S&容器:CKA/CKS *數(shù)據(jù)庫(kù):ORACLE OCP/ OCM ;MySQL ;達(dá)夢(mèng)數(shù)據(jù)庫(kù) *虛擬化:VMware VCP/VCAP *安全認(rèn)證:CISP體系/CISSP/ CISA;CCSK;CISAW體系 *管理類:PMP 項(xiàng)目管理;軟考中/高項(xiàng);ITIL體系;Togaf 其他課程如:ACP;Azure...Sep 17 2015 21:46:11+08:00 DS_02 VRRP/3/VRRPMASTERDOWN:OID 1.3.6.1.4.1.2011.5.25.127.2.30.1 The state of VRRP changed from master to other state.(VrrpIfIndex=143, VrId=48, IfIndex=143, IPAddress=11.91.127.239, NodeName=DS_02, IfName=Vlanif948, CurrentState=2, ChangeReason=priority calculation)
Sep 17 2015 21:46:11+08:00 DS_02 %%01VRRP/4/STATEWARNINGMEV1R3(l):Virtual Router state BACKUP changed to MASTER, because of protocol timer expired. (Interface=Vlanif948, VrId=48).
Sep 17 2015 21:46:11+08:00 DS_02 %%01VRRP/4/STATEWARNINGMEV1R3(l):Virtual Router state MASTER changed to BACKUP, because of priority calculation. (Interface=Vlanif948, VrId=48).1. 查看VRRP備份組的狀態(tài)信息。
<Switch_1> display vrrp brief
VRID State Interface Type Virtual IP
--------------------------------------------------------
3 Backup Vlanif903 Normal 10.93.4.30
5 Backup Vlanif599 Normal 11.91.127.94
14 Backup Vlanif914 Normal 10.93.41.126
24 Backup Vlanif924 Normal 10.93.32.126
25 Backup Vlanif925 Normal 10.93.32.254
…………<Switch_1> display cpu-defend vrrp statistics all
Statistics on mainboard:
-------------------------------------------------------------------------------
Packet Type Pass(Bytes) Drop(Bytes) Pass(Packets) Drop(Packets)
-------------------------------------------------------------------------------
vrrp 0 0 0 0
-------------------------------------------------------------------------------
Statistics on slot 1:
-------------------------------------------------------------------------------
Packet Type Pass(Bytes) Drop(Bytes) Pass(Packets) Drop(Packets)
-------------------------------------------------------------------------------
vrrp 0 0 0 0
-------------------------------------------------------------------------------
Statistics on slot 4:
-------------------------------------------------------------------------------
Packet Type Pass(Bytes) Drop(Bytes) Pass(Packets) Drop(Packets)
-------------------------------------------------------------------------------
vrrp 79880066214 2581617736 1174644777 37950869
-------------------------------------------------------------------------------<Switch_1> display interface brief
…………
Interface PHY Protocol InUti OutUti inErrors outErrors
Eth-Trunk1 up up 31% 31% 0 0
GigabitEthernet4/0/22 up up 0.72% 81% 0 0
GigabitEthernet4/0/23 up up 81% 0.73% 2 0
Ethernet0/0/0 down down 0% 0% 0 0
…………
GigabitEthernet4/0/0 up up 0% 81% 0 0
GigabitEthernet4/0/1 up up 0% 81% 0 0
GigabitEthernet4/0/2 up up 0% 81% 2 0
GigabitEthernet4/0/3 up up 0% 81% 0 0
GigabitEthernet4/0/4 up up 0% 81% 0 0
GigabitEthernet4/0/5 up up 0% 81% 0 0
GigabitEthernet4/0/6 up up 0% 81% 0 0
GigabitEthernet4/0/7 up up 0% 81% 0 0
GigabitEthernet4/0/8 up up 0% 82% 0 0
GigabitEthernet4/0/9 up up 0% 82% 0 0
GigabitEthernet4/0/10 up up 0% 82% 0 0
GigabitEthernet4/0/11 down down 0% 0% 0 0
GigabitEthernet4/0/12 up up 0% 82% 0 0
GigabitEthernet4/0/13 up up 0% 82% 0 0
GigabitEthernet4/0/14 up up 0% 82% 0 0
GigabitEthernet4/0/15 up up 0% 82% 0 0
GigabitEthernet4/0/16 up up 0% 82% 0 0
GigabitEthernet4/0/17 up up 0.01% 82% 0 0
GigabitEthernet4/0/18 up up 82% 0% 0 0
GigabitEthernet4/0/19 up up 87% 82% 0 0
GigabitEthernet4/0/20 down down 0% 0% 0 0
GigabitEthernet4/0/21 up up 0.01% 0.01% 0 0
LoopBack500 up up(s) 0% 0% 0 0
NULL0 up up(s) 0% 0% 0 0
Vlanif599 up up -- -- 0 0
…………