某金融客户SR6608路由器不转发报文的问题

某金融客户SR6608路由器不转发报文的问题

一     组网：

二     问题描述：

2014年07月28日下午17：44左右，某金融客户反映，SR6608（R1）与总行和SR6608(R2）的OSPF邻居由FULL变成INIT，从内网终端或SR6608(R2） PING该SR6608（R1）所有地址不通，从该SR6608（R1） PING省行或内网也是不通，所有接口状态正常。

三     过程分析：

故障发生以后，现场收集了诊断信息和日志文件。从故障时的信息分析：SR6608（R1）的HIM-8GE处于 UP状态的几个接口（G3/1/0、G3/1/1、G3/1/6、G3/1/7）FIFO队列均已堵死，无法正常收发报文并反压FIP210线卡，致线卡上的CREDIT异常，以致OSPF邻居关系出现变化；

GigabitEthernet3/1/1 current state: UP 

Line protocol current state: UP

Description: GigabitEthernet3/1/1 Interface

The Maximum Transmit Unit is 1500, Hold timer is 10(sec)

Internet protocol processing : disabled

IP Packet Frame Type: PKTFMT_ETHNT_2,  Hardware Address: 5cdd-70a3-4e01

IPv6 Packet Frame Type: PKTFMT_ETHNT_2,  Hardware Address: 5cdd-70a3-4e01    

Media type is twisted pair, loopback not set, promiscuous mode not set

1000Mb/s, Full-duplex, link type is force link

Output flow-control is disabled, input flow-control is disabled

Output queue : (Urgent queuing : Size/Length/Discards)  61/100/0  —其他几个接口也有类似堵死的情况；

Output queue : (Protocol queuing : Size/Length/Discards)  500/500/5868//其他几个接口也有类似堵死的情况；

Output queue : (FIFO queuing : Size/Length/Discards)  1024/1024/866//其他几个接口也有类似堵死的情况；

Last clearing of counters: Never

    Last 300 seconds input rate 9301.95 bytes/sec, 74408 bits/sec, 45.00 packets/sec

    Last 300 seconds output rate 0.00 bytes/sec, 0 bits/sec, 0.00 packets/sec

    Input: 54634242 packets, 11161945908 bytes, 0 no buffers

           2170 broadcasts, 410536 multicasts, 0 pauses

           0 errors, 0 runts, 0 giants

           0 crc, 0 align errors, 0 overruns

           0 dribbles, 0 drops

    Output:62812185 packets, 19874442276 bytes

           93 broadcasts, 3503617 multicasts, 0 pauses

           0 errors, 0 underruns, 0 collisions

           0 deferred, 0 lost carriers

Credit of Core[0] to GMAC:  4  4  4  4

Credit of Core[1] to GMAC:  4  4  4  4

Credit of Core[2] to GMAC:  4  4  4  4

Credit of Core[3] to GMAC:  4  4  4  4

Credit of Core[4] to GMAC:  4  4  4  4

Credit of Core[5] to GMAC:  4  4  4  4

Credit of Core[6] to GMAC:  4  4  4  4

Credit of Core[7] to GMAC:  4  4  4  4

Credit of Core[0] to SPI4A:  0  4  4  4  4  4  0  0 //出现“零”说明线卡的CREDIT异常，影响了转发；

Credit of Core[1] to SPI4A:  0  0  4  4  4  4  0  0

Credit of Core[2] to SPI4A:  0  0  4  4  4  4  0  0

Credit of Core[3] to SPI4A:  0  0  4  4  4  4  0  0

Credit of Core[4] to SPI4A:  0  0  4  4  4  4  0  0

Credit of Core[5] to SPI4A:  0  0  4  4  4  4  0  0

Credit of Core[6] to SPI4A:  0  0  4  4  4  4  0  0

Credit of Core[7] to SPI4A:  0  0  4  4  4  4  0  0

Credit of Core[0] to SPI4B:  4  4  4  4  4  4  4  4

Credit of Core[1] to SPI4B:  4  4  4  4  4  4  4  4

Credit of Core[2] to SPI4B:  4  4  4  4  4  4  4  4

Credit of Core[3] to SPI4B:  4  4  4  4  4  4  4  4

Credit of Core[4] to SPI4B:  4  4  4  4  4  4  4  4

Credit of Core[5] to SPI4B:  4  4  4  4  4  4  4  4

Credit of Core[6] to SPI4B:  4  4  4  4  4  4  4  4

Credit of Core[7] to SPI4B:  4  4  4  4  4  4  4  4

%@15635%Dec  8 09:41:32:778 2014 JX_JDZ_R1 OSPF/5/OSPF_NBR_CHG: OSPF 32 Neighbor 44.0.241.1(GigabitEthernet3/1/1.100) from Full to Init.

%@15639%Dec  8 09:41:34:223 2014 JX_JDZ_R1 OSPF/5/OSPF_NBR_CHG: OSPF 32 Neighbor 44.32.31.2(GigabitEthernet3/1/6.1) from Full to Init.

%@15667%Dec  8 09:41:45:224 2014 JX_JDZ_R1 OSPF/5/OSPF_NBR_CHG: OSPF 32 Neighbor 44.32.31.18(GigabitEthernet3/1/7.2) from Full to Init.//OSPF邻居关系从FULL to INIT 状态；

综合之前的信息来看，初步分析硬件故障导致此问题，建议更换FIP210线卡+8GE子卡，并将故障件返回研发分析。

另一方面，由于版本过于陈旧（R2420P06），维护信息不足，并且存在一切相关的已知问题，建议推动客户研讨升级事宜。

四     解决方法：

建议更换FIP210线卡+8GE子卡，并将故障件返回研发分析；

升级到现有稳定版本R3303P16。