某局点交换机IRF后做MAD失败问题处理经验案例

某局点S5130-52S-EI，版本V7 R3116，正常堆叠，上联设备是S5560-56C-HI，版本V7 R7122，堆叠后为了提高系统的可用性做了LACP MAD检测，S5130-52S-EI上XGE6/0/52和XGE7/0/52加入聚合口1，S5560-56C-HI上XGE1/2/1和XGE1/2/2加入聚合口2，两边对接做动态聚合。

两边物理口是UP的，聚合口的配置也是一致的，但是两边聚合口没有正常起来。

1.查看两边聚合配置：

S5130-52S-EI：

#
interface Ten-GigabitEthernet6/0/52
 port link-aggregation group 1
#
interface Ten-GigabitEthernet7/0/52
 port link-aggregation group 1
#
interface Bridge-Aggregation1
 port link-type trunk
 undo port trunk permit vlan 1
 port trunk permit vlan 30 32 to 33 100
 link-aggregation mode dynamic
 mad enable
#

S5560-56C-HI：

#
interface Ten-GigabitEthernet1/2/1
 port link-mode bridge
 port link-aggregation group 2
#
interface Ten-GigabitEthernet1/2/2
 port link-mode bridge
 port link-aggregation group 2
#
interface Bridge-Aggregation2
 description to_DL_DX_S5130_4
 port link-type trunk
 undo port trunk permit vlan 1
 port trunk permit vlan 30 32 to 33 100
 link-aggregation mode dynamic
#

2.查看两边接口状态：

S5130-52S-EI：

Ten-GigabitEthernet6/0/52
Current state: DOWN
Line protocol state: DOWN(LAGG)
IP packet frame type: Ethernet II, hardware address: 782c-293a-d1cc
Description: Ten-GigabitEthernet6/0/52 Interface
Bandwidth: 10000000 kbps
Loopback is not set
Media type is optical fiber, Port hardware type is 10G_BASE_SR_SFP
Unknown-speed mode, unknown-duplex mode
Link speed type is autonegotiation, link duplex type is autonegotiation
Flow-control is not enabled
Maximum frame length: 12288
Allow jumbo frames to pass
Broadcast max-ratio: 100%
Multicast max-ratio: 100%
Unicast max-ratio: 100%
PVID: 1
MDI type: Automdix
Port link-type: Access
 Tagged VLANs:   None
 Untagged VLANs: 1
Port priority: 0
Last link flapping: 0 hours 16 minutes 54 seconds
Last clearing of counters: Never
 Peak input rate: 22 bytes/sec, at 2013-01-01 00:07:28
 Peak output rate: 25 bytes/sec, at 2013-01-01 00:07:43
 Last 300 second input: 0 packets/sec 0 bytes/sec -%
 Last 300 second output: 0 packets/sec 0 bytes/sec -%
 Input (total):  50 packets, 10530 bytes
  0 unicasts, 0 broadcasts, 50 multicasts, 0 pauses
 Input (normal):  50 packets, - bytes
  0 unicasts, 0 broadcasts, 50 multicasts, 0 pauses
 Input:  0 input errors, 0 runts, 0 giants, 0 throttles
  0 CRC, 0 frame, - overruns, 0 aborts
  - ignored, - parity errors
 Output (total): 52 packets, 11332 bytes
  0 unicasts, 0 broadcasts, 52 multicasts, 0 pauses
 Output (normal): 52 packets, - bytes
  0 unicasts, 0 broadcasts, 52 multicasts, 0 pauses
 Output: 0 output errors, - underruns, - buffer failures
  0 aborts, 0 deferred, 0 collisions, 0 late collisions
  0 lost carrier, - no carrier

Ten-GigabitEthernet7/0/52
Current state: UP
Line protocol state: DOWN(LAGG)
IP packet frame type: Ethernet II, hardware address: 782c-293a-d22c
Description: Ten-GigabitEthernet7/0/52 Interface
Bandwidth: 10000000 kbps
Loopback is not set
Media type is optical fiber, Port hardware type is 10G_BASE_SR_SFP
10Gbps-speed mode, full-duplex mode
Link speed type is autonegotiation, link duplex type is autonegotiation
Flow-control is not enabled
Maximum frame length: 12288
Allow jumbo frames to pass
Broadcast max-ratio: 100%
Multicast max-ratio: 100%
Unicast max-ratio: 100%
PVID: 1
MDI type: Automdix
Port link-type: Access
 Tagged VLANs:   None
 Untagged VLANs: 1
Port priority: 0
Last link flapping: 0 hours 25 minutes 0 seconds
Last clearing of counters: Never
 Peak input rate: 22 bytes/sec, at 2013-01-01 00:09:24
 Peak output rate: 25 bytes/sec, at 2013-01-01 00:07:18
 Last 300 second input: 0 packets/sec 15 bytes/sec 0%
 Last 300 second output: 0 packets/sec 20 bytes/sec 0%
 Input (total):  118 packets, 26520 bytes
  0 unicasts, 0 broadcasts, 118 multicasts, 0 pauses
 Input (normal):  118 packets, - bytes
  0 unicasts, 0 broadcasts, 118 multicasts, 0 pauses
 Input:  0 input errors, 0 runts, 0 giants, 0 throttles
  0 CRC, 0 frame, - overruns, 0 aborts
  - ignored, - parity errors
 Output (total): 156 packets, 33170 bytes
  0 unicasts, 0 broadcasts, 156 multicasts, 0 pauses
 Output (normal): 156 packets, - bytes
  0 unicasts, 0 broadcasts, 156 multicasts, 0 pauses
 Output: 0 output errors, - underruns, - buffer failures
  0 aborts, 0 deferred, 0 collisions, 0 late collisions
  0 lost carrier, - no carrier

Bridge-Aggregation1
Current state: DOWN
IP packet frame type: Ethernet II, hardware address: 782c-293a-cdb0
Description: Bridge-Aggregation1 Interface
Bandwidth: 0 kbps
Unknown-speed mode, unknown-duplex mode
Link speed type is autonegotiation, link duplex type is autonegotiation
PVID: 1
Port link-type: Trunk
 VLAN Passing:   30, 32-33, 100
 VLAN permitted: 30, 32-33, 100
 Trunk port encapsulation: IEEE 802.1q
Last clearing of counters: Never
Last 300 seconds input:  0 packets/sec 15 bytes/sec -%
Last 300 seconds output:  0 packets/sec 20 bytes/sec -%
Input (total):  168 packets, 37050 bytes
 0 unicasts, 0 broadcasts, 168 multicasts, 0 pauses
Input (normal):  168 packets, - bytes
 0 unicasts, 0 broadcasts, 168 multicasts, 0 pauses
Input:  0 input errors, 0 runts, 0 giants, 0 throttles
 0 CRC, 0 frame, - overruns, 0 aborts
 - ignored, - parity errors
Output (total): 206 packets, 44220 bytes
 0 unicasts, 0 broadcasts, 206 multicasts, 0 pauses
Output (normal): 206 packets, - bytes
 0 unicasts, 0 broadcasts, 206 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
 0 aborts, 0 deferred, 0 collisions, 0 late collisions
 0 lost carrier, - no carrier

Aggregate Interface: Bridge-Aggregation1
Aggregation Mode: Dynamic
Loadsharing Type: Shar
Management VLAN : None
System ID: 0x8000, 782c-293a-cdb0
Local:
  Port             Status  Priority Oper-Key  Flag
--------------------------------------------------------------------------------
  XGE6/0/52        U       32768    1         {A}
  XGE7/0/52        U       32768    1         {A}
Remote:
  Actor            Partner Priority Oper-Key  SystemID               Flag  
--------------------------------------------------------------------------------
  XGE6/0/52        69      32768    2         0x8000, 38ad-8ed4-1944 {A}
  XGE7/0/52        70      32768    2         0x8000, 38ad-8ed4-1944 {A}

S5560-56C-HI：

Ten-GigabitEthernet1/2/1
Current state: DOWN
Line protocol state: DOWN(LAGG)
IP packet frame type: Ethernet II, hardware address: 38ad-8ed4-19a4
Description: Ten-GigabitEthernet1/2/1 Interface
Bandwidth: 10000000 kbps
Loopback is not set
Media type is optical fiber, Port hardware type is 10G_BASE_SR_SFP
Unknown-speed mode, unknown-duplex mode
Link speed type is autonegotiation, link duplex type is autonegotiation
Flow-control is not enabled
Maximum frame length: 12288
Allow jumbo frames to pass
Broadcast max-ratio: 100%
Multicast max-ratio: 100%
Unicast max-ratio: 100%
PVID: 1
MDI type: automdix
Port link-type: Access
 Tagged VLANs:   None
 Untagged VLANs: 1
Port priority: 0
Last link flapping: 0 hours 32 minutes 34 seconds
Last clearing of counters: Never
 Peak input rate: 29 bytes/sec, at 2019-04-26 20:30:29
 Peak output rate: 26 bytes/sec, at 2019-04-26 20:49:45
 Last 300 second input: 0 packets/sec 0 bytes/sec -%
 Last 300 second output: 0 packets/sec 0 bytes/sec -%
 Input (total):  199 packets, 42130 bytes
  0 unicasts, 0 broadcasts, 199 multicasts, 0 pauses
 Input (normal):  199 packets, - bytes
  0 unicasts, 0 broadcasts, 199 multicasts, 0 pauses
 Input:  0 input errors, 0 runts, 0 giants, 0 throttles
  0 CRC, 0 frame, - overruns, 0 aborts
  - ignored, - parity errors
 Output (total): 185 packets, 39832 bytes
  0 unicasts, 0 broadcasts, 185 multicasts, 0 pauses
 Output (normal): 185 packets, - bytes
  0 unicasts, 0 broadcasts, 185 multicasts, 0 pauses
 Output: 0 output errors, - underruns, - buffer failures
  0 aborts, 0 deferred, 0 collisions, 0 late collisions
  0 lost carrier, - no carrier

Ten-GigabitEthernet1/2/2
Current state: UP
Line protocol state: DOWN(LAGG)
IP packet frame type: Ethernet II, hardware address: 38ad-8ed4-19a5
Description: Ten-GigabitEthernet1/2/2 Interface
Bandwidth: 10000000 kbps
Loopback is not set
Media type is optical fiber, Port hardware type is 10G_BASE_SR_SFP
10Gbps-speed mode, full-duplex mode
Link speed type is autonegotiation, link duplex type is autonegotiation
Flow-control is not enabled
Maximum frame length: 12288
Allow jumbo frames to pass
Broadcast max-ratio: 100%
Multicast max-ratio: 100%
Unicast max-ratio: 100%
PVID: 1
MDI type: automdix
Port link-type: Access
 Tagged VLANs:   None
 Untagged VLANs: 1
Port priority: 0
Last link flapping: 0 hours 40 minutes 42 seconds
Last clearing of counters: Never
 Peak input rate: 29 bytes/sec, at 2019-04-26 20:31:20
 Peak output rate: 27 bytes/sec, at 2019-04-26 20:50:16
 Last 300 second input: 0 packets/sec 21 bytes/sec 0%
 Last 300 second output: 0 packets/sec 15 bytes/sec 0%
 Input (total):  392 packets, 82860 bytes
  0 unicasts, 0 broadcasts, 392 multicasts, 0 pauses
 Input (normal):  392 packets, - bytes
  0 unicasts, 0 broadcasts, 392 multicasts, 0 pauses
 Input:  0 input errors, 0 runts, 0 giants, 0 throttles
  0 CRC, 0 frame, - overruns, 0 aborts
  - ignored, - parity errors
 Output (total): 315 packets, 70552 bytes
  0 unicasts, 0 broadcasts, 315 multicasts, 0 pauses
 Output (normal): 315 packets, - bytes
  0 unicasts, 0 broadcasts, 315 multicasts, 0 pauses
 Output: 0 output errors, - underruns, - buffer failures
  0 aborts, 0 deferred, 0 collisions, 0 late collisions
  0 lost carrier, - no carrier

Bridge-Aggregation2
Current state: DOWN
IP packet frame type: Ethernet II, hardware address: 38ad-8ed4-1944
Description: to_DL_DX_S5130_4
Bandwidth: 0 kbps
Unknown-speed mode, unknown-duplex mode
Link speed type is autonegotiation, link duplex type is autonegotiation
PVID: 1
Port link-type: Trunk
 VLAN Passing:   30, 32-33, 100
 VLAN permitted: 30, 32-33, 100
 Trunk port encapsulation: IEEE 802.1q
Last clearing of counters: Never
Last 300 seconds input:  0 packets/sec 21 bytes/sec -%
Last 300 seconds output:  0 packets/sec 17 bytes/sec -%
Input (total):  591 packets, 124990 bytes
 0 unicasts, 0 broadcasts, 591 multicasts, 0 pauses
Input (normal):  591 packets, - bytes
 0 unicasts, 0 broadcasts, 591 multicasts, 0 pauses
Input:  0 input errors, 0 runts, 0 giants, 0 throttles
 0 CRC, 0 frame, - overruns, 0 aborts
 - ignored, - parity errors
Output (total): 500 packets, 110384 bytes
 0 unicasts, 0 broadcasts, 500 multicasts, 0 pauses
Output (normal): 500 packets, - bytes
 0 unicasts, 0 broadcasts, 500 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
 0 aborts, 0 deferred, 0 collisions, 0 late collisions
 0 lost carrier, - no carrier

Aggregate Interface: Bridge-Aggregation2
Aggregation Mode: Dynamic
Loadsharing Type: Shar
Management VLAN : None
System ID: 0x8000, 38ad-8ed4-1944
Local:
  Port             Status  Priority Oper-Key  Flag
--------------------------------------------------------------------------------
  XGE1/2/1            U       32768    2         {A}
  XGE1/2/2            U       32768    2         {A}
Remote:
  Actor            Partner Priority Oper-Key  SystemID               Flag  
--------------------------------------------------------------------------------
  XGE1/2/1            377     32768    1         0x8000, 782c-293a-cdb0 {A}
  XGE1/2/2            442     32768    1         0x8000, 782c-293a-cdb0 {A}

3.debug查看两边LACP协商没有输出。

两边配置一样，但是没有正常协商，怀疑是聚合口的配置没有正常下发到物理口导致聚合失败。让现场工程师先把物理口加入聚合口，然后再在聚合口配置，让其重新下发一次，后正常协商。