某局点border设备S12500X AC口聚合口突然变化问题

无

原互连接口为Bridge-Aggregation5，故障时发现互连接口变成了Bridge-Aggregation4096，查看logbuffer发现同一时间Bridge-Aggregation5 down，Bridge-Aggregation4096 up，且没有人为操作。AGG5的配置丢失后，影响业务。

根据反馈的诊断和日志， 可以看出设备设备自动化进程在删除接口相关配置，并且将该端口挪到了新创建的agg4096：

%@71129%Jan 19 15:18:01:929 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is system-view

%@71130%Jan 19 15:18:02:797 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is interface Ten-GigabitEthernet1/6/0/8

%@71131%Jan 19 15:18:02:862 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is system-view

%@71132%Jan 19 15:18:02:867 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is interface Ten-GigabitEthernet1/6/0/8

%@71133%Jan 19 15:18:02:869 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo mirroring-group 1 mirroring-port

%@71134%Jan 19 15:18:02:876 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo lldp compliance admin-status cdp

%@71135%Jan 19 15:18:02:887 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo port trunk permit vlan 10 70 80 150 190 240 270 300 330 360

%@71136%Jan 19 15:18:02:948 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is port trunk permit vlan 1

%@71137%Jan 19 15:18:03:002 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo port link-type

%@71138%Jan 19 15:18:03:076 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo description

%@71139%Jan 19 15:18:03:080 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo port link-mode

%@71140%Jan 19 15:18:03:327 2022 HN-LC-SYY-2-S12508X-Border-1 IFNET/5/LINK_UPDOWN: Line protocol state on the interface Ten-GigabitEthernet1/6/0/8 changed to down.

%@71141%Jan 19 15:18:03:360 2022 HN-LC-SYY-2-S12508X-Border-1 LAGG/6/LAGG_ACTIVE: Member port XGE1/6/0/8 of aggregation group BAGG4096 changed to the active state.

%@71142%Jan 19 15:18:03:383 2022 HN-LC-SYY-2-S12508X-Border-1 IFNET/5/LINK_UPDOWN: Line protocol state on the interface Ten-GigabitEthernet1/6/0/8 changed to up.

%@71143%Jan 19 15:18:03:385 2022 HN-LC-SYY-2-S12508X-Border-1 IFNET/3/PHY_UPDOWN: Physical state on the interface Bridge-Aggregation4096 changed to up.

%@71144%Jan 19 15:18:03:385 2022 HN-LC-SYY-2-S12508X-Border-1 IFNET/5/LINK_UPDOWN: Line protocol state on the interface Bridge-Aggregation4096 changed to up.

%@71145%Jan 19 15:18:05:780 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is system-view

%@71146%Jan 19 15:18:06:678 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is interface Ten-GigabitEthernet5/6/0/8

%@71147%Jan 19 15:18:06:743 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is system-view

%@71148%Jan 19 15:18:06:748 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is interface Ten-GigabitEthernet5/6/0/8

%@71149%Jan 19 15:18:06:750 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo mirroring-group 3 mirroring-port

%@71150%Jan 19 15:18:06:758 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo lldp compliance admin-status cdp

%@71151%Jan 19 15:18:06:779 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo port trunk permit vlan 10 70 80 150 190 240 270 300 330 360

%@71152%Jan 19 15:18:06:852 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is port trunk permit vlan 1

%@71153%Jan 19 15:18:06:912 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo port link-type

%@71154%Jan 19 15:18:06:982 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo description

%@71155%Jan 19 15:18:06:986 2022 HN-LC-SYY-2-S12508X-Border-1 SHELL/6/SHELL_CMD: -Line=-IPAddr=**-User=**; Command is undo port link-mode

进一步查看配置，发现设备的自动化进程确实没有暂停：

#

 vcf-fabric role leaf

#

 vcf-fabric topology enable

#

 vcf-fabric underlay autoconfigure 545_leaf.template

#

进一步查看fabric.log可以看到，是对端防火墙sysname名称发生了变更（从HN-LC-SYY-DC-E8000E-X16-1改为了HN-LC-SYY-1-DC-E8000E-X16-1），导致设备认为拓扑发现变化，触发配置变更：

2022-01-19 15:17:58,956 base.py[line:257] DEBUG [underlay]--Notified--topology change {'data': {u'Ten-GigabitEthernet1/6/0/8': {u'add': [], u'del': [], u'mod': [{u'PeerIP': None, u'Oldrole': u'computer', u'sysName': u'HN-LC-SYY-1-DC-E8000E-X16-1', u'sysdesc': u'', u'Loopback1IP': u'0.0.0.0', u'OldsysName': u'HN-LC-SYY-DC-E8000E-X16-1', u'mac': u'602e-2048-051f', u'PeerIntf': u'GigabitEthernet1/1/1', u'role': u'computer', u'LoopbackIP': u'10.199.22.156', u'OldPeerIntf': u'GigabitEthernet1/1/1', u'OldPeerIP': None, u'OldLoopbackIP': u'10.199.22.156', u'OldLoopback1IP': u'0.0.0.0', u'Oldmac': u'602e-2048-051f', u'oldsysdesc': u''}]}}, 'event': 9} module [<underlay.allocation.updown_link.UpDownLinkIF object at 0xffe8889dd0>, <underlay.allocation.aggregation.AggrAllocation object at 0xffe8323b10>, <underlay.allocation.irf.IRFAllocation object at 0xffe8323b50>, <underlay.underlay_route.bgp object at 0xffe8323c50>]

2022-01-19 15:17:58,957 topo.py[line:87] DEBUG [topology]--Notified--topology change {'Ten-GigabitEthernet5/6/0/8': {'add': [], 'del': [], 'mod': [{'PeerIP': None, 'Oldrole': 'computer', 'sysName': 'HN-LC-SYY-1-DC-E8000E-X16-1', 'sysdesc': '', 'Loopback1IP': '0.0.0.0', 'OldsysName': 'HN-LC-SYY-DC-E8000E-X16-1', 'mac': '602e-2048-051f', 'PeerIntf': 'GigabitEthernet1/1/2', 'role': 'computer', 'LoopbackIP': '10.199.22.156', 'OldPeerIntf': 'GigabitEthernet1/1/2', 'OldPeerIP': None, 'OldLoopbackIP': '10.199.22.156', 'OldLoopback1IP': '0.0.0.0', 'Oldmac': '602e-2048-051f', 'oldsysdesc': ''}]}}

2022-01-19 15:17:58,958 base.py[line:36] DEBUG UpDownLinkIF <parse_topo_del:439>: local interface [Ten-GigabitEthernet1/6/0/8:([u'HN-LC-SYY-DC-E8000E-X16-1', u'HN-LC-SYY-DC-E8000E-X16-1'])]

2022-01-19 15:17:58,960 base.py[line:36] DEBUG UpDownLinkIF <parse_topo_add:361>: local interface [Ten-GigabitEthernet1/6/0/8:([u'HN-LC-SYY-DC-E8000E-X16-1', u'HN-LC-SYY-DC-E8000E-X16-1', u'HN-LC-SYY-1-DC-E8000E-X16-1'])]

2022-01-19 15:17:58,960 topo.py[line:87] DEBUG [topology]--Notified--topology change {'Ten-GigabitEthernet5/6/0/9': {'add': [], 'del': [], 'mod': [{'PeerIP': None, 'Oldrole': 'computer', 'sysName': 'HN-LC-SYY-1-DC-E8000E-X16-1', 'sysdesc': '', 'Loopback1IP': '0.0.0.0', 'OldsysName': 'HN-LC-SYY-DC-E8000E-X16-1', 'mac': '602e-2048-051f', 'PeerIntf': 'GigabitEthernet2/1/2', 'role': 'computer', 'LoopbackIP': '10.199.22.156', 'OldPeerIntf': 'GigabitEthernet2/1/2', 'OldPeerIP': None, 'OldLoopbackIP': '10.199.22.156', 'OldLoopback1IP': '0.0.0.0', 'Oldmac': '602e-2048-051f', 'oldsysdesc': ''}]}}

2022-01-19 15:17:58,964 topo.py[line:87] DEBUG [topology]--Notified--topology change {'Ten-GigabitEthernet1/6/0/9': {'add': [], 'del': [], 'mod': [{'PeerIP': None, 'Oldrole': 'computer', 'sysName': 'HN-LC-SYY-1-DC-E8000E-X16-1', 'sysdesc': '', 'Loopback1IP': '0.0.0.0', 'OldsysName': 'HN-LC-SYY-DC-E8000E-X16-1', 'mac': '602e-2048-051f', 'PeerIntf': 'GigabitEthernet2/1/1', 'role': 'computer', 'LoopbackIP': '10.199.22.156', 'OldPeerIntf': 'GigabitEthernet2/1/1', 'OldPeerIP': None, 'OldLoopbackIP': '10.199.22.156', 'OldLoopback1IP': '0.0.0.0', 'Oldmac': '602e-2048-051f', 'oldsysdesc': ''}]}}

2022-01-19 15:17:58,974 base.py[line:36] DEBUG AggrAllocation <process_neighbor_mod:642>: Port Ten-GigabitEthernet1/6/0/8 process neighbor {u'PeerIP': None, u'Oldrole': u'computer', u'sysName': u'HN-LC-SYY-1-DC-E8000E-X16-1', u'sysdesc': u'', u'Loopback1IP': u'0.0.0.0', u'OldsysName': u'HN-LC-SYY-DC-E8000E-X16-1', u'mac': u'602e-2048-051f', u'PeerIntf': u'GigabitEthernet1/1/1', u'role': u'computer', u'LoopbackIP': u'10.199.22.156', u'OldPeerIntf': u'GigabitEthernet1/1/1', u'OldPeerIP': None, u'OldLoopbackIP': u'10.199.22.156', u'OldLoopback1IP': u'0.0.0.0', u'Oldmac': u'602e-2048-051f', u'oldsysdesc': u''} modify

2022-01-19 15:17:58,976 base.py[line:36] DEBUG AggrAllocation <process_neighbor_del:608>: Port Ten-GigabitEthernet1/6/0/8 process neighbor {u'PeerIP': None, u'Oldrole': u'computer', u'sysName': u'HN-LC-SYY-DC-E8000E-X16-1', u'sysdesc': u'', u'Loopback1IP': u'0.0.0.0', u'OldsysName': u'HN-LC-SYY-DC-E8000E-X16-1', u'mac': u'602e-2048-051f', u'PeerIntf': u'GigabitEthernet1/1/1', u'role': u'computer', u'LoopbackIP': u'10.199.22.156', u'OldPeerIntf': u'GigabitEthernet1/1/1', u'OldPeerIP': None, u'OldLoopbackIP': u'10.199.22.156', u'OldLoopback1IP': u'0.0.0.0', u'Oldmac': u'602e-2048-051f', u'oldsysdesc': u''} delete。

综上，此种情况触发了topo变化，在这种情况下聚合模块认为接口对端更换了设备，需要加入新聚合组，此处之所以sysname作为了聚合组标识的一部分是因为对端是服务器，我们无法通过lldp获取对端的更多信息，此时只能将sysname作为唯一标识。

自动化部署完成之后需要暂停设备的自动化进程。