CPU utilization in 5 secs: 51.8%; 1 min: 48.0%; 5 mins: 42.4%
JID 5Sec 1Min 5Min Name
1 1.5% 0.0% 0.0% scmd
2 0.0% 0.0% 0.0% [kthreadd]
3 0.0% 0.0% 0.0% [migration/0]
4 0.0% 0.0% 0.0% [ksoftirqd/0]
5 0.0% 0.0% 0.0% [watchdog/0]
6 0.0% 0.0% 0.0% [migration/1]
7 0.0% 0.0% 0.0% [ksoftirqd/1]
8 0.0% 0.0% 0.0% [watchdog/1]
9 0.0% 0.0% 0.0% [events/0]
10 0.0% 0.0% 0.0% [events/1]
11 0.0% 0.0% 0.0% [khelper]
12 0.0% 0.0% 0.0% [kblockd/0]
13 0.0% 0.0% 0.0% [kblockd/1]
14 0.0% 0.0% 0.0% [ata/0]
15 0.0% 0.0% 0.0% [ata/1]
16 0.0% 0.0% 0.0% [ata_aux]
17 0.0% 0.0% 0.0% [khubd]
18 0.0% 0.0% 0.0% [kseriod]
19 0.0% 0.0% 0.0% [vzmond]
20 0.0% 0.0% 0.0% [pdflush]
21 0.0% 0.0% 0.0% [pdflush]
22 0.0% 0.0% 0.0% [kswapd0]
23 0.0% 0.0% 0.0% [aio/0]
24 0.0% 0.0% 0.0% [aio/1]
25 0.0% 0.0% 0.0% [mtdblockd]
54 8.7% 17.4% 19.9% [TMTH]
55 0.0% 0.0% 0.0% [dGDB]
56 0.0% 0.0% 0.0% [DSTK]
57 0.0% 0.0% 0.0% [DST2]
58 0.0% 0.0% 0.0% [DST3]
59 0.0% 0.0% 0.0% [TSTK]
60 0.0% 0.0% 0.0% [SOFT]
63 0.0% 0.0% 0.0% [DrvD]
64 0.0% 0.0% 0.0% [DSYN]
65 0.0% 0.0% 0.0% [DIPC]
66 0.0% 0.0% 0.0% [TXAT]
67 0.0% 0.0% 0.0% [DVP]
68 0.0% 0.0% 0.0% [DDEV]
69 0.0% 0.0% 0.0% [DTIM]
74 0.0% 0.1% 0.0% [IntTask]
75 0.0% 0.0% 0.0% [evHndl_0]
76 0.0% 0.0% 0.0% [evHndl_1]
77 0.0% 0.0% 0.0% [evHndl_2]
78 0.7% 0.6% 0.0% [evHndl_3]
79 0.0% 0.0% 0.0% [evHndl_4]
80 0.0% 0.0% 0.0% [evHndl_5]
81 0.3% 0.6% 0.4% [evHndl_6]
82 0.3% 0.3% 0.3% [evHndl_9]
83 0.7% 0.6% 0.5% [portTune]
85 0.0% 0.0% 0.0% [DQIT]
86 0.0% 0.0% 0.0% [PIEE]
87 0.0% 0.1% 0.1% [STAT]
88 0.0% 0.0% 0.0% [D_MI]
89 0.0% 0.0% 0.0% [BUF_]
90 0.9% 0.9% 0.8% [FMCK]
91 0.0% 0.0% 0.0% [dPOE]
92 0.0% 0.0% 0.0% [DRMR]
93 0.0% 0.0% 0.0% [DRPN]
94 0.0% 0.0% 0.0% [T_DM]
95 0.0% 0.0% 0.0% [mIPC]
96 0.0% 0.0% 0.0% [TMCS]
97 0.0% 0.0% 0.0% [NAEvHndl]
98 0.0% 0.0% 0.0% [TMCC]
99 0.0% 0.0% 0.0% [DARP]
100 0.0% 0.0% 0.0% [T_ST]
101 0.0% 0.0% 0.0% [TMCN]
102 0.0% 0.0% 0.0% [T_SI]
103 0.0% 0.0% 0.0% [IPSG]
104 0.0% 0.0% 0.0% [TL3P]
105 0.0% 0.0% 0.0% [MRFS]
106 0.0% 0.0% 0.0% [IPMC]
107 0.0% 0.0% 0.0% [TRFS]
108 0.0% 0.0% 0.0% [TVIR]
109 0.0% 0.0% 0.0% [T_PS]
110 0.0% 0.0% 0.0% [VX_R]
111 0.0% 0.0% 0.0% [VX_M]
112 0.0% 0.0% 0.0% [TVLR]
113 0.0% 0.0% 0.0% [OAM_]
114 0.0% 0.0% 0.0% [SCAR]
115 0.0% 0.0% 0.0% [TxQ/0]
116 0.0% 0.0% 0.0% [TxQ/1]
117 0.0% 0.0% 0.0% [TxQ/2]
118 0.0% 0.0% 0.0% [TxQ/3]
119 0.0% 0.0% 0.0% [TxQ/4]
120 0.1% 0.1% 0.0% [TxQ/5]
121 0.0% 0.0% 0.0% [TxQ/6]
122 0.0% 0.0% 0.0% [TxQ/7]
123 0.6% 0.5% 0.3% [TxF/7]
124 0.0% 0.0% 0.0% [tunn]
125 0.0% 0.0% 0.0% [D_UN]
126 0.0% 0.0% 0.0% [RSF0]
127 0.0% 0.0% 0.0% [PROQ]
128 0.0% 0.0% 0.0% [DRSM]
129 0.0% 0.0% 0.0% [ICM1]
130 0.0% 0.0% 0.0% [ICM2]
131 0.0% 0.0% 0.0% [tEXP]
133 1.1% 1.1% 1.0% [PMOT]
136 0.0% 0.0% 0.0% [lipc_topology]
150 0.0% 0.0% 0.0% [LOAD]
151 0.0% 0.0% 0.0% [LOADProc]
152 0.0% 0.0% 0.0% [kdlipc]
153 0.0% 0.0% 0.0% [krpc_event]
154 0.0% 0.0% 0.0% [krpc_serv]
157 0.0% 0.1% 0.1% [STM_Main]
158 0.0% 0.0% 0.0% [hellopkt]
159 0.0% 0.0% 0.0% [timesyncs]
160 0.0% 0.0% 0.0% [lipc_portevt]
161 0.3% 0.1% 0.1% [kevent]
162 1.9% 1.7% 1.4% [kifupdown]
163 0.0% 0.0% 0.0% [kifbufmon]
164 0.0% 0.0% 0.0% [kiftcb]
165 0.0% 0.0% 0.0% [kifmethlinkup]
166 0.0% 0.0% 0.0% [1LED]
167 0.0% 0.0% 0.0% [DRVR]
168 0.0% 0.0% 0.0% [OPTK]
169 0.0% 0.0% 0.0% [kmac/1]
170 0.0% 0.0% 0.0% [kipfs/1]
171 0.0% 0.0% 0.0% [kip6fs/1]
172 0.0% 0.0% 0.0% [kepa]
173 0.0% 0.0% 0.0% [mbuf_main]
174 0.0% 0.0% 0.0% [rlink/1]
177 0.0% 0.0% 0.0% [sock/1]
178 0.0% 0.0% 0.0% [knqa/1/0]
179 0.0% 0.0% 0.0% [knqa/1/1]
182 0.0% 0.0% 0.0% [UBTM]
186 0.0% 0.0% 0.0% cioctld
187 0.0% 0.0% 0.0% fsd
189 0.0% 0.0% 0.0% licd
190 2.7% 2.0% 1.6% dbmd
193 0.0% 0.0% 0.0% resmond
194 9.2% 1.2% 1.0% diagd
196 0.0% 0.0% 0.0% had
197 3.7% 3.2% 2.8% syslogd
198 0.3% 0.5% 0.3% devd
199 0.0% 0.0% 0.0% licsynd
200 0.0% 0.0% 0.0% cryptomgrd
202 0.0% 0.0% 0.0% licxcvrd
206 1.9% 3.7% 1.3% ifmgr
207 0.0% 0.0% 0.0% edev
222 0.0% 0.0% 0.0% [GMpt]
223 1.1% 1.0% 0.8% vbrd
225 0.0% 0.0% 0.0% evbd
237 0.7% 0.3% 0.3% ifmond
239 0.0% 0.0% 0.0% clcpd
242 0.0% 0.0% 0.0% drvplatd
244 0.0% 0.0% 0.0% comsh
245 0.0% 0.0% 0.0% sysmand
246 0.0% 0.0% 0.0% lauthd
247 0.0% 0.0% 0.0% ttymgrd
248 0.0% 0.0% 0.0% aaad
249 0.0% 0.0% 0.0% cfad
250 3.6% 3.1% 2.5% laggd
251 0.0% 0.0% 0.0% tranged
252 0.0% 0.0% 0.0% vland
253 0.0% 0.0% 0.0% httpredrd
263 0.0% 0.0% 0.0% taed
303 0.0% 0.0% 0.0% aclmgrd
322 0.4% 0.3% 0.2% qosd
371 0.0% 0.0% 0.0% ethd
372 0.0% 0.0% 0.0% coppd
377 0.0% 0.0% 0.0% wsald
378 0.0% 0.0% 0.0% xmlcfgd
383 0.3% 0.5% 0.4% bfdd
384 0.0% 0.0% 0.0% dhcpd
385 0.0% 0.0% 0.0% dhcpcd
386 0.0% 0.0% 0.0% dhcpc6d
387 0.0% 0.0% 0.0% dnsd
388 0.0% 0.0% 0.0% ip6stackd
389 0.0% 0.0% 0.0% ipcimd
390 0.0% 0.0% 0.0% ipstackd
391 0.0% 0.0% 0.0% l3vpnd
393 4.1% 2.5% 2.2% lldpd
394 0.1% 0.1% 0.0% ospfd
395 0.0% 0.0% 0.0% routed
396 0.0% 0.0% 0.0% routed
397 0.0% 0.0% 0.0% sshd
398 0.6% 0.5% 0.4% stpd
399 0.0% 0.0% 0.0% telnetd
401 0.0% 0.0% 0.0% [kbfd/1]
414 0.0% 0.0% 0.0% [kND/1]
416 0.0% 0.0% 0.0% staticrtd
417 0.0% 0.0% 0.0% staticrtd
418 0.0% 0.0% 0.0% [kwadj6/1]
419 0.0% 0.0% 0.0% [kfib/1]
424 0.0% 0.0% 0.0% [karp/1]
425 0.0% 0.0% 0.0% [kwadj/1]
431 0.0% 0.0% 0.0% [loop0]
433 0.0% 0.0% 0.0% [loop1]
435 0.0% 0.0% 0.0% [loop2]
437 0.0% 0.0% 0.0% [loop3]
439 0.0% 0.0% 0.0% [loop4]
441 0.0% 0.0% 0.0% [loop5]
443 0.0% 0.0% 0.0% [loop6]
445 0.0% 0.0% 0.0% [loop7]
447 0.0% 0.0% 0.0% [loop8]
449 0.0% 0.0% 0.0% [loop9]
451 0.0% 0.0% 0.0% [loop10]
453 0.0% 0.0% 0.0% [loop11]
455 0.0% 0.0% 0.0% [loop12]
458 0.0% 0.0% 0.0% [loop13]
460 0.0% 0.0% 0.0% [loop14]
462 0.0% 0.0% 0.0% [loop15]
464 0.0% 0.0% 0.0% [loop16]
466 0.0% 0.0% 0.0% [loop17]
468 0.0% 0.0% 0.0% [loop18]
470 0.0% 0.0% 0.0% [loop19]
472 0.0% 0.0% 0.0% [loop20]
474 0.0% 0.0% 0.0% [loop21]
476 0.0% 0.0% 0.0% [loop22]
478 0.0% 0.0% 0.0% [loop23]
480 0.0% 0.0% 0.0% [loop24]
482 0.0% 0.0% 0.0% [loop25]
484 0.0% 0.0% 0.0% [loop26]
486 0.0% 0.0% 0.0% [loop27]
488 0.0% 0.0% 0.0% [loop28]
490 0.0% 0.0% 0.0% [loop29]
492 0.0% 0.0% 0.0% [loop30]
494 0.0% 0.0% 0.0% [loop31]
496 0.0% 0.0% 0.0% [loop32]
498 0.0% 0.0% 0.0% [loop33]
500 0.0% 0.0% 0.0% [loop34]
502 0.0% 0.0% 0.0% [loop35]
504 0.0% 0.0% 0.0% [loop36]
506 0.0% 0.0% 0.0% [loop37]
508 0.0% 0.0% 0.0% [loop38]
510 0.0% 0.0% 0.0% [loop39]
512 0.0% 0.0% 0.0% [loop40]
514 0.0% 0.0% 0.0% [loop41]
516 0.0% 0.0% 0.0% [loop42]
518 0.0% 0.0% 0.0% [loop43]
520 0.0% 0.0% 0.0% [loop44]
522 0.0% 0.0% 0.0% [loop45]
524 0.0% 0.0% 0.0% [loop46]
526 0.0% 0.0% 0.0% [loop47]
528 0.0% 0.0% 0.0% [loop48]
530 0.0% 0.0% 0.0% [loop49]
532 0.0% 0.0% 0.0% [loop50]
534 0.0% 0.0% 0.0% [loop51]
536 0.0% 0.0% 0.0% [loop52]
538 0.0% 0.0% 0.0% [loop53]
540 0.0% 0.0% 0.0% [loop54]
542 0.0% 0.0% 0.0% [loop55]
545 0.0% 0.0% 0.0% [loop56]
547 0.0% 0.0% 0.0% [loop57]
549 0.0% 0.0% 0.0% [loop58]
551 0.0% 0.0% 0.0% [loop59]
556 0.0% 0.0% 0.0% [loop60]
558 0.0% 0.0% 0.0% [loop61]
560 0.0% 0.0% 0.0% [loop62]
562 0.0% 0.0% 0.0% [loop63]
565 0.0% 0.0% 0.0% [loop64]
567 0.0% 0.0% 0.0% [loop65]
569 0.0% 0.0% 0.0% [loop66]
571 0.0% 0.0% 0.0% [loop67]
573 0.0% 0.0% 0.0% [loop68]
575 0.0% 0.0% 0.0% [loop69]
577 0.0% 0.0% 0.0% [loop70]
579 0.0% 0.0% 0.0% [loop71]
581 0.0% 0.0% 0.0% [loop72]
583 0.0% 0.0% 0.0% [loop73]
612 0.0% 0.0% 0.0% [GMAC]
613 0.0% 0.0% 0.0% [krpc0_2_20131]
810 0.0% 0.0% 0.0% [krpc0_2_28878]
7076 1.8% 2.1% 0.7% sshd
7078 0.0% 0.0% 0.0% login
7081 0.0% 0.0% 0.0% comshc
7082 0.0% 0.0% 0.1% comsh
7097 0.1% 0.0% 0.0% comsh
7099 1.7% 0.9% 0.2% comsh
3、后续又让现场在主设备收集了一次dis process cpu信息,发现还是TMTH进程占用很多。
CPU utilization in 5 secs: 41.5%; 1 min: 41.2%; 5 mins: 40.5%
JID 5Sec 1Min 5Min Name
54 21.7% 19.0% 19.4% [TMTH]
4、找到了问题所在,就是TMTH进程占用过高导致的。TMTH进程是端口训练进程,如果接口接了网线或者光模块但是对端没有接设备,设备会不断训练端口让其up。让现场排查下是否有将插入模块和网线但是未接终端的接口情况,如果有将这些端口手动shutdown之后再看下cpu。排查后发现确实是有端口接线但是未接终端的情况。