组网及说明
该功能支持3PAR全系列产品，3.2.2 版本以上。
问题描述
经常遇到客户反映存储性能在某个时间段发生卡顿现象。如果现场去收集的日志实时数据是无法分析历史性能数据。所以提供一个方法去收集历史性能数据。
过程分析
如何收集3PAR性能数据
先检查一下版本：下面以3.3.1版本为例
ss8400b cli% showversion
Release version 3.3.1 (MU3)
Patches: P58,P77,P78,P81
执行controlsr export -sqlite 命令将需要分析的时间段性能数据从sqlite数据库导出成文本格式
ss8400b cli% controlsr export -sqlite -hires -btsecs "2019-07-10 09:00:00" -etsecs "2019-07-13 09:00:00"
Task 21541 started
ss8400b cli%
-hires >>>>> 每五分钟采样一次，system reporter 存放到 sqlite 数据库最小采样周期为每五分钟采样，手动方式可以每秒采样；
-btsecs >>>> 起始时间
-etsecs >>>> 截止时间
上面的输出就是将 2019年7月10号上午9点到 2019年7月13号上午9点之间的每五分钟采样的性能数据从 sqlite 数据库导出。
ss8400b cli% showtask -d 21541 >>>> 查看进程详细信息：
Id Type Name Status Phase Step -------StartTime------- ------FinishTime------- -Priority- -User--
21541 background_command controlsr_export done --- --- 2019-07-13 11:59:21 CST 2019-07-13 11:59:25 CST n/a 3paradm
Detailed status:
2019-07-13 11:59:21 CST Created task.
2019-07-13 11:59:21 CST Updated Executing "controlsr_export" as 1:45712
2019-07-13 11:59:21 CST Updated Starting SR export Phase 1. -btsecs 1562720400 -etsecs 1562979600 -sqlite -hires -tid 21541 -file_name /common/srdata_export/exportsr_hires_1690216_20190713_115909_CST_sqlite.tbz
2019-07-13 11:59:21 CST Updated export ldspace: 32006 records in 0 seconds
2019-07-13 11:59:21 CST Updated export pdspace: 17300 records in 0 seconds
2019-07-13 11:59:21 CST Updated export sysspace: 7785 records in 0 seconds
2019-07-13 11:59:21 CST Updated export cpgspace: 6920 records in 0 seconds
2019-07-13 11:59:21 CST Updated export setmembership: 5 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statcache: 1730 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statcmp: 1730 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statcpu: 31140 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statfsav: 1730 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statfsblock: 5190 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statfscpu: 10380 records in 1 second
2019-07-13 11:59:21 CST Updated export statfsfpg: 865 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statfshttp: 1730 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statfsmem: 1730 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statfsnet: 3460 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statfsnfs: 1730 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statfssmb: 1730 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statfssnapshot: 865 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statiscsi: 0 records in 0 seconds
2019-07-13 11:59:21 CST Updated export statiscsisession: 0 records in 0 seconds
2019-07-13 11:59:22 CST Updated export statld: 32005 records in 0 seconds
2019-07-13 11:59:22 CST Updated export statlink: 6920 records in 0 seconds
2019-07-13 11:59:22 CST Updated export statpd: 34600 records in 0 seconds
2019-07-13 11:59:22 CST Updated export statport: 17300 records in 1 second
2019-07-13 11:59:22 CST Updated export statqos: 0 records in 0 seconds
2019-07-13 11:59:22 CST Updated export statrcopy: 3460 records in 0 seconds
2019-07-13 11:59:22 CST Updated export statrcvv: 1730 records in 0 seconds
2019-07-13 11:59:22 CST Updated export statvlun: 0 records in 0 seconds
2019-07-13 11:59:22 CST Updated export statvv: 12975 records in 0 seconds
2019-07-13 11:59:22 CST Updated export statvvcmp: 0 records in 0 seconds
2019-07-13 11:59:23 CST Updated export vvspace: 13840 records in 0 seconds
2019-07-13 11:59:23 CST Updated exported hires: 250856 records exported in 2 seconds
2019-07-13 11:59:23 CST Updated Phase 2. Estimated export file size: 7.756 MB
2019-07-13 11:59:23 CST Updated Compressing files into exportsr_hires_1690216_20190713_115909_CST_sqlite.tbz
2019-07-13 11:59:25 CST Updated Tar complete. Total 2.870 MB
2019-07-13 11:59:25 CST Updated Starting sendhome: type SRData node 1 file /common/srdata_export/exportsr_hires_1690216_20190713_115909_CST_sqlite.tbz
2019-07-13 11:59:25 CST Completed scheduled task.
ss8400b cli%
登录到连接这台3PAR的SP的 root 账号
The programs included with the HPE Linux system are free software; the
exact license terms for each program are described in the individual
files in /usr/share/doc/*/copyright.
HPE Linux comes with ABSOLUTELY NO WARRANTY, to the extent permitted by
applicable law.
Last login: Sat Jul 13 19:52:14 2019 from 10.12.176.236
hpesupport@SP0001690216:~$ su -
Password:
root@SP0001690216:~#
然后连到3PAR的 root 账号
hpesupport@SP0001690216:~$ su -
Password:
root@SP0001690216:~# ls
home installinfo
root@SP0001690216:~# cd /sp
root@SP0001690216:/sp# ls
AgentXfer AxedaHome bin conf credvault data db home lib lost+found sbin scripts SPxfer tmp var
root@SP0001690216:/sp# cd home
root@SP0001690216:/sp/home# ls
hpesupport
root@SP0001690216:/sp/home# cd hpesupport
root@SP0001690216:/sp/home/hpesupport# ls -al
total 1137612
drwxr-xr-x 3 hpesupport csst 4096 Jun 24 09:39 .
drwxr-xr-x 3 root root 4096 Aug 17 2018 ..
drwx------ 2 hpesupport csst 4096 Jul 11 18:09 .ssh
-rw-r--r-- 1 hpesupport csst 1163345920 May 29 10:47 tpdpackage.latest
root@SP0001690216:/sp/home/hpesupport# cd .ssh
root@SP0001690216:/sp/home/hpesupport/.ssh# ls
1690216 1690216.pub known_hosts
root@SP0001690216:/sp/home/hpesupport/.ssh# ssh -i 1690216 root@xx.xx.xx.xx
root@xx.xx.xx.xx"s password:
Last login: Wed Jul 3 08:58:52 2019 from 10.12.175.239
Sat Jul 13 12:12:51 CST 2019
root@1690216-1 Sat Jul 13 12:12:51:~#
检查性能日志是放在哪个节点上 ： 从下面输出可以看到是存放在节点1上，
root@1690216-1 Sat Jul 13 12:12:51:~# onallnodes ls /common/sr*
Node 0:
exportsr_hires_1690216_20190530_164110_CST_spcollect.tbz
hires
Node 1:
exportsr_hires_1690216_20190713_115909_CST_sqlite.tbz
exportsr_sysinfo_1690216_20190713_115909_CST.txt
hires
root@1690216-1 Sat Jul 13 12:14:58:~#
root@1690216-1 Sat Jul 13 12:14:58:~# cd /common/
root@1690216-1 Sat Jul 13 12:16:43:/common/srdata_export# ls -al
total 2960
drwxr-xr-x 3 root root 4096 Jul 13 11:59 .
drwxr-xr-x 27 root root 4096 Jul 13 11:59 ..
-rw-r--r-- 1 root root 3009514 Jul 13 11:59 exportsr_hires_1690216_20190713_115909_CST_sqlite.tbz
-rw-r--r-- 1 root root 562 Jul 13 11:59 exportsr_sysinfo_1690216_20190713_115909_CST.txt
drwxr-xr-x 2 root root 4096 Jul 13 11:59 hires
root@1690216-1 Sat Jul 13 12:16:46:/common/srdata_export#
找到文件后，将文件通过 SCP 方式导出到一台 FTP 服务器。
root@1690216-1 Sat Jul 13 12:16:46:/common/srdata_export# scp * root@10.12.173.232:/tmp/.
The authenticity of host "10.12.173.232 (10.12.173.232)" can"t be established.
RSA key fingerprint is SHA256:VkOZisRAUslg42KW28InE8zYl6IHNqzVKhS34jIb5nc.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added "10.12.173.232" (RSA) to the list of known hosts.
root@10.12.173.232"s password:
exportsr_hires_1690216_20190713_115909_CST_sqlite.tbz 100% 2939KB 419.8KB/s 00:07
exportsr_sysinfo_1690216_20190713_115909_CST.txt 100% 562 1.1MB/s 00:00
hires: not a regular file
root@1690216-1 Sat Jul 13 12:18:27:/common/srdata_export#
然后再将文件收集下来，升级上来。
解决方法
我们通过controlsr工具对收集回来的历史性能数据分析性能问题。
该案例暂时没有网友评论
编辑评论
✖
案例意见反馈
亲~登录后才可以操作哦!
确定你的邮箱还未认证，请认证邮箱或绑定手机后进行当前操作