CloudOS安装部署完成后,需要定期巡检来监测平台运行状态。
在使用df -h命令查看磁盘占用情况时,发现CloudOS根分区占用100%。
首先需要查找出空间被占满原因,使用du -sh * | grep G命令逐级查找
查看nova-conductor.log日志内容,发现有以下日志反复打印
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
b.py", line 90, in _report_state
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db service.service_ref.save()
py", line 223, in wrapper
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db return fn(self, *args, **kwargs)
ine 297, in save
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db db_service = db.service_update(self._context, self.id, updates)
in service_update
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db return IMPL.service_update(context, service_id, values)
in wrapper
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db ectxt.value = e.inner_exc
ne 220, in __exit__
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db self.force_reraise()
ne 196, in force_reraise
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db six.reraise(self.type_, self.value, self.tb)
in wrapper
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db return f(*args, **kwargs)
line 300, in wrapped
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db return f(context, *args, **kwargs)
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db File "/usr/lib64/python2.7/contextlib.py", line 24, in __exit__
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db self.gen.next()
cade.py", line 760, in _transaction_scope
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db yield resource
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db File "/usr/lib64/python2.7/contextlib.py", line 24, in __exit__
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db self.gen.next()
cade.py", line 495, in _session
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db self._end_session_transaction(self.session)
cade.py", line 516, in _end_session_transaction
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db session.commit()
", line 813, in commit
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db self.transaction.commit()
", line 392, in commit
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db self._prepare_impl()
", line 372, in _prepare_impl
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db self.session.flush()
", line 2027, in flush
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db self._flush(objects)
", line 2145, in _flush
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db transaction.rollback(_capture_exception=True)
rs.py", line 60, in __exit__
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db compat.reraise(exc_type, exc_value, exc_tb)
", line 2109, in _flush
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db flush_context.execute()
.py", line 373, in execute
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db rec.execute(self)
.py", line 532, in execute
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db uow
e.py", line 170, in save_obj
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db mapper, table, update)
e.py", line 728, in _emit_update_statements
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db (table.description, len(records), rows))
ate 1 row(s); 2 were matched.
2018-05-21 12:05:20.273 1260 ERROR nova.servicegroup.drivers.db
异常增长导致根分区被占满
1、首先通过echo>nova-conductor.log命令清空日志内容;
2、需要联系研发来具体分析日志异常增长的原因,这个问题是由于数据库nova-conductor ID与其它冲突导致,研发修改nova-conductor ID后已不再打印异常日志。
该案例暂时没有网友评论
✖
案例意见反馈
亲~登录后才可以操作哦!
确定你的邮箱还未认证,请认证邮箱或绑定手机后进行当前操作