碰到一例磁盘不释放的问题

最新推荐文章于 2024-07-13 20:25:25 发布

原创最新推荐文章于 2024-07-13 20:25:25 发布 · 394 阅读

0 ·

CC 4.0 BY-SA版权

linux 专栏收录该内容

2 篇文章

订阅专栏

本文记录了一次服务器磁盘空间异常的排查过程，通过使用df-h、du-h、lsof等命令定位到sendmail程序占用大量空间的问题，并详细描述了如何通过查看sendmail进程、结束进程来解决问题的过程。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

最近在维护一台服务器时看到磁盘使用一直在变大，想想是不是又什么大文件占用，针对这个过程中碰到问题做一下记录：

df -h 命令看到磁盘快满了

Filesystem Size Used Avail Use% Mounted on
/dev/hda1 49G 45G 3G

du -h --max-depth=1 / 看了一下/目录下各个文件夹占用情况，发现加起来根本不足18G

怀疑有文件删了，但是没有释放

lsof |grep delete 然后用这个命令看到如下结果
sendmail 2152 smmsp 4uW REG 3,1 1708371968 3544598 /var/spool/clientmqueue/dfrAP0L1Td002152 (deleted)
gpm 2654 root 0u CHR 136,0 2 /dev/pts/0 (deleted)
gpm 2654 root 1u CHR 136,0 2 /dev/pts/0 (deleted)
gpm 2654 root 2u CHR 136,0 2 /dev/pts/0 (deleted)
sendmail 2844 smmsp 4uW REG 3,1 792395776 1897359 /var/spool/clientmqueue/dfs386B1Ma002844 (deleted)
sendmail 3758 smmsp 4uW REG 3,1 1770913792 3489080 /var/spool/clientmqueue/dfrAFKL1AM003758 (deleted)
sendmail 4093 smmsp 4uW REG 3,1 1830895616 3435802 /var/spool/clientmqueue/dfrA71L1Sf004093 (deleted)
sh 5028 root 255r REG 3,1 1213 2818674 /home/script/updateIP-stat.sh~ (deleted)
sendmail 5035 smmsp 4uW REG 3,1 2226159616 3269834 /var/spool/clientmqueue/dfr8A312sS005035 (deleted)
sendmail 8150 smmsp 4uW REG 3,1 300285952 3116658 /var/spool/clientmqueue/dfs5J9B1Bu008150 (deleted)
sendmail 9033 smmsp 4uW REG 3,1 136331264 3194464 /var/spool/clientmqueue/dfs6D9p1M2009033 (deleted)
sendmail 10805 smmsp 4uW REG 3,1 1770831872 3489163 /var/spool/clientmqueue/dfrAFKf1E3010805 (deleted)
sendmail 12349 smmsp 4uW REG 3,1 1784700928 3476797 /var/spool/clientmqueue/dfrADJp1Fh012349 (deleted)
sendmail 12755 smmsp 4uW REG 3,1 1771286528 3488739 /var/spool/clientmqueue/dfrAFJ11sg012755 (deleted)
sh 13006 root 255r REG 3,1 1213 2818674 /home/script/updateIP-stat.sh~ (deleted)
sendmail 13014 smmsp 4uW REG 3,1 2226069504 3269877 /var/spool/clientmqueue/dfr8A3L1ms013014 (deleted)
sendmail 15510 smmsp 4uW REG 3,1 1708687360 3544306 /var/spool/clientmqueue/dfrAONB13u015510 (deleted)
sh 18791 root 255r REG 3,1 1213 2818674 /home/script/updateIP-stat.sh~ (deleted)
sendmail 18807 smmsp 4uW REG 3,1 2226397184 3269725 /var/spool/clientmqueue/dfr8A2B1sT018807 (deleted)
sh 19279 root 255r REG 3,1 1213 2818674 /home/script/updateIP-stat.sh~ (deleted)
sendmail 19306 smmsp 4uW REG 3,1 1941708800 3337339 /var/spool/clientmqueue/dfr9LJV14J019306 (deleted)
sh 20184 root 255r REG 3,1 1213 2818674 /home/script/updateIP-stat.sh~ (deleted)
sendmail 20208 smmsp 4uW REG 3,1 1900642304 3373814 /var/spool/clientmqueue/dfr9RK11ak020208 (deleted)
sendmail 20223 smmsp 4uW REG 3,1 1708605440 3544389 /var/spool/clientmqueue/dfrAONV1no020223 (deleted)
sendmail 24180 smmsp 4uW REG 3,1 792440832 1897338 /var/spool/clientmqueue/dfs38611Ff024180 (deleted)
mysqld 25366 mysql 5u REG 3,1 0 6717442 /tmp/ib1X5rcx (deleted)
mysqld 25366 mysql 6u REG 3,1 0 6717478 /tmp/ibJ0TmEU (deleted)
mysqld 25366 mysql 7u REG 3,1 0 6717479 /tmp/ib9Z1h6h (deleted)
mysqld 25366 mysql 8u REG 3,1 0 6717480 /tmp/ibXH6xzF (deleted)
mysqld 25366 mysql 12u REG 3,1 0 6717481 /tmp/ibTt5ub3 (deleted)
sendmail 25635 smmsp 4uW REG 3,1 136671232 3194309 /var/spool/clientmqueue/dfs6D8f1Dj025635 (deleted)
sendmail 27246 smmsp 4uW REG 3,1 1643921408 3601745 /var/spool/clientmqueue/dfrB4B11pG027246 (deleted)
sendmail 28199 smmsp 4uW REG 3,1 175763456 3176114 /var/spool/clientmqueue/dfs67FB1WA028199 (deleted)
gconfd-2 30222 sunwei 13wW REG 3,1 618 7176205 /tmp/gconfd-sunwei/lock/0t1399537695ut402183u507p30222r1135107923k2269593176 (deleted)
sh 31567 root 255r REG 3,1 1213 2818674 /home/script/updateIP-stat.sh~ (deleted)
sendmail 31588 smmsp 4uW REG 3,1 1893732352 3379969 /var/spool/clientmqueue/dfr9SKL1KS031588 (deleted)
sendmail 32667 smmsp 4uW REG 3,1 1772048384 3488068 /var/spool/clientmqueue/dfrAFGL13Q032667 (deleted)

大量的 sendmail 10805 smmsp 4uW REG 3,1 1770831872 3489163 /var/spool/clientmqueue/dfrAFKf1E3010805 (deleted)

这样就可以知道是sendmail程序导致文件没有释放的

[root@h52 ~]# ps -ef|grep sendmail 看一下sendmail的进程情况
smmsp 2152 2122 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 2844 2802 0 Apr08 ? 00:00:01 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 3758 3726 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 4093 4069 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 5035 5024 0 2013 ? 00:00:04 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 8150 8120 0 Jun19 ? 00:00:00 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 9033 8990 0 Jul13 ? 00:00:00 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
root 9689 9678 0 17:25 ? 00:00:00 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
root 9906 9525 0 17:25 pts/6 00:00:00 grep sendmail
smmsp 10805 10778 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 12349 12328 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 12755 12724 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 13014 13002 0 2013 ? 00:00:04 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 15510 15473 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 18807 18787 0 2013 ? 00:00:04 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 19306 19272 0 2013 ? 00:00:04 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 20208 20180 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 20223 20207 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 24180 24139 0 Apr08 ? 00:00:01 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 25635 25605 0 Jul13 ? 00:00:00 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 27246 27213 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 28199 28169 0 Jul07 ? 00:00:00 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 31588 31560 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t
smmsp 32667 32647 0 2013 ? 00:00:03 /usr/sbin/sendmail -FCronDaemon -i -odi -oem -oi -t

大量的sendmail进程，怎么会有那么多进程呢？？？

[root@h52 ~]# service sendmail stop 那么结束掉这个sendmail进程吧，发现没，结束了2次才结束掉。。。
Shutting down sendmail: [FAILED]
[root@h52 ~]# service sendmail stop
Shutting down sendmail: [ OK ]

lsof |grep delete 最后再查一下，搞定了
gpm 2654 root 0u CHR 136,0 2 /dev/pts/0 (deleted)
gpm 2654 root 1u CHR 136,0 2 /dev/pts/0 (deleted)
gpm 2654 root 2u CHR 136,0 2 /dev/pts/0 (deleted)
mysqld 25366 mysql 5u REG 3,1 0 6717442 /tmp/ib1X5rcx (deleted)
mysqld 25366 mysql 6u REG 3,1 0 6717478 /tmp/ibJ0TmEU (deleted)
mysqld 25366 mysql 7u REG 3,1 0 6717479 /tmp/ib9Z1h6h (deleted)
mysqld 25366 mysql 8u REG 3,1 0 6717480 /tmp/ibXH6xzF (deleted)
mysqld 25366 mysql 12u REG 3,1 0 6717481 /tmp/ibTt5ub3 (deleted)

[root@h52 ~]# df -h 日志也正常了
Filesystem Size Used Avail Use% Mounted on
/dev/hda1 49G 7.4G 39G 16% /