hadoop hbase log backup

hacker_zhb

于 2012-06-28 16:43:58 发布

阅读量107

点赞数

CC 4.0 BY-SA版权

分类专栏： hadoop 文章标签：大数据

本文链接：https://blog.youkuaiyun.com/hacker_zhb/article/details/84241183

hadoop 专栏收录该内容

32 篇文章

订阅专栏

本文提供了一个shell脚本，用于备份并清理Hadoop和HBase日志文件，仅保留最近30天的数据。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

hadoop hbase logs目录下日志越来越多，写个简单的脚本备份删除一下

#!/bin/sh
#backup hadoop&hbase logs which are 30 days ago, and delete them


cd /work/hadoop-0.20.203.0/logs

today=`date +%Y-%m-%d`
find . -mtime +30 -print > /tmp/hadooplogslist-$today

if [ -d /work/hadoop_logs_bak ]; then 
        echo "/work/hadoop_logs_bak already exists";
else
        mkdir /work/hadoop_logs_bak
fi 

tar -T /tmp/hadooplogslist-$today -zcvf /work/hadoop_logs_bak/hadoop-logs-bak-$today.tar.gz
find . -mtime +30 -exec rm -r {} \;
rm -rf /tmp/hadooplogslist-$today
echo "hadoop logs backup done"

cd /work/hbase-0.90.3/logs

find . -mtime +30 -print > /tmp/hbaselogslist-$today

if [ -d /work/hbase_logs_bak ]; then 
        echo "/work/hbase_logs_bak already exists"
else
        mkdir /work/hbase_logs_bak
fi 

tar -T /tmp/hbaselogslist-$today -zcvf /work/hbase_logs_bak/hbase-logs-bak-$today.tar.gz
find . -mtime +30 -exec rm -r {} \;
rm -rf /tmp/hbaselogslist-$today
echo "hbase logs backup done"