TaskTracker节点心跳监控配置

本文介绍如何通过配置Hadoop的TaskTracker来周期性执行脚本以检查节点健康状态。当脚本输出含有“ERROR”时,节点会被标记为不健康,JobTracker会将其列入黑名单并停止分配新任务。文章详细解释了相关配置项及其作用。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

1. 可以配置TaskTracker,让其周期性的执行脚本以报告其自身的"healthy or not".

     (1)TaskTracker周期性的执行脚本,检查输出是否含有“ERROR”,若是,该节点的状态被报告为"unhealthy",JobTracker将该TaskTracker节点设为black-listed,并且不再会给该节点分配任务。

     (2) TaskTracker将继续周期性执行该脚本,直到该节点变为恢复"healthy",其将从JobTracker的black-listed中删除。

     (3)Admin可以从JobTracker的Web接口查看TaskTracker节点的状态(healthy or unhealthy)。


2. 配置:conf/mapred-site.xml

         

<property>
                <name>mapreduce.tasktracker.healthchecker.script.path</name>
                <value>/home/hadoop/program/hadoop-0.21.0/*****</value>
                <description>Absolute path to the script which is periodically run by the TaskTracker to determine if the node is healthy or not. The file should be executable by the TaskTracker. If the value of this key is empty or the file does not exist or is not executable, node health monitoring is not started</description>
</property>


<property>
                <name>mapreduce.tasktracker.healthchecker.interval</name>
                <value>10000</value>
                <description>Frequency at which the node health script is run, in milliseconds</description>
</property>

<property>
                <name>mapreduce.tasktracker.healthchecker.script.timeout</name>
                <value>***</value>
                <description>Time after which the node health script will be killed by the TaskTracker if unresponsive. The node is marked unhealthy. if node health script times out.</description>
</property>

<property>
                <name>mapreduce.tasktracker.healthchecker.script.args</name>
                <value> ,  , </value>
                <description>Extra arguments that can be passed to the node health script when launched. These should be comma separated list of arguments. </description>
</property>

     

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值