hadoop yarn 获取日志,Hadoop在哪里存储YARN应用程序的日志？

张志城

于 2021-01-17 17:05:02 发布

阅读量169

点赞数

文章标签： hadoop yarn 获取日志

本文解答了如何找到Hadoop YARN中非MapReduce任务的日志文件。通常这些日志位于由yarn.nodemanager.log-dirs配置项指定的目录下，每个应用的日志会存放在以应用ID为名的子目录中，而各容器的日志则进一步按容器ID组织。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

I run the basic example of Hortonworks' yarn application example. The application fails and I want to read the logs to figure out why. But I can't find any files at the expected location (/HADOOP_INSTALL_FOLDER/logs) where the logs of my mapreduce jobs are stored.

Does anybody know where yarn stores the non-mapreduce log files? Do I have to configure a special directory in the xml files?

解决方案

The container logs should be under yarn.nodemanager.log-dirs:

Where to store container logs. An application's localized log directory will be found in ${yarn.nodemanager.log-dirs}/application_${appid}. Individual containers' log directories will be below this, in directories named container_{$contid}. Each container directory will contain the files stderr, stdin, and syslog generated by that container.