Hadoop Yarn core concepts

最新推荐文章于 2025-08-23 23:02:37 发布

weixin_30515513

最新推荐文章于 2025-08-23 23:02:37 发布

阅读量55

点赞数

CC 4.0 BY-SA版权

文章标签：大数据开发工具

原文链接：http://www.cnblogs.com/huaxiaoyao/p/4452373.html

本文介绍了YARN的基本概念，阐述了其通过将资源管理和作业调度/监控职责分离来提高效率的设计理念。具体而言，YARN引入了ResourceManager进行全局资源管理，并为每个应用分配一个ApplicationMaster负责具体的任务调度和监控。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

The fundamental idea of YARN is to split the two major responsibilities of the JobTracker—that is, resource management and job scheduling/monitoring—into separate

daemons: a global ResourceManager and a per-application ApplicationMaster (AM).

The ResourceManager and per-node slave, the NodeManager (NM), form the new,

and generic,operating system for managing applications in a distributed manner.

The NodeManager is the per-machine slave, which is responsible for launching the

applications' containers, monitoring their resource usage (CPU, memory, disk, network), and reporting the same to the ResourceManager.

The ApplicationMaster is, in effect, an instanceof a framework-specific libraryand is responsible for negotiating resources from the ResourceManager and working with the NodeManager(s) to

execute and monitor the containers and their resource consumption. It has the responsibility of negotiating for appropriate resource containers from the ResourceManager,

tracking their status, and monitoring progress.