hadoop测试题目-每天5题,总35题,第三天

本文深入探讨了Hadoop平台中Combiner、JobTracker、TaskTracker等关键组件的功能与应用场景,详细阐述了它们在大数据处理流程中的角色与作用,特别是针对常见操作如distinct与平均值计算的使用场景,以及JobTracker与TaskTracker的主要任务,如接收任务、数据定位与任务监控。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

地址: http://www.cnblogs.com/jarlean/archive/2013/04/10/3011667.html                       

Q11. Give an example scenario where a cobiner can be used and where it cannot be used
There can be several examples following are the most common ones
- Scenario where you can use combiner
  Getting list of distinct words in a file (进行distinct操作时用combiner)
- Scenario where you cannot use a combiner
  Calculating mean of a list of numbers (计算平均值时用)
Q12. What is job tracker
Job Tracker is the service within Hadoop that runs Map Reduce jobs on the cluster (jt是运行MR作业的集群)
Q13. What are some typical functions of Job Tracker(jobtracker 的作用)
The following are some typical tasks of Job Tracker
- Accepts jobs from clients(接收客户端的任务)
- It talks to the NameNode to determine the location of the data(获取namenode返回的数据位置信息)
- It locates TaskTracker nodes with available slots at or near the data(定位于数据近的可用的tasktracker节点)
- It submits the work to the chosen Task Tracker nodes and monitors progress of each task by receiving heartbeat signals from Task tracker(将作业提交给tasktracker,接收tasktracker的heartbeat信息)
Q14. What is task tracker
Task Tracker is a node in the cluster that accepts tasks like Map, Reduce and Shuffle operations - from a JobTracker(从jobtracker接收Map,Reduce任务和进行Shuffle操作)
Q15. Whats the relationship between Jobs and Tasks in Hadoop
One job is broken down into one or many tasks in Hadoop.(job分解为1或多个task)

转载于:https://www.cnblogs.com/jarlean/archive/2013/04/10/3011667.html

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值