spark-storage模块
文章平均质量分 72
heruilong1988
喜欢动漫 排球
展开
专栏收录文章
- 默认排序
- 最新发布
- 最早发布
- 最多阅读
- 最少阅读
-
BlockManagerSlaveActor类
private[storage] class BlockManagerSlaveActor(blockManager: BlockManager) extends Actor { override def receive = { case RemoveBlock(blockId) => blockManager.removeBlock(blockId)原创 2014-05-20 16:00:15 · 948 阅读 · 0 评论 -
BlockManager
每次rdd调用iterator方法时,都先会从 final def iterator(split: Partition, context: TaskContext): Iterator[T] = { if (storageLevel != StorageLevel.NONE) { SparkEnv.get.cacheManager.getOrCom原创 2014-05-20 16:25:30 · 770 阅读 · 0 评论 -
BlockManagerMasterActor类
override def preStart() { if (!BlockManager.getDisableHeartBeatsForTesting(conf)) { import context.dispatcher timeoutCheckingTask = context.system.scheduler.schedule(0.seconds, chec原创 2014-05-20 15:56:08 · 670 阅读 · 0 评论
分享