HadoopSourceAnalyse --- Nodemanager Container FSM

最新推荐文章于 2022-07-04 20:41:04 发布

江山疯宇晴

最新推荐文章于 2022-07-04 20:41:04 发布

阅读量736

点赞数

本文链接：https://blog.youkuaiyun.com/woelegant/article/details/8896433

版权

source analyse 同时被 2 个专栏收录

15 篇文章

订阅专栏

hadoop

14 篇文章

订阅专栏

本文详细解析了YARN中Container的生命周期，包括初始化容器服务、加载资源、启动容器过程及状态转换等内容。深入探讨了ContainersLauncher如何使用新线程启动容器，并介绍了容器脚本和令牌的写入细节。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

overview

上图中还有一个状态变换，从killing 到 Exited_with_failure,这个变换由事件：CONTAINER_EXITED_WITH_FAILURE 触发，执行：ExitedWithFailureTransition；

INIT_CONTAINER And RESOURCE_LOCALIZED Handle

Container 收到该事件通知后，会首先偿试启动所有的和当前App 相关的 AuxServices，

 for (Map.Entry<String,ByteBuffer> service : csd.entrySet()) {
          container.dispatcher.getEventHandler().handle(
              new AuxServicesEvent(AuxServicesEventType.APPLICATION_INIT,
                  ctxt.getUser(), container.container.getId()
                      .getApplicationAttemptId().getApplicationId(),
                  service.getKey().toString(), service.getValue()));
        }

然年请求所有与当前用户及App相关的 localization resource，然后进入localizing 状态，等待系统加载Resource，当ResourceLocalizer成功加载Resource之后，会向Container发送：RESOURCE_LOCALIZED 事件:

 for (ContainerId container : rsrc.ref) {
        rsrc.dispatcher.getEventHandler().handle(
            new ContainerResourceLocalizedEvent(
              container, rsrc.rsrc, rsrc.localPath));
      }

当所有的Resource都成功加载之后，Container向 ContainersLauncher 发送一个LAUNCH_CONTAINER事件并进入Localized状态， ContainersLauncher将用一个新的线程去launche container：

 Application app =
          context.getApplications().get(
              containerId.getApplicationAttemptId().getApplicationId());

        ContainerLaunch launch = new ContainerLaunch(getConfig(), dispatcher,
            exec, app, event.getContainer(), dirsHandler);
        running.put(containerId,
            new RunningContainer(containerLauncher.submit(launch), 
                launch));

在新在线程中，先会替换所有的变量（主要是log相关），并用给定的命令生成一份本地执行的脚本文件，奖后向container 发送 LAUNCH_CONTAINER 事件，然后开始执行该脚本，线程会一直等到脚本执行结束，或被Kill掉，最后返回执行结果。

 try {
        // /// Write out the container-script in the nmPrivate space.
        List<Path> appDirs = new ArrayList<Path>(localDirs.size());
        for (String localDir : localDirs) {
          Path usersdir = new Path(localDir, ContainerLocalizer.USERCACHE);
          Path userdir = new Path(usersdir, user);
          Path appsdir = new Path(userdir, ContainerLocalizer.APPCACHE);
          appDirs.add(new Path(appsdir, appIdStr));
        }
        containerScriptOutStream =
          lfs.create(nmPrivateContainerScriptPath,
              EnumSet.of(CREATE, OVERWRITE));

        // Set the token location too.
        environment.put(
            ApplicationConstants.CONTAINER_TOKEN_FILE_ENV_NAME, 
            new Path(containerWorkDir, 
                FINAL_CONTAINER_TOKENS_FILE).toUri().getPath());

        // Sanitize the container's environment
        sanitizeEnv(environment, containerWorkDir, appDirs, localResources);
        
        // Write out the environment
        writeLaunchEnv(containerScriptOutStream, environment, localResources,
            launchContext.getCommands());
        
        // /// End of writing out container-script

        // /// Write out the container-tokens in the nmPrivate space.
        tokensOutStream =
            lfs.create(nmPrivateTokensPath, EnumSet.of(CREATE, OVERWRITE));
        Credentials creds = container.getCredentials();
        creds.writeTokenStorageToStream(tokensOutStream);
        // /// End of writing out container-tokens
      } finally {
        IOUtils.cleanup(LOG, containerScriptOutStream, tokensOutStream);
      }

发送 LAUNCH_CONAINER,并启动脚本：

      // LaunchContainer is a blocking call. We are here almost means the
      // container is launched, so send out the event.
      dispatcher.getEventHandler().handle(new ContainerEvent(
            containerID,
            ContainerEventType.CONTAINER_LAUNCHED));

      // Check if the container is signalled to be killed.
      if (!shouldLaunchContainer.compareAndSet(false, true)) {
        LOG.info("Container " + containerIdStr + " not launched as "
            + "cleanup already called");
        ret = ExitCode.TERMINATED.getExitCode();
      }
      else {
        exec.activateContainer(containerID, pidFilePath);
        ret = exec.launchContainer(container, nmPrivateContainerScriptPath,
                nmPrivateTokensPath, user, appIdStr, containerWorkDir,
                localDirs, logDirs);
      }