Spark源码之Executor线程池

最新推荐文章于 2025-09-22 20:46:11 发布

原创最新推荐文章于 2025-09-22 20:46:11 发布 · 1k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#spark

Spark 专栏收录该内容

7 篇文章

订阅专栏

本文深入探讨了Java中Executor线程池的实现细节，包括如何使用ThreadFactory自定义线程名称，以及通过UninterruptibleThread避免任务因中断而挂起的问题。文章提供了具体的代码示例，展示了如何创建和配置一个高性能的线程池。

1：Executor线程池

  // Start worker thread pool
  private val threadPool = {
    val threadFactory = new ThreadFactoryBuilder()
      .setDaemon(true)
      .setNameFormat("Executor task launch worker-%d")
      .setThreadFactory(new ThreadFactory {
        override def newThread(r: Runnable): Thread =
          // Use UninterruptibleThread to run tasks so that we can allow running codes without being
          // interrupted by `Thread.interrupt()`. Some issues, such as KAFKA-1894, HADOOP-10622,
          // will hang forever if some methods are interrupted.
          new UninterruptibleThread(r, "unused") // thread name will be set by ThreadFactoryBuilder
      })
      .build()
    Executors.newCachedThreadPool(threadFactory).asInstanceOf[ThreadPoolExecutor]
  }