工作纪实45-记一段多线程批处理的代码

LeoGoGoGoo

已于 2024-03-05 19:27:09 修改

阅读量166

点赞数 3

CC 4.0 BY-SA版权

分类专栏：工作纪实 java技术专栏文章标签： java

于 2024-02-29 13:49:38 首次发布

本文链接：https://blog.youkuaiyun.com/u013553309/article/details/136369155

数据很多，多线程分批处理

@Slf4j
public class ThreadPoolUtils {
   
   
	public static <R> List<R> batchExecute(String taskName, List<?> originList, Function<List<?>, Callable<R>> supplier) {
   
   
        // 多线程批处理
        int batchSize = ContentFeedpostConfig.batchZPCreativeLimit;
        List<? extends List<?>> partition = Lists.partition(originList, batchSize);
        CompletionService<R> completionService = new ExecutorCompletionService<>(ThreadPoolUtils.getPreparePoolExecutor());
        List<Future<R>> futureList = Lists.newArrayListWithCapacity(4);
        for (List<?> list : partition) {
   
   
            Callable<R> apply = supplier.apply(list);
            futureList.add(completionService.submit(apply));
        }
        List<R> result = Lists.newArrayListWithCapacity(4);
        for (int n = 0; n < futureList.size(); n++) {
   
   
            try {
   
   
                Future<R> future = completionService.poll(10, TimeUnit.MILLISECONDS);
                if (future != null) {
   
   
                    R r = future.get(