python asyncio wait和gather

最新推荐文章于 2025-06-26 22:26:34 发布

转载最新推荐文章于 2025-06-26 22:26:34 发布 · 499 阅读

0 ·

CC 4.0 BY-SA版权

原文链接：http://www.cnblogs.com/callyblog/p/11217158.html

文章标签：

#python

本文通过实例对比了Python中asyncio模块下wait与gather两种异步处理方式的特点及使用场景。详细介绍了如何利用这两种方法来优化多任务处理流程，包括任务的分组、取消以及异常处理等关键操作。

1. wait, 等待某某执行完成以后才执行下一步

FIRST_COMPLETED = concurrent.futures.FIRST_COMPLETED
FIRST_EXCEPTION = concurrent.futures.FIRST_EXCEPTION
ALL_COMPLETED = concurrent.futures.ALL_COMPLETED

import asyncio
import time
async def get_html(term):
    print("start get url")
    await asyncio.sleep(term)
    print("end get url")

if __name__ == '__main__':
    group1 = [get_html(i) for i in range(10)]
    loop = asyncio.get_event_loop()
    import concurrent.futures
    loop.run_until_complete(asyncio.wait(group1, return_when=concurrent.futures.FIRST_COMPLETED))
    print(1)

2. gather 比wait更加高级，可以将任务分组，并且取消掉，取消时，必须设置 return_exception为True，不然会抛异常

import asyncio
import time
async def get_html(url):
    print("start get url")
    await asyncio.sleep(2)
    print("end get url")

if __name__ == "__main__":
    start_time = time.time()
    loop = asyncio.get_event_loop()
    #gather和wait的区别
    #gather更加high-level
    group1 = [get_html("http://projectsedu.com") for i in range(2)] # 分组
    group2 = [get_html("http://www.imooc.com") for i in range(2)]
    group1 = asyncio.gather(*group1)
    group2 = asyncio.gather(*group2)
    group2.cancel()
    loop.run_until_complete(asyncio.gather(group1, group2, return_exceptions=True))
    print(time.time() - start_time)