python sql多并发

import concurrent.futures
import urllib.request
import pandas as pd
import numpy as np
from sqlalchemy import create_engine
import pymysql
engine2 = create_engine('mysql+pymysql://root:wxl3322335@localhost:3306/my_db?charset=utf8')

SQLS = ['select * from t1',
        'select * from t2']

def run_sql(sql):
    df=pd.read_sql(sql,con=engine2)
    return df

with concurrent.futures.ThreadPoolExecutor(max_workers=None) as executor:
    future_to_sql = {executor.submit(run_sql, sql): sql for sql in SQLS}
    df3=pd.merge([df.result() for df in [future for future in concurrent.futures.as_completed(future_to_sql)]][0],
         [df.result() for df in [future for future in concurrent.futures.as_completed(future_to_sql)]][1].drop_duplicates('id'),
         how='left',on='id')
df3

 

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值