pandas读取 bigquery

最新推荐文章于 2025-01-16 12:23:57 发布

luoganttcc

最新推荐文章于 2025-01-16 12:23:57 发布

阅读量724

点赞数

CC 4.0 BY-SA版权

分类专栏： pandas

本文链接：https://blog.youkuaiyun.com/luoganttcc/article/details/98641441

pandas 专栏收录该内容

26 篇文章

订阅专栏

本文介绍如何利用Google Cloud的BigQuery和BigQuery Storage API进行数据查询和处理，通过创建凭证对象实现两个客户端间的资源共享，避免了重复获取认证令牌的不必要API调用。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

# -*- coding: utf-8 -*-
"""
Spyder Editor

This is a temporary script file.
"""

import google.auth
from google.cloud import bigquery
from google.cloud import bigquery_storage_v1beta1

# Explicitly create a credentials object. This allows you to use the same
# credentials for both the BigQuery and BigQuery Storage clients, avoiding
# unnecessary API calls to fetch duplicate authentication tokens.
credentials, your_project_id = google.auth.default(
    scopes=["https://www.googleapis.com/auth/cloud-platform"]
)



# Make clients.
bqclient = bigquery.Client(
    credentials=credentials,
    project=your_project_id
)
bqstorageclient = bigquery_storage_v1beta1.BigQueryStorageClient(
    credentials=credentials
)