taste_cyn的博客

读 1. spark read parquet file parquetFile = spark.read.parquet('traj_pred_bc_train_data_sampled/dt=2021-09-30/city_id=88/') parquetFile.count() parquetFile.take(2) 2. pyarrow.parquet read parquet file import pyarrow.parquet as pq pfile = pq.read_table(file