impala刷新hive数据shell脚本

最新推荐文章于 2024-04-09 13:06:00 发布

原创最新推荐文章于 2024-04-09 13:06:00 发布 · 3.3k 阅读

2 ·

CC 4.0 BY-SA版权

文章标签：

#impala刷新hive数据shell脚 #impala #impala刷新 #impala刷新hive数据shell脚

hive 同时被 2 个专栏收录

5 篇文章

订阅专栏

impala

2 篇文章

订阅专栏

本文介绍了一个使用bash脚本刷新Impala中指定数据库表元数据的方法。通过传递Impala主机名、数据库名称及表名作为参数，脚本将执行无效化元数据与刷新操作，并检查命令执行状态。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

#!/bin/bash

source job.properties

impalaHost=$1
databaseName=$2
tableName=$3

echo "[INFO]: Hive Database :------> ${databaseName}"
echo "[INFO]: Table Name :---------> ${tableName}"
echo "[INFO]: Impala Host :--------> ${impalaHost}"
echo " "

export PYTHON_EGG_CACHE=./myeggs

#Impala metadata refresh
impala-shell -i ${impalaHost} -d ${databaseName} -q "invalidate metadata ${tableName}";
#Check if the above command executed successfully.
if [ $? -eq 0 ]; then
    echo "[INFO]: The impala invalidate metadata command executed successfully."
else
    echo "[ERROR]: Problem in executing the Impala invalidate metadata command."
    exit 1
fi

#Refresh the impala tableName
impala-shell -i ${impalaHost} -d ${databaseName} -q "REFRESH ${tableName}";
#Check if the above command executed successfully.
if [ $? -eq 0 ]; then
    echo "[INFO]: The impala REFRESH ${tableName} command executed successfully."
else
    echo "[ERROR]: Problem in executing the Impala REFRESH ${tableName} command."
    exit 1
fi
echo " "

echo "[INFO]: The impala table and metadata refreshed successfully."
exit 0