hive hms和hs2的sql执行日志分析

sunxunyong

已于 2024-12-04 07:59:55 修改

阅读量937

点赞数 10

CC 4.0 BY-SA版权

文章标签： hive sql hadoop

于 2024-12-04 07:58:43 首次发布

本文链接：https://blog.youkuaiyun.com/sunxunyong/article/details/144228425

HMS日志：
2024-12-02 15:39:20,811 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-8-thread-114]: 114: source:10.11.17.999 get_all_databases
2024-12-02 15:39:20,812 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-8-thread-114]: ugi=hive ip=10.11.17.999 cmd=source:10.11.17.999 get_all_databases --请求ip及请求的数据内容

HS2日志：
[HiveServer2-Handler-Pool: Thread-190281]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe
[HiveServer2-Handler-Pool: Thread-190281]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281
[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Adding operation: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced]
[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 编译开始时间 --根据sql找到位置，根据Thread-190281 查询线程运行，根据产生的queryId，往后查sql执行。
[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Semantic Analysis Completed
[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null)
[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Initializing operator LIST_SINK[0]
[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Completed compiling command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.014 seconds 编译结束时间
[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe
[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Resetting thread name to HiveServer2-Handler-Pool: Thread-190281
[HiveServer2-Background-Pool: Thread-191087]: Executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8): show databases 执行sql开始！
[HiveServer2-Background-Pool: Thread-191087]: Starting task [Stage-0:DDL] in serial mode
[HiveServer2-Background-Pool: Thread-191087]: results : 12
[HiveServer2-Background-Pool: Thread-191087]: Completed executing command(queryId=hive_20241202153920_217e1a21-acc4-499f-becb-12fa49ff3be8); Time taken: 0.003 seconds 执行sql结束时间！
[HiveServer2-Background-Pool: Thread-191087]: OK
[HiveServer2-Handler-Pool: Thread-190281]: Using the default value passed in for log id: c095e5ef-b29a-4524-8ad3-04ba52546cbe
[HiveServer2-Handler-Pool: Thread-190281]: Updating thread name to c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281
。。。。。。
[c095e5ef-b29a-4524-8ad3-04ba52546cbe HiveServer2-Handler-Pool: Thread-190281]: Closing operation: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=311acd89-1594-4c1b-bdbf-26de06496ced]