Ambari2.75集成flink-1.14.4

最新推荐文章于 2022-10-27 18:00:00 发布

原创

最新推荐文章于 2022-10-27 18:00:00 发布 · 5.8k 阅读

7 ·

CC 4.0 BY-SA版权

文章标签：

#flink #ambari

本文记录了使用Ambari 2.7.5安装Flink 1.13.2过程中遇到的问题及解决方法，包括安装时的错误处理、用户创建、内存配置调整等关键步骤。

ambari集成flink详情可参考：Ambari 2.7.5安装Flink1.13.2_不饿同学的博客-优快云博客_ambari安装flink

这里说一下安装过程遇到的问题：

1、安装时报错：Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-710.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-710.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', '']

解决办法：

cd /var/lib/ambari-server/resources/scripts

python configs.py -u admin -p admin -n zsCluster -l hadoop01 -t 8080 -a set -c cluster-env -k ignore_groupsusers_create -v ture

2022-03-25 09:38:14,125 INFO ### Performing "set":
2022-03-25 09:38:14,125 INFO ### new property - "ignore_groupsusers_create":"ture"
2022-03-25 09:38:14,156 INFO ### on (Site:cluster-env, Tag:d88402a7-13d7-4e4d-8d8d-e8007e1319e8)
2022-03-25 09:38:14,170 INFO ### PUTting json into: doSet_version1648172294170011.json
2022-03-25 09:38:14,403 INFO ### NEW Site:cluster-env, Tag:version1648172294170011

其中，zsCluster替换为自己的集群名称；hadoop01为ambari-server所在机器的主机名。

2、安装时报错：KeyError: 'getpwnam(): name not found: flink'，...resource_management.core.exceptions.Fail: User 'flink' doesn't exist

Traceback (most recent call last):
  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 51, in _ensure_metadata
    _user_entity = pwd.getpwnam(user)
KeyError: 'getpwnam(): name not found: flink'

The above exception was the cause of the following exception:

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.1/services/FLINK/package/scripts/flink.py", line 172, in <module>
    Master().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.1/services/FLINK/package/scripts/flink.py", line 30, in install
    group=params.flink_group
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 125, in __new__
    cls(names_list.pop(0), env, provider, **kwargs)
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", li