cloudera add host

最新推荐文章于 2023-07-06 14:05:53 发布
原创 最新推荐文章于 2023-07-06 14:05:53 发布 · 537 阅读 · 0 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。

本文介绍如何在CentOS系统中安装Perl并配置yum源，同时提供了设置代理的方法及清理硬盘数据的步骤。


yum install perl部署之前先安装perl

\\10.239.44.128\home\chenmeixiu\CentOS-Base.repo

配置yum源,放到/etc/yum.repo.d

vi /etc/yum.conf设置代理

http_proxy=http://child-prc.intel.com:913

Machine generated alternative text: Applications Places System Eile Edit View History Bookmarks Tools Help @Specify hosts for your CDH clus... # cloudera MANAGER Specify hosts for your CDH cluster installation. - Cloudera Manager - -rue Mar 28, 1:50 PM Mozilla Firefox root Google New Search Continue Inspect Support • admin • Specify hosts for your CDH cluster installation. Hint: Search for hostnames and IP addresses using patterns 1 hosts scanned, 1 running SSH. IP Address 172.1&0.47 [VNC config] Expanded Query 172.1&0.47 Back Il Specify hosts for your Hostnarne (FQDN) traci ng047 Currently Managed Result Host ready: O ms response time. Web Console O Debugger More Tools x

 

Machine generated alternative text: Applications Places System Eile Edit View History Bookmarks Tools Help @Add New Hosts to Cluster- X @Home - Cloudera Manager 172.18.o.41:7180vcmfiadd-hosts-wizard/wizard cloudera MANAGER Add New Hosts to Cluster - Cloudera Manager - -rue Mar 28, Mozilla Firefox 1:52 PM root Google Continue Inspect Support • admin • Add New Hosts to Cluster Select Repository Select the specific release of the Cloudera Manager Agent you want to install on your hosts. O Matched release for this Cloudera Manager Server @ Custom Repository http://172.18.o.41/5.10 Exampe for SLES, Redhat or other RPM based distributions: https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5/ Example for Ubuntu or other Debian based distributions: deb https://archive.c10udera.com/cm5/ubuntu/1ucid/amd64/cm/ lucid-cm5 contrib Enter a custom URL for the location of the GPG signing key (applies to all custom repositories and without Internet access). Custom GPG Key URL: http://172.18.O.41/5.10/RPM-GPG-KEY-cIoudera Exampe for SLES, Redhat or other RPM based distributions: https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/RPM -GPG -KEY -cloudera Example for Ubuntu or other Debian based distributions: https://archive.cloudera.com/cm5/debian/squeeze/amd64/cm/archive.key oaooaøao x [VNC config] Back Il Add New Hosts to Clus... Web Console O Debugger More Tools

 

Machine generated alternative text: Applications File Edit View Places System History Bookmarks Tools Help Add New Hosts to Cluster - Cloudera Manager - Mozilla -rue Mar 28, Firefox 1:53 PM root @Add New Hosts to Cluster- X @Home - Cloudera Manager cloudera MANAGER Add New Hosts to Cluster JDK Installation Options Oracle Binary Code License Agreement for the Java SE Platform Products and JavaFX Google Support • admin • ORACLE AMERICA, INC. ('ORACLE'), FOR AND ON BEHALF OF ITSELF AND ITS SUBSIDIARIES AND AFFILIATES UNDER COMMON CONTROL, IS WILLING TO LICENSE THE SOFTWARE TO YOU ONLY UPON THE CONDITION THAT YOU ACCEPT ALL OF THE TERMS CONTAINED IN THIS BINARY CODE LICENSE AGREEMENT AND SUPPLEMENTAL LICENSE TERMS (COLLECTIVELY 'AGREEMENT'). PLEASE READ THE AGREEMENT CAREFULLY. BY SELECTING THE 'ACCEPT LICENSE AGREEMENT' (OR THE EQUIVALENT) BUTTON AND/OR BY USING THE SOFTWARE YOU ACKNOWLEDGE THAT YOU HAVE READ THE TERMS AND AGREE TO THEM. IF YOU ARE AGREEING TO THESE TERMS ON BEHALF OF A COMPANY OR OTHER LEGAL ENTITY, YOU REPRESENT THAT YOU HAVE THE LEGAL AUTHORITY TO BIND THE LEGAL ENTITY TO THESE TERMS. IF YOU DO NOT HAVE SUCH AUTHORITY, OR IF YOU DO NOT WISH TO BE BOUND BY THE TERMS, THEN SELECT THE 'DECLINE LICENSE AGREEMENT' (OR THE EQUIVALENT) BUTTON AND YOU MUST NOT USE THE SOFTWARE ON THIS SITE OR ANY OTHER MEDIA ON WHICH THE SOFTWARE IS CONTAINED. 1 . DEFINITIONS. 'Software' means the software identified above in binary form that you selected for download, install or use (in the version You selected for download, install or use) from Oracle or its authorized licensees, any other machine readable materials (including, but not limited to, libraries, source files, header files, and data files), any updates or error corrections provided by Oracle, and any user manuals, programming guides and other documentation provided to you by Oracle under this Agreement. 'General Purpose Desktop Computers and Servers' means computers, including desktop and laptop computers, or servers, used for general computing functions under end user control (such as but not specifically limited to email, general purpose Internet browsing, and office suite productivity tools). The use of Software in systems and solutions that provide dedicated functionality (other than as mentioned above) or designed for use in embedded or function-specific software applications, for example but not limited to: Software embedded in or bundled with industrial control systems, wireless mobile telephones, wireless handheld devices, kiosks, TV/STB, Blu-ray Disc devices, telematics and network control switching equipment, printers and storage management systems, and other related systems are excluded from this definition and not licensed under this Agreement. 'Programs' means (a) Java technology applets and applications intended to run on the Java Platform, Standard Edition platform on Java-enabled General Purpose Desktop Computers and Servers; and (b) JavaFX technoloav aoolications intended to run on the JavaFX Runtime on JavaFX-enabIed General Puroose Desktoo Comouters and Servers. 'Commercial Features' means Install Oracle Java SE Development Kit (JDK) Check this box to accept the Oracle Binary Code License Agreement and install the JDK. Leave it unchecked to use a currently installed JDK. Continue Inspect O Debugger [VNC config] Back Il Add New Hosts to Clus... oaooaøao Web Console More Tools x

 

Machine generated alternative text: Applications Places System Eile Edit View History Bookmarks Tools Help @Add New Hosts to Cluster- X @Home - Cloudera Manager cloudera MANAGER Add New Hosts to Cluster - Cloudera Manager - -rue Mar 28, Mozilla Firefox 1:53 PM root Google Support • admin • Add New Hosts to Cluster Provide SSH login credentials. Root access to your hosts is required to install the Cloudera packages. This installer will connect to your hosts via SSH and log in either directly as root or as another user with password-less sudo/pbrun privileges to become root. Login To All Hosts As: @ root O Another user You may connect via password or public-key authentication for the user selected above. x [VNC config] Authentication Method: Enter Password: Confirm Password: SSH Pon: Number of Simultaneous Installations: Back Il Add New Hosts to Clus... @ All hosts accept same password O All hosts accept same private key 22 10 (Running a large number of installations at once can consume large amounts of network bandwidth and other system resources) oasoaøao Web Console Continue Inspect O Debugger More Tools

 

Machine generated alternative text: Applications Places System Eile Edit View History Bookmarks Tools Help @Add New Hosts to Cluster- X @Home - Cloudera Manager cloudera MANAGER Add New Hosts to Cluster - Cloudera Manager - -rue Mar 28, Mozilla Firefox 2:37 PM root 6 Web Console Google Details Continue Inspect Support • admin • Add New Hosts to Cluster Installation completed successfully. 1 of 1 host(s) comp eted successfully. O Debugger x [VNC config] Hostnarne traci ng047 Back Il Add New Hosts to Clus... IP Address 172.1&0.47 Progress Status Installation completed successfully. oaoaaøao More Tools untitled window

 

Applications Places System Eile Edit View History Bookmarks Tools Help @Add New Hosts to Cluster- X @Home - Cloudera Manager cloudera MANAGER Add New Hosts to Cluster - Cloudera Manager - -rue Mar 28, Mozilla Firefox Unpacked: 4/4 Unpacked: 4/4 2:37 PM root Activated: 3/4 Activated: 3/4 6 Web Console Google Continue Inspect Support • admin . Add New Hosts to Cluster Installing Selected Parcels The selected parcels are being downloaded and installed on all the hosts in the cluster. > CDH 5.10.0-1.cdh5.10.O.pO.41 > KUDU 1.2.0-1.cdh5.10.O.pO.55 Downloaded: Downloaded: 100% 100% Distributed: 4/4 Distributed: 4/4 oaoosøao [VNC config] Back Il Add New Hosts to Clus... O Debugger More Tools x untitled window

 

Applications File Edit View Places System History Bookmarks Tools Help Add New Hosts to Cluster - Cloudera Manager - Mozilla -rue Mar 28, Firefox 2:43 PM root Google @Add New Hosts to Cluster- X @Home - Cloudera Manager cloudera MANAGER Add New Hosts to Cluster Inspect hosts for correctness c Run Again Validations Inspector failed on the following hosts.. Individual hosts resolved their own hostnames correctly. errors were found while looking for conflicting init scripts. The following errors were found while checking /etc/hosts... All hosts resolved localhost to 127.0.0.1. All hosts checked resolved each other's hostnames correctly and in a timely manner. Host clocks are approximately in sync (within ten minutes). Host time zones are consistent across the cluster. users or groups are missing. conflicts detected between packages and parcels. kernel versions that are known to be bad are running. problems were found with /proc/sys/vm/swappiness on any of the hosts. Support • admin . Transparent Huge Page Compaction is enabled and can cause significant performance problems. Run "echo never > /sys/kernel/mm/transparent_hugepage/defrag" and "echo never > /sys/kernel/mm/transparent_hugepage/enabled" to disable this, and then add the same command to an init script such as /etc/rc.local so it will be set on system reboot. The following hosts are affected: CDH 5 Hue Python version dependency is satisfied. O hosts are running CDH 4 and 4 hosts are running CDH 5. There are mismatched versions across the system, which will cause failures. See below for details on which hosts are running what versions of components. All managed hosts have consistent versions of Java. All checked Cloudera Management Daemons versions are consistent with the server. oaooa•ao Continue x [VNC config] Back Il Add New Hosts to Clus... 6 Web Console Inspect O Debugger More Tools untitled window

 

Applications Places System -rue Mar 28, Add Hive Service to Cluster 1 - Cloudera Manager - Mozilla Firefox 3:27 PM root Eile Edit View History Bookmarks Tools Help @AII Hosts - Cloudera Manager X @Add HDFS Service to Cluster ...X @Log Details - Cloudera Mana... X cloudera MANAGER Add Hive Service to Cluster 1 Database Setup @Add Hive Service to Cluster X Google Support • admin . Configure and test database connections. Create the databases first according to the Installing and Configuring an External Database section of the Installation Guide Hive Database Host Narne: * tracing041 Notes: Database Type: PostgreSQL Database Narne : * hive Usernarne: hive • The value in the Database Host Narne field must match the value you used for the host name when creating the database. Learn more • If the database is not running on its default port, specify the port number using host:port in the Database Host Narne field. • It is highly recommended that each database is on the same host as the corresponding role instance. oasoaø Successful Password: hive Show Password Test Connection Continue Web Console x [VNC config] Back Il Add Hive Service to Cl... Inspect O Debugger More Tools untitled window

添加服务之前要把硬盘下面的数据都清空/mnt/sda/


mirabelle521
关注
cloudera5.13.0手动添加新主机操作步骤
maximiliansheng的专栏
05-23 1750
准备工作 第一步：配置主机名 新机器初始化，挂载好硬盘，配置好hostname，例如 hadoop9 hostname hadoop9 ​ vim /etc/sysconfig/network ---- HOSTNAME=hadoop9 ---- ​ vi /etc/sysctl.conf ---- vm.swappiness = 10 ---- ​ sysctl -p ​ 第二步准备：...
CDH6.3.1添加新机器
最新发布
无忧
08-19 768
cdh 6.3.1添加新机器
CDH5.12.1添加新主机
张老邪的博客
08-22 593
一． JDK安装 1.卸载自带JDK 查看安装的Java包 rpm -qa | grep java 将显示的java包全部删除 rpm -e --nodeps tzdata-java-2013g-1.el6.noarch 卸载自带的版本 yum -y remove java java-1.7.0-openjdk 验证是否还有java相关包 rpm -qa | grep java 2.安装JDK 在/usr下新建java文件夹 ==》 将压缩包复制到java中 ==》解压 ==》 配置 vi /e
CDH6.2.0-集群扩容(添加新节点)
永青技术博客
06-08 4336
向CDH6.2.0集群中添加新的主机节点 一、新节点基本环境准备 1、首先得在新的机器上关闭防火墙、修改selinux、NTP时钟与主机同步（阿里云忽略此步骤） 2、在新的机器上环境中安装JDK、修改hosts、与主机配置ssh免密码登录、保证安装好了perl和python. 3、上传cloudera-manager文件到/opt目录 [root@xx-xx cloudera-repos]# ls cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm
CDH6 cluster添加新节点
liuwei0376的专栏
11-06 3906
一、节点规划 NO IP HOSTNAME ROLE 1 11.11.11.11 server11-11 dn 2 11.11.11.12 server11-12 dn 二、安装前准备 2.1 配置yum仓库 Yum资源库配置目录位于/etc/yum.repos.d下： ①、创建CM的yum资源库配置文件cloudera-repo.repo [cloudera-repo] ...
java调用Cloudera Manager Api实例
03-31
HttpPost httpPost = new HttpPost("https://your_cloudera_manager_host:7180/api/v31/auth/login"); List<NameValuePair> params = new ArrayList(); params.add(new BasicNameValuePair("username", "admin"))...
【CDH】Cloudera manager 卸载并重新安装某一个节点
菜鸟叔叔的博客
03-11 2625
完美卸载CDH一个节点并重新安装
基于cloudera搭建大数据集群（docker）记录
u013093426的博客
06-01 1212
1安装docker 安装最新稳定版的 # step 1: 安装必要的一些系统工具 sudo yum install -y yum-utils device-mapper-persistent-data lvm2 # Step 2: 添加软件源信息 sudo yum-config-manager --add-repo https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo # Step 3: 更新并安装Docker-CE sudo
cloudera大数据平台搭建流程
yu_shao的博客
12-06 3261
  基础环境 软件环境 NO 软件名称 版本 1 操作系统 centos7 64位 2 jdk jdk-8u181-linux-x64.tar.gz 3 cloudera manager cloudera-manager-centos7-cm5.15.1_x86_64.tar.gz 4 cdh CDH-5.15...
Cloudera Manager搭建集群环境过程中部分错误解决
sy793314598的博客
05-19 3095
Cloudera Manager搭建集群环境过程中部分错误解决 前一阵子在公司的几台测试机上搭建cdh的集群环境，过程中遇见了不少问题，这里记录一下： 一、版本信息： 项 版本 安装方式 服务器 5台（1master, 4slave） * CentOS Linux release 7.3.1611 (Core) \ Cloudera Manag...
Cloudera Manager6.3.1&CDH6.3.2集群部署（超详细，亲测可用）
矿泉水瓶子
01-11 3129
Cloudera Manager是一个拥有集群自动化安装、中心化管理、集群监控、报警功能的一个工具，使得安装集群从几天的时间缩短在几个小时内，运维人员从数十人降低到几人以内，极大的提高集群管理的效率。
Cloudera Manager企业大数据平台集群增加节点实践
weixin_38023225的博客
05-18 987
准备工作 1.主机域名配置 #第一台服务器上执行 echo "172.31.30.81ptx-bigdata1" >> /etc/hosts echo "172.31.27.167ptx-bigdata2" >> /etc/hosts echo "172.31.31.127 ptx-bigdata3" >> /etc/hosts echo "172.31.28.41 ptx-bigdata4" >> /etc/host...
Cloudera CDH新增节点到集群参考步骤
热门推荐
BabyFish13
09-20 1万+
1、新加机器环境配置 首先得在新的主机环境中安装JDK，关闭防火墙、修改selinux、NTP时钟与主机同步、修改hosts、与主机配置ssh免密码登录、保证安装好了perl和python。 2、上传cloudera-manager文件到/opt目录，修改agent配置文件： vi /opt/cm-5.7.0/etc/cloudera-scm-agent/config.ini server
万恶之源：Could not resolve host
我是你大爷
07-06 9449
万恶之源：Could not resolve host
CDH安装指南（Centos6）
chenjadeli的博客
01-25 2882
1. 环境说明 软件准备 JDK Tar包 Mysql RPM及其依赖 Mysql JDBC Driver Tar包 Clouda RPM及其依赖 Parcels文件（CDH，KAFKA等） 本文以3台机器为例，sys01-sys03，其中sys01是主节点，其他是从节点 2. 开始前 2.1 修改主机名并添加到hosts文件 # 设置主机名 修改 /etc/sysconfig/network 的HostName hostname newmachinename # 将主机名和IP映射关系添加
有关etc/hosts文件在使用Cloudera Manager安装CDH中的作用
zy103118的博客
09-02 702
群集主机必须具有工作的网络名称解析系统，集群的主机之间必须有一个网络，且必须有个主机名称解析系统，目的就是将主机名称解析成ip地址，反之亦然，这个东西和DNS的工作原理差不多，就是个机器名称和IP地址的映射关系 以下内容摘自官方文档： 在集群中的每一台节点主机的etc/hosts文件下的书写内容应该保持一致，当使用etc/hosts文件（本地主机上暂存的域名解析映射存储文件）时候，保持...
Unknown host ‘child-prc.intel.com‘. You may need to adjust the proxy settings in Gradle.
csdn9228的博客
10-30 624
在github中下载项目出现错误，定位错误地方为gradle.prooerties 对比别的AndroidX项目 对比以前Android项目 考虑到该项目没有启动AndroidX，最终修改为如下：
CDH安装之篇一：Cloudera Manager安装部署
chundai20040826的博客
03-13 1257
Cloude Manager概述 CDH是Cloudera公司对整体hadoop集群环境进行监控与管理的企业级大数据管理平台。 Cloudera Manager分为： Cloudera Manager Server：对整个集群提供监控与管理操作。Cloudera Manager ...
ClouderaManager管理平台搭建(CDH6.2.1)
CDHong.it的技术分享博客
05-18 1641
CM 简介 Cloudera Manager是一个拥有集群自动化安装、中心化管理、集群监控、报警功能的一个工具，使得安装集群从几天的时间缩短在几个小时内，运维人员从数十人降低到几人以内，极大的提高集群管理的效率。 CM 架构 CM部署准备配置 下载 CDH6-CentOS7 离线软件安装包 下载 CM6-CentOS7 集群安装软件包 使用 VMware 克隆三台机器，分别修改对应的 IP 及 主机名，使用 MobaXterm 连接测试。 主机名 IP地址 内存 硬盘 CUP 服务进程
Cloudera入门：Hadoop实战指南
"Cloudera学习指南" Cloudera是一家专注于提供大数据和分析解决方案的公司，其主要产品是Cloudera Data Platform (CDP)，这是一个全面的数据管理平台，包含了Apache Hadoop等开源技术。本学习指南针对Hadoop入门，...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值