docker搭建hadoop分布式集群

查看当前镜像

 spc@spc-virtual-machine:~$ sudo docker images    //这是镜像
REPOSITORY          TAG                 IMAGE ID            CREATED             SIZE
hello-world         latest              e38bc07ac18e        5 days ago          1.85kB
spc@spc-virtual-machine:~$ sudo docker ps -a     //这是容器
CONTAINER ID        IMAGE               COMMAND             CREATED             STATUS                          PORTS               NAMES
95f86eafda4e        hello-world         "/hello"            2 minutes ago       Exited (0) About a minute ago                       epic_cori
spc@spc-virtual-machine:~$ 

在docker上安装ubuntu

 spc@spc-virtual-machine:~$ sudo docker pull ubuntu
Using default tag: latest
latest: Pulling from library/ubuntu
d3938036b19c: Pull complete 
a9b30c108bda: Pull complete 
67de21feec18: Pull complete 
817da545be2b: Pull complete 
d967c497ce23: Pull complete 
Digest: sha256
Status: Downloaded newer image for ubuntu:latest

查看

 sudo docker images
REPOSITORY          TAG                 IMAGE ID            CREATED             SIZE
ubuntu              latest              c9d990395902        4 days ago          113MB
hello-world         latest              e38bc07ac18e        5 days ago          1.85kB

创建共享文件夹

 用于本地与docker中的Ubuntu系统传输数据
本地路径
    /home/spc/build

进入docker中的ubuntu

 spc@spc-virtual-machine:~/build$ sudo docker run -it -v /home/spc/build:/root/build --name ubuntu ubuntu
root@122a0d05b89a:/# ll

更新docker中的ubuntu安装需要的软件

 apt-get update 更新
apt-get install vim 安装vim
apt-get install ssh 安装ssh以便分布式hadoop连接
把这启动命令写进~/.bashrc文件，这样每次登录Ubuntu系统时，都能自动启动sshd服务;
    vim ~/.bashrc
    在最后一行添加
    /etc/init.d/ssh start
配置ssh无密码连接本地ssh
    ssh-keygen -t rsa
    root@122a0d05b89a:~/.ssh# ll
    total 20
    drwx------ 2 root root 4096 Apr 17 09:10 ./
    drwx------ 1 root root 4096 Apr 17 09:08 ../
    -rw-r--r-- 1 root root    0 Apr 17 09:10 authorized_keys
    -rw------- 1 root root 1679 Apr 17 09:11 id_rsa
    -rw-r--r-- 1 root root  399 Apr 17 09:11 id_rsa.pub
    root@122a0d05b89a:~/.ssh# cat id_rsa.pub >> authorized_keys
    root@122a0d05b89a:~/.ssh# 

    注意：cat id_rsa.pub >> authorized_keys 有的地方写的的dsa,不知道写rsa对不对
    dsa与rsa的区别

    之后使用dsa
    ssh-keygen -t dsa
    root@122a0d05b89a:~/.ssh# ll
    total 32
    drwx------ 2 root root 4096 Apr 17 09:14 ./
    drwx------ 1 root root 4096 Apr 17 09:08 ../
    -rw-r--r-- 1 root root  399 Apr 17 09:11 authorized_keys
    -rw------- 1 root root  668 Apr 17 09:14 id_dsa
    -rw-r--r-- 1 root root  607 Apr 17 09:14 id_dsa.pub
    -rw------- 1 root root 1679 Apr 17 09:11 id_rsa
    -rw-r--r-- 1 root root  399 Apr 17 09:11 id_rsa.pub
    root@122a0d05b89a:~/.ssh# cat id_dsa.pub >> authorized_keys
    root@122a0d05b89a:~/.ssh# 

安装JDK

 apt-get install default-jdk
    安装后的路径
        /usr/lib/jvm/java-1.8.0-openjdk-amd64
        /usr/lib/jvm/java-8-openjdk-amd64
添加环境变量
        export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-amd64
        export PATH=$PATH:$JAVA_HOME/bin
        source ~/.bashrc

将当前容器保存为镜像

启动保存的镜像

 $ sudo docker run -it -v /home/spc/build:/root/build --name hadooptext first
 * Starting OpenBSD Secure Shell server sshd