[slurm] CentOS7/Ubuntu18上Slurm部署步骤（单机版）

onlyellow

已于 2023-06-21 13:50:32 修改

阅读量1.5k

点赞数

分类专栏： slurm shell 文章标签： slurm

于 2023-03-23 17:27:26 首次发布

本文链接：https://blog.youkuaiyun.com/onlyellow/article/details/129728981

版权

shell 同时被 2 个专栏收录

12 篇文章

订阅专栏

slurm

2 篇文章

订阅专栏

1. 关闭防火墙，禁用selinux

2. 创建munge和slurm用户

需要确认1190和1191没有被其他user占用

export MUNGEUSER=1190
groupadd -g $MUNGEUSER munge
useradd  -m -c "MUNGE Uid 'N' Gid Emporium" -d /var/lib/munge -u $MUNGEUSER -g munge -s /sbin/nologin munge
export SlurmUSER=1191
groupadd -g $SlurmUSER slurm
useradd -m -c "Slurm workload manager" -d /var/lib/slurm -u $SlurmUSER -g slurm -s /bin/bash slurm

3. 安装munge

##centos7
yum install munge munge-libs munge-devel rng-tools -y

## ubuntu18
apt install munge libmunge-dev -y

#rng 相关ubuntu跳过
rngd -r /dev/urandom
sed -i 's#^ExecStart.*#ExecStart=/sbin/rngd -f -r /dev/urandom#g'  /usr/lib/systemd/system/rngd.service
systemctl daemon-reload
systemctl start rngd
systemctl enable rngd

# 华为Euler系统下编译安装
dnf install bzip2-devel openssl-devel zlib-devel gdb -y
rpmbuild -tb --without verify munge-0.5.15.tar.xz
cd /root/rpmbuild/RPMS/aarch64
dnf install ./*.rpm

# 创建密钥

dd if=/dev/urandom bs=1 count=1024 > /etc/munge/munge.key
chown munge: /etc/munge/munge.key
chmod 400 /etc/munge/munge.key

systemctl restart munge
systemctl enable munge
systemctl status munge

4. 安装slurm

# centos7
yum install gcc gcc-c++ readline-devel perl-ExtUtils-MakeMaker pam-devel rpm-build mysql-devel http-parser-devel json-c-devel libjwt  libjwt-devel python3 -y

# ubuntu18
apt-get install make hwloc libhwloc-dev libmunge-dev libmunge2 munge mariadb-server libmysqlclient-dev libhttp-parser-dev libjwt-dev libjwt0 libjson-c-dev -y

# Euler
dnf install gcc gcc-c++ readline-devel perl-ExtUtils-MakeMaker pam-devel rpm-build mariadb-devel mariadb http-parser-devel json-c-devel -y

5. 文件权限修改

 mkdir -p /var/spool/slurm/ctld
chmod 0755 /var/spool/slurm/ctld
chown slurm:slurm /var/spool/slurm/ctld

mkdir -p /var/spool/slurm
chown slurm: /var/spool/slurm
mkdir -p /var/log/slurm
chown slurm: /var/log/slurm

6. 安装数据库

从https://mariadb.org/download/?t=repo-config&d=CentOS+7&v=10.3&r_m=blendbyte 获取10.3版本的repo文件
高版本需要一些依赖，arm操作系统可能没有，故选择10.3

yum install MariaDB-server MariaDB-client

在/etc/my.cnf中增加如下内容
[mysqld]
innodb_buffer_pool_size=1024M
innodb_log_file_size=64M
innodb_lock_wait_timeout=900
注: 此步骤解决slurmdbd链接数据库报错

增加数据库用户

mysql -e "CREATE USER 'slurm'@'%' identified  by 'Slurm1234'"
mysql -e "GRANT ALL ON slurm_acct_db.* TO 'slurm'@'%'"
mysql -e "CREATE USER 'slurm'@'localhost' identified  by 'Slurm1234'"
mysql -e "GRANT ALL ON slurm_acct_db.* TO 'slurm'@'localhost'"
mysql -e "CREATE USER 'slurm'@'***HOSTNAME****' identified  by 'Slurm1234'"
mysql -e "GRANT ALL ON slurm_acct_db.* TO 'slurm'@'***HOSTNAME****'"  #替换HOSTNAME

Euler系统仓库内没有mysql或者mariadb服务端（有客户端），需要自行从源码编译或者下载arm架构二进制包
mariadb没找到，但mysql有
https://downloads.mysql.com/archives/community/
从以上网址下载centos8或者centos7的二进制安装包即可
本次测试Eulerv2r8用了centos8得二进制安装包，可以成功安装并运行

7. 编译slurm

./configure --enable-debug --with-munge --enable-slurmrestd
不需要调试就不加debug

修改auth验证：编辑src/slurmrestd/operations.c，注释掉

        if ((rc = rest_authenticate_http_request(args))) {
                _operations_router_reject(args, "Authentication failure",
                                          HTTP_STATUS_CODE_ERROR_UNAUTHORIZED);
                return rc;
        }