docker安装airflow

airflow官方文档
https://airflow.apache.org/docs/apache-airflow/stable/howto/docker-compose/index.html

配置基础环境
yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo

yum install docker-ce docker-compose-plugin

yum install docker-ce docker-compose-plugin
systemctl enable docker
systemctl start docker
systemctl status docker

1.创建目录
mkdir -p /opt/airflow
cd/opt/airflow && mkdir -p ./dags ./logs ./plugins ./config

执行变量
echo -e “AIRFLOW_UID=$(id -u)” > .env

2.拉取镜像
docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/airflow:2.9.3
docker tag swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/airflow:2.9.3 docker.io/apache/airflow:2.9.3

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/postgres:13.14
docker tag swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/postgres:13.14 docker.io/postgres:13.14

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/redis:7.2-bookworm
docker tag swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/redis:7.2-bookworm docker.io/redis:7.2-bookworm

3.拉取配置文件

放在 /opt/airflow/目录下
curl -LfO ‘https://airflow.apache.org/docs/apache-airflow/2.9.3/docker-compose.yaml’
修改刚刚拉取的yaml文件
关闭示例dag
AIRFLOW__CORE__LOAD_EXAMPLES: ‘false’
映射本地路径
volumes:
- 本地路径/dags:/opt/airflow/dags
- 本地路径/logs:/opt/airflow/logs
- 本地路径/config:/opt/airflow/config
- 本地路径/plugins:/opt/airflow/plugins

4.初始化容器
docker compose up airflow-init

5.启动
docker compose up -d
访问 http://localhost:8080
默认账号: airflow
默认密码: airflow