docker下安装
1、 在Linux服务器上创建目录 mkdir airflow
2、 拉取 git clone https://github.com/puckel/docker-airflow.git /root/airflow
3、 docker run -d -p 8082:8080 puckel/docker-airflow
4、 在mysql中创建数据库airflow
修改airflow支持的数据库为mysql 修改airflow.cfg
sql_alchemy_conn = mysql://root:123456@localhost/airflow
pip install mysqlclient
"Can’t connect to local MySQL server through socket ‘/var/lib/mysql/mysql.sock’
解决办法:sql_alchemy_conn = mysql://root:123456@127.0.0.1/airflow
5、 airflow webserver --debug &
访问 http://172.16.1.49:8083/admin/
非docker下安装
export AIRFLOW_HOME=~/airflow
pip install apache-airflow
airflow initdb
运行
nohup airflow webserver >> ./logs/webserver.log 2>&1 &
nohup airflow scheduler >> ./logs/scheduler.log 2>&1 &
nohup airflow worker >> ./logs/worker.log 2>&1