llama-factory || AutoDL平台 ||启动web界面

失眠的树亚

已于 2025-03-04 14:05:53 修改

阅读量428

点赞数 1

分类专栏： LLM 文章标签： llama

于 2025-03-02 23:24:10 首次发布

本文链接：https://blog.youkuaiyun.com/weixin_44021274/article/details/145972576

版权

LLM 专栏收录该内容

5 篇文章

订阅专栏

报错如下：

root@autodl-container-d83e478b47-3def8c49:~/LLaMA-Factory# llamafactory-cli webui
* Running on local URL:  http://0.0.0.0:7860

Could not create share link. Missing file: /root/miniconda3/lib/python3.10/site-packages/gradio/frpc_linux_amd64_v0.3. 

Please check your internet connection. This can happen if your antivirus software blocks the download of this file. You can install manually by following these steps: 

1. Download this file: https://cdn-media.huggingface.co/frpc-gradio-0.3/frpc_linux_amd64
2. Rename the downloaded file to: frpc_linux_amd64_v0.3
3. Move the file to this location: /root/miniconda3/lib/python3.10/site-packages/gradio

解决办法：

cp frpc_linux_amd64_v0.3 /root/miniconda3/lib/python3.10/site-packages/gradio

cd /root/miniconda3/lib/python3.10/site-packages/gradio

提高权限

 chmod +x frpc_linux_amd64_v0.3

重新执行

llamafactory-cli webui

 CUDA_VISIBLE_DEVICES=0 llamafactory-cli webchat   --model_name_or_path /root/autodl-fs/Qwen2.5-1.5B-Instruct   --template qwen

结果：

[INFO|2025-03-02 23:15:05] llamafactory.model.model_utils.attention:157 >> Using torch SDPA for faster training and inference.
[INFO|2025-03-02 23:15:05] llamafactory.model.loader:157 >> all params: 1,543,714,304
* Running on local URL:  http://0.0.0.0:7860
* Running on public URL: https://35d22b023607f1702a.gradio.live

This share link expires in 72 hours. For free permanent hosting and GPU upgrades, run `gradio deploy` from the terminal in the working directory to deploy to Hugging Face Spaces (https://huggingface.co/spaces)