【GPT入门】第48课 LlamaFacotory 合并原模型与LoRA模型

1.合并原模型与LoRA训练的增量模型

• llamafactory-cli webui 执行合并

• 合并后模型大小

(base) root@autodl-container-b4b04ea4f2-b5ee47d1:~# du -sh  /root/autodl-tmp/models/*
15G     /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1
15G     /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged
15G     /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui

• 模型文件详情

(base) root@autodl-container-b4b04ea4f2-b5ee47d1:~# du -sh  /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/*
4.0K    /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/Modelfile
4.0K    /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/chat_template.jinja
4.0K    /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/config.json
4.0K    /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/generation_config.json
4.7G    /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/model-00001-of-00004.safetensors
4.7G    /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/model-00002-of-00004.safetensors
4.6G    /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/model-00003-of-00004.safetensors
1.1G    /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/model-00004-of-00004.safetensors
24K     /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/model.safetensors.index.json
4.0K    /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/special_tokens_map.json
17M     /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/tokenizer.json
52K     /root/autodl-tmp/models/Llama3-8B-Chinese-Chat1-merged-ui/tokenizer_config.json

2. 测试模型