题意:
从本地仓库加载DeepSeek-V3模型
问题背景:
I want to run the DeepSeek-V3 model inference using the Hugging-Face Transformer library (>= v4.51.0).
我想使用Hugging Face Transformers库(版本≥4.51.0)运行DeepSeek-V3模型推理
I read that you can do the following to do that (download the model and run it)
我了解到可通过以下步骤实现(下载模型并运行它)
from transformers import pipeline
messages = [
{"role": "user", "content": "Who are you?"},
]
pipe = pipeline("text-generation", model="deepseek-ai/DeepSeek-R1", trust_remote_code=True)
pipe(messages)
My issue is that I already downloaded the DeepSeek-V3 hugging-face repository separately, and I just want to t