Ollama记录

小林一直冲

已于 2024-12-19 15:48:59 修改

阅读量263

点赞数 2

CC 4.0 BY-SA版权

文章标签：语言模型

于 2024-12-06 15:40:13 首次发布

本文链接：https://blog.youkuaiyun.com/m0_51749389/article/details/144278889

先在官网下载Ollama

模型下载

ollama run qwen2:0.5b

如果ollama是部署在docker上

docker exec -it ollama ollama run qwen2:0.5b

可以快速部署很多模型方便

可以替换openai api key

from openai import OpenAI

client = OpenAI(
    base_url = 'https://127.0.0.1:11434/v1',
    api_key='ollama', # required, but unused
)

response = client.chat.completions.create(
  model="llama2",
  messages=[
    {"role": "system", "content": "You are a helpful assistant."},
    {"role": "user", "content": "Who won the world series in 2020?"},
    {"role": "assistant", "content": "The LA Dodgers won in 2020."},
    {"role": "user", "content": "Where was it played?"}
  ]
)
print(response.choices[0].message.content)