10、大型语言模型应用与提示工程全解析

大型语言模型应用与提示工程全解析

1. 使用Hugging Face平台的LLaMA模型

1.1 代码实现

以下是使用Hugging Face平台上的“Meta-Llama-3-8B”模型与大语言模型（LLM）进行交互的代码：

!pip install langchain==0.2.0
!pip install transformers==4.40.2
!pip install accelerate==0.30.1
!pip install langchain-community==0.2.0
import torch
from langchain import HuggingFacePipeline
from transformers import (
    AutoModelForCausalLM,
    AutoTokenizer,
    pipeline,
    StoppingCriteria,
    StoppingCriteriaList,
    logging
)
from huggingface_hub import login
logging.set_verbosity_error()  # Suppress warnings
# 1. Authenticate with Hugging Face (if required)
login(token="Your access token")
# 2. Load the Model and Tokenizer
model_id = "meta-llama/Meta-Llama-3-8B"
tokenizer = AutoTokenize