NLP预训练汇总

NLP预训练汇总

预训练大模型

• transformer

• Elmo

• Bert

• Llama

  • 2023-arxiv-LLaMA: Open and Efficient Foundation Language Models
  • LLaMA源码解析

大模型微调

RAG

• [KG-RAG]
• [RankRAG]
• [GraphRAG]

Agent