DuoAttention: EFFICIENT LONG-CONTEXT LLM INFERENCE WITH RETRIEVAL AND STREAMING HEADS 翻译

Doc2X | 高效 PDF 转换助手
Doc2X 提供精准的 PDF转Docx、PDF转Markdown、PDF转HTML 功能，支持 多栏识别、表格解析、公式编辑，满足多样化文档处理需求。
Doc2X | Efficient PDF Conversion Assistant
Doc2X offers precise PDF to Docx, Markdown, and HTML conversion, supporting multi-column recognition, table parsing, and formula editing for versatile document handling.
👉 了解 Doc2X 的独特功能 | Explore Doc2X Features

原文链接：https://arxiv.org/pdf/2410.10819

DuoAttention: EFFICIENT LONG-CONTEXT LLM INFERENCE WITH RETRIEVAL AND STREAMING HEADS

DuoAttention: 带有检索和流式头的高效长上下文LLM推理

Guangxuan Xiao ${}^{1\ast }$ Jiaming Tang ${}^1$ Jingwei Zuo ${}^2$ Junxian Guo ${}^{1,3}$

肖广轩 ${}^{1\ast }$ 唐嘉明 ${}^1$ 左静伟 ${}^2$ 郭俊贤 ${}^{1,3}$

Shang Yang ${}^1$ Haotian Tang ${}^1$ Yao Fu ${}^4$ Song Han ${}^{1,5}$

杨尚 ${}^1$ 唐浩天 ${}^1$ 付尧 ${}^4$ 韩松 ${}^{1,5}$

$\frac{1}{}$ MIT 2 {}^{2}