distilbert模型的测试

最新推荐文章于 2025-04-16 22:30:00 发布

weixin_45955767

最新推荐文章于 2025-04-16 22:30:00 发布

阅读量535

点赞数 1

分类专栏：机器阅读理解比赛模板代码比赛复盘

本文链接：https://blog.youkuaiyun.com/weixin_45955767/article/details/119854310

版权

本文介绍了如何加载DistilBERT模型并进行测试。通过加载tokenizer，定义问题与上下文，对数据进行编码，然后进行预测，找出答案的起始和终止位置，最终转化为可读的答案。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

参考资料:实验楼的《探究bert的阅读机理》

模型的加载

# 加载模型
model = DistilBertForQuestionAnswering.from_pretrained(MODEL_PATH)
# 将模型移到相应设备
DEVICE = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")
model.to(DEVICE)  # 查看模型结构

基于同样的路径，加载 tokenizer：

# 加载 tokenizer，用于处理训练数据
from transformers import DistilBertTokenizerFast
# 初始化tokenizer
tokenizer = DistilBertTokenizerFast.from_pretrained(MODEL_PATH)

定义测试的问题与上下文

question = "in 2011, Beyonce performed for four nights where?"
context = "Her fourth studio album 4 was released on June 28, 2011 in the US. 4 sold 310,000 copies in its first week and debuted atop the Billboard 200 chart, giving Beyonc\u00e9 her fourth consecutive number-one album in the US. The album was preceded by two of its singles \"Run the World (Girls)\" and \"Best Thing I Never Had\", which both attained moderate success. The fourth single \"Love on Top\" was a commercial success in the US. 4 also produced four other singles; \"Party\", \"Countdown\", \"I Care\" and \"End of Time\". \"Eat, Play, Love\", a cover story written by Beyonc\u00e9 for Essence that detailed her 2010 career break, won her a writing award from the New York Association of Black Journalists. In late 2011, she took the stage at New

最低0.47元/天解锁文章