[AI医学] 领域指令微调样本生成框架OpenGPT与医疗健康大模型NHS-LLM

原创

已于 2023-05-15 20:05:17 修改 · 1k 阅读

2 ·

CC 4.0 BY-SA版权

文章标签：

#人工智能

于 2023-05-12 11:12:56 首次发布

关键词：AI医疗，医学大模型，样本数据生成，OpenGPT, chatGPT, NHS, NHS-LLM

OpenGPT：基于领域知识生成指令微调样本框架

用于创建基于领域数据的指令微调样本，并在底座大模型上进行指令微调的一个开源框架。使用该框架，作者对医疗健康数据NHS生成指令微调样本，并在LLaMA的基础上进行微调训练，得到医疗健康大模型NHS-LLM。

指令微调样本的生成思路有别于standford-alpaca，相比于直接使用chatGPT的生成结果，引入领域数据作为chatGPT生成数据的参考，在一定程度能够约束生成结果的有效性，避免有偏或不恰当的生成结果。使用该框架还可用于在其他领域的非结构化数据上生成指令样本，这种样本数据的生成方式值得借鉴。

项目地址：https://github.com/CogStack/opengpt

1. 样本数据描述及格式

NHS UK Q/A：24665对，基于NHS网站数据在OpenGPT框架下使用ChatGPT生成

text,raw_data_id
"<|user|> What is high blood pressure? <|eos|> <|ai|> High blood pressure is a condition where the force at which your heart pumps blood around your body is high. It is recorded with 2 numbers, the systolic pressure and the diastolic pressure, both measured in millimetres of mercury (mmHg).
References:
- https://www.nhs.uk/conditions/Blood-pressure-(high)/Pages/Introduction.aspx <|eos|> <|eod|>",0

NHS UK对话：2354条会话，基于NHS网站数据在OpenGPT框架下使用ChatGPT生成

text,raw_data_id
"<|user|> Hi, I am a bit worried about my blood pressure. How can I tell if I have high blood pressure? <|eos|> <|ai|> The only way to determine if you have high blood pressure is to have your blood pressure checked. All adults over 40 are recommended to have their blood pressure checked at least every 5 years. You can get your blood pressure checked at your GP surgery, some pharmacies, as part of your NHS Health Check or in some workplaces. You can also check your blood pressure yourself with a home blood pressure monitor.
References:
- https://www.nhs.uk/conditions/Blood-pressure-(high)/Pages/Introduction.aspx <|eos|>