书生大模型实战营第四期-闯关挑战L1G6000 OpenCompass 评测书生大模型实践

环境配置

首先在训练营提供的开发机上创建用于评测 conda 环境:

conda create -n opencompass python=3.10
conda activate opencompass

git clone -b 0.3.3 https://github.com/open-compass/opencompass
cd opencompass
pip install -e .
pip install -r requirements.txt
pip install huggingface_hub==0.25.2
pip install importlib-metadata

评测 API 模型

cd至opencompass根目录
配置模型:
touch opencompass/configs/models/openai/puyu_api.py, 然后打开文件, 贴入以下代码: