[论文笔记] pai-megatron-patch 环境安装

CUDA12，python3.10！！！

汇总：

git clone https://github.com/alibaba/Pai-Megatron-Patch.git
cd Pai-Megatron-Patch
git submodule update --init --recursive

conda create -n mcore python==3.10 ipykernel

pip install -r requirements.txt
pip install flash-attn

# 如果安装了，需要卸载
git clone --branch stable --recursive https://github.com/NVIDIA/TransformerEngine.git
CMAKE_BUILD_PARALLEL_LEVEL=1
cd TransformerEngine
git checkout 744624d
export NVTE_FRAMEWORK&