| 模型 | 参数 | Layers |
| Bert Base | 110M | 12 |
| Bert Large | 340M | 24 |
| GPT2-small | 117M | 12 |
| GPT2-medium | 345M | 24 |
| GPT2-large | 762M | 36 |
|
GPT2-extern-large | 1.542B | 48 |
| GPT3-small | 125M | 12 |
| GPT3-medium | 350M | 24 |
| GPT3-large | 760M | 24 |
| GPT3-XL | 1.3B | 24 |
| GPT3-2.7B | 2.7B | 32 |
| GPT3-6.7B | 6.7B | 32 |
| GPT3-13B | 13B | 40 |
| GPT3-175B | 175B | 96 |
| LLaMa | 7B | |
| LLaMa | 13B | |
| LLaMa | 33B | |
| LLaMa | 65B | |
| BLOOM | 560M | |
| BLOOM | 1.1B | |
| BLOOM | 1.7B | |
| BLOOM | 3B | |
| BLOOM | 7.1B | |
| BLOOM | 176B | |
AI模型参数大小
于 2023-05-17 11:31:19 首次发布
本文列举了不同AI模型如Bert、GPT2、GPT3以及新兴的LLaMa和BLOOM的参数量,展示了从基础到超大规模模型的发展趋势。
778






