打开 LLM列表
整理了 Open LLM。
以下是截至2023年7月10日的信息，请重新确认相关许可证等。
按照发布日期排序。
Language ModelDeveloperRelease DateCheckpointsLanguageParams (B)TokensContext LengthLicenceHugging FaceXgenSalesforce2023/06XGen-7B-4K-Base, XGen-7B-8K-Base, XGen-7B-8K-Inst (for research only)22 languages: Bulgarian, Catalan, Czech, Danish, German, English, Spanish, French, Croatian, Hungarian, Italian, Dutch, Polish, Romanian, Russian, Slovenian, Serbian, Swedish, Ukrainian, Japanese, Chinese71.5T4K to 8KApache 2.0SalesforceDLiteAI Squared2023/05dlite-v2-1_5bEnglish0.124 to 1.5
1024Apache 2.0AI Squaredh2oGPTH2O LLM Studio2023/05h2oGPTEnglish12 to 20
256 – 2048Apache 2.0H2O LLM StudioRedPajama-INCITETogether and leaders2023/05RedPajama-INCITEEnglish3 to 7
2048Apache 2.0Together and leadersOpenLLaMAOpenLM Research2023/05open_llama_7b_700bt_preview, open_llama_3b_600bt_previewEnglish3, 7, 131T2048Apache 2.0OpenLM ResearchFalconThe Technology Innovation Institute (TII)2023/05Falcon-40B, Falcon-7B11 languages, English, German, Spanish, French (and limited capabilities in Italian, Portuguese, Polish, Dutch, Romanian, Czech, Swedish)7, 401T2048Apache 2.0TIIMPTMosaicML2023/05MPT-7B, MPT-7B-Instruct, MPT-30B, MPT-30B-instructEnglish7, 301T8192 to 65kApache 2.0, CC BY-SA-3.0MosaicMLPythiaEleutherAI2023/0470M, 160M, 410M, 1B, 1.4B, 2.8B, 6.9B, 12BEnglish0.07 to 12
2048Apache 2.0EleutherAIDollyDatabricks2023/04dolly-v2-3b, dolly-v2-7b, dolly-v2-12bEnglish3, 7, 12
2048MITDatabricksStableLM-AlphaStableLM2023/04StableLM-AlphaEnglish3 to 7
4096CC BY-SA-4.0StableLMFastChat-T5lmsys2023/04fastchat-t5-3b-v1.0English3
512Apache 2.0lmsysCerebras-GPTCerebras2023/03111M, 256M, 590M, 1.3B, 2.7B, 6.7B, and 13BEnglish0.111 to 13
2048Apache 2.0CerebrasOpen Assistant (Pythia family)Open-Assistant2023/03OA-Pythia-12B-SFT-8, OA-Pythia-12B-SFT-4, OA-Pythia-12B-SFT-1English12
2048Apache 2.0Open-AssistantBloomBigScience2022/11Bloom46 languages (No Japanese)176366B2048OpenRAIL-M v1BigScienceGPT-NeoX-20BEleutherAI2022/04GPT-NEOX-20BEnglish20
2048Apache 2.0EleutherAIRWKVBlinkDL2021/08RWKV, ChatRWKV100+ languages0.1 to 14
infinity (RNN)Apache 2.0BlinkDLGPT-J-6BEleuther AI2021/06GPT-J-6B, GPT4All-JEnglish6
2048Apache 2.0EleutherAImT5Google2020/11mT5-Small, mT5-Base, mT5-Large, mT5-XL, mT5-XXL101 (with Japanese)0.3 to 13
512Apache 2.0GoogleT5Google2019/10T5 & Flan-T5, Flan-T5-xxl (HF)English0.06 to 11
512Apache 2.0Google
1024Apache 2.0AI Squaredh2oGPTH2O LLM Studio2023/05h2oGPTEnglish12 to 20
256 – 2048Apache 2.0H2O LLM StudioRedPajama-INCITETogether and leaders2023/05RedPajama-INCITEEnglish3 to 7
2048Apache 2.0Together and leadersOpenLLaMAOpenLM Research2023/05open_llama_7b_700bt_preview, open_llama_3b_600bt_previewEnglish3, 7, 131T2048Apache 2.0OpenLM ResearchFalconThe Technology Innovation Institute (TII)2023/05Falcon-40B, Falcon-7B11 languages, English, German, Spanish, French (and limited capabilities in Italian, Portuguese, Polish, Dutch, Romanian, Czech, Swedish)7, 401T2048Apache 2.0TIIMPTMosaicML2023/05MPT-7B, MPT-7B-Instruct, MPT-30B, MPT-30B-instructEnglish7, 301T8192 to 65kApache 2.0, CC BY-SA-3.0MosaicMLPythiaEleutherAI2023/0470M, 160M, 410M, 1B, 1.4B, 2.8B, 6.9B, 12BEnglish0.07 to 12
2048Apache 2.0EleutherAIDollyDatabricks2023/04dolly-v2-3b, dolly-v2-7b, dolly-v2-12bEnglish3, 7, 12
2048MITDatabricksStableLM-AlphaStableLM2023/04StableLM-AlphaEnglish3 to 7
4096CC BY-SA-4.0StableLMFastChat-T5lmsys2023/04fastchat-t5-3b-v1.0English3
512Apache 2.0lmsysCerebras-GPTCerebras2023/03111M, 256M, 590M, 1.3B, 2.7B, 6.7B, and 13BEnglish0.111 to 13
2048Apache 2.0CerebrasOpen Assistant (Pythia family)Open-Assistant2023/03OA-Pythia-12B-SFT-8, OA-Pythia-12B-SFT-4, OA-Pythia-12B-SFT-1English12
2048Apache 2.0Open-AssistantBloomBigScience2022/11Bloom46 languages (No Japanese)176366B2048OpenRAIL-M v1BigScienceGPT-NeoX-20BEleutherAI2022/04GPT-NEOX-20BEnglish20
2048Apache 2.0EleutherAIRWKVBlinkDL2021/08RWKV, ChatRWKV100+ languages0.1 to 14
infinity (RNN)Apache 2.0BlinkDLGPT-J-6BEleuther AI2021/06GPT-J-6B, GPT4All-JEnglish6
2048Apache 2.0EleutherAImT5Google2020/11mT5-Small, mT5-Base, mT5-Large, mT5-XL, mT5-XXL101 (with Japanese)0.3 to 13
512Apache 2.0GoogleT5Google2019/10T5 & Flan-T5, Flan-T5-xxl (HF)English0.06 to 11
512Apache 2.0Google
