All models
471 models so far, best known first. 21 more are on the list to be written.
🇯🇵 Japan and 1 moreBuddhaBot
A chatbot answering questions from early Buddhist textsDomain · Research only · 2021
WorldBERT
An encoder-only transformer that reads text in both directions at once.Research · Open weights · 2018
🇺🇸 United StatesGloVe
Unsupervised word embeddings from global word co-occurrence countsResearch · Fully open · 2014
🇮🇳 IndiaMuRIL
A BERT-style encoder pre-trained on 17 Indian languages and their transliterationsEncoder · Open weights · 2021
🇺🇸 United StatesRoBERTa
A robustly optimised BERT pretraining study with released models and codeEncoder · Open weights · 2019
🇺🇸 United StatesXLM-RoBERTa
A multilingual masked language model covering 100 languages, built on RoBERTa.General · Open weights · 2019
🇺🇸 United StatesMegatron-LM
Model-parallel training techniques for transformer language models with billions of parametersResearch · Fully open · 2019
WorldBioBERT
Biomedical language model based on BERT architectureDomain · Open weights · 2019
🇺🇸 United StatesDeBERTa
A BERT-style encoder with disentangled attention and an enhanced mask decoder.Encoder · Open weights · 2020
🇮🇳 IndiaIndicBERT
Multilingual encoder model for Indian languagesEncoder · Open weights · 2022
🇩🇪 GermanySentence-BERT
Efficient sentence embeddings using Siamese BERT networksEncoder · Open weights · 2019
🇺🇸 United StatesNomic Embed
Open-source long-context text embedding modelEncoder · Open weights · 2024
🇩🇪 GermanyJina Embeddings v3
Multilingual text embedding model with task-specific adaptersEncoder · Open weights · 2024
WorldDistilBERT
A smaller, faster version of the BERT language model.Encoder · Open weights · 2019
🇺🇸 United StatesSciBERT
A BERT model trained on scientific text.Domain · Open weights · 2019
🇫🇷 FranceCamemBERT
French language model based on RoBERTa architectureEncoder · Open weights · 2019
🇨🇳 ChinaERNIE 1.0
Knowledge-enhanced language model for Chinese NLP tasks.Encoder · Research only · 2019
WorldELECTRA
A pre-training method that trains text encoders to spot replaced tokens.Research · Research only · 2020
WorldAfriBERTa
Multilingual encoder model for eleven African languagesEncoder · Open weights · 2021
🇺🇸 United States and 1 moreModernBERT
A modernised encoder model for retrieval and classification tasks.Encoder · Open weights · 2024
🇺🇸 United StatesGemini Embedding
Google's embedding model built from Gemini for text, code and many languagesEncoder · API only · 2025
🇺🇸 United StatesALBERT
A slimmed-down BERT encoder that shares weights across its layersEncoder · Open weights · 2019