Search: masked language model
Concepts
WorldBERT
An encoder-only transformer that reads text in both directions at once.Research · Open weights · 2018
🇺🇸 United StatesRoBERTa
A robustly optimised BERT pretraining study with released models and codeEncoder · Open weights · 2019
🇺🇸 United StatesXLM-RoBERTa
A multilingual masked language model covering 100 languages, built on RoBERTa.General · Open weights · 2019