Search: pretraining
Concepts
🇺🇸 United StatesELMo
A 2018 bidirectional LSTM that produced context-sensitive word embeddings.Research · Research only · 2018
🇺🇸 United StatesGrok 4
xAI's flagship reasoning model with native tool use and live searchGeneral · API only · 2025
🇺🇸 United StatesMinerva
A language model trained further on technical content to solve maths and science problemsResearch · Research only · 2022
🇺🇸 United StatesRoBERTa
A robustly optimised BERT pretraining study with released models and codeEncoder · Open weights · 2019
WorldMeditron
Open-source medical language models based on Llama-2.Domain · Open weights · 2023
🇺🇸 United StatesLlemma
Open language model for mathematical reasoningDomain · Open weights · 2023
🇺🇸 United StatesGrok 3
xAI's reasoning-focused language model, released in beta in 2025General · API only · 2025