Search: distillation
Concepts
🇺🇸 United StatesGPT-2
OpenAI's 2019 text model that predicts the next word in a sequenceGeneral · Open weights · 2019
🇺🇸 United StatesGemma 2
Open lightweight language models from Google DeepMind, 2B to 27B parametersGeneral · Open weights · 2024
🇺🇸 United StatesGemma 3
Lightweight multimodal open models from 1B to 27B parametersGeneral · Open weights · 2025
🇺🇸 United StatesAmazon Nova Premier
Amazon's largest Nova model for complex tasks and model distillationGeneral · API only
WorldDistilBERT
A smaller, faster version of the BERT language model.Encoder · Open weights · 2019
🇰🇷 South KoreaHyperCLOVA X SEED Think
Efficient reasoning model for Korean and multimodal tasksReasoning · Open weights
🇺🇸 United StatesLlama 3.1 405B
Meta's largest openly available language model, released in 2024General · Conditional licence · 2024