Search: training
Concepts
Pre-trainingPost-trainingTraining dataTraining computeChinchilla scalingKnowledge distillationKnowledge cutoff
WorldVicuna
An open chat model fine-tuned from LLaMA and Llama 2 by LMSYSGeneral · Conditional licence · 2023
WorldGPT-1
OpenAI's first GPT model, a 117M-parameter decoder-only transformer from 2018.Research · Open weights · 2018
🇮🇹 ItalyMinerva
An Italian-first large language model trained from scratch at Sapienza University of Rome.General · Open weights · 2024
🇦🇪 United Arab EmiratesJais
An open Arabic and English large language model from the UAEGeneral · Open weights · 2023
🇺🇸 United StatesT5
Encoder-decoder language model family from Google AI using a text-to-text framework.General · Fully open · 2019
🇺🇸 United StatesELMo
A 2018 bidirectional LSTM that produced context-sensitive word embeddings.Research · Research only · 2018
🇨🇭 SwitzerlandLumo
A privacy-focused chatbot from Proton with encrypted chat historiesAssistant · API only · 2025
🇺🇸 United StatesTalkie
A 13B small language model trained only on pre-1931 public domain English textSmall · Open weights · 2026
🇺🇸 United StatesMinerva
A language model trained further on technical content to solve maths and science problemsResearch · Research only · 2022
🇺🇸 United StatesLlama 3.1 405B
Meta's largest openly available language model, released in 2024General · Conditional licence · 2024
🇺🇸 United StatesPhi-4
A 14B Microsoft Research model trained heavily on synthetic data for reasoning.General · Open weights · 2024
🇺🇸 United StatesRoBERTa
A robustly optimised BERT pretraining study with released models and codeEncoder · Open weights · 2019
🇺🇸 United StatesMegatron-LM
Model-parallel training techniques for transformer language models with billions of parametersResearch · Fully open · 2019
🇨🇳 ChinaQwen2.5-Max
Large-scale mixture of experts model by Alibaba CloudGeneral · API only · 2025
🇮🇳 IndiaSarvam-M
Hybrid reasoning model for Indian languages and EnglishGeneral · Open weights · 2025
🇯🇵 JapanSwallow
Japanese-enhanced Llama models by Tokyo TechGeneral · Open weights · 2024
🇨🇳 ChinaKimi k1.5
Multimodal LLM trained with reinforcement learning for reasoningReasoning · Research only · 2025
🇫🇷 FranceT0
Encoder-decoder model for zero-shot task generalisation via promptsGeneral · Open weights · 2021
WorldBioBERT
Biomedical language model based on BERT architectureDomain · Open weights · 2019
WorldULMFiT
Transfer learning method for NLP text classification tasksResearch · Open weights · 2018
🇺🇸 United StatesNemotron-4 340B
NVIDIA's 340B open-access model family for chat and synthetic data generationGeneral · Conditional licence · 2024
WorldBLIP-2
Efficient vision-language model using frozen encodersMultimodal · Research only · 2023
WorldOpenCoder
Open code model family with full training data and pipelineCode · Open weights · 2024
WorldMeditron
Open-source medical language models based on Llama-2.Domain · Open weights · 2023
🇺🇸 United StatesNomic Embed
Open-source long-context text embedding modelEncoder · Open weights · 2024
🇨🇳 ChinaDeepSeekMath
Open language model for mathematical reasoningReasoning · Open weights · 2024
🇺🇸 United StatesSmolLM3
Open 3B parameter language model with reasoning modesGeneral · Open weights
🇺🇸 United StatesSmolLM2
Compact language models for on-device useGeneral · Open weights · 2025
🇺🇸 United StatesLlemma
Open language model for mathematical reasoningDomain · Open weights · 2023
🇺🇸 United StatesOLMo 2
Open language model family with full training transparencyGeneral · Open weights · 2024
🇺🇸 United StatesSciBERT
A BERT model trained on scientific text.Domain · Open weights · 2019
🇺🇸 United StatesTülu 3
Open post-trained model family built on Llama 3.1General · Open weights · 2024
🇯🇵 JapanEvoLLM-JP
Experimental Japanese language model created by merging open-source models.General · Open weights · 2024
🇸🇬 SingaporeSeaLLMs
Open language models for Southeast Asian languagesGeneral · Open weights · 2023
🇰🇷 South KoreaHyperCLOVA X SEED Think
Efficient reasoning model for Korean and multimodal tasksReasoning · Open weights
🇰🇷 South KoreaHyperCLOVA X
Korean-focused large language model with English and coding skillsGeneral · Research only · 2024
🇯🇵 JapanLlama-3-ELYZA-JP-8B
Japanese-tuned Llama 3 model by ELYZAGeneral · Conditional licence
🇮🇳 IndiaNavarasa 2.0
Instruction-tuned model for 15 Indian languages and English.Regional · Open weights
🇨🇳 ChinaMiniCPM
Efficient small language models for end-side devicesGeneral · Open weights · 2024
🇮🇳 IndiaKrutrim-1
Multilingual language model for Indian languagesGeneral · Conditional licence · 2024
🇨🇳 ChinaGLM-5.3
Open-weights coding and cyber-security model from Z.aiCode · Open weights · 2026
🇨🇳 ChinaERNIE 3.0
Knowledge-enhanced pre-training model for language tasksGeneral · Research only · 2021
🇨🇳 ChinaERNIE 3.0 Titan
Large-scale Chinese knowledge-enhanced pre-trained language modelGeneral · Research only · 2021
🇨🇳 ChinaERNIE 1.0
Knowledge-enhanced language model for Chinese NLP tasks.Encoder · Research only · 2019
🇨🇳 ChinaPangu Ultra
A 135-billion parameter dense language model trained on Ascend hardware.General · API only · 2025
🇨🇳 ChinaInternVL3
Open-source multimodal large language model seriesMultimodal · Open weights · 2025
🇺🇸 United StatesOpenELM
Apple's small open language models with a full training and inference releaseSmall · Open weights · 2024
WorldK2-Think
A 32 billion parameter open reasoning modelReasoning · Open weights · 2025
🇺🇸 United StatesLlama 3
Meta's open-weight language model family in 8B and 70B sizesGeneral · Conditional licence · 2024
WorldELECTRA
A pre-training method that trains text encoders to spot replaced tokens.Research · Research only · 2020
🇺🇸 United StatesGrok 3
xAI's reasoning-focused language model, released in beta in 2025General · API only · 2025
🇺🇸 United StatesGrok-1
xAI's 314 billion parameter open-weights mixture-of-experts base modelGeneral · Open weights · 2024
🇷🇺 RussiaT-Pro 2.0
Russian-tuned reasoning model based on Qwen 3Reasoning · Open weights
🇪🇸 SpainSalamandra
Open multilingual language models for European languagesGeneral · Open weights · 2025
🇸🇦 Saudi ArabiaALLaM
Bilingual Arabic and English language model seriesGeneral · Open weights · 2024
WorldMM1
A family of multimodal language models up to 30B parameters, dense and MoE.Multimodal · Research only · 2024
🇺🇸 United StatesOrca 2
A small LLaMA-2-based model trained on synthetic data to reason.Small · Conditional licence · 2023
🇺🇸 United StatesGrok 4
xAI's flagship reasoning model with native tool use and live searchGeneral · API only · 2025
🇺🇸 United StatesInstructGPT
GPT-3 models fine-tuned with human feedback to follow instructionsGeneral · API only · 2022
🇺🇸 United StatesGemma 3n
Mobile-first open model family for on-device text, image and audio workMultimodal · Open weights · 2025