Search: nlp
Events
🇺🇸 United StatesELMo
A 2018 bidirectional LSTM that produced context-sensitive word embeddings.Research · Research only · 2018
🇮🇹 ItalyMinerva
An Italian-first large language model trained from scratch at Sapienza University of Rome.General · Open weights · 2024
WorldXLNet
Permutation-based autoregressive transformer model created by Google AIResearch · Open weights · 2019
WorldULMFiT
Transfer learning method for NLP text classification tasksResearch · Open weights · 2018
🇺🇸 United StatesMegatron-Turing NLG 530B
A 530-billion-parameter generative language model trained by Microsoft and NVIDIA.General · Research only · 2022
🇺🇸 United StatesBioGPT
A generative Transformer trained on biomedical writing for text and mining tasksDomain · Open weights · 2022
🇺🇸 United StatesBloombergGPT
A 50 billion parameter language model for finance.Domain · Research only · 2023
🇺🇸 United StatesSciBERT
A BERT model trained on scientific text.Domain · Open weights · 2019
🇫🇮 FinlandPoro 2
Finnish and English instruction-following model based on Llama 3.1General · Conditional licence
🇨🇳 ChinaPanGu-Sigma
Trillion-parameter sparse language model for Chinese NLP tasksGeneral · Research only · 2023
🇨🇳 ChinaERNIE 1.0
Knowledge-enhanced language model for Chinese NLP tasks.Encoder · Research only · 2019
🇫🇮 FinlandPoro
Open 34B parameter model for Finnish, English and codeGeneral · Fully open · 2024
🇫🇮 FinlandViking
Open source language model for Nordic languages and codeGeneral · Fully open · 2023
🇺🇸 United StatesGLaM
A trillion-parameter mixture-of-experts language model from Google ResearchResearch · Research only · 2021
🇫🇷 FranceT0
Encoder-decoder model for zero-shot task generalisation via promptsGeneral · Open weights · 2021