News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM
GPT-SW3

GPT-SW3

Generative language model for Nordic languages

GPT-SW3 is an autoregressive large language model designed specifically for Nordic languages. Developed by a research team including Magnus Sahlgren and Ariel Ekgren, it aims to support smaller language communities through native generative capabilities.

Share on WhatsApp

  • First native large generative model for Nordic languages
  • Autoregressive architecture for text generation
  • Paper first submitted in May 2023
  • Designed to support smaller language communities
  • Covers data collection to instruction fine-tuning

What it is

GPT-SW3 is the first native large generative language model built for Nordic languages. It functions as an autoregressive system, predicting subsequent text tokens based on prior input. The project addresses the lack of high-quality generative tools for smaller language groups in Northern Europe. Researchers developed it to serve as a reference for similar initiatives targeting under-resourced linguistic communities.

How it came about

The development process was documented in a paper first submitted to arXiv in May 2023. A team of ten authors, including Ariel Ekgren and Magnus Sahlgren, detailed the creation of the model. The work covers data collection, processing, and training configurations. The paper was revised in October 2024 to provide updated guidance for researchers building large models for smaller languages.

Inside the model

The model uses an autoregressive architecture, generating text one token at a time. The developers focused on collecting and processing data specific to Nordic languages. Training involved specific configuration choices suited to these linguistic structures. The team also performed instruction fine-tuning to align the model with user commands. This approach ensures the system handles the nuances of Nordic grammar and vocabulary effectively.

What it can do

GPT-SW3 generates text in Nordic languages. It serves as a foundational tool for natural language processing tasks in this region. The model supports generative applications such as translation, summarisation, and content creation. Its primary capability lies in understanding and producing coherent text in languages that often lack dedicated large-scale models.

How to use it

The model is described in academic literature available on arXiv. The developers intend for the paper to guide other researchers. The focus remains on sharing the development methodology rather than commercial deployment.

Why it matters

GPT-SW3 provides a framework for developing large generative models for smaller languages. It demonstrates that native models can be built for Nordic linguistic contexts. The documentation serves as a reference for future projects aiming to support under-represented language communities with advanced artificial intelligence tools.

Questions people ask about GPT-SW3

What languages does GPT-SW3 support?

GPT-SW3 is designed specifically for Nordic languages. It is the first native large generative model built to handle the linguistic characteristics of this region, supporting text generation and processing in these specific tongues.

Who developed GPT-SW3?

A team of ten researchers developed the model. Key authors include Ariel Ekgren, Amaru Cuba Gyllensten, and Magnus Sahlgren. They documented the entire process from data collection to evaluation in an academic paper.

What is the architecture of GPT-SW3?

The model uses an autoregressive architecture. This means it predicts the next word in a sequence based on the words that came before it. This design is common for generative language models that produce coherent text outputs.

Good reading and sources

    Where this page comes from

    There is no English Wikipedia article on GPT-SW3 yet, so the facts on this page come from the sources listed above: arxiv.org/abs/2305.12987. Some are the subject's own pages, so its claims about itself are reported as its claims. EveryLLM wrote the text in its own words, with AI assistance, and compares it with the sources to make sure no passage is copied.

    It may contain mistakes, and figures change over time. Nothing here is investment or buying advice. If something is wrong, tell us. Last refreshed 2026-11-14.

    The weekly digest

    Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.