News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM
Snowflake Arctic

Snowflake Arctic

Open enterprise language model with hybrid MoE design

Snowflake Arctic is a large language model released by the Snowflake AI Research Team in April 2024. It uses a hybrid architecture combining dense and mixture of experts layers to balance efficiency with scale, offering open weights for enterprise use.

Share on WhatsApp

  • Released by Snowflake AI Research Team in April 2024
  • Hybrid architecture with 480 billion total parameters
  • Uses only 17 billion active parameters per token
  • Weights available under Apache-2.0 open licence
  • Generates both text and programming code

What it is

Snowflake Arctic is a foundation language model developed by the Snowflake AI Research Team. Released in April 2024, it targets enterprise artificial intelligence applications. The model features a total parameter count of 480 billion, yet activates only 17 billion during inference. This design aims to provide high intelligence while maintaining computational efficiency. It generates both natural language text and programming code from text inputs.

How it came about

The Snowflake AI Research Team built Arctic from scratch. They announced the release of both base and instruct-tuned checkpoints on 24 April 2024. The team positioned the model as an efficient option for enterprise systems. They provided supporting resources such as cookbooks for training custom mixture of experts models and guidance on creating high-quality training data.

Inside the model

Arctic uses a hybrid transformer architecture. It combines a 10 billion parameter dense transformer with a residual mixture of experts multi-layer perceptron. This secondary component consists of 128 experts, each with 3.66 billion parameters. A top-2 gating mechanism selects which experts to activate, resulting in 17 billion active parameters per token. The model was pre-trained from scratch by the research team.

What it can do

The model accepts text as input and produces text and code as output. It is designed for enterprise artificial intelligence tasks. The developers describe it as efficiently intelligent. Specific benchmark scores are not listed in the provided material, but the architecture supports complex reasoning and coding tasks through its large total parameter count and selective activation.

How to use it

Snowflake releases the model weights under an Apache-2.0 licence. This permits free use in research, prototypes, and commercial products. Checkpoints are available for both the base and instruct-tuned versions on Hugging Face. Users can run the model using the transformers library with custom code support or via vLLM. Inference typically requires significant hardware, such as an eight GPU instance.

Questions people ask about Snowflake Arctic

What is the architecture of Snowflake Arctic?

It uses a hybrid dense-mixture of experts transformer. It combines a 10 billion parameter dense model with a residual expert layer, activating 17 billion parameters from a total of 480 billion.

Is Snowflake Arctic open source?

Yes, the model checkpoints are released under an Apache-2.0 licence. This allows free use for research, prototypes, and commercial products without restrictive conditions.

What hardware is needed to run Arctic?

Due to its size, inference is recommended on powerful instances such as an eight GPU setup. The developers suggest using FP8 quantization with DeepSpeed to manage memory requirements effectively.

Good reading and sources

    Where this page comes from

    There is no English Wikipedia article on Snowflake Arctic yet, so the facts on this page come from the sources listed above: huggingface.co/Snowflake/snowflake-arctic-instruct. Some are the subject's own pages, so its claims about itself are reported as its claims. EveryLLM wrote the text in its own words, with AI assistance, and compares it with the sources to make sure no passage is copied.

    It may contain mistakes, and figures change over time. Nothing here is investment or buying advice. If something is wrong, tell us. Last refreshed 2026-11-14.

    The weekly digest

    Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.