News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM
fnDeepSeek-V4-Pro

DeepSeek-V4-Pro

1.6T parameter MoE model with one million token context

DeepSeek-V4-Pro is a large language model from DeepSeek AI featuring 1.6 trillion total parameters and a mixture of experts design. Released in 2026, it supports a context window of one million tokens and offers variable reasoning effort levels for complex tasks.

Share on WhatsApp

  • 1.6 trillion total parameters with 49 billion activated
  • Supports context length of one million tokens
  • Trained on more than 32 trillion diverse tokens
  • Uses hybrid attention for efficient long context processing
  • Offers three distinct reasoning effort modes

What it is

DeepSeek-V4-Pro is a large language model developed by DeepSeek AI. It belongs to the DeepSeek-V4 series and features a mixture of experts architecture. The model contains 1.6 trillion total parameters, with 49 billion activated during inference. It supports a context length of one million tokens, allowing it to process vast amounts of information at once. The system is designed for general purpose use, coding, and complex reasoning tasks. It offers different modes of operation to balance speed and accuracy based on user needs.

How it came about

The model was introduced as part of the DeepSeek-V4 series preview. An official release named DeepSeek-V4-Pro-0813 followed, superseding the initial preview version. This update included enhanced agentic capabilities and performance improvements for production environments. The development built upon the structure of the preview model while adding a DSpark speculative decoding module. The team focused on improving stability and convergence during training through specific optimization techniques.

Inside the model

The architecture uses a mixture of experts approach, activating only a subset of parameters for each token. It employs a hybrid attention mechanism combining compressed sparse attention and heavily compressed attention. This design reduces computational costs for long contexts significantly. Manifold-constrained hyper-connections strengthen residual links to improve signal propagation. Training involved more than 32 trillion tokens using the Muon optimizer. Post-training included independent cultivation of domain experts followed by unified model consolidation via distillation.

What it can do

The model performs strongly in coding benchmarks and reasoning tasks. In maximum reasoning mode, it achieves high scores on tests like LiveCodeBench and Codeforces. It handles long context queries effectively, maintaining accuracy over one million tokens. The system supports three reasoning effort levels: non-think for fast responses, think high for logical analysis, and think max for deep deliberation. It bridges the gap with leading closed-source models on agentic workflows and complex problem solving.

How to use it

Weights are available for download on platforms like Hugging Face and ModelScope. The model supports FP8 and mixed precision formats. Users can run it locally or via API using frameworks like vLLM and SGLang. The official release includes scripts for encoding messages in OpenAI-compatible formats. Speculative decoding can be enabled with specific configuration flags to improve inference speed. Sampling parameters such as temperature and top p are adjustable for different use cases.

Questions people ask about DeepSeek-V4-Pro

How many parameters does DeepSeek-V4-Pro have?

The model has 1.6 trillion total parameters. However, it uses a mixture of experts architecture, so only 49 billion parameters are activated for each token during inference. This design allows for high capacity while maintaining computational efficiency.

What is the context window size?

DeepSeek-V4-Pro supports a context length of one million tokens. This allows the model to process and reason over extremely large documents or codebases in a single pass. Hybrid attention mechanisms help maintain efficiency at this scale.

Can I run this model locally?

Yes, the weights are available for download. You can run it using frameworks like vLLM or SGLang. The developers provide specific configuration instructions for enabling features like speculative decoding and managing memory usage with FP8 precision.

Good reading and sources

    Where this page comes from

    There is no English Wikipedia article on DeepSeek-V4-Pro yet, so the facts on this page come from the sources listed above: huggingface.co/deepseek-ai/DeepSeek-V4-Pro, huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813. Some are the subject's own pages, so its claims about itself are reported as its claims. EveryLLM wrote the text in its own words, with AI assistance, and compares it with the sources to make sure no passage is copied.

    It may contain mistakes, and figures change over time. Nothing here is investment or buying advice. If something is wrong, tell us. Last refreshed 2026-11-14.

    The weekly digest

    Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.