๐Ÿง  DeepSeek-V4-Pro-0813

The official release of DeepSeek-V4-Pro โ€” a 1.65-trillion-parameter mixture-of-experts model with a 1M-token context and enhanced agentic capabilities, built on the DeepSeek-V4-Pro structure with a DSpark speculative-decoding module.

MIT License text-generation MoE 1M context fp8 / 8-bit 598 likes ยท 30.9K downloads

๐Ÿ“ Architecture

Total params
~1.65T
from safetensors metadata
Hidden size
7168
hidden_size
Layers
61
num_hidden_layers
Experts / token
6
routed + shared
Context
1,048,576
max_position_embeddings
Vocab
129,280
vocab_size
DType
bf16
torch_dtype
Decoder
DSpark
speculative decoding

๐Ÿ“Š Benchmark highlights

Benchmark V4-Pro-0813 V4-Flash-0731 V4-Pro (Prev) GLM-5.2 Kimi K3 Opus-4.8
HLE (w/ tools)60.051.548.254.756.057.9
Terminal Bench 2.187.982.772.181.088.385.0
NL2Repo61.554.238.548.9โ€”69.7
Cybergym83.376.752.7โ€”80.078.3
DeepSWE62.754.412.846.267.558.0
Toolathlon-Verified74.170.355.959.976.576.2
DSBench-FullStack71.168.741.861.873.771.6
DSBench-Hard67.259.631.154.563.071.7

Scores from the official model card. Higher is better. DeepSeek-V4-Pro-0813 leads on most agentic / coding benchmarks, with Opus-4.8 competitive on DSBench-Hard.

๐Ÿ’ป Usage

The tokenizer and model load via transformers. Weights are large (~1.6 TB on disk), so local deployment needs multi-GPU expert parallelism.

import transformers

tokenizer = transformers.AutoTokenizer.from_pretrained(
    "deepseek-ai/DeepSeek-V4-Pro-0813"
)
# model = transformers.AutoModelForCausalLM.from_pretrained(
#     "deepseek-ai/DeepSeek-V4-Pro-0813", torch_dtype="auto"
# )

# Recommended sampling (from the model card):
#   temperature = 1.0
#   top_p       = 0.95  (agentic) / 1.0 (otherwise)
#   max output  = 384K tokens for high / max reasoning effort

๐Ÿš€ Why this is a showcase (not a self-hosted demo)

DeepSeek-V4-Pro-0813 cannot be hosted on a Hugging Face Space. Its safetensors metadata reports roughly 1.65 trillion parameters โ€” about 1.6 TB of weights (the bulk in int8 expert matrices). The largest Space GPU (NVIDIA H200) has 141 GB of VRAM, so the full model would need many GPUs with expert parallelism.

This Space therefore showcases the model with verified data from its repo (architecture, benchmarks, paper, license) and links you to the real thing:

Want a live chat demo here? If you have a DeepSeek API key (platform.deepseek.com), I can wire a chat UI that calls the API with the key kept server-side. Just say the word.