A task with its own rules.
A Chinese short-form factuality benchmark reported by DeepSeek for V4 model evaluations.
- Organisation
- DeepSeek-AI
- Version
- 2026
Loading benchmark header
Loading benchmark registry
Knowledge / Benchmark profile
A Chinese short-form factuality benchmark reported by DeepSeek for V4 model evaluations.
Observed results
2 ranked models · higher is better · labels show rank and score
| Model | Rank | Model ID | Provider | Score | Unit |
|---|---|---|---|---|---|
| DeepSeek V4 Pro | #1 | deepseek-v4-pro | DeepSeek | 84.4 | percent |
| DeepSeek V4 Flash | #2 | deepseek-v4-flash | DeepSeek | 78.9 | percent |
One best compatible score per canonical product · higher is better
| Rank | Model | Weights | Evidence | Score |
|---|---|---|---|---|
| 01 | DeepSeek V4 ProDeepSeek | Open weights | Source carrier | 84.4% |
| 02 | DeepSeek V4 FlashDeepSeek | Open weights | Source carrier | 78.9% |
Each distinct published measurement is retained. Same-snapshot canonical and configuration projections appear once.
| Published model / configuration | Score | Evidence & protocol | Source & dates |
|---|---|---|---|
Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration.DeepSeek V4 ProExact identitydeepseek-v4-pro-max Canonical product: deepseek-v4-pro | 84.4% | Source carriersource-checkedVersion & system2026 Source-native system | BenchLM public datasets — 2026-08-01Observed Checked |
Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration.DeepSeek V4 FlashExact identitydeepseek-v4-flash-max Canonical product: deepseek-v4-flash | 78.9% | Source carriersource-checkedVersion & system2026 Source-native system | BenchLM public datasets — 2026-08-01Observed Checked |
Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration.DeepSeek V4 ProExact identitydeepseek-v4-pro-high Canonical product: deepseek-v4-pro | 77.7% | Source carriersource-checkedVersion & system2026 Source-native system | BenchLM public datasets — 2026-08-01Observed Checked |
Exact BenchLM registry variant DeepSeek V4 Pro; bulk export does not retain a complete upstream harness configuration.DeepSeek V4 ProExact identitySource label without a registered configuration ID Canonical product: deepseek-v4-pro | 75.8% | Source carriersource-checkedVersion & system2026 Source-native system | BenchLM public datasets — 2026-08-01Observed Checked |
Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration.DeepSeek V4 FlashExact identitydeepseek-v4-flash-high Canonical product: deepseek-v4-flash | 73.2% | Source carriersource-checkedVersion & system2026 Source-native system | BenchLM public datasets — 2026-08-01Observed Checked |
Exact BenchLM registry variant DeepSeek V4 Flash; bulk export does not retain a complete upstream harness configuration.DeepSeek V4 FlashExact identitySource label without a registered configuration ID Canonical product: deepseek-v4-flash | 71.5% | Source carriersource-checkedVersion & system2026 Source-native system | BenchLM public datasets — 2026-08-01Observed Checked |
Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration.DeepSeek V4 ProExact identitydeepseek-v4-pro-max Canonical product: deepseek-v4-pro | 84.4% | Source carriersource-checkedVersion & system2026 Source-native system | BenchLM public datasets — 2026-07-27Observed Checked |
Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration.DeepSeek V4 FlashExact identitydeepseek-v4-flash-max Canonical product: deepseek-v4-flash | 78.9% | Source carriersource-checkedVersion & system2026 Source-native system | BenchLM public datasets — 2026-07-27Observed Checked |
Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration.DeepSeek V4 ProExact identitydeepseek-v4-pro-high Canonical product: deepseek-v4-pro | 77.7% | Source carriersource-checkedVersion & system2026 Source-native system | BenchLM public datasets — 2026-07-27Observed Checked |
Exact BenchLM registry variant DeepSeek V4 Pro; bulk export does not retain a complete upstream harness configuration.DeepSeek V4 ProExact identitySource label without a registered configuration ID Canonical product: deepseek-v4-pro | 75.8% | Source carriersource-checkedVersion & system2026 Source-native system | BenchLM public datasets — 2026-07-27Observed Checked |
From result to context
A Chinese short-form factuality benchmark reported by DeepSeek for V4 model evaluations.
The summary shows one best compatible source result per canonical product. Versions, effort settings and execution systems remain attached to the underlying records.
Scores from different versions or harnesses may not be interchangeable. The published source rows preserve those distinctions and their original units. A source result is not automatically an input to a current index.
This catalogue entry preserves available source evidence. Current indices admit only their specifically reviewed tracks and configurations.
Contamination risk: Unknown. Lifecycle: Active.