deepseek-v4.1-flash-1017
deepseek-v4.1-flash-1017 · xhigh, showing overall score. Results for all tested efforts are available below.
Overall score69.90
deepseek-v4.1-flash-1017 · xhigh
- Backend engineering
- 64
- Frontend interaction
- 83
- Knowledge & Reasoning
- 75
- Visual aesthetics
- 57
- Maintainability
- 57
- Evaluation time
- 37m 29s
- Reference cost
- $0.26
Complete evaluation · API reference cost
Backend tested · 10/17/2026Tasks & methodology
Results by reasoning effort
Swipe to see all results →
| Model / effort | Overall | Backend engineering | Frontend interaction | Knowledge & Reasoning | Visual aesthetics | Maintainability | Total eval. time | Total ref. cost | Compare |
|---|---|---|---|---|---|---|---|---|---|
| 70.10 | 64 | 85 | 70 | 66 | 59 | 27m 47s | $0.30 | ||
| 69.90 | 64 | 83 | 75 | 57 | 57 | 37m 29s | $0.26 | ||
| 74.30 | 72 | 96 | 75 | 61 | 53 | 64m 50s | $0.45 |
Score breakdown
- Overall score
- 69.90
- Evaluation time
- 37m 29s
- Reference cost
- $0.26
Service logic, error handling, and test verification.
Contracts and boundaries13 / 20
API contracts, input validation, and boundary behavior.
Retries and failures15 / 20
Error recovery, retry conditions, and failure handling.
CI and adversarial review9 / 20
Verification plans, risk detection, and audit evidence.
Transactions and consistency14 / 20
State transitions, concurrency control, and data consistency.
Caching and regression13 / 20
Cache invalidation, data updates, and regression coverage.
What changes with higher reasoning effort
Compare overall scores, cost, and time across neighboring tested efforts.
high xhigh
- Overall
- −0.2 pts 70.10 → 69.90
- Reference cost
- −$0.030 $0.30 → $0.26
- Evaluation time
- +34.9% 27m 47s → 37m 29s
Data snapshot published · 10/20/2026Scoring & cost notes