k3.1-pro
k3.1-pro · high, showing overall score. Results for all tested efforts are available below.
Overall score76.10
k3.1-pro · high
- Backend engineering
- 72
- Frontend interaction
- 87
- Knowledge & Reasoning
- 80
- Visual aesthetics
- 68
- Maintainability
- 61
- Evaluation time
- 31m 48s
- Reference cost
- $1.39
Complete evaluation · API reference cost
Backend tested · 10/24/2026Tasks & methodology
Results by reasoning effort
Swipe to see all results →
| Model / effort | Overall | Backend engineering | Frontend interaction | Knowledge & Reasoning | Visual aesthetics | Maintainability | Total eval. time | Total ref. cost | Compare |
|---|---|---|---|---|---|---|---|---|---|
| 76.10 | 72 | 87 | 80 | 68 | 61 | 31m 48s | $1.39 | ||
| 79.60 | 84 | 91 | 80 | 68 | 64 | 109m 33s | $5.00 |
Score breakdown
- Overall score
- 76.10
- Evaluation time
- 31m 48s
- Reference cost
- $1.39
Service logic, error handling, and test verification.
Contracts and boundaries14 / 20
API contracts, input validation, and boundary behavior.
Retries and failures16 / 20
Error recovery, retry conditions, and failure handling.
CI and adversarial review11 / 20
Verification plans, risk detection, and audit evidence.
Transactions and consistency14 / 20
State transitions, concurrency control, and data consistency.
Caching and regression17 / 20
Cache invalidation, data updates, and regression coverage.
What changes with higher reasoning effort
Compare overall scores, cost, and time across neighboring tested efforts.
high xhigh
- Overall
- +3.5 pts 76.10 → 79.60
- Reference cost
- +$3.60 $1.39 → $5.00
- Evaluation time
- +244.5% 31m 48s → 109m 33s
Data snapshot published · 10/24/2026Scoring & cost notes