- Published
- Oct 27, 2026, 12:22 AM UTC
- Question pack
- coding-fast-v4.12
- Tested
- 2 measured configurations
- Batch
- pricing-558102e552269389e09ab11477f8c63d3aedee5bab43565c55e4168c61b36cf4
This is a publication snapshot of retained results. Evaluations may have completed on different dates; these scores describe the backend axis, not the three-axis overall score.
Published backend results
| Measure | GPT-5.6 Sol / max | Qwen 3.8 / default |
|---|---|---|
| Backend configuration rank | #15 | #64 |
| Backend score | 85/100 | 64/100 |
| Backend tested | Sep 20, 2026, 10:40 PM UTC | Sep 9, 2026, 09:53 PM UTC |
| Elapsed | 29m 19s | 47m 48s |
| Reference cost | $1.71 | $1.07 |
| Route | Custom endpoint | Custom endpoint |
| Black-box Regression Audit | 17/20 | 12/20 |
| Retry Planner Counterexamples | 18/20 | 17/20 |
| CI Adversarial Audit | 13/20 | 8/20 |
| Transaction Regression Design | 18/20 | 14/20 |
| Cache Propagation Certificate | 19/20 | 13/20 |
How to choose from these results
Does the higher-scoring option also fit your time and cost budget?
Start with the backend score and question profile. Use elapsed time only after both configurations clear your quality floor, and leave cost undecided when either side is not covered.