Configuration comparison

GPT-5.6 Sol vs Qwen 3.8

Compare each model’s highest-scoring published backend effort. The retained evaluations may have completed on different dates.

Backend & testing

GPT-5.6 Sol / max leads these published backend results by 21 points. GPT-5.6 Sol / max completed 18m 29s sooner. Reference costs are available for both configurations.

Published backend evidence
Published
Oct 27, 2026, 12:22 AM UTC
Question pack
coding-fast-v4.12
Tested
2 measured configurations
Batch
pricing-558102e552269389e09ab11477f8c63d3aedee5bab43565c55e4168c61b36cf4

This is a publication snapshot of retained results. Evaluations may have completed on different dates; these scores describe the backend axis, not the three-axis overall score.

Published backend results

MeasureGPT-5.6 Sol / maxQwen 3.8 / default
Backend configuration rank#15#64
Backend score85/10064/100
Backend testedSep 20, 2026, 10:40 PM UTCSep 9, 2026, 09:53 PM UTC
Elapsed29m 19s47m 48s
Reference cost$1.71$1.07
RouteCustom endpointCustom endpoint
Black-box Regression Audit17/2012/20
Retry Planner Counterexamples18/2017/20
CI Adversarial Audit13/208/20
Transaction Regression Design18/2014/20
Cache Propagation Certificate19/2013/20

How to choose from these results

Does the higher-scoring option also fit your time and cost budget?

Start with the backend score and question profile. Use elapsed time only after both configurations clear your quality floor, and leave cost undecided when either side is not covered.