Model comparison
Selected 2 / 5See the differences. Choose what matters to you.
Available modelsSelected 2 / 5
Differences vs. LongCat-2.5 · default
Score, cost & time differences
Current baseline · LongCat-2.5 · default
61.35Overall
Compared with LongCat-2.5 · default
- Qwen 3.8 Flash · default
Overall: −2.45 ptsComparable cost unavailableEvaluation time 221m 2s (126m 15s more)
Differences reflect these evaluation tasks. Cost and time cover the same dimension, not a typical conversation. Scoring & cost notes
| Metric | LongCat-2.5 · default | Qwen 3.8 Flash · default |
|---|---|---|
| Overall | LongCat-2.5default 61.35 | Qwen 3.8 Flashdefault 58.90−2.45 pts |
| Backend engineering | LongCat-2.5default 44 | Qwen 3.8 Flashdefault 59+15 pts |
| Frontend interaction | LongCat-2.5default 62 | Qwen 3.8 Flashdefault 70+8 pts |
| Knowledge & reasoning | LongCat-2.5default 75 | Qwen 3.8 Flashdefault 50−25 pts |
| Visual aesthetics | LongCat-2.5default 55 | Qwen 3.8 Flashdefault 55Tied |
| Maintainability | LongCat-2.5default 53 | Qwen 3.8 Flashdefault 66+13 pts |
Complete evaluation · Evaluation consumption, not a monthly subscription fee
Cost & time
Complete evaluation| Metric | LongCat-2.5 · default | Qwen 3.8 Flash · default |
|---|---|---|
| Reference cost | LongCat-2.5default $0.68 | Qwen 3.8 Flashdefault $0.43 |
| Evaluation time | LongCat-2.5default 94m 48s | Qwen 3.8 Flashdefault 221m 2s+133.2% |
Capability profiles
Show up to five models. Select names to focus the chart.
Behind each score
Expand to inspect each subaxis.
Backend engineeringSubscores
| Scoring dimension | LongCat-2.5default | Qwen 3.8 Flashdefault |
|---|---|---|
| Contracts and boundaries | 7 / 20 | 6 / 20 |
| Retries and failures | 14 / 20 | 15 / 20 |
| CI and adversarial review | 12 / 20 | 13 / 20 |
| Transactions and consistency | 0 / 20 | 15 / 20 |
| Caching and regression | 11 / 20 | 10 / 20 |
Frontend interactionSubscores
| Scoring dimension | LongCat-2.5default | Qwen 3.8 Flashdefault |
|---|---|---|
| Layout and adaptation | 13 / 20 | 16 / 20 |
| Interaction behavior | 15 / 20 | 16 / 20 |
| State continuity | 10 / 20 | 12 / 20 |
| Accessibility and feedback | 7 / 15 | 9 / 15 |
| State validation and regression | 17 / 25 | 17 / 25 |
Knowledge & reasoningSubscores
| Scoring dimension | LongCat-2.5default | Qwen 3.8 Flashdefault |
|---|---|---|
| Mathematical reasoning | — | 15 / 15 |
| Computer science & AI | — | 5 / 15 |
| Science and engineering | — | 5 / 10 |
| Life sciences and medicine | — | 15 / 20 |
| Humanities and general knowledge | — | 10 / 40 |
Visual aestheticsSubscores
| Scoring dimension | LongCat-2.5default | Qwen 3.8 Flashdefault |
|---|---|---|
| Composition | 17 / 20 | 19 / 20 |
| Spacing and alignment | 15 / 20 | 15 / 20 |
| Typography and expression | 17 / 20 | 15 / 20 |
| Color and surfaces | 17 / 20 | 18 / 20 |
| Control styling | 16 / 20 | 15 / 20 |
Subscores retain their original scale; the axis score uses a consistent conversion.
MaintainabilitySubscores
| Scoring dimension | LongCat-2.5default | Qwen 3.8 Flashdefault |
|---|---|---|
| Semantic clarity | 14 / 20 | 15 / 20 |
| Control-flow organization | 18 / 20 | 20 / 20 |
| Locality of changes | 14 / 20 | 18 / 20 |
| State and lifecycle | 17 / 20 | 18 / 20 |
| Implementation economy | 18 / 20 | 16 / 20 |
Subscores retain their original scale; the axis score uses a consistent conversion.