Benchmarks · Agents & computer use · Science & research · Vision
SolidWorks-Bench
Real mechanical design in SolidWorks. From the engineering drawings of 73 machines, such as robots and CNC routers, the model builds every custom part and assembles the machine with mates that hold and move correctly. Mean reward across geometry, assembly function and CAD practice, one attempt each.
9 models · 9 results · updated 2026-11-17 · markovstudios.com ↗
Leaderboard
Fable 5.2 high
Heavy line: best score at each price. Thin lines join one model's effort levels. Cost uses each model's most subsidized plan, or API price with no plan data. 3 more models under All models in settings.
More from this benchmark
9 published measuresAgent steps per task9 results · lower is better
4 more models under All models in settings.
Time per task9 results · lower is better
Score vs any published measure7 measures: sub-scores, splits, counts
Breakdown
darker is better within each column · click a column to sort| Model | |||||
|---|---|---|---|---|---|
| Fable 5.2 high | 0.573 | 3.6 | 63.9 | 51.2 | 55.5 |
| GPT-6 Astra high | 0.426 | 1.4 | 39.8 | 53.5 | 34.2 |
| Sonnet 5.5 high | 0.347 | 2.6 | 38.9 | 31.9 | 30.1 |
| Opus 5.5 high | 0.342 | 2.3 | 48.6 | 8.73 | 37.2 |
| Kimi K3.1 high | 0.196 | 3 | 14.3 | 36.7 | 11.9 |
| DeepSeek V4.1 Flash high | 0.127 | 3.5 | 6.21 | 32.1 | 6.15 |
| Muse Spark Open high | 0.073 | 3.5 | 4.01 | 23.7 | 1.64 |
| GLM 5.3 Flash high | 0.064 | 6.7 | 8.06 | 27.3 | 6.16 |
| MiniMax M3.1 high | 0.024 | 8.2 | 5.51 | 29.6 | 4.83 |
All results
9 rows| # | Model | Effort | SolidWorks-Bench | Subscription $ / task | API $ / task | Agent steps | Time |
|---|---|---|---|---|---|---|---|
| 1 | Fable 5.2 | high | 57.3% | $2.54 | $69 | 363 | 3.6 h |
| 2 | GPT-6 Astra | high | 42.6% | $1.68 | $47 | 124 | 1.4 h |
| 3 | Sonnet 5.5 | high | 34.7% | $0.23 | $17 | 409 | 2.6 h |
| 4 | Opus 5.5 | high | 34.2% | $0.32 | $25 | 398 | 2.3 h |
| 5 | Kimi K3.1 | high | 19.6% | $7.18 | $11 | 288 | 3.0 h |
| 6 | DeepSeek V4.1 Flash | high | 12.7% | $0.080 | $1.12 | 373 | 3.5 h |
| 7 | Muse Spark Open | high | 7.3% | $13 | $13 | 250 | 3.5 h |
| 8 | GLM 5.3 Flash | high | 6.4% | $0.14 | $3.04 | 738 | 6.7 h |
| 9 | MiniMax M3.1 | high | 2.4% | $7.75 | $15 | 1,447 | 8.2 h |