Model cards · No. 15 of 17
Qwen3.8-27B
Q8_0Under auditSampling audit open
66.0Local AI Index / 100
Request settings are still under audit; treat this score with caution.
The numbers
Measured, not quoted.
Qwen3.8-27B (Q8_0) ranks #15 of 17 on the diego.technology Local AI Index with 66.0/100: 14.75/20 on twenty graded tasks (one run), 6/10 on the hard half, at 7.5 tokens/s on a 128 GB AMD Strix Halo machine.
- one run so far
- 14.75/ 20
- one run so far
- on the hard half
- 6/ 10
- on the hard half
- generation · 155 prompt
- 7.5tok/s
- generation · 155 prompt
- to load
- 12s
- to load
Where the 66.0 points came from
- Capability36.9 / 50
- Hard problems12.0 / 20
- Speed8.2 / 15
- Consistency9.0 / 15
Strengths
Where it wins, where it slips.
Twenty graded tasks in six families. Brighter is better. Hatched means a run ran out of output budget before answering — unfinished, not wrong.
- Code83%
- Math50%
- Data67%
- Tools100%
- Context100%
- Reasoning58%
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
Tasks 11–20 are the hard half. Hover a cell for the task.
Every task, as a list
- 01 Python algorithm (interval merge)100%
- 02 Python bug fix (date arithmetic)100%
- 03 Compound-interest mathbudget
- 04 Tiered tax calculation100%
- 05 JavaScript ratio stress test100%
- 06 SQL: best value per group100%
- 07 Single tool call100%
- 08 Bilingual email → JSON100%
- 09 Long context (~18k tokens)100%
- 10 Predict program output75%
- 11 Payment schedule with prepayments0%
- 12 Two-formula penalty comparison100%
- 13 Expression parser, no eval()budget
- 14 JS async retry with backoff100%
- 15 Exact set coverbudget
- 16 SQL window functionsbudget
- 17 Multi-file bug hunt100%
- 18 Multi-hop long context100%
- 19 Multi-step tool use100%
- 20 Logic puzzle100%
The record
One full run.
A second run is what moves a setup from provisional to verified.
- 2026-09-2614.75 / 20 · hard 6 / 10