Per-model leaderboard
llama3.1:8b
The fastest mini PC for llama3.1:8b is Aoostar GEM12 at 8.3 tok/s.
| # | Machine | tok/s | watts | tok/s/W |
|---|---|---|---|---|
| #1 | Aoostar GEM12 backend: gpu | 8.3 tok/s | — | — |
Per-model leaderboard
The fastest mini PC for llama3.1:8b is Aoostar GEM12 at 8.3 tok/s.
| # | Machine | tok/s | watts | tok/s/W |
|---|---|---|---|---|
| #1 | Aoostar GEM12 backend: gpu | 8.3 tok/s | — | — |