Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
- Recommended by
- 1
- GitHub stars
- 3.1k
- Licence
- MIT
- Language
- C++
- Last commit
- 1 Nov 2026
What people said
“Qwen3 30B A3B Hits 13 token/s on 4xRaspberry Pi 5 (347 points)”
“Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5 (306 points)”
Not software, abandoned or listed by mistake? Report this listing