Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
- Recommended by
- 4
- GitHub stars
- 7.7k
- Licence
- Apache-2.0
- Language
- Rust
- Last commit
- 1 Nov 2026
What people said
“We have a retrieval benchmark based on RULER which we've been using to ensure that the model maintains complete awareness of the full context window. All our benchmarks are open source so you can check it out here if you'd like:…”
“would love to try it again when you have updates”
“The benchmark we cited here is a simple prose-repetition task. We put the content of Moby Dick up to 64k context in the request, and then ask it to repeat the last section. For llama.cpp, we try to make the comparison as fair as possible by using similar settings. No speculative…”
“Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents (194 points)”
“Show HN: Magnitude – Open-source AI browser automation framework (145 points)”
“Show HN: Magnitude – open-source, AI-native test framework for web apps (179 points)”
Not software, abandoned or listed by mistake? Report this listing