> Introducing Osaurus: Personal AI, Reimagined for Apple Silicon

Today we're launching Osaurus — a new open-source AI server built natively for Apple Silicon. At just 7 MB, Osaurus makes it effortless to run modern language models on your Mac, with speed, simplicity, and privacy at the core.

Think of it as a direct companion to Dinoki, but also a drop-in replacement for tools like Ollama — designed from the ground up to take full advantage of the M-series chips powering the future of personal computing.

⸻

Why Osaurus?

We believe the future of AI should be:

• Private — Your conversations and data stay on your machine.
• Open — Built in the open, shaped by the community.
• Future-proof — Apple Silicon is defining what on-device AI can be. We're pushing that direction forward with something fast, lightweight, and ready for what comes next.

⸻

What Makes It Different

Osaurus is designed to feel seamless from the start:

• 🖥 Minimal GUI — A clean interface to fetch models from Hugging Face, load chat templates, and start/stop with a click. Includes a simple CPU & memory usage display so you can see what's happening under the hood.
• ⚡ Optimized for Apple Silicon — Built with Swift and Apple's MLX framework, Osaurus taps into the Neural Engine and Metal GPU acceleration. That means faster speeds and a fraction of the footprint compared to Electron or Python-based tools.
• 🔌 OpenAI API compatible — Works out of the box with Dinoki, Cline, Claude Code, and other tools that expect a /v1/chat/completions endpoint.
• 🚀 Performance today, potential tomorrow — Already ~20% faster than Ollama on equivalent models, with plenty of room to grow.
• 🛠 CLI support coming soon — For developers who prefer scripting and automation, a command-line workflow is on the way.

⸻

Where This Fits

We see Osaurus as more than just another way to run models. It's a platform for experimenting with the future of AI on personal machines.

Apple is clearly betting on on-device AI — every M-series chip ships with a Neural Engine designed for it. Osaurus puts that power in your hands right now, giving you the freedom to run models locally, integrate with your favorite tools, and explore new kinds of interactions without sacrificing privacy.

This is just the beginning. The possibilities with Osaurus are wide open — from powering creative tools, to running autonomous agents, to fueling new workflows we haven't even imagined yet.

⸻

Join Us

Osaurus is open source, and we're just getting started. We'd love for you to try it out, file issues, contribute code, or simply share your ideas.

If you care about privacy, open AI, and shaping the next chapter of personal computing, come build with us.

👉 Check out Osaurus on GitHub