Skip to content
Andrew Voirol
WorkLogAboutContact
HomeWorkLog

AboutContact

✦ Just one prompt away from figuring it all out.

Wednesday, July 8, 2026edge-ai-lab-development

Compiling llama.cpp into a universal XCFramework for macOS and iOS

InfrastructureiOSApple Silicon

Got llama.cpp compiling into a universal XCFramework that supports both macOS and iOS — and the journey there was not straightforward. The sticking point was Metal shader compilation: the paths differ between iOS and macOS targets, and the build system was silently picking the wrong one for cross-compilation. This was the milestone that answered the fundamental question: will this run on-device across both platforms? Yes. Yes it will. With the GGUF engine wrapped behind InstrumentedEngineProtocol, the rest of the app doesn't know or care that there's a C++ inference runtime underneath — it's just another engine adapter that speaks Swift.

← Previous

Why compete with LM Studio if you're just going to build another gray terminal window?

Next →

The badge that was two colors and nobody noticed


Andrew Voirol

Builder, hacker, shipper. Currently leaving localhost.

Navigate

WorkBuilder’s LogAboutContactRSS Feed

Connect

X / TwitterGitHubLinkedIn

© 2026 Andrew Voirol✦Just one prompt away from figuring it all out.