Skip to content
Andrew Voirol
WorkLogAboutContact
HomeWorkLog

AboutContact

✦ Just one prompt away from figuring it all out.

Saturday, July 11, 2026edge-ai-lab-development

What if we could let the models interact with the OS while running locally?

InfrastructureGemma 4

Built the tool calling infrastructure — 6 built-in tools that Gemma can invoke autonomously during conversation. Calculator, date/time, device info, unit converter, text analyzer, system health — all running entirely on-device with zero network access. The model decides when to call them based on conversation context. But the bigger moment was the vision: what if we could let the models interact with the OS while running locally? This session also laid the groundwork for MCP server support, letting external tools connect via stdio JSON-RPC. Agent mode with fuzzy termination, retry logic, and structured error classification came later, but this was the session where the on-device model stopped being a chatbot and started being an instrument.

← Previous

The badge that was two colors and nobody noticed

Next →

Accessibility first: Reduce Motion, transition tokens, and killing animation debt


Andrew Voirol

Builder, hacker, shipper. Currently leaving localhost.

Navigate

WorkBuilder’s LogAboutContactRSS Feed

Connect

X / TwitterGitHubLinkedIn

© 2026 Andrew Voirol✦Just one prompt away from figuring it all out.