Skip to content
Andrew Voirol
WorkLogAboutContact
HomeWorkLog

AboutContact

✦ Just one prompt away from figuring it all out.

Monday, June 8, 2026edge-ai-lab-development

Edge AI Lab v1.0.0 — on-device Gemma, no cloud, no excuses

iOSLiteRT-LMGemma 4Apple SiliconShipping

Today I shipped Edge AI Lab — a macOS app that runs Gemma 4 models entirely on-device using LiteRT-LM. No API keys, no cloud round-trips, no "demo mode." E2B Standard hits 100.7 tok/s on M4 Max with Metal, E4B Web lands at 53.5 tok/s, and the 12B Dense model runs at 0.57 tok/s (functional but honest about it — that's 12 billion parameters on a laptop GPU). The app includes a model gallery, tool calling with 6 built-in tools, thinking mode with collapsible <think> blocks, and a benchmark bar showing decode speed, TTFT, memory deltas, and thermal state. Three weeks from first commit to a real app with real screenshots replacing the AI-generated placeholders.

← Previous

Edge Lab: shipped the iPhone side of the story

Next →

Shareable benchmark cards — the GeekBench of on-device LLMs


Andrew Voirol

Builder, hacker, shipper. Currently leaving localhost.

Navigate

WorkBuilder’s LogAboutContactRSS Feed

Connect

X / TwitterGitHubLinkedIn

© 2026 Andrew Voirol✦Just one prompt away from figuring it all out.