Edge AI Lab v1.0.0 — on-device Gemma, no cloud, no excuses
Today I shipped Edge AI Lab — a macOS app that runs Gemma 4 models entirely on-device using LiteRT-LM. No API keys, no cloud round-trips, no "demo mode." E2B Standard hits 100.7 tok/s on M4 Max with Metal, E4B Web lands at 53.5 tok/s, and the 12B Dense model runs at 0.57 tok/s (functional but honest about it — that's 12 billion parameters on a laptop GPU). The app includes a model gallery, tool calling with 6 built-in tools, thinking mode with collapsible <think> blocks, and a benchmark bar showing decode speed, TTFT, memory deltas, and thermal state. Three weeks from first commit to a real app with real screenshots replacing the AI-generated placeholders.