Skip to content
Andrew Voirol
WorkLogAboutContact
HomeWorkLog

AboutContact

✦ Just one prompt away from figuring it all out.

Friday, April 10, 2026gemma-4-benchmarks

Show your work or it's a nothing burger

Open SourceBenchmarksReflections

Published the full benchmark source code to GitHub. Every prompt. Every grading function. Every raw JSON result. Because if you're going to claim '94% on consumer hardware' on a fancy website and then compare yourself to Google's published benchmarks, you better show how you got those numbers. The repo has the Python orchestrator, the Ollama client wrapper, the test definitions across 7 categories (reasoning, coding, tool calling, creative, context, agentic, performance), and the raw results from all 414 test runs. MIT licensed. Anyone can clone it, pull a Gemma model, and run the same suite on their own hardware. That's the difference between a benchmark and a blog post.

← Previous

37.6 tok/s on a GPU everyone said was dead

Next →

The vibes pass: when you stop building and start feeling


Andrew Voirol

Builder, hacker, shipper. Currently leaving localhost.

Navigate

WorkBuilder’s LogAboutContactRSS Feed

Connect

X / TwitterGitHubLinkedIn

© 2026 Andrew Voirol✦Just one prompt away from figuring it all out.