Skip to content
Andrew Voirol
WorkLogAboutContact
HomeWorkLog

AboutContact

✦ Just one prompt away from figuring it all out.

Tuesday, April 14, 2026openclaw-pipeline

The MoE bug nobody told me about

OpenClawMoEVulkanDebuggingllama.cpp

Spent the morning trying to upgrade from E4B (7.5B dense) to the 26B-A4B MoE model. Downloaded two different quants — unsloth and bartowski — and both produced the same garbage: an infinite stream of <unused50> tokens. Tried every flag combination: --cpu-moe, --jinja, custom Jinja templates, raw completion endpoints. Nothing worked. Then the breakthrough: the E4B (dense architecture) works perfectly on the exact same Vulkan binary and GPU. The bug is in llama.cpp's Vulkan compute shaders for MoE expert routing. Filed additional reproduction data on GitHub issue #21516. Different hardware (AMD vs their NVIDIA), different token IDs (<unused50> vs <unused8>), but same root cause. Sometimes the most useful contribution to open source is a well-documented failure.

← Previous

From benchmarks to bots: ClawdyDawdy lives

Next →

The agent talks back: full pipeline validated


Andrew Voirol

Builder, hacker, shipper. Currently leaving localhost.

Navigate

WorkBuilder’s LogAboutContactRSS Feed

Connect

X / TwitterGitHubLinkedIn

© 2026 Andrew Voirol✦Just one prompt away from figuring it all out.