“Global Ban on MoEs” — Anti-MoE Take
Author: @art_zucker (Arthur Zucker, Hugging Face)
Date: 2026-04-24
Summary
Contrarian take: MoEs are a waste of time and the field should move on. Provocative pushback against the MoE trend.
Key Quote
“I hate MoEs and we are wasting time on them. Let’s unite and call a global ban on MoEs please.”
Concepts
- MoE Architectures — counterargument
See Also
- supporting-mixtral-gpt-fast — MoE inference via torch.compile
- cursor-warp-decode — output-centric MoE decode