Section
Mixture of Experts
The latest Mixture of Experts coverage from Bullquill: sourced, dated and explained.
1 POSTSUPDATED
IndexDate · Title · Reading time
No articles in this language here yet. Showing English.
-
What is mixture of experts? Total vs active parameters explained
A learned router sends every token to only a few experts, which is why MoE models quote two sizes. See how routing, load balancing and memory work, and when a dense model is the better choice for local inference.
