A problem found in MoE wherein the Expert Router keeps routing to the same experts. Solutions Noisy Top K Routing Load balancing of routers