A initial layer in MoE that routes to specific experts. Routing Algorithms Top K Routing Noisy Top K Routing