man training a large MoE is just really really hard. hats off to any and every team that get something out the door no matter how it benchmarks.