it's honestly pretty refreshing how unprotective xAI is about their model details they're just like yeah it's a big chungus MoE, what did you expect