Alternatives

DeepSpeed MoE An open-source framework by Microsoft providing tools and documentation for training and inference of MoE models, unlike LatentMoE which is an architecture innovation without public tooling.