MoE Language Model (MoE )