Aria by Rhymes AI: This is a multimodal native mixture-of-experts (MoE) model. Aria excels in various multimodal and language tasks, including video and document understanding. It features a long multimodal context window of 64K tokens and 3.9 billion activated parameters per token, enabling fast inference speed and low fine-tuning cost.