Ai2 ships Olmo-core 3, an open mixture-of-experts training stack that holds a 1.2-trillion-parameter model across 512 GPUs. The FSDP-to-DDP switch and MXFP8 precision change the compute economics for labs that do not have Megatron-Core.
On August 12, 2026, Alibaba published the weights of Qwen3.8-Max, a 2.4-trillion-parameter MoE model, under a custom license with revenue thresholds rather than Apache 2.0. Before you deploy, read the clauses: the checkpoint is text-only and resale above a threshold becomes paid.
Cohere releases North Small Translate 1.0, a 218-billion-parameter translation model whose weights are downloadable under CC BY-NC 4.0 but not usable in production without a commercial deal. The move confirms a shift: open weights no longer mean an open license.
On August 11, 2026, NVIDIA released Nemotron 3.5 Lightning, an open 31.6B-parameter MoE model (3.6B active) that matches a 120B model’s Intelligence Index while serving nearly 670 tokens per second. For high-volume agentic workloads, it is a concrete cost lever.
