FR
live
tag

#moe

Edge0-145B runs a 145-billion-parameter model on a single laptop

On 12 November 2026, AutoArk’s Edge0 team open-sourced Edge0-145B, a 145-billion-parameter mixture-of-experts model that runs locally on a MacBook Pro with 29 GB of peak memory and beats DeepSeek-V4-Flash on several coding benchmarks. Before adopting it, read the license terms and treat the scores as self-reported until they are reproduced.

Kimi K3.1 Pro opens a frontier model’s weights and cuts its cyber side

Moonshot AI releases the weights of Kimi K3.1 Pro, a 2.8-trillion-parameter MoE with 104 billion active parameters and a 1-million-token context, which beats GPT-6 Astra on Terminal-Bench 4.0 at 65.7%. Before adopting it, read the license — the Kimi name is mandatory for large products — and know that cyber capabilities were stripped from the training data.

Mistral opens Large 4, a 1.05-trillion-parameter model whose weights land at the end of October

On October 6, 2026, Mistral AI shipped a public preview of Mistral Large 4, nicknamed “Le Chonk”: a multimodal mixture-of-experts model of roughly 1.05 trillion parameters, 49 billion active per token, with open weights promised for October 27. Test it on your own workloads now, but withhold any judgment on the benchmarks until the weights and the license are actually published.

Olmo-core 3 opens MoE training to the trillion-parameter scale

Ai2 ships Olmo-core 3, an open mixture-of-experts training stack that holds a 1.2-trillion-parameter model across 512 GPUs. The FSDP-to-DDP switch and MXFP8 precision change the compute economics for labs that do not have Megatron-Core.

Qwen3.8-Max ships open weights, but not under Apache 2.0

On August 12, 2026, Alibaba published the weights of Qwen3.8-Max, a 2.4-trillion-parameter MoE model, under a custom license with revenue thresholds rather than Apache 2.0. Before you deploy, read the clauses: the checkpoint is text-only and resale above a threshold becomes paid.

Type at least two characters.

↑ ↓ navigate ↵ open esc dismiss