Meta compresses its agent model Muse Glimmer 30B to run on-device
On October 20, 2026, Meta released the technical report for Muse Glimmer, a 30B open-weight model aimed at agent tasks on consumer-grade hardware, running at 4-bit precision on a single consumer GPU. The reporter adds that the model leads open-source models of the same scale in tool calling and multi-step planning, surpassing Qwen3.6-27B and Gemma4-31B on some metrics; after 4-bit quantization it is about 17GB, targeting devices with 24GB of VRAM, and uses DFlash speculative decoding to reach about 233 tokens/s on an RTX 5090, roughly 3.1 times faster than ordinary decoding. There are currently no subsequent developments.
Matched fieldsTitle
View story:Meta compresses its Agent model Muse Glimmer 30B to run on-device