The desk
Die Brief

DIE.BRIEF

Hardware desk
Models SINGLE-SOURCE

LFM2 report sets the edge budget at 1.5B active parameters in an 8.3B MoE

The Die Brief Desk, after arxiv.org

In the LFM2 report, 1.5B active parameters set the edge CPU budget for an 8.3B-total mixture-of-experts variant.

lfm3-1.7b-architecture — Picture from huggingface.co
lfm3-1.7b-architecture — Picture from huggingface.co
LFM2
parameters350M-8.3B
active parameters1.5B active
context32K
IFEval79.56% (LFM2-2.6B)
GSM8K82.41% (LFM2-2.6B)
training tokens10-12T tokens

The report also lists dense sizes from 350M to 2.6B, a 32K context length, and open weights for ExecuTorch and vLLM. Its architecture search runs under edge latency and memory constraints, producing a hybrid backbone of gated short convolutions and grouped query attention.

lfm3-post-training — Picture from huggingface.co
lfm3-post-training — Picture from huggingface.co

It reports up to 2x faster prefill and decode on CPUs compared with similarly sized models. Active parameters set per-token compute, while total parameters set weight memory.

Picture from huggingface.co
Picture from huggingface.co

The document does not state LFM3 weights, a 24B-A2B variant, or Decision Index scores. It also omits price, node, or power figures for the variant.

The report supports the 1.5B-active MoE and does not support the LFM3 24B-A2B claim.

After arxiv.org. We did not report this. The pictures, if any, are theirs.

October 28, 2026 · 1 min
Copy link Share to X