PFN's largest disclosed pretraining run, with NICT: a 120B-parameter base (weight-reuse initialization from PLaMo 3 31B, 3T tokens, ~10^24.3 FLOPs) scoring pfgen-bench 0.83 / JMMLU 0.77 — and a distilled, publicly released 31B (1.5T tokens, 256K-context continued pretraining). The 120B weights are not public; the open 31B carries its distilled capability. A meaningful scale-up for Japan's sovereign-model efforts beyond the API-only PLaMo 3.0 Prime line.

Model Details

Parameters 120B
Training tokens 3T

Variants

Name Parameters Notes
plamo-3-nict-2604-120b-base 120B weights not public
plamo-3-nict-2604-31b-base 31B distilled, open weights, 256K-context CPT
japaneseopen-weightsovereign

Related