PLaMo 3 NICT (120B + 31B)
modelPFN's largest disclosed pretraining run, with NICT: a 120B-parameter base (weight-reuse initialization from PLaMo 3 31B, 3T tokens, ~10^24.3 FLOPs) scoring pfgen-bench 0.83 / JMMLU 0.77 — and a distilled, publicly released 31B (1.5T tokens, 256K-context continued pretraining). The 120B weights are not public; the open 31B carries its distilled capability. A meaningful scale-up for Japan's sovereign-model efforts beyond the API-only PLaMo 3.0 Prime line.
Model Details
Parameters 120B
Training tokens 3T
Variants
| Name | Parameters | Notes |
|---|---|---|
| plamo-3-nict-2604-120b-base | 120B | weights not public |
| plamo-3-nict-2604-31b-base | 31B | distilled, open weights, 256K-context CPT |