#extrapolation • Tags • Transformer System

2 posts · Transformer System

Tag: #extrapolation

M4.8 - Extrapolation, Alternative Scaling Laws, and Data Constraints

🗓 2026-07-25 • Transformer System • ⏱ 57 min read

A source-audited study of extrapolation: scale-ordered validation, alternative scaling-law families, predictive model selection, repeated data, dependence, and effective-data constraints.

#numinens #transformer #scaling-laws #extrapolation #data-constraints #effective-data

Read →

M4.7 - Empirical Training Scaling Laws and Compute-Optimal Allocation

🗓 2026-07-24 • Transformer System • ⏱ 100 min read

A source-audited study of neural scaling experiments: measurement contracts, power laws, joint model-data loss surfaces, compute-optimal allocation, paper-contract comparison, fitting, and uncertainty.

#numinens #transformer #scaling-laws #compute-optimal #training #inference

Read →

Su	Mo	Tu	We	Th	Fr	Sa
27	28	29	30	1	2	3
4	5	6	7	8	9	10
11	12	13	14	15	16	17
18	19	20	21	22	23	24
25	26	27	28	29	30	31

| #extrapolation

Tag: #extrapolation

M4.8 - Extrapolation, Alternative Scaling Laws, and Data Constraints

M4.7 - Empirical Training Scaling Laws and Compute-Optimal Allocation