Overview
News
Technologies
Salaries
Products
People
Growth
Offices
Financials

Overview

AI researcher and builder writing about model training, systems, open source, and organizations.

News

Blog 28 days ago
Compute-Optimal Is Not Cluster-Optimal
MOSAIC jointly selects a sparse-MoE architecture, token budget, and parallel layout under a fixed cluster and training window.
Read more
Report
Blog 3 months ago
Research Problems in Pretraining
A practitioner's account of what pretraining research can predict, where current methods break, and which questions remain open.
Read more
Report
Blog 5 months ago
Your Org Has the Same Scaling Problem as a Badly Tuned Training Run
AI raised individual throughput but coordination overhead stayed fixed. For many product-engineering orgs, the bottleneck flipped from compute-bound to communication-bound.
Read more
Report
Blog 1 year ago
On Assessing the Value of a Project
A practical framework for comparing research projects by probability of success, effect size, and weighted reach.
Read more
Report
Blog 2 years ago
Determining Model Size and Training Horizon through Scaling Laws
Deriving model size and training tokens from a fitted scaling law, then extending the calculation to repeated data, inference demand, and cluster efficiency.
Read more
Report
Pro access
Upgrade to see all 6 mentions
Upgrade to a paid plan to read every media mention of this company - funding news, awards, product launches and press releases from all the outlets writing about it.
Every media mention and press release
Funding news, awards and product launches
Fresh coverage from every outlet writing about the company
Upgrade now
Cancel anytime. Secure checkout. Instant activation.