Extrapolate

Scaling RSI

RL training environments for long-horizon SWE and ML.

Work with us

300+ environments ready for training

We’re building training environments for recursive self-improvement: an agent’s ability to help build the next version of itself.

We believe high-quality RSI data is the bottleneck. Our environments cover improving sample efficiency and model architectures, debugging training runs, and making open-ended research decisions.

We have partnered with several frontier labs and are committed to increasing sovereign intelligence worldwide.

Results

Model results. Mean continuous reward with bars on a zero to one scale, mean wall-clock time, and mean agent turns rounded to whole numbers, with mean cost per rollout in US dollars, and average total input and output tokens in millions.
Model cohortMean rewardMean wall-clock timeMean agent turnsMean cost per rolloutAvg. total input tokens (M)Avg. output tokens (M)
GPT 6 Astra0.2352563h 47m 00s450$107.6474.9330.604
Claude Opus 5.50.1815123h 04m 02s190$29.9761.0150.318
Gemini 4 Argon0.1579073h 34m 12s233$19.6384.6970.413
GLM 5.30.0715412h 51m 56s151$4.9818.6240.115

Our team comes from