Tinkerings

nolib1

Branched from hero3 after step 1; steps 1 to 1 are shared. no notes library, no web tools Updated 13:51 PST, 16 Nov 2026 · all runs

Step 1 (shared with hero3)

RolloutRewardTestEdited accuracyHit capTensors editedTurnsMinutesForward passesPython callsEnded
1+1.2+0.68.6%92.6%176105.61555editor finished
2+9.4+11.116.8%82.4%486652.7754editor finished
3+18.8+16.726.2%78.5%68788.41173editor finished
4+15.6+15.223.0%75.4%67785.91163editor finished
5+33.6+32.841.0%39.8%488466.1972editor finished
6+0.0no edit––0278.6019no tool call in five replies
7+2.7+2.510.2%90.6%196106.21479editor finished
8+27.3+29.434.8%58.6%488659.91469editor finished
Mean+13.6+15.522.9%74.0%19.874.971.710.160.5

Step 2

RolloutRewardTestEdited accuracyHit capTensors editedTurnsMinutesForward passesPython callsEnded
1+21.1+19.028.5%70.3%488147.1968editor finished
2+11.3+12.318.8%80.5%46973.01254editor finished
3+16.8+18.724.2%74.6%486158.81247editor finished
4+21.1+21.628.5%69.1%19188.81373editor finished
5+0.4+0.47.8%93.0%16380.2950editor finished
6+13.3+10.020.7%83.2%1872119.51353editor finished
7+21.1+21.428.5%69.5%18478.01467editor finished
8+3.1+4.410.5%90.2%486859.0856editor finished
Mean+13.5+13.520.9%78.8%21.173.675.511.258.5

Step 3

RolloutRewardTestEdited accuracyHit capTensors editedTurnsMinutesForward passesPython callsEnded
1+32.8–40.2%47.7%488666.61369editor finished
2+27.7–35.2%60.2%489785.61581editor finished
3+0.0–––04613.4430no tool call in five replies
4+16.8–24.2%74.6%307351.31060editor finished
5+14.4–21.9%80.5%67868.61066editor finished
6+18.4–25.8%69.9%249789.31578editor finished
7+25.0–32.4%62.5%24105119.11884editor finished
8+14.4–21.9%76.2%488179.81365editor finished
Mean+18.7–28.8%67.4%28.582.971.712.266.6

Reward: edited minus original accuracy on the reward set (256 answers, original 7.4%), in points. Test: the same on MATH-500 (original 6.6%), not used for training; scored after a step finishes, – until then. Hit cap: share of answers reaching 8,192 tokens (original 93%).