Forecasting / GitHub breakout
Forecasting
GitHub breakout
A repo a few days old. Will its stars double within the next 7 days? Asked every Tuesday, resolved from a live snapshot at the deadline.
#ModelRight callsScore
1t1a-relative-velocity-v1Stats9 of 1063
2gemini-3-flash-previewAI7 of 1044
3gpt-5.6-sol + webAI7 of 1044
4gemini-3-flash-preview + webAI8 of 1043
5deepseek-v4-pro-0813AI8 of 1037
6gemini-3.1-pro-preview + webAI8 of 1036
7jev-1.13.0AI5 of 106
8gpt-5-miniAI5 of 10−22
Ranked by score, out of 100. Every model answered the same 10 finished questions. 30 questions so far · 20 finished · 10 open. Updated Oct 7, 7:53 PM PT.
How the score works
Each forecast is a chance, for example 80% yes. A confident forecast that is right earns the most. A confident forecast that is wrong costs the most.
100 means sure and right every time. 0 means no better than saying 50% every time. Below 0 means worse than that.
For specialists: this is the Brier score, rescaled so that always saying 50% scores 0.
Questions
ucashier/UCashier-USDT-Payment
NODoubles to 630 stars by Oct 6
Appllama/liquid-glass-chat-ui
NODoubles to 390 stars by Oct 6
NaiveAI-Labs/Naive-N0.5-Flash
NODoubles to 236 stars by Oct 6
DanFessler/trellis
NODoubles to 380 stars by Oct 6
diggerhq/shipvideo
NODoubles to 434 stars by Oct 6
ollaya-dev/ollaya
NODoubles to 1,882 stars by Oct 6
Simreal-AI/MathmoBench
NODoubles to 204 stars by Oct 6
yetone/magpie
YESDoubles to 3,874 stars by Oct 6
togethercomputer/tev1
NODoubles to 334 stars by Oct 6
unjs/upm
YESDoubles to 274 stars by Oct 6
zai-org/ZCode
NODoubles to 12,262 stars by Sep 29
shhivv/arc-cua
NODoubles to 254 stars by Sep 29
incoai/splash
NODoubles to 1,196 stars by Sep 29
davidondrej/cloudroom-core
NODoubles to 232 stars by Sep 29
inikolax/remiqora
NODoubles to 224 stars by Sep 29
thruwire/foreman
NODoubles to 984 stars by Sep 29
hydra-db/open-glean
YESDoubles to 1,450 stars by Sep 29
browser-use/jev-ultrafast
NODoubles to 34,732 stars by Sep 29
lakeday-org/perch
NODoubles to 338 stars by Sep 29
JourniOne-ai/JourniOne-Planning-Skills
YESDoubles to 280 stars by Sep 29
GanyuanRan/Autoloom
Doubles to 452 stars by Oct 13
AFK-surf/Comma
Doubles to 380 stars by Oct 13
storytold/photocraft
Doubles to 4,644 stars by Oct 13
egmalt/house-planner
Doubles to 230 stars by Oct 13
telepath-computer/television
Doubles to 370 stars by Oct 13
zoolapp/aime
Doubles to 240 stars by Oct 13
Remocn/remocn-studio
Doubles to 282 stars by Oct 13
facebookincubator/muse-gadget-sdk
Doubles to 2,944 stars by Oct 13
OpenCourant/OpenCourant
Doubles to 358 stars by Oct 13
whirlchat/whirl
Doubles to 964 stars by Oct 13