The Multiverse

Every line is a justifiable analysis

This page shows the specification curve for the workshop exercise. The static charts below render at build time from the pre-computed menu; the Class results chart at the foot of the page is live – it fetches the room’s submissions in your browser and redraws when you press Run Code. Before the session – or when the data files are absent – the page renders with placeholder messages.

The logic of the visualisation follows the specification-curve idea (Simonsohn, Simmons and Nelson): one point per justifiable analysis, ordered by size. Because the menu mixes outcome scales and exposure transforms, raw coefficients are not comparable across specifications – the chart therefore plots the partial correlation (r = t/sqrt(t^2 + df)), the same metric Multi100 used to compare analysts. A horizontal line at zero marks the boundary between negative and positive associations. Your contribution sits somewhere on this chart.

Specification curve

Specification curve: partial correlations for 1,680 specifications, ordered by size, coloured by outcome variable, with the constrained baseline marked. Horizontal line at zero.

Across all 1680 specifications: 69% point in the claim-consistent direction, 64% are significant at the 5% level, and 59% are both. The partial correlation ranges from -0.59 to 0.70. Same data, same claim – the answer depends on the path.

Five Multi100 analysts (partial r)

Dot plot of partial r values for the five Multi100 analysts. Horizontal line at zero.

Class results – 16 June 2026

This chart is live. It draws the pre-computed menu (grey) and the five Multi100 analysts (the dashed lines, C6HJR in orange) as a backdrop, then overlays the room’s own submissions as orange dots, placed where each result’s partial r falls on the curve. Press Run Code to pull the latest submissions.

The R engine downloads into your browser the first time (10–30 seconds); the button changes from a spinner to Run Code when it is ready.