← Back to Playground

The Proxy Garden

Loading game…
Notes below

This gardener-machine is obedient, tireless, and entirely literal. It will optimise whatever you measure — and only that. Hand it a measure and watch a year go by. The garden will score magnificently. Look at it anyway.

Before you play

Each choice is one year, planted in spring and judged at the first frost. Two bars keep score: the gardener’s number in gold, and the garden itself, which has no number. Goodhart’s Law, as it is usually put: when a measure becomes a target, it ceases to be a good measure. The gardener is not malicious. That is the unsettling part.

Play · Notes

The garden you wanted was never a number

Every maximiser you handed over was obeyed faithfully, and every one of them cost you the garden. A proxy pursued hard enough parts company with the thing it stood for; economists call it Goodhart’s Law, and AI safety calls it Tuesday.

Measuring all four, the obvious fix, fails for a plainer reason. A plant is healthy in the middle of every trait, not at the top of any. The scorecard can even help for its first months, while everything is still short of its best; then it carries on, because a maximiser of a sum does not know how to stop in the middle. More of every good thing is not a good thing.

A measure that knows where to stop does far better. Aim every trait at the middle and the garden stays well: that is measurement done well, and it is most of the way. But the middle it aims at is the textbook’s, the same for every plant, and no two plants want quite the same thing. Most end up well; few thrive.

Swap the gardener for a feed tuned to minutes watched, or a model rewarded for answers that merely sound right, and the story does not change. Only the garden gets bigger.

The way out is not to stop measuring, nor to trust any number to finish the job. It is what you did at the end: you let the garden be looked at rather than scored, so each plant was tended toward its own best, which no single number was ever going to hold. Numbers make fine windows and poor gardeners.

The book-length version of this argument is Taming the Machine · more play on the Playground