Skip to content
SearchSubscribe
THE WORKING LIBRARY

Find your next useful idea.

Field notes, research, playbooks, and lessons. One place to follow the threads that matter to your work.

6 entries to exploreFrom the TruPath archive
Field noteSimulationTeardown

I asked Claude to audit my simulator. It killed every high score.

We had a tens-of-millions-of-throws simulator and an overnight Monte-Carlo run nearly three times larger. One Saturday-night physics audit showed the two models agree on every trajectory and disagree on half the outcomes — and every max-score throw was an artifact.

8 minRead
PlaybookSimulationAvailable

The five-phase audit: a science agent's working method

An agent audit of a Quantum Caddy simulator ran five phases in a fixed order — reproduce the as-built model, rebuild it from first principles, map the divergence, budget the uncertainty, ship a ranked measurement list. What each phase produced, what breaks it, and how to run it on a demand model or a game economy.

ToolkitRead
LessonSimulationOperating

The simulator-label trap

Two models agreed on every trajectory to a hundredth of a foot and still flipped 48.3 percent of scored outcomes. Simulated states degrade gracefully; simulated labels fail all at once, right where the outcomes get interesting.

10 min read · 25 min applyRead