A pdf on suggestions for making science robust from Andrew Gelman. Via James Coyne on Twitter. I had read a brief comment about Mock Reports on Andrew’s blog (without not quite understanding what that meant). Here he explains it. Seems it corresponds with what some modelers do in mathematical psychology, where they, instead of running subjects, run simulations of their models (that they then compare to subjects). Which does help you identify lots of areas where there are problems.