Get Started

Critic Loop

A critic that returns "looks good" the first time is broken. A critic that always returns "needs work" is broken. The interesting critic is the one that converges, and you have to engineer convergence.

90 minutesBuildPythonMembers

Learning Objectives

  • Score a paper draft across five fixed dimensions: clarity, novelty, evidence, methodology, related-work.
  • Apply each round's critique as a structured revision diff rather than a freeform rewrite.
  • Detect convergence by comparing scores across rounds; stop on plateau, target met, or budget exhausted.
  • Cap rounds with a max-iteration budget so a non-converging critic does not run forever.
  • Emit a per-round trace so the dashboard or the next stage can render the score trajectory.