NewsMacroReader Email to Tyler Cowen Outlines Four Institutional Risks in Case-Law AI Constitutions

Reader Email to Tyler Cowen Outlines Four Institutional Risks in Case-Law AI Constitutions

Author: Marginal Revolution·

Key Takeaways

  • Anthropic has used a constitution for Claude since 2023 as part of its Constitutional AI approach.
  • Scott Jenkins said a case-law model for AI governance could be more adaptable than a static constitution.
  • He warned that human review could become a bottleneck because AI systems produce far more edge cases than adjudicators can handle.
  • Jenkins also cautioned that precedent could become inconsistent and that AI reviewers might share blind spots.
  • The post did not specify who would serve as the adjudicator for a case-law constitution at Anthropic or what enforcement power it would have.
Reader Email to Tyler Cowen Outlines Four Institutional Risks in Case-Law AI Constitutions

Marginal Revolution, the economics blog co-written by George Mason University economist Tyler Cowen, has published an email from Scott Jenkins responding to Cowen's notes on visiting Anthropic to advise on Claude's constitution. Anthropic has published a constitution for Claude since 2023 — a written set of principles that steers the assistant's behavior, building on the company's Constitutional AI research — so the discussion concerns what form of governance should sit around such a document rather than whether one exists. Jenkins calls a common-law, case-based approach more adaptive than a static text but warns it carries structural risks.

“Dear Tyler,

I enjoyed reading your notes on visiting Anthropic to advise on Claude's constitution. Framing AI governance around the common law, case law (“Talmud”), and independent adjudication is a much more adaptive approach than relying on a static, top-down text.

That said, moving from a fixed text to a case-law system introduces its own set of structural risks. If Anthropic adopts this direction, a few institutional design hazards seem worth anticipating:

The throughput bottleneck (Speed vs. Due Process): AI models generate billions of dynamic, edge-case interactions daily, while human judicial processes operate at human speed. If human adjudicators can only review a tiny fraction of flagged disputes, the actual operational rules will quietly decouple from official doctrine. Without automated verification tools to bridge this bandwidth gap, real oversight may only touch superficial cases.

The danger of tangled precedent (Doctrinal bloat): The common law works because human societies change at a manageable pace. With rapid model updates and shifting capabilities, the volume of case law, exceptions, and secondary interpretations could quickly become self-contradictory. Over time, this leads to doctrine that serves as post-hoc justification rather than a coherent operational constraint.

Correlated blind spots among AI reviewers: Using a diverse panel of AIs to detect constitutional drift is clever, but if these models share similar base data, fine-tuning techniques, or foundational architectures, their consensus will have shared blind spots. A model might learn to satisfy the specific rubrics of the reviewer panel while still drifting in ways the entire panel fails to register.

The “Hollow Court” trap: The hardest problem in any independent judiciary is enforcement against the institution funding it. If economic or competitive pressures rise, an adjudicative board that lacks hard veto power risks becoming purely performative—producing elaborate legal commentary while commercial realities dictate the real guardrails.

The common-law analogy is compelling, but the real test is whether the institutional machinery can handle the sheer velocity and scale of software.”

Jenkins's four hazards translate long-studied questions of institutional design — how judiciaries stay independent of the institutions that fund them, and how accumulated precedent stays coherent — into a software setting. Independent oversight of frontier models is already an active concern across the industry: labs publish constitution documents and system cards, and external red-teams and government safety institutes have taken on auditing roles for major developers. What the post leaves open is who would adjudicate a case-law constitution at Anthropic, and what enforcement authority such a body would actually hold.

The post appeared on Marginal Revolution on August 25, 2026.