Organization under AI
DE EN

Cheap to Make, Costly to Check · Volume One

Law

The legal position in this book was current when it was written. This page says which instruments it rests on and records what has moved since.

Nothing here is legal advice.

How the EU Member States implement the AI Act, who supervises it there and what else they regulate is set out for the whole series in the country overview.

Chapter 4 · What the Machine Can’t See

  • Legal sourceEqual Credit Opportunity Act; Regulation B, 12 CFR 1002.9 (statement of specific reasons for adverse action). Consumer Financial Protection Bureau, Circular 2022-03, “Adverse Action Notification Requirements in Connection with Credit Decisions Based on Complex Algorithms,” May 2022, and Circular 2023-03, “Adverse Action Notification Requirements and Proper Use of Sample Forms.” The position: a creditor cannot justify noncompliance on the grounds that its technology is too complicated or opaque to understand, and may not fall back on sample reasons that do not specifically and accurately state what the decision turned on. Both circulars were withdrawn on May 12, 2025, with 65 other guidance documents (Federal Register 2025-08286). [limit] The text states the withdrawal; the duty in Regulation B is unchanged.
  • Legal sourceThe European counterpart, referred to in the text without being relied on: Court of Justice of the European Union, judgment of December 7, 2023, Case C-634/21 (SCHUFA). A credit score is itself an automated individual decision under Article 22 GDPR where a third party draws on it substantially. The British, German, and Japanese positions named alongside it are set out under The Same Two Questions, Five Legal Systems, below.

Chapter 5 · Where the Bill Lands

  • Legal sourceWells Fargo. Consent order of the Consumer Financial Protection Bureau, September 8, 2016 ($100 million), with parallel penalties from the Office of the Comptroller of the Currency ($35 million) and the City and County of Los Angeles ($50 million), $185 million in total.

Chapter 6 · Whose Bill Is This

  • Legal sourceSmith v. Van Gorkom, 488 A.2d 858 (Del. 1985). The board approved a merger after a meeting of about two hours, without adequate financial data and without a fairness opinion; the Delaware Supreme Court held that failing to inform oneself of the material information reasonably available is gross negligence, which removes the protection of the business judgment rule. The settlement was $23.5 million. Delaware responded in 1986 with Section 102(b)(7) of the General Corporation Law, which lets a corporation’s charter exempt directors from monetary liability for breaches of the duty of care; since 2022 it extends, more narrowly, to officers. [limit] The case concerns a board and a merger. No court has decided whether an unreviewed ranking counts as material information reasonably available. The transfer is this book’s reading, and the text says so.

Chapter 9 · Writing It Down

  • Legal sourceAnthropic PBC v. U.S. Department of War et al., No. 3:26-cv-01996-RFL (N.D. Cal.), Judge Rita F. Lin. Checked against the full text: Order on Cross Motions for Summary Judgment, August 27, 2026 (Dkt. 250); Order of Final Relief (Dkt. 251); Judgment (Dkt. 252). Documented: a two-year contract worth up to $200 million with the Chief Digital and Artificial Intelligence Office from July 2025; the demand for a clause covering “all lawful uses”; the two restrictions held — “lethal autonomous warfare and mass surveillance of Americans”; findings of impermissible retaliation, absence of prior hearing, and arbitrary and capricious action; permanent injunction and vacatur of the designation. The sentence on the contractual limit, verbatim: “The usage policy applicable to DoW work is a purely contractual limit; Anthropic is incapable of enforcing it technologically, and does not have direct visibility into how DoW uses its model.” [limit] A first-instance decision under U.S. law, with an appeal window running into late October 2026. The chapter’s argument hangs on the contractual limit and the two held restrictions, not on the survival of the judgment.
  • Legal sourceBoard of Governors of the Federal Reserve System. Supervisory Guidance on Model Risk Management, SR 11-7, April 4, 2011 (issued jointly with the OCC as Bulletin 2011-12; adopted by the FDIC in 2017 as FIL-22-2017). Verbatim: “Effective challenge depends on a combination of incentives, competence, and influence.” Checked against the full text. Replaced on April 17, 2026, by SR 26-2, Revised Guidance on Model Risk Management, which excludes generative and agentic AI from its scope. [limit] Supervisory guidance does not have the force of law (Interagency Statement on the Role of Supervisory Guidance, 2018, codified 2021). Its transfer to AI-assisted decisions outside banking is this book’s reading.

Chapter 11 · Ninety Seconds Per Case

  • Legal sourceThe lapsing approval as a legal device. Deemed-approval provisions are long established in administrative law; the recurring criticism cited in the text — that the fiction accelerates no review and creates no capacity — comes from the submissions of affected professional bodies. [limit] Not a scientific evaluation.

Chapter 12 · Faster, Not Easier

  • Legal sourceThe American position on psychosocial hazards at work: OSHA has no standalone standard; whether the general duty clause reaches psychological hazards is contested and unsettled. NIOSH, “An Urgent Call to Address Work-Related Psychosocial Hazards and Improve Worker Well-Being,” 2024. Office of the Surgeon General, Framework for Workplace Mental Health & Well-Being, 2022 — five essentials, beginning with protection from harm. All of it is guidance. The German, Japanese, and British counterparts the chapter sets against it are under The Same Two Questions, Five Legal Systems, below.

Chapter 15 · Where Ownership Meets Capacity

  • Legal sourceThe claim that current AI rulebooks govern decision rights and none of them names a number for inflow or review time: checked against two full texts. NIST AI RMF 1.0 contains no reference to workload, throughput, time pressure, case volume, fatigue, or review capacity. The European AI regulation’s Article 14 requires understanding, monitoring, and the ability to override, and measures “proportionate to the risks, level of autonomy and context of use” — naming no quantity, no frequency, and no time per case. [limit] A negative finding from two checked frameworks, not a claim of priority. Other frameworks were not checked in full text, and the text is limited accordingly.
  • Legal sourceThe one instrument that names time and workload: Global Privacy Assembly, 47th closed session, Seoul, September 2025, Resolution on Meaningful Human Oversight of Decisions Involving AI Systems. The Resources section, verbatim: “The organization should provide the overseer with the resources necessary to adequately oversee a decision. This should include sufficient time to undertake the oversight and a reasonable workload […].” [limit] A resolution, not law. It binds nobody, and it names no number either.

Chapter 16 · The Price of the Objection

  • Legal sourceThe safeguards around external audit: Sarbanes-Oxley Act of 2002, Section 301 (the audit committee is directly responsible for appointing, compensating, and overseeing the auditor) and Section 201 (prohibited non-audit services, resting on the test that a service is barred where it would have the auditor auditing its own work or performing management functions); and the SEC auditor independence rules on partner rotation, under which the lead and concurring partners may not serve the same audit client beyond five consecutive years. The European counterpart the chapter names — rotation of the audit firm after ten years, extendable to twenty after a public bidding process, with key audit partners limited to seven — is Article 17 of Regulation (EU) No 537/2014. [limit] These provisions govern the statutory audit of public companies and say nothing about reviewing AI output. This chapter transfers an arrangement; it asserts no legal duty, and the text says so.

Changes since publication

Corrections and legal developments are recorded here with a date. They are not folded into the text silently — a book about accountability cannot quietly rewrite its own record.

  • Second review: the case made consistent, claims made precise A final pass held the English text against the corrections made to the German edition the day before. What changed, in substance: The case made consistent. Thirty-two more bids arrived than four years earlier, not thirty-one. Frank Ostrowski’s company was a bidder in the process. Five names, not five signatures, lie between the Tuesday in March and the release. The buyer had eighteen minutes per bid in Chapter 16 as everywhere else. The closing chapter now says that each of the two repairs explains half the case rather than preventing it; the pre-selection, not the award, lacked an owner; and Ines Kessler had access to all forty-one bids but not the time to read them. Claims made precise. Challenger counts announced job cuts. The claim that organizations have treated effort as a proxy for care “for centuries” is gone. The study in Chapter 11 measured heart rate variability. An update that adds a scoring or recommending function is a good reason to repeat the review, not proof that the earlier review is void. A reviewer who contradicts the system owes no more justification than one who agrees. One of the five requirements was met, and only half. The toolkit. The survey promise is an assurance of protection, not an amnesty, and it carries a note that it is an example to adapt to local law. Working without an additional mandate is possible only as far as existing access and analysis rights allow. A difference found in a pattern review is a reason to look closer, not proof of cause or discrimination. Chapter 11 now contains the handhold its table row referred to; the list of things to do has twenty-seven entries. Terms. The two halves of the argument are now called the ownership framework and the capacity framework; “order” and “construction” were German loan structures that read as sequence, purchase order, or building work. Chapter 15 is titled Where Ownership Meets Capacity, the assignment of processes to paces is a pace map, and the handholds in the tables are diagnostics. Several statements were narrowed: an event-triggered review means you no longer depend on an annual one, the effort is a few minutes per update, a forty-person company often has no independent position, the minimal start needs no project of its own, and the legal comparison speaks only of the provisions it compares. Copyright page. The author expressly reserves all rights in the work with respect to text and data mining under Article 4(3) of Directive (EU) 2019/790, and training AI systems on it requires permission except where applicable law provides otherwise; the e-book carries the reservation in machine-readable form.
  • Full review of the book: corrections, legal updates, cuts The whole text was checked again against its sources. What changed, in substance: Legal positions that had moved. The two CFPB circulars on adverse-action notices were withdrawn on May 12, 2025. The Federal Reserve’s SR 11-7 was replaced by SR 26-2 on April 17, 2026; the new guidance excludes generative and agentic AI. Enforcement of Colorado’s AI Act was stayed in April 2026 on a joint motion in x.AI v. Weiser, and SB 26-189, signed May 14, 2026, removed its core duties and moved the start to January 1, 2027. The legal comparison in the back of the book was rechecked line by line. Facts corrected. Goldratt’s method has five focusing steps, not three. In the Dutch childcare benefits case more than 43,000 parents have been recognized as affected, and the model used non-Dutch nationality as a feature. Amazon identified the bias in its recruiting tool by 2015; it became public in 2018. The METR trial is one field study among several, not the only one. The phrase “ratchet effect” comes from economics (Weitzman, 1980), not from the researcher previously credited. The University of Chicago rule applies to required first-year courses in a pilot year. The case made consistent. The night-time on-call service was known to the head of maintenance, not to purchasing, and he was shown only the top ten. The buyer had eighteen minutes per bid, not four. The award went to the second-ranked bid, 12 percent cheaper than the first. The five triggers were renamed where needed (“reversibility” instead of “stakes”) and now give the same result in every chapter that applies them. Counter-evidence added. Chapter 16 now takes up the strongest objection to the book: statistical rules often predict better than experts because they do not vary (Meehl; Kahneman, Sibony and Sunstein). Cut. Several passages that did not carry the argument: the interruption-figure detour, the scored ethics profile and the comment discussion around it, the Žižek reference, the Kipker quote, the Shopify, Duolingo and Box examples, and most of the Pentagon dispute. The case notes that stood in the book now appear on the Claims page.
  • Companion site published The site goes live with the book. Every source in the volume is listed with its type, every claim with what would refute it, and every legal instrument with the date it was last checked. The legal position described in the book was current at the time of writing. Where it moves, the change is recorded here with a date rather than folded into the text.