Benchmark

Where the book uses it

• Chapter 3 — The Missing Researcher

  The dated promise of an AI that does its own research, what the laboratories have published, and what the public record can and cannot yet check.

Where the record uses it

• Scorecard indicator Humanity’s Last Exam
• Scorecard indicator CoreWeave 2026 borrowing spread ladder
• Dated test Chapter 3, the intern, due 31 August 2027
• Person Pachocki, Jakub

Sources that use it

• Silicon Data, “Silicon Data Raises $30.5 Million Series A to Build the Independent Benchmark Layer for the AI Compute Economy,” company announcement, 11 August 2026 ($30.5 million initial closing led by the Valor Atreides AI Fund — Antonio Gracias and Gavin Baker — with CME Ventures and DRW among the additional investors; CME Group to use Silicon Data’s benchmarks as the reference price for its GPU futures, pending regulatory approval; announced the same day as the CME compute-futures launch; the closing paragraph: “making sure every part of the compute economy — buyers, sellers, exchanges, and the institutions now underwriting it — builds on the same reference points”; the About paragraph calls the company “the independent benchmark and market intelligence platform for the AI compute economy”). In the Sources
• Oracle Corporation, final pricing term sheet (free writing prospectus, Rule 433), 2 February 2026 (5.700% Notes due 2036: $5,000,000,000, price 99.782%, benchmark Treasury 4.000% due 15 November 2035 at 4.279%, “Spread to Benchmark Treasury: +145 basis points”, yield to maturity 5.729%; one of eight tranches — floating 2029, 4.550% 2029, 4.950% 2031, 5.350% 2033, 5.700% 2036, 6.550% 2046, 6.700% 2056, 6.850% 2066 — in a $25,000,000,000 offering priced with a concurrent $5 billion of 6.50% mandatory convertible preferred; the 2036 notes’ “Expected Ratings” from Moody’s, S&P and Fitch: Baa2 negative, BBB negative and BBB stable). In the Sources
• Joel Becker (METR), “Reconciling Impressive AI Benchmark Performance, Limited Developer Productivity Impacts,” Stanford Digital Economy Lab seminar, published 17 March 2026 (“the title’s a bit over-promising with ‘limited developer productivity impact’ … probably developer productivity impacts look pretty impressive today”, “impact” at 1:16 read singular on the 13 September pair and plural on the 24 September pair, so whether he misquoted his own plural title is unsettled, “impact” kept as printed under the set’s standard; “maybe accidentally” at 45:16; “I think it’s something like 80 to 90% of these people are continuing to use Cursor.” at 45:30, the caption track prints “custom” there where large-v3 has no word, the room audio gating to silence, and renders Cursor correctly fifteen times elsewhere, the word “Cursor” unsettled and kept as printed under the set’s standard; the caption’s repeated these at 45:30 rendered once; “we traditionally measure AIs under conditions that are optimized for them to be most performant, and then we deploy them under conditions optimized for humans”; read against the caption track and two decodes, 13 September 2026; he calls it “an opinionated perspective” and prefaces it “I think”, offering it conditional on “we haven’t messed something up here” at 49:26–49:32; the caption’s let’s let’s and on on at 49:28–49:30 sit before that quotation, outside it, read on the word-timed track on 24 September 2026; the um at 49:35, between I think and we in the sentence book 1 prints, dropped from that quotation, one um on the loudness profile where large-v3 hears two, the 24 September pair held in the set’s Quote audio checks folder of that day with their md5 in its manifest; here at the end of we haven’t messed something up here on large-v3 where medium.en reads yet, kept as printed and unsettled; on the two conditions, from his I think: “I think we traditionally measure AIs under conditions that are optimized for them to be most performant, and then we deploy them under conditions optimized for humans” (49:35.0–49:41.3)). In the Sources
• Empire State Development, “New York State Guidance for Host Communities Implementing the Community Investment Framework for Data Center Development,” and Office of Governor Kathy Hochul, “Governor Hochul Announces Strongest Community Investment Framework in the Nation to Protect Communities from Exploitative Data Center Development,” 15 September 2026 (voluntary guidance for towns negotiating with data center developers, under Executive Order No. 62; the guidance, p. 1, “New York has developed a voluntary Community Investment Framework”; p. 6, “The Investment Benchmark offers a proposed community investment benchmark of $1 million-per-megawatt of utility demand, inclusive of investments into grid modernization as required by New York State. For example, a project utilizing 50MW has an associated recommended community investment level of $50M, much of which may be distributed through a Community Investment Fund.”; the release: “The voluntary Framework establishes a recommended community investment benchmark of $1 million for every megawatt of utility demand associated with a data center project”; the guidance carries no date of its own, and the date is the release’s). In the Sources
• Artificial Analysis, “Humanity’s Last Exam Benchmark Leaderboard,” accessed 30 August 2026 (Claude Fable 5, Adaptive Reasoning/Max Effort with Opus 4.8 fallback, scored 55.5% on Artificial Analysis’s 2,158-question text-only HLE evaluation; an independently preserved 15 August 2026 snapshot was not located). In the Sources

And 2 more: search the Sources.

Related terms

• SOFR
• ARC-AGI-3
• Humanity’s Last Exam
• Spread
• Adoption clock
• Agent
• AGI
• Alignment
• Astra
• Automated AI researcher
• Brake, the
• Capability clock