GPQA
A 2023 benchmark of very hard science questions written by PhD experts so that web searching does not help.
Also: Graduate-Level Google-Proof Q&A
GPQA, published by David Rein and colleagues in 2023, has 448 multiple-choice questions in biology, physics and chemistry. Experts with or pursuing PhDs in the field reached about 65 per cent, while skilled non-experts with unrestricted web access for half an hour scored about 34 per cent. Its hardest subset, GPQA Diamond, became a standard benchmark for reasoning models, with leading models surpassing the expert score during 2024 and 2025.