Needle in a haystack test
A long-context test that hides one fact in a long text and asks the model to find it.
Also: NIAH
In the needle in a haystack test, a short unrelated sentence is planted at various depths in a long filler document and the model is asked about it. Results are drawn as a grid of context length against depth. The test was popularised by developer Greg Kamradt in 2023 and featured in launch reports for Claude and Gemini. Leading models now score close to perfect, so researchers have built harder benchmarks such as RULER that need several facts to be found and combined.