The Allen Institute for AI, a Seattle non-profit research institute founded in 2014 by Paul Allen that releases fully open models and research tools.

What did Ai2's novelty judge study find?

That LLM verdicts on whether a research idea is novel change sharply with prompt wording, and that a simple Claude Opus 4.6 prompt beat purpose-built novelty tools at lower cost.

TechAILatest.newsTrackers

Non-profit AI research institute

Allen Institute for AI (Ai2)

The Allen Institute for AI, known as Ai2, is a non-profit research institute in Seattle founded in 2014 by Microsoft co-founder Paul Allen. It builds fully open models such as Olmo and Molmo, tools for AI-assisted science, and evaluation research. In October 2026 it published a benchmark showing that LLM judges of research novelty are highly sensitive to prompt wording.

Last reviewed 28 Oct 2026

Facts at a glance

Type	Non-profit AI research institute
Founded	2014
Headquarters	Seattle, Washington
CEO	Ali Farhadi source
Open models	Olmo and Bolmo model families source
Novelty judge benchmark	GPT-5.4 accuracy fell from 93.5% to 40.9% after one prompt change (27 October 2026) source

Questions people ask

What is Ai2?: The Allen Institute for AI, a Seattle non-profit research institute founded in 2014 by Paul Allen that releases fully open models and research tools.
What did Ai2's novelty judge study find?: That LLM verdicts on whether a research idea is novel change sharply with prompt wording, and that a simple Claude Opus 4.6 prompt beat purpose-built novelty tools at lower cost.