WikiIQ

WikiIQ is a benchmark designed to test the ability of a model to navigate in the Wikipedia web of articles. The task consists of reaching a goal article from a given source article in the network by following links, constrained by fixed budgets. WikiIQ consists of task instances based on a static snapshot of the Wikipedia link graph, with standard and structural versions of challenge partitions.

Performance of the models is measured in terms of success of reaching the goal article, efficiency of the path, and shortest path finding ability. The problem is a proxy for information retrieval-driven goal-oriented navigation, where agents have to decide about the most promising next actions, perform search under resource-constraints, and cope with mistakes in the huge link-graph of a large information network.

I'd consider this benchmark saturated once top models start hitting scores of 95+. Scores aren't calculated strictly off of percentage of tasks solved (some minor weighting and path efficiency etc. are considered) but for all intents and purposes can be considered as such. So it looks like we have a ways to go!

The benchmark is currently closed source, plans for open sourcing soon

Results

WikiIQ score by model View results table
Model Effort Score Provider
Gemini 4 NeonXhigh54Google
Claude Fable 5.2Max52Anthropic
Gemini 4 CarbonHigh52Google
GPT-6.2 AstraMax50OpenAI
Claude Opus 5.5Max49Anthropic
GPT-6 AstraMax46OpenAI
GPT-6.2 SolMax45OpenAI
GPT-6.1 SolMax43OpenAI
Gemini 4 HydrogenXhigh40Google
Gemini 4 ArgonHigh40Google
Claude Sonnet 5.5Max37Anthropic
GPT-6.1 TerraMax34OpenAI
Kimi K3.1 ProMax30Kimi
Qwen4Max29Alibaba
Grok 4.7Xhigh25SpaceXAI
Claude Haiku 5.5Max24Anthropic
DeepSeek V4.1 Flash 1017Max15DeepSeek
GLM-5.3Max13Z AI