data source· draft
GeoKTools
Benchmark from Google Research of generated geospatial queries with known answers that require chaining one to four kinds of geospatial tool; used to test an AI agent's multi-step tool use and exact spatial computation.
One of the two Geospatial Reasoning Benchmarks that Google Research released alongside its technical report on the Google Earth AI Geospatial Reasoning Agent (arXiv 2610.15750, submitted 11 October 2026). GeoKTools is a set of programmatically generated queries, each with a ground-truth answer from a deterministic reference solver, that vary the number K of tool families (one to four) an agent must chain to answer.
It measures whether an agent can compose several geospatial tools in sequence and arrive at an exact numerical or spatial result. An exact match scores full credit; otherwise an element-wise LLM judge is used, and a deterministic offline scorer is also supplied, with partial credit for near-miss numbers and string overlap.
The public release holds 85 development queries from 19 templates; the 210-query test split from 72 templates is held back. Code is under Apache 2.0 and data under CC BY 4.0, with Google Maps data excluded from both. The authors ask that the benchmark not be used as training data.
is about this entity
-
Experimental Gemini-based agent from Google Research that plans a multi-step spatial analysis, calls Earth AI models and geospatial data sources, and returns the result with its plan and sources shown.
Tags: benchmark, tool use, ai agents, geospatial reasoning, evaluation