The Gemini (Vertex) API now provides restricted entry to grounding queries and returns the search phrases within the [‘groundingMetadata’] object. That’s thrilling information, in concept, however it seems to be messy in apply. We encountered two main points:
1. Gemini is grasping about grounding
Even operating Gemini 3.5 Flash with a [MEDIUM] or greater “considering” stage, it’s uncommon to get greater than 1-2 grounding queries. In lots of instances, you’ll see none in any respect. If you happen to’ve used AI Mode a lot, you recognize it virtually at all times runs a number of grounding queries. We had been in a position to nudge the system directions and push Google to generate 4-6 grounding queries. Whereas these queries are “actual” (Google truly ran the searches), it’s honest to say that we cheated somewhat bit. AI Mode and precise question fan-out may behave very in a different way.
2. Google is grasping on your cash
On prime of token prices, grounding queries at the moment value (as of August 2026) $14 per 1,000 queries. This isn’t a per-prompt value. In our case, every immediate ran about 5 grounding queries, so grounding knowledge value one thing like $7 per 100 prompts. That is orders of magnitude greater than the token value, and at enterprise-scale, it provides up quick. If you happen to’re utilizing Third-party instruments that run by yourself API keys, preserve a detailed eye on prices.
