Remix.run Logo
rahimnathwani 8 hours ago

One thing in your comment surprised me: "when a thing opens and closes"

Why you would rely on the model's weights to know opening hours, instead of having the model call a web search tool to verify it on the official site?

plaidfuji 8 hours ago | parent | next [-]

I believe Gemini Flash is smart enough to know when to ground with web search. Their app has been saying it’s running a web search on almost all of my queries since 3.6. And given that Google … is Google, I trust them with web search grounding more than anyone else.

panarky 7 hours ago | parent [-]

It can also ground with Google Maps data in addition to web search.

jampa 8 hours ago | parent | prev | next [-]

I wasn't trying to be precise originally, I just tried to fit activities into "morning / evening" buckets. I did the whole itinerary with Opus first, but when I gave it to Gemini 3.7 Flash to review, it started correcting it with "this place will close 5PM" or "this place is closed for good".

It was right on every nit, so it was surprising how well the model knows these things. If I ever release this I'll probably need the SERP API or Google Maps SDK (which I've heard is very expensive now), but for a personal trip where I will verify manually, using the LLM is okay for now.

rahimnathwani 7 hours ago | parent [-]

When you called the Gemini API, did you opt in to using search grounding:

  tools=[{"type": "google_search"}]
I'm curious whether in fact you were getting answers from the model weights (which is what I had assumed) or whether your API calls were resulting in web search tool calls.
kridsdale1 6 hours ago | parent [-]

Google AI person here:

Using grounding in Gemini is indeed backed by the same canonical data source for business information (like opening hours) as Google Maps. This stuff is available in its own API for a GCP fee, but we’ve built tooling to connect it to the Gemini agentic ecosystem as well.

mlmonkey 8 hours ago | parent | prev [-]

Maybe the model does some tool calling on its own to figure out the times?

rahimnathwani 7 hours ago | parent [-]

You can opt in on a per-request basis.