AI news · Google · Google-Agent
Google tells sites how to let its AI agent past their bot filters
A new help page explains how firewalls and bot checks can recognise Google-Agent, which browses, fills baskets and books on a person’s behalf.
On Tuesday 17 November 2026 Google posted instructions for site owners whose security tools keep out Google-Agent, the name its AI agents use when they browse and act for a person. The page covers bot-detection services, web application firewalls (filters that screen incoming traffic) and the content delivery networks that serve a site’s pages. Google’s stated goal is that a person’s genuine requests get through without a site lowering its defences, Search Engine Roundtable reports. Google-Agent itself has been documented since March; the guide is new.
PPC Land’s reading of the page explains why shops and travel sites should care. The agent makes bookings, fills baskets and searches and filters a site’s listings, by Google’s own description, and it generally ignores robots.txt, the file sites use to steer crawlers. A site confirms the visitor is Google’s agent in up to three ways: the name it gives in its request (the user-agent header), whether its address appears on Google’s published list, and, for some requests in an experiment Google is running, a digital signature. Google tells sites to let traffic that passes those checks skip bot challenges such as CAPTCHA puzzles.
The page also lists six ways a site can keep refusing the agent after adding an allow rule. One example: Google sends many people’s requests out through a shared set of addresses, so a cap on requests per address can shut the agent out.
Google’s guide expects its agent to add items to baskets and make bookings, so a retailer’s bot defences now decide whether those agent-led visits reach checkout, since the agent generally ignores robots.txt.
Sources
- PPC Land: Google lists six ways sites still block its AI agent after allowing it. Checked
- Search Engine Roundtable: New Google Search Help Document On How To Allow Google-Agent Traffic. Checked
More AI news from
- OpenAI releases GPT-6.2 Astra and cuts its API price by a fifth
- Gemini Tasks goes free and can phone and pay for US users
- ElevenLabs takes 55% off annual plans for Black Friday
- Meta launches Muse in Australia with MECCA, Kogan and Canva
- Word, Excel and PowerPoint now run inside Microsoft Copilot
- Philips buys streaming TV on six networks via Amazon Ads Agent
- SparkToro finds shopping intent in 6.9% of ChatGPT chats
- Google extends Gemini chat storage to two months with history off
- Similarweb posts first profit with AI deals near a fifth of sales
- illumin’s Ask Lu AI reports on ads and drafts campaigns in beta
- Daydream’s AI stylist agent can now buy clothes for shoppers