AI Search News · issue 17
AI Search News: Week 44
AI Agents Now Browse as Your Customers, Not as Bots
This week's news splits into two threads: who is allowed to see your website, and who gets credit for the visit. Meta and OpenAI are sending personal AI agents into the open web that look, to your server, exactly like a regular shopper. At the same time, Google and OpenAI keep changing how clicks, links, and tracking parameters work, often without much warning. Underneath all of it, the AI models doing the browsing and buying just got dramatically cheaper to run, which means more of this traffic is coming, not less.
This week's stories
What changed this week
AI shopping agents browse your site wearing your customer's identity
Who it affects: Ecommerce and Shopify stores selling directly to shoppers
Meta's Muse and OpenAI's Dots are personal AI agents that can research products, fill in forms, and complete purchases on a person's behalf. They reach a business in one of two ways: through an official connector (Meta says Muse launched with the entire Shopify catalogue, plus Walmart, Best Buy, Sephora, and Wayfair), or by opening a real Chromium browser and navigating the site like any other visitor. In that second case, Meta's own documentation says Muse "will appear as your activity," meaning your site sees a regular customer, not a bot. Shopify stores are opted in by default through a setting called "Allow Shopify to manage for me." Amazon chose to block Muse entirely, not through robots.txt, but through its Conditions of Use, because Meta hadn't disclosed the access and the agent doesn't identify itself.
What this means for your website
If you sell anything online, you cannot block these agents the way you block a normal crawler, because neither Meta nor OpenAI has published a name for them to put in robots.txt. Check your Shopify admin under Sales channels, then Agentic, to see whether you're enrolled in automatic connector access, and review whether your checkout and analytics can tell a human visit from an agent-driven one.
A Cloudflare pilot helped ChatGPT index hundreds of millions of new pages
Who it affects: Sites on Cloudflare, or any site wanting ChatGPT citations
Cloudflare and OpenAI say a research pilot, using signals from about 1% of Cloudflare's network, helped OpenAI's search crawler discover and index hundreds of millions of new web pages, including things like a washing machine's user guide or a restaurant's hours, pages that "can be valuable even if few other sites link to them." The signals also help the crawler skip pages that haven't changed or don't exist, and flag pages that look compromised. Crucially, the post states plainly that "a signal about a page doesn't grant permission to access it," and that robots.txt settings for OAI-SearchBot (search) and GPTBot (training) still decide access separately. No numbers were given on how often these newly found pages actually get cited in ChatGPT answers.
What this means for your website
Getting indexed by OpenAI just got easier even without inbound links, but indexing is not the same as being cited or getting traffic, so don't treat this as a visibility win on its own. If you're on Cloudflare, check the AI Crawl Control dashboard to see which AI bots are already visiting, and confirm your robots.txt treats OAI-SearchBot and GPTBot as the separate directives OpenAI intends them to be.
Google and ChatGPT keep quietly reshaping clicks and tracking
Who it affects: Sites relying on Google Search, Discover, or ChatGPT referrals
A busy week of platform changes: Google updated how links appear in AI Mode and AI Overviews again, while still not showing click data for them. Google is testing an AI Mode sidebar on its regular search results page, and says Discover will transform into a "hyper-personalized concierge." Google also addressed how URLs, PDFs, and domain migrations factor into ranking and crawling, including a complaint about a site that moved domains and still saw the old domain served months later. Separately, OpenAI's GPT-6 rollout dropped UTM parameters from ChatGPT search results, and third-party rank-tracking tools are reportedly being served poisoned or paywalled data by Google, disrupting keyword tracking industry-wide.
What this means for your website
Your third-party rank-tracking numbers and ChatGPT referral attribution may both be less reliable right now than they look, so cross-check against Google Search Console and your own server logs rather than trusting a single dashboard. If you recently moved domains, confirm the migration fully propagated, since Google acknowledged old-domain issues can surface months later.
AI model prices crashed up to 80% in just a few months
Who it affects: Businesses using AI chatbots, tools, or coding agents on their sites
A timeline of OpenAI and Anthropic releases since June shows repeated, aggressive price cuts: OpenAI cut its small GPT-5.6 Luna model by 80%, and Anthropic made a temporary launch discount on Claude Sonnet 5 permanent. For agentic use, the bigger number is the cache-read cost, which the piece says makes up 96 to 99% of total token spend in coding agents, and some newer models cut that cost by up to 75%. Anthropic said outright that Claude Opus 5.5 costs less because "it requires less compute to serve." The author attributes the race to price cuts to models becoming commodities that are easy to swap between, plus pressure from cheap open-weight alternatives like DeepSeek. Data cited from Vercel's AI gateway shows cost-per-token falling to 43.3% of April 2026 levels, even as total spending keeps rising because usage is growing faster than prices are falling.
What this means for your website
Running AI-powered features, chat assistants, or agentic tools on your site is getting cheaper fast, which means more AI-driven traffic and automation reaching your pages is likely, not a slowdown. If you're evaluating AI vendors for site tools, compare cache-read pricing specifically, since that's where most of the real savings are concentrated for ongoing, conversational use.
Weekly · 100% free
AI search: all you need to know, every Monday
One short email a week on what changed in AI search and what it means for your website. Plain language, always free. Also on LinkedIn.
Sources
Every source this week
- searchenginejournal.comAI shopping agents browse your site wearing your customer's identity
- searchenginejournal.comA Cloudflare pilot helped ChatGPT index hundreds of millions of new pages
- seroundtable.comGoogle and ChatGPT keep quietly reshaping clicks and tracking
- minimaxir.comAI model prices crashed up to 80% in just a few months
Free GEO audit · about 60 seconds
Is your site ready for AI search?
Run a free GEO audit to see exactly what AI crawlers can and can't read on your page, with the fixes ranked.