AI Search News · issue 16
AI Search News: Week 43
Rankings, Clicks, Citations: The Week Your Data Went Dark
This was a week where the problem wasn't what changed on your website, it was whether you could trust what your tools were telling you about it. A rank tracker found Google results quietly scrambled for weeks. ChatGPT stopped tagging its own links, making real traffic look like it vanished. And a new study found that the shortcuts marketers use to guess what ChatGPT cites miss most of the actual pages. Google and Bing also kept reshaping how AI answers show links and citations.
This week's stories
What changed this week
Rank-Tracking Tools Are Returning Scrambled Google Data
Who it affects: Any site using third-party rank trackers
Rank-tracking company Nozzle found that from Sept. 13 to Oct. 9, 8.0% of the Google results pages it could check against history were missing most of the usual sites for that keyword, compared with just 0.17% in the prior month. The share peaked near a quarter of pages between Sept. 27-29 and has run at roughly 5% to 11% a day since Oct. 1. On these affected pages, a client's own site failed to appear in the top 10 58.6% of the time, versus 2.7% normally. Nozzle links the pattern to Google's response to AI scraping, though Google hasn't commented on it.
What this means for your website
If a rank report shows a sudden drop this month, check Search Console for a matching dip in impressions and clicks for that same query and page before you treat the drop as real or report it to a client.
Study: Free Workarounds Miss Half Of ChatGPT's Real Sources
Who it affects: Anyone using Google rankings or OpenAI's API to guess ChatGPT citations
A preprint from researchers at the National University of Singapore and Xi'an Jiaotong University tested whether Google search results and OpenAI's Responses API could stand in for watching ChatGPT's actual citations directly. Combined, the two substitutes found only 26.2% to 28.3% of the exact pages ChatGPT cited across four model versions, though they caught 48.7% to 50.3% of the actual cited sites. ChatGPT never searched using a question's exact wording in the tested models, often ran searches in English even for Chinese-language prompts, and which pages got cited varied heavily between repeated runs of the same question. The researchers recommend monitoring at both the page and site level, running prompts multiple times, and checking whether any tracking tool pulls data through OpenAI's API versus the live ChatGPT app.
What this means for your website
If you're using a rank tracker or a Google-ranking proxy to estimate your ChatGPT visibility, treat the result as a rough site-level signal rather than proof of which exact page gets cited, and ask any AI-visibility tool you pay for whether it sources data from the ChatGPT app or from the API.
Weekly · 100% free
AI search: all you need to know, every Monday
One short email a week on what changed in AI search and what it means for your website. Plain language, always free. Also on LinkedIn.
Sources
Every source this week
Free GEO audit · about 60 seconds
Is your site ready for AI search?
Run a free GEO audit to see exactly what AI crawlers can and can't read on your page, with the fixes ranked.