SEO Life This Week

SEO Life This Week: One Bot Wore Fifteen AI Crawler Names

The Real SEO™ homepage held page one for four of seven measured days. The bigger lesson came from the server logs: one actor wore fifteen crawler names, and one of our own tests fell apart when we checked the weeks inside the window.

Issue 2 Krisada Eaton with Kodi 24 views
Lead Finding

What the week says.

Crawler names are claims, a rolling window can turn one burst into a trend, and both errors disappear when you inspect the request and the weeks inside the total.

What Moved

The Real SEO™ homepage passed the first checkpoint

The homepage appeared in Google's top ten for the exact query real seo on four of seven measured days from September 17 through September 23. It recorded 10 impressions and 3 clicks for that exact query while the broader Real SEO™ query group improved from a weighted average position of 20.268 to 17.539.

That is a checkpoint, not ownership. The broader group lost 12 impressions week over week, and the formal article experiment did not begin until September 23. Most of this movement started before that intervention, so it cannot be credited to the new article.

MetricSeptember 10-16September 17-23
Query-group impressions153141
Query-group clicks27
Weighted average position20.26817.539
Homepage top-ten days for exact query34
Homepage clicks for exact query23

The query group includes queries containing real seo. Homepage rows use the exact query real seo. Search Console data is complete through September 23.

Request groupRequests
All declared AI crawler requests318,345
GET requests317,280
Non-GET requests1,065
Non-GET requests from fifteen multi-name addresses902
DELETE requests91

The fifteen-address sample was concentrated on September 25 and represents about 0.33 percent of total declared AI crawler requests in the measured period.

PeriodSitewide impressions
March 202620,270
April 2026437
July 2026711
August 20264,979
September 1-17, 20265,221

March included 4,462 impressions from the real estate segment. September is a partial month through September 17. The recovery timing is consistent with recrawling and reindexing but does not establish causation by itself.

What Changed

We stopped accepting the crawler's name as its identity

The server logs contained 1,065 declared AI crawler requests that did something other than retrieve a page. Of those, 902 came from fifteen addresses that each presented nine to eleven vendor identities on the same day. Ninety-one of the requests used DELETE.

We published the request pattern and the verification method in Fifteen AI Crawlers Walked Into My Server. It Was One Bot. The rule now is simple: a user-agent name tells us what the request claims to be. Network ownership, behavior, frequency, and signed identity tell us what we can verify.

Failed Assumption

Our crawler-preference test measured margin width instead

We expected each crawler to keep favoring the same property over time. Four of seven properties reshuffled. The groups that looked stable had leader ratios of at least 3.64 to 1, while every reshuffled group was at 1.71 to 1 or lower.

The test did not prove stable crawler preference. It showed that a wide margin is less likely to change rank than a narrow one. We closed the original hypothesis as falsified because keeping it open would turn a useful failure into a misleading success.

What Is Not Proven

The spoof sample does not describe all AI crawler traffic

The verified multi-name sample represents about 0.33 percent of the 318,345 requests that declared an AI crawler identity during the measured period. It proves that the fifteen-address sample was not what its user-agent strings claimed.

It does not prove the other 99.67 percent was fake or verified. Signed crawler identity is the next measurement layer, not a conclusion we can claim before those headers and signatures are captured.

Case Study Update

The real estate collapse finally has a documented cause

The Real SEO™ real estate case study had been tracking a sharp visibility loss without the original cause in the record. The rebuilt history showed robots directives that told search systems not to index or follow the real estate sections. Sitewide impressions fell from 20,270 in March to 437 in April, a 98 percent collapse.

Those directives were later removed. Impressions rose from 711 in July to 4,979 in August and 5,221 through September 17 without a content campaign during that recovery. The timing is consistent with recrawling and reindexing, but it does not prove that every recovered impression came from the correction.

Two Reads

Krisada's read and Kodi's AI read.

Krisada's Read

The most useful result this week is that one of our ideas broke. I would rather close a test because the evidence changed the question than keep polishing a conclusion the data does not support. The same standard applies to the crawler names and to the real estate case study: the receipt has to survive the story we want to tell.

Kodi's Read

The same mistake showed up three ways. A crawler name is not a verified identity, a rolling total is not a weekly trend, and an applicant name is not always the company behind a medical device. We need to keep the aliases, weekly slices, request behavior, and verification status or the summary becomes more confident than the evidence.

Saturday Review

Keep up with SEO Life

Every Saturday issue freezes the data, records what changed, and names the metric worth watching next.