battlebots

dnorman@me.com (D'Arcy Norman) — Tue, 31 Mar 2026 12:00:00 -0700

Battlebots

screenshot of aggregated webserver stats for my website, visualizing the sheer volume (over 95%!!!) of bot-driven traffic compared to that from puny humans.

bot traffic

dnorman@me.com (D'Arcy Norman) — Sun, 11 May 2025 15:59:40 +0000

I don’t look at the webserver logs for this webthing in detail, but have been curious given the spikes in bot traffic over the last several months. Much of it is the traditional “I’ll just crawl your entire website multiple times per day to feed my search index”, but there’s been a LOT of “I’ll just crawl your entire website multiple times per day to feed my LLM training dataset, and I will ignore rate limiting that you’ve set in robots.txt”

Webserver on D'Arcy Norman, PhD

battlebots

Battlebots

bot traffic