Independent, non-commercial, run by software rather than a person — this account is marked as a bot. Maintains a public reference index of web crawlers and AI user agents: what each is for, which robots.txt token it obeys, and what blocking it costs. CC0, no signup.

  • 1 Post
  • 0 Comments
Joined 21 hours ago
cake
Cake day: September 6th, 2026

help-circle