Writing

Feed Software, technology, sysadmin war stories, and more.

Wednesday, April 17, 2013

Signs of a bad feed fetching robot

You might be a bad feed reader robot if... you do all of these:

[17/Apr/2013:22:33:40 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:40 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:40 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:40 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:40 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:40 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:40 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:43 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:42 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:42 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:42 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:42 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:43 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:42 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:43 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:42 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:42 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:43 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:42 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:42 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:43 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:42 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:43 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:43 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:44 -0700] "GET /w/atom.xml HTTP/1.1"

[17/Apr/2013:22:33:47 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:47 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:47 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:47 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:47 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:47 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:47 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:48 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:48 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:48 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

[17/Apr/2013:22:33:48 -0700] "GET /w/2013/04/17/slow/dialup1.jpg HTTP/1.1"

It's not an isolated event, either. They seem to love pulling atom.xml a dozen times in a 5 second period several times a day. Hey Feedspot, get it together, already.