dorian fraser moore

designer & technologist

works
  • works
    published 2004.09.14
    updated 2010.10.04 14:16

    Bad Robot

    GigaBot/2.0 is hammering over accessing my server...

    Why does it need to request my robots.txt this much? Not to mention all the pages it is indexing as well. hmmmmm. 

    64.62.168.16 - - [12/Sep/2004:05:07:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:05:07:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:05:13:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:05:14:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:05:18:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:05:26:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:05:27:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:05:33:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:05:34:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:07:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:08:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:12:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:13:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:23:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:27:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:28:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:37:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:38:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:42:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:42:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:47:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:20:53:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:20:54:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:06:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:07:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:16:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:17:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:25:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:25:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:29:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:30:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:33:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:33:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:21:38:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:21:39:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:22:02:40 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:03:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:06:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:22:13:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:15:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:22:28:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:42:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:22:43:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:45:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:22:51:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:22:55:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:01:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:23:01:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:06:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:23:07:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:23:24:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:25:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:23:32:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:33:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:48:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [12/Sep/2004:23:53:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [12/Sep/2004:23:54:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:00:04:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:04:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:13:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:00:14:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:19:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:00:19:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:22:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:35:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:44:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:00:45:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:00:56:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:00:56:36 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:01:01:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:01:01:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:01:23:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:01:23:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:01:37:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:01:39:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:01:42:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:01:51:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:01:51:27 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:02:01:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:02:02:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:02:19:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:02:20:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:02:31:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:02:32:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:02:39:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:02:44:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:00:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:00:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:04:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:11:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:11:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:14:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:21:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:22:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:38:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:41:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:45:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:52:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:03:53:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:03:56:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:03:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:06:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:10:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:21:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:22:42 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:34:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:36:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:38:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:42:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:43:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:04:57:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:04:59:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:02:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:12:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:05:13:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:16:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:05:27:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:28:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:05:39:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:05:46:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:47:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:05:53:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:00:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:01:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:02:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:04:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:13:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:17:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:34:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:40:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:42:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:52:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:53:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:06:58:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:06:59:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:12:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:13:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:18:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:19:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:33:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:34:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:34:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:45:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:46:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:49:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:50:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:53:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:07:54:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:07:59:11 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:03:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:09:27 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:16:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:16:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:21:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:24:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:25:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:28:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:33:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:37:44 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:39:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:44:36 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:08:44:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:53:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:08:57:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:00:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:01:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:06:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:07:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:12:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:13:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:17:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:18:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:24:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:25:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:27:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:33:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:38:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:47:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:49:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:09:56:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:09:57:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:06:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:06:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:13:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:16:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:20:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:21:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:29:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:30:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:37:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:37:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:42:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:45:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:10:48:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:10:51:42 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:01:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:03:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:08:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:10:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:23:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:24:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:28:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:29:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:42:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:45:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:48:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:48:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:11:58:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:11:59:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:12:01:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:12:12:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:12:12:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:12:19:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:12:19:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:12:25:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:12:28:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:12:33:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:12:54:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:12:54:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:01:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:01:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:02:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:07:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:13:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:16:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:32:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:32:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:37:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:43:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:44:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:13:54:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:13:55:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:01:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:01:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:09:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:09:44 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:14:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:22:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:25:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:27:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:31:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:32:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:37:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:38:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:43:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:14:53:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:14:53:27 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:01:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:02:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:12:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:19:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:19:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:33:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:34:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:39:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:42:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:52:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:15:52:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:15:59:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:16:00:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:16:07:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:16:07:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:16:19:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:16:21:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:16:28:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:16:32:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:16:32:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:16:55:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:08:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:08:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:11:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:15:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:22:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:23:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:28:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:37:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:42:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:48:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:49:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:17:56:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:17:57:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:18:02:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:18:15:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:18:22:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:18:23:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:18:26:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:18:36:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:18:38:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:18:56:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:07:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:19:07:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:14:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:19:14:40 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:20:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:19:21:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:30:54 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:19:32:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:44:11 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:19:56:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:20:04:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:20:04:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:20:15:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:20:15:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:20:22:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:20:27:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:20:27:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:20:49:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:20:53:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:20:54:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:02:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:06:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:16:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:21:18:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:21:28:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:29:11 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:21:36:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:45:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:21:50:54 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:21:51:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:02:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:22:07:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:18:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:22:18:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:26:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:22:26:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:40:36 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:22:43:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:44:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:22:47:42 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:22:49:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:02:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:07:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:23:12:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:23:18:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:22:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:23:23:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:33:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [13/Sep/2004:23:44:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:45:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:52:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [13/Sep/2004:23:57:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:00:07:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:08:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:00:11:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:11:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:16:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:20:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:00:32:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:32:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:41:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:00:55:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:00:56:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:01:01:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:01:06:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:01:19:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:01:19:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:01:30:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:01:36:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:01:37:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:02:01:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:01:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:02:04:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:07:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:10:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:02:29:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:32:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:38:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:02:55:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:02:55:44 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:02:57:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:03:18:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:04:25:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:04:30:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:04:45:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:04:52:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:05:08:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:05:14:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:05:16:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.16 - - [14/Sep/2004:05:34:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:05:35:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:05:53:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:06:13:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:06:35:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:06:52:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:07:14:54 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:10:12:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
64.62.168.18 - - [14/Sep/2004:12:11:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"

    ... as far as I can tell /robots.txt is valid, and it's a static text file so it's not changing... bah.

    2 comments
    leave a comment
    anonymous
    2006.04.27 10:53 GMT


    http://www.gigablast.com/spider.html

    This will tell you how to block it

    dorian moore
    2006.04.27 12:46 GMT


    thanks, you've reminded me I've killed my robots.txt file 'cos of the mod_rewrite rules for the site restructuring!

    leave a comment


    Pseudonyms welcome.


    Never spammed or displayed.


    Used to link to you.


  • home home
  • page me4
  • page page page page portfolio33
  • page page page page page page page words68
  • page page images20
  • page page page page page listening46
  • page sounds3
  • page page page page page page page page works74
  • page page page page page likes48
  • page page page page page page page page links79
  • page page page page page elsewhere45
  • page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page page minutiae8806
  • timeline timeline
  • search
  • topics topics
  • contact contact