Google

Table of bad robots

deutsch

This table contains a history about those bad or bad-appearing bots we exluded access for.
The listed bots ran into a bot trap (very often due to misuse or not honouring the robots.txt file see http://www.robotstxt.org).
Especially the reason "doesn't read robots.txt" means the bot ran into the trap without reading robots.txt before (every "good" bot reads robots.txt before and ignores "forbidden" pages afterwards).
In cases where in the column "remarks" is a note "emailaddress sniffer" a robot read out hidden emailaddresses from a website and now someone uses these addresses to send spam to. Because the emailaddresses are not real and contain information about date and ip address of the robot host we can show you information about the reading host and the hosts that use the sniffed emailaddresses for sending spam to.
If you believe we made a mistake to put your user agent in the database please contact us via hostmaster at weblab dot de.
Many thanks for the idea of this page to Ralf D. Kloth (http://www.kloth.net/internet/badbots.php)!!!

IP address(es)dateUser Agentexclusion reasonexcluded byremarkslast seenaccesses since 2005-04-21
80.90.232.1 (ns.homei.net.ua.)2006-01-11Mozilla/3.0 (compatible)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2007-02-27 22:28:0830
67.15.119.25 (ev1s-67-15-119-25.ev1servers.net.)2005-12-27User-Agent: User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)hides its identityUser Agentprobably bad programmed user agent (tries to camouflage as MS Internet Explorer but senselessly prepends a "User-Agent:"), what does it want from me???2007-07-16 09:21:081946
139.18.2.209, 139.18.2.43 (gkpc9.informatik.uni-leipzig.de., depth.informatik.uni-leipzig.de.)2005-12-27findlinks/1.1-a8 (+http://wortschatz.uni-leipzig.de/findlinks/)ignores entries in robots.txtUser Agent2013-07-23 19:58:38245
139.18.13.202 (woclu2.informatik.uni-leipzig.de.)2005-12-27findlinks/1.1-a7 (+http://wortschatz.uni-leipzig.de/findlinks/)ignores entries in robots.txtUser Agent2011-10-29 05:24:5260
84.185.191.95, 84.185.224.92 (.dip.t-dialin.net.)2005-12-27findlinks/1.1-a4 (+http://wortschatz.uni-leipzig.de/findlinks/)ignores entries in robots.txtUser Agent2005-12-23 10:27:502
63.241.61.7 (7-9745.san2.attens.net.)2005-12-20ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl)reads robots.txt and ignores it afterwardsUser AgentThough they declare in http://mail.tawdemo.com/crawl/ to use robots.txt they read it and ignore the values afterwards. So it is excluded until they have a better product.2007-03-11 03:40:355943
216.179.125.69 (tubgirl.biz.)2005-12-19WebVulnScan/1.0 libwww-perl/5.803misuses and ignores robots.txtUser AgentThis bot ignores entries in robots.txt and misuses them (it explicitly reads pages which are entries in robots.txt and which aren't referenced anywhere)2006-03-27 02:52:0478
65.98.67.74 (no reverse lookup, accoording ARIN it belongs to "Pegasus Web Technologies, New Jersey, USA")2005-12-19User-Agent: Mozilla/4.0 (http://www.fast-search-engine.com/)hides its identityUser Agentprobably bad programmed user agent (tries to camouflage as MS Internet Explorer but senselessly prepends a "User-Agent:"), the site www.fast-search-engine.com is VERY suspect. So I banned it until anybody tells me that it's better to let it through... :-)2005-12-28 07:27:444
213.36.152.95 (dyn-213-36-152-95.ppp.tiscali.fr.)2005-12-19Zeus 19083 Webster Pro V2.9 Win32User Agentif anybody can show me the sense of this bot I remove it from the list...2005-11-21 09:43:291
84.140.220.129 (p548CDC81.dip.t-dialin.net.)2005-12-19MSFrontPage/6.0we don't accept Frontpage as browserUser AgentFrontpage is not a regular browser therefor motivation to use it as a browser is unclear2005-12-04 13:42:511
38.99.203.110 (Panscient_Data_Services.demarc.cogentco.com.)2005-12-19Java/1.6.0-rcUser Agentbad programmed user agent, what does it want from me???2006-06-13 08:43:273
80.184.152.0/24, 80.184.191.0/24, 80.184.179.0/24, 80.184.181.0/24, 80.184.160.0/24, 80.184.170.0/24 (.d.pppool.de.)2005-12-19Java/1.5.0_05User Agentbad programmed user agent, what does it want from me???2005-12-30 14:43:2512
69.231.200.92 (adsl-69-231-200-92.dsl.irvnca.pacbell.net.)2005-12-19Java/1.5.0_05User Agentbad programmed user agent, what does it want from me???2005-12-05 01:52:512
84.178.26.216, 84.177.151.35, 84.178.12.204, 84.176.201.176, 84.176.86.156, 84.176.176.80, 84.176.60.83, 84.176.92.54, 84.176.49.88, 84.176.159.28, 84.176.173.96, 84.176.137.99, 84.176.208.246 (.dip0.t-ipconnect.de.)2005-12-19Java/1.4.2_03User Agentbad programmed user agent, what does it want from me???2005-12-29 10:01:4018
139.18.2.214, 139.18.2.81, 84.185.207.78 (aspra25.informatik.uni-leipzig.de., info015.informatik.uni-leipzig.de., p54B9CF4E.dip.t-dialin.net., p54B9F5B0.dip.t-dialin.net.)2005-12-19findlinks/1.1-a3 (+http://wortschatz.uni-leipzig.de/findlinks/)ignores entries in robots.txtUser Agent2007-05-11 10:26:4478
129.177.138.109, 129.177.44.58, 139.18.2.250 (proxy-gw.uib.no., tunnel-44-58.vpn.uib.no., ifiswai1.informatik.uni-leipzig.de.)2005-12-19findlinks/1.0.9 (+http://wortschatz.uni-leipzig.de/findlinks/)ignores entries in robots.txtUser Agent2005-12-18 23:54:5858
222.148.11.144 (p4144-ipbf707marunouchi.tokyo.ocn.ne.jp.)2005-12-05Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2005-12-04 13:33:343
212.227.60.13, 212.227.60.15, 212.227.83.122, 212.227.83.69 (p15181124.pureserver.info., p15181126.pureserver.info., p15188133.pureserver.info., p15188079.pureserver.info.)2005-12-05Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2007-09-09 14:46:52266
139.18.13.204, 139.18.2.216 (woclu4.informatik.uni-leipzig.de., pcai056.informatik.uni-leipzig.de.)2005-12-05findlinks/1.06 (+http://wortschatz.uni-leipzig.de/findlinks/)ignores entries in robots.txtUser Agent2009-09-01 16:31:58108
129.177.138.109 (proxy-gw.uib.no.)2005-12-05findlinks/1.0.8 (+http://wortschatz.uni-leipzig.de/findlinks/)ignores entries in robots.txtUser Agent2005-11-21 03:21:321
129.177.227.101 (AK227101.klientdrift.uib.no.)2005-12-05findlinks/1.01 (+http://wortschatz.uni-leipzig.de/findlinks/)ignores entries in robots.txtUser Agent2005-10-30 11:57:301
129.177.138.109 (proxy-gw.uib.no.)2005-12-05findlinks/1.0 (+http://wortschatz.uni-leipzig.de/findlinks/)ignores entries in robots.txtUser Agent2005-11-16 06:23:494
62.225.152.12 (no reverse lookup (according RIPE it belongs to "TSI fuer HVBG", Germany))2005-11-15Wget/1.9+cvs-stable (Red Hat modified)we simply don't accept wget...User Agent2005-11-13 02:25:193
80.144.222.127 (p5090DE7F.dip.t-dialin.net.)2005-11-15Java/1.5.0_05User Agentbad programmed user agent, what does it want from me???2005-11-14 20:41:138
213.131.235.103 (server00.whcity.de.)2005-11-15Java/1.5.0_05User Agentbad programmed user agent, what does it want from me???2005-11-17 22:02:43445
202.157.111.17 (ca9d6f-017.tiki.ne.jp.)2005-11-06curl/7.13.1 (powerpc-apple-darwin8.0) libcurl/7.13.1 OpenSSL/0.9.7g zlib/1.2.3no plain programmed software allowed hereUser Agent2005-10-26 06:51:351
211.124.134.24 (zaqd37c8618.zaq.ne.jp.)2005-11-06curl/7.10.2 (powerpc-apple-darwin7.0) libcurl/7.10.2 OpenSSL/0.9.7g zlib/1.1.4no plain programmed software allowed hereUser Agent2005-10-25 10:27:084
217.7.127.178 (no reverse lookup (according to RIPE it belongs to Sunrise Medical GmbH, Germany))2005-11-06Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2005-11-06 09:38:285
207.35.59.15 (no reverse lookup (according to ARIN it belongs to Bell, Canada))2005-11-06Mozilla/4.0 (compatible; Win32; WinHttp.WinHttpRequest.5)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2006-02-24 13:39:1124
12.44.181.220 (no reverse lookup (according to ARIN it belongs to AT&T, USA))2005-10-15Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; ....../1.0 )hides its identity, doesn't read robots.txtIP addresscamouflaged robot2007-06-09 18:21:5985
222.47.100.173 (no reverse lookup, according APNIC it belongs to CHINA RAILWAY TELECOMMUNICATIONS CENTER in Beijing, China))2005-10-05222.47.183.35 [no reverse lookup, according APNIC it belongs to CHINA RAILWAY TELECOMMUNICATIONS CENTER in Beijing, China)] (2005-06-24)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-09-28 10:40:081
200.153.202.86 (200-153-202-86.dial-up.telesp.net.br.)2005-10-05201.1.180.205 [201-1-180-205.dsl.telesp.net.br.] (2005-04-24)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-10-02 17:50:011
84.141.253.79 (p548DFD4F.dip.t-dialin.net.)2005-10-0584.141.198.209 [p548DC6D1.dip.t-dialin.net.] (2005-09-20)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-09-28 18:05:593
85.101.64.118 (no reverse lookup (according RIPE it belongs to Turk Telekom in Ankara, Turkey))2005-10-0585.99.150.19 [dsl.dynamic859915019.ttnet.net.tr.] (2005-06-04)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-09-28 10:41:581
85.102.147.86 (no reverse lookup (according RIPE it belongs to Turk Telekom in Ankara, Turkey))2005-10-0585.100.24.35 [dsl.dynamic851002435.ttnet.net.tr.] (2005-09-26)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-09-28 11:00:476
58.180.198.241 (no reverse lookup (according APNIC it belongs to ONSE Telecom Co. in Seoul, South Korea))2005-10-0558.93.60.89 [i58-93-60-89.s05.a013.ap.plala.or.jp.] (2005-09-10)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-09-29 23:44:531
58.180.212.180, 58.180.215.125 (no reverse lookup (according APNIC it belongs to ONSE Telecom Co. in Seoul, South Korea))2005-10-05219.66.234.214 [OFSfb-08p3-214.ppp11.odn.ad.jp.] (2005-09-15)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-09-29 16:51:522
58.180.198.191, 58.180.198.189 (no reverse lookup (according APNIC it belongs to ONSE Telecom Co. in Seoul, South Korea))2005-10-05210.159.183.201 [PPPbf1951.tokyo-ip.dti.ne.jp.] (2005-07-09)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-10-02 12:17:193
58.180.198.139, 58.180.215.210 (no reverse lookup (according APNIC it belongs to ONSE Telecom Co. in Seoul, South Korea))2005-10-05221.187.27.122 [p3122-ipbf401marunouchi.tokyo.ocn.ne.jp.] (2005-09-18)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-09-29 20:41:292
84.56.177.93 (dslb-084-056-177-093.pools.arcor-ip.net.)2005-10-0584.56.186.60 [dslb-084-056-186-060.pools.arcor-ip.net.] (2005-09-21)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-10-04 05:48:003
62.154.194.51 (mail.dbb.de.)2005-10-0585.178.96.97 [e178096097.adsl.alicedsl.de.] (2005-05-05)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-10-04 03:27:542
85.178.65.142, 85.178.67.103, 85.178.81.213, 85.178.84.218, 85.178.120.18, 85.178.69.24 (...adsl.alicedsl.de.)2005-10-0585.178.96.97 [e178096097.adsl.alicedsl.de.] (2005-05-05)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-10-04 22:32:1611
85.255.86.5 (zh07.zagler.net.)2005-10-0585.212.16.22 [p85.212.16.22.tisdip.tiscali.de.] (2005-09-21)at the date noted in the "User Agent" column a host with address (same column) has read emailaddresses from web pages and now the host with the address noted in the "IP address" column tries to send spams to these addressesIP addressemailaddress sniffer2005-10-04 13:11:421
216.168.237.71 (nat.networksolutions.com.)2005-09-28Java1.3.1_07User Agentbad programmed user agent, what does it want from me???2006-02-14 09:41:299
80.184.153.218, 80.184.216.66, 80.184.208.39, 80.184.169.212, 80.184.174.55, 80.184.204.200 (...d.pppool.de.)2005-09-28Java/1.4.2_09User Agentbad programmed user agent, what does it want from me???2005-10-16 21:16:4116
82.150.18.3 (no reverse lookup (according RIPE it belings to Communications Networking Services in Amsterdam))2005-09-28Java/1.4.2_05User Agentbad programmed user agent, what does it want from me???2005-11-04 05:49:2617
62.75.218.82 (elbe016.server4you.de.)2005-09-17Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x4.90)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2012-03-19 16:13:37553
68.164.8.154 (h-68-164-8-154.chcgilgm.dynamic.covad.net.)2005-09-17Java1.3.1_15User Agentbad programmed user agent, what does it want from me???2005-09-08 09:47:291
217.115.131.193, 217.115.131.194 (n217-115-131-193.cnet.hosteurope.de., n217-115-131-194.cnet.hosteurope.de.)2005-09-17User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows 98)hides its identityUser Agentprobably bad programmed user agent (tries to camouflage as MS Internet Explorer but senselessly prepends a "User-Agent:"), what does it want from me???2005-10-10 10:12:476
64.246.0.17 (ev1s-64-246-0-17.ev1servers.net.)2005-09-17Mozilla/4.0 (compatible; MSIE 5.01; Windows NT)hides its identity, reads robots.txt but ignores it afterwardsIP addresscamouflaged robot2006-10-12 14:27:569
63.160.77.236 (no reverse lookup (according to ARIN it belongs to Sprint, Reston, USA))2005-09-17Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; ....../1.0 )hides its identity, follows forbidden links, doesn't read robots.txtIP addresscamouflaged robot2007-06-09 18:26:35306
192.50.74.224 (uenodhcp224.apgrid.org.)2005-09-03Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2005-09-08 22:52:4745
62.217.61.165 (cylex.62217061165.obone.de.)2005-09-01Wget/1.10we simply don't accept wget...User Agent2005-09-24 12:07:537
84.148.0.0/16 (.dip.t-dialin.net.)2005-09-01User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.4) Gecko/20030711hides its identityUser Agentprobably bad programmed user agent (tries to camouflage as MS Internet Explorer but senselessly prepends a "User-Agent:"), what does it want from me???2006-03-25 10:38:0727
202.165.100.89, 202.165.100.90 (web77.search.cnb.yahoo.com., web78.search.cnb.yahoo.com.)2005-09-01curl/7.10.7 (i386-portbld-freebsd4.3) libcurl/7.10.7 OpenSSL/0.9.6g zlib/1.1.4no plain programmed software allowed hereUser Agent2005-08-31 23:39:305
203.28.159.135 (proxy5-10.adl2.internode.on.net.)2005-09-01Java/1.6.0-eaUser Agentbad programmed user agent, what does it want from me???2005-08-13 04:05:491
65.208.122.46 (no reverse lookup, according ARIN it belongs to "UUNET Technologies, Inc.")2005-09-01Java1.4.2_03User Agentbad programmed user agent, what does it want from me???2005-12-22 18:46:472
80.98.146.8, 80.98.142.182, 80.98.142.36, 80.98.143.230, 80.98.78.143, 80.98.78.137, 80.98.78.71, 80.98.78.212 (*.catv.broadband.hu.)2005-08-25Mozilla/4.0 (compatible ; MSIE 6.0; Windows NT 5.1)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2009-06-30 19:13:32258
194.254.160.4 (grief.griotte.com.)2005-08-11Wget/1.9+cvs-stable (Red Hat modified)we simply don't accept wget...User Agent2005-08-11 05:50:081
81.223.254.34 (e134.smartservercontrol.com.)2005-08-05Mozilla/4.0 (compatible; MSIE 5.01; Windows NT)hides its identity, doesn't read robots.txt, tries to read nonexisting filesIP addresscamouflaged robot2016-01-17 12:13:27238
several ip addresses2005-08-05Java/1.5.0_04User Agentbad programmed user agent, what does it want from me???2011-04-09 00:50:15328
68.126.233.177 (adsl-68-126-233-177.dsl.pltn13.pacbell.net.)2005-08-05curl/7.13.1 (powerpc-apple-darwin8.0) libcurl/7.13.1 OpenSSL/0.9.7b zlib/1.2.2no plain programmed software allowed hereUser Agentseems to be part of the test phase of http://www.nextthing.org/bot. Now it appears with a new string and is not blocked anymore because it accepts rules for robots.2005-07-24 13:06:221
195.134.143.180 (srv1.juhui.net.)2005-08-05Wget/1.9+cvs-devwe simply don't accept wget...User Agent2005-06-27 06:14:512
209.172.35.150, 209.172.52.233 (ip-209-172-35-150.reverse.privatedns.com., ip-209-172-52-233.reverse.privatedns.com.)2005-08-05User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows 98)hides its identityUser Agentprobably bad programmed user agent (tries to camouflage as MS Internet Explorer but senselessly prepends a "User-Agent:"), what does it want from me???2005-12-05 13:25:557
219.238.134.69 (no reverse lookup, according APNIC it belongs to "Beijing SHI JI GENG YUN CO.LTD")2005-08-05User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)hides its identityUser Agentprobably bad programmed user agent (tries to camouflage as MS Internet Explorer but senselessly prepends a "User-Agent:"), what does it want from me???2005-08-16 23:49:112
66.17.15.0/24 (.biz.bkfd.arrival.net)2005-07-30Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50215)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2007-02-06 08:31:14785
62.252.32.16 (cdif-cache-6.server.ntli.net.)2005-07-30Six Six Sixmisuses robots.txtIP addressExplicitly searched the robots.txt for Disallow-Entries and read the files referenced there (there were no other links to those files).2006-12-25 14:14:42139
72.3.139.243 (www.iag.com.)2005-07-15Wget/1.9+cvs-stable (Red Hat modified)we simply don't accept wget...User Agent2005-07-10 08:09:572
80.237.184.66 (crawl1.wwweasel.de.)2005-07-15WWWeasel Robot v1.00 (http://wwweasel.de)doesn't read robots.txtUser AgentSeems to be a new bot - but with a bad style, because they don't accept the common robot to read and interpret the robots.txt2006-01-31 13:27:09458
several ip addresses2005-07-04MSFrontPage/4.0we don't accept Frontpage as browserUser AgentFrontpage is not a regular browser therefor motivation to use it as a browser is unclear2016-03-10 23:16:4143
82.183.140.189 (1-1-14-39a.spa.sth.bostream.se.)2005-06-30Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2007-09-06 16:43:0922
84.149.191.149, 84.149.252.220 (dip.t-dialin.net)2005-06-30FS-WebC 0.1doesn't read robots.txtUser Agentunknown user agent, ignores existence of robots.txt, follows forbidden links2005-06-29 16:22:443
220.194.54.26, 220.194.54.27 (no reverse lookup, according APNIC it belongs to "China United Telecommunications Corporation")2005-06-30Mozilla/4.0 (compatible; MSIE 5.00; Windows 98hides its identity, doesn't read robots.txtIP addresscamouflaged robot2005-11-10 02:18:53139
several ip addresses2005-06-27Java/1.4.2_04User Agentbad programmed user agent, what does it want from me???2005-08-05 20:43:252
82.80.249.0/24 (.dcenter.bezeqint.net)2005-06-27Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; (R1 1.1); .NET CLR 1.1.4322)aggressive download agent, camouflaged agent, doesn't read robots.txtIP addressafter the ban of WebDownload of the same IP area they now try it with a camouflaged agent string. Welcome! :-))2006-11-01 22:34:4356
66.132.132.63 (securityspace.com)2005-06-27Mozilla/4.0 (compatible; MSIE 5.01; Windows NT)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2007-07-22 10:46:5831
195.62.20.7 (server7.cfmx.de)2005-06-27cupriBOT [http://www.cfmx.de/webspider]doesn't read robots.txtUser AgentThey clearly say they don't read robots.txt. This is a misbehaviour of the idea of robots. So this robot will be banned until they change their policy.2005-09-23 23:45:52139
217.172.186.195 (austria195.server4free.de)2005-06-09Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x4.90)hides its identity, doesn't read robots.txt, follows every linkIP addresscamouflaged robot2005-08-13 21:37:2619
80.190.240.51, 80.190.253.147, 212.112.227.153 (ipx10044.ipxserver.de, ipx10940.ipxserver.de, ipx11205.ipxserver.de)2005-06-08[G]ooglebot/2.1 (+http://www.google.com/bot.html) ("G" was included in brackets to avoid a database query match with the real google bot)hides its identity, doesn't read robots.txtIP addressdeclares itself as Google but it isn't (it ignores robots.txt)2005-11-15 02:11:3647
212.138.47.0/24 (.ruh.isu.net.sa.)2005-06-08Schmozilla/v9.14 Platinumdoesn't read robots.txtUser Agentprobably bad programmed user agent (sample code from perl cookbook), shows behaviour of a spider2005-06-07 03:09:592
61.30.75.68 (61-30-75-68.static.tfn.net.tw.)2005-06-08Java/1.4.2_07User Agentbad programmed user agent, what does it want from me???2005-06-07 03:05:2512
65.19.169.0/24 (no reverse lookup, according ARIN it belongs to "Integrated Data Processing, Inc.")2005-06-06[OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Internet Categorizer], [OmniExplorer_Bot/1.09 (+http://www.omni-explorer.com) Cars Crawler]doesn't read robots.txtIP addresshttp://www.omni-explorer.com just tells "coming soon". So we banned this bot because it's misbehaving and because the intention of this company is VERY unclear.2005-07-24 18:23:5382
64.71.131.0/24 (no reverse lookup, according ARIN it belongs to "Argon Blue")2005-06-06[OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Internet Categorizer], [OmniExplorer_Bot/1.09 (+http://www.omni-explorer.com) Cars Crawler]doesn't read robots.txtIP addresshttp://www.omni-explorer.com just tells "coming soon". So we banned this bot because it's misbehaving and because the intention of this company is VERY unclear.2005-07-24 18:23:5382
65.19.150.0/24 (no reverse lookup, according ARIN it belongs to "Hurricane Electric")2005-06-06[OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Internet Categorizer], [OmniExplorer_Bot/1.09 (+http://www.omni-explorer.com) Cars Crawler]doesn't read robots.txtIP addresshttp://www.omni-explorer.com just tells "coming soon". So we banned this bot because it's misbehaving and because the intention of this company is VERY unclear. 2005-12-19: They declare to be clean now. So this entry is deactivated but under investigation2005-11-24 01:22:3198
69.50.208.24 (no reverse lookup, according ARIN it belongs to "atjeu publishing, llc")2005-06-01[Mozilla/4.0 (compatible; MSIE 5.0; MSN 2.5; Windows 98; DigExt; Creative; KITV4 Wanadoo)], [Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.5b) Gecko/20030912 Firebird/0.6.1+], [Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; KITV4], ...hides its identity, doesn't read robots.txtIP addresshow funny - shows a different UA string with each access...2005-06-01 02:19:0418
69.50.193.104 (no reverse lookup, according ARIN it belongs to "atjeu publishing, llc")2005-06-01[Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; H010818; Hotbar 4.1.8.0; Hewlett-Packard; .NET CLR 1.0.3705)], [Mozilla/4.0 (compatible; MSIE 6.0b; Windows NT 5.0)], [Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Gestion Plus)], ...hides its identity, doesn't read robots.txtIP addresshow funny - shows a different UA string with each access...2005-05-31 19:11:0924
67.19.136.180 (ns1.bhelper.com)2005-06-01[Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; Version EI 02102000)], [Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Creative; Wanadoo 5.5; Wanadoo 6.0)], [Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-US; rv:1.0.1) Gecko/20021104 Chimera/0.], ...hides its identity, doesn't read robots.txtIP addresshow funny - shows a different UA string with each access...2005-05-31 16:22:0913
200.115.174.34 (host-200-115-174-34.ccipanama.com)2005-06-01[Mozilla/5.0 (X11; U; Linux i686; fr-FR; rv:1.0.0) Gecko/20020623 Debian/1.0.0-0.woody.1], [Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; i-NavFourF)], ...hides its identity, doesn't read robots.txtIP addresshow funny - shows a different UA string with each access...2005-05-28 22:55:017
205.209.134.60 (no reverse lookup, according ARIN it belongs to "m. marinero")2005-06-01[Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Hotbar 4.1.5.0)], [Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; LycosFR1)]hides its identity, doesn't read robots.txtIP addresshow funny - shows a different UA string with each access...2005-05-31 22:55:1129
81.180.251.250 (no reverse lookup, according RIPE it belongs to "O.A.O RoEduNet")2005-06-01MSIE 6.0doesn't read robots.txtIP addressIt seems to act as a spy for links in webpages2005-06-01 03:02:37204
133.51.10.140 (dhcp10-140.slis.tsukuba.ac.jp)2005-06-01Wget/1.9+cvs-stable (Red Hat modified)we simply don't accept wget...User Agent2005-05-25 09:40:501
several ip addresses2005-05-21JobSpider_BA/1.1reads robots.txt and ignores it afterwardsUser Agent2012-05-29 05:54:43280
67.167.114.21 (c-67-167-114-21.hsd1.il.comcast.net)2005-05-19[WorldWideWeb-X/3.1 (+http://www.worldwideweb-x.com/)], [Biology-X/3.1 (+http://www.biology-x.com/)], [Science-Index/3.1 (+http://www.science-index.com/)]reads robots.txt and ignores it afterwardsIP addressIgnores ALL entries of robots.txt. Very suspect bot and the websites in the ua string are mass copies. Until they don't do a better job they are banned2005-08-19 13:34:0268
68.164.230.30 (h-68-164-230-30.chcgilgm.dynamic.covad.net)2005-05-19[Christianity-X/3.1 (+http://www.christianity-x.com/)], [Caribbean-X/3.1 (+http://www.caribbean-x.com/)], [WorldWideWeb-X/3.1 (+http://www.worldwideweb-x.com/)], [Investing-X/3.1 (+http://www.investing-x.com/)], ...reads robots.txt and ignores it afterwardsIP addressIgnores ALL entries of robots.txt. Very suspect bot and the websites in the ua string are mass copies. Until they don't do a better job they are banned2005-05-17 07:33:2511
80.237.204.58 (ds80-237-204-58.dedicated.hosteurope.de)2005-05-19User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows 98)hides its identityUser Agentprobably bad programmed user agent (tries to camouflage as MS Internet Explorer but senselessly prepends a "User-Agent:"), what does it want from me???2005-12-13 06:52:087
69.230.202.16 (adsl-69-230-202-16.dsl.irvnca.pacbell.net)2005-05-19EmailSiphonEmail address collector (harvester)User Agent2005-05-16 22:17:521
several ip addresses2005-05-19Java/1.5.0_03User Agentbad programmed user agent, what does it want from me???2007-03-22 19:44:196
62.40.4.2 (no reverse lookup, according RIPE it belongs to "e-Prompt Germany Commercial Services GmbH")2005-05-19Java/1.4.1_05User Agentbad programmed user agent, what does it want from me???2005-08-09 11:08:012
69.64.49.243 (air840.startdedicated.com)2005-05-10curl/7.11.1 (i386-redhat-linux-gnu) libcurl/7.11.1 OpenSSL/0.9.7a ipv6 zlib/1.2.1.2User Agentchanges UA strings, declares itself as Google often2006-02-20 01:59:486463
195.244.228.86 (no reverse lookup, according RIPE it belongs to "HanseCom GmbH")2005-05-10Java1.3.1_07User Agentbad programmed user agent, what does it want from me???2005-05-09 18:52:522
198.54.202.210 (no reverse lookup, according AFRINIC it belongs to "Telkom SA Ltd.")2005-05-06Zeus 14 Webster Pro V2.9 Win32User Agentif anybody can show me the sense of this bot I remove it from the list...2005-05-06 12:17:481
70.84.220.194 (194.70-84-220.reverse.theplanet.com)2005-05-03[Mozilla/5.0 (X11; U; Linux i686; en-US; rv:0.9.9) Gecko/20020408], [Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; Wanadoo 5.2; Wanadoo 5.3; Wanadoo 5.5; (R1 1.3))],...doesn't read robots.txt; tries nonexistent page names itselfIP addresshow funny - shows a different UA string with each access...2005-05-11 16:27:27106
63.241.61.8 (8-9745.san2.attens.net.)2005-05-02ConveraCrawler/0.7 (+http://www.authoritativeweb.com/crawl)reads robots.txt and ignores it afterwardsUser AgentThough they declare in http://mail.tawdemo.com/crawl/ to use robots.txt they read it and ignore the values afterwards. So it is excluded until they have a better product.2005-12-08 11:56:2613601
67.106.152.131 (67.106.152.131.ptr.us.xo.net)2005-04-27Java/1.4.2_05User Agentbad programmed user agent, what does it want from me???2005-10-06 20:56:152
several ip addresses2005-04-27Java/1.4.1_04User Agentbad programmed user agent, what does it want from me???2016-12-08 01:24:014172
213.70.80.10 (no reverse lookup, according RIPE it belongs to "webwasher.com AG")2005-04-26Mozilla/5.001 (windows; U; NT4.0; en-us) Gecko/25250101hides its identity, doesn't read robots.txtIP addresscamouflaged robot2005-10-30 00:43:5763
217.65.17.18, 217.91.2.118 (adsl274.jetzweb.de, pd95b0276.dip0.t-ipconnect.de.)2005-04-26MSFrontPage/5.0we don't accept Frontpage as browserUser AgentFrontpage is not a regular browser therefor motivation to use it as a browser is unclear2005-11-27 15:59:243
several ip addresses2005-04-23Download Ninja 7.0doesn't read robots.txtUser AgentIt acts as a spy for links in webpages (even follows http://-texts if they aren't links, just hidden comments)2007-12-01 15:13:4385
several ip addresses2005-04-23Download Ninja 3.0doesn't read robots.txtUser AgentIt acts as a spy for links in webpages (even follows http://-texts if they aren't links, just hidden comments)2006-04-01 10:11:3595
217.20.114.85 (217-20-114-85.internetserviceteam.com)2005-04-23[Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)] or [Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.3)] or [Opera/7.23 (Windows NT 5.1; U) [de]] etc.hides its identity, doesn't read robots.txtIP addresshow funny - shows a different UA string with each access...2005-12-28 02:35:3021
216.65.117.228 (no reverse lookup, according ARIN it belongs to "VIRTUAL HOSTING GROUP SERVERS")2005-04-22Mozilla/4.0 (compatible; MSIE 5.01; Windows NT)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2006-11-24 14:19:468
67.15.16.28 (ev1s-67-15-16-28.ev1servers.net)2005-04-22User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)hides its identityUser Agentprobably bad programmed user agent (tries to camouflage as MS Internet Explorer but senselessly prepends a "User-Agent:"), what does it want from me???2005-12-14 08:07:14214
several ip addresses2005-04-21Wget/1.8.2we simply don't accept wget...User Agent2009-11-12 15:28:37177
220.132.160.57 (220-132-160-57.HINET-IP.hinet.net)2005-04-21Java/1.4.2_07User Agentbad programmed user agent, what does it want from me???2005-05-10 19:31:5213
several ip addresses2005-04-19Download Ninja 2.0doesn't read robots.txtUser AgentIt acts as a spy for links in webpages (even follows http://-texts if they aren't links, just hidden comments)2006-04-01 08:57:55137
several ip addresses2005-04-19Java(TM) 2 Runtime Environment, Standard EditionUser AgentBad programmed user agent? It acts as a spy for links in webpages (even follows http://-texts if they aren't links, just hidden comments)2008-01-27 18:17:54111
67.68.21.222 (Toronto-HSE-ppp3729413.sympatico.ca)2005-04-19Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2005-04-18 00:00:000
194.131.98.226 (fwco.surfcontrol.com)2005-04-19Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2006-03-31 17:03:0354
several ip addresses2005-04-17Wget/1.9.1we simply don't accept wget...User Agent2010-06-01 10:49:22105
several ip addresses2005-04-17Java/1.5.0_02User Agentbad programmed user agent, what does it want from me???2007-03-22 11:28:0779
195.14.205.173 (netcologne.de)2005-04-16Microsoft URL Control - 6.00.8169User Agentprobably bad programmed user agent, what does it want from me???2005-04-16 00:00:000
66.17.15.0/24 (.biz.bkfd.arrival.net)2005-04-16Schmozilla/v9.14 Platinumdoesn't read robots.txtUser Agentprobably bad programmed user agent (sample code from perl cookbook), shows behaviour of a spider2005-06-26 19:01:35242
80.237.207.72 (ds80-237-207-72.dedicated.hosteurope.de)2005-04-15Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)hides its identity, reads robots.txt and ignores it afterwardsIP addresscamouflaged robot2005-12-09 01:24:3442
several ip addresses2005-04-14Missigua Locator 1.9Scammer Bot, doesn't read robots.txtUser Agentused for 4-1-9 (see http://www.secretservice.gov/alert419.shtml)2008-04-07 23:05:24182
217.20.113.110 (ip110.ffm.traffic4all.com)2005-04-14[Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; FunWebProd] or [Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) WebWasher 3.3]doesn't read robots.txt; tries nonexistent page names itselfIP addresshow funny - shows a different UA string with each access...2006-04-14 15:32:53108
82.80.249.0/24 (.dcenter.bezeqint.net)2005-04-13WebDownloadaggressive download agent, doesn't read robots.txtUser Agentbanned as a first action, needs further action2005-06-01 19:42:0715
63.238.163.76, 209.200.25.56, 65.36.241.76, 64.235.250.82 (pm76.internetseer.com, inetseer2.webair.com., no reverse lookup, inetseer3.webair.com.)2005-04-13InternetSeer.comUser Agentif anybody can show me the sense of this bot I remove it from the list...2015-03-06 17:46:451067
211.49.151.21, 211.49.137.140 (no reverse lookup, according APNIC it belongs to "Thrunet Co., Ltd.")2005-04-12Microsoft URL Control - 6.01.9782User Agentprobably bad programmed user agent, what does it want from me???2005-05-28 08:32:421
81.189.87.77 (dsl-87-77.utaonline.at)2005-04-12Zeus 50531 Webster Pro V2.9 Win32User Agentif anybody can show me the sense of this bot I remove it from the list...2005-04-12 00:00:000
62.157.59.18, 62.157.61.71, 62.157.62.183, 62.157.51.91 (.dip.t-dialin.net)2005-04-12Java/1.4.2_05User Agentbad programmed user agent, what does it want from me???2005-04-19 00:00:000
38.118.42.35 (no reverse lookup, according ARIN it belongs to "Performance Systems International Inc.")2005-04-12Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)hides its identityIP addresscamouflaged robot2006-05-08 01:05:4266
38.118.42.38, 38.118.42.36 (no reverse lookup, according ARIN it belongs to "Performance Systems International Inc.")2005-04-12Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2006-08-18 14:26:381138
38.118.25.60 (no reverse lookup, according ARIN it belongs to "Performance Systems International Inc.")2005-04-12Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2006-05-24 00:11:45288
63.148.99.234, 63.148.99.237, 63.148.99.239, 63.148.99.240 (no reverse lookup, according ARIN it belongs to "Cyveillance")2005-04-11Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)hides its identity, doesn't read robots.txtIP addressunknown, camouflaged bot2006-09-27 15:16:312686
several ip addresses2005-04-11Java/1.4.2_06User Agentbad programmed user agent, what does it want from me???2008-02-25 19:33:49193
several ip addresses2005-04-11Java/1.4.2_08User Agentbad programmed user agent, what does it want from me???2016-09-29 02:03:271521
192.166.197.157 (no reverse lookup, according RIPE it belongs to CRONON in Berlin)2005-04-10Java1.1.7.30oUser Agentbad programmed user agent, what does it want from me???2007-07-13 00:33:23775
217.115.228.52 (no reverse lookup, according RIPE it belongs to "RDC Core Infrastructure" in Netherlands)2005-04-10Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)hides its identity, doesn't read robots.txtIP addresscamouflaged robot2005-09-05 16:36:0837
70.84.132.74, 70.84.196.98, 67.19.17.114 (.reverse.theplanet.com)2005-04-08Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0;)hides its identityIP addresscamouflaged robot2006-05-12 00:59:5068
24.227.118.54, 67.8.212.142, 67.8.209.191 (rrcs-24-227-118-54.se.biz.rr.com., 142.212.8.67.cfl.res.rr.com., 191.209.8.67.cfl.res.rr.com.)2005-04-08EmeraldShield.com WebBot (http://www.emeraldshield.com/webbot.aspx)User Agentvery suspect what they are doing2006-07-23 00:00:26107
several ip addresses2005-04-08empty user agent stringsif it's empty - what the user has to hide to?User AgentI don't like such nonsense "secrets" - banned!2016-12-08 04:57:3612733520
several ip addresses2005-04-08Microsoft URL Control - 6.00.8862User Agentprobably bad programmed user agent, what does it want from me???2012-09-03 10:17:082439
202.108.1.3, 202.108.1.4, 202.108.1.7, 202.108.1.11 (no reverse lookup, according APNIC it belongs to "China Network Communications Group Corporation")2005-04-02User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)hides its identityUser Agentprobably bad programmed user agent (tries to camouflage as MS Internet Explorer but senselessly prepends a "User-Agent:"), what does it want from me???2005-10-25 18:21:3438
84.133.219.71, 217.81.16.234, 217.85.55.156, 84.139.87.175, 217.247.75.211, 84.188.87.201 (.dip.t-dialin.net)2005-04-02Microsoft URL Control - 6.00.8169User Agentprobably bad programmed user agent, what does it want from me???2005-10-26 10:51:478
209.167.50.22 (no reverse lookup, according ARIN it belongs to "SevenTwentyfour Incorporated")2005-04-02LinkWalkerUser Agentunknown motivation - what are the goals?2006-12-12 14:39:02425
several ip addresses2005-04-01libwww-perl/5.51, libwww-perl/5.65, libwww-perl/5.69, libwww-perl/5.79, libwww-perl/5.801, libwww-perl/5.803, libwww-perl/5.48, libwww-perl/5.64, libwww-perl/5.75, libwww-perl/5.76, libwww-perl/5.800User Agentprobably bad programmed user agent, what does it want from me???2012-04-16 21:20:402710
217.205.124.18 (ENVISIONAL)2005-03-15ignores robots.txtIP addressEnvisional declares to look for misuse company marks only but does much more...2006-03-23 02:12:5312
several ip addresses2005-03-15Mozilla/3.0 (compatible; Indy Library)spam crawler, searches for files usually containing contact data like about.html, contact.html etc.User Agentspam mail address harvesting bot, Beijing Gold, sina.com, CN.2016-10-28 17:24:553027

Spams
Viruses
Telefontarife
Home

 Please look here!