user-agent: ABCdatos BotLink/1.0.2 user-agent: 'Ahoy! The Homepage Finder' user-agent: AITCSRobot/1.1 user-agent: AlkalineBOT user-agent: AnthillV1.1 user-agent: appie/1.1 user-agent: Arachnophilia user-agent: Araneo/0.7 user-agent: AraybOt/1.0 user-agent: ArchitextSpider user-agent: arks/1.0 user-agent: ASpider/0.09 user-agent: ATN_Worldwide User-agent: Atomz user-agent: Atomz/1.0 user-agent: AURESYS/1.0 User-agent: AVSearch user-agent: aWapClient user-agent: BackRub/*.* user-agent: BaySpider user-agent: bbot/0.100 user-agent: Big Brother user-agent: Bjaaland/0.5 user-agent: BlackWidow user-agent: borg-bot/0.9 user-agent: BoxSeaBot/0.5 user-agent: BSpider/1.0 libwww-perl/0.40 user-agent: CACTVS Chemistry Spider user-agent: Calif/0.6 user-agent: Checkbot/x.xx LWP/5.x user-agent: cIeNcIaFiCcIoN.nEt Spider user-agent: CMC/0.01 user-agent: combine/0.0 user-agent: ComputingSite Robi/1.0 user-agent: Confuzzledbot/X.X user-agent: CoolBot user-agent: cosmos/0.3 user-agent: CrawlPaper/n.n.n (Windows n) user-agent: Cusco/3.2 user-agent: CyberSpyder/2.1 user-agent: CydralSpider/X.X (Cydral Web Image Search; user-agent: DesertRealm.com; 0.2; [J]; user-agent: Deweb/1.01 user-agent: Die Blinde Kuh user-agent: dienstspider/1.0 user-agent: Digger/1.0 JDK/1.3.0 user-agent: Digimarc CGIReader/1.0 user-agent: Digimarc WebReader/1.2 user-agent: DIIbot user-agent: dlw3robot/x.y user-agent: DNAbot/1.0 user-agent: DragonBot/1.0 libwww/5.0 user-agent: Duppies user-agent: DWCP/2.0 user-agent: EbiNess/0.01a user-agent: EIT-Link-Verifier-Robot/0.2 user-agent: elfinbot user-agent: Emacs-w3/v[0-9\.]+ user-agent: EMC Spider user-agent: esculapio/1.1 user-agent: ESIRover v1.0 user-agent: ESISmartSpider/2.0 user-agent: esther user-agent: Evliya Celebi v0.151 - http://ilker.ulak.net.tr user-agent: explorersearch user-agent: FastCrawler 3.0.X (crawler@1klik.dk) - http://www.1klik.dk User-agent: FAST-WebCrawler user-agent: FelixIDE/1.0 user-agent: fido/0.9 Harvest/1.4.pl2 user-agent: Fish-Search-Robot user-agent: Freecrawl user-agent: FunnelWeb-1.0 user-agent: gammaSpider xxxxxxx ()/ user-agent: gazz/1.0 user-agent: gcreep/1.0 user-agent: gestaltIconoclast/1.0 libwww-FM/2.17 user-agent: GetURL.rexx v1.05 user-agent: Golem/1.1 User-agent: Googlebot user-agent: Googlebot/2.X (+http://www.googlebot.com/bot.html) user-agent: grabber user-agent: griffon/1.0 user-agent: Gromit/1.0 user-agent: Gulliver/1.1 user-agent: Gulper Web Bot 0.2.4 (www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot) user-agent: Hämähäkki/0.2 user-agent: havIndex/X.xx[bxx] user-agent: Hazel's Ferret Web hopper, user-agent: HKU WWW Robot, user-agent: Hometown Spider Pro User-agent: htdig user-agent: htdig/3.1.0b2 user-agent: HTMLgobble v2.2 user-agent: http://www.sygol.com user-agent: I Robot 0.4 (irobot@chaos.dk) user-agent: 'IAGENT/1.0' user-agent: iajaBot/0.1 user-agent: IBM_Planetwide, user-agent: image.kapsi.net/1.0 user-agent: IncyWincy/1.0b1 User-agent: InfoNaviRobot user-agent: Informant user-agent: InfoSeek Robot 1.0 user-agent: Infoseek Sidewinder user-agent: InfoSpiders/0.1 user-agent: INGRID/0.1 user-agent: inspectorwww/1.0 user-agent: Internet Cruiser Robot/2.1 user-agent: Iron33/0.0 user-agent: IsraeliSearch/1.0 user-agent: JavaBee user-agent: JBot (but can be changed by the user) user-agent: JCrawler/0.2 user-agent: JoBo (can be modified by the user) user-agent: Jobot/0.1alpha libwww-perl/4.0 user-agent: JoeBot/x.x, user-agent: JubiiRobot/version# user-agent: jumpstation user-agent: Katipo/1.0 user-agent: KDD-Explorer/0.1 user-agent: KIT-Fireball/2.0 libwww/5.0a user-agent: KO_Yappo_Robot/1.0.4(http://yappo.com/info/robot.html) user-agent: LabelGrab/1.1 user-agent: larbin (+mail) user-agent: legs User-agent: libwww-perl user-agent: libwww-perl-5.41 user-agent: Linkidator/0.93 user-agent: LinkScan Server/5.5 | LinkScan Workstation/5.5 user-agent: LinkWalker user-agent: Lockon/xxxxx user-agent: logo.gif crawler user-agent: LWP user-agent: LWP:: user-agent: Lycos/x.x User-agent: Lycos_Spider user-agent: M/3.8 user-agent: Magpie/1.0 user-agent: marvin/infoseek (marvin-team@webseek.de) user-agent: MediaFox/x.y User-agent: Mercator user-agent: MerzScope user-agent: MindCrawler user-agent: moget/1.0 user-agent: MOMspider/1.00 libwww-perl/0.40 user-agent: Monster/vX.X.X -$TYPE ($OSTYPE) user-agent: Motor/0.2 user-agent: mouse.house/7.1 user-agent: Mozilla 3.01 PBWF (Win95) user-agent: Mozilla/2.0 (compatible fouineur v2.0; fouineur.9bit.qc.ca) user-agent: Mozilla/2.0 (compatible; Ask Jeeves/Teoma) user-agent: Mozilla/3.0 (Black Widow v1.1.0; Linux 2.0.27; Dec 31 1997 12:25:00 user-agent: Mozilla/3.01 (compatible;) user-agent: Mozilla/4.0 (compatible: FDSE robot) user-agent: Mozilla/4.0 (compatible: Pimptrain's robot) user-agent: Mozilla/4.0 (compatible; ChristCrawler.com, ChristCrawler@ChristCENTRAL.com) user-agent: Mozilla/4.0 (compatible; SpiderView 1.0;unix) user-agent: Mozilla/4.0 (Sleek Spider/1.2) user-agent: MSNBOT/0.1 (http://search.msn.com/msnbot.htm) User-agent: MultiText user-agent: Muninn/0.1 libwww-perl-5.76 user-agent: MuscatFerret/ user-agent: MwdSearch/0.1 user-agent: NDSpider/1.5 user-agent: NEC-MeshExplorer user-agent: Nederland.zoek user-agent: NetCarta CyberPilot Pro user-agent: NetMechanic User-agent: NetMechanic user-agent: NetScoop/1.0 libwww/5.0a user-agent: newscan-online/1.1 user-agent: NHSEWalker/3.0 user-agent: Nomad-V2.x user-agent: NorthStar user-agent: ObjectsSearch/0.01 user-agent: Occam/1.0 user-agent: OntoSpider/1.0 libwww-perl/5.65 user-agent: Orbsearch/1.0 user-agent: PackRat/1.0 user-agent: PageBoy/1.0 user-agent: ParaSite/0.21 (http://www.ianett.com/parasite/) user-agent: Patric/0.01a user-agent: Peregrinator-Mathematics/0.7 user-agent: PerlCrawler/1.0 Xavatoria/2.0 user-agent: PGP-KA/1.2 user-agent: phpdig/x.x.x user-agent: PiltdownMan/1.0 profitnet@myezmail.com user-agent: Pioneer user-agent: PlumtreeWebAccessor/0.9 user-agent: Poppi/1.0 user-agent: PortalBSpider/1.0 (spider@portalb.com) user-agent: PortalJuice.com/4.0 user-agent: psbot/0.X (+http://www.picsearch.com/bot.html) user-agent: Raven-v2 user-agent: RHCS/1.0a user-agent: RixBot (http://www.oops-as.no/rix/) user-agent: Road Runner: ImageScape Robot (lim@cs.leidenuniv.nl) user-agent: Robbie/0.1 user-agent: RoboCrawl (http://www.canadiancontent.net) user-agent: Robofox v2.0 user-agent: Robot du CRIM 1.0a user-agent: Robozilla/1.0 user-agent: root/0.1 user-agent: Roverbot user-agent: RuLeS/1.0 libwww/4.0 user-agent: SafetyNet Robot 0.1, User-agent: Scooter user-agent: Scooter/2.0 G.R.A.B. V1.1.0 User-agent: SearchengineLicenceSheep user-agent: searchprocess/0.9 user-agent: Senrigan/xxxxxx user-agent: SG-Scout User-agent: shadow user-agent: Shagseeker at http://www.shagseek.com /1.0 user-agent: Shai'Hulud user-agent: SimBot/1.0 user-agent: Site Valet user-agent: SiteTech-Rover user-agent: SLCrawler User-agent: Slurp user-agent: Slurp/2.0 user-agent: Snooper/b97_01 user-agent: Solbot/1.0 LWP/5.07 user-agent: Speedy Spider ( http://www.entireweb.com/speedy.html ) User-agent: spider00.logika.net user-agent: SpiderBot/1.0 user-agent: spiderline/3.1.3 user-agent: SpiderMan 1.0 user-agent: ssearcher100 user-agent: straight FLASH!! GetterroboPlus 1.5 user-agent: suke/*.* user-agent: suntek/1.0 user-agent: Tarantula/1.0 user-agent: tarspider user-agent: TechBOT User-agent: Teleport Pro user-agent: Templeton/{version} for {platform} user-agent: TITAN/0.1 user-agent: TitIn/0.2 user-agent: TLSpider/1.1 User-agent: TV33_Mercator user-agent: UCSD-Crawler user-agent: UdmSearch user-agent: UdmSearch/2.1.1 user-agent: uptimebot user-agent: URL Spider Pro user-agent: urlck/1.2.3 user-agent: User-Agent: Mozilla/4.0 (compatible; sharp-info-agent v1.0; ) user-agent: Valkyrie/1.0 libwww-perl/0.40 user-agent: Verticrawl user-agent: Victoria/1.0 user-agent: vision-search/3.0' user-agent: void-bot/0.1 (bot@void.be; http://www.void.be/) user-agent: Voyager/0.0 user-agent: VWbot_K/4.2 user-agent: w@pSpider/xxx (unix) by wap4.com user-agent: w3index user-agent: W3M2/x.xxx user-agent: w3mir user-agent: web robot PEGASUS user-agent: WebBandit/1.0 user-agent: WebCatcher/1.0 user-agent: WebCopy/(version) user-agent: WebFetcher/0.8, user-agent: weblayers/0.0 user-agent: WebLinker/0.0 libwww-perl/0.1 user-agent: WebMoose/0.0.0000 user-agent: WebQuest/1.0 user-agent: WebReaper [webreaper@otway.com] user-agent: webs@recruit.co.jp user-agent: webvac/1.0 user-agent: webwalk user-agent: WebWalker/1.10 user-agent: WebWatch user-agent: Wget/1.4.0 user-agent: whatUseek_winona/3.0 user-agent: wired-digital-newsbot/1.5 user-agent: wlm-1.1 user-agent: WOLP/1.0 mda/1.0 user-agent: WWWC/0.25 (Win95) user-agent: WWWWanderer v3.0 user-agent: XGET/0.7 Disallow: /searchtools-rss.xml User-agent: * Disallow: /Gallery/ Disallow: /Gallery/html