User-agent: AboutUsBot Disallow: / User-agent: ah-ha.com Disallow: / User-agent: Alphablend Disallow: / User-agent: Alligator Disallow: / User-agent: AltoVistoWebCrawler Disallow: / User-agent: Amaya Disallow: / User-agent: amphetameme Disallow: / User-agent: asterias Disallow: / User-agent: autoemailspider Disallow: / User-agent: b2w Disallow: / User-agent: Baiduspider Disallow: / User-agent: Balihoo Disallow: / User-agent: BitBeamer Disallow: / User-agent: Brutus Disallow: / User-agent: Bullshit Disallow: / User-agent: bumblebee Disallow: / User-agent: CacheabilityEngine Disallow: / User-agent: Camino Disallow: User-agent: CAST Disallow: / User-agent: Charlotte Disallow: / User-agent: Check&Get Disallow: / User-agent: CheckLinks Disallow: / User-agent: CherryPicker Disallow: / User-agent: COMBINE Disallow: / User-agent: contype Disallow: / User-agent: CPT_CUM_PROXY_CHECKER Disallow: / User-agent: curl Disallow: / User-agent: Custo Disallow: / User-agent: Cyberdog Disallow: / User-agent: DeepIndexer Disallow: / User-agent: devSoft Disallow: / User-agent: DiaGem Disallow: / User-agent: DISCo Disallow: / User-agent: DnloadMage Disallow: / User-agent: DownloadSession Disallow: / User-agent: Download Demon User-agent: Download Express User-agent: Download Ninja User-agent: Download Wonder User-agent: Download Disallow: / User-agent: DreamPassport Disallow: / User-agent: DSurf Disallow: / User-agent: "DTS Agent" Disallow: / User-agent: EasyDL Disallow: / User-agent: EasyWebPromotion Disallow: / User-agent: EBrowse Disallow: / User-agent: eCatch Disallow: / User-agent: ElectricSurfMaster Disallow: / User-agent: Email Extractor User-agent: Email Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: ESurf Disallow: / User-agent: Exalead Disallow: / User-agent: ExtractorPro Disallow: / User-agent: ezic.com Disallow: / User-agent: fantomBrowser Disallow: / User-agent: fast Disallow: / User-agent: FDSE Disallow: / User-agent: FileHeap! file downloader User-agent: FileHeap! User-agent: FileHeap Disallow: / User-agent: FileHound Disallow: / User-agent: Fluffy Disallow: / User-agent: Franklin Locator Disallow: / User-agent: FreshDownload Disallow: / User-agent: FrontPage Disallow: / User-agent: FSurf Disallow: / User-agent: Funnel Disallow: / User-agent: Gaisbot Disallow: / User-agent: www.galaxy.com Disallow: / User-agent: Gamespy_Arcade Disallow: / User-agent: GetBot Disallow: / User-agent: Getinfo Disallow: / User-agent: GetRight Disallow: / User-agent: Gigabot Disallow: / User-agent: Gigabot/3.0 Disallow: / User-agent: Gigabot/2.0att Disallow: / User-agent: Girafabot Disallow: / User-agent: gnome-vfs Disallow: / User-agent: Go-Ahead-Got-It Disallow: / User-agent: Gozilla Disallow: / User-agent: Go!Zilla Disallow: / User-agent: McBot Disallow: / User-agent: grub-client Disallow: / User-agent: HLoader Disallow: / User-agent: home.thenewweb.com Disallow: / User-agent: HTTrack Disallow: / User-agent: iCollect Disallow: / User-agent: iGetter Disallow: / User-agent: ImageWalker Disallow: / User-agent: Industry Program Disallow: / User-agent: Indy Library User-agent: Indy Disallow: / User-agent: InternetLinkAgent/ Disallow: / User-agent: IntScanner Disallow: / User-agent: InstallShield DigitalWizard User-agent: InstallShield Disallow: / User-agent: ipd Disallow: / User-agent: Innerprise Disallow: / User-agent: IPiumBot Disallow: / User-agent: Iria Disallow: / User-agent: IUPUI Research Bot Disallow: / User-agent: Java1.3.0 User-agent: Java1.3.1 User-agent: Java1 User-agent: Java2 User-agent: Java Disallow: / User-agent: JoBo Disallow: / User-agent: JOC Web Spider Disallow: / User-agent: johnhasbeenhere Disallow: / User-agent: Kapere Disallow: / User-agent: Lachesis Disallow: / User-agent: Larbin Disallow: / User-agent: LeechGet Disallow: / User-agent: libwww-perl Disallow: / User-agent: LightningDownload Disallow: / User-agent: LinkAlarm Disallow: / User-agent: LinkChecker Disallow: / User-agent: LinkLint-checkonly Disallow: / User-agent: Linkman Disallow: / User-agent: LLUPDATECTRL Disallow: / User-agent: Mac Finder Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: Mass Downloader User-agent: Mass Disallow: / User-agent: MetaProducts Download Express User-agent: MetaProducts Disallow: / User-Agent: MFC_Tear_Sample Disallow: / User-agent: MFHttpScan Disallow: / User-agent: MicrosoftPrototypeCrawler User-agent: Microsoft URL Control User-agent: Microsoft Disallow: / User-agent: Missauga Locate User-agent: Missauga Locator User-agent: Missauga Disallow: / User-agent: Missouri College Browse Disallow: / User-agent: Mister PiX Disallow: / User-agent: MJ12bot Crawl-Delay: 86400 User-agent: moget Disallow: / User-agent: MovableType Disallow: / User-agent: Mozzilla Disallow: / User-agent: MSIECrawler Disallow: / User-agent: MSNBOT_Mobile Disallow: / User-agent: MSRBot Crawl-Delay: 86400 User-agent: MyGetRight Disallow: / User-agent: NaverBot User-agent: NaverRobot User-agent: Naver Disallow: / User-agent: "Net Probe" Disallow: / User-agent: NetPumper Disallow: / User-agent: NEWT ActiveX User-agent: NEWT Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Nitro Downloader User-agent: Nitro Disallow: / User-agent: "none of your business" Disallow: / User-agent: Nudelsalat Disallow: / User-agent: Nutch Disallow: / User-agent: oBot Disallow: / User-agent: Offline Explorer User-agent: Offline Disallow: / User-Agent: page_prefetcher Disallow: / User-agent: PagmIEDownload Disallow: / User-agent: panscient.com Disallow: / User-agent: pavuk Disallow: / User-agent: PlantyNet_WebRobot Disallow: / User-agent: Plucker Disallow: / User-agent: Pockey Disallow: / User-agent: Popdexter Disallow: / User-agent: Program Shareware User-agent: Program Disallow: / User-agent: Progressive Download User-agent: Progressive Disallow: / User-agent: ProxyTester Disallow: / User-agent: puf Disallow: / User-agent: PuxaRapido Disallow: / User-agent: Python-urllib Disallow: / User-agent: Python-webchecker Disallow: / User-agent: RobotMidareru Disallow: / User-agent: RealDownload Disallow: / User-agent: RPT-HTTPClient Disallow: / User-agent: RepoMonkey Bait & Tackle User-agent: RepoMonkey Disallow: / User-agent: Scat Disallow: / User-agent: ScoutAbout Disallow: / User-agent: Sonic Disallow: / User-agent: searchpreview Disallow: / User-agent: semanticdiscovery Disallow: / User-agent: Siphon Disallow: / User-agent: SiteSnagger Disallow: / User-agent: SiteWinder Disallow: / User-agent: Slurp Disallow: / Crawl-delay: 86400.0 User-agent: SlySearch Disallow: / User-agent: SmartDownload Disallow: / User-agent: SOFTWING_TEAR_AGENT Disallow: / User-agent: "Space Bison" Disallow: / User-agent: SpeedDownload Disallow: / User-agent: sprocket Disallow: / User-agent: SQ Webscanner User-agent: SQ Disallow: / User-agent: "SSM Agent" Disallow: / User-agent: Stamina Disallow: / User-agent: Star Downloader User-agent: Star Disallow: / User-agent: Steeler Disallow: / User-agent: SuperHTTP Disallow: / User-agent: SurveyBot Disallow: / User-agent: SynoBot Disallow: / User-agent: Teleport Disallow: / User-agent: Teoma Disallow: / User-agent: "tom bot" Disallow: / User-agent: "TSW Bot" Disallow: / User-agent: TurnitinBot Disallow: / User-agent: TweakMASTER Disallow: / User-agent: UdmSearch Disallow: / User-agent: Undisclosed Disallow: / User-agent: URLGetFile Disallow: / User-agent: "URL Spider SQL" Disallow: / User-agent: UtilMind HTTPGet User-agent: UtilMind Disallow: / User-agent: VCIKJZDDLS Disallow: / User-agent: vobsub Disallow: / User-agent: WebAlta Disallow: / User-agent: WebAuto Disallow: / User-agent: WebCapture Disallow: / User-agent: Webclipping.com Disallow: / User-agent: webcollage Disallow: / User-agent: WebCopier Disallow: / User-agent: "Web Downloader" Disallow: / User-agent: WebLeacher Disallow: / User-agent: "Web Link Validator" Disallow: / User-agent: "Web Magnet" Disallow: / User-agent: WEBMOLE Disallow: / User-agent: WebReaper Disallow: / User-agent: WebSauger Disallow: / User-agent: Website eXtractor Disallow: / User-agent: WebStripper Disallow: / User-agent: WebZIP Disallow: / User-agent: WEP Search 00 User-agent: WEP Search User-agent: WEP Disallow: / User-agent: WGet User-agent: Wget Disallow: / User-agent: WhizBang Disallow: / User-agent: Wildsoft Surfer User-agent: Wildsoft Disallow: / User-agent: WinHttp.WinHttpRequest Disallow: / User-agent: www4mail Disallow: / User-agent: WWWOFFLE Disallow: / User-agent: Xaldon WebSpider User-agent: Xaldon Disallow: / User-agent: xEdit Disallow: / User-agent: Xenu Disallow: / User-agent: Yandex Disallow: / User-agent: Zao Disallow: / User-agent: ZBot Disallow: / User-agent: Zeus Disallow: / User-agent: ZyBorg Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: whsearch Disallow: /