# Tells Scanning Robots Where They Are And Are Not Welcome # # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path # # For now disallow all we can modify this as needed to allow certain crawlers. # User-agent: * Disallow: /93 Disallow: /97 Disallow: /adv_tech Disallow: /airs Disallow: /attachments Disallow: /cal Disallow: /calendar Disallow: /cassini Disallow: /cchen Disallow: /cf_test Disallow: /cfdocs Disallow: /CFIDE Disallow: /cgi-bin Disallow: /coldfusion Disallow: /dailyplanet Disallow: /ds1news Disallow: /earth_test Disallow: /education Disallow: /ethics Disallow: /facts Disallow: /forum Disallow: /fweb Disallow: /fweb2 Disallow: /fweb_logs Disallow: /genesis Disallow: /genesismission Disallow: /gif Disallow: /grace Disallow: /info Disallow: /internal Disallow: /jason Disallow: /jpl-internal-only Disallow: /jupiterflyby Disallow: /kids Disallow: /lidar Disallow: /lost+found Disallow: /openhouse Disallow: /outgoing Disallow: /pictures Disallow: /planpro Disallow: /projects Disallow: /pso Disallow: /pso_old Disallow: /radar Disallow: /rm.old.cassini Disallow: /scijinks Disallow: /sespd Disallow: /sircxsar Disallow: /spaceplace Disallow: /stardust Disallow: /stylesheets Disallow: /temp Disallow: /tours Disallow: /voyager Disallow: /webalizer