User-agent: * allow: / allow: /courses/ allow: /images/ disallow: /aspnet_client/ disallow: /cabrillo/ allow: /caltranz/ disallow: /cf_files/ disallow: /email/