# /robots.txt file for http://www.film.com # mail staff@film.com for constructive criticism User-agent: Googlebot-Image Disallow: User-agent: yahoo-mmcrawler Disallow: User-agent: psbot Disallow: User-agent: * Sitemap: http://www.film.com/sitemap.xml Disallow: /auth/ Disallow: /authors/ Disallow: /movies/review Disallow: /movies/mediaplayback Disallow: /tv/mediaplayback Disallow: /celebrities/mediaplayback Disallow: /dvds/mediaplayback Disallow: /bigbrother/mediaplayback Disallow: /siff/mediaplayback Disallow: /play/ Disallow: /tv/season/ Disallow: /tv/episode/ Disallow: /features/photos/1/ Disallow: /features/photos/2/ Disallow: /features/photos/3/ Disallow: /features/photos/4/ Disallow: /features/photos/5/ Disallow: /features/photos/6/ Disallow: /features/photos/7/ Disallow: /features/photos/8/ Disallow: /features/photos/9/ Disallow: /features/photos/1*/ Disallow: /features/photos/2*/ Disallow: /features/photos/3*/ Disallow: /features/photos/4*/ Disallow: /features/photos/5*/ Disallow: /features/photos/6*/ Disallow: /features/photos/7*/ Disallow: /features/photos/8*/ Disallow: /features/photos/9*/ # changes # 21 JAN 09 changed disallow rules for individual photos to include '/features' prefix. # 21 JAN 09 changed disallow for /author/ to /authors/ # 2_02 removed disallow for Slurp # 2_01 added disallow for Slurp