User-agent: * Disallow: / # Baidu Bots User-agent: baiduspider Disallow: User-agent: baiduspider-image Disallow: User-agent: baiduspider-mobile Disallow: User-agent: baiduspider-news Disallow: User-agent: baiduspider-video Disallow: # Bing Bots User-agent: bingbot Disallow: User-agent: msnbot Disallow: User-agent: msnbot-media Disallow: User-agent: adidxbot Disallow: # Google Bots User-agent: Googlebot Disallow: User-agent: Googlebot-Image Disallow: User-agent: Googlebot-Mobile Disallow: User-agent: Googlebot-News Disallow: User-agent: Googlebot-Video Disallow: User-agent: AdsBot-Google Disallow: User-agent: bingbot Disallow: # Yahoo Bot User-agent: slurp Disallow: # Yandex Bot User-agent: yandex Disallow: