# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: Sitemap: http://www.reyada.com/sitemaps/tags/sitemap_index.xml.gz Sitemap: http://www.reyada.com/sitemaps/sections/sitemap_index.xml.gz Sitemap: http://www.reyada.com/sitemaps/sources/sitemap_index.xml.gz Sitemap: http://www.reyada.com/sitemaps/videos/sitemap_index.xml.gz Sitemap: http://www.reyada.com/sitemaps/articles/sitemap_index.xml.gz Sitemap: http://www.reyada.com/sitemaps/matches/sitemap_index.xml.gz Sitemap: http://www.reyada.com/sitemaps/teams/sitemap_index.xml.gz Sitemap: http://www.reyada.com/sitemaps/players/sitemap_index.xml.gz Sitemap: http://www.reyada.com/sitemaps/championships/sitemap_index.xml.gz Sitemap: http://www.reyada.com/sitemaps/static/sitemap_index.xml.gz #User-Agent: Google #Disallow: /admin/ #User-agent: Googlebot #Disallow: /admin/ #User-agent: Mediapartners-Google #Disallow: /admin/ User-agent: * Crawl-delay: 5 Disallow: /admin/ #User-Agent: * #Disallow: /