Free tools
Robots.txt Examples
Robots.txt file content for eurogamer.net.
Robot.txt file for: eurogamer.net
User-agent: GPTBot Disallow: / User-agent: * Disallow: /search?q= Disallow: /search/ Disallow: /community/ Disallow: /*?view=comments Disallow: /*?ajax=1 Disallow: /*?preview_key= Disallow: /liveblog/ Disallow: /poll/* Disallow: /mypop/ Disallow: /for-you/ Disallow: /competition/ Sitemap: https://www.eurogamer.net/sitemap.xml Sitemap: https://www.eurogamer.net/sitemap-news.xml