robots.txt
Table of Contents
robots.txt
Example
User-agent: * Disallow: / User-agent: Bingbot User-agent: Googlebot Disallow:
Example Bots
Links
robots.txt.txt · Last modified: 2024-03-23 by hanez
Welcome, this is not the xw3 project Wiki... But it is part of the xw3.org development infrastructure.
User-agent: * Disallow: / User-agent: Bingbot User-agent: Googlebot Disallow: