Add Sitemap To robots.txt For Autodiscovery


All search crawlers recognize robots.txt, so it seemed like a good idea to use that mechanism to allow webmasters to share their Sitemaps. You agreed and encouraged us to allow robots.txt discovery of Sitemaps on our suggestion board. We took the idea to Google and Microsoft and are happy to announce today that you can now find your sitemaps in a uniform way across all participating engines. To do this, simply add the following line to your robots.txt file: Sitemap: http://www.example.tld/sitemap.xml

Information and Links

Join the fray by commenting, tracking what others have to say, or linking to it from your blog.


Other Posts
Remove X-cart Footer
Amazon s3 backup for web server files and SQL using bash

Write a Comment

Take a moment to comment and tell us what you think. Some basic HTML is allowed for formatting.

You must be logged in to post a comment. Click here to login.

Reader Comments

Be the first to leave a comment!