Search Engine Rivals Come Together For Sitemaps
In a moment of rare cooperation, search rivals Google, Yahoo and Microsoft have, gasp, worked together to improve the sitemaps protocol which now features auto-discovery via a robots.txt file. In addition to new features, the big three announced that Ask.com and IBM will now also support the protocol.
Back in November we covered the initial launch of the sitemaps protocol, which was originally developed by Google, but quickly adopted by Yahoo and Microsoft as well.
Sitemaps are a tool for webmaster to control what pages on their site are indexed and how frequently the search engine spiders should update a page index.
Since then the Sitemaps team has launched a website and today announced the first big step in widespread adoption of the indexing tool: auto discovery.
Previously if you wanted to add your site’s sitemaps to search engine indexes you needed to create an account on each of the three search sites and then tell it where to find your sitemap. Not only was the process rather technical the additional complication of creating accounts, many felt sitemaps were more of a pain than they were worth.
But today’s announcement means that webmasters can add a sitemap to all four search engines by adding one line of code to a site’s robots.txt file. The actual code looks like this:
Sitemap: http://www.mysite.com/sitemap.xml
A Google Blog post on the subject notes that “we still think it’s useful to submit your Sitemap through Webmaster tools so you can make sure that the Sitemap was processed without any issues.”
Many of the search engines also provide some statistical analysis if you create an account which is a bonus for those that want more tools for watching site traffic. But at least now you don’t have to do that just to create a sitemap.
