Hi Rob,

Robots.txt is just a file to tell crawlers about folders or paths you don't want them to crawl. Not all crawlers are good citizens though and may ignore it.

Its not generated it exists in the root and applies to all sites withing an installation and can be edited with a text editor but if you do customize it you should keep a backup somewhere because it will be overwritten on upgrades since it is included. If you point me to documentation about something that needs to be there for Live Search, then maybe I will include it.

Or maybe you are thinking about the siteroot/SiteMap.ashx which is the generated site map for submitting to google and other search engines.

Hope it helps,

Joe

Yes, now that I'm signed in I can submit my site, both the root url and the site map url. Doing this precludes any need for autodiscovery via robots.txt.

Best,

Joe

They apparently are new to supporting sitemap protocol, there is a disadvantage with Live Search because with google you can submit multiple site maps not just one. So for example the blog feature has its own site map at siteroot/Blog/BlogSiteMap.ashx If you are using your site primarily as a blog it may be better to submit that one instead of the main one to Live Search.

Event Calendar Pro also has its own site map for events at /siteroot/Events/EventSiteMap.ashx

WebStore does not yet have its own site map but I created a plain xml file for my few products and submitted that site map to google as well.

Hopefully Live Search will get on the ball.

Best,

Joe