Search Engine optimisation
- https://www.google.com/webmasters - Google webmaster tools.
- http://www.google.com/support/webmasters - Google webmaster info.
DMOZ - open directory project
Yahoo
- https://siteexplorer.search.yahoo.com/mysites - yahoos equivalent of google webmasters page.
others
- http://search.msn.com/msnbot.htm
- http://www.gigablast.com/spider.html
- http://www.cuil.com/twiceler/robot.html
robots.txt
Need to have robots.txt properly setup for xwiki so it doesnt crash.- http://www.robotstxt.org/robotstxt.html
- http://www.mcanerin.com/EN/search-engine/robots-txt.asp - robots generator
- http://platform.xwiki.org/robots.txt - this is the file for Xwiki
optimisation tips
- http://www.webconfs.com/15-minute-seo.php - this page has some good basic tips for SEO on a website, not sure how current it is though.