Building BobSmithPhotography.net has stopped expanding because I've been overwhelmed with spam on the comment forums. So, if you're here and have questions about web design come and visit Forums, Blogs, Wikis dot com. It has articles that I've written, some of which are also here, and a web design forum as well so you can ask any questions you may have. There is still a lot of good stuff here though, so poke around the links and take a look.
robots.txtThe robots.txt file is a small text file stored in the root of your web site that suggests what areas you do not want web crawlers to access. I say suggests because it is not a requirement that crawlers don't visit those pages listed, but more of a polite request for them not to. Most of the major bots respect this request. |
 |