[squeak-dev] [Q] How deal with unwanted looking to private stuff?Edgar J. De Cleene edgardec2001 at yahoo.com.arFri Jan 29 09:36:05 UTC 2010
On 1/29/10 8:17 AM, "Igor Stasenko" <siguctua at gmail.com> wrote: > I think, you should define rules for bots in robots.txt file, and put > there anything which you want robots to index, and what's not. > See http://www.robotstxt.org/robotstxt.html Very thanks!
More information about the Squeak-dev mailing list |