[squeak-dev] SqueakSource indexability (aka should we just ask crawlers to desist?)

Ken Causey ken at kencausey.com
Wed Apr 28 20:59:42 UTC 2010


> -------- Original Message --------
> Subject: Re: [squeak-dev] SqueakSource indexability (aka should we just
> ask crawlers to desist?)
> From: Bert Freudenberg <bert at freudenbergs.de>
> Date: Wed, April 28, 2010 3:31 pm
> To: The general-purpose Squeak developers list
> <squeak-dev at lists.squeakfoundation.org>

> I just read up on it. Glob patterns are *not* allowed, the single asterisk in the user agent is a special char and not a pattern match. We used
> 
> User-agent: *
> Disallow: /@*
> 
> But it should be 
> 
> User-agent: *
> Disallow: /@
> 
> I'm going to fix that, let's see how it works out.
> 
> - Bert -

Thank you very much Bert, again...

Ken




More information about the Squeak-dev mailing list