[squeak-dev] SqueakSource indexability (aka should we just ask crawlers to desist?)
Ken Causey
ken at kencausey.com
Wed Apr 28 20:59:42 UTC 2010
> -------- Original Message --------
> Subject: Re: [squeak-dev] SqueakSource indexability (aka should we just
> ask crawlers to desist?)
> From: Bert Freudenberg <bert at freudenbergs.de>
> Date: Wed, April 28, 2010 3:31 pm
> To: The general-purpose Squeak developers list
> <squeak-dev at lists.squeakfoundation.org>
> I just read up on it. Glob patterns are *not* allowed, the single asterisk in the user agent is a special char and not a pattern match. We used
>
> User-agent: *
> Disallow: /@*
>
> But it should be
>
> User-agent: *
> Disallow: /@
>
> I'm going to fix that, let's see how it works out.
>
> - Bert -
Thank you very much Bert, again...
Ken
More information about the Squeak-dev
mailing list
|