I've been reading these posts about plans for improving SqueakMap. The real deal maker is to mirror SqueakSource. If you could go to SM and know you were getting access to everything at SqueakSource and other things. Then it'd be compelling.
Andreas was saying that SM was useful because it could be searched by Google. You know, he's got a point. SqS is awful for finding things. Truly. Unless you know what you're looking for, forget it. And it'd be easy to add a Google search window.
But how to siphon all the data about projects out of SqS? I mean, Google can't crawl it, and there's a reason for that. Does anybody have an idea?
Chris
On 3/6/12, Chris Cunnington smalltalktelevision@gmail.com wrote: ....
But how to siphon all the data about projects out of SqS? I mean, Google can't crawl it, and there's a reason for that. Does anybody have an idea?
One option would be to to write a robot which regularily visits SqueakSource and other repositories and then use a screen scraper to extract the data and feed it into SqueakMap.
-- Hannes
On 6 March 2012 09:18, H. Hirzel hannes.hirzel@gmail.com wrote:
On 3/6/12, Chris Cunnington smalltalktelevision@gmail.com wrote: ....
But how to siphon all the data about projects out of SqS? I mean, Google can't crawl it, and there's a reason for that. Does anybody have an idea?
One option would be to to write a robot which regularily visits SqueakSource and other repositories and then use a screen scraper to extract the data and feed it into SqueakMap.
-- Hannes
While we're scraping things, a lot of folk (myself included) are either mirroring their packages on ss3.gemstone.com, or simply abandoning ss for ss3.
Also, the ss3 folk might be amenable to exposing an introspection API, or adding RESTful URLs?
But as a counterpoint, the project front pages _are_ indexable: googling "shift reset" shows http://www.squeaksource.com/Control/ as the 8th hit. But certainly nothing beyond those landing pages is indexable.
frank
Hi all!
On 03/06/2012 11:27 AM, Frank Shearar wrote:
On 6 March 2012 09:18, H. Hirzelhannes.hirzel@gmail.com wrote:
On 3/6/12, Chris Cunningtonsmalltalktelevision@gmail.com wrote: ....
But how to siphon all the data about projects out of SqS? I mean, Google can't crawl it, and there's a reason for that. Does anybody have an idea?
One option would be to to write a robot which regularily visits SqueakSource and other repositories and then use a screen scraper to extract the data and feed it into SqueakMap.
-- Hannes
While we're scraping things, a lot of folk (myself included) are either mirroring their packages on ss3.gemstone.com, or simply abandoning ss for ss3.
Also, the ss3 folk might be amenable to exposing an introspection API, or adding RESTful URLs?
I don't want to stifle any effort (*any* effort is good IMHO) but I think that the upcoming SmalltalkHub (that Nicolas is working on, and possibly with a bit of help from me if I ever get free time to spend) will offer a compelling new platform for all of SS and SM etc.
It would give all our communities (Squeak, Pharo and others) a chance to converge in a single much more powerful and fresh platform.
regards, Göran
On 06.03.2012, at 21:13, Göran Krampe wrote:
Hi all!
On 03/06/2012 11:27 AM, Frank Shearar wrote:
On 6 March 2012 09:18, H. Hirzelhannes.hirzel@gmail.com wrote:
On 3/6/12, Chris Cunningtonsmalltalktelevision@gmail.com wrote: ....
But how to siphon all the data about projects out of SqS? I mean, Google can't crawl it, and there's a reason for that. Does anybody have an idea?
One option would be to to write a robot which regularily visits SqueakSource and other repositories and then use a screen scraper to extract the data and feed it into SqueakMap.
-- Hannes
While we're scraping things, a lot of folk (myself included) are either mirroring their packages on ss3.gemstone.com, or simply abandoning ss for ss3.
Also, the ss3 folk might be amenable to exposing an introspection API, or adding RESTful URLs?
I don't want to stifle any effort (*any* effort is good IMHO) but I think that the upcoming SmalltalkHub (that Nicolas is working on, and possibly with a bit of help from me if I ever get free time to spend) will offer a compelling new platform for all of SS and SM etc.
It would give all our communities (Squeak, Pharo and others) a chance to converge in a single much more powerful and fresh platform.
regards, Göran
Many squeaksource urls are still in use. Squeaksource3 is similar enough to squeaksource so we can keep things working. The plan is to migrate everything from squeaksource to squeaksource3 and then just switch the url to point to the new ss3 server.
SmalltalkHub may become the first choice for new projects, when it is finished. For now, squeaksource3 is a fine successor to squeaksource that will be more stable but otherwise pretty similar.
- Bert -
squeak-dev@lists.squeakfoundation.org
-
Bert Freudenberg -
Chris Cunnington -
Frank Shearar -
Göran Krampe -
H. Hirzel