We now have access to a complete snapshot copy of SqueakSource. I am
in the process of retrieving the files to my personal PC (not yet complete,
I'm still trying to get a clean copy of one large 15GB file), and I will
now need a place to put them on squeak.org.
I need some help to proceed. We need a server with 20 to 30 GB of file space
available for the SqueakSource files, and with memory and CPU resources
similar to whatever we are currently doing for source.squeak.org.
Can someone help, either by giving me access to an existing server, or by
letting me know what is available? I will need a user account (lewis) similar
to my current account on build.squeak.org, and I will need sudo privilege
to set up an account for squeaksource and to set up the runtime environment.
In addition it would be helpful if I could get enough access to the
source.squeak.org server so that I can look at it and figure out how that
server is configured. Even better would be if the source.squeak.org
server has enough capacity (mainly disk space) to also host squeaksource,
in which case we can put both of them on the same server.
I would like to do this as soon as possible (tomorrow perhaps?) so any
assistance and pointers will be gratefully received.
Thanks,
Dave
----- Forwarded message from Andrea Caracciolo <caracciolo(a)iam.unibe.ch> -----
From: Andrea Caracciolo <caracciolo(a)iam.unibe.ch>
Date: Fri, 23 Aug 2013 09:41:33 +0200
Subject: Re: squeaksource.com transition to new server
To: "David T. Lewis" <lewis(a)mail.msen.com>
Cc: Fabrizio Perin <perin(a)iam.unibe.ch>,
Andrei Vasile Chis <chisvasileandrei(a)gmail.com>,
Bert Freudenberg <bert(a)freudenbergs.de>,
Andrea CARACCIOLO <caracciolo(a)iam.unibe.ch>,
Oscar Nierstrasz <oscar(a)iam.unibe.ch>,
Chris Muller <asqueaker(a)gmail.com>, denker(a)acm.org
Hi David,
We have made all the files available at the following url:
http://scg.unibe.ch/download/SSdump/
username:
password:
Let me know if you need anything else.
> we would switch DNS entries at some agreed time after the move has been
successfully completed.
I made a quick WHOIS lookup and it seems that the domain is owned by Marcus
Denker (in CC).
I will keep the site running until you manage to set everything up on your
side.
Please keep me informed.
Cheers
_____________________________
Andrea Caracciolo - caracciolo(a)iam.unibe.ch
Software Composition Group
University of Bern
On Thu, Sep 19, 2013 at 07:41:41PM +0200, Tobias Pape wrote:
> Hi
> Am 18.09.2013 um 20:01 schrieb David T. Lewis <lewis(a)mail.msen.com>:
>
> >
> > Yes, this is how the image is configured. It is a copy of the actual squeaksource.com
> > image, with only a few changes that I made to correct problems with repository
> > loading, image saving, etc.
>
> Ok, then I know this image.
>
> > I installed it in /home/ssdotcom/SqueakSource/ and the file and directory structure
> > below this is an exact copy of the files at squeaksource.com.
>
> Ok.
>
> >
> >>
> >>> Can anyone tell me how to write a rule that would cause http://box3.squeak.org
> >>> to be mapped to the squeaksource service running on port 8888?
> >>
> >>
> >> First, arrange that squeaksource is the default seaside app in the image
> >> so that it responds to requests on /.
> >
> > I believe that this is the current configuration (although I am away and cannot
> > check anything in the image right now). The image is currently running on
> > box3.squeak.org:8888 and squeaksource is the default application.
>
> good.
>
> >
> >> Then, just use the first (with On) and the last Rewrite-statement.
> >>
> >
> > I am attaching a copy of the /etc/apache2/sites-available/squeaksource.com file.
> > This is a copy of the one that SCG provided to us, and I am trying to edit it
> > so that it will work on box3.squeak.org. Can you please take a look at this file
> > and tell me if it looks right to you?
>
> It looks exactly as the scg one with your obvious changes :)
>
> >
> > In the future, the public URL will be squeaksource.com, but of course for now
> > that URL is in use for the real squeaksource.com. I want to set up the Apache
> > configuration so that it will work when we switch the real URL, but in advance
> > of that I want to test it to make sure it is actually going to work.
>
> Well, the ServerName and ServerAlias really have to match the public DNS name
> when we use <VirtualHost *:80>. Apache then checks the host header and matches
> against that ServerName/Alias. What are the logs? (squeaksource-error.log)
>
Ah, I think I see now. Thanks.
I'm not sure what those logs are, but it looks like they will be just
the normal apache logging (whatever that might happen to be) renamed so
you can see that they came from the squeaksource.com virtual host.
>
> shouldn't we move this to box-admins?
>
Yes (I cc'ed box-admins this time). I've been trying to work this out on the
box-admins list but I suspect there may be a few more Apache gurus here on
squeak-dev, so I decided to hijack this thread and see if I could get some
tips. It worked :-)
> Best
> -Tobias
Thanks a lot for your help.
Dave
For many years, SqueakSource has been hosted by the Software Composition
Group and the University of Bern, providing a valuable resource to the
Squeak and Pharo community. The maintainers of SqueakSource at SCG have
kindly offered to support a transition of this service to a server maintained
by the Squeak community, and the Squeak oversight board has agreed to
take responsibility for maintaining that service.
Effective October 1, 2013 or thereabouts, the squeaksource.com address
will be redirected to a new server. This change may impact you in the
following ways:
1) Files that have been committed to SqueakSource since August 22, 2013
may be missing after the switch. We expect to identify and restore any
such missing files within a few days following the change, but until this
is complete, some recent repository updates will be temporarily missing.
2) If you are the owner of a project on SqueakSource, and have recently
(since August 22) made changes to your project such as adding new developer
authorizations, those recent changes may be lost. We will attempt to
identify problems such as this, but it may be necessary for you to redo
the changes.
3) Outbound mail notifications from SqueakSource will be disabled. If
your project is configured to send mail to a mailing list or to yourself
when commits are made, that mail will not be sent. This feature will be
restored in the future, but will not be available immediately after the
transition.
No changes have been made to existing SqueakSource policies, and at the
present time creation of new projects on squeaksource.com remains disabled.
Dave
On Fri, Sep 20, 2013 at 12:44:16PM -0300, Camillo Bruni wrote:
> If I read correctly on http://squeaksource.com/ it should be read-only by now? What is the time-frame?
The existing squeaksource.com service is being kept on line a little longer
to facilitate a proposed rehosting on one of the squeak.org servers.
Discussion at http://lists.squeakfoundation.org/pipermail/box-admins/
Great thanks to SCG for continued support and patience :-)
Dave
I am seeing console output like this:
http://build.squeak.org/job/CogVM/335/console
Construction à distance sur lfpdeb64 in workspace /home/tonyg/jenkins/workspace/CogVM
So how did a job that I set up to run on build.squeak.org end up getting
executed on a remote machine in an inappropriate environment?
I am guessing that the job got assigned to the lfpdeb64 slave machine
of Tony Garnock-Jones, but I cannot see how or why that happened. Any
ideas?
Dave
> -------- Original Message --------
> Subject: Re: [Box-Admins] Did www.squeak.org crash?
> From: Levente Uzonyi <leves(a)elte.hu>
> Date: Fri, September 13, 2013 6:22 pm
> To: Squeak Hosting Support <box-admins(a)lists.squeakfoundation.org>
> Cc: "squeak-dev(a)lists.squeakfoundation.org developers list"
> <squeak-dev(a)lists.squeakfoundation.org>
>
>
> My guess is that the server was restarted, or it ran out of memory a few
> times, because all images seem to be down.
> There used to be some sort of monitoring system (nagios maybe). I'm not
> sure if it's still working or not, but if it's not, then we can try using
> Hetzner's simple system monitoring sevice:
> http://wiki.hetzner.de/index.php/System_Monitor_%28SysMon%29/en
>
>
> Levente
>
> On Fri, 13 Sep 2013, Bert Freudenberg wrote:
>
> >
> > - Bert -
No, actually I rebooted the system which would inevitably cause
everything to stop working for a period of time.
I decided to take this step after having www.squeak.org go down again.
But, perhaps unsurprisingly, that didn't actually help. It turns out
that I in fact made a mistake and copied the files from the backup as
root (sudo bash, old-fashionedness and typing laziness) and failed to
change the ownership to the website account/group. Once I fixed this
and restarted it is up again, I believe everything is up. Of course
that may change so I will continue to check periodically for a while.
Ken
> -------- Original Message --------
> Subject: RE: [Box-Admins] Did www.squeak.org crash?
> From: "Ken Causey" <ken(a)kencausey.com>
> Date: Fri, September 13, 2013 3:45 pm
> To: "Squeak Hosting Support" <box-admins(a)lists.squeakfoundation.org>
> Cc: webteam(a)lists.squeakfoundation.org,
> "squeak-dev(a)lists.squeakfoundation.org developers list"
> <squeak-dev(a)lists.squeakfoundation.org>
>
>
> > -------- Original Message --------
> > Subject: [Box-Admins] Did www.squeak.org crash?
> > From: Bert Freudenberg <bert(a)freudenbergs.de>
> > Date: Fri, September 13, 2013 2:16 pm
> > To: Squeak Hosting Support <box-admins(a)lists.squeakfoundation.org>
> > Cc: "squeak-dev(a)lists.squeakfoundation.org developers list"
> > <squeak-dev(a)lists.squeakfoundation.org>
> >
> >
> > - Bert -
>
> Something like that. I tried to simply restart it but that didn't work.
> I've tried restoring a backup from a day ago and that doesn't seem to
> be working. I will continue to try b ackups but at a glance all the
> image files look larger than they should be which in the past has not
> been a good sign in terms of a working image. This may require
> assistance from someone with knowledge of the image/AIDA. But I will
> report back after I have tried all the backups or it is up again.
>
> Ken
I finally succeeded on the 4th or 5th attempt. But frankly I am
confused.
-rw-r--r-- 1 website website 10085010 Sep 13 09:00
squeaksite-badq.changes
-rw-r--r-- 1 website website 100529268 Sep 13 09:00
squeaksite-badq.image
These are copies of the image/changes (i/c for short) that I found
initially when the site was not responding.
-rw-r--r-- 1 website website 10085010 Sep 13 09:00
/var/cache/rsnapshot/daily.0/localhost/home/website/website/squeaksite.changes
-rw-r--r-- 1 website website 100529268 Sep 13 09:00
/var/cache/rsnapshot/daily.0/localhost/home/website/website/squeaksite.image
The above are the most recent backup i/c. I never even tried them since
they appeared to be direct copies of what obviously wasn't working.
-rw-r--r-- 1 website website 10081707 Sep 12 17:00
/var/cache/rsnapshot/daily.1/localhost/home/website/website/squeaksite.changes
-rw-r--r-- 6 website website 93703960 Aug 13 05:00
/var/cache/rsnapshot/daily.1/localhost/home/website/website/squeaksite.image
-rw-r--r-- 1 website website 10076943 Sep 11 16:00
/var/cache/rsnapshot/daily.2/localhost/home/website/website/squeaksite.changes
-rw-r--r-- 6 website website 93703960 Aug 13 05:00
/var/cache/rsnapshot/daily.2/localhost/home/website/website/squeaksite.image
-rw-r--r-- 1 website website 10072081 Sep 10 15:00
/var/cache/rsnapshot/daily.3/localhost/home/website/website/squeaksite.changes
-rw-r--r-- 6 website website 93703960 Aug 13 05:00
/var/cache/rsnapshot/daily.3/localhost/home/website/website/squeaksite.image
-rw-r--r-- 1 website website 10067622 Sep 9 15:00
/var/cache/rsnapshot/daily.4/localhost/home/website/website/squeaksite.changes
-rw-r--r-- 6 website website 93703960 Aug 13 05:00
/var/cache/rsnapshot/daily.4/localhost/home/website/website/squeaksite.image
-rw-r--r-- 1 website website 10062810 Sep 8 15:00
/var/cache/rsnapshot/daily.5/localhost/home/website/website/squeaksite.changes
-rw-r--r-- 6 website website 93703960 Aug 13 05:00
/var/cache/rsnapshot/daily.5/localhost/home/website/website/squeaksite.image
-rw-r--r-- 1 website website 10058287 Sep 7 15:00
/var/cache/rsnapshot/daily.6/localhost/home/website/website/squeaksite.changes
-rw-r--r-- 6 website website 93703960 Aug 13 05:00
/var/cache/rsnapshot/daily.6/localhost/home/website/website/squeaksite.image
And above are the other local backups we have, most recent to oldest. I
tried each of these in turn starting from daily.1. I waited at least 2+
minutes after restarting the image in each case. The one where it
finally worked and I stopped is daily.5. Now I didn't notice this until
after it was working and I looked more closely but the images in
daily.1-daily.6 all have the same size and date, in fact that date is a
month ago. I don't know how the image save works in the squeak.org
image, perhaps it was intelligent enough to note that there had been no
changes and so there had in fact been no need to save since Aug 13?
Why did the 5th one work? I don't know. I don't believe the image has
any external dependencies. Could it somehow depend on the changes file?
Any other explanation I can come up with suggests at minimum it is time
to reboot the system as a whole or that we have other more serious
problems. Everything else seems to be working for now, even
www.squeak.org is working. I'm just going to leave it alone for the
time being.
Ken
P.S. Note the number 6 in the second column of each of those
daily.1-daily.5 .image backups? That number indicates the links to the
file data, the number of paths in the directory table that all point to
the same file data. These 6 files are in fact actually just 6 directory
entries pointing to the same data (they daily.6 one is the 'original').
This is exactly how our backup system (rsnapshot/rsync) is supposed to
work. If a file has not changed from one backup to the next a hard link
is created to the file rather than copy the file. This is actually done
using the venerable cp command (see the -l option in the man page or
other documentation). Anyway the point is that when the each backup
took place, it was rsync's opinion that compared to the previous backup,
the image file was unchanged, in which case it did not copy the file
over the previously created hard link.
> -------- Original Message --------
> Subject: [Box-Admins] Did www.squeak.org crash?
> From: Bert Freudenberg <bert(a)freudenbergs.de>
> Date: Fri, September 13, 2013 2:16 pm
> To: Squeak Hosting Support <box-admins(a)lists.squeakfoundation.org>
> Cc: "squeak-dev(a)lists.squeakfoundation.org developers list"
> <squeak-dev(a)lists.squeakfoundation.org>
>
>
> - Bert -
Something like that. I tried to simply restart it but that didn't work.
I've tried restoring a backup from a day ago and that doesn't seem to
be working. I will continue to try b ackups but at a glance all the
image files look larger than they should be which in the past has not
been a good sign in terms of a working image. This may require
assistance from someone with knowledge of the image/AIDA. But I will
report back after I have tried all the backups or it is up again.
Ken