Box-Admins October 2013

box-admins@lists.squeakfoundation.org

9 participants
12 discussions

Server needed for squeaksource hosting [caracciolo@iam.unibe.ch: Re: squeaksource.com transition to new server]
by David T. Lewis 25 Nov '13

25 Nov '13

We now have access to a complete snapshot copy of SqueakSource. I am in the process of retrieving the files to my personal PC (not yet complete, I'm still trying to get a clean copy of one large 15GB file), and I will now need a place to put them on squeak.org. I need some help to proceed. We need a server with 20 to 30 GB of file space available for the SqueakSource files, and with memory and CPU resources similar to whatever we are currently doing for source.squeak.org. Can someone help, either by giving me access to an existing server, or by letting me know what is available? I will need a user account (lewis) similar to my current account on build.squeak.org, and I will need sudo privilege to set up an account for squeaksource and to set up the runtime environment. In addition it would be helpful if I could get enough access to the source.squeak.org server so that I can look at it and figure out how that server is configured. Even better would be if the source.squeak.org server has enough capacity (mainly disk space) to also host squeaksource, in which case we can put both of them on the same server. I would like to do this as soon as possible (tomorrow perhaps?) so any assistance and pointers will be gratefully received. Thanks, Dave ----- Forwarded message from Andrea Caracciolo <caracciolo(a)iam.unibe.ch> ----- From: Andrea Caracciolo <caracciolo(a)iam.unibe.ch> Date: Fri, 23 Aug 2013 09:41:33 +0200 Subject: Re: squeaksource.com transition to new server To: "David T. Lewis" <lewis(a)mail.msen.com> Cc: Fabrizio Perin <perin(a)iam.unibe.ch>, Andrei Vasile Chis <chisvasileandrei(a)gmail.com>, Bert Freudenberg <bert(a)freudenbergs.de>, Andrea CARACCIOLO <caracciolo(a)iam.unibe.ch>, Oscar Nierstrasz <oscar(a)iam.unibe.ch>, Chris Muller <asqueaker(a)gmail.com>, denker(a)acm.org Hi David, We have made all the files available at the following url: http://scg.unibe.ch/download/SSdump/ username: password: Let me know if you need anything else. > we would switch DNS entries at some agreed time after the move has been successfully completed. I made a quick WHOIS lookup and it seems that the domain is owned by Marcus Denker (in CC). I will keep the site running until you manage to set everything up on your side. Please keep me informed. Cheers _____________________________ Andrea Caracciolo - caracciolo(a)iam.unibe.ch Software Composition Group University of Bern

5 20

Please add chrismuller to ssdotcom
by Chris Muller 31 Oct '13

31 Oct '13

I would like to examine the SqueakSource socket leak issue. Dave, Ken, or someone -- would you please add me to ssdotcom group on box3. Thanks.

2 1

squeaksource.com image changes
by Chris Muller 30 Oct '13

30 Oct '13

I'm going through Dave's image and looking at all changes and merging them into the current SqueakSource package maintained at source.squeak.org/ss. Dave's squeaksource.com image runs with a dirty Monticello package. All but one of the changes appear to be in trunk. The one that's not -- Bert, you made this change to MCVersionMerger>>#addVersion: to remove the lines indicated with an X in front: addVersion: aVersion records add: (MCMergeRecord version: aVersion). X aVersion dependencies do: X [ : ea | | dep | X dep := ea resolve. X (records anySatisfy: X [ : r | r version = dep ]) ifFalse: [ self addVersion: dep ] ] Does this need to be a permanent MC change? What is the purpose of this? On Sat, Oct 12, 2013 at 4:58 PM, David T. Lewis <lewis(a)mail.msen.com> wrote: > On Wed, Oct 02, 2013 at 05:33:31PM +0200, Bert Freudenberg wrote: >> On 2013-10-02, at 17:17, "David T. Lewis" <lewis(a)mail.msen.com> wrote: >> >> > Would you mind putting a copy of the image and changes files for source.squeak.org >> > on box3 so I can take a look at it (I don't have access to box2)? Thanks. >> >> Done: ~bertfreudenberg/ >> > > I have replaced the older squeaksource.com image with a newer image based on > the source.squeak.org image that Bert provided. I activated the new image > on box3.squeak.org today, and am monitoring it for problems. > > I started the repository export yesterday and completed the import to the new > image today. During that period there have been no commits to squeaksource.com, > so I anticipate no loss of data. > > The new image is called ~ssdotcom/SqueakSource/squeaksource.3.image. In the > event of problems, the rollback plan is to reactivate the older > ~ssdotcom/SqueakSource/squeaksource.2.image (see ~ssdotcom/README for details). > > Currently the new image is running and appears to work fine (although users > may have noticed some brief outages, for which I apologize). However it is > currently consuming a heavy CPU load, so I am watching to see if this goes > down (I have seen similar patterns in the past related to cache updates, > which seem to settle down after a while). If the CPU load does not go back > down within the next hour, I will revert back to the old image and try this > again on another day. > > Dave >

4 4

Re: [squeak-dev] MC accessing 'source/squeak.org' fails with 301/301 type error
by David T. Lewis 23 Oct '13

23 Oct '13

On Thu, Sep 19, 2013 at 07:41:41PM +0200, Tobias Pape wrote: > Hi > Am 18.09.2013 um 20:01 schrieb David T. Lewis <lewis(a)mail.msen.com>: > > > > > Yes, this is how the image is configured. It is a copy of the actual squeaksource.com > > image, with only a few changes that I made to correct problems with repository > > loading, image saving, etc. > > Ok, then I know this image. > > > I installed it in /home/ssdotcom/SqueakSource/ and the file and directory structure > > below this is an exact copy of the files at squeaksource.com. > > Ok. > > > > >> > >>> Can anyone tell me how to write a rule that would cause http://box3.squeak.org > >>> to be mapped to the squeaksource service running on port 8888? > >> > >> > >> First, arrange that squeaksource is the default seaside app in the image > >> so that it responds to requests on /. > > > > I believe that this is the current configuration (although I am away and cannot > > check anything in the image right now). The image is currently running on > > box3.squeak.org:8888 and squeaksource is the default application. > > good. > > > > >> Then, just use the first (with On) and the last Rewrite-statement. > >> > > > > I am attaching a copy of the /etc/apache2/sites-available/squeaksource.com file. > > This is a copy of the one that SCG provided to us, and I am trying to edit it > > so that it will work on box3.squeak.org. Can you please take a look at this file > > and tell me if it looks right to you? > > It looks exactly as the scg one with your obvious changes :) > > > > > In the future, the public URL will be squeaksource.com, but of course for now > > that URL is in use for the real squeaksource.com. I want to set up the Apache > > configuration so that it will work when we switch the real URL, but in advance > > of that I want to test it to make sure it is actually going to work. > > Well, the ServerName and ServerAlias really have to match the public DNS name > when we use <VirtualHost *:80>. Apache then checks the host header and matches > against that ServerName/Alias. What are the logs? (squeaksource-error.log) > Ah, I think I see now. Thanks. I'm not sure what those logs are, but it looks like they will be just the normal apache logging (whatever that might happen to be) renamed so you can see that they came from the squeaksource.com virtual host. > > shouldn't we move this to box-admins? > Yes (I cc'ed box-admins this time). I've been trying to work this out on the box-admins list but I suspect there may be a few more Apache gurus here on squeak-dev, so I decided to hijack this thread and see if I could get some tips. It worked :-) > Best > -Tobias Thanks a lot for your help. Dave

6 45

Username 'lewis' changed to 'davidlewis' on box3
by Ken Causey 23 Oct '13

23 Oct '13

At David's request and in the spirit of consistency I have changed David's username on box3 from 'lewis' to 'davidlewis' and moved his home directory in the process. For the curious the magic incantation that does this in one step was $ sudo usermod -l davidlewis -d /home/davidlewis -m lewis Ken

1 0

box3.squeak.org off line - HELP neeeded
by David T. Lewis 14 Oct '13

14 Oct '13

I cannot ping box3.squeak.org, which is our build.squeak.org and squeaksource.com server. The box4.squeak.org box is responding, but box3 times out on a ping. Can someone please check it and restart if needed? If rebooted, the squeaksource.com service will require a manual restart as per ~ssdotcom/README. I have limited connectivity today but will try to keep in touch. A root cause analyis will be in order, and since squeaksource.com is the most recent change on box3.squeak.org, that will be an obvious suspect. TIA, Dave

8 27

The technical side of the status of things
by Ken Causey 12 Oct '13

12 Oct '13

I'm going to try to summarize as simply as I can the servers statuses, the original plan, modifications to the plan, and what has been done. First our assets: Hetzner - box2.squeak.org (85.10.195.197) - Our aging outgoing server that has been our singular server for many years now and hosted all online services. Stats: ancient version of Debian, full hardware server, 1GB RAM, 150GB HD Gandi.net - box3.squeak.org (173.246.101.237) - This server was originally allocated and setup at the request of Frank for use as a continuous integration server and hosts build.squeak.org, a Jenkins instance. As far as I am concerned this is still the primary purpose of this server. Currently this is also hosting our 'recovered' squeaksource.com. David can speak to details about the plan for this. Stats: current and up to date Debian Squeeze (32bit), virtual server, 1GB RAM, 60GB HD Gandi.net - box4.squeak.org (173.246.104.42) - This server is intended to be the primary replacement host for box2.squeak.org. I'll speak more to the status of this server below. Stats: current and up to date Debian Wheezy (64bit), virtual server, 4GB RAM, 100GB HD Both Gandi.net virtual servers are provided kindly by Gandi.net at no charge and through an agreement and with the assistance of the Software Freedom Consortium and Bradley Kuhn. The plan: In brief the goal is to replicate all existing services hosted by the old server using primarily box4 and secondarily box3. My intention had been to setup mailman and mailing list hosting on box3 to reduce the load on box4. However this was prior to setting up squeaksource.com on box3 and so this is now unlikely without changes. The intention is to use up to date software and use leaner software when possible, for example: nginx for top-level HTTP, qmail for SMTP, djbdns for DNS, etc. Both classic Squeak VM and Cog VM would be available. Super user access is consistently through sudo which logs actions in case of problems. Every individual with access to the server will have their own personal account. How to handle access to 'shared' resources is still somewhat to be determined. Status: On both servers an administrative log is being kept in /root/admin-log.txt with a hopefully consistent format and under RCS. Those with access should feel free to review these for more detail. DNS (djbdns) has been setup on both box3 and box4. box4 is the primary DNS and box3 the secondary and automatically updates from box4. Repeated emails to the holders of squeak.org and squeakfoundation.org to update the root servers to point to these have met with total silence. This has been frustrating. Daemontools has been installed and whenever 'service' software needs to be maintained and does not come with ready support for init, Daemontools can and should be used. Whenever software needs to be installed which is not readily installable via apt-get (or a newer version is desired) checkinstall should be used to build and install a debian package so that all installed software can be consistently managed. Classic SqueakVM 4.10.2.2614 was built and a debian package produced and installed. Some testing was done but issues may remain and a newer version may well be available. All .sources files were placed in a central location so that none should be needed per project. This will need to be updated (links?) whenever a new VM version is installed. NTP server was installed. Nginx was installed on box4 but little configuration has been done. I repeatedly tried to build and install Cog but ran into multiple problems. Even beyond build problems one issue is that Cog is built to name the executable squeak and as such collides with the Classic VM. Having both VMs seems necessary given the age of some of the Squeak hosted services. Having Cog is desirable for more recent services and updates to the old ones. Note that work on both VMs was some time back and the issues I had would need to be revisited and evaluated. Ken

2 2

If you need something from me...
by Ken Causey 10 Oct '13

10 Oct '13

Please note that I'm not following the mailing lists with the care that I have in the past. I follow box-admins more closely but still I'm going to miss things, particularly buried deep in a long thread. If you expect me to do something then I strongly suggest you send an email directly to me (ken(a)kencausey.com and cc the list as well) and specify a new and explicit subject. Ken

1 1

Cees de Groot added to box3/box4
by Ken Causey 10 Oct '13

10 Oct '13

I have added accounts for Cees to both box3 and box4. Ken

1 0

The status of things
by Ken Causey 08 Oct '13

08 Oct '13

First I have to say that I'm sorry. I've clearly failed to provide the level of service that the box-admins team leader should provide and that I said I would provide. The situation is that I have my own set of problems which I won't go into detail about. But the sad reality is that I just can't seem to summon the will or the interest or what have you to do what should be done. I can monitor the status generally and when a problem does show up I can often find enough interest in it to fix or provide feedback about the problem but not always in a very timely manner. I wish I could fix the situation on my own, but it has gone on long enough now that it is just not realistic to expect that to happen. I wish someone would appear who has an interest in the entirety of the status of the Squeak online services. If such a person would appear I think I would be able to work with them to get up to speed on the status and plan and perhaps even their interest would increase my own. But so far it seems like the best we can do is people who have an interest in individual parts of the system. Ultimately you need at least one person who does care about the complete set of services and has some high level ability to monitor and diagnose issues that appear related to them. I wish I had a solution and I'm sorry about my own failings in this regard. I just don't know what I can do about it at this point. Ken

3 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Box-Admins October 2013