Box-Admins October 2008

box-admins@lists.squeakfoundation.org

5 participants
12 discussions

Achieving redundancy of the website
by Janko Mivšek 28 Oct '08

28 Oct '08

Hi box team, I subscribed to your mailing list to coordinate common goals and problems more easily. I'm sure that way we'll be able to make a whole Squeak infrastructure better and better. What we need to do first in my opinion is to enhance the availability of the services, for me as from webteam the website is of primary importance. During the recent few days downtime I was thinking a lot about that and decided to propose you a solution, which will reduce such a downtime to few hours most. Solution is a classical one: increase redundancy by making a mirror website, which is in hot backup mode, that is, it can be put online immediately, just by changing the DNS pointer. I'm actually having such backup in place for my servers and it works perfect. It is also not hard to configure, you put a rsync script in place to mirror the changes of website from time to time, say every day or even every hour. We need an additional server for that of course, well, for a while I can offer my one (pingo.eranova.si). Later we can mirror other services too, ok, mailing list could be harder to mirror I suppose. But at least we put instructions what to do on the our website first page in case of such a long downtime. Best regards Janko

1 0

ZoneEdit.com Secondary DNS for Squeak.org and SqueakLand.org
by Ken Causey 27 Oct '08

27 Oct '08

At Göran's suggestion I have setup an account at ZoneEdit.com and setup secondary DNS service for squeak.org and squeakland.org. Please add the additional secondary DNS servers listed below to the registration information for each of these domain names. ns15.zoneedit.com 69.10.134.195 ns17.zoneedit.com 209.126.159.118 Hopefully this will help improve our stability in the future. Ken

1 1

Re: [squeak-dev] Community Server Report
by Ken Causey 27 Oct '08

27 Oct '08

On Mon, 2008-10-27 at 11:15 +0100, Göran Krampe wrote: > Hi! > > rudolf-Rednose wrote: > > Michael van der Gulik schrieb: > >> May I recommend that we host the mailing list on another machine than our > >> main server? A cheap VPS server would manage this fine. Most services we can > >> afford to lose for a while, but it was a bit unnerving not being able to see > >> what was happening. > > > > Well it was possible to get informed about the "rescue mission" on irc. > > One thing is that we are most probably moving DNS to zoneedit or similar > so that we can easily point www.squeak.org to another ip during an event > like this. That should easily fix the "we don't know what is going > on"-problem. Just a little correction. We are adding zoneedit.com as additional secondary DNS servers, not moving it. The community server will still be the primary DNS server. But if it is down for an extended time the zoneedit configuration can be manually modified to point to a different server temporarily. > Now we couldn't easily do that unless involving Dan etc. I've emailed Dan. We just have to be patient. Ken > regards, Göran > > >

1 0

Re: Notification for 85.10.195.197 -> ping:ERROR
by Ken Causey 26 Oct '08

26 Oct '08

On the assumption that this is the result of the server locking up again and not a local network issue (which a traceroute suggests to me it might be): What would it cost us to have the remote console system connected to our server for a couple of weeks to a month cost us? At this point it seems like this is going to be required to track down the cause. Ken On Sun, 2008-10-26 at 01:30 +0200, noreply(a)hetzner.de wrote: > Notification for 85.10.195.197: > > ==> PING <== > State is now: ERROR (01:30h 2008.10.26) > State before: OK (was 3 days) > Service params: > Service uptime: 95.66% > Check output: > > PING 85.10.195.197 (85.10.195.197) 56(84) bytes of data. > > --- 85.10.195.197 ping statistics --- > > 20 packets transmitted, 0 received, 100% packet loss, time 9539 > > ms > > > In case of any question regarding the Hetzner Server Monitoring, > please do not reply to this email address - use support(a)hetzner.de instead. > >

1 1

Brand new server!
by Göran Krampe 22 Oct '08

22 Oct '08

Hi folks! Ok, just got an email from Marcus - Hetzner didn't take any chances this last time the serve went down - they moved the harddrive to another identical server. So hopefully we now have a much better chance of staying up! :) regards, Göran

1 0

RE: Notification for 85.10.195.197 -> ping:OK
by Ken Causey 21 Oct '08

21 Oct '08

I don't have any password. We don't generally use passwords but ssh keys. In fact I believe you have a public ssh key installed under the root account. Cees may well know the root password, but he's the only one likely to know it. However this is irrelevant. Ping works, yes. SSH starts a connection but you can't actually login. If you have a matching private key it queries you for the passphrase but then once you enter it, it immediately exits, often with an error that sounds like a memory issue. If you have no private keys it doesn't even offer you the opportunity to enter a password. Please try it, I would love to know if you get a different result. Also, it should be noted that all of the services should start up cleanly, they have every time the server has been rebooted over the last month or so. We've done nothing that should have changed that, and yet they are not starting, or at least not working. Surely Hetzner can provide more support than this? Ken > -------- Original Message -------- > Subject: Re: Notification for 85.10.195.197 -> ping:OK > From: Marcus Denker <denker(a)iam.unibe.ch> > Date: Mon, October 20, 2008 1:22 pm > To: Ken Causey <ken(a)kencausey.com> > Cc: box-admins Support <box-admins(a)lists.squeakfoundation.org> > > > On 20.10.2008, at 18:03, Ken Causey wrote: > > > It's back in the same bad state it has been in since Friday. Few if > > any > > services are started and those that seem to be up do not work > > correctly. > > I can't ssh to the server at all. Something is seriously wrong and > > someone is going to have to coordinate with Hetzner. > > > > > So, the hosting company rebooted again. And they claim that a) it > reacts to ping and b) ssh can connect. > > As I have no passwd, I can not check further. Same situation as > Saturday. > > *this makes no sense*. Would it be possible to get *some* form of > passwd to be able to check? > > Marcus > > > I'm at OOPSLA this week and have limited network access unfortunately. > > > > > >> -------- Original Message -------- > >> Subject: Fwd: Notification for 85.10.195.197 -> ping:OK > >> From: Marcus Denker <denker(a)iam.unibe.ch> > >> Date: Mon, October 20, 2008 4:28 am > >> To: Ken Causey <ken(a)kencausey.com> > >> > >> Hi, > >> > >> Can you check if that is really ok? the web seems to be not yet up. > >> > >> Marcus > >> > >> Begin forwarded message: > >> > >>> From: sysmon(a)hetzner.de > >>> Date: 20. Oktober 2008 06:43:20 GMT+02:00 > >>> To: denker(a)iam.unibe.ch > >>> Subject: Notification for 85.10.195.197 -> ping:OK > >>> > >>> Notification for 85.10.195.197: > >>> > >>> ==> PING <== > >>> State is now: OK (06:42h 2008.10.20) > >>> State before: ERROR (was about 9 hours) > >>> Service params: > >>> Service uptime: 96.0% > >>> Check output: > >>>> 3 packets transmitted, 3 received, 0% packet loss, time 1002ms, > >>>> rtt min/avg/max/mdev = 0.221/0.325/0.503/0.126 ms > >>> > >>> > >> > >> -- > >> Marcus Denker -- denker(a)iam.unibe.ch > >> http://www.iam.unibe.ch/~denker > > > > -- > Marcus Denker -- denker(a)iam.unibe.ch > http://www.iam.unibe.ch/~denker

2 1

Re: Notification for 85.10.195.197 -> ping:OK
by Marcus Denker 20 Oct '08

20 Oct '08

On 20.10.2008, at 18:03, Ken Causey wrote: > It's back in the same bad state it has been in since Friday. Few if > any > services are started and those that seem to be up do not work > correctly. > I can't ssh to the server at all. Something is seriously wrong and > someone is going to have to coordinate with Hetzner. > So, the hosting company rebooted again. And they claim that a) it reacts to ping and b) ssh can connect. As I have no passwd, I can not check further. Same situation as Saturday. *this makes no sense*. Would it be possible to get *some* form of passwd to be able to check? Marcus > I'm at OOPSLA this week and have limited network access unfortunately. > > >> -------- Original Message -------- >> Subject: Fwd: Notification for 85.10.195.197 -> ping:OK >> From: Marcus Denker <denker(a)iam.unibe.ch> >> Date: Mon, October 20, 2008 4:28 am >> To: Ken Causey <ken(a)kencausey.com> >> >> Hi, >> >> Can you check if that is really ok? the web seems to be not yet up. >> >> Marcus >> >> Begin forwarded message: >> >>> From: sysmon(a)hetzner.de >>> Date: 20. Oktober 2008 06:43:20 GMT+02:00 >>> To: denker(a)iam.unibe.ch >>> Subject: Notification for 85.10.195.197 -> ping:OK >>> >>> Notification for 85.10.195.197: >>> >>> ==> PING <== >>> State is now: OK (06:42h 2008.10.20) >>> State before: ERROR (was about 9 hours) >>> Service params: >>> Service uptime: 96.0% >>> Check output: >>>> 3 packets transmitted, 3 received, 0% packet loss, time 1002ms, >>>> rtt min/avg/max/mdev = 0.221/0.325/0.503/0.126 ms >>> >>> >> >> -- >> Marcus Denker -- denker(a)iam.unibe.ch >> http://www.iam.unibe.ch/~denker > -- Marcus Denker -- denker(a)iam.unibe.ch http://www.iam.unibe.ch/~denker

1 0

[Fwd: Notification for 85.10.195.197 -> ping:ERROR]
by Ken Causey 16 Oct '08

16 Oct '08

Well, 5 days isn't too bad given recent history. Is there any way I can provide you some backup on requesting server reboots? Can I get access to request them? Is the interface in English? Have you been able to get any explanation from Hetzner? Ken -------- Forwarded Message -------- From: sysmon(a)hetzner.de To: ken(a)kencausey.com Subject: Notification for 85.10.195.197 -> ping:ERROR Date: Thu, 16 Oct 2008 17:38:00 +0200 (CEST) Notification for 85.10.195.197: ==> PING <== State is now: ERROR (17:37h 2008.10.16) State before: OK (was 5 days) Service params: Service uptime: 97.72% Check output: > PING 85.10.195.197 (85.10.195.197) 56(84) bytes of data. > --- 85.10.195.197 ping statistics --- > 11 packets transmitted, 0 received, +1 errors, 100% packet loss > , time 5041ms

1 0

people.squeakfoundation.org
by Cees de Groot 14 Oct '08

14 Oct '08

Guys, Just discovered that apparently people.squeakfoundation.org (aka's Ken's Private Blog ;-)) is still running on my machine, and I canceled it per 30/11 because I'm hardly using it anymore. What shall we do with it? TIA, Cees

1 0

[Fwd: Notification for 85.10.195.197 -> ping:ERROR]
by Ken Causey 10 Oct '08

10 Oct '08

I was on the server no more than a few minutes before it went down. I was just doing a daily check (server up, filesystem usage not up too much, system not too busy, etc.). Everything seemed fine. I logged off. Minutes later I was going to check for a URL from the FTP site and was unable to get a response. Just thought I would send this is a very minor data point suggesting that at least there is no obvious minutes-long software-related process that leads to the lockup. Ken -------- Forwarded Message -------- From: sysmon(a)hetzner.de To: ken(a)kencausey.com Subject: Notification for 85.10.195.197 -> ping:ERROR Date: Fri, 10 Oct 2008 21:18:20 +0200 (CEST) Notification for 85.10.195.197: ==> PING <== State is now: ERROR (21:18h 2008.10.10) State before: OK (was 4 days) Service params: Service uptime: 97.42% Check output: > PING 85.10.195.197 (85.10.195.197) 56(84) bytes of data. > --- 85.10.195.197 ping statistics --- > 20 packets transmitted, 0 received, 100% packet loss, time 9564 > ms

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Box-Admins October 2008