[Box-Admins] Re: [squeak-dev] squeaksource down?

[Levente Uzonyi]

The problem was that an error occured, so Seaside was trying to send an 
email about it. But generating the stack trace for the email resulted in 
another error. This recursively triggered another attempt to create an 
email. The runaway process consumed 850MB of memory, and did not trigger 
the low space watcher, probably because it was a low priority (30) process 
(probably a Seaside request handler).
Someone who's more familiar with Seaside should fix this issue. There may 
even be a patch for this in the official repository.

To fix the problem, I downloaded the image, terminated the runaway 
process, saved it as a new version, and uploaded it. Then I stopped the 
service, modified it to use the new image, and restarted it.
I assume this has no side effects, but it would be great if someone more 
familiar with the image could take a look.

Levente

On Sun, 21 Dec 2014, Levente Uzonyi wrote:

> Hi All,
>
> squeaksource.com is hosted on box3. source.squeak.org is on box2, but that's 
> a different thing.
>
> The problem with squeaksource.com is that it's leaking memory. The size of 
> the image is close to 1GB, and it's saved like that on the disk. The service 
> is too slow to respond due to swapping, because the server has 1GB memory 
> total. I downloaded the image to my machine, and I'm investigating the image 
> now.
>
> Levente
>
> On Sun, 21 Dec 2014, Tobias Pape wrote:
>
>> 
>> On 21.12.2014, at 20:31, Chris Muller <asqueaker at gmail.com> wrote:
>> 
>>> On Sun, Dec 21, 2014 at 1:07 PM, Chris Cunnington <brasspen at gmail.com> 
>>> wrote:
>>>> I’ve been looking at box3 for about half an hour now. I’d say Dale is 
>>>> right
>>>> and squeaksource.com is down.
>>>> I logged in and killed the ssdotcom process. This did not solve the 
>>>> problem
>>>> once it had restarted under daemontools. And I saw that Jenkins is also
>>>> unreachable.
>>>> I restarted the server and the problem again still persists. My options 
>>>> are
>>>> exhausted. I would guess off the top of my head and with no evidence
>>>> whatsoever that this is a DNS thing.
>>>> I’ll have to leave this to somebody with better knowledge than mine.
>>> 
>>> squeaksource.com runs on box 2.
>> 
>> how so?
>> 
>> ~ $ host www.squeaksource.com
>> www.squeaksource.com has address 173.246.101.237
>> 
>> tpape at box3-squeak:~$ /sbin/ifconfig
>> eth0      Link encap:Ethernet  HWaddr 00:16:3e:e3:3a:ff
>>          inet addr:173.246.101.237  Bcast:173.246.103.255 
>> Mask:255.255.252.0
>> 
>> tpape at box2:~$ /sbin/ifconfig
>> eth0      Link encap:Ethernet  HWaddr 00:11:09:C6:91:51
>>          inet addr:85.10.195.197  Bcast:85.10.195.223  Mask:255.255.255.224
>> 
>> 
>> ==> SqueakSource is on box 3.
>> 
>> And that host is loaded with running qmail-remote processes that try to 
>> deliver bounces…
>> 
>> Best
>> 	-Tobias
>> 
>> 
>> 
>>>> 
>>>> Chris
>>>> 
>>>> 
>>>> On Dec 21, 2014, at 1:21 PM, Dale Henrichs
>>>> <dale.henrichs at gemtalksystems.com> wrote:
>>>> 
>>>> Looks like it might have gone down last night?
>>>> 
>>>> http://www.downforeveryoneorjustme.com/http://www.squeaksource.com/
>>>> 
>>>> Dale
>> 
>> 
>