The problem was that an error occured, so Seaside was trying to send an email about it. But generating the stack trace for the email resulted in another error. This recursively triggered another attempt to create an email. The runaway process consumed 850MB of memory, and did not trigger the low space watcher, probably because it was a low priority (30) process (probably a Seaside request handler). Someone who's more familiar with Seaside should fix this issue. There may even be a patch for this in the official repository.
To fix the problem, I downloaded the image, terminated the runaway process, saved it as a new version, and uploaded it. Then I stopped the service, modified it to use the new image, and restarted it. I assume this has no side effects, but it would be great if someone more familiar with the image could take a look.
Levente
On Sun, 21 Dec 2014, Levente Uzonyi wrote:
Hi All,
squeaksource.com is hosted on box3. source.squeak.org is on box2, but that's a different thing.
The problem with squeaksource.com is that it's leaking memory. The size of the image is close to 1GB, and it's saved like that on the disk. The service is too slow to respond due to swapping, because the server has 1GB memory total. I downloaded the image to my machine, and I'm investigating the image now.
Levente
On Sun, 21 Dec 2014, Tobias Pape wrote:
On 21.12.2014, at 20:31, Chris Muller asqueaker@gmail.com wrote:
On Sun, Dec 21, 2014 at 1:07 PM, Chris Cunnington brasspen@gmail.com wrote:
I’ve been looking at box3 for about half an hour now. I’d say Dale is right and squeaksource.com is down. I logged in and killed the ssdotcom process. This did not solve the problem once it had restarted under daemontools. And I saw that Jenkins is also unreachable. I restarted the server and the problem again still persists. My options are exhausted. I would guess off the top of my head and with no evidence whatsoever that this is a DNS thing. I’ll have to leave this to somebody with better knowledge than mine.
squeaksource.com runs on box 2.
how so?
~ $ host www.squeaksource.com www.squeaksource.com has address 173.246.101.237
tpape@box3-squeak:~$ /sbin/ifconfig eth0 Link encap:Ethernet HWaddr 00:16:3e:e3:3a:ff inet addr:173.246.101.237 Bcast:173.246.103.255 Mask:255.255.252.0
tpape@box2:~$ /sbin/ifconfig eth0 Link encap:Ethernet HWaddr 00:11:09:C6:91:51 inet addr:85.10.195.197 Bcast:85.10.195.223 Mask:255.255.255.224
==> SqueakSource is on box 3.
And that host is loaded with running qmail-remote processes that try to deliver bounces…
Best -Tobias
Chris
On Dec 21, 2014, at 1:21 PM, Dale Henrichs dale.henrichs@gemtalksystems.com wrote:
Looks like it might have gone down last night?
http://www.downforeveryoneorjustme.com/http://www.squeaksource.com/
Dale