Box-Admins February 2011

box-admins@lists.squeakfoundation.org

11 participants
26 discussions

RE: [Box-Admins] [FWD: ** PROBLEM Service Alert: squeak box2/Squeak website is CRITICAL **]
by Ken Causey 28 Feb '11

28 Feb '11

Perhaps by 'vm dump' you mean the SqueakDebug.log. When there is one it is in the same directory as the image and so you have access to it. However, the only one there is dated yesterday. Ken > -------- Original Message -------- > Subject: Re: [Box-Admins] [FWD: ** PROBLEM Service Alert: squeak > box2/Squeak website is CRITICAL **] > From: Janko Mivšek <janko.mivsek(a)eranova.si> > Date: Mon, February 28, 2011 4:52 pm > To: Squeak Hosting Support <box-admins(a)lists.squeakfoundation.org> > > > Hi Ken, > > I checked too and see no website process active, so I restarted it and > now I'm connected with VNC to the image. > > Today seems that image crashed, but snapshoted correctly at 9pm GMT last > time. > > Can we see some vm dump somewhere? > > Best regards > Janko > > On 28. 02. 2011 23:47, Ken Causey wrote: > > After I received this notice I checked and the website process had the > > CPU pegged with normal memory usage. I tried to connect with VNC and > > got connected but the image was locked up. There was a debugger open > > and I took a screenshot which can be found at > > > > http://users.squeak.org/~kencausey/website_locked.png > > > > I chatted in the IRC channel as I was fiddling with it: > > > > 2011-02-28 16:24:21 kencausey JankoMivsek: website process is > > flipping out again > > 2011-02-28 16:26:14 kencausey the memory usage is normal this > > time, it just has the CPU pegged > > 2011-02-28 16:26:41 kencausey looking at the logs, the last > > successful hit was the nagios check oddly enough, 2 hits before google > > hit the stats page again > > 2011-02-28 16:26:56 kencausey I don't see anything suspicious > > like the last time > > 2011-02-28 16:29:41 kencausey there is a debugger open on a > > send of #bottomContext to UndefinedObject > > 2011-02-28 16:29:50 kencausey I can't interact with it > > 2011-02-28 16:30:54 kencausey it's in a call to > > Process>>terminate > > 2011-02-28 16:32:38 kencausey restarting it now > > 2011-02-28 16:34:09 kencausey website is back up > > > >>From the apache logs: > > > > this is when it went down: > > > > 80.81.242.100 - - [28/Feb/2011:21:41:03 +0000] "GET > > /stats.html?view=main&year=1684&month=8 HTTP/1.1" 200 24288 "-" > > "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www. > > google.com/bot.html)" > > 173.255.225.4 - - [28/Feb/2011:21:42:13 +0000] "GET /favicon.ico > > HTTP/1.1" 200 1406 "-" "Safari/6533.19.4 CFNetwork/454.11.5 > > Darwin/10.5.0 (i386) (MacBook3%2C1)" > > 89.212.16.244 - - [28/Feb/2011:21:42:18 +0000] "GET /ping.html HTTP/1.1" > > 200 - "-" "check_http/v1.4.14 (nagios-plugins 1.4.14)" > > 38.99.97.225 - - [28/Feb/2011:21:42:49 +0000] "GET /Smalltalk/ HTTP/1.1" > > 502 399 "-" "Mozilla/5.0 (compatible; ScoutJet; > > +http://www.scoutjet.com/)" > > 67.195.112.235 - - [28/Feb/2011:21:43:15 +0000] "GET > > /Merchandise/?version=3 HTTP/1.0" 502 403 "-" "Mozilla/5.0 (compatible; > > Yahoo! Slurp; http://help.yahoo.com/help/us/ > > ysearch/slurp)" > > > > We have a googlebot hit to the stats page (relevant?), an irrelevant > > favicon request, a successful nagios ping which is I assume Janko's and > > not relevant, then hits start failing. Before that I see nothing > > suspicious and no flood of requests. > > > > Ken > > > >> -------- Original Message -------- > >> Subject: ** PROBLEM Service Alert: squeak box2/Squeak website is > >> CRITICAL ** > >> From: nagios(a)mivsek.eranova.si (User for Nagios) > >> Date: Mon, February 28, 2011 3:49 pm > >> To: ken(a)kencausey.com > >> > >> > >> ***** Nagios ***** > >> > >> Notification Type: PROBLEM > >> > >> Service: Squeak website > >> Host: squeak box2 > >> Address: 85.10.195.197 > >> State: CRITICAL > >> > >> Date/Time: Mon Feb 28 22:49:47 CET 2011 > >> > >> Additional Info: > >> > >> CRITICAL - Socket timeout after 10 seconds > > > > > > -- > Janko Mivšek > Svetovalec za informatiko > Eranova d.o.o. > Ljubljana, Slovenija > www.eranova.si > tel: 01 514 22 55 > faks: 01 514 22 56 > gsm: 031 674 565

1 0

RE: [Box-Admins] [FWD: ** PROBLEM Service Alert: squeak box2/Squeak website is CRITICAL **]
by Ken Causey 28 Feb '11

28 Feb '11

VM dump? I'm not sure what you mean. The VM does not crash, the image is simply locked up. It's probable that I could have interrupted it with alt-. but that doesn't seem to work over VNC. No website process active? You are mistaken and have created a second one now: box2:~# ps auwx | grep website website 8850 0.0 0.5 6800 5020 ? S 22:30 0:00 Xtightvnc :1 -desktop X -auth /home/website/.Xauthority -geometry 1024x768 -depth 24 -rfbwait 120000 -rfbauth /home/website/.vnc/passwd -rfbport 5901 -fp /usr/X11R6/lib/X11/fonts/Type1/,/usr/X11R6/lib/X11/fonts/Speedo/,/usr/X11R6/lib/X11/fonts/misc/,/usr/X11R6/lib/X11/fonts/75dpi/,/usr/X11R6/lib/X11/fonts/100dpi/ -co /usr/X11R6/lib/X11/rgb website 8855 2.6 8.1 1052604 79196 ? S 22:30 1:07 /usr/local/lib/squeak/3.11.3-2135/squeakvm -pathenc UTF-8 -encoding UTF-8 -plugins /usr/local/lib/squeak/3.11.3-2135 /home/website/website/squeaksite.image website 9044 0.0 0.6 8044 5920 ? S 22:32 0:00 Xtightvnc :4 -desktop X -auth /home/website/.Xauthority -geometry 1024x768 -depth 24 -rfbwait 120000 -rfbauth /home/website/.vnc/passwd -rfbport 5904 -fp /usr/X11R6/lib/X11/fonts/Type1/,/usr/X11R6/lib/X11/fonts/Speedo/,/usr/X11R6/lib/X11/fonts/misc/,/usr/X11R6/lib/X11/fonts/75dpi/,/usr/X11R6/lib/X11/fonts/100dpi/ -co /usr/X11R6/lib/X11/rgb website 9049 1.6 7.7 1052616 74836 ? S 22:32 0:39 /usr/local/lib/squeak/3.11.3-2135/squeakvm -pathenc UTF-8 -encoding UTF-8 -plugins /usr/local/lib/squeak/3.11.3-2135 /home/website/website/squeaksite.image That's two VNC servers running now and two website processes active. Did you think I didn't test the website after I restarted it? Ken > -------- Original Message -------- > Subject: Re: [Box-Admins] [FWD: ** PROBLEM Service Alert: squeak > box2/Squeak website is CRITICAL **] > From: Janko Mivšek <janko.mivsek(a)eranova.si> > Date: Mon, February 28, 2011 4:52 pm > To: Squeak Hosting Support <box-admins(a)lists.squeakfoundation.org> > > > Hi Ken, > > I checked too and see no website process active, so I restarted it and > now I'm connected with VNC to the image. > > Today seems that image crashed, but snapshoted correctly at 9pm GMT last > time. > > Can we see some vm dump somewhere? > > Best regards > Janko > > On 28. 02. 2011 23:47, Ken Causey wrote: > > After I received this notice I checked and the website process had the > > CPU pegged with normal memory usage. I tried to connect with VNC and > > got connected but the image was locked up. There was a debugger open > > and I took a screenshot which can be found at > > > > http://users.squeak.org/~kencausey/website_locked.png > > > > I chatted in the IRC channel as I was fiddling with it: > > > > 2011-02-28 16:24:21 kencausey JankoMivsek: website process is > > flipping out again > > 2011-02-28 16:26:14 kencausey the memory usage is normal this > > time, it just has the CPU pegged > > 2011-02-28 16:26:41 kencausey looking at the logs, the last > > successful hit was the nagios check oddly enough, 2 hits before google > > hit the stats page again > > 2011-02-28 16:26:56 kencausey I don't see anything suspicious > > like the last time > > 2011-02-28 16:29:41 kencausey there is a debugger open on a > > send of #bottomContext to UndefinedObject > > 2011-02-28 16:29:50 kencausey I can't interact with it > > 2011-02-28 16:30:54 kencausey it's in a call to > > Process>>terminate > > 2011-02-28 16:32:38 kencausey restarting it now > > 2011-02-28 16:34:09 kencausey website is back up > > > >>From the apache logs: > > > > this is when it went down: > > > > 80.81.242.100 - - [28/Feb/2011:21:41:03 +0000] "GET > > /stats.html?view=main&year=1684&month=8 HTTP/1.1" 200 24288 "-" > > "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www. > > google.com/bot.html)" > > 173.255.225.4 - - [28/Feb/2011:21:42:13 +0000] "GET /favicon.ico > > HTTP/1.1" 200 1406 "-" "Safari/6533.19.4 CFNetwork/454.11.5 > > Darwin/10.5.0 (i386) (MacBook3%2C1)" > > 89.212.16.244 - - [28/Feb/2011:21:42:18 +0000] "GET /ping.html HTTP/1.1" > > 200 - "-" "check_http/v1.4.14 (nagios-plugins 1.4.14)" > > 38.99.97.225 - - [28/Feb/2011:21:42:49 +0000] "GET /Smalltalk/ HTTP/1.1" > > 502 399 "-" "Mozilla/5.0 (compatible; ScoutJet; > > +http://www.scoutjet.com/)" > > 67.195.112.235 - - [28/Feb/2011:21:43:15 +0000] "GET > > /Merchandise/?version=3 HTTP/1.0" 502 403 "-" "Mozilla/5.0 (compatible; > > Yahoo! Slurp; http://help.yahoo.com/help/us/ > > ysearch/slurp)" > > > > We have a googlebot hit to the stats page (relevant?), an irrelevant > > favicon request, a successful nagios ping which is I assume Janko's and > > not relevant, then hits start failing. Before that I see nothing > > suspicious and no flood of requests. > > > > Ken > > > >> -------- Original Message -------- > >> Subject: ** PROBLEM Service Alert: squeak box2/Squeak website is > >> CRITICAL ** > >> From: nagios(a)mivsek.eranova.si (User for Nagios) > >> Date: Mon, February 28, 2011 3:49 pm > >> To: ken(a)kencausey.com > >> > >> > >> ***** Nagios ***** > >> > >> Notification Type: PROBLEM > >> > >> Service: Squeak website > >> Host: squeak box2 > >> Address: 85.10.195.197 > >> State: CRITICAL > >> > >> Date/Time: Mon Feb 28 22:49:47 CET 2011 > >> > >> Additional Info: > >> > >> CRITICAL - Socket timeout after 10 seconds > > > > > > -- > Janko Mivšek > Svetovalec za informatiko > Eranova d.o.o. > Ljubljana, Slovenija > www.eranova.si > tel: 01 514 22 55 > faks: 01 514 22 56 > gsm: 031 674 565

1 0

[FWD: ** PROBLEM Service Alert: squeak box2/Squeak website is CRITICAL **]
by Ken Causey 28 Feb '11

28 Feb '11

After I received this notice I checked and the website process had the CPU pegged with normal memory usage. I tried to connect with VNC and got connected but the image was locked up. There was a debugger open and I took a screenshot which can be found at http://users.squeak.org/~kencausey/website_locked.png I chatted in the IRC channel as I was fiddling with it: 2011-02-28 16:24:21 kencausey JankoMivsek: website process is flipping out again 2011-02-28 16:26:14 kencausey the memory usage is normal this time, it just has the CPU pegged 2011-02-28 16:26:41 kencausey looking at the logs, the last successful hit was the nagios check oddly enough, 2 hits before google hit the stats page again 2011-02-28 16:26:56 kencausey I don't see anything suspicious like the last time 2011-02-28 16:29:41 kencausey there is a debugger open on a send of #bottomContext to UndefinedObject 2011-02-28 16:29:50 kencausey I can't interact with it 2011-02-28 16:30:54 kencausey it's in a call to Process>>terminate 2011-02-28 16:32:38 kencausey restarting it now 2011-02-28 16:34:09 kencausey website is back up >From the apache logs: this is when it went down: 80.81.242.100 - - [28/Feb/2011:21:41:03 +0000] "GET /stats.html?view=main&year=1684&month=8 HTTP/1.1" 200 24288 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www. google.com/bot.html)" 173.255.225.4 - - [28/Feb/2011:21:42:13 +0000] "GET /favicon.ico HTTP/1.1" 200 1406 "-" "Safari/6533.19.4 CFNetwork/454.11.5 Darwin/10.5.0 (i386) (MacBook3%2C1)" 89.212.16.244 - - [28/Feb/2011:21:42:18 +0000] "GET /ping.html HTTP/1.1" 200 - "-" "check_http/v1.4.14 (nagios-plugins 1.4.14)" 38.99.97.225 - - [28/Feb/2011:21:42:49 +0000] "GET /Smalltalk/ HTTP/1.1" 502 399 "-" "Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)" 67.195.112.235 - - [28/Feb/2011:21:43:15 +0000] "GET /Merchandise/?version=3 HTTP/1.0" 502 403 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ ysearch/slurp)" We have a googlebot hit to the stats page (relevant?), an irrelevant favicon request, a successful nagios ping which is I assume Janko's and not relevant, then hits start failing. Before that I see nothing suspicious and no flood of requests. Ken > -------- Original Message -------- > Subject: ** PROBLEM Service Alert: squeak box2/Squeak website is > CRITICAL ** > From: nagios(a)mivsek.eranova.si (User for Nagios) > Date: Mon, February 28, 2011 3:49 pm > To: ken(a)kencausey.com > > > ***** Nagios ***** > > Notification Type: PROBLEM > > Service: Squeak website > Host: squeak box2 > Address: 85.10.195.197 > State: CRITICAL > > Date/Time: Mon Feb 28 22:49:47 CET 2011 > > Additional Info: > > CRITICAL - Socket timeout after 10 seconds

2 1

RE: [Webteam] Re: [Box-Admins] RE: [FWD: ** PROBLEM Service Alert: squeak box2/Squeak website is CRITICAL **]
by Ken Causey 27 Feb '11

27 Feb '11

OK, so let's examine the possibility this was the result of a DOS of some kind (intentional or unintentional). First let's work out the timeline a bit: The Nagios notice was sent out at "Sat Feb 26 11:24:15 CET 2011" or 10:24:15 GMT Saturday. I'm a little less certain when I restarted the image. I forwarded the error notice and commented on the state of things at about 10:39. I replied that I had restarted the image at about 10:46. Looking at the apache logs for www.squeak.org: 207.46.195.239 - - [26/Feb/2011:10:20:53 +0000] "GET /robots.txt HTTP/1.1" 404 149 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)" 80.81.242.100 - - [26/Feb/2011:10:21:49 +0000] "GET /stats.html?view=main&year=1702&month=8 HTTP/1.1" 502 399 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" at 10:20:53 We have Bing requesting a robots.txt which we don't have. The next line is the next event: At 10:21:49 we have Google (it appears) surfing the stats.html page and the request failing. After this it is all 502 responses until 173.192.238.44 - - [26/Feb/2011:10:43:30 +0000] "GET / HTTP/1.1" 502 232 "-" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9 .0.19; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/2010040121 Firefox/3.0.19" 87.59.72.91 - - [26/Feb/2011:10:43:41 +0000] "GET /Documentation/Installation/ HTTP/1.1" 200 13209 "http://www.seaside.st/down load" "Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_6_6; en-us) AppleWebKit/533.19.4 (KHTML, like Gecko) Version/5.0.3 Safari/ 533.19.4" The second at 10:43:41 being the first successful response after I restarted the image. I estimate there were about 50 hits between these two times, all failures of course. At a glance, before 10:20:53 there is no large number of hits logged; in general several seconds to several minutes goes by between each logged event. One suspicious event shortly before: 84.227.142.227 - - [26/Feb/2011:10:20:22 +0000] "POST / HTTP/1.1" 413 329 "-" "Apache-HttpClient/4.1 (java 1.5)" 84.227.142.227 - - [26/Feb/2011:10:20:23 +0000] "POST / HTTP/1.1" 413 329 "-" "Apache-HttpClient/4.1 (java 1.5)" 84.227.142.227 - - [26/Feb/2011:10:20:23 +0000] "POST / HTTP/1.1" 413 329 "-" "Apache-HttpClient/4.1 (java 1.5)" 84.227.142.227 - - [26/Feb/2011:10:20:23 +0000] "POST / HTTP/1.1" 413 329 "-" "Apache-HttpClient/4.1 (java 1.5)" After this there is 123.125.71.52 - - [26/Feb/2011:10:20:39 +0000] "GET /Documentation/Installation/ HTTP/1.1" 200 13209 "-" "Baiduspider+(+http:/ /www.baidu.com/search/spider.htm)" 207.46.195.239 - - [26/Feb/2011:10:20:53 +0000] "GET /robots.txt HTTP/1.1" 404 149 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)" The second of these two being the same robots.txt request mentioned before. Other than this, again at a glance, nothing appears suspicious. The majority of the traffic is search bots but the requests do not come in at any significant speed. Ken P. S. Casey: perhaps you could look into adding a basic robots.txt which tells the bots to avoid the stats and other administrative stuff. > -------- Original Message -------- > Subject: [Webteam] Re: [Box-Admins] RE: [FWD: ** PROBLEM Service Alert: > squeak box2/Squeak website is CRITICAL **] > From: Janko Mivšek <janko.mivsek(a)eranova.si> > Date: Sat, February 26, 2011 12:08 pm > To: Squeak Hosting Support <box-admins(a)lists.squeakfoundation.org> > Cc: Squeak Webteam <webteam(a)lists.squeakfoundation.org> > > > Hi guys, > > This fast growing image problem could be cause because of Dos attack, So > Sean, go looking there if there you'll see some enormous amount of > requests from our site and specially, are they coming from there same > IP. Knowing that IP we can narrower the culpit closer. > > Past two image crashes were caused by image not snapshoting every hour. > We switched snapshoting off a time ago and forgot to switch on, ok, now > it is on again. > > Best regards > Janko

1 0

RE: [Box-Admins] RE: [FWD: ** PROBLEM Service Alert: squeak box2/Squeak website is CRITICAL **]
by Ken Causey 26 Feb '11

26 Feb '11

Technically I could give you access but that image is owned and created by the webteam and is their responsibility. As such I suggest you contact them and volunteer your assistance within that context. This may seem a little silly, but a lack of communication has been a problem around here in the past. Ken > -------- Original Message -------- > Subject: Re: [Box-Admins] RE: [FWD: ** PROBLEM Service Alert: squeak > box2/Squeak website is CRITICAL **] > From: Casey Ransberger <casey.obrien.r(a)gmail.com> > Date: Sat, February 26, 2011 11:43 am > To: Squeak Hosting Support <box-admins(a)lists.squeakfoundation.org> > > > Drives me a little nuts that we don't know what's causing that. I'd like to get a copy of the image we're using and spend some time with it. Is this something I currently have access to? Not at my machine now, but I think I'm an updates user. > > > > On Feb 26, 2011, at 2:46 AM, "Ken Causey" <ken(a)kencausey.com> wrote: > > > Well it continued to grow quickly so I did indeed kill it. I have > > restarted it under vnc at port :1. It appears the image was being saved > > regularly and the site is back up and fine as far as I'm aware. > > > > Ken > > > >> -------- Original Message -------- > >> Subject: [FWD: ** PROBLEM Service Alert: squeak box2/Squeak website is > >> CRITICAL **] > >> From: "Ken Causey" <ken(a)kencausey.com> > >> Date: Sat, February 26, 2011 4:39 am > >> To: webteam(a)lists.squeakfoundation.org > >> > >> > >> I happen to be awake and online during this event, still on-going: > >> appearance of the process in top: > >> > >> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > >> > >> > >> 10856 website 25 0 1027m 753m 3324 R 94.2 79.5 82:28.27 > >> /usr/local/lib/squeak/3.11.3-2135/squeakvm -pathenc UTF-8 -encoding > >> UTF-8 -plugins /usr/local/lib/squeak/3.11.3-2135 /home/website/w ... > >> > >> as you can see it is pegging the CPU and using a lot of memory (in no > >> more than a minute it has gone from about 700MB to over 750MB). I'll > >> watch it for a few minutes but I am almost certainly going to have to > >> kill it and restart. I hope you have been saving.... > >> > >> Ken > >> > >> > >>> -------- Original Message -------- > >>> Subject: ** PROBLEM Service Alert: squeak box2/Squeak website is > >>> CRITICAL ** > >>> From: nagios(a)mivsek.eranova.si (User for Nagios) > >>> Date: Sat, February 26, 2011 4:24 am > >>> To: ken(a)kencausey.com > >>> > >>> > >>> ***** Nagios ***** > >>> > >>> Notification Type: PROBLEM > >>> > >>> Service: Squeak website > >>> Host: squeak box2 > >>> Address: 85.10.195.197 > >>> State: CRITICAL > >>> > >>> Date/Time: Sat Feb 26 11:24:15 CET 2011 > >>> > >>> Additional Info: > >>> > >>> CRITICAL - Socket timeout after 10 seconds > >

3 5

RE: [FWD: ** PROBLEM Service Alert: squeak box2/Squeak website is CRITICAL **]
by Ken Causey 26 Feb '11

26 Feb '11

Well it continued to grow quickly so I did indeed kill it. I have restarted it under vnc at port :1. It appears the image was being saved regularly and the site is back up and fine as far as I'm aware. Ken > -------- Original Message -------- > Subject: [FWD: ** PROBLEM Service Alert: squeak box2/Squeak website is > CRITICAL **] > From: "Ken Causey" <ken(a)kencausey.com> > Date: Sat, February 26, 2011 4:39 am > To: webteam(a)lists.squeakfoundation.org > > > I happen to be awake and online during this event, still on-going: > appearance of the process in top: > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > > > 10856 website 25 0 1027m 753m 3324 R 94.2 79.5 82:28.27 > /usr/local/lib/squeak/3.11.3-2135/squeakvm -pathenc UTF-8 -encoding > UTF-8 -plugins /usr/local/lib/squeak/3.11.3-2135 /home/website/w ... > > as you can see it is pegging the CPU and using a lot of memory (in no > more than a minute it has gone from about 700MB to over 750MB). I'll > watch it for a few minutes but I am almost certainly going to have to > kill it and restart. I hope you have been saving.... > > Ken > > > > -------- Original Message -------- > > Subject: ** PROBLEM Service Alert: squeak box2/Squeak website is > > CRITICAL ** > > From: nagios(a)mivsek.eranova.si (User for Nagios) > > Date: Sat, February 26, 2011 4:24 am > > To: ken(a)kencausey.com > > > > > > ***** Nagios ***** > > > > Notification Type: PROBLEM > > > > Service: Squeak website > > Host: squeak box2 > > Address: 85.10.195.197 > > State: CRITICAL > > > > Date/Time: Sat Feb 26 11:24:15 CET 2011 > > > > Additional Info: > > > > CRITICAL - Socket timeout after 10 seconds

2 1

Fwd: ** PROBLEM Service Alert: squeak box2/Squeak website is CRITICAL **
by Casey Ransberger 10 Feb '11

10 Feb '11

Okay, so what's this guy usually mean to us? Begin forwarded message: > From: nagios(a)mivsek.eranova.si (User for Nagios) > Date: February 10, 2011 2:11:44 PM PST > To: casey.obrien.r(a)gmail.com > Subject: ** PROBLEM Service Alert: squeak box2/Squeak website is CRITICAL ** > > ***** Nagios ***** > > Notification Type: PROBLEM > > Service: Squeak website > Host: squeak box2 > Address: 85.10.195.197 > State: CRITICAL > > Date/Time: Thu Feb 10 23:11:44 CET 2011 > > Additional Info: > > HTTP CRITICAL - Invalid HTTP response received from host: HTTP/1.1 502 Bad Gateway

3 3

RE: Backup solutions (was Re: [Box-Admins] Permissions)
by Ken Causey 08 Feb '11

08 Feb '11

No, http is not used at any step. I'm not absolutely sure of the details but it is much closer to using ssh although I think it is even smarter than that in terms of not copying entire files when only part of the file is changed. Ken > -------- Original Message -------- > Subject: Re: Backup solutions (was Re: [Box-Admins] Permissions) > From: Philippe Marschall <philippe.marschall(a)gmail.com> > Date: Tue, February 08, 2011 1:56 pm > To: Ken Causey <ken(a)kencausey.com> > Cc: Squeak Hosting Support <box-admins(a)lists.squeakfoundation.org> > > > 2011/2/8 Ken Causey <ken(a)kencausey.com>: > > It has nothing to do with the Squeak image. Rsnapshot/rsync do the job > > and I would be very surprised if it has any noticeable effect on the > > system, it has none on the community server. > > My question way more do you download all the .mcz versions through > http (which makes the squeaksource image serve them) or do you use ssh > to copy them from the local disc of the squeaksource server? > > Cheers > Philippe

1 0

RE: Backup solutions (was Re: [Box-Admins] Permissions)
by Ken Causey 08 Feb '11

08 Feb '11

It has nothing to do with the Squeak image. Rsnapshot/rsync do the job and I would be very surprised if it has any noticeable effect on the system, it has none on the community server. Ken > -------- Original Message -------- > Subject: Re: Backup solutions (was Re: [Box-Admins] Permissions) > From: Philippe Marschall <philippe.marschall(a)gmail.com> > Date: Mon, February 07, 2011 11:46 pm > To: Squeak Hosting Support <box-admins(a)lists.squeakfoundation.org> > > You backup squeaksource.com? How is that done? If you make that poor > Squeak image transfer 2 GB a day that would certainly help to explain > some of the performance problems squeaksource.com has been having > lately. > > Cheers > Philippe

2 1

RE: Backup solutions (was Re: [Box-Admins] Permissions)
by Ken Causey 08 Feb '11

08 Feb '11

Your memory is failing. The total used diskspace for the server currently is about 120GB, of that more than half is due to local backup and a backup of squeaksource.com. A backup of the custom content (i.e. not the operating system files or software installed in the normal places or related support files) I made last July was about 36GB, the incremental I made yesterday, in reference to the July backup, came to about 5GB. I believe a normal daily incremental (again of just the custom content) would be about 3GB. At a very rough guess I think a complete backup would be about 50-60 GB and the daily incremental still around 3GB. Ken > -------- Original Message -------- > Subject: Re: Backup solutions (was Re: [Box-Admins] Permissions) > From: Casey Ransberger <casey.obrien.r(a)gmail.com> > Date: Mon, February 07, 2011 1:49 pm > To: Squeak Hosting Support <box-admins(a)lists.squeakfoundation.org> > > > I thought I saw a message from Ken saying total data footprint was ~ 500GB. My memory may be failing though. > > On Feb 7, 2011, at 11:30 AM, Göran Krampe <goran(a)krampe.se> wrote: > > > On 02/07/2011 07:41 PM, Casey Ransberger wrote: > >> I hope I'm not adding too much noise to the conversation, but what do folks think about using something like S3 for backups? We'd have to find funding for it somewhere, but it might be cheaper than buying terabyte drives, etc, and the thing is pretty darned reliable for backup. > > > > We don't need tera byte drives, although those don't cost much these days :). But sure, Duplicity supports S3 as a targer, so that would work. > > > >> Also makes sure that the bottleneck for data transfer isn't a home connection. > > > > That is no big deal if running at night, and IMHO we would then set up 2-3 different ones so if one fails one night it wouldn't matter. > > > > Upside is of course that it would cost 0. > > > > regards, Göran > >

3 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Box-Admins February 2011