This is not a message I want to send. squeak.org is down again and I can't bring it back up. There's a 502 Gateway error. One that I did not create. map.squeak.org and wiki.squeak.org and Squeak-Dev are up.
Following Ken's instructions, I did:
vncserver -kill :1
which closes things down and produces this:
website@box2:~$ ps aux | grep website root 19315 0.0 0.1 6224 1912 ? Ss Apr24 0:00 sshd: website [priv] website 19317 0.0 0.2 6388 1980 ? S Apr24 0:00 sshd: website@pts/0 website 19318 0.0 0.1 2600 1500 pts/0 Rs Apr24 0:00 -bash website 21913 0.0 0.0 2496 848 pts/0 R+ 00:22 0:00 ps aux website 21914 0.0 0.0 1548 480 pts/0 R+ 00:22 0:00 grep website
Then, following his instructions:
vncserver
which produces this:
website@box2:~$ ps aux | grep website root 19315 0.0 0.1 6224 1912 ? Ss Apr24 0:00 sshd: website [priv] website 19317 0.0 0.2 6388 1980 ? S Apr24 0:00 sshd: website@pts/0 website 19318 0.0 0.1 2600 1500 pts/0 Ss Apr24 0:00 -bash website 22163 0.0 0.4 6544 4760 pts/0 S 00:23 0:00 Xtightvnc :1 -desktop X -auth /home/website/.Xauthority -geometry 1024x768 -depth 24 -rfbwait 120000 -rfbauth /home/website/.vnc/passwd -rfbport 5901 -fp /usr/X11R6/lib/X11/fonts/Type1/,/usr/X11R6/lib/X11/fonts/Speedo/,/usr/X11R6/lib/X11/fonts/misc/,/usr/X11R6/lib/X11/fonts/75dpi/,/usr/X11R6/lib/X11/fonts/100dpi/ -co /usr/X11R6/lib/X11/rgb website 22168 36.4 11.7 1052208 113860 pts/0 R 00:23 1:03 /usr/local/lib/squeak/3.11.3-2135/squeakvm -pathenc UTF-8 -encoding UTF-8 -plugins /usr/local/lib/squeak/3.11.3-2135 /home/website/website/squeaksite.image website 22238 0.0 0.0 2496 848 pts/0 R+ 00:25 0:00 ps aux website 22239 0.0 0.0 1548 480 pts/0 R+ 00:25 0:00 grep website
The image is up and running. The vnc is running. And there is still a 502 Bad Gateway from www.squeak.org. I took a crack at:
svc -u wwwservice
and was permission denied. But if you, as a root person, do that, then the VNC doesn't come up, because the squeak.org process can run either under daemontools or under VNC, but not both.
I'm out of options. Sorry.
Chris
On Tue, Apr 24, 2012 at 5:48 PM, Chris Cunnington smalltalktelevision@gmail.com wrote:
This is not a message I want to send. squeak.org is down again and I can't bring it back up.
I'm happy to take a look if someone can give me access to the box.
Colin
On 24.04.2012, at 17:58, Colin Putney wrote:
On Tue, Apr 24, 2012 at 5:48 PM, Chris Cunnington smalltalktelevision@gmail.com wrote:
This is not a message I want to send. squeak.org is down again and I can't bring it back up.
I'm happy to take a look if someone can give me access to the box.
Colin
We need your SSH pubkey.
- Bert -
On 2012-04-25, at 9:20 AM, Bert Freudenberg wrote:
We need your SSH pubkey.
Oh, right.
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC7uNF0dmIwo+FLHqYjVFQPAHtAHC5UPtSSKDOo+fBoW2i7Ls8x7l1OlgaUug7jqdswA268pFvW0sXrl8RKnQic/nkDXwpNMPyRaLgtar4efpQMWTNjLgoDvksDi0/rLWzO4FtAYYFai/DhYZRQUuHIbfb2PuQHWObtlFITNoTx+bQwmKrDS9ti6OXHTwGa+3/2RJzyCQzp4fNvdR8Uu+Vp4tt6k/x/U+vi1o/yHwqBA/Cjc0gCy7JZya/vgy2qpQm7Kx6AQDR/lx8xPoCTsIF88vBXzocQ9e2C1dOdjKPJVZhoMh5zUGkTDHtoC9UWvjp4OVnsYKT2q3o1UmtBLEED colin@wiresong
On Tue, Apr 24, 2012 at 7:48 PM, Chris Cunnington smalltalktelevision@gmail.com wrote:
This is not a message I want to send. squeak.org is down again and I can't bring it back up. There's a 502 Gateway error. One that I did not create. map.squeak.org and wiki.squeak.org and Squeak-Dev are up.
Following Ken's instructions, I did:
vncserver -kill :1
which closes things down and produces this:
website@box2:~$ ps aux | grep website root 19315 0.0 0.1 6224 1912 ? Ss Apr24 0:00 sshd: website [priv] website 19317 0.0 0.2 6388 1980 ? S Apr24 0:00 sshd: website@pts/0 website 19318 0.0 0.1 2600 1500 pts/0 Rs Apr24 0:00 -bash website 21913 0.0 0.0 2496 848 pts/0 R+ 00:22 0:00 ps aux website 21914 0.0 0.0 1548 480 pts/0 R+ 00:22 0:00 grep website
Then, following his instructions:
vncserver
which produces this:
website@box2:~$ ps aux | grep website root 19315 0.0 0.1 6224 1912 ? Ss Apr24 0:00 sshd: website [priv] website 19317 0.0 0.2 6388 1980 ? S Apr24 0:00 sshd: website@pts/0 website 19318 0.0 0.1 2600 1500 pts/0 Ss Apr24 0:00 -bash website 22163 0.0 0.4 6544 4760 pts/0 S 00:23 0:00 Xtightvnc :1 -desktop X -auth /home/website/.Xauthority -geometry 1024x768 -depth 24 -rfbwait 120000 -rfbauth /home/website/.vnc/passwd -rfbport 5901 -fp /usr/X11R6/lib/X11/fonts/Type1/,/usr/X11R6/lib/X11/fonts/Speedo/,/usr/X11R6/lib/X11/fonts/misc/,/usr/X11R6/lib/X11/fonts/75dpi/,/usr/X11R6/lib/X11/fonts/100dpi/ -co /usr/X11R6/lib/X11/rgb website 22168 36.4 11.7 1052208 113860 pts/0 R 00:23 1:03 /usr/local/lib/squeak/3.11.3-2135/squeakvm -pathenc UTF-8 -encoding UTF-8 -plugins /usr/local/lib/squeak/3.11.3-2135 /home/website/website/squeaksite.image website 22238 0.0 0.0 2496 848 pts/0 R+ 00:25 0:00 ps aux website 22239 0.0 0.0 1548 480 pts/0 R+ 00:25 0:00 grep website
The image is up and running. The vnc is running. And there is still a 502 Bad Gateway from www.squeak.org. I took a crack at:
svc -u wwwservice
and was permission denied. But if you, as a root person, do that, then the VNC doesn't come up, because the squeak.org process can run either under daemontools or under VNC, but not both.
Yes, you have to be root to do this. But DON'T DO THIS if you are still using VNC as that will start up yet another process of the website and is likely to just make it worse as they both try to contend for the same ports. There is never a need to do both of these.
All I could do is simply repeat what you have already done which is to shut it down with vncserver -kill :1 (this :1 assumes that this is the assigned display port stated when vncserver was original run, you can also see it in the command line of the XTightvnc command line) and then start it back up with vncserver. After that the problem is almost certainly with something in the image and so you will have to fix it from there.
So I just tried this and am not able to get into the image via VNC, so something is badly messed up with the image. At that point the only choice is to recover from backup. One piece of information you perhaps did not have is that you can find local backups on the system under /var/cache/rsnapshot/*/localhost/home/website/ . It just so happens that under
/var/cache/rsnapshot/daily.0/localhost/home/website/website/ (today's backup)
there were copies made at about 15:00 UTC on the 24th. I copied those over the current copies (~website/website/squeaksite.image and squeaksite.changes) and started vncserver back up and the site is now running again.
Ken
I'm out of options. Sorry.
Chris
On 12-04-24 9:45 PM, Ken Causey wrote:
On Tue, Apr 24, 2012 at 7:48 PM, Chris Cunnington smalltalktelevision@gmail.com wrote:
and was permission denied. But if you, as a root person, do that, then the VNC doesn't come up, because the squeak.org process can run either under daemontools or under VNC, but not both.
Yes, you have to be root to do this. But DON'T DO THIS if you are still using VNC as that will start up yet another process of the website and is likely to just make it worse as they both try to contend for the same ports. There is never a need to do both of these.
OK, safety tips. If the VNC is running don't create a competing process by using daemontools.
All I could do is simply repeat what you have already done which is to shut it down with vncserver -kill :1 (this :1 assumes that this is the assigned display port stated when vncserver was original run, you can also see it in the command line of the XTightvnc command line) and then start it back up with vncserver. After that the problem is almost certainly with something in the image and so you will have to fix it from there.
So I just tried this and am not able to get into the image via VNC, so something is badly messed up with the image. At that point the only choice is to recover from backup. One piece of information you perhaps did not have is that you can find local backups on the system under /var/cache/rsnapshot/*/localhost/home/website/ . It just so happens that under
/var/cache/rsnapshot/daily.0/localhost/home/website/website/ (today's backup)
A backup. Nice. The only real upshot of all this is that we learn more about the system. Just for my own sanity I have to restate I can't think of anything I did to contribute to this.
I think Colin should get root access. I can't think of any body more qualified for the web work side of Smalltalk. At the next SOB meeting.
Thanks again, Ken. It is probably a nuisance to you, but I can't complain too much as I seem to learn something fascinating each time. At the same time, though. I'm not touching this system for a few days. I think my nerves are a little shot.
Cheers, Chris
box-admins@lists.squeakfoundation.org