[Box-Admins] Build.squeak.org not working

[Ken Causey]

On 02/11/2014 12:57 PM, Ken Causey wrote:
> I'm getting a proxy error at the moment at http://build.squeak.org/ .
> Before trying anything myself I thought I would check to see if you are
> aware of the issue and perhaps working on Jenkins currently.
>
> Ken

After waiting a bit I decided to just jump in.  So to recap Apache 
claimed that jenkins was not responding.

kencausey at box3-squeak:~$ ps auwx
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
...
jenkins  17551  0.0  0.0   3672   484 ?        S    Feb09   0:00 
/usr/bin/daemon --name=jenkins --inherit 
--env=JENKINS_HOME=/var/lib/jenkins 
--output=/var/log/jenkins/jenkins.log 
--pidfile=/var/run/jenkins/jenkins.pid -- /usr/bin/java 
-XX:+UseConcMarkSweepGC -XX:+CMSCla
jenkins  17555 10.5 18.1 727164 187320 ?       Sl   Feb09 286:42 
/usr/bin/java -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -jar 
/usr/share/jenkins/jenkins.war --webroot=/var/cache/jenkins/war 
--httpPort=8080 --ajp13Port=-1
...

kencausey at box3-squeak:~$ sudo service jenkins
Usage: /etc/init.d/jenkins {start|stop|status|restart|force-reload}
kencausey at box3-squeak:~$ sudo service jenkins status
2 instances of jenkins are running at the moment
but the pidfile /var/run/jenkins/jenkins.pid is missing
kencausey at box3-squeak:~$ sudo service jenkins stop
Stopping Jenkins Continuous Integration Server: jenkins.
kencausey at box3-squeak:~$ ps auwx
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
...
jenkins  17551  0.0  0.0   3672   484 ?        S    Feb09   0:00 
/usr/bin/daemon --name=jenkins --inherit 
--env=JENKINS_HOME=/var/lib/jenkins 
--output=/var/log/jenkins/jenkins.log 
--pidfile=/var/run/jenkins/jenkins.pid -- /usr/bin/java 
-XX:+UseConcMarkSweepGC -XX:+CMSCla
jenkins  17555 10.5 18.1 727164 187320 ?       Sl   Feb09 287:29 
/usr/bin/java -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -jar 
/usr/share/jenkins/jenkins.war --webroot=/var/cache/jenkins/war 
--httpPort=8080 --ajp13Port=-1
...

Given the comment about missing pid file that it did not stop was not 
really surprising.  I'm not sure what to make of the '2 instances' 
comment, I suspect the logic in that comment is wrong.

kencausey at box3-squeak:~$ sudo kill 17555

still running

kencausey at box3-squeak:~$ sudo kill -9 17555

Now both the java and daemon process are gone.

kencausey at box3-squeak:~$ sudo service jenkins status
Jenkins Continuous Integration Server is not running
kencausey at box3-squeak:~$ sudo service jenkins start
Starting Jenkins Continuous Integration Server: jenkins.
kencausey at box3-squeak:~$ ps auwx
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
...
jenkins  13825  0.0  0.0   3672   544 ?        S    20:53   0:00 
/usr/bin/daemon --name=jenkins --inherit 
--env=JENKINS_HOME=/var/lib/jenkins 
--output=/var/log/jenkins/jenkins.log 
--pidfile=/var/run/jenkins/jenkins.pid -- /usr/bin/java 
-XX:+UseConcMarkSweepGC -XX:+CMSCla
jenkins  13828 21.0  3.6 673132 37328 ?        Sl   20:53   0:00 
/usr/bin/java -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -jar 
/usr/share/jenkins/jenkins.war --webroot=/var/cache/jenkins/war 
--httpPort=8080 --ajp13Port=-1
...
kencausey at box3-squeak:~$ sudo service jenkins status
Jenkins Continuous Integration Server is running with the pid 13825

And the site is responsive.  For the moment...

Ken

P.S. I left the /etc/default/jenkins file as is for now although the 
JAVA_ARGS specified there seem like an obvious suspect.