[Box-Admins] Re: Accidental self-DOS in progress on build.squeak.org

David T. Lewis lewis at mail.msen.com
Sat Jan 4 18:32:30 UTC 2014


On Sat, Jan 04, 2014 at 04:20:22PM +0000, Frank Shearar wrote:
> On 4 January 2014 13:36, Frank Shearar <frank.shearar at gmail.com> wrote:
> > On 4 January 2014 13:23, Frank Shearar <frank.shearar at gmail.com> wrote:
> >> I added a small change to the ExternalPackages builds that would
> >> display the exact versions of things under test... and blew up
> >> Jenkins. I'm killing all the processes at the moment. Hopefully things
> >> will be back to normal soon.
> >>
> >> Sorry!
> >
> > www.squeaksource.com is fine; it's just build.squeak.org, broken with
> > a "Service Temporarily Unavailable". I have to pop out for a bit, but
> > I've killed all the lingering jenkins squeak processes, and corrected
> > the script so that future builds won't break. When I get back, I'll
> > take another run at kicking build.squeak.org back into life.
> 
> Seems like it just needed some time alone, after I restarted the
> jenkins service. Looks good once more.

There were some runaway processes reparented to root (see attached output
from ps xjf), so I killed the three offending processes.

I also noticed the other day that the java process associated with jenkins
was gobbling up all the CPU for no apparent reason. I suspect this may
have been related to a change in one of the test configurations also but
I did not follow up on it at the time.

Dave

-------------- next part --------------
 PPID   PID  PGID   SID TTY      TPGID STAT   UID   TIME COMMAND
15696 15698 15696 15671 pts/0    15870 S      103   0:00 su - jenkins
15698 15699 15699 15671 pts/0    15870 S      103   0:00  \_ -su
15699 15870 15870 15671 pts/0    15870 R+     103   0:00      \_ ps xjf
    1 15408 26020 26020 ?           -1 S      103   0:37 /var/lib/jenkins/workspace/ExternalPackages/target/Squeak-4.10.2.2614-src-32/bld/squeakvm -vm-sound-null -vm-display-null /var/lib/jenkins/workspace/ExternalPackages/target/Metacello.image ../package-load-scripts/Metacello.st
    1 15225 26020 26020 ?           -1 S      103   0:20 /var/lib/jenkins/workspace/ExternalPackages/target/Squeak-4.10.2.2614-src-32/bld/squeakvm -vm-sound-null -vm-display-null /var/lib/jenkins/workspace/ExternalPackages/target/Fuel.image ../package-load-scripts/Fuel.st
    1 14825 26020 26020 ?           -1 S      103   0:39 /var/lib/jenkins/workspace/ExternalPackages/target/Squeak-4.10.2.2614-src-32/bld/squeakvm -vm-sound-null -vm-display-null /var/lib/jenkins/workspace/ExternalPackages/target/FileSystem-with-Xtreams.image ../package-load-scripts/FileSystem-with-Xtreams.st
    1 26023 26020 26020 ?           -1 S      103   0:00 /usr/bin/daemon --name=jenkins --inherit --env=JENKINS_HOME=/var/lib/jenkins --output=/var/log/jenkins/jenkins.log --pidfile=/var/run/jenkins/jenkins.pid -- /usr/bin/java -jar /usr/share/jenkins/jenkins.war --webroot=/var/cache/jenkins/war --httpPort=8080 --ajp13Port=-1
26023 26026 26020 26020 ?           -1 Sl     103   1:43  \_ /usr/bin/java -jar /usr/share/jenkins/jenkins.war --webroot=/var/cache/jenkins/war --httpPort=8080 --ajp13Port=-1
26026 11039 26020 26020 ?           -1 S      103   0:00      \_ /bin/sh -xe /tmp/hudson9126061288567765725.sh
11039 11040 26020 26020 ?           -1 Sl     103   0:04      |   \_ /var/lib/jenkins/.rvm/gems/ruby-1.9.3-p392/bin/rspec                                                                                                   
11040 15849 26020 26020 ?           -1 S      103   0:00      |       \_ sh -c /var/lib/jenkins/workspace/ExternalPackages/target/Squeak-4.10.2.2614-src-32/bld/squeak.sh -vm-sound-null -vm-display-null "/var/lib/jenkins/workspace/ExternalPackages/target/OSProcess.image" ../package-load-scripts/OSProcess.st && echo command 57 finished
15849 15852 26020 26020 ?           -1 R      103   0:15      |           \_ /var/lib/jenkins/workspace/ExternalPackages/target/Squeak-4.10.2.2614-src-32/bld/squeakvm -vm-sound-null -vm-display-null /var/lib/jenkins/workspace/ExternalPackages/target/OSProcess.image ../package-load-scripts/OSProcess.st
26026 15059 26020 26020 ?           -1 S      103   0:00      \_ /bin/sh -xe /tmp/hudson1912650506709227998.sh
15059 15061 26020 26020 ?           -1 Sl     103   0:04          \_ /var/lib/jenkins/.rvm/gems/ruby-1.9.3-p392/bin/rake                                                                                
15061 15269 26020 26020 ?           -1 S      103   0:00              \_ sh -c /var/lib/jenkins/.rvm/rubies/ruby-1.9.3-p392/bin/ruby -S rspec test/image_test.rb -fdoc --tag ~interpreter
15269 15271 26020 26020 ?           -1 Sl     103   0:00                  \_ /var/lib/jenkins/.rvm/rubies/ruby-1.9.3-p392/bin/ruby -S rspec test/image_test.rb -fdoc --tag ~interpreter
15271 15680 26020 26020 ?           -1 S      103   0:00                      \_ sh -c /var/lib/jenkins/workspace/ReleaseSqueakTrunk/target/cog.r2776/coglinux/bin/squeak -vm-sound-null -vm-display-null "/var/lib/jenkins/workspace/ReleaseSqueakTrunk/target/PostTestTrunkImage.image" ../benchmarks.st && echo command 1 finished
15680 15683 26020 26020 ?           -1 R      103   0:54                          \_ /var/lib/jenkins/workspace/ReleaseSqueakTrunk/target/cog.r2776/coglinux/bin/../lib/squeak/4.0-2776/squeak -vm-sound-null -vm-display-null /var/lib/jenkins/workspace/ReleaseSqueakTrunk/target/PostTestTrunkImage.image ../benchmarks.st


More information about the Box-Admins mailing list