<div dir="ltr"><div>I just looked at the image and there were bunch of processes hung up on one or another of two critical blocks; although it did not appear that either was part of the call stack of the other.</div><div><br></div><div>One of them was using a Semaphore instead of a Mutex, so that is suspicious.</div><div><br></div><div>There were so many, it wasn't evident what the root cause of the issue was, so I decided to bounce the server and will monitor it over the next days to see if the issue returns.</div><div><br></div><div><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Dec 30, 2016 at 2:34 AM, Fabio Niephaus <span dir="ltr"><<a href="mailto:lists@fniephaus.com" target="_blank">lists@fniephaus.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><span class=""><div class="m_3736228352384837445GmSign">On Fri, Dec 30, 2016 at 12:18 AM Chris Muller <<a href="mailto:asqueaker@gmail.com" target="_blank">asqueaker@gmail.com</a>> wrote:<br></div></span><div class="gmail_quote"><span class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="m_3736228352384837445gmail_msg">Appears there is a problem accessing one of the MCVersions -- #versionNamed: returned nil, but the calling code didn't expect that.<div class="m_3736228352384837445gmail_msg"><br class="m_3736228352384837445gmail_msg"></div><div class="m_3736228352384837445gmail_msg">Very helpful would be to know what version it failed on..</div></div><div dir="ltr" class="m_3736228352384837445gmail_msg"><div class="m_3736228352384837445gmail_msg"><br class="m_3736228352384837445gmail_msg"></div></div></blockquote><div><br></div></span><div>Yes, that'd be helpful. But I'm afraid we only have a call stack at the moment. Interestingly, the error only seems to occur occasionally, so maybe we need one more retry somewhere in the updater? Obviously, the updater needs to be as bullet proof as possible, because it's used to build new trunk images.</div><div><div class="h5"><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="m_3736228352384837445gmail_msg"><div class="m_3736228352384837445gmail_msg"><div class="gmail_extra m_3736228352384837445gmail_msg"><br class="m_3736228352384837445gmail_msg"><div class="gmail_quote m_3736228352384837445gmail_msg">On Tue, Dec 27, 2016 at 12:35 PM, Fabio Niephaus <span dir="ltr" class="m_3736228352384837445gmail_msg"><<a href="mailto:lists@fniephaus.com" class="m_3736228352384837445gmail_msg" target="_blank">lists@fniephaus.com</a>></span> wrote:<br class="m_3736228352384837445gmail_msg"><blockquote class="gmail_quote m_3736228352384837445gmail_msg" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="m_3736228352384837445gmail_msg">Trunk builds are failing because of:<div class="m_3736228352384837445gmail_msg"><br class="m_3736228352384837445gmail_msg"><div class="m_3736228352384837445gmail_msg">UndefinedObject(Object)>><wbr>doesNotUnderstand: #dependencies MCMcmUpdater>><wbr>updateFromConfig: [] in [] in [] in MCMcmUpdater>><wbr>updateFromRepository:<br class="m_3736228352384837445gmail_msg"></div><div class="m_3736228352384837445gmail_msg">...</div><div class="m_3736228352384837445gmail_msg"><br class="m_3736228352384837445gmail_msg"></div><div class="m_3736228352384837445gmail_msg">See <a href="https://travis-ci.org/squeak-smalltalk/squeak-app/jobs/186982813#L79" class="m_3736228352384837445gmail_msg" target="_blank">https://travis-ci.org/squeak-<wbr>smalltalk/squeak-app/jobs/<wbr>186982813#L79</a></div><div class="m_3736228352384837445gmail_msg"><br class="m_3736228352384837445gmail_msg"><div class="m_3736228352384837445m_6625633111894856251m_3276959658006525093GmSign m_3736228352384837445gmail_msg">-- <br class="m_3736228352384837445gmail_msg"></div><br class="m_3736228352384837445gmail_msg"><div class="gmail_quote m_3736228352384837445gmail_msg"><div dir="ltr" class="m_3736228352384837445gmail_msg">On Tue, Dec 27, 2016 at 4:45 PM Travis CI <<a href="mailto:builds@travis-ci.org" class="m_3736228352384837445gmail_msg" target="_blank">builds@travis-ci.org</a>> wrote:<br class="m_3736228352384837445gmail_msg"></div><blockquote class="gmail_quote m_3736228352384837445gmail_msg" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><u class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg"></u>
<div class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<div id="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956body" style="font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:16px;color:#808080;width:570px;margin:0 auto" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<table class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956repository m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="padding:0px;border:0px;width:100%;color:#606060;font-size:20px;margin-bottom:15px;margin-top:15px">
<tbody class="m_3736228352384837445gmail_msg"><tr style="padding:0px;border:0px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<td style="padding:0px;border:0px;vertical-align:middle" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<img src="https://avatars.githubusercontent.com/u/4463853?s=40&d=https%3A%2F%2Ftravis-ci.org%2Fimages%2Fmailer%2Fmascot-avatar-40px.png" style="vertical-align:middle;width:40px;height:40px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg"> <span style="vertical-align:middle;margin-left:3px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg"><strong class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg"><a href="https://travis-ci.org/squeak-smalltalk/squeak-app" style="text-decoration:underline;color:#606060" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" target="_blank">squeak-smalltalk / squeak-app</a></strong> (<a href="https://github.com/squeak-smalltalk/squeak-app/tree/master" style="text-decoration:underline;color:#606060" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" target="_blank">master</a>)</span>
</td>
</tr>
</tbody></table>
<div id="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956build" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956failure m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="border-radius:5px;padding:0px;width:570px;font-size:13px">
<div class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956content m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<table style="padding:0px;border:0px;width:100%;border-spacing:0" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<thead class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<tr style="padding:0px;border:0px;font-weight:700;font-size:18px;background-color:#fdcdce;color:#df192a" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<td style="border:0px;padding:0px 20px 0px 0px;border-top:1px solid #808080;border-bottom:1px solid #adadad;width:50px;padding:0px;text-align:center;vertical-align:middle;padding-top:5px;border-left:1px solid #606060;border-top-left-radius:5px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg"><div class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956status-image m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="width:25px;background-size:25px;height:30px;margin-left:15px;margin-top:0px;vertical-align:middle"><img src="https://travis-ci.org/images/mailer/failed.png" width="25" height="25" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg"></div></td>
<td class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956build-message m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="padding:0px;border:0px;padding:0px 20px 0px 0px;vertical-align:middle;border-top:1px solid #808080;border-bottom:1px solid #adadad">
<span style="display:inline-block;margin-top:12px;vertical-align:middle" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg"><a href="https://travis-ci.org/squeak-smalltalk/squeak-app/builds/186982810" style="text-decoration:none;font-weight:bold;color:#57769d;text-decoration:underline;color:#df192a" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" target="_blank">Build #320 was broken.</a></span><img src="https://travis-ci.org/images/mailer/arrow-failed.png" style="float:right" height="45" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
</td>
<td align="right" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956time m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="padding:0px;border:0px;font-weight:normal;font-size:12px;padding:0px 20px 0px 0px;vertical-align:middle;border-top:1px solid #808080;border-bottom:1px solid #adadad;border-right:1px solid #606060;border-top-right-radius:5px">
<div class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956stop-watch m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="vertical-align:middle;padding:0px;background-size:20px;display:inline-block;width:20px;height:20px"><img src="https://travis-ci.org/images/mailer/stopwatch-failed.png" width="20" height="20" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg"></div> <span style="vertical-align:middle" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">14 minutes and 20 seconds</span>
</td>
</tr>
</thead>
<tbody style="margin-bottom:40px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<tr style="padding:0px;border:0px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<td class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956profile-image m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="border:0px;padding:10px 20px 10px 0px;height:20px;width:50px;padding:0px;border-left:1px solid #adadad;padding-top:20px;padding-bottom:5px;text-align:center"><img src="https://secure.gravatar.com/avatar/8885d0209940b8eded8b2b79fb3a0f54?s=15&d=https%3A%2F%2Ftravis-ci.org%2Fimages%2Fmailer%2Fmascot-avatar-15px.png" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg"></td>
<td class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956grey m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="padding:0px;border:0px;color:#808080;padding:10px 20px 10px 0px;height:20px;padding-top:20px;padding-bottom:5px"><strong class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">Fabio Niephaus</strong></td>
<td align="right" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956grey m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="padding:0px;border:0px;color:#808080;padding:10px 20px 10px 0px;height:20px;border-right:1px solid #adadad;padding-top:20px;padding-bottom:5px">
<a href="https://github.com/squeak-smalltalk/squeak-app/commit/87356bd88d61872872f9aebfc757109dee512018" style="text-decoration:underline;text-decoration:none;font-weight:bold;color:#57769d" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" target="_blank">87356bd</a> <a href="https://github.com/squeak-smalltalk/squeak-app/compare/867efa13c3594f99e9edacdc23b66ae27048201c...87356bd88d61872872f9aebfc757109dee512018" style="text-decoration:underline;text-decoration:none;font-weight:bold;color:#57769d" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" target="_blank">Changeset →</a>
</td>
</tr>
<tr style="padding:0px;border:0px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<td style="border:0px;padding:10px 20px 10px 0px;height:20px;width:50px;padding:0px;border-left:1px solid #adadad;border-bottom-left-radius:5px;border-bottom:1px solid #adadad" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg"> </td>
<td colspan="2" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956grey m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="padding:0px;border:0px;color:#808080;padding:10px 20px 10px 0px;height:20px;border-right:1px solid #adadad;padding-bottom:20px;padding-top:0px;border-bottom:1px solid #adadad;border-bottom-right-radius:5px">Exclude SqueakSSLTest</td>
</tr>
</tbody>
</table>
</div>
</div>
<div style="padding-top:10px;width:570px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<span class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<div class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956section m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956footnote m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="margin-top:20px;border-radius:5px;border:1px solid #adadad;font-size:12px;padding:10px 20px;width:528px">
<p class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956grey m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="color:#808080;margin-top:0px;margin-bottom:5px"><strong style="font-size:14px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">Want to know about upcoming build environment updates?</strong></p>
<p class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956grey m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="color:#808080;margin-top:0px;margin-bottom:5px">Would you like to stay up-to-date with the upcoming Travis CI build environment updates?
We set up a mailing list for you!
Sign up <a href="http://eepurl.com/9OCsP" style="text-decoration:underline;color:#606060" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" target="_blank">here</a>.
</p>
</div>
</span>
</div>
<table border="0" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956footer m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="padding:0px;border:0px;width:100%;background-color:#e9e6e7;border-radius:5px;border:1px solid #adadad;padding:10px;margin-top:20px;font-size:12px;width:570px;line-height:16px">
<tbody class="m_3736228352384837445gmail_msg"><tr style="padding:0px;border:0px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<td style="padding:0px;border:0px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<img src="https://travis-ci.org/images/mailer/email-footer-travis-logo.png" style="width:50px;height:50px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
</td>
<td style="padding:0px;border:0px;color:#808080" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956grey m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<a href="https://docs.travis-ci.com" style="text-decoration:underline;color:#606060" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" target="_blank">Documentation</a> about Travis CI<br class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
Need help? Mail <a href="mailto:support@travis-ci.com" style="text-decoration:underline;color:#606060" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" target="_blank">support</a>!<br class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
Choose who receives these build notification emails in your <a href="https://docs.travis-ci.com/user/notifications" style="text-decoration:underline;color:#606060" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" target="_blank">configuration file</a>.
</td>
</tr>
</tbody></table>
<div style="padding-top:10px;width:570px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<img id="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956mascot" src="https://travis-ci.org/images/mailer/travis-mascot.png" width="80" style="float:right;margin-top:10px;margin-right:20px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
<div class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956section m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956footnote m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="margin-top:20px;border-radius:5px;border:1px solid #adadad;font-size:12px;padding:10px 20px;width:528px">
<p class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956grey m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="color:#808080;margin-top:0px;margin-bottom:5px"><strong style="font-size:14px" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">Would you like to test your private code?</strong></p>
<p class="m_3736228352384837445m_6625633111894856251m_3276959658006525093m_5848493843113489956grey m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" style="color:#808080;margin-top:0px;margin-bottom:5px"><a href="https://travis-ci.com?utm_source=build_email_footer&utm_campaign=travis-ci.org&utm_medium=email" style="text-decoration:underline;color:#606060" class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg" target="_blank">Travis CI for Private Projects</a> could be your new best friend!</p>
</div>
</div>
</div>
</div>
<br class="m_3736228352384837445m_6625633111894856251m_3276959658006525093gmail_msg m_3736228352384837445gmail_msg">
</blockquote></div></div></div></div>
<br class="m_3736228352384837445gmail_msg"><br class="m_3736228352384837445gmail_msg">
<br class="m_3736228352384837445gmail_msg"></blockquote></div><br class="m_3736228352384837445gmail_msg"></div></div></div></blockquote></div></div></div></div>
<br><br>
<br></blockquote></div><br></div></div>