Squeak-dev February 2011

squeak-dev@lists.squeakfoundation.org

87 participants
295 discussions

The Inbox: Compiler-nice.186.mcz
by commits＠source.squeak.org 03 Feb '11

03 Feb '11

A new version of Compiler was added to project The Inbox: http://source.squeak.org/inbox/Compiler-nice.186.mcz ==================== Summary ==================== Name: Compiler-nice.186 Author: nice Time: 3 February 2011, 11:26:04.738 pm UUID: 9bdb53d0-56a1-4d0b-9835-f60a135dd7f6 Ancestors: Compiler-nice.184 Add both Compiler and Decompiler support for inlined #repeat. Implementation notes: For compilation, the repeat is implemented with a simple backward jump if ever the receiver is a block. For decompilation, things are a bit more tedious because conditonnal loops (whileTrue/False) must be differentiated from unconditional loops (repeat). The signature of conditional loops is that they all have their backward jump hoping over their conditional jump. If a backward jump does not cross any conditional jump on its way back, then it must be a repeat. The idea is thus to register the program counter of the test instruction before the conditional jump (lastJumpIfPc), and verify if the bacward jump branch after or before this instruction. Things are a bit more complex because there can be a conditional instruction inside the repeat body. That's why those conditional jumps must be stacked (on lastJumpIfPcStack), and unstacked once decompiled. =============== Diff against Compiler-nice.184 =============== Item was changed: InstructionStream subclass: #Decompiler + instanceVariableNames: 'constructor method instVars tempVars constTable stack statements lastPc exit caseExits lastJumpPc lastReturnPc limit hasValue blockStackBase numLocalTemps blockStartsToTempVars tempVarCount lastJumpIfPcStack' - instanceVariableNames: 'constructor method instVars tempVars constTable stack statements lastPc exit caseExits lastJumpPc lastReturnPc limit hasValue blockStackBase numLocalTemps blockStartsToTempVars tempVarCount' classVariableNames: 'ArgumentFlag CascadeFlag CaseFlag IfNilFlag' poolDictionaries: '' category: 'Compiler-Kernel'! + !Decompiler commentStamp: 'nice 2/3/2011 22:54' prior: 0! - !Decompiler commentStamp: 'nice 3/1/2010 19:56' prior: 0! I decompile a method in three phases: Reverser: postfix byte codes -> prefix symbolic codes (nodes and atoms) Parser: prefix symbolic codes -> node tree (same as the compiler) Printer: node tree -> text (done by the nodes) instance vars: constructor <DecompilerConstructor> an auxiliary knowing how to generate Abstract Syntax Tree (node tree) method <CompiledMethod> the method being decompiled instVars <Array of: String> the instance variables of the class implementing method tempVars <String | (OrderedCollection of: String)> hold the names of temporary variables (if known) NOTE: POLYMORPHISM WILL BE RESOLVED IN #initSymbols: constTable <Collection of: ParseNode> parse node associated with byte encoded constants (nil true false 0 1 -1 etc...) stack <OrderedCollection of: (ParseNode | String | Integer) > multipurpose... statements <OrderedCollection of: ParseNode> the statements of the method being decompiled lastPc <Integer> exit <Integer> caseExits <OrderedCollection of: Integer> - stack of exit addresses that have been seen in the branches of caseOf:'s lastJumpPc <Integer> lastReturnPc <Integer> limit <Integer> hasValue <Boolean> blockStackBase <Integer> numLocaltemps <Integer | Symbol> - number of temps local to a block; also a flag indicating decompiling a block blockStartsToTempVars <Dictionary key: Integer value: (OrderedCollection of: String)> + tempVarCount <Integer> number of temp vars used by the method + lastJumpIfPcStack <OrderedCollection of: Integer> the value of program counter just before the last encountered conditional jumps! - tempVarCount <Integer> number of temp vars used by the method! Item was changed: ----- Method: Decompiler>>decompile:in:method:using: (in category 'public access') ----- decompile: aSelector in: aClass method: aMethod using: aConstructor | block node | constructor := aConstructor. method := aMethod. self initSymbols: aClass. "create symbol tables" method isQuick ifTrue: [block := self quickMethod] ifFalse: [stack := OrderedCollection new: method frameSize. + lastJumpIfPcStack := OrderedCollection new. caseExits := OrderedCollection new. statements := OrderedCollection new: 20. numLocalTemps := 0. super method: method pc: method initialPC. "skip primitive error code store if necessary" (method primitive ~= 0 and: [self willStore]) ifTrue: [pc := pc + 2. tempVars := tempVars asOrderedCollection]. block := self blockTo: method endPC + 1. stack isEmpty ifFalse: [self error: 'stack not empty']]. node := constructor codeMethod: aSelector block: block tempVars: tempVars primitive: method primitive class: aClass. method primitive > 0 ifTrue: [node removeAndRenameLastTempIfErrorCode]. ^node preen! Item was changed: ----- Method: Decompiler>>jump: (in category 'instruction decoding') ----- jump: dist + | blockBody destPc nextPC | + destPc := pc + dist. + (lastJumpIfPcStack isEmpty or: [dist < 0 and: [destPc > lastJumpIfPcStack last]]) + ifTrue: + ["Rule: aBackward jump not crossing a Bfp/Btp must be a repeat" + nextPC := pc. + pc := destPc. + blockBody := self statementsTo: lastPc. + blockBody size timesRepeat: [statements removeLast]. + pc := nextPC. + statements addLast: + (constructor + codeMessage: (constructor codeBlock: blockBody returns: false) + selector: (constructor + codeSelector: #repeat + code: #macro) + arguments: #()). + ] + ifFalse: + [exit := destPc. + lastJumpPc := lastPc]! - - exit := pc + dist. - lastJumpPc := lastPc! Item was changed: ----- Method: Decompiler>>jump:if: (in category 'instruction decoding') ----- jump: dist if: condition | savePc sign elsePc elseStart end cond ifExpr thenBlock elseBlock thenJump elseJump condHasValue isIfNil saveStack blockBody | + lastJumpIfPcStack addLast: lastPc. + stack last == CascadeFlag ifTrue: [^ [self case: dist] ensure: [lastJumpIfPcStack removeLast]]. - stack last == CascadeFlag ifTrue: [^ self case: dist]. elsePc := lastPc. elseStart := pc + dist. end := limit. "Check for bfp-jmp to invert condition. Don't be fooled by a loop with a null body." sign := condition. savePc := pc. self interpretJump ifNotNil: [:elseDist| (elseDist >= 0 and: [elseStart = pc]) ifTrue: [sign := sign not. elseStart := pc + elseDist]]. pc := savePc. ifExpr := stack removeLast. (isIfNil := stack size > 0 and: [stack last == IfNilFlag]) ifTrue: [stack removeLast]. saveStack := stack. stack := OrderedCollection new. thenBlock := self blockTo: elseStart. condHasValue := hasValue or: [isIfNil]. "ensure jump is within block (in case thenExpr returns)" thenJump := exit <= end ifTrue: [exit] ifFalse: [elseStart]. "if jump goes back, then it's a loop" thenJump < elseStart ifTrue: ["Must be a while loop... thenJump will jump to the beginning of the while expr. In the case of while's with a block in the condition, the while expr should include more than just the last expression: find all the statements needed by re-decompiling." stack := saveStack. pc := thenJump. blockBody := self statementsTo: elsePc. "discard unwanted statements from block" blockBody size - 1 timesRepeat: [statements removeLast]. statements addLast: (constructor codeMessage: (constructor codeBlock: blockBody returns: false) selector: (constructor codeSelector: (sign ifTrue: [#whileFalse:] ifFalse: [#whileTrue:]) code: #macro) arguments: { thenBlock }). pc := elseStart. self convertToDoLoop] ifFalse: ["Must be a conditional..." elseBlock := self blockTo: thenJump. elseJump := exit. "if elseJump is backwards, it is not part of the elseExpr" elseJump < elsePc ifTrue: [pc := lastPc]. cond := isIfNil ifTrue: [constructor codeMessage: ifExpr ifNilReceiver selector: (constructor codeSelector: (sign ifTrue: [#ifNotNil:] ifFalse: [#ifNil:]) code: #macro) arguments: (Array with: thenBlock)] ifFalse: [constructor codeMessage: ifExpr selector: (constructor codeSelector: #ifTrue:ifFalse: code: #macro) arguments: (sign ifTrue: [{elseBlock. thenBlock}] ifFalse: [{thenBlock. elseBlock}])]. stack := saveStack. condHasValue ifTrue: [stack addLast: cond] + ifFalse: [statements addLast: cond]]. + lastJumpIfPcStack removeLast.! - ifFalse: [statements addLast: cond]]! Item was changed: ----- Method: MessageNode class>>initialize (in category 'class initialization') ----- + initialize + "MessageNode initialize" - initialize "MessageNode initialize" MacroSelectors := #( ifTrue: ifFalse: ifTrue:ifFalse: ifFalse:ifTrue: and: or: whileFalse: whileTrue: whileFalse whileTrue to:do: to:by:do: caseOf: caseOf:otherwise: + ifNil: ifNotNil: ifNil:ifNotNil: ifNotNil:ifNil: + repeat ). - ifNil: ifNotNil: ifNil:ifNotNil: ifNotNil:ifNil:). MacroTransformers := #( transformIfTrue: transformIfFalse: transformIfTrueIfFalse: transformIfFalseIfTrue: transformAnd: transformOr: transformWhile: transformWhile: transformWhile: transformWhile: transformToDo: transformToDo: transformCase: transformCase: + transformIfNil: transformIfNil: transformIfNilIfNotNil: transformIfNotNilIfNil: + transformRepeat: ). - transformIfNil: transformIfNil: transformIfNilIfNotNil: transformIfNotNilIfNil:). MacroEmitters := #( emitCodeForIf:encoder:value: emitCodeForIf:encoder:value: emitCodeForIf:encoder:value: emitCodeForIf:encoder:value: emitCodeForIf:encoder:value: emitCodeForIf:encoder:value: emitCodeForWhile:encoder:value: emitCodeForWhile:encoder:value: emitCodeForWhile:encoder:value: emitCodeForWhile:encoder:value: emitCodeForToDo:encoder:value: emitCodeForToDo:encoder:value: emitCodeForCase:encoder:value: emitCodeForCase:encoder:value: emitCodeForIfNil:encoder:value: emitCodeForIfNil:encoder:value: + emitCodeForIf:encoder:value: emitCodeForIf:encoder:value: + emitCodeForRepeat:encoder:value:). - emitCodeForIf:encoder:value: emitCodeForIf:encoder:value:). MacroSizers := #( sizeCodeForIf:value: sizeCodeForIf:value: sizeCodeForIf:value: sizeCodeForIf:value: sizeCodeForIf:value: sizeCodeForIf:value: sizeCodeForWhile:value: sizeCodeForWhile:value: sizeCodeForWhile:value: sizeCodeForWhile:value: sizeCodeForToDo:value: sizeCodeForToDo:value: sizeCodeForCase:value: sizeCodeForCase:value: + sizeCodeForIfNil:value: sizeCodeForIfNil:value: sizeCodeForIf:value: sizeCodeForIf:value: + sizeCodeForRepeat:value:). - sizeCodeForIfNil:value: sizeCodeForIfNil:value: sizeCodeForIf:value: sizeCodeForIf:value:). MacroPrinters := #( printIfOn:indent: printIfOn:indent: printIfOn:indent: printIfOn:indent: printIfOn:indent: printIfOn:indent: printWhileOn:indent: printWhileOn:indent: printWhileOn:indent: printWhileOn:indent: printToDoOn:indent: printToDoOn:indent: printCaseOn:indent: printCaseOn:indent: + printIfNil:indent: printIfNil:indent: printIfNilNotNil:indent: printIfNilNotNil:indent: + printRepeatOn:indent:)! - printIfNil:indent: printIfNil:indent: printIfNilNotNil:indent: printIfNilNotNil:indent:)! Item was added: + ----- Method: MessageNode>>emitCodeForRepeat:encoder:value: (in category 'code generation') ----- + emitCodeForRepeat: stack encoder: encoder value: forValue + " L1: ... Jmp(L1)" + | loopSize | + loopSize := sizes at: 1. + receiver emitCodeForEvaluatedEffect: stack encoder: encoder. + self emitCodeForJump: 0 - loopSize encoder: encoder. + forValue ifTrue: [encoder genPushSpecialLiteral: nil. stack push: 1]! Item was added: + ----- Method: MessageNode>>printRepeatOn:indent: (in category 'printing') ----- + printRepeatOn: aStream indent: level + + self printReceiver: receiver on: aStream indent: level. + + ^self printKeywords: selector key + arguments: (Array new) + on: aStream indent: level! Item was added: + ----- Method: MessageNode>>sizeCodeForRepeat:value: (in category 'code generation') ----- + sizeCodeForRepeat: encoder value: forValue + "L1: ... Jmp(L1) nil (nil for value only);" + | loopSize | + loopSize := (receiver sizeCodeForEvaluatedEffect: encoder) + (encoder sizeJumpLong: 1). + sizes := Array with: loopSize. + ^loopSize + (forValue ifTrue: [encoder sizePushSpecialLiteral: nil] ifFalse: [0])! Item was added: + ----- Method: MessageNode>>transformRepeat: (in category 'macro transformations') ----- + transformRepeat: encoder + "answer true if this #repeat message can be optimized" + + ^(self checkBlock: receiver as: 'receiver' from: encoder) + and: [receiver noteOptimizedIn: self. + true]!

1 0

Box-Admins Team needs a new leader and/or we need a new way
by Chris Cunnington 03 Feb '11

03 Feb '11

I'm interested in doing this kind of work. I have the time and the inclination. I'm interested in it because I DON'T know much about it and would like to gain these skills in context. In the short term you could find somebody who is more knowledgeable than I am. But you won't find somebody who would approach these sysadmin tasks with more fascination. Squeak-dev a rough place to find a replacement, because sysadmin work is thankless and prosaic. This is a developers board. And honestly, if the box went down for a few hours because I kicked the plug out of the wall, so what? If people want volunteer service, then they'd better learn to pay for it with a little forbearance. Nothing is absolutely free. Chris

1 0

The Trunk: Tools-laza.294.mcz
by commits＠source.squeak.org 03 Feb '11

03 Feb '11

Alexander Lazarević uploaded a new version of Tools to project The Trunk: http://source.squeak.org/trunk/Tools-laza.294.mcz ==================== Summary ==================== Name: Tools-laza.294 Author: laza Time: 3 February 2011, 9:21:19.739 pm UUID: 1b6fdc16-3cdf-3f45-bb5b-520c65f1e983 Ancestors: Tools-cmm.293 Display DependencyBrowsers class comment in it's code pane while no method is selected, to give a clue about what is being shown in the list views =============== Diff against Tools-cmm.293 =============== Item was changed: ----- Method: DependencyBrowser>>aboutToStyle: (in category 'contents') ----- aboutToStyle: aStyler "This is a notification that aStyler is about to re-style its text. Set the classOrMetaClass in aStyler, so that identifiers will be resolved correctly. Answer true to allow styling to proceed, or false to veto the styling" | selectedClass | selectedClass := self classListSelection ifNil:[^false]. + self messageListSelection ifNil:[^false]. aStyler classOrMetaClass: ((self messageListSelection == #Definition) ifFalse:[Smalltalk classNamed: selectedClass]). ^true! Item was changed: ----- Method: DependencyBrowser>>selectedMessage (in category 'contents') ----- selectedMessage "Source code for currently selected message" | className methodName mref | className := self classListSelection. methodName := self messageListSelection. mref := (classDeps at: self classDepsSelection ifAbsent:[#()]) detect:[:mr| mr classSymbol = className and:[mr methodSymbol = methodName]] ifNone:[nil]. + mref ifNil:[^self class comment]. - mref ifNil:[^'']. mref methodSymbol == #Definition ifTrue:[^mref actualClass definition]. ^mref sourceCode!

1 0

Reg. SqueakSource
by Casey Ransberger 03 Feb '11

03 Feb '11

Does anyone here know this guts of SS well? I've wondered for some time what it would take to decouple the SCM repository bits from the web front end. I think I was listening to independent misinterpretations when someone suggested adding a query API to it; if we did that, it wouldn't be hard to attach various "views" or web front ends (e.g., we might make a front end that's "spider food" such that searching for a package at Google might turn up a project page, like with CPAN. The current default Seaside URLs pretty much guarantee that SEO is DOA.) It seems like having an integrated web front end probably encumbers SS. I wonder what the performance impact of being both a WFE and a SCM winds up being. Any thoughts?

2 1

conflicting requirements for Pier installed via Installer script included with Squeak4.2-10950.image
by Lawson English 03 Feb '11

03 Feb '11

In the Squeak4.2-10950.image, at the end of the "How to extend the Image" window, there is a line of code: (Smalltalk at: #PRDistribution) new register. This returns errors due to the fact that PRAjaxSearchWidget is not in the package Pier-Seaside-Widgets specified by the ConfigurationOfPier2 and in fact, it isn't included in any version after Pier-Seaside-NickAger.490. If I drop back to that version, I can register a new Pier kernel via PRDistribution, but otherwise, not. Lawson

1 0

Empty directories in 4.2
by K. K. Subramaniam 03 Feb '11

03 Feb '11

Hi, ftp://ftp.squeak.org/4.2 shows mac/ unix-linux/ win/ as empty directories. is this is working as designed or am I missing something in my browser? TIA .. Subbu

2 1

The Trunk: Installer-Core-mtf.343.mcz
by commits＠source.squeak.org 03 Feb '11

03 Feb '11

Matthew Fulmer uploaded a new version of Installer-Core to project The Trunk: http://source.squeak.org/trunk/Installer-Core-mtf.343.mcz ==================== Summary ==================== Name: Installer-Core-mtf.343 Author: mtf Time: 3 February 2011, 3:58:45.146 am UUID: 06001be5-55a0-43f8-bf51-810cb68d47ce Ancestors: Installer-Core-ul.342 Added "Installer cobalt" to name the cobalt squeaksource =============== Diff against Installer-Core-ul.342 =============== Item was added: + ----- Method: Installer classSide>>cobalt (in category 'repositories') ----- + cobalt + + ^ self monticello http: 'http://croquet-src-01.oit.duke.edu:8886'!

1 0

Re: [squeak-dev] final 4.2 image available
by Chris Muller 03 Feb '11

03 Feb '11

Same problem in trunk? On Wed, Feb 2, 2011 at 5:18 PM, Ken G. Brown <kbrown(a)mac.com> wrote: > With fresh Squeak4.2-10950, doing cmd-click no longer pulls up the halos on Mac, does not seem to matter which VM. > > Ken > > > At 11:24 AM -0600 1/31/11, Chris Muller apparently wrote: >>Squeak4.2-10950.zip is now available at http://ftp.squeak.org/4.2, >>which is intended to be the actual-released 4.2 image (unless we find >>some problem, which we won't). >> >>The trunk will be reopened shortly, thanks for your patience. >> >> - Chris > > >

3 4

Accessing external resources in a cross-platform way
by Hernán Morales Durand 03 Feb '11

03 Feb '11

Let's say you want to resolve paths in a cross platform way Binaries @ 'MyExec' Libraries @ 'MyLib' SystemLibraries @ 'SystemLib' etc. then Binaries is In Windows: #( 'C:\Program Files\' 'C:\Archivos de Programa\' ...) " and all standard locations including translations " In UNIX: #('/usr/bin/' '/usr/local/bin' ....) " and all standard locations " etc Now you may say it is necessary to scan all directories to find MyExec, yes but you may then save that location myBinaryLocation := Binaries @ 'MyExec'. so you scan for it just once. What do you think? it is already implemented anywhere? If not what package do you think is more suitable or prepared for implementing it? Cheers, -- Hernán Morales Information Technology Manager, Institute of Veterinary Genetics. National Scientific and Technical Research Council (CONICET). La Plata (1900), Buenos Aires, Argentina. Telephone: +54 (0221) 421-1799. Internal: 422 Fax: 425-7980 or 421-1799.

4 5

Daily Commit Log
by commits＠source.squeak.org 03 Feb '11

03 Feb '11

Changes to Trunk (http://source.squeak.org/trunk.html) in the last 24 hours: http://lists.squeakfoundation.org/pipermail/packages/2011-February/004212.h… Name: ReleaseBuilder-cmm.59 Ancestors: ReleaseBuilder-ul.58 Added script for transferring currently-loaded packages from trunk to squeak42 release repository. =============================================

1 0

Jump to page: