Vm-dev May 2014

vm-dev@lists.squeakfoundation.org

32 participants
151 discussions

build.linux32x86 and build.linux32x86_64 build trees flattened, ready to peruse
by gettimothy 31 May '14

31 May '14

Hi all. http://www.svn.menmachinesmaterials.com/Flat/ The build.linux* build tree has been flattened. All implemented builds have configured and at least started to compile--which is exactly what I get from the Cog/ svn branch (: Builds from the Cog/ tree that work on my linux box also work on the flattened tree. Please QA the layout if you like HowToBuilds are just cut-n-paste from Cog/ with very minor edits--I have done no QA on the content at this time as I just want to get things "over" before a qa sweep. Next up is flattening the Dos and Mac trees. After that is mirroring the build.linux* trees with CMakeVMMakerSqueak configurations etc. Please let me know what I have mis-interpreted in the instructions I was given and I will fix it. Also, if you see any missing build configurations, give me a heads up. Cheers tty

1 0

VM Maker: Cog-eem.155.mcz
by commits＠source.squeak.org 31 May '14

31 May '14

Eliot Miranda uploaded a new version of Cog to project VM Maker: http://source.squeak.org/VMMaker/Cog-eem.155.mcz ==================== Summary ==================== Name: Cog-eem.155 Author: eem Time: 31 May 2014, 8:06:54.424 am UUID: 64eb21e0-b04d-428e-8d2f-5fc5c71f61b5 Ancestors: Cog-tpr.154 Add Spur method prototypes for ClassBuilder>>update:to: & ClassDescription>>updateMethodBindingsTo: Go some small way towards fixing the bootstrap now that pig compact does the business (no chunks left to create a snapshot full of segments). =============== Diff against Cog-tpr.154 =============== Item was added: + ----- Method: SpurBootstrap class>>ClassBuilderPROTOTYPEupdate:to: (in category 'method prototypes') ----- + ClassBuilderPROTOTYPEupdate: oldClass to: newClass + "Convert oldClass, all its instances and possibly its meta class into newClass, + instances of newClass and possibly its meta class. The process is surprisingly + simple in its implementation and surprisingly complex in its nuances and potentially + bad side effects. + We can rely on two assumptions (which are critical): + #1: The method #updateInstancesFrom: will not create any lasting pointers to + 'old' instances ('old' is quote on quote since #updateInstancesFrom: will do + a become of the old vs. the new instances and therefore it will not create + pointers to *new* instances before the #become: which are *old* afterwards) + #2: The non-preemptive execution of the critical piece of code guarantees that + nobody can get a hold by 'other means' (such as process interruption and + reflection) on the old instances. + Given the above two, we know that after #updateInstancesFrom: there are no pointers + to any old instances. After the forwarding become there will be no pointers to the old + class or meta class either. + Andreas Raab, 2/27/2003 23:42" + | meta | + meta := oldClass isMeta. + "Note: Everything from here on will run without the ability to get interrupted + to prevent any other process to create new instances of the old class." + ["Note: The following removal may look somewhat obscure and needs an explanation. + When we mutate the class hierarchy we create new classes for any existing subclass. + So it may look as if we don't have to remove the old class from its superclass. However, + at the top of the hierarchy (the first class we reshape) that superclass itself is not newly + created so therefore it will hold both the oldClass and newClass in its (obsolete or not) + subclasses. Since the #become: below will transparently replace the pointers to oldClass + with newClass the superclass would have newClass in its subclasses TWICE. With rather + unclear effects if we consider that we may convert the meta-class hierarchy itself (which + is derived from the non-meta class hierarchy). + Due to this problem ALL classes are removed from their superclass just prior to converting + them. Here, breaking the superclass/subclass invariant really doesn't matter since we will + effectively remove the oldClass (becomeForward:) just a few lines below." + + oldClass superclass removeSubclass: oldClass. + oldClass superclass removeObsoleteSubclass: oldClass. + + "make sure that the VM cache is clean" + oldClass methodDict do: [:cm | cm flushCache]. + + "Convert the instances of oldClass into instances of newClass" + newClass updateInstancesFrom: oldClass. + + meta + ifTrue: + [oldClass becomeForward: newClass. + oldClass updateMethodBindingsTo: oldClass binding] + ifFalse: + [{oldClass. oldClass class} elementsForwardIdentityTo: {newClass. newClass class}. + oldClass updateMethodBindingsTo: oldClass binding. + oldClass class updateMethodBindingsTo: oldClass class binding]. + + "eem 5/31/2014 07:22 At this point there used to be a garbage collect whose purpose was + to ensure no old instances existed after the becomeForward:. Without the GC it was possible + to resurrect old instances using e.g. allInstancesDo:. This was because the becomeForward: + updated references from the old objects to new objects but didn't destroy the old objects. + But as of late 2013/early 2014 becomeForward: has been modified to free all the old objects."] + valueUnpreemptively! Item was added: + ----- Method: SpurBootstrap class>>ClassDescriptionPROTOTYPEupdateMethodBindingsTo: (in category 'method prototypes') ----- + ClassDescriptionPROTOTYPEupdateMethodBindingsTo: aBinding + "ClassBuilder support for maintaining valid method bindings." + methodDict do: [:method| method methodClassAssociation: aBinding]! Item was changed: ----- Method: SpurBootstrap>>on: (in category 'initialize-release') ----- on: imageName StackInterpreter initializeWithOptions: Dictionary new. + (oldInterpreter := StackInterpreterSimulator new) + openOn: imageName extraMemory: 0; + assertValidExecutionPointersAtEachStep: false. - oldInterpreter := StackInterpreterSimulator new. - oldInterpreter openOn: imageName extraMemory: 0. oldHeap := oldInterpreter objectMemory. newHeap := Spur32BitMMLESimulator new. newHeap allocateMemoryOfSize: (oldHeap youngStart * 3 / 2 roundUpTo: 1024 * 1024) newSpaceSize: 2 * 1024 * 1024 stackSize: 1024 * 1024 codeSize: 0. newHeap setCheckForLeaks: 15 - 6. "don't check become; or newSpace; soooo many rehashes in bootstrap" newHeap bootstrapping: true. self initMaps! Item was changed: ----- Method: SpurBootstrap>>writeSnapshot:ofTransformedImage:headerFlags:screenSize: (in category 'testing') ----- writeSnapshot: imageFileName ofTransformedImage: spurHeap headerFlags: headerFlags screenSize: screenSizeInteger "The bootstrapped image typically contains a few big free chunks and one huge free chunk. Test snapshot writing and loading by turning the largest non-huge chunks into segment bridges and saving." | penultimate ultimate sizes counts barriers sim | sim := StackInterpreterSimulator onObjectMemory: spurHeap. sim bootstrapping: true. spurHeap coInterpreter: sim. sim initializeInterpreter: 0; setImageHeaderFlagsFrom: headerFlags; setDisplayForm: (Form extent: screenSizeInteger >> 16 @ (screenSizeInteger bitAnd: 16rFFFF)). spurHeap allOldSpaceEntitiesDo: [:e| penultimate := ultimate. ultimate := e]. self assert: (spurHeap isFreeObject: penultimate). self assert: (spurHeap isSegmentBridge: ultimate). sizes := Bag new. spurHeap allObjectsInFreeTree: (spurHeap freeLists at: 0) do: [:f| sizes add: (spurHeap bytesInObject: f)]. counts := sizes sortedCounts. self assert: counts last key = 1. "1 huge chunk" counts size > 1 ifTrue: [self assert: ((counts at: counts size - 1) key > 2 and: [(counts at: counts size - 1) value > 1024]). barriers := (1 to: (counts at: counts size - 1) key) collect: [:ign| spurHeap allocateOldSpaceChunkOfExactlyBytes: (counts at: counts size - 1) value]. barriers := barriers, {spurHeap allocateOldSpaceChunkOfExactlyBytes: (spurHeap bytesInObject: penultimate)}] ifFalse: [barriers := {spurHeap allocateOldSpaceChunkOfExactlyBytes: (spurHeap bytesInObject: penultimate)}]. + barriers last ifNotNil: + [:end| + spurHeap setEndOfMemory: end. + spurHeap allOldSpaceEntitiesDo: [:e| penultimate := ultimate. ultimate := e]. + self assert: (spurHeap addressAfter: ultimate) = end]. - spurHeap setEndOfMemory: barriers last. - spurHeap allOldSpaceEntitiesDo: [:e| penultimate := ultimate. ultimate := e]. - self assert: (spurHeap addressAfter: ultimate) = barriers last. spurHeap checkFreeSpace. spurHeap runLeakCheckerForFullGC: true. spurHeap segmentManager initializeFromFreeChunks: (barriers sort collect: [:b| spurHeap objectStartingAt: b]). spurHeap checkFreeSpace. spurHeap runLeakCheckerForFullGC: true. sim bereaveAllMarriedContextsForSnapshotFlushingExternalPrimitivesIf: true. sim imageName: imageFileName. sim writeImageFileIO!

1 0

VM Maker: VMMaker-dtl.346.mcz
by commits＠source.squeak.org 31 May '14

31 May '14

David T. Lewis uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker-dtl.346.mcz ==================== Summary ==================== Name: VMMaker-dtl.346 Author: dtl Time: 30 May 2014, 7:19:01.389 pm UUID: b3d921ff-4a69-45e5-9321-d022b072e50b Ancestors: VMMaker-dtl.345 VMMaker 4.13.5 In primitiveUtcWithOffset, use storePointer:ofObject:withValue: rather than stObject:at:put: to avoid unnecessary checks =============== Diff against VMMaker-dtl.345 =============== Item was changed: ----- Method: InterpreterPrimitives>>primitiveUtcWithOffset (in category 'system control primitives') ----- primitiveUtcWithOffset "Answer an array with UTC microseconds since the Posix epoch and the current seconds offset from GMT in the local time zone. An empty two element array may be supplied as a parameter. This is a named (not numbered) primitive in the null module (ie the VM)" | clock offset resultArray | <export: true> <var: #clock type: 'sqLong'> <var: #offset type: 'int'> argumentCount > 1 ifTrue: [^self primitiveFailFor: PrimErrBadNumArgs]. (self cCode: 'ioUtcWithOffset(&clock, &offset)' inSmalltalk: [-1]) = -1 ifTrue: [^ self primitiveFail]. objectMemory pushRemappableOop: (self positive64BitIntegerFor: clock). argumentCount > 0 ifTrue: [resultArray := self popStack. ((objectMemory isPointers: resultArray) and: [(objectMemory lengthOf: resultArray) = 2]) ifFalse: [^self primitiveFailFor: PrimErrBadArgument]] ifFalse: [resultArray := objectMemory instantiateClass: objectMemory classArray indexableSize: 2]. + objectMemory storePointer: 0 ofObject: resultArray withValue: objectMemory popRemappableOop. + objectMemory storePointerUnchecked: 1 ofObject: resultArray withValue: (objectMemory integerObjectOf: offset). - self stObject: resultArray at: 1 put: objectMemory popRemappableOop. - self stObject: resultArray at: 2 put: (objectMemory integerObjectOf: offset). self pop: 1 thenPush: resultArray ! Item was changed: ----- Method: VMMaker class>>versionString (in category 'version testing') ----- versionString "VMMaker versionString" + ^'4.13.5'! - ^'4.13.4'!

1 0

-DNDEBUG
by gettimothy 31 May '14

31 May '14

Hi Eliot. I have the /build.linux32x86/squeak.stack.v3/ tree ported. Since I am on a 64 bit machine with 32 bit libs, I cannot test these--however, the configuration compilation steps run--compilation just fails. In build.linux32x86_64/squeak.stack.v3/ I can build just fine as I have configuration options that work for this platform for both mvm and mvm_assert. However, whenever I compile anything without the -DNDEBUG preprocessor flag (which, according to my reading, has the preprocessor strip out debugging code) the compile fails. This is effecting mvm_debug and mvm_debug_threaded_heartbeat. I really do not feel like tracking this down at the moment and am considering adopting the policy of only adding mvm scripts that work. What do you think? thx. tty

3 3

VM Maker: VMMaker.oscog-dtl.738.mcz
by commits＠source.squeak.org 30 May '14

30 May '14

David T. Lewis uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-dtl.738.mcz ==================== Summary ==================== Name: VMMaker.oscog-dtl.738 Author: dtl Time: 29 May 2014, 9:19:40.39 pm UUID: 5911e4eb-32e9-4ecb-802a-b9bd422812de Ancestors: VMMaker.oscog-dtl.737 Remove unnecessary pushRemappableOop in primitiveUtcWithOffset =============== Diff against VMMaker.oscog-dtl.737 =============== Item was changed: ----- Method: InterpreterPrimitives>>primitiveUtcWithOffset (in category 'system control primitives') ----- primitiveUtcWithOffset "Answer an array with UTC microseconds since the Posix epoch and the current seconds offset from GMT in the local time zone. This is a named (not numbered) primitive in the null module (ie the VM)" | epochDelta offset resultArray utcMicroseconds | <export: true> <var: #epochDelta declareC: 'static usqLong epochDelta= 2177452800000000ULL'> <var: #utcMicroseconds type: #usqLong> <var: #offset type: #sqLong> utcMicroseconds := self ioUTCMicroseconds. offset := self ioLocalMicroseconds - utcMicroseconds. offset := offset / 1000000. - objectMemory pushRemappableOop: (objectMemory integerObjectOf: offset). objectMemory pushRemappableOop: (self positive64BitIntegerFor: utcMicroseconds - epochDelta). resultArray := objectMemory instantiateClass: objectMemory classArray indexableSize: 2. self storePointer: 0 ofObject: resultArray withValue: objectMemory popRemappableOop. + self storePointerUnchecked: 1 ofObject: resultArray withValue: (objectMemory integerObjectOf: offset). - self storePointerUnchecked: 1 ofObject: resultArray withValue: objectMemory popRemappableOop. self pop: 1 thenPush: resultArray !

1 0

VM Maker: VMMaker.oscog-dtl.737.mcz
by commits＠source.squeak.org 30 May '14

30 May '14

David T. Lewis uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-dtl.737.mcz ==================== Summary ==================== Name: VMMaker.oscog-dtl.737 Author: dtl Time: 29 May 2014, 8:18:52.343 pm UUID: dd942895-9394-4192-aa6f-dc808c730053 Ancestors: VMMaker.oscog-tpr.736 Fix code generation for ThreadedFFIPlugin by ensuring that target directory exists, addressing failures in http://build.squeak.org/job/CogVM/ code generation test. Fix regression in primitiveUtcWithOffset, answer the correct local time offset. =============== Diff against VMMaker.oscog-tpr.736 =============== Item was changed: ----- Method: InterpreterPrimitives>>primitiveUtcWithOffset (in category 'system control primitives') ----- primitiveUtcWithOffset "Answer an array with UTC microseconds since the Posix epoch and the current seconds offset from GMT in the local time zone. This is a named (not numbered) primitive in the null module (ie the VM)" + | epochDelta offset resultArray utcMicroseconds | + - | resultArray | <export: true> + <var: #epochDelta declareC: 'static usqLong epochDelta= 2177452800000000ULL'> + <var: #utcMicroseconds type: #usqLong> + <var: #offset type: #sqLong> + utcMicroseconds := self ioUTCMicroseconds. + offset := self ioLocalMicroseconds - utcMicroseconds. + offset := offset / 1000000. + objectMemory pushRemappableOop: (objectMemory integerObjectOf: offset). + objectMemory pushRemappableOop: (self positive64BitIntegerFor: utcMicroseconds - epochDelta). - "2177452800000000 = '1/1/1970' asDate asSeconds - '1/1/1901' asDate asSeconds * 1,000,000" - objectMemory pushRemappableOop: (self positive64BitIntegerFor: self ioUTCMicrosecondsNow - 2177452800000000). resultArray := objectMemory instantiateClass: objectMemory classArray indexableSize: 2. self storePointer: 0 ofObject: resultArray withValue: objectMemory popRemappableOop. + self storePointerUnchecked: 1 ofObject: resultArray withValue: objectMemory popRemappableOop. - self storePointerUnchecked: 1 ofObject: resultArray withValue: (objectMemory integerObjectOf: self ioLocalSecondsOffset). self pop: 1 thenPush: resultArray ! Item was changed: ----- Method: ThreadedFFIPlugin class>>translateInDirectory:doInlining: (in category 'translation') ----- translateInDirectory: directory doInlining: inlineFlag "As a hack to allow ThreadedFFIPlugin to generate a skeletal SqueakFFIPrims.c that simply includes the fleshed-out SqueakIA32FFIPrims.c, SqueakARMFFIPrims.c et al, intercept for ThreadedFFIPlugin and output generateCodeStringForPrimitives." | ffiPluginRootClass | ffiPluginRootClass := thisContext method methodClass soleInstance. ^self == ffiPluginRootClass ifTrue: [self storeString: self generateCodeStringForPrimitives onFileNamed: (directory fullNameFor: self moduleName, '.c'). #()] ifFalse: [super + translateInDirectory: (directory containingDirectory directoryNamed: ffiPluginRootClass moduleName) assureExistence - translateInDirectory: (directory containingDirectory directoryNamed: ffiPluginRootClass moduleName) doInlining: inlineFlag]!

1 0

Note to all vm build tree developers--'make reallyclean' is very bad mojo.
by gettimothy 30 May '14

30 May '14

Aaaand...Poof! its gone! just sayin. For a quick update, I am flattening the build.linux32x86/squeak.stack.v3/ directory. I should have it done in the a.m. after I start over. (: cheers. tty.

1 0

Second iteration of build directory flattening now viewable here:
by gettimothy 29 May '14

29 May '14

http://www.svn.menmachinesmaterials.com/Flat/ Bear in mind I shut down my computer at the end of the day and the url may not be valid. The existing top level cygwinbuild, macbuild, unixbuild where moved to the squeak.cog.v3/ folder for the respective platform. Next step is flattening the various unixbuilds to use one directory and 1 makefile. I think I will do this by first creating separate "mvm" files "mvm_assert" "mvm_debug" "mvm_foo" and getting those working. Feel free to jump in if I am messing things up. Cheers. tty

1 1

Remove pharo artifacts on port from Cog/cygwinbuild->Flat/build.win32x86/squeak.cog.v3 ?
by gettimothy 29 May '14

29 May '14

Hi Eliot. "Flat" is "Cog" for the purpose of this flattening project. I named it after my jokes. (: I am copying Cog/cygwinbuild to Flat/win32x86/squeak.cog.v3/ Currently thare are some pharo artifacts: Pharo.def.in Pharo.exe.manifest Pharo.ico Pharo.rc Since Pharo has their own build system, I think these should be removed from squeak stuff to avoid confusion. Your call. t

1 0

What VM do we file CroquetVM under? squeak.cog.v3? or squeak.stack.v3?
by gettimothy 29 May '14

29 May '14

Hi Eliot. I am looking at the Cog/cygwinbuild/HowToBuild and looking at the build.win32x86/squeak.VM.ImageFormat format to put it in, and reading the HowToBuild it refers to the CroquetVM. My guess this is a stack.v3 thing and Cog/cygwinbuild tree needs to go in Flat/build.win32x86/squeak.stack.v3 folder. Sound about right? thx. t

1 1

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Vm-dev May 2014