Vm-dev August 2010

vm-dev@lists.squeakfoundation.org

26 participants
51 discussions

About the image
by Nicolás Paez 19 Aug '10

19 Aug '10

Hi, I have just began to work at this low level and I have 2 questions: - What is the minimal object structure I should implement from VM perspective? - Where are defined the 3 formats of objects representation? Thanks, Nico. blog: nicopaez.wordpress.com

7 16

Cog crashing when installing Cryptography
by Casimiro de Almeida Barreto 17 Aug '10

17 Aug '10

Hello, When installing from Monticello everything go OK until "initializing..." & then a seg fault happens. OS: Fedora 13, libuuid-2.17.2-6.fc13.i686 & libuuid-devel-2.17.2-6.fc13.i686 [casimiro@localhost cog.work]$ /opt/cog/squeak squeak.image Segmentation fault Smalltalk stack dump: 0xbfcc1428 I UUID>initialize 2039877212: a(n) UUID 0xbfcc1440 M UUID class(Behavior)>new: 2009777744: a(n) UUID class 0xbfcc1464 I UUID class>new 2009777744: a(n) UUID class 0xbfcc1484 I SmalltalkImageInstanceID class>instanceID 2031947652: a(n) SmalltalkImageInstanceID class 0xbfcc14a4 I SmalltalkImageInstanceID class>startUp 2031947652: a(n) SmalltalkImageInstanceID class 0xbfcc14c4 I SmalltalkImageInstanceID class>initialize 2031947652: a(n) SmalltalkImageInstanceID class 0xbfcc14dc M MCMethodDefinition>postload 2031532728: a(n) MCMethodDefinition 0xbfcc14f4 M MCMethodDefinition(MCDefinition)>postloadOver: 2031532728: a(n) MCMethodDefinition 0xbfcc1510 M [] in MCPackageLoader>basicLoad 2031738704: a(n) MCPackageLoader 0xbfcc1548 M [] in OrderedCollection(Collection)>do:displayingProgress:every: 2031739124: a(n) OrderedCollection 0xbfcc1568 M OrderedCollection>do: 2031739124: a(n) OrderedCollection 0xbfcc1598 M [] in OrderedCollection(Collection)>do:displayingProgress:every: 2031739124: a(n) OrderedCollection 0xbfcc15bc M [] in ProgressInitiationException>defaultMorphicAction 2038412300: a(n) ProgressInitiationException 0xbfcc15d8 M BlockClosure>on:do: 2038413028: a(n) BlockClosure 0xbfcb7e3c M [] in ProgressInitiationException>defaultMorphicAction 2038412300: a(n) ProgressInitiationException 0xbfcb7e5c M BlockClosure>ensure: 2038412884: a(n) BlockClosure 0xbfcb7e80 M ProgressInitiationException>defaultMorphicAction 2038412300: a(n) ProgressInitiationException 0xbfcb7e98 M ProgressInitiationException>defaultAction 2038412300: a(n) ProgressInitiationException 0xbfcb7eb4 M UndefinedObject>handleSignal: 2004160516: a(n) UndefinedObject 0xbfcb7ed4 M MethodContext(ContextPart)>handleSignal: 2031738956: a(n) MethodContext 0xbfcb7ef4 M MethodContext(ContextPart)>handleSignal: 2031765780: a(n) MethodContext 0xbfcb7f10 M ProgressInitiationException(Exception)>signal 2038412300: a(n) ProgressInitiationException 0xbfcb7f28 M ProgressInitiationException>display:at:from:to:during: 2038412300: a(n) ProgressInitiationException 0xbfcb7f54 M ProgressInitiationException class>display:at:from:to:during: 2010792396: a(n) ProgressInitiationException class 0xbfcb7f80 M ByteString(String)>displayProgressAt:from:to:during: 2013083456: a(n) ByteString 0xbfcb7fb4 M OrderedCollection(Collection)>do:displayingProgress:every: 2031739124: a(n) OrderedCollection 0xbfcb7fd8 M OrderedCollection(Collection)>do:displayingProgress: 2031739124: a(n) OrderedCollection 0xbfcb7ffc M [] in MCPackageLoader>basicLoad 2031738704: a(n) MCPackageLoader 0xbfcb8018 M BlockClosure>on:do: 2031765648: a(n) BlockClosure 0xbfcb8044 I [] in MCPackageLoader>basicLoad 2031738704: a(n) MCPackageLoader 0xbfcb8064 M BlockClosure>ensure: 2031765512: a(n) BlockClosure 0xbfcb808c I MCPackageLoader>basicLoad 2031738704: a(n) MCPackageLoader 0xbfcb80ac I [] in MCPackageLoader>loadWithNameLike: 2031738704: a(n) MCPackageLoader 0xbfcb80d0 I [] in MCPackageLoader>useChangeSetNamed:during: 2031738704: a(n) MCPackageLoader 0xbfcb80f0 M BlockClosure>ensure: 2031765304: a(n) BlockClosure 0xbfcb8120 I MCPackageLoader>useChangeSetNamed:during: 2031738704: a(n) MCPackageLoader 0xbfcb8148 I MCPackageLoader>useNewChangeSetNamedLike:during: 2031738704: a(n) MCPackageLoader 0xbfcb8170 I MCPackageLoader>loadWithNameLike: 2031738704: a(n) MCPackageLoader 0xbfcb8198 I MCVersionLoader>load 2031738628: a(n) MCVersionLoader 0xbfcb81b8 I MCVersionLoader class>loadVersion: 2011151236: a(n) MCVersionLoader class 0xbfcb81dc I MCVersion>load 2031738172: a(n) MCVersion 0xbfcb81fc I [] in MCFileRepositoryInspector(MCVersionInspector)>load 2030878628: a(n) MCFileRepositoryInspector 0xbfcb821c M BlockClosure>ensure: 2031738492: a(n) BlockClosure 0xbfcb8244 I CursorWithMask(Cursor)>showWhile: 2007183192: a(n) CursorWithMask 0xbfcb8268 I MCFileRepositoryInspector(MCVersionInspector)>load 2030878628: a(n) MCFileRepositoryInspector 0xbfcb8280 M MCFileRepositoryInspector>load 2030878628: a(n) MCFileRepositoryInspector 0xbfcb82a0 I PluggableButtonMorphPlus(PluggableButtonMorph)>performAction 2030929912: a(n) PluggableButtonMorphPlus 0xbfcb82c0 I PluggableButtonMorphPlus>performAction 2030929912: a(n) PluggableButtonMorphPlus 0xbfcb82dc M [] in PluggableButtonMorphPlus(PluggableButtonMorph)>mouseUp: 2030929912: a(n) PluggableButtonMorphPlus 0xbfcb8300 M Array(SequenceableCollection)>do: 2031219412: a(n) Array 0xbfcb8324 I PluggableButtonMorphPlus(PluggableButtonMorph)>mouseUp: 2030929912: a(n) PluggableButtonMorphPlus 0xbfcb8348 I PluggableButtonMorphPlus>mouseUp: 2030929912: a(n) PluggableButtonMorphPlus 0xbfcb836c I PluggableButtonMorphPlus(Morph)>handleMouseUp: 2030929912: a(n) PluggableButtonMorphPlus 0xbfcb8388 M MouseButtonEvent>sentTo: 2031220332: a(n) MouseButtonEvent 0xbfcb83a4 M PluggableButtonMorphPlus(Morph)>handleEvent: 2030929912: a(n) PluggableButtonMorphPlus 0xbfcb83c0 M PluggableButtonMorphPlus(Morph)>handleFocusEvent: 2030929912: a(n) PluggableButtonMorphPlus 0xbfcb83e8 M [] in HandMorph>sendFocusEvent:to:clear: 2020519028: a(n) HandMorph 0xbfcb8404 M [] in PasteUpMorph>becomeActiveDuring: 2020518544: a(n) PasteUpMorph 0xbfcb8420 M BlockClosure>on:do: 2031220276: a(n) BlockClosure 0xbfcb844c M PasteUpMorph>becomeActiveDuring: 2020518544: a(n) PasteUpMorph 0xbfcb8470 M HandMorph>sendFocusEvent:to:clear: 2020519028: a(n) HandMorph 0xbfcb8498 M HandMorph>sendEvent:focus:clear: 2020519028: a(n) HandMorph 0xbfcb84bc M HandMorph>sendMouseEvent: 2020519028: a(n) HandMorph 0xbfcb84e0 M HandMorph>handleEvent: 2020519028: a(n) HandMorph 0xbfcb850c M HandMorph>processEvents 2020519028: a(n) HandMorph 0xbfcb8528 M [] in WorldState>doOneCycleNowFor: 2020518768: a(n) WorldState 0xbfcb854c M Array(SequenceableCollection)>do: 2020519140: a(n) Array 0xbfcb8568 M WorldState>handsDo: 2020518768: a(n) WorldState 0xbfcb8588 M WorldState>doOneCycleNowFor: 2020518768: a(n) WorldState 0xbfcb85a4 M WorldState>doOneCycleFor: 2020518768: a(n) WorldState 0xbfcb85c0 M PasteUpMorph>doOneCycle 2020518544: a(n) PasteUpMorph 0xbfcb85e0 I [] in Project class>spawnNewProcess 2014823304: a(n) Project class 2021953880 s [] in BlockClosure>newProcess Most recent primitives @ @ basicNew @ @ @ @ perform:with: @ @ perform:with: @ basicNew @ basicNew basicNew basicAt: basicAt: bitShiftMagnitude: basicAt: bitOr: digitCompare: bitShiftMagnitude: perform:with: basicNew perform:with: fractionPart truncated perform:with: @ @ @ @ @ @ basicNew @ @ basicNew @ @ @ basicNew perform:with: truncated @ @ @ @ @ basicNew @ @ basicNew @ @ basicNew @ @ basicNew @ @ @ perform:with: @ perform:with: @ @ perform:with: @ basicNew @ basicNew basicNew basicNew perform:with: basicNew perform:with: basicNew basicNew basicNew basicNew basicNew basicNew perform:with: basicNew basicNew basicNew perform:with: fractionPart truncated @ @ perform:with: @ @ perform:with: @ basicNew @ shallowCopy new species species @ @ @ @ @ basicNew new: at:put: @ @ basicNew @ @ new: at:put: at:put: at:put: at:put: species new: @ at:put: @ at:put: @ at:put: @ at:put: @ @ @ @ @ @ basicNew @ perform:with: @ @ perform:with: @ basicNew @ basicNew @ perform:with: @ @ perform:with: @ @ @ perform:with: @ @ perform:with: @ basicNew @ @ perform:with: @ @ perform:with: @ basicNew @ shallowCopy basicNew basicNew basicNew perform:with: basicNew perform:with: basicNew basicNew basicNew basicNew basicNew basicNew perform:with: basicNew basicNew basicNew @ @ @ @ @ @ basicNew @ @ basicNew @ @ @ basicNew perform:with: truncated @ @ @ @ @ basicNew @ @ basicNew @ @ basicNew @ @ basicNew @ @ @ basicNew basicNew basicNew perform:with: basicNew perform:with: basicNew basicNew basicNew @ @ @ @ @ @ basicNew @ @ basicNew @ @ @ basicNew perform:with: truncated @ @ @ @ @ signal basicNew: primMakeUUID Abortado (imagem do núcleo gravada)

3 5

Switching an active context in Cog
by Igor Stasenko 16 Aug '10

16 Aug '10

Hello, i want to adopt an image-side scheduling for Cog and since everything which sounds like 'Process' will be wiped out from VM, i need a way to cleanly switch the active context to a new one. I think that as a guide for implementation could be taken CoInterpreter>>transferTo: newProc from: sourceCode but i am a bit confused by following: self push: instructionPointer. ...(switching code)... instructionPointer := self popStack. does that means, that instruction pointer is always stored in last stack position instead of some fixed slot of context? -- Best regards, Igor Stasenko AKA sig.

2 3

Re: [squeak-dev] Inlining native code in Cog
by Eliot Miranda 16 Aug '10

16 Aug '10

(redirecting to vm-dev) On Mon, Aug 16, 2010 at 1:18 AM, Igor Stasenko <siguctua(a)gmail.com> wrote: > Hello, Eliot. > > I just started exploring the Cog, and here's my first idea: > - with NativeBoost, i can actually generate the native code, which can > be inlined into other methods. > > So, then, whenever Cog sees, that primitive is NativeBoost primitive > and it going to invoke > a native code, then its possible to inline this method into outer > method by copying a native code into > generated method's code. > Right, sounds good. > > I remember you mentioned that primitive invocation in Cog is rather > ineffective , because > you have to do some deoptimizations before entering a primitive. > No, that's not the issue. In Cog there are two kinds of primitives, generated primitives and C primitives. Cog generates the code for generated primitives and these are fast; their code is inlined in the start of the method immediately following the unchecked entry-point and preceeding frame build. See Cogit>>compilePrimitive and Cogit>>primitiveGeneratorOrNil. C primitives are the conventional primitives that the interpreter can call, i.e. the contents of the PrimitiveTable plus all the named primitives. The issue is that these C primitives must be called on the C stack since Cog has no way of knowing how much stack a C primitive uses and Cog stack pages are fixed size. So the JIT must generate a stack switching call to invoke C primitives from machine code. This call is very like a system call and it is certainly slower than a normal C call and hence slower than invoking a C primitive from within the interpreter. See SimpleStackBasedCogit>>compileInterpreterPrimitive:. I wonder if its possible to do such things. > The problem, what i see is that NativeBoost's native code works as a > primitive (its using interpreterProxy > and its functions, and generated code honoring all VM/primitive > conventions), so if primitive fails, it should > enter the method's bytecode. > I think you'll need to generate two forms of the machine code, one that is used as NativeBoost works now, and one that is designed to be inlined into a Cog native method. You may also also want to include metadata so that the JIT can add metadata for embedded object references and relocateable calls (since Cog moves native methods) to the NB code it inlines into a native method. See Cogit's method map protocol, and Cogit>>relocateMethodsPreCompaction & Cogit>>relocateCallsAndSelfReferencesInMethod:. This maybe a major barrier, which could make a native code inlining > highly problematic. > > What you think about it? > I think it should work well if different versions are created for the interpreter and the Cogit. The issues are to do with knowing what are the conventions the Cogit requires and those that C requires. It strikes me that you may be able to use one single piece of machine code and just add metadata. The machine code looks like: A NativeBoost primitive: C frame building code start of common code: code that actually implements the primitive start of exit code C frame tear-down and return code start of primitive failure code: call interpreterProxy->primitiveFail/primitiveFailFor jump to start of exit code and add metadata for Cog that specifies where "start of common code" & "start of exit code" is, where in the common code any object references or relocateable call references are, (and perhaps where any jumps to "start of primitive failure code" are). When the Cogit compiles a method containing this NB primitive it inlines from "start of common code" up to (but not including) "start of exit code" and plants a jump over its generated primitive failure code. Make sense? best Eliot > -- > Best regards, > Igor Stasenko AKA sig. > >

2 1

Cog: invalid nanosleep argument (i.e. socket errors)
by Henrik Johansen 16 Aug '10

16 Aug '10

I think I figured out why Cog some times terminates when downloading large files on OSX; An oversleep which is interrupted can be returned as a t_time struct with tv_sec -1 and tv_nsec close to 999999999. The while check is nanosleep (&naptime, &naptime) == -1 && naptime.tv_sec > 0 1|| naptime.tv_nsec > MINSLEEPNS or so, so when an interrupt is encountered which has tv_sec = -1, you will get the invalid argument error. rewriting it to naptime.tvsec > -1 && naptime.tv_nsec > MINSLEEPNS && nanosleep(&naptime, &naptime) == -1 I no longer had crashes in 99% of hte cases when evaluating the following test: HTTPSocket httpGetDocument: 'http://www.squeaksource.com/Pharo/Morphic-stephane_ducasse.334.mcz'. I've attached the sqUnixHeartbeat.c. Cheers, Henry

4 5

walk-backs on the Seaside
by Vaidotas Didžbalis 16 Aug '10

16 Aug '10

Hello, To see the bug do filein, go to: http://localhost:9090/ask and then do fast clicking on the button. You shall receive walk-back attached. I am using http://squeakvm.org/win32/experimental/CogSqueak4.1.zip http://ftp.squeak.org/various_images/seaside/Squeak4.1/Seaside3.0.zip with all trunk updates. Vaidotas

1 0

Cog build success on win32/mingw
by Igor Stasenko 16 Aug '10

16 Aug '10

Hello, just want to note, that i just built Cog VM on win32/mingw from a first try! Good job, Eliot! Btw, building is much faster than Squeak VM. $ gcc -v Reading specs from g:/sig/mingw/bin/../lib/gcc/mingw32/3.4.2/specs Configured with: ../gcc/configure --with-gcc --with-gnu-ld --with-gnu-as --host=mingw32 --target=mingw32 --prefix=/mingw --enable-threads --disable-nls --enable-languages=c,c++,f77,ada,objc,java --disable-win32-registry --disable-shared --enable-sjlj-exceptions --enable-libgcj --disable-java-awt --without-x --enable-java-gc=boehm --disable-libgcj-debug --enable-interpreter --enable-hash-synchronization --enable-libstdcxx-debug Thread model: win32 gcc version 3.4.2 (mingw-special) -- Best regards, Igor Stasenko AKA sig.

1 0

VM Maker: VMMaker-dtl.185.mcz
by squeak-dev-noreply＠lists.squeakfoundation.org 14 Aug '10

14 Aug '10

Dave Lewis uploaded a new version of VMMaker to project VM Maker: http://www.squeaksource.com/VMMaker/VMMaker-dtl.185.mcz ==================== Summary ==================== Name: VMMaker-dtl.185 Author: dtl Time: 14 August 2010, 3:20:37 am UUID: 4efbd2df-4b90-4188-a850-fc577fb91910 Ancestors: VMMaker-John M McIntosh.184 VMMaker 4.2.7 Fix comment for #primitiveUtcWithOffset. Declare #extraHeaderBytes: external to permit access from external plugins.

1 0

getVMParameters broken
by Adrian Lienhard 14 Aug '10

14 Aug '10

Hi, In recent VMs (Mac and Unix), SmalltalkImage current vmStatisticsReportString is broken, in that it returns nonsense data for GC times: ... GCs 1,145,798 (84ms between GCs) full 3914 totalling 723,736,998ms (755.3% uptime), avg 184909.8ms incr 1141884 totalling 248,056,609ms (258.9% uptime), avg 217.2ms tenures 14,222 (avg 80 GCs/tenure) Since last view 72 (49ms between GCs) uptime 3.5s full 0 totalling 0ms (0.0% uptime) incr 72 totalling 15,110ms (426.1% uptime), avg 209.9ms tenures 0 primitiveVMParameter in the most recent version of VMMaker package was changed. Does the image-side code need to be adapted or is this a bug in the primitive? Thanks, Adrian ___________________ http://www.adrian-lienhard.ch/

5 6

[commit] r2253 - Integrate Henrik Johansen's fix for the nanosleep call in the heartbeat.
by commits＠squeakvm.org 14 Aug '10

14 Aug '10

Author: eliot Date: 2010-08-13 14:14:21 -0700 (Fri, 13 Aug 2010) New Revision: 2253 Modified: branches/Cog/platforms/unix/vm/sqUnixHeartbeat.c Log: Integrate Henrik Johansen's fix for the nanosleep call in the heartbeat. Modified: branches/Cog/platforms/unix/vm/sqUnixHeartbeat.c =================================================================== --- branches/Cog/platforms/unix/vm/sqUnixHeartbeat.c 2010-08-11 18:03:02 UTC (rev 2252) +++ branches/Cog/platforms/unix/vm/sqUnixHeartbeat.c 2010-08-13 21:14:21 UTC (rev 2253) @@ -607,6 +607,8 @@ struct timespec naptime = beatperiod; while (nanosleep(&naptime, &naptime) == -1 + /* oversleeps can return tv_sec = -1 tv_nsec approx 999999999 */ + && naptime.tv_sec >= 0 /* avoid undoc'ed oversleep behaviour */ && (naptime.tv_sec > 0 || naptime.tv_nsec > MINSLEEPNS)) /*repeat*/ if (errno != EINTR) { perror("nanosleep");

3 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Vm-dev August 2010