[squeak-dev] Can I create a 75 Gb Image? (about those post-build stats)gettimothy gettimothy at zoho.comWed Oct 20 20:19:55 UTC 2021
First, thanks to all for the advice.
I parsed 1 Million elements, if you need more, let me know.
It takes about 11 hours to parse 20 million elements (out of 300million+).
For Eliot, here are the VM stats pre and post run:
pre:
uptime 1m 47s (runtime 0m 28s, idletime 1m 18s)
memory 183,500,800 bytes
old 174,548,768 bytes (95.1%)
young 7,190,528 bytes (3.9%)
used 141,216,264 bytes (77%)
free 36,618,336 bytes (20%)
GCs 75 (1429.6 ms between GCs 379.4 ms runtime between GCs)
full 2 totalling 166 ms (0.58% runtime), avg 83 ms
marking 93 ms (56%) avg 46.5 ms,
compacting 73 ms (44%) avg 36.5 ms
scavenges 73 totalling 18 ms (0.06% runtime), avg 0.2 ms
tenures 17,175 (avg 235 tenures per scavenge)
Code compactions
7 totalling 7 ms (0.025% runtime), avg 1 ms
post:
uptime 2h 13m 56s (runtime 1h 27m 35s, idletime 46m 21s)
memory 200,278,016 bytes
old 191,325,984 bytes (95.5%)
young 7,190,528 bytes (3.6%)
used 168,101,832 bytes (83.9%)
free 26,376,560 bytes (13.2%)
GCs 51,213 (156.9 ms between GCs 102.6 ms runtime between GCs)
full 64 totalling 5,280 ms (0.1% runtime), avg 82.5 ms
marking 3,056 ms (57.9%) avg 47.8 ms,
compacting 2,224 ms (42.1%) avg 34.8 ms
scavenges 51,149 totalling 7,078 ms (0.13% runtime), avg 0.1 ms
tenures 51,863 (avg 1 tenures per scavenge)
Code compactions
70 totalling 67 ms (0.001% runtime), avg 1 ms
Since last view 51,138 (155 ms between GCs, 102 ms runtime between GCs)
uptime 7929.3 s, runtime 5227 s, idletime 2702.3 s
full 62 totalling 5,114 ms (0.1% runtime), avg 82.5 ms
scavenge 51,076 totalling 7,060 ms (0.1% runtime), avg 0.1 ms
tenures 34,688 (avg 0 tenures per scavenge)
code compactions 63 totalling 60 ms (0.001% runtime), avg 1 ms
Again, let me know If I you need moar stats.
Levente: Regarding #timeProfile is my friend.
I am not sure how to read this, but it may be that "peek" is the hog here.
- 2377155 tallies, 2405632 msec.
**Tree**
--------------------------------
Process: (40) 13800: nil
--------------------------------
99.6% {2395202ms} [] MorphicProject>>spawnNewProcess
99.6% {2395202ms} PasteUpMorph>>doOneCycle
99.6% {2395202ms} WorldState>>doOneCycleFor:
99.6% {2395202ms} WorldState>>doOneCycleNowFor:
99.6% {2395202ms} WorldState>>handsDo:
99.6% {2395202ms} Array(SequenceableCollection)>>do:
99.6% {2395202ms} [] WorldState>>doOneCycleNowFor:
99.6% {2395202ms} HandMorph>>becomeActiveDuring:
99.6% {2395202ms} ActiveHandVariable class>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveHandVariable class>>value:during:
99.6% {2395202ms} ActiveHandVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveHandVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} [[]] WorldState>>doOneCycleNowFor:
99.6% {2395202ms} HandMorph>>processEvents
99.6% {2395202ms} HandMorph>>handleEvent:
99.6% {2395202ms} HandMorph>>sendKeyboardEvent:
99.6% {2395202ms} HandMorph>>sendEvent:focus:clear:
99.6% {2395202ms} HandMorph>>sendFocusEvent:to:clear:
99.6% {2395202ms} PasteUpMorph>>becomeActiveDuring:
99.6% {2395202ms} ActiveWorldVariable class>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveWorldVariable class>>value:during:
99.6% {2395202ms} ActiveWorldVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveWorldVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} [] HandMorph>>sendFocusEvent:to:clear:
99.6% {2395202ms} HandMorph>>becomeActiveDuring:
99.6% {2395202ms} ActiveHandVariable class>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveHandVariable class>>value:during:
99.6% {2395202ms} ActiveHandVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveHandVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} [[]] HandMorph>>sendFocusEvent:to:clear:
99.6% {2395202ms} KeyboardEvent(MorphicEvent)>>becomeActiveDuring:
99.6% {2395202ms} ActiveEventVariable class>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveEventVariable class>>value:during:
99.6% {2395202ms} ActiveEventVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveEventVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} [[[]]] HandMorph>>sendFocusEvent:to:clear:
99.6% {2395202ms} TextMorphForEditView(Morph)>>processFocusEvent:
99.6% {2395202ms} TextMorphForEditView(Morph)>>processFocusEvent:using:
99.6% {2395202ms} MorphicEventDispatcher>>dispatchFocusEvent:with:
99.6% {2395202ms} MorphicEventDispatcher>>doHandlingForFocusEvent:with:
99.6% {2395202ms} TextMorphForEditView(Morph)>>handleFocusEvent:
99.6% {2395202ms} TextMorphForEditView(Morph)>>handleEvent:
99.6% {2395202ms} KeyboardEvent>>sentTo:
99.6% {2395202ms} TextMorphForEditView(TextMorph)>>handleKeystroke:
99.6% {2395202ms} TextMorphForEditView(Morph)>>handleKeystroke:
99.6% {2395202ms} TextMorphForEditView>>keyStroke:
99.6% {2395202ms} TextMorphForEditView(TextMorph)>>keyStroke:
99.6% {2395202ms} ToolSet class>>codeCompletionAround:textMorph:keyStroke:
99.6% {2395202ms} ECToolSet class>>codeCompletionAround:textMorph:keyStroke:
99.6% {2395202ms} [] TextMorphForEditView(TextMorph)>>keyStroke:
99.6% {2395202ms} TextMorphForEditView>>handleInteraction:fromEvent:
99.6% {2395202ms} TextMorphForEditView(TextMorph)>>handleInteraction:fromEvent:
99.6% {2395202ms} [[]] TextMorphForEditView(TextMorph)>>keyStroke:
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>keyStroke:
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>dispatchOnKeyboardEvent:
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>doIt:
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>doIt
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>evaluateSelection
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>evaluateSelectionAndDo:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>on:do:
99.6% {2395202ms} [] SmalltalkEditor(TextEditor)>>evaluateSelectionAndDo:
99.6% {2395202ms} Compiler>>evaluate:in:to:environment:notifying:ifFail:logged:
99.6% {2395202ms} Compiler>>evaluateCue:ifFail:logged:
99.6% {2395202ms} Compiler>>evaluateCue:ifFail:
99.6% {2395202ms} UndefinedObject>>DoIt
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>timeProfile
99.6% {2395202ms} TimeProfileBrowser class>>onBlock:
99.6% {2395202ms} TimeProfileBrowser>>runBlock:
99.6% {2395202ms} TimeProfileBrowser>>runBlock:pollingEvery:
99.6% {2395202ms} MessageTally>>spyEvery:on:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] UndefinedObject>>DoIt
99.6% {2395202ms} DocDemoSaxHandler(SAXHandler)>>parseDocument
99.6% {2395202ms} XMLParser>>parseDocument
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>on:do:
99.6% {2395202ms} [] XMLParser>>parseDocument
99.6% {2394956ms} XMLWellFormedParserTokenizer(XMLParserTokenizer)>>nextToken
99.6% {2394892ms} XMLContentState>>nextTokenFrom:
99.5% {2392436ms} XMLWellFormedParserTokenizer(XMLParserTokenizer)>>nextContentToken
98.2% {2363012ms} XMLWellFormedParserTokenizer>>nextPCDataToken
|67.6% {1626652ms} XMLNestedStreamReader>>peek
| |67.6% {1626281ms} FSReadStream>>next
| | 66.4% {1597152ms} primitives
| | 1.2% {28325ms} UTF8TextConverter>>nextFromStream:
|26.5% {637549ms} XMLNestedStreamReader>>next
|3.6% {87248ms} XMLWellFormedParserTokenizer>>nextGeneralEntityOrCharacterReferenceOnCharacterStream
| 3.0% {72138ms} XMLWellFormedParserTokenizer>>nextGeneralEntityReferenceOnCharacterStream
| 2.5% {59508ms} XMLWellFormedParserTokenizer>>nextEntityName
| 1.8% {42464ms} XMLNestedStreamReader>>peek
| 1.8% {42307ms} FSReadStream>>next
| 1.7% {41744ms} primitives
1.1% {27156ms} XMLWellFormedParserTokenizer>>nextContentMarkupToken
**Leaves**
69.6% {1674285ms} FSReadStream>>next
26.5% {637941ms} XMLNestedStreamReader>>next
**Memory**
old +0 bytes
young -4,101,240 bytes
used -4,101,240 bytes
free +4,101,240 bytes
**GCs**
full 29 totalling 2,391 ms (0.1% uptime), avg 82.4 ms
incr 24985 totalling 2,810 ms (0.1% uptime), avg 0.1 ms
tenures 3,015 (avg 8 GCs/tenure)
root table 0 overflows
- 2377155 tallies, 2405632 msec.
**Tree**
--------------------------------
Process: (40) 13800: nil
--------------------------------
99.6% {2395202ms} [] MorphicProject>>spawnNewProcess
99.6% {2395202ms} PasteUpMorph>>doOneCycle
99.6% {2395202ms} WorldState>>doOneCycleFor:
99.6% {2395202ms} WorldState>>doOneCycleNowFor:
99.6% {2395202ms} WorldState>>handsDo:
99.6% {2395202ms} Array(SequenceableCollection)>>do:
99.6% {2395202ms} [] WorldState>>doOneCycleNowFor:
99.6% {2395202ms} HandMorph>>becomeActiveDuring:
99.6% {2395202ms} ActiveHandVariable class>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveHandVariable class>>value:during:
99.6% {2395202ms} ActiveHandVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveHandVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} [[]] WorldState>>doOneCycleNowFor:
99.6% {2395202ms} HandMorph>>processEvents
99.6% {2395202ms} HandMorph>>handleEvent:
99.6% {2395202ms} HandMorph>>sendKeyboardEvent:
99.6% {2395202ms} HandMorph>>sendEvent:focus:clear:
99.6% {2395202ms} HandMorph>>sendFocusEvent:to:clear:
99.6% {2395202ms} PasteUpMorph>>becomeActiveDuring:
99.6% {2395202ms} ActiveWorldVariable class>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveWorldVariable class>>value:during:
99.6% {2395202ms} ActiveWorldVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveWorldVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} [] HandMorph>>sendFocusEvent:to:clear:
99.6% {2395202ms} HandMorph>>becomeActiveDuring:
99.6% {2395202ms} ActiveHandVariable class>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveHandVariable class>>value:during:
99.6% {2395202ms} ActiveHandVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveHandVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} [[]] HandMorph>>sendFocusEvent:to:clear:
99.6% {2395202ms} KeyboardEvent(MorphicEvent)>>becomeActiveDuring:
99.6% {2395202ms} ActiveEventVariable class>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveEventVariable class>>value:during:
99.6% {2395202ms} ActiveEventVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] ActiveEventVariable class(DynamicVariable class)>>value:during:
99.6% {2395202ms} [[[]]] HandMorph>>sendFocusEvent:to:clear:
99.6% {2395202ms} TextMorphForEditView(Morph)>>processFocusEvent:
99.6% {2395202ms} TextMorphForEditView(Morph)>>processFocusEvent:using:
99.6% {2395202ms} MorphicEventDispatcher>>dispatchFocusEvent:with:
99.6% {2395202ms} MorphicEventDispatcher>>doHandlingForFocusEvent:with:
99.6% {2395202ms} TextMorphForEditView(Morph)>>handleFocusEvent:
99.6% {2395202ms} TextMorphForEditView(Morph)>>handleEvent:
99.6% {2395202ms} KeyboardEvent>>sentTo:
99.6% {2395202ms} TextMorphForEditView(TextMorph)>>handleKeystroke:
99.6% {2395202ms} TextMorphForEditView(Morph)>>handleKeystroke:
99.6% {2395202ms} TextMorphForEditView>>keyStroke:
99.6% {2395202ms} TextMorphForEditView(TextMorph)>>keyStroke:
99.6% {2395202ms} ToolSet class>>codeCompletionAround:textMorph:keyStroke:
99.6% {2395202ms} ECToolSet class>>codeCompletionAround:textMorph:keyStroke:
99.6% {2395202ms} [] TextMorphForEditView(TextMorph)>>keyStroke:
99.6% {2395202ms} TextMorphForEditView>>handleInteraction:fromEvent:
99.6% {2395202ms} TextMorphForEditView(TextMorph)>>handleInteraction:fromEvent:
99.6% {2395202ms} [[]] TextMorphForEditView(TextMorph)>>keyStroke:
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>keyStroke:
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>dispatchOnKeyboardEvent:
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>doIt:
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>doIt
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>evaluateSelection
99.6% {2395202ms} SmalltalkEditor(TextEditor)>>evaluateSelectionAndDo:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>on:do:
99.6% {2395202ms} [] SmalltalkEditor(TextEditor)>>evaluateSelectionAndDo:
99.6% {2395202ms} Compiler>>evaluate:in:to:environment:notifying:ifFail:logged:
99.6% {2395202ms} Compiler>>evaluateCue:ifFail:logged:
99.6% {2395202ms} Compiler>>evaluateCue:ifFail:
99.6% {2395202ms} UndefinedObject>>DoIt
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>timeProfile
99.6% {2395202ms} TimeProfileBrowser class>>onBlock:
99.6% {2395202ms} TimeProfileBrowser>>runBlock:
99.6% {2395202ms} TimeProfileBrowser>>runBlock:pollingEvery:
99.6% {2395202ms} MessageTally>>spyEvery:on:
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>ensure:
99.6% {2395202ms} [] UndefinedObject>>DoIt
99.6% {2395202ms} DocDemoSaxHandler(SAXHandler)>>parseDocument
99.6% {2395202ms} XMLParser>>parseDocument
99.6% {2395202ms} FullBlockClosure(BlockClosure)>>on:do:
99.6% {2395202ms} [] XMLParser>>parseDocument
99.6% {2394956ms} XMLWellFormedParserTokenizer(XMLParserTokenizer)>>nextToken
99.6% {2394892ms} XMLContentState>>nextTokenFrom:
99.5% {2392436ms} XMLWellFormedParserTokenizer(XMLParserTokenizer)>>nextContentToken
98.2% {2363012ms} XMLWellFormedParserTokenizer>>nextPCDataToken
|67.6% {1626652ms} XMLNestedStreamReader>>peek
| |67.6% {1626281ms} FSReadStream>>next
| | 66.4% {1597152ms} primitives
| | 1.2% {28325ms} UTF8TextConverter>>nextFromStream:
|26.5% {637549ms} XMLNestedStreamReader>>next
|3.6% {87248ms} XMLWellFormedParserTokenizer>>nextGeneralEntityOrCharacterReferenceOnCharacterStream
| 3.0% {72138ms} XMLWellFormedParserTokenizer>>nextGeneralEntityReferenceOnCharacterStream
| 2.5% {59508ms} XMLWellFormedParserTokenizer>>nextEntityName
| 1.8% {42464ms} XMLNestedStreamReader>>peek
| 1.8% {42307ms} FSReadStream>>next
| 1.7% {41744ms} primitives
1.1% {27156ms} XMLWellFormedParserTokenizer>>nextContentMarkupToken
**Leaves**
69.6% {1674285ms} FSReadStream>>next
26.5% {637941ms} XMLNestedStreamReader>>next
**Memory**
old +0 bytes
young -4,101,240 bytes
used -4,101,240 bytes
free +4,101,240 bytes
**GCs**
full 29 totalling 2,391 ms (0.1% uptime), avg 82.4 ms
incr 24985 totalling 2,810 ms (0.1% uptime), avg 0.1 ms
tenures 3,015 (avg 8 GCs/tenure)
root table 0 overflows
Time Profile
Thank you all for your time and for the new stuff learned!
t
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squeakfoundation.org/pipermail/squeak-dev/attachments/20211020/2ad2474f/attachment-0001.html>
More information about the Squeak-dev mailing list |