Magma August 2007

magma@lists.squeakfoundation.org

10 participants
19 discussions

bug in MaAtomicFileStream?
by Igor Stasenko 10 Aug '07

10 Aug '07

Just loaded magma r40Beta2 in fresh 3.10.7137 image. then did: MagmaRepositoryController create: 'magma' root: nil (magma dir was empty , so it starts creating new DB) then at some moment it warns about 'outage' of system resources, i pressing continue.. and few seconds later got error 'primitive failed' , because of StandardFileStream tried to read from closed file. I put assert in: MaAtomicFileStream>>renewAccess: aPhysicalStream pool renewAccess: aPhysicalStream. self assert: aPhysicalStream closed not restarted it, and yes, assertion failed. Seems a bit strange , how stream appeared in 'openStreams' ivar is closed. -- Best regards, Igor Stasenko AKA sig.

2 4

unique objects
by Dan Corneanu 10 Aug '07

10 Aug '07

Hi, I have to maintain a collection of ULUser(s). How can I make sure that I can't register two users with the same #login (instance attribute)? Is MagmaSet the solution to the problem? Best regards, cdan.

3 5

Fwd: magma handle memory
by Burella Juan M. 07 Aug '07

07 Aug '07

Hi Chris, Thanks for your answer. I've attached a monticello package with the tests, open a Transcript window and see class comments for instructions of how to run them. This is the Transcript output for 50 "trees" with 5 of depth: Creating magma repository Opening magma session Image size before creating magma collection: 69851252 Creating magma collection at MagmaMemoryTest --Iteration: 1..5: Image size BEFORE creating test object: 69851252 Creating test objects... Image size AFTER creating test object: 69851252 Saving 5 next objects from collection to magma collection... Image size BEFORE Magma cleaning: 85098444 Image size AFTER Magma cleaning: 82623944 --Iteration: 6..10: Image size BEFORE creating test object: 82623944 Creating test objects... Image size AFTER creating test object: 82623944 Saving 5 next objects from collection to magma collection... Image size BEFORE Magma cleaning: 106407888 Image size AFTER Magma cleaning: 83066628 --Iteration: 11..15: Image size BEFORE creating test object: 83066628 Creating test objects... Image size AFTER creating test object: 83066628 Saving 5 next objects from collection to magma collection... Image size BEFORE Magma cleaning: 108570520 Image size AFTER Magma cleaning: 85184212 --Iteration: 16..20: Image size BEFORE creating test object: 85184212 Creating test objects... Image size AFTER creating test object: 85184212 Saving 5 next objects from collection to magma collection... Image size BEFORE Magma cleaning: 108627824 Image size AFTER Magma cleaning: 85212848 --Iteration: 21..25: Image size BEFORE creating test object: 85212848 Creating test objects... Image size AFTER creating test object: 85212848 Saving 5 next objects from collection to magma collection... Image size BEFORE Magma cleaning: 108615528 Image size AFTER Magma cleaning: 85216916 --Iteration: 26..30: Image size BEFORE creating test object: 85216916 Creating test objects... Image size AFTER creating test object: 85216916 Saving 5 next objects from collection to magma collection... Image size BEFORE Magma cleaning: 108787536 Image size AFTER Magma cleaning: 85257868 --Iteration: 31..35: Image size BEFORE creating test object: 85257868 Creating test objects... Image size AFTER creating test object: 85257868 Saving 5 next objects from collection to magma collection... Image size BEFORE Magma cleaning: 108857164 Image size AFTER Magma cleaning: 85307012 --Iteration: 36..40: Image size BEFORE creating test object: 85307012 Creating test objects... Image size AFTER creating test object: 85307012 Saving 5 next objects from collection to magma collection... Image size BEFORE Magma cleaning: 108623676 Image size AFTER Magma cleaning: 85257812 --Iteration: 41..45: Image size BEFORE creating test object: 85257812 Creating test objects... Image size AFTER creating test object: 85257812 Saving 5 next objects from collection to magma collection... Image size BEFORE Magma cleaning: 108390116 Image size AFTER Magma cleaning: 85159312 --Iteration: 46..50: Image size BEFORE creating test object: 85159312 Creating test objects... Image size AFTER creating test object: 85159312 Saving 5 next objects from collection to magma collection... Image size BEFORE Magma cleaning: 108594588 Image size AFTER Magma cleaning: 85183668 On 8/7/07, Chris Muller <asqueaker(a)gmail.com> wrote: > > HI Juan, > > I really need to add a "How to do a Bulk Load" page to the documentation, > sorry. > > In the meantime, you weren't clear what you were adding the 19K trees > of objects *TO*. My guess is you are adding to a Smalltlak > collection; a Dictionary or OrderedCollection perhaps? It's good you > are doing the stubbing and finalizieOids, but they won't help much if > the root collection is a Smalltalk collection because the entire > persistent graph is in memory then (except for the stubbed, maybe). > > You need to add them to a MagmaCollection instead, so that transparent > paging of objects in and out of memory can occur. > > To verify what kinds of persistents you have in memory, check out your > #cachedObjectCountByClass. You should have no more than one 19K tree > worth of objects given that you are doing a garbageCollect after each > one. > > If you would share the skeleton of your load script it also might shed > some light. > > Thanks, > Chris > > > On 8/6/07, Burella Juan M. <juan.burella(a)gmail.com> wrote: > > I need to do a massive migration to Magma. My approach is currently like > > > this: I'm loading the data from external files, then build a complex > object > > and commit it to a magma repository, and over again until the file ends. > > > > While doing this, my image was growing at very high rates, approx. 200Mb > and > > taking several days, between 5 or 6. So, to see what's happening, I've > done > > some tests with toy objects, each one of them has 5 iVars. and each one > has > > another 5 iVars. This generates a tree of 19.556 objects > > (5^0+5^1+5^2+5^3+5^4+5^5). Then I started to adding 50 of these "tree" > (or > > smock?) objects, by groups of 5. I tried to maintain the complexity of > these > > objects by adding "random" variable sized strings to the leafs and other > > > miscellaneous objets. > > When this 50 are finalized, I've done: > > > > self magmaSession stubOut: aCollection. "aCollection has 50 smock > objects" > > aCollection := nil. > > Smalltalk garbageCollect. > > self magmaSession finalizeOids. > > > > But still the image is increasing its size. At beggining of the test the > > image size (as reported from #vmParameterAt: 3) was approx. 60Mb and at > the > > end was approx. 89MB. > > > > Any suggestions for reducing the growing of the image size? > > > > Thanks in advance. > > Juan Matias. > > > > _______________________________________________ > > Magma mailing list > > Magma(a)lists.squeakfoundation.org > > http://lists.squeakfoundation.org/mailman/listinfo/magma > > > > >

1 0

Loading problem
by Keith Hodges 07 Aug '07

07 Aug '07

In loading beta2, I get: UndefinedObject(Object)>>doesNotUnderstand: #critical: Receiver: nil Arguments and temporary variables: aMessage: critical: [] in MagmaRepositoryController>>close {[OpenControllers ...etc... Receiver's instance variables: nil MagmaRepositoryController class>>controllersGuard: Receiver: MagmaRepositoryController ---- Of course I suspect it would have helped to #cleanUp before loading the new version. However this code is closing open sessions on initialization (on load) and the close code may encounter the fact that ControllerGuard has yet to be initialized. see below: initialize OpenControllers ifNotNil: [ OpenControllers do: [ : each | each close ] ]. OpenControllers _ Set new. ControllersGuard _ Monitor new. Smalltalk addToStartUpList: self ; addToShutDownList: self cheers keith

2 1

MagmaBufferController?
by Joseph Blatter 07 Aug '07

07 Aug '07

Hi. I'm trying to follow directions of this page http://wiki.squeak.org/squeak/5728 in order to use the repository browser, but I was unable to find the class MagmaBufferController in the Monticellos. It is deprecated? Anybody has used it? thanks --------------------------------- Ne gardez plus qu'une seule adresse mail ! Copiez vos mails vers Yahoo! Mail

3 2

magma handle memory
by Burella Juan M. 07 Aug '07

07 Aug '07

I need to do a massive migration to Magma. My approach is currently like this: I'm loading the data from external files, then build a complex object and commit it to a magma repository, and over again until the file ends. While doing this, my image was growing at very high rates, approx. 200Mb and taking several days, between 5 or 6. So, to see what's happening, I've done some tests with toy objects, each one of them has 5 iVars. and each one has another 5 iVars. This generates a tree of 19.556 objects (5^0+5^1+5^2+5^3+5^4+5^5). Then I started to adding 50 of these "tree" (or smock?) objects, by groups of 5. I tried to maintain the complexity of these objects by adding "random" variable sized strings to the leafs and other miscellaneous objets. When this 50 are finalized, I've done: self magmaSession stubOut: aCollection. "aCollection has 50 smock objects" aCollection := nil. Smalltalk garbageCollect. self magmaSession finalizeOids. But still the image is increasing its size. At beggining of the test the image size (as reported from #vmParameterAt: 3) was approx. 60Mb and at the end was approx. 89MB. Any suggestions for reducing the growing of the image size? Thanks in advance. Juan Matias.

2 1

garbage collect
by Dan Corneanu 07 Aug '07

07 Aug '07

Hi, does magma perform automatic garbage collection on the repository? or do I have to explicitelly use *MagmaCompressor*? Best regards, cdan.

2 1

searching context use case
by Joseph Blatter 06 Aug '07

06 Aug '07

In order to "find by keyword", I was looking for a way to scan or enumerate all classes in my image using Magma. I've seen MaSearchContext subclasses could serve to this purpose and so tried a little script, but obviously it didn't work. How I'm suppose to do something like this? (no results are returned): | aContext | aContext := MaCodeElementContext forClasses. aContext prepareForScan. aContext scanClasses. aContext resetResults. Cheers --------------------------------- Ne gardez plus qu'une seule adresse mail ! Copiez vos mails vers Yahoo! Mail

1 0

Release 40 is now in beta
by Chris Muller 03 Aug '07

03 Aug '07

Over the next few days I will be doing final testing on release 40. If anyone has *release 39* repositories, I would appreciate your opening (a backup of) them directly in the r40 beta to see how the automatic upgrade feature worked. There is a one-click-loadable Monticello configuration for release 40 on the MagmaTester project called "r40Beta1". This will essentially become the released version sometime next week. If any problems are found with it, now is the time to let me know. Thanks! Chris

2 3

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Magma August 2007