Magma August 2006

magma@lists.squeakfoundation.org

12 participants
31 discussions

deprecation of MaAsciiStringIndex
by Chris Muller 01 Sep '06

01 Sep '06

I'm about to post a minor update to Magma with a minor bug fix from Brent and an enhanced MaSearchStringIndex. MaSearchStringIndex will now allow the user to specify the range of indexed characters. Four convenience methods offer the most common ranges: #beAlpha "$A to $Z" #beAlhpaNumberic "$0 to $Z" #bePunctuated "$! to $Z" #beAscii "ascii 0 to 127" Using the more-restricted ranges (i.e., #beAlpha) relaxes the strictness the searches while permitting more #meaningfulCharacters for the same number of bits. This flexibility now renders MaAsciiStringIndex redundant, since you can now use a MaSearchStringIndex with #beAscii to accomplish the same thing. Therefore I would like to deprecate MaAsciiStringIndex. It will remain in the package for now, in case you have persistent instances of it, but please don't create new instances as I would like to remove it some day. Any questions or concerns, please speak. thanks..

3 6

Index woes
by goran＠krampe.se 29 Aug '06

29 Aug '06

Howdy! I have problems with indexing. I have an index type that looks like this: indexHashForIndexObject: aUniqueObject ^ aUniqueObject id maUint: self keySize at: 0 keySize ^ 128 More concretely - a Q2Case in Gjallar has a reference to a Q2WorkflowStage (the node in the workflow graph it is situated at). A Q2WorkflowStage has an id which is a UUID. The problem is that the index is not "working". :) Is there any principal problem with the above? The stage would never change its id btw. If we do: cases select: [:c | c stage == processes first workflow stages first] We get correctly: a Bag (1) Q2Case[4] (1) Q2Case[2] (1) Q2Case[1] (1) Q2Case[7] (1) Q2Case[5] (1) Q2Case[6] But if we do: (cases where: [:r | r read: #stage from: processes first workflow stages first to: processes first workflow stages first]) size ... we get 0 instead of those 6. The index was created using: cases addIndex: (MaUniqueObjectIndex attribute: #stage). And stage:/stage are just simple accessors. I also wonder how I can rebuild an index - remove and add it? Hmmm. Ok, I did that, and then testing the above *almost* worked - but Q2Case[1] is missing from the index! So I only get 5 hits. regards, Göran

1 0

Magma + seasidehosting
by Pablo Iaria 25 Aug '06

25 Aug '06

Hi all, I'm deploying a small seaside application that uses magma to store objects. I did it in win2k. When I try to create the repository I got an error because seasidehosting uses a modified version of the VM with some sort of issue in the SecurityPlugin that dont let me do that. (this part isn't related to Magma but I wrote it to put as in context ) So I tried to create the repository in my win2k and then upload it to the server. When I startup the application I got an error (I included the stack trace at the end of the message and attached the blank repository I'm trying to use). Does anybody knows what I'm doing wrong and why I couln'd use the repository created with win2k in linux? Thanks! Pablo.- I set WAMagmaConfiguration's Repository Location to '/service/edp/files/magma' (as seaside suggested). I'm using the Sq3.8f+seaside+magma image. MaUserError: fileStream required * MaUserError class(Exception class)>>signal: self MaUserError temps signalerText 'fileStream required' inst vars superclass MaError methodDict a MethodDictionary(#isUserError->a CompiledMethod (196) ) format 140 instanceVariables nil organization ('as yet unclassified' isUserError) subclasses #(MaClientServerUserError MagmaUserError MaHashIndexUserError MaObjectSerializationUserError MauiUse...etc... name #MaUserError classPool nil sharedPools nil environment a SystemDictionary(lots of globals) category nil * MaTransactionalFileStream class>>fileStream: self MaTransactionalFileStream temps aFileStream nil inst vars superclass MaObject methodDict a MethodDictionary(#bePhysical->a CompiledMethod (520) #binary->a CompiledMethod (680) #close->a Com...etc... format 142 instanceVariables #('filename' 'fileStream' 'guard' 'uncommittedSize' 'position' 'writers') organization ('accessing' bePhysical committedSize copyToDirectory: physicalStream writersDo:) ('filestream api' ...etc... subclasses nil name #MaTransactionalFileStream classPool nil sharedPools nil environment a SystemDictionary(lots of globals) category nil * MaObjectFiler>>openFile: self a MaObjectFiler temps unqualifiedName 'objects' answer nil inst vars directory UnixFileDirectory on '/service/edp/files/magma' file nil preMadeObjectBuffer a MaObjectBuffer oid : **invalid** classId : **invalid** objectInstSize : **invalid** filePositionIndex nil usedByteArrays #(a ByteArray(0) a ByteArray(0 0) a ByteArray(0 0 0) a ByteArray(0 0 0 0) a ByteArray(0 0 0 0 0) a B...etc... primitiveAttributeAddressesMap a Dictionary('anchorOid'->43->64 'booleanFlags'->10->8 'classDefinitionsOid'->27->64 'definitionOid'...etc... * MaObjectFiler>>openObjectsFile self a MaObjectFiler temps inst vars directory UnixFileDirectory on '/service/edp/files/magma' file nil preMadeObjectBuffer a MaObjectBuffer oid : **invalid** classId : **invalid** objectInstSize : **invalid** filePositionIndex nil usedByteArrays #(a ByteArray(0) a ByteArray(0 0) a ByteArray(0 0 0) a ByteArray(0 0 0 0) a ByteArray(0 0 0 0 0) a B...etc... primitiveAttributeAddressesMap a Dictionary('anchorOid'->43->64 'booleanFlags'->10->8 'classDefinitionsOid'->27->64 'definitionOid'...etc... * MaObjectFiler>>open self a MaObjectFiler temps inst vars directory UnixFileDirectory on '/service/edp/files/magma' file nil preMadeObjectBuffer a MaObjectBuffer oid : **invalid** classId : **invalid** objectInstSize : **invalid** filePositionIndex nil usedByteArrays #(a ByteArray(0) a ByteArray(0 0) a ByteArray(0 0 0) a ByteArray(0 0 0 0) a ByteArray(0 0 0 0 0) a B...etc... primitiveAttributeAddressesMap a Dictionary('anchorOid'->43->64 'booleanFlags'->10->8 'classDefinitionsOid'->27->64 'definitionOid'...etc... * MaObjectFiler class>>open: self MaObjectFiler temps aFileDirectory UnixFileDirectory on '/service/edp/files/magma' inst vars superclass MaObject methodDict a MethodDictionary(#anchorOid->a CompiledMethod (795) #anchorOid:->a CompiledMethod (2841) #appendOb...etc... format 142 instanceVariables #('directory' 'file' 'preMadeObjectBuffer' 'filePositionIndex' 'usedByteArrays' 'primitiveAttributeA...etc... organization ('accessing' anchorOid classDefinitionsOid dataFileName definitionOid directory filePointerForOid: f...etc... subclasses nil name #MaObjectFiler classPool nil sharedPools nil environment a SystemDictionary(lots of globals) category nil * MaObjectRepository>>open: self a MaObjectRepository temps aFileDirectory UnixFileDirectory on '/service/edp/files/magma' inst vars transactionLog a MaTransactionLog sessions a Dictionary() filer nil repositoryController a MagmaRepositoryController largeCollectionManagers a Dictionary() systemReadStrategy nil nextOid nil recoveryManager nil commitGuard a Semaphore() applyProcess nil * MaObjectRepository class>>open:controller: self MaObjectRepository temps aFileDirectory UnixFileDirectory on '/service/edp/files/magma' aMaRepositoryController a MagmaRepositoryController inst vars superclass MaObject methodDict a MethodDictionary(#abortTransactionFor:->a CompiledMethod (2026) #applyToCache:->a CompiledMethod (...etc... format 150 instanceVariables #('transactionLog' 'sessions' 'filer' 'repositoryController' 'largeCollectionManagers' 'systemReadSt...etc... organization ('client-requests' abortTransactionFor: numberOfEntriesFrom:to:inLargeCollection:on: readAnchorFor:u...etc... subclasses nil name #MaObjectRepository classPool a Dictionary(#RunningTestCases->false #SimulateOutage->false ) sharedPools nil environment a SystemDictionary(lots of globals) category nil * MagmaRepositoryController>>privateOpen: self a MagmaRepositoryController temps aFileDirectory UnixFileDirectory on '/service/edp/files/magma' inst vars repository a MaObjectRepository session a MagmaSession serverSerializer a MaObjectSerializer requestInterruptGuard a Semaphore() directory UnixFileDirectory on '/service/edp/files/magma' preferences a MagmaServerPreferences * [] in MagmaRepositoryController>>open {[self privateOpen: directory]} self a MagmaRepositoryController temps didRetry false err nil inst vars repository a MaObjectRepository session a MagmaSession serverSerializer a MaObjectSerializer requestInterruptGuard a Semaphore() directory UnixFileDirectory on '/service/edp/files/magma' preferences a MagmaServerPreferences * BlockContext>>on:do: self [] in MagmaRepositoryController>>open {[self privateOpen: directory]} temps exception MagmaCorruptionError handlerAction [] in MagmaRepositoryController>>open {[:err | didRetry ifTrue: [self error: 'serious problem'] ...etc... handlerActive true inst vars sender BlockContext>>on:do: pc 63 stackp 0 nargs 0 startpc 60 home MagmaRepositoryController>>open * MagmaRepositoryController>>open self a MagmaRepositoryController temps didRetry false err nil inst vars repository a MaObjectRepository session a MagmaSession serverSerializer a MaObjectSerializer requestInterruptGuard a Semaphore() directory UnixFileDirectory on '/service/edp/files/magma' preferences a MagmaServerPreferences * MagmaRepositoryController>>open: self a MagmaRepositoryController temps aFileDirectory UnixFileDirectory on '/service/edp/files/magma' inst vars repository a MaObjectRepository session a MagmaSession serverSerializer a MaObjectSerializer requestInterruptGuard a Semaphore() directory UnixFileDirectory on '/service/edp/files/magma' preferences a MagmaServerPreferences * MagmaRepositoryController class>>open: self MagmaRepositoryController temps fullyQualifiedPathString '/service/edp/files/magma' inst vars superclass MaObject methodDict a MethodDictionary(#averageObjectSize->a CompiledMethod (263) #backupTo:->a CompiledMethod (2344) #b...etc... format 142 instanceVariables #('repository' 'session' 'serverSerializer' 'requestInterruptGuard' 'directory' 'preferences') organization ('statistics' averageObjectSize numberOfConnectedClients objectCount version) ('utilities' backupTo:...etc... subclasses nil name #MagmaRepositoryController classPool a Dictionary(#OpenControllers->a Set() ) sharedPools nil environment a SystemDictionary(lots of globals) category nil * MagmaRepositoryController class>>openedOn: self MagmaRepositoryController temps fullyQualifiedPathString '/service/edp/files/magma' existingController nil inst vars superclass MaObject methodDict a MethodDictionary(#averageObjectSize->a CompiledMethod (263) #backupTo:->a CompiledMethod (2344) #b...etc... format 142 instanceVariables #('repository' 'session' 'serverSerializer' 'requestInterruptGuard' 'directory' 'preferences') organization ('statistics' averageObjectSize numberOfConnectedClients objectCount version) ('utilities' backupTo:...etc... subclasses nil name #MagmaRepositoryController classPool a Dictionary(#OpenControllers->a Set() ) sharedPools nil environment a SystemDictionary(lots of globals) category nil * MagmaSession class>>openLocal: self MagmaSession temps pathString '/service/edp/files/magma' inst vars superclass MaObject methodDict a MethodDictionary(size 109) format 152 instanceVariables #('id' 'user' 'serializer' 'transaction' 'readStrategy' 'definition' 'preferences' 'anchor' 'transac...etc... organization ('transactions' abort begin commit commitAndBegin commitAndBegin: commit: didChange: inNestedTransac...etc... subclasses nil name #MagmaSession classPool a Dictionary(#ConnectedSessions->a Set(a MagmaSession a MagmaSession a MagmaSession a MagmaSessio...etc... sharedPools nil environment a SystemDictionary(lots of globals) category nil * [] in MagmaLocalLocation>>newSession {[sessionClass openLocal: fullPath]} self /service/edp/files/magma temps sessionClass MagmaSession fullPath '/service/edp/files/magma' each a MagmaSession foundSession nil inst vars name nil path '/service/edp/files/magma'

2 1

Magma-Seaside-Pier intregration
by keith hodges 24 Aug '06

24 Aug '06

I have uploaded a couple of packages to the MagmaTester repository and to the Pier repository. I havent tested them in a fresh image yet. Seaside-Examples-Store-Magma - contains the store example with a new control panel for the store repository. Magma seaside - provides a control panel for initializing repositories and some status information. Pier-Model - my latest provided PRMagmaPersistecny and PRMagmaRepository Pier-Seaside - control panel for PRMagmaRepository to select kernels for making persistent. I am away for a few days so really verify that everything works as planned. I havent quite got pier working yet, but I am not sure why not. Perhaps it would be worth chris having a look Keith ___________________________________________________________ All New Yahoo! Mail Tired of Vi@gr@! come-ons? Let our SpamGuard protect you. http://uk.docs.yahoo.com/nowyoucan.html

1 0

Class comments?
by goran＠krampe.se 22 Aug '06

22 Aug '06

Hi! I was starting up our Gjallar system today on an existing db and after having done class changes (but I am unsure of what they were) and it took *forever*. Eventually I used ProcessBrowser to sample a message profile on it and it is attached. It seems to spend 95% digging out class comments? Oh well, I guess it could be interesting. Today I have also witnessed some odd things happening with objects in a plain Dictionary. I am not sure it has to do with Magma - but it smells. An instvar that I definitely don't assign to other than in initialize - it suddenly held onto an OrderedCollectio() instead of a Q2Person. When digging around I also ended up with this Dictionary having integers as both keys and values - it should be an email String as key and a Q2Person as value. Hard to replicate of course, just wanted to mention it. regards, Göran

2 1

Magma at SeasideHosting.st
by Viktor Švub 18 Aug '06

18 Aug '06

are there any patches needed to make Magma work (in 3.9g) image on seasidehosting account? when i created the /magma directory and tried to set up a new repo from the seaside magma control panel, it managed to create some files ('objects', 'commitPackages', 'objects.idx' and 'applied.images') but then the operation broke with the message "Outage occurred while writing system-definitions! Will now attempt to repair." and the magma app is broken now and repeats this message only. viktor

2 1

Re: [Q] Can I use Magma without Morphic System? (Re: [Seaside] Goods)
by Chris Muller 17 Aug '06

17 Aug '06

(answering on Magma list) > I'm currently using 3.8 based MVC only image + Seaside. Can I use > Magma without Morphic System? It _should_ work. Magma has no requirements for Morphic (no UI). To support Morphs in the database, the serializer calls special hooks for Morphs *classNames* that should be ignored if the class is not present in the system. However, I have never tried an image without Morphic. But, I do want this it to work without Morphic so, if you try it and find a problem, post to the Magma list and I will look at it promptly (although I might need your help in obtaining the MVC-only image). - Chris

1 0

error-handling tip
by Chris Muller 16 Aug '06

16 Aug '06

I just wanted to post about a tricky situation that can occur related to errors inside of a commit block. This recently fooled Brent and I where we thought changes weren't being reflected in other sessions, and I think it even got Göran once in the past. Its very easy, in our minds, to extend the atomicity concept of the commit block to its actual mechanics. This is not the case. The following: mySession commit: [ "..make some changes to the model.." ] this is exactly the same as: mySession begin. "..make some changes to the model.." mySession commit So if "..make some changes to the model.." causes a debugger, it's normal to think "the commit didn't work, I'm back to exactly where I was, nothing is changed." But this is only true with respect to the persistent model. The state of the session *is* changed, the transaction has already been started, and its still started. Therefore the next time commit:[ "..fixed make some changes to the model.." ] is run, you have a transaction inside the original transaction, so nothing actually gets written. Sneaky! Since this has occurred several times I thought it worth mentioning as a tip to watch out for. Cheers, Chris

1 0

[ENH] Two New Index Types: Boolean and Class Hierarchy
by Brent Pinkney 16 Aug '06

16 Aug '06

Hi all, The recent release of Magma with complex query capacity has made it opportune to extend the list of index types which can be added to a MagmaCollection. 1. MaBooleanIndex ------------------------- This is a very simple index which indexes a Boolean attribute. e.g. people where: [ :p | (p isMale = true) & (p age > 30) ]. This index is NOT recommended for heavy production use as it can only hash the objects into one of two values - harldy good key dispersal. Nevertheless, it has proved quite useful in prototyping and is a simple example. 2. MaClassHierarchyIndex --------------------------------- A SIGNIFICANT benefit of an object database over a relation database is the ability to store heterogenous instances in the same collection. The instances may be of different classes and have a different number of instance variables. Often the object model has a deep class hierarchy but all the instances inheriting from some base class are maintained in a common MagmaCollection. A canonical example is the Lava test case which maintains a list of *people* but the elements of the collection are instances of one of the concrete subclasses: viz. Person( familyName firstName ) OccidentalPerson OrientalPerson AfricanPerson In this case it may be convenient to find all the Oriental teenagers: people where: [ :p | (p isKindOf: OrientalPerson) & (p age between: 13 and: 20) ]. #isMemberOf: is also supported. This index will also suffer from relatively poor key dispersal; however its implementation and usage will mitigate the effects. The implementation of this index uses some nice arbitrary base arithmetic and some extensive use of Smalltalk reflection. Please find attached, comments and questions are welcomed. Brent

1 0

Re: refreshing an object
by Brent Pinkney 15 Aug '06

15 Aug '06

Hi Chris, > If you are in a transaction and not ready to commit or abort.. I guess > you're out of luck.. We probably need a "continue" like GemStone..? No, I am most definatley not in a transaction, but explicitly calling abort does not seem to refresh the objects. PS. For my ongoing educaton, what is Gemstone's 'continue' ? Thanks Brent

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Magma August 2006