Setools

setools@lists.squeakfoundation.org

165 discussions

Gjallar status report
by goran＠krampe.se 06 Aug '07

06 Aug '07

Hi folks! I am just back from my vacation that lasted whole july and some more. Since my ISP has been down for about 2 weeks I have been more or less totally "offline" and I am now gradually catching up on work being done on Gjallar by Keith, Igor, Balacs and Levente during july. By summarizing version comments the fruits of july are listed below. I also left out lots of "small stuff". It looks like a lot of noteworthy stuff like moving to Seaside 2.8 (involving plenty of work), major work on offline operation, major improvements on calling external programs and indexing using swish-e, several improvements to Forms and tons of other fixes. My hat off to you guys! I am now trying to make a fresh build, Keith did one recently but I want to make one myself too. :) regards, Göran ------------------------------------------------------------------------ - Snipped from version comments: Igor: - added field grouping - divider field - some visual improvements - added 'Print' link in case view, by clicking on it a printable version of case view rendered in separate window. - fixed color settings - added coloring for stages, but its out of date Keith: - Lots of small rendering code changes in moving over to seaside 2.8 - Moved scripts and styles into Q2GjallarResources - Loaded disk based resources into Q2GjallarResources - settings interface - resources interface - uses the new WANotCachedDocument that I have put into seaside 2.8. Balazs: - Added multiplaform capabilities to Q2MirrorDownloader (untested). - Removed unused code from Q2Process (old indexing code) - made soap server port configurable - Introduced ProcessWrapper for clean handling of external win32 processes instead of Win32Shell. The code can be found at http://squeaksource.com/ProcessWrapper.html - Q2MirrorDownloader uses it for downloading a mirror - Q2Win32SwishEWrapper is completly rewritten There are some places left using Win32Shell: - Q2MirrorCreator >> #zipDbWin32 - Win32GraphVizGenerator >> #runOSProcess:with: - Win32InstallerBuilder >> #buildLists Levente: - indexing updated - Q2SwishEWrapper class >> #defaultWrapperClass references the implementor classes directly. - Q2SwishEWrapper >> #index:with:into: moved to private, because it's not part of the public api - Added comments to the public methods - Added flags (#q2todo) about issues with filepaths containing spaces - tests added for indexing - other changes - Added time measurement to Q2Process >> #searchIndex:. - Removed obsolate flags from Q2MirrorDownloader >> #downloadDbWin32 - String >> #utf8ToIndexCompatible conforms to standards. It's a bit ugly, but it probably works better than the previous version. - added a new test to test swish-e's search operators - the ? wildcard is only supported from version 2.4.4 and up - fixed phrase search (it didn't work at all) - Removed the extra double quotes from Q2FilterStack and Q2FreeTextFilter, because they killed phrase searching. - Q2IndexingTests updated, to use double quotes for phrases instead of hashes (untested). - Added another check for phrase search testing. - bug fixed: rowcnt was not initialized when called at Q2FormComponent >> #render:label:control:tooltip:help: (to get the error in an previous version add a filter in View cases) - fixed: Q2FreeTextFilter's freetext was not initialized - fixed: Q2FreeTextFilter >> searchProcesses: created Set of Arrays with UUID's, instead of Set of UUID's >From ul.319: - Q2FilterStack has it's own Q2FreeTextFilter - Q2FilterStackView and Q2UserCentralView shows swish-e error messages - Q2FreeTextFilter can store swish-e error messages - Q2SwishEWrapper now escapes query strings (5cr1p7 |<1dd135 won't have fun :) (win32 version n/a yet, no tests) - Minor cleanup >From ul.318: - Q2SwishEWrapper raises an Error, when the query string is invalid. - Implemented #escape: in Q2Win32SwishEWrapper - Updated test for swish-e input errors - Added exploit tests - Search commands are logged - Added quotes to protect paths with spaces - Attachment creation changed. - Bug fixed: Attachments were moved twice when, they were created from files collection (instead of formValue). - in Q2MagmaSessionPool >> #deleteDatabase we send #delete to MagmaLocalLocation instead of #deleteDatabase according to the change in its implementation. - added some settings to initializeMissingDefaultSettings involving mirroring. These should be merged with Keith's new setting management code. - Processes can now recreate their index files. This is how mirrors will create their own indexes.

1 0

Re: Your electronic tax guide
by Keith Hodges 29 Jul '07

29 Jul '07

I ran the latest Gjallar build script. The resultant image is available in ~/gjallar/keith/Gj28Jul/dist/ cheers Keith

1 1

Gjallar settings contd.
by Keith Hodges 14 Jul '07

14 Jul '07

I used a variety of settings and the autoLogin feature for debugging UI, so I thought that it would be useful to promote all the relevant settings into the ini file and Q2GjallarSettings interface. Keith ============= (*optional - indicates defaults supplied by Q2GjallarSettings) new iniFile settings [globals] (required) serverPort=8081 mirrorServerPort=8090 (optional) autoLoginUsername= #empty indicates autoLogin disabled autoLoginPassword= [seaside] (optional) sessionClass=Q2Session #alternative for debugging UI - Q2SessionWithoutMagma rootComponentClass=Q2Main #alternative for debugging UI - use the component you are working on as root. resourcesLibraryClass=Q2Resources #alternative in-image resource set (must be subclass of Q2Resources) magmaLocationClass=Q2MagmaLocalLocation These settings are used in Q2Main initialize, which is called before starting the server.

1 0

Gjallar
by Keith Hodges 13 Jul '07

13 Jul '07

Some more informal Gjallar documentation: Keith ====================================================================== In moving to Seaside 2.8 Deprecated api. - html heading: 'text' level: 3. is now html heading level3; with: 'text'. - html image fileName: is no more. ====================================================================== Revised access to ini file settings. Rationale: Tidy the global settings api a little. Application installation chooses from available ini files. Gjallar can be distributed with a number pre-defined out of the box configuration files for different roles/installation types. (e.g. db server, web server, personal installation etc) usage: Access to settings from the typical Gjallar domains: - everywhere: Q2Session current settings - in the model: Q2Object settings - in the ui: a Q2ChildComponent settings #settings obtains an interface onto the iniFile named in the '/seaside/config' configuration preference #settingsFile named in the seaside #gjallar group defined by Q2GjallarConfiguration. - 'Q2GjallarSettings clear' is included in 'Q2Gjallar cleanImage' to clear ini files cached in memory. When an iniFile is read, it notes its own expireTime as specified by #inifileSeconds on future accesses if the the file has expired it will be re-read. If #inifileSeconds is 0, it will be read once only. As a convenience settings may be referred to directly with message sends, e.g. self settings databaseDirectory. References to #gjallar have been replaced with the equivalent of 'self settings systemName'. The exisiting Q2Object interface to settings is still present (effectively deprecated) but has been re-routed via #settings. There are 55 senders of the old Q2Object api to migrate.

1 0

Gjallar Resources
by Keith Hodges 13 Jul '07

13 Jul '07

In moving Gjallar to use Seaside 2.8 I have modified how Gjallar accesses its resources. Keith -------------------- New grand scheme for handling resources using WAFileLibrary. 1. All of the defaults are in the in-image file library Q2DefaultResources. (so external files are not needed to deploy gjallar) 2. Additional in-image resource sets can be provided as subclasses of Q2Resources, these inherit their defaults from Q2DefaultResources. The resource set is used if its Q2MyResources-c-#libraryName matches the inifile setting 'resourcesDirectory'. 3. Additional user-customized resources can be placed in a directory nominated by 'resourcesDirectory', these, if present, override, 1 and 2, above. Usage in code: html image url: (Q2Resources / 'gjallar.png') this is an extension to the standard seaside 2.8 approach which would be html image url: (Q2Resources / #gjallarPng) notes: Gjallar file libraries inherit their file selectors whereas standard WAFileLibrary does not. Gjallar inherits the standard seaside file libraries, but needs the potential to override the defaults (especially kalseyTabsCss).

1 0

Plotkit and Seaside 2.8
by Keith Hodges 05 Jul '07

05 Jul '07

Dear Gjallarenes, Our main reservation for moving to Seaside 2.8 was the suggestion that Plotkit was not supported. It appears that the main reason Seaside 2.8 does not directly support plotkit is that the canvas html tag had been removed and placed in the separate addon package "HTML5". So I tested plotkit with the latest Seaside 2.8, and the HTML5 package and all appears to be well. Keith

1 0

MagmaServerRequests
by Keith Hodges 18 Jun '07

18 Jun '07

Dear All, I have uploaded an add-on package to http://www.squeaksource.com/MagmaTester called 'Magma server requests'. This is as mentioned in a previous email to this list but it is now packaged in a generic form independent of Gjallar. to install with Installer use: Installer mc http: 'http://www.squeaksource.com'; project: 'MagmaTester'; install: 'Magma server requests'. After installing the package into a working Magma installation, you will need to do a MagmaSession cleanUp to get it adopted by the MagmaRepositoryController's I have made it fairly generic since it passes arbitrary messages, and returns any values, trapping server-side errors, it transports them back over the wire in order to signal them in the client. Actions are atomic since, and I quote from the "Magma client server" read-me text. "The answer block is only ever evaluated for one client request at a time." So to use this all you have to do is implement the Client side and the server side in MyOwnServerRequestResponder e.g. Client side: MyClass-counterValue ^ (self magmaSession serverRequest counterValue) submit e.g Server side MagmaRequestResponder subclass: MyOwnRequestResponder -- MyOwnRequestResponder-#counterValue ^ Count := Count + 1 -- RequestResponder-class-#requestsSupported ^ #( #counterValue ) -- You can send a batch of requests like so... (self magmaSession serverRequest counterIncrement; counterIncrement; counterIncrement; counterValue) submit -- Then there is a handy server backdoor! Normally each request in a batch of requests is sent to the responder which can handle each request. However if we enable requests to be chained, such that the next request is sent to the result of the previous request we can gain full remote control of the server. This is enabled by MagmaServerBackdoorResponder which in itself only serves one request: #login:password: e.g. ((self magmaSession serverRequest login: 'admin' password: 'magma rocks') repositoryController isReadOnly) submit To do: The login could be tied in to magma's exisitng users management. Some responders need simple persistence for their use which I do not know how to do enjoy Keith

2 4

MagmaReadStrategies
by Keith Hodges 17 Jun '07

17 Jun '07

Dear Chris, I was using read strategies and found a bug in the depths generation process, here is a test which shows the problem. Problem A: Subclass defines depths on instVars, superclass defines a depth for all instVars - raises an error .. not indexable. This test case demonstrates the problem: (MagmaSession new) readStrategy: (MaReadStrategy new onAny: Collection readToDepth: 2; forVariableNamed: 'tally' onAny: Dictionary readToDepth: 3; yourself). Problem B: Looking at the code, if a class defines a depth for all instVars, no attempt is made to see if the superclasses have defined a greater depth. The code has an (a max: b) statement as if to intend this behaviour but in reality it looks to me like it is actually (a max: a). (MagmaSession new) readStrategy: (MaReadStrategy new onAny: Collection readToDepth: 3; onAny: Dictionary readToDepth: 2; yourself). Also Problem C: The ObjectExplorer behaviour is not completely in sync with Magma's behaviour. Ideally you want Magma to realize objects when you select them in explorer, not unexplicably due to explorers inner workings. And finally very useful Logging "D" ------ Solutions: In package 'magma seaside' I have included the fixes for A and B, in WAMagmaReadStrategyDefault. I have also added a couple of methods to MagmaMutatingProxy, and a MagmaProxyStandIn class to improve the way that ObjectExplorer behaves. Now you can really explore how magma thinks when it is using read strategies. Logging: The class WAMagmaReadStrategyWithQ2Logging, logs realizations verbosely to the Q2Log, a logging facility available in Gjallar. This is very useful. My fixes for A and B, have a couple of enhancements to the basic scheme. Negative depths are valid and subtracted from the inherited value. This can be useful so as to specify pulling a whole datastructure except this instVar or class type. ---- cheers Keith

3 6

Clock Faking Test Resource
by Keith Hodges 16 Jun '07

16 Jun '07

Dear Ralph, you asked about a clock faking test resource. A while ago I developed a ClassClonerTestResource, this allows you to take a current class which is normally a singleton that is in use, e.g. DateAndTime, and to clone it especially for testing purposes so as to be able to test the clone separately. This would allow me to set my clock under test to some crucial rollover points and test its behaviour. I developed this especially to test bug fix 474 on mantis. [ Edgar/Ralph - here is a fix with tests for you!] However what this doesn't do is replace DateAndTime, so if you want to run code which calls "DateAndTime now" and have it do something clever like run last week, or run backwards it will not work. However you raise an interesting problem which I think it may be worth solving for everyone, and I think that as a result of my recent discovery of the amazing ProcessLocalVariables I may have an answer. At present ProcessLocalVariables only support value and #value: As it happens I added a #doesNotUnderstand: handler as an experiment in allowing gjallar Sessions to spoof as MagmaSessions for Magma. At the time I thought that this would have some interesting possibilities. For us it means that a ProcessLocalVariable can spoof a class for us within a defined scope (process or block). ProcessSpecificVariable-doesNotUnderstand: aMessage ^ aMessage sendTo: self value So I made a DateAndTimeWarp a subclass of DynamicVariable (a variant of the ProcessLocalVariable which has block scope as well as process scope) and set the default to return DateAndTime. We now have a psuedo DateAndTime "class" which is pluggable on a per process basis. If we swap DateAndTime in the system dictionary for DateAndTimeWarp, it works! (i.e. nothing breaks!!!) DateAndTimeWarp-installImposter (DateAndTime respondsTo: #installImposter) ifTrue: [ self error: 'DateAndTime is already spoofed' ]. DateAndTimeReal := Smalltalk at: #DateAndTime. Smalltalk at: #DateAndTime put: self. Now we can substitute our clone with some modifications. The fixed DateAndTime implementation available on mantis via "Installer mantis fixBug: 474." (tested in 3.8 and Gjallar0,4) has already been refactored to refer to its ClassVar "ClockProvider" for all clock references. (default setting is class Time) So all we need to do is replace ClockProvider, we will replace it with an instance of DateAndTimeWarp, DateAndTimeWarp-class-warpedClockBeginAt: t speed: s | newClock newSystemClockProvider | newSystemClockProvider := self new setStart: t speed: s. newClock := ClassClonerTestResource cloneOf: DateAndTimeReal. newClock classPool at: #ClockProvider put: newSystemClockProvider. clock initializeOffsets. ^ newClock We instantiate our new clock provider with a start time, (nil for now), and a speed. The new clock provider saves some offsets, and re-implements #totalSeconds, #millisecondClockValue and #secondsWhenClockTicks (this method waits until the clock ticks and is used for syncing the seconds and milliseconds clocks together. The new clock is substituted for the default clock with the following code: DateAndTimeWarp-class-beginAt: start warpSpeed: s during: aBlock ^ self value: (self warpedClockBeginAt: start speed: s) during: aBlock To Test: DateAndTime beginAt: DateAndTime yesterday warpSpeed: 3 during: [ 10 timesRepeat: [ Transcript cr; show: DateAndTime now. (Delay forSeconds: 1) wait. ] ]. I thought that was pretty impressive stuff. I am well impressed with these process local variables! Also speed wise: au natural, DateAndTime nowBenchmark. '6.84 µs' (I did improve DateAndTime now by a factor of 50-80 in fix 474) The equivalent benchmark spoofed using process local variable DynamicVariable, benchmark gives: 29.09 µs, i.e. not slow. This code is available in Gjallar monticello repository 'http://mc.gjallar.se' in the ProcessSpecific package. enjoy Keith

1 0

Re: [Setools] Gjallar report
by goran＠krampe.se 13 Jun '07

13 Jun '07

Hi Raymond! Raymond Asselin <raymondasselin(a)sympatico.ca> wrote: > >o. :) > Hi GÃ¶ran, Iâm following the work on Gjallar from the beginning. > It is very interesting continue the good work as all your team. > > I would like to help but Iâm shy because Iâm not an expert and > because I donât want to slow you down taking the time to inform > me..... We should always be able to find tasks to work on! Drop by on IRC and we can chat a bit. > But....I would like to help..even for tiny work...I donât know if > Gjallar run on Mac platform, I would say I donât know what doesnât > work on Mac platform, nore if this is something I can do...where > can I found some information on that. If this implies FFI or > Pluggins..sorry this is too heavy for me. Anything else...? If I am not mistaken Gjallar does run on the Mac - Keith Hodges has details. We haven't packaged it yet so to speak, but I think it works. > Raymond regards, Göran

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

Setools