Squeak-dev December 2015

squeak-dev@lists.squeakfoundation.org

60 participants
161 discussions

Re: potential to include cryptography in base image
by Robert Withers 15 Dec '15

15 Dec '15

Thank you, Sven, giving me the opportunity to scope the right mailing lists into the discussion. I love that Pharo is oriented towards business. My particular excitement is to see all the scientific computing. These recent threads on expanding capacity and targeting marketing are good. I think Cryptography in the base, including SecureSession, adds to that effort. The Cryptography package, both for squeak and the Cryptography-Pharo package, and in the Cryptography repository (http://www.squeaksource.com/Cryptography. Through the Monticello Browser this is a loadable item. The loading of SecureSession, which is loadable by both squeak and pharo, ois a separate load. I appreciate that pharo has established a different mechanism for loading. At this time, I am deep into fixing ReedSolomon FEC code, so I must be conservative (which I am) and defer learning and including Cryptography in that mechanism. I must be careful what promises I make and I cannot make a commitment here. If you are interested in seeing this in pharo's catalog, then the Cryptography team welcomes new members, especially from new environments. Welcome. We appreciate all the work that you do! Again, I appreciate the opportunity to engage the community in discussion around the definition and example of a minimal modular image that includes Cryptography & SecureSession in the base. NB: I think that business computing and scientific computing does not equal mobile devices, necessarily. I have long made the case, with varying degrees of effectiveness, that squeak belongs on the server. A SecureSession & Cryptography capability in the base, minimal, headless image is desired: the first question in the OP. Therefore, the correct target of growth is not mobile, it is BigData! On 12/15/2015 05:20 AM, Sven Van Caekenberghe wrote: > Robert, > > I think that the Pharo community, part of which is more business oriented, is absolutely interested in more and better Crypto code. In any case, I am. > > What we absolutely want, if it is not already the case (I did not check), is that the Crypto code can be loaded using 1 single action (through our validated Monticello configurations and Catalog mechanism) - I am sure you will find help to achieve and maintain (through a CI process) that goal. > > Whether it should be a base part of the image is another question. Modularity is a huge goal for Pharo. This is a much harder discussion (as the same can be said of or asked for for many packages that are generally useful: XML, CSV, JSON, SQL, ...). In any the case, the first step is the one described in the previous paragraph. Then you need traction, usage, and maybe demand for full inclusion. > > Regards, > > Sven > >> On 15 Dec 2015, at 11:00, Robert Withers <robert.w.withers(a)gmail.com> wrote: >> >> It was suggested to me that I write to the list and raise the question about cryptography being included in the base image. Really I have 3 questions I would ask you all: >> >> • is it desirable to include cryptography? >> • is it feasible to include cryptography? >> • what is the time frame for including cryptography? >> Given the thread on password hashing (and salting and so on), there are good, solid implementations in the cryptography package. Looking in the Cryptography repository, there is a Pharo 5.0 compatible Cryptography package. >> >> In light of another recent thread discussing random number generation, discussion about the best approach to random algorithms in cryptography ought be engaged. For instance, the SecureRandom algorithm evidently provides some level of guarantee. >> >> To underline the solidity I am attaching a profile of all 102 cryptography tests passing green. This profile demonstrates that there are no areas of particular inefficiency - nothing stands out to be improved - means that the entire library is maximally efficient. >> >> And so I please ask that we have these discussions, for there is a lot of value in this package for general and basic use. >> >> >> -- >> . .. ... ^,^ best, robert >> <Cryptography Spy Results.text.gz> -- . .. .. ^,^ best, robert

1 0

Crypto plugins for ubuntu 32-bits
by Robert Withers 15 Dec '15

15 Dec '15

I loaded the CryptographyPlugins package, from the Cryptography repository into a VMMaker image, and generated the crypto plugins externally. Although I have not measured it rigorously, there is a noticeable performance improvement with SqueakElib tests. Untar these Ubuntu 32-bit crypto plugins into /usr/local/lib/squeak/5.0... https://www.dropbox.com/s/v502zudwsbtr243/CryptoPlugins.ubuntu32.12.4.15.tg… Let me know any issues. Regards, Robert

2 7

Merry Christmas from OopluCon 2016
by Chris Cunnington 14 Dec '15

14 Dec '15

OopluCon 2016 A Day for the Smalltalk Programming Language and its Friends Sunday 10 April 2016 8am - 4pm The Box SF 1069 Howard Street (between 6th and 7th) three blocks from Moscone Center, SoMa San Francisco, USA http://www.theboxsf.com/ * Dr. Eliot Miranda will deliver the keynote presentation Cog - The Open Source Smaltalk VM * Chris Thorgrimsson of Lam Research is presenting. Talk name to be announced in 2016 * Chris Cunnington is presenting An Introduction To Smalltalk * a request for further presentations will be announced on 11 Jan. 2016 * this event will be promoted to the Ruby, Python, JavaScript and Objective C communities * the event is free * The latest details will be available at http://www.ooplu.com

2 3

squeak: could not find any display driver
by Robert Withers 14 Dec '15

14 Dec '15

Are you tired of seeing this result: rabbit@rabbithole:~/warren/cogvm/image$ cogvm Mushroom.4.image squeak: could not find any display driver Aborted (core dumped) I am! Thank you for the help today. Unfortunately this is still an issue for me on both laptops: 32-bit and 64-bit OS. Both were working as well. I reinstalled the 64-bit and it failed right off the start. The commonality to all three failures was the fact that I did these below commands prior to it failing this way, everytime. I think it is the upgrade that does it in. I'll reinstall 32-bit and try without these commands; let you know. Robert sudo apt-get update sudo apt-get upgrade and I ran this script for system libraries for 32-bit squeak. #!/bin/bash # ARGUMENT HANDLING ============================================================= if { [ "$1" = "-h" ] || [ "$1" = "--help" ]; }; then echo "Install libraries required to build the pharo VM under ubuntu. " exit 0; elif [ $# -gt 0 ]; then echo "--help/-h is the only argument allowed" exit 1; fi # INSTALL BUILD LIBRARIES ====================================================== sudo apt-get install cmake zip bash-completion ruby git xz-utils debhelper devscripts sudo apt-get install libc6-dev:i386 libasound2:i386 libasound2-dev:i386 libasound2-plugins:i386 libssl-dev:i386 i#!libssl0.9.8:i386 libfreetype6-dev:i386 libx11-dev:i386 libsm-dev:i386 libice-dev:i386 sudo apt-get install build-essential gcc-multilib g++ sudo apt-get install libgl1-mesa-dev libgl1-mesa-glx:i386 sudo apt-get install binutils:i386 g++-4.6:i386 gcc-4.6:i386 sudo ln -s /usr/lib/i386-linux-gnu/mesa/libGL.so /usr/lib/i386-linux-gnu/libGL.so sudo ln -s /usr/lib/i386-linux-gnu/mesa/libGL.so.1 /usr/lib/i386-linux-gnu/mesa/libGL.so sudo apt-get install uuid-dev:i386 sudo apt-get install subversion

3 6

DirectoryPlugin updated on SqueakSource
by David T. Lewis 14 Dec '15

14 Dec '15

A few years ago (well, more than a few), I implemented DirectoryPlugin. This claimed to (and I believe actually did) provide very large performance benefits on images of that time. It also required some intrusive changes on the image side, so it really was not appropriate for integration into the image. I recently updated the primitive and provided a separate image side access class, This is now on SqueakSource.com as package DirectoryPlugin. Since this was originally written circa 2003, the Squeak image has apparently improved immensely. The directory stream primitives, which were the original motivation for writing it, no longer provide any benefit at all. In fact, they seem to be slightly slower than the standard (modern) image). The file stat primitives do provide substantial performance benefit, so these may still be of interest for modern images. Here is the description from SqueakSource: ------- Project Description Home page http://wiki.squeak.org/squeak/2274 DirectoryPlugin provides access to a Posix directory stream for efficient access to directory contents. It also provides methods for testing file status and how to creating directory entries for a files and directories. The directory stream primitives use the address of a directory stream as a handle to identify a directory stream. This permits several directory streams to be opened and manipulated independently by separate Smalltalk processes. However, care must be taken to avoid passing the handle for an invalid directory stream (such as one which has already been closed) to one of these methods. The plugin has been tested on Linux and on Windows. The directory stream support produces a performance improvement only on Unix (Linux) systems. The file access primitives provide substantial improvements for both Unix and Windows systems. Other platforms have not been tested. DirectoryPluginAccess provides access to primitives in DirectoryPlugin, along with utility methods for various directory and file access functions. Performance characteristics have changed significantly since Squeak circa 2003. The readdir() primitives no longer provide any benefit, but the file testing primitives still yield a couple orders of magnitude improvement for some functions.

2 2

Re: [Pharo-dev] Unicode Support
by EuanM 13 Dec '15

13 Dec '15

Elliot, what's your take on having heterogenous collections for the composed Unicode? i.e. collections with one element for each character, with some characters being themselves a collection of characters (Simple character like "a" is one char, and a character which is a collection of characters is the fully composed version of Ǖ (01d5), a U (0055) with a diaeresis - ¨ - ( 00a8 aka 0308 in combining form ) on top to form the compatibility character Ü (ooDC) which then gets a macron- ̄ -( 0304) on top of that so a #(0061) Ǖ #(01d5) = #( 00dc 0304) = #( 0055 0308 0304) i.e a string which alternated those two characters 'aǕaǕaǕaǕ' would be represented by something equivalent to: #( 0061 #( 0055 0308 0304) 0061 #( 0055 0308 0304) 0061 #( 0055 0308 0304) 0061 #( 0055 0308 0304) ) as opposed to a string of compatibility characters: #( 0061 01d5 0061 01d5 0061 01d5 0061 01d5) Does alternating the type used for characters in a string have a significant effect on speed? On 11 December 2015 at 23:08, Eliot Miranda <eliot.miranda(a)gmail.com> wrote: > Hi Todd, > > On Dec 11, 2015, at 12:57 PM, Todd Blanchard <tblanchard(a)mac.com> wrote: > > > On Dec 11, 2015, at 12:19, EuanM <euanmee(a)gmail.com> wrote: > > "If it hasn't already been said, please do not conflate Unicode and > UTF-8. I think that would be a recipe for > a high P.I.T.A. factor." --Richard Sargent > > > Well, yes. But I think you guys are making this way too hard. > > A unicode character is an abstract idea - for instance the letter 'a'. > The letter 'a' has a code point - its the number 97. How the number 97 is > represented in the computer is irrelevant. > > Now we get to transfer encodings. These are UTF8, UTF16, etc.... A > transfer encoding specifies the binary representation of the sequence of > code points. > > UTF8 is a variable length byte encoding. You read it one byte at a time, > aggregating byte sequences to 'code points'. ByteArray would be an > excellent choice as a superclass but it must be understood that #at: or > #at:put refers to a byte, not a character. If you want characters, you have > to start at the beginning and process it sequentially, like a stream (if > working in the ASCII domain - you can generally 'cheat' this a bit). A C > representation would be char utf8[] > > UTF16 is also a variable length encoding of two byte quantities - what C > used to call a 'short int'. You process it in two byte chunks instead of > one byte chunks. Like UTF8, you must read it sequentially to interpret the > characters. #at and #at:put: would necessarily refer to byte pairs and not > characters. A C representation would be short utf16[]; It would also to > 50% space inefficient for ASCII - which is normally the bulk of your text. > > Realistically, you need exactly one in-memory format and stream > readers/writers that can convert (these are typically table driven state > machines). My choice would be UTF8 for the internal memory format and the > ability to read and write from UTF8 to UTF16. > > But I stress again...strings don't really need indexability as much as you > think and neither UTF8 nor UTF16 provide this property anyhow as they are > variable length encodings. I don't see any sensible reason to have more > than one in-memory binary format in the image. > > > The only reasons are space and time. If a string only contains code points > in the range 0-255 there's no point in squandering 4 bytes per code point > (same goes for 0-65535). Further, if in some application interchange is > more important than random access it may make sense in performance grounds > to use utf-8 directly. > > Again, Smalltalk's dynamic typing makes it easy to have one's cake and eat > it too. > > My $0.02c > > > _,,,^..^,,,_ (phone) > > > I agree. :-) > > Regarding UTF-16, I just want to be able to export to, and receive > from, Windows (and any other platforms using UTF-16 as their native > character representation). > > Windows will always be able to accept UTF-16. All Windows apps *might > well* export UTF-16. There may be other platforms which use UTF-16 as > their native format. I'd just like to be able to cope with those > situations. Nothing more. > > All this is requires is a Utf16String class that has an asUtf8String > method (and any other required conversion methods). > >

5 7

Broken Update [was [squeak-dev] Daily Commit Log]
by Eliot Miranda 12 Dec '15

12 Dec '15

Hi, whatever happened in unloading Universes, it broke the ability to update a release Squeak 5.0 image to the current tip. Hence my automated scripts to build 64-bit images are broken. Can whoever broke the update either fix it, or provide some reasonable workaround so that I can restore my scripts? What's at stake here is, well, a high performance 64-bit Squeak and/or Pharo. I think it's reasonable, even mandatory that we should be able to update a release N image to the tip of release N. We should have CI servers that try and do this (I think we do, don't we?), and so IMO it's incumbent on whoever breaks the update to fix things, e.g. by changing update maps appropriately. [and I don't mean this as a punishment, or something that the person has to do on their own; I'm happy to help fix things, it's /really/ important that the update works, and not just from the last update]. Thanks in advance. Apologies if I appear rude; it's not my intent. I just want my auto-update back ;-) On Thu, Nov 26, 2015 at 2:55 PM, <commits(a)source.squeak.org> wrote: > Changes to Trunk (http://source.squeak.org/trunk.html) in the last 24 > hours: > > > http://lists.squeakfoundation.org/pipermail/packages/2015-November/009199.h… > > Name: Squeak-Version-kfr.4713 > Ancestors: Squeak-Version-kfr.4712 > > Unload and unregister Universes > > ============================================= > _,,,^..^,,,_ best, Eliot

5 16

Re: Recovering method changes after crash (Ralph Boland) (Sorry for being brain dead)
by Ralph Boland 12 Dec '15

12 Dec '15

> Hi Ralph, > I think what you are looking for is "Extras > Recover Changes" in the > world main docking bar. But the path you mentioned with "World Menu > > changes > recently logged changes" does exist as well in my 4.6 > images, so I wonder why it was not there for you. > Best regards, > Jakob You are of course totally correct. I was behaving too brain dead to figure out that to file in selections I use a menu. In Squeak 3.11 this could be done by clicking on a button. Ralph (If I only had a brain; from the Wizard of Oz)

1 0

squeak & pharo versions of crypto and SecureSession
by Robert Withers 12 Dec '15

12 Dec '15

Folks, I cross-tested with Pharo and here are the good versions: Cryptography - squeak: Cryptography-rww.49.mcz - pharo: Cryptography-Pharo-rww.38.mcz SecureSession: - squeak & pharo: SecureSession-RobertWithers.20.mcz I hope this helps, Robert

1 0

looking for an image file
by Robert Withers 11 Dec '15

11 Dec '15

Where could I find an image file version 6505? I need to see to something first and hopefully all will be well. Thank you, Robert

4 11

← Newer
1
...
6
7
8
9
10
11
12
...
17
Older →

Jump to page: