Hi Folks -
Thanks to some dedicated OLPC-related work done in Greece by Chris Petsos[1], we now have a Windows VM with Unicode support enabled. This VM will both generate UTF input from characters as well as support clipboard, file and directory names in UTF-8. The VM is available here:
http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.1-bin.zip http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.1-src.zip
You are invited to test the new work but be advised that this may require some manual adjustments - for an understanding what needs to be done, please see [2].
I'm interested in reports, both good and bad about whether the clipboard, file, directory and input support behaves as expected.
[1]http://lists.squeakfoundation.org/pipermail/vm-dev/2007-May/001194.html [2]http://lists.squeakfoundation.org/pipermail/vm-dev/2007-June/001306.html
Cheers, - Andreas
http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.1-bin.zip http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.1-src.zip
You are invited to test the new work but be advised that this may require some manual adjustments - for an understanding what needs to be done
I am getting a primitive has failed error when i try to publish an EToy... I think it's happening when it tries to create the resourcecache.map file in the Squeaklets folder, or the folder itself.
To reproduce the problem: 1) Just run the exe inside the *bin.zip file above. 2) Try to publish the empty eToy.
Note that the VM version that i compiled does not create this error...
Christos
Chris Petsos wrote:
I am getting a primitive has failed error when i try to publish an EToy... I think it's happening when it tries to create the resourcecache.map file in the Squeaklets folder, or the folder itself.
Thanks for finding this. The problem was a left-over CreateDirectoryA() call which of course should now be CreateDirectoryW(). It'll be fixed in the next version.
Cheers, - Andreas
To reproduce the problem:
- Just run the exe inside the *bin.zip file above.
- Try to publish the empty eToy.
Note that the VM version that i compiled does not create this error...
Christos
I have fixed the problem with directory creation and updated the VM to 3.10.2 which is up in the usual places:
http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.2-bin.zip http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.2-src.zip
Cheers, - Andreas
Andreas Raab wrote:
Hi Folks -
Thanks to some dedicated OLPC-related work done in Greece by Chris Petsos[1], we now have a Windows VM with Unicode support enabled. This VM will both generate UTF input from characters as well as support clipboard, file and directory names in UTF-8. The VM is available here:
http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.1-bin.zip http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.1-src.zip
You are invited to test the new work but be advised that this may require some manual adjustments - for an understanding what needs to be done, please see [2].
I'm interested in reports, both good and bad about whether the clipboard, file, directory and input support behaves as expected.
[1]http://lists.squeakfoundation.org/pipermail/vm-dev/2007-May/001194.html [2]http://lists.squeakfoundation.org/pipermail/vm-dev/2007-June/001306.html
Cheers,
- Andreas
http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.2-bin.zip http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.2-src.zip
The file path interpretation works on Japanese Windows (see the file name pane in the attached picture) by changing the fileNameConverterClass of JapaneseEnvironment. However, I can't quite figure out to make keyboard input work... It doesn't seem that I get meaningful values when the input is done via an IME.
I'll take a look at it later...
-- Yoshiki
The file path interpretation works on Japanese Windows (see the file name pane in the attached picture) by changing the fileNameConverterClass of JapaneseEnvironment. However, I can't quite figure out to make keyboard input work... It doesn't seem that I get meaningful values when the input is done via an IME.
Yoshiki,
Don't forget that the VM is sending unicode chars as the sixth data member of the event buffer. So advice your input interpreter as
evtbuf sixth.
instead of
evtbuf third.
I also tried to copy/paste same japanese text with the new VM and i couldn't do it... Japanese locale specific question... does a unicode Japanese character fit inside a WCHAR struct?
Cause, there have been used Windows functions that convert WCHAR streams
MultiByteToWideChar WideCharToMultiByte
Could the problem be there?
Christos.
Chris,
Don't forget that the VM is sending unicode chars as the sixth data member of the event buffer.
Sure. I looked at these values yet didn't see it.
(If I remember correctly, it got changed (from third to sixth. take a look at MacUnicodeInputInterpreter>>initialize. It tells you the history^^;))
Japanese locale specific question... does a unicode Japanese character fit inside a WCHAR struct?
It does. UTF-16LE without surrogated pairs is almost ok for daily use.
Cause, there have been used Windows functions that convert WCHAR streams
MultiByteToWideChar WideCharToMultiByteCould the problem be there?
I can't quite trace the detail (and my memory), but when the macro UNICODE is defined, the latter should be just used?
-- Yoshiki
Yoshiki Ohshima wrote:
Cause, there have been used Windows functions that convert WCHAR streams
MultiByteToWideChar WideCharToMultiByteCould the problem be there?
I can't quite trace the detail (and my memory), but when the macro UNICODE is defined, the latter should be just used?
The VM is not generally compiled with -DUNICODE; the places where we utilize WCHAR are explicit and we use the explicit *W variants of the Windows functions.
Cheers, - Andreas
Japanese locale specific question... does a unicode Japanese character fit inside a WCHAR struct?
It does. UTF-16LE without surrogated pairs is almost ok for daily use.
Right, but take a look at the codepage parameter of the functions
http://msdn2.microsoft.com/en-us/library/ms776413.aspx http://msdn2.microsoft.com/en-us/library/ms776420.aspx
It only supports until UTF8...so, can it work for Japanese chars?
Cause, there have been used Windows functions that convert WCHAR streams
MultiByteToWideChar WideCharToMultiByte
Christos.
Yoshiki Ohshima wrote:
The file path interpretation works on Japanese Windows (see the file name pane in the attached picture) by changing the fileNameConverterClass of JapaneseEnvironment. However, I can't quite figure out to make keyboard input work... It doesn't seem that I get meaningful values when the input is done via an IME.
Give this another shot with the 3.10.3 VM - one of the bugs I fixed was the fact that we were delegating from a Unicode WndProcW to an Ansi DefWindowProcA which would *completely* and mysteriously upset some functions and not others (like changing the window title would always fail because it implicitly sends a WM_SETTEXT message which we delegated with Unicode input to the Ansi version of the handler...) I strongly suspect that the IME translation gets into similar trouble if you delegate from WndProcW to DefWindowProcA.
Cheers, - Andreas
Hi Folks -
[cc: v3dot10 for consideration of related fixes]
After a few more rounds of fixes and debugging (incl. the unicodification of the drag and drop and async file primitives) we have a shiny new 3.10.3 VM which should be usable for a more general audience:
http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-bin.zip http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-src.zip
I think this is a good candidate to get any pending fixes into 3.10 - I have posted the list of required fixes to Mantis and would like to ask the 3.10 team to consider those:
http://bugs.squeak.org/view.php?id=6523 http://bugs.squeak.org/view.php?id=6524 http://bugs.squeak.org/view.php?id=6525 http://bugs.squeak.org/view.php?id=6526
Those of you who have been using 3.10.1 or 3.10.2 please make sure you upgrade to 3.10.3 - the prior versions had a fatal error in the clipboard code which might cause VM crashes or other serious memory corruptions (dumb mistake on my behalf). I have deleted these versions from the servers and you should do the same.
Other than that: Enjoy!
Cheers, - Andreas
Hi Andreas,
When I started Squeakland image with new vm on the desktop (I extracted SqueakVM-Win32-3.10.3-bin.zip, and dragged SqueakPlugin.image icon to Squeak.exe), I got this error.
Image file read problem (0 out of 4 bytes read)
Cheers, - Takashi
Andreas Raab wrote:
After a few more rounds of fixes and debugging (incl. the unicodification of the drag and drop and async file primitives) we have a shiny new 3.10.3 VM which should be usable for a more general audience:
http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-bin.zip http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-src.zip
I just did the same without any problems. Can you check to see whether that was a one-time problem or if a different image file works. And if so, can you try to download the VM again (perhaps there was something corrupted?). Oh, and finally, check your virus, spyware etc. checker - they might think to take a closer look on an application that you just put there and dropped a file on.
Cheers, - Andreas
Takashi Yamamiya wrote:
Hi Andreas,
When I started Squeakland image with new vm on the desktop (I extracted SqueakVM-Win32-3.10.3-bin.zip, and dragged SqueakPlugin.image icon to Squeak.exe), I got this error.
Image file read problem (0 out of 4 bytes read) Cheers,
- Takashi
Andreas Raab wrote:
After a few more rounds of fixes and debugging (incl. the unicodification of the drag and drop and async file primitives) we have a shiny new 3.10.3 VM which should be usable for a more general audience:
http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-bin.zip http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-src.zip
I think what Takashi meant was to put an image file on the "desktop", which is translated to Katakana characters on Japanese Windows, and then try to launch the image with the new VM. I did get the same error in this way.
-- Yoshiki
At Tue, 05 Jun 2007 09:58:20 -0700, Andreas Raab wrote:
I just did the same without any problems. Can you check to see whether that was a one-time problem or if a different image file works. And if so, can you try to download the VM again (perhaps there was something corrupted?). Oh, and finally, check your virus, spyware etc. checker - they might think to take a closer look on an application that you just put there and dropped a file on.
Cheers,
- Andreas
Takashi Yamamiya wrote:
Hi Andreas,
When I started Squeakland image with new vm on the desktop (I extracted SqueakVM-Win32-3.10.3-bin.zip, and dragged SqueakPlugin.image icon to Squeak.exe), I got this error.
Image file read problem (0 out of 4 bytes read) Cheers,
- Takashi
Andreas Raab wrote:
After a few more rounds of fixes and debugging (incl. the unicodification of the drag and drop and async file primitives) we have a shiny new 3.10.3 VM which should be usable for a more general audience:
http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-bin.zip http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-src.zip
Ah! Indeed this doesn't seem to work correctly. I'll have a look at it.
Cheers, - Andreas
Yoshiki Ohshima wrote:
I think what Takashi meant was to put an image file on the "desktop", which is translated to Katakana characters on Japanese Windows, and then try to launch the image with the new VM. I did get the same error in this way.
-- Yoshiki
At Tue, 05 Jun 2007 09:58:20 -0700, Andreas Raab wrote:
I just did the same without any problems. Can you check to see whether that was a one-time problem or if a different image file works. And if so, can you try to download the VM again (perhaps there was something corrupted?). Oh, and finally, check your virus, spyware etc. checker - they might think to take a closer look on an application that you just put there and dropped a file on.
Cheers,
- Andreas
Takashi Yamamiya wrote:
Hi Andreas,
When I started Squeakland image with new vm on the desktop (I extracted SqueakVM-Win32-3.10.3-bin.zip, and dragged SqueakPlugin.image icon to Squeak.exe), I got this error.
Image file read problem (0 out of 4 bytes read) Cheers,
- Takashi
Andreas Raab wrote:
After a few more rounds of fixes and debugging (incl. the unicodification of the drag and drop and async file primitives) we have a shiny new 3.10.3 VM which should be usable for a more general audience:
http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-bin.zip http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-src.zip
Hi Takashi -
The latest version (3.10.4) fixes this and many related problems. Turns out that there were still plenty of places in the whole vm/image path conversion that were a little unclean to say the least ;-) 3.10.4 allows me to have both, the VM as well as images sitting in internationalized directories without any problems. Give it a try.
Cheers, - Andreas
Takashi Yamamiya wrote:
Hi Andreas,
When I started Squeakland image with new vm on the desktop (I extracted SqueakVM-Win32-3.10.3-bin.zip, and dragged SqueakPlugin.image icon to Squeak.exe), I got this error.
Image file read problem (0 out of 4 bytes read) Cheers,
- Takashi
Andreas Raab wrote:
After a few more rounds of fixes and debugging (incl. the unicodification of the drag and drop and async file primitives) we have a shiny new 3.10.3 VM which should be usable for a more general audience:
http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-bin.zip http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.3-src.zip
Hi Andreas,
It works with new VM, http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.4-bin.zip Good. I still got primitive failed in Squeakland image, but it would not be vm issue. I'll check another image.
Thanks, - Takashi
Andreas Raab wrote:
Hi Takashi -
The latest version (3.10.4) fixes this and many related problems. Turns out that there were still plenty of places in the whole vm/image path conversion that were a little unclean to say the least ;-) 3.10.4 allows me to have both, the VM as well as images sitting in internationalized directories without any problems. Give it a try.
Hi Andreas,
When I started Squeakland image with new vm on the desktop (I extracted SqueakVM-Win32-3.10.3-bin.zip, and dragged SqueakPlugin.image icon to Squeak.exe), I got this error.
Image file read problem (0 out of 4 bytes read) Cheers,
vm-dev@lists.squeakfoundation.org
-
Andreas Raab -
Chris Petsos -
Takashi Yamamiya -
Yoshiki Ohshima