[squeak-dev] Re: MC should really write snaphsot/source.st in UTF8

Tobias Pape Das.Linux at gmx.de
Thu May 23 06:47:04 UTC 2013


At least it does not switch encodings mid-stream, this would be the absolute nightmare...

Am 23.05.2013 um 01:00 schrieb Nicolas Cellier <nicolas.cellier.aka.nice at gmail.com>:

> Yes, this is the easy part, I was speaking of how the hell we can write a 32bits Word-oriented collection into a Byte-oriented stream and magically end up with ut-32be ;)
> 
> 
> 2013/5/23 Tobias Pape <Das.Linux at gmx.de>
>> 
>> 
>> Am 23.05.2013 um 00:11 schrieb Nicolas Cellier <nicolas.cellier.aka.nice at gmail.com>:
>> 
>>> Yes, it's UTF-32BE, see SO post. And you get a bonus point if you can find by what magic this happens without tracing in a Debugger ;)
>> 
>> That one might be easy, as it bit me several times.
>> First, the stream that is uses for sources.st is backed by a simple ByteString, but
>> during the writing of the definitions, comments, etc, once you hit a method with a wide
>> Character, its source is a WideString, and putting that onto the stream makes
>> the underlying string #become a WideString, too. Which will then be written us g utf32be (as i just learned).
>> 
>>> 
>>> 
>>> 2013/5/23 Tobias Pape <Das.Linux at gmx.de>
>>>> Fun fact:
>>>> Having one “wide” character somewhere in one method or comment and 
>>>> Filing out an mcz, the sources.st becomes a persisted WideString (utf16?)
>>>> And you won't know it...
>>>> 
>>>> Am 22.05.2013 um 23:16 schrieb Nicolas Cellier <nicolas.cellier.aka.nice at gmail.com>:
>>>> 
>>>>> First thing would be to simplify #setConverterForCode and #selectTextConverterForCode.
>>>>> Do we still want to use a MacRomanTextConverter, seriously? I'm not even sure I've got that many files with that encoding on my Mac-OSX...
>>>>> Do we really need to put a ByteOrderMark for UTF-8, seriously? See http://en.wikipedia.org/wiki/Byte_order_mark, it's valueless, and not recommended. It were a Squeak way to specify that a Squeak source file would use UTF-8 rather than MacRoman, but now this should be obsolescent.
>>>>> 
>>>>> 
>>>>> 2013/5/22 Nicolas Cellier <nicolas.cellier.aka.nice at gmail.com>
>>>>>> http://stackoverflow.com/questions/16645848/squeak-monticello-character-encoding
>>>>>> Let's kill this one, it's totally insane
>>>>> 
>>> 
> 
> 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.squeakfoundation.org/pipermail/squeak-dev/attachments/20130523/a504e1bd/attachment.htm


More information about the Squeak-dev mailing list