[squeak-dev] Re: MC should really write snaphsot/source.st in UTF8
Tobias Pape
Das.Linux at gmx.de
Thu May 23 06:47:04 UTC 2013
At least it does not switch encodings mid-stream, this would be the absolute nightmare...
Am 23.05.2013 um 01:00 schrieb Nicolas Cellier <nicolas.cellier.aka.nice at gmail.com>:
> Yes, this is the easy part, I was speaking of how the hell we can write a 32bits Word-oriented collection into a Byte-oriented stream and magically end up with ut-32be ;)
>
>
> 2013/5/23 Tobias Pape <Das.Linux at gmx.de>
>>
>>
>> Am 23.05.2013 um 00:11 schrieb Nicolas Cellier <nicolas.cellier.aka.nice at gmail.com>:
>>
>>> Yes, it's UTF-32BE, see SO post. And you get a bonus point if you can find by what magic this happens without tracing in a Debugger ;)
>>
>> That one might be easy, as it bit me several times.
>> First, the stream that is uses for sources.st is backed by a simple ByteString, but
>> during the writing of the definitions, comments, etc, once you hit a method with a wide
>> Character, its source is a WideString, and putting that onto the stream makes
>> the underlying string #become a WideString, too. Which will then be written us g utf32be (as i just learned).
>>
>>>
>>>
>>> 2013/5/23 Tobias Pape <Das.Linux at gmx.de>
>>>> Fun fact:
>>>> Having one “wide” character somewhere in one method or comment and
>>>> Filing out an mcz, the sources.st becomes a persisted WideString (utf16?)
>>>> And you won't know it...
>>>>
>>>> Am 22.05.2013 um 23:16 schrieb Nicolas Cellier <nicolas.cellier.aka.nice at gmail.com>:
>>>>
>>>>> First thing would be to simplify #setConverterForCode and #selectTextConverterForCode.
>>>>> Do we still want to use a MacRomanTextConverter, seriously? I'm not even sure I've got that many files with that encoding on my Mac-OSX...
>>>>> Do we really need to put a ByteOrderMark for UTF-8, seriously? See http://en.wikipedia.org/wiki/Byte_order_mark, it's valueless, and not recommended. It were a Squeak way to specify that a Squeak source file would use UTF-8 rather than MacRoman, but now this should be obsolescent.
>>>>>
>>>>>
>>>>> 2013/5/22 Nicolas Cellier <nicolas.cellier.aka.nice at gmail.com>
>>>>>> http://stackoverflow.com/questions/16645848/squeak-monticello-character-encoding
>>>>>> Let's kill this one, it's totally insane
>>>>>
>>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.squeakfoundation.org/pipermail/squeak-dev/attachments/20130523/a504e1bd/attachment.htm
More information about the Squeak-dev
mailing list
|