[Seaside-dev] Encoding issues? Entering 'euro sign' into a text input breaks render

Philippe Marschall philippe.marschall at gmail.com
Wed Oct 17 18:30:03 UTC 2007 

2007/10/17, John Thornborrow <john at pinesoft.co.uk>:
> I've been walking-through the kom request process after halting in
> HttpService>>#handleRequest: and can see that the field finalises as
> unencoded string of three characters (which cannot be copy/pasted due to
> obvious encoding issues)

Do you mean WAKom>>#handleRequest:? If then what you observe is the
correct behaviour. The normal WAKom should represent the euro sign as
a ByteString with the three Characters (actually only bytes) 16rE2
16r82 16rAC. Only the WAKomEncoded should represent it as a WideString
with one Character with value 16r20AC.

Cheers
Philippe

> However, it is just odd that I can challenge this with what I mentioned
> before and it will convert easily. I shall discuss with my colleague
> when he returns from sick leave, as this is edging me on to believe it
> is a squeak encoding issue - and he has a far superiour understanding of
> squeak's encoding than I. I will let you know the outcome; but in the
> meantime I shall continue to look/walk through Kom.
>
> Regards,
> John.
>
> Philippe Marschall wrote:
> > 2007/10/17, John Thornborrow <john at pinesoft.co.uk>:
> >> I have 3.10.2 vm, Windows XP (32Bit)
> >>
> >> Seaside 2.8beta from SqueakMap, with "Yes" to all options (Kom,
> >> Scriptaculous, RSS) Just reinstalled to confirm.
> >>
> >> KomHttpServer-pmm.2 - yes.
> >> Seaside2.8a1-pmm.476 - yes
> >>
> >> /seaside/tests/alltests (encoding) multipart fails for Euro symbol, and
> >> other unicode chars. (prime, left side quote, etc) Same error(s) as before.
> >>
> >> The sample code I provided in my first mail also breaks with the same
> >> result.
> >
> > Wow, this is getting really strange, I just did the same and still can
> > not reproduce:
> > http://img502.imageshack.us/img502/3742/shotih6.png
> >
> > You did not change something in the session or browser properties? Is
> > there some way how you could build a clean image that exposes the bug
> > and give it to me?
> >
> > Cheers
> > Philippe
> >
> >> Thanks and regards,
> >> John.
> >>
> >> Philippe Marschall wrote:
> >>> 2007/10/16, John Thornborrow <john at pinesoft.co.uk>:
> >>>> So what am I to use instead? I've not seen anything about an alternative.
> >>>>
> >>>> I used SeasideInstaller - I always did, yet it left me with what I have
> >>>> been having trouble with today - the encoding test failing, and Seaside
> >>>> rendering breaking on any "special" character. I only installed other
> >>>> versions of KomHttpServer in a bid to try and fix this problem.
> >>> Ok, this is different then, you have my full attention. So lets recap:
> >>> - you use Squeak 3.9, correct?
> >>> - you use SeasideInstaller from SqueakMap, which version, 2.8beta?
> >>> - you use WAKom
> >>> - /seaside/tests/alltests the "Encoding" tests fails?
> >>> Anything else? I just did all this for Windows XP and a 3.10.6 VM and
> >>> the tests work. Can you confirm that you have KomHttpSever-pmm.2 and
> >>> Seaside2.8a1-pmm.476? This is configuration that is really supposed to
> >>> work. If this really doesn't work for you then I need your image
> >>> because otherwise I'm not able to reproduce this bug.
> >>>
> >>> Cheers
> >>> Philippe
> >>>
> >>>> Regards,
> >>>> John
> >>>>
> >>>> Philippe Marschall wrote:
> >>>>> 2007/10/16, John Thornborrow <john at pinesoft.co.uk>:
> >>>>>> I orignally had the Package Universe version of KomHttpServer (6.2) and
> >>>>>> received the same results - the test does not pass.
> >>>>> Then you did use WAKom in a Squeak 3.9 image. As noted several times
> >>>>> this is not supported. This is a bug in KomHttpServer. We contacted
> >>>>> the maintainer and sent him patches (2 methods). He's too busy.
> >>>>>
> >>>>>> The same is also true for many other characters, unicode 2000+ also
> >>>>>> cause the test and Seaside to fail rendering.
> >>>>>>
> >>>>>> This is proving to be havoc for my clients who are copying from Word
> >>>>>> documents made by publishers who make use of left/right-side quotes,
> >>>>>> primes etc. in their documents and wish to publish them on the web in
> >>>>>> HTML form. I agree, this is not your problem, it is mine, but surely you
> >>>>>> must be able to see that it is something to consider, rather than just
> >>>>>> sticking to the still-not-yet-fully-supported-by-browsers (X)HTML standards?
> >>>>> XHTML has _nothing_ at all to do with it. Just that the specified and
> >>>>> actual encoding don't match. You want options? I'll give you options.
> >>>>> They all work with all the languages you get on
> >>>>> http://www.columbia.edu/kermit/utf8.html, not only the euro symbol.
> >>>>>
> >>>>> - use the attached KomHttpServer version. This is the one from the
> >>>>> SeasideInstaller. This makes WAKom and WAKomEncoded work on Squeak 3.9
> >>>>> - use http://squeak.krampe.se/KomHttpServer-gk.14.mcz this makes
> >>>>> WAKomEncoded39 work on Squeak 3.9
> >>>>>
> >>>>> Anything beyond that I don't care.
> >>>>>
> >>>>> Cheers
> >>>>> Philippe
> >>>>>
> >>>>>> Regards,
> >>>>>> John
> >>>>>>
> >>>>>> Philippe Marschall wrote:
> >>>>>>> 2007/10/16, John Thornborrow <john at pinesoft.co.uk>:
> >>>>>>>> The /seaside/tests/alltests for encoding doesn't pass - it fails with:
> >>>>>>>>
> >>>>>>>> "Internal Error
> >>>>>>>>
> >>>>>>>> MessageNotUnderstood: UndefinedObject>>asCharacter
> >>>>>>>>
> >>>>>>>> RWBinaryOrTextStream>>nextPut:
> >>>>>>>> WAHtmlEncoder(WAEncoder)>>nextPutAll:
> >>>>>>>> ByteString(String)>>encodeOn:
> >>>>>>>> WAHtmlStreamDocument>>print:
> >>>>>>>> WARenderCanvas(WAHtmlCanvas)>>text:
> >>>>>>>> ByteString(String)>>renderOn:
> >>>>>>>> [] in WAGenericTag(WATagBrush)>>with: {[self before. anObject renderOn:
> >>>>>>>> canvas. self after]}
> >>>>>>>>
> >>>>>>>> etc.."
> >>>>>>>>
> >>>>>>>> I've got the lastest KomHttpServer from squeaksource.com and I'm not
> >>>>>>>> sure what version WAKom* is - I thought this was part of the seaside
> >>>>>>>> package?
> >>>>>>> No, we only support the official one on SqueakMap and the one from
> >>>>>>> netstyle.ch which comes with the SeasideInstaller.
> >>>>>>>
> >>>>>>>> I've made a work around, and that is to include:
> >>>>>>> Use one of the supported KomHttpServers. They should pass the
> >>>>>>> /seaside/tests/alltests at least in ecoding mode.
> >>>>>>>
> >>>>>>> If you use an other version of Kom we don't care. We're sorry but
> >>>>>>> already supporting these is enough of a mess.
> >>>>>>>
> >>>>>>> Cheers
> >>>>>>> Philippe
> >>>>>>>
> >>>>>>>> aCharacter = (Character value: 1069555884) ifTrue: [^ aStream
> >>>>>>>> nextPutAll: '&euro;' ] .
> >>>>>>>>
> >>>>>>>> to the list of characters in WAHtmlEncoder class>>encode:on: but given
> >>>>>>>> the ourcome of the last time I made changes to this method, it is not
> >>>>>>>> the preferred/accepted solution.
> >>>>>>>>
> >>>>>>>> Regards,
> >>>>>>>> John
> >>>>>>>>
> >>>>>>>> Philippe Marschall wrote:
> >>>>>>>>> 2007/10/16, John Thornborrow <john at pinesoft.co.uk>:
> >>>>>>>>>> Hello all,
> >>>>>>>>>>
> >>>>>>>>>> I've discussed this briefly before on the list, following my
> >>>>>>>>>> contribution regarding encoding more characters than what the (X)HTML
> >>>>>>>>>> spec defines - but did not have an example at the time.
> >>>>>>>>>>
> >>>>>>>>>> However, I have just stumbled upon a significant problem which I wanted
> >>>>>>>>>> to raise as an issue to the dev-list; that is that Seasides rendering
> >>>>>>>>>> does not like the Euro-symbol.
> >>>>>>>>>>
> >>>>>>>>>> The simplest example:
> >>>>>>>>>>
> >>>>>>>>>> renderContentOn: html
> >>>>>>>>>>   html form with: [
> >>>>>>>>>>     html textInput callback: [ :x | text := x ].
> >>>>>>>>>>     html paragraph with: text.
> >>>>>>>>>>     html submitButton
> >>>>>>>>>>   ]
> >>>>>>>>>>
> >>>>>>>>>> On the form, enter a Euro symbol (ALT+0128 on Windows) in the text box
> >>>>>>>>>> and submit.
> >>>>>>>>>>
> >>>>>>>>>> After submitting, it is very obvious that there is a problem (the screen
> >>>>>>>>>> will be filled with characters that cannot be rendered.)
> >>>>>>>>>>
> >>>>>>>>>> Just incase it is something I am doing wrong, I have attached a file-out
> >>>>>>>>>> of the example component. If anyone could confirm this is a problem/bug
> >>>>>>>>>> then I shall submit a bug-report, providing it is not already reported :).
> >>>>>>>>>>
> >>>>>>>>>> However, I've also noticed that the WAEncoder>>initializeBMP does not
> >>>>>>>>>> reach the range necessary to encode the euro (Character value: 1069555884)
> >>>>>>>>>>
> >>>>>>>>>> P.S. Tested with the latest version available in Monticello as of today,
> >>>>>>>>>> and this is on Squeak 32bit 3.10 vm on Windows platform.
> >>>>>>>>> What combination of WAKom* and KomHttpServer do you run?
> >>>>>>>>> WAEncodingTest under /seaside/test/alltests should test this exact
> >>>>>>>>> scenario and run.
> >>>>>>>>>
> >>>>>>>>> Cheers
> >>>>>>>>> Philippe
> >>>>>>>>>
> >>>>>>>>>> Regards,
> >>>>>>>>>> John
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Pinesoft Computers are registered in England, Registered number: 2914825. Registered office: 266-268 High Street, Waltham Cross, Herts, EN8 7EA
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> This message has been scanned for viruses by BlackSpider MailControl - www.blackspider.com
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> 'From Squeak3.9 of 7 November 2006 [latest update: #7067] on 16 October 2007 at 11:50:34 am'!
> >>>>>>>>>> WAComponent subclass: #BrokenEuro
> >>>>>>>>>>         instanceVariableNames: 'text'
> >>>>>>>>>>         classVariableNames: ''
> >>>>>>>>>>         poolDictionaries: ''
> >>>>>>>>>>         category: 'MyStuff'!
> >>>>>>>>>>
> >>>>>>>>>> !BrokenEuro methodsFor: 'rendering' stamp: 'jmt 10/16/2007 10:58'!
> >>>>>>>>>> renderContentOn: html
> >>>>>>>>>>         html form with: [
> >>>>>>>>>>                 html textInput callback: [ :x | text := x ].
> >>>>>>>>>>                 html paragraph with: text.
> >>>>>>>>>>                 html submitButton
> >>>>>>>>>>         ]! !
> >>>>>>>>>>
> >>>>>>>>>> "-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- "!
> >>>>>>>>>>
> >>>>>>>>>> BrokenEuro class
> >>>>>>>>>>         instanceVariableNames: ''!
> >>>>>>>>>>
> >>>>>>>>>> !BrokenEuro class methodsFor: 'as yet unclassified' stamp: 'jmt 10/16/2007 11:49'!
> >>>>>>>>>> canBeRoot
> >>>>>>>>>>         ^true! !
> >>>>>>>>>>
> >>>>>>>>>> _______________________________________________
> >>>>>>>>>> seaside-dev mailing list
> >>>>>>>>>> seaside-dev at lists.squeakfoundation.org
> >>>>>>>>>> http://lists.squeakfoundation.org/mailman/listinfo/seaside-dev
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>> _______________________________________________
> >>>>>>>>> seaside-dev mailing list
> >>>>>>>>> seaside-dev at lists.squeakfoundation.org
> >>>>>>>>> http://lists.squeakfoundation.org/mailman/listinfo/seaside-dev
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>> _______________________________________________
> >>>>>>>> seaside-dev mailing list
> >>>>>>>> seaside-dev at lists.squeakfoundation.org
> >>>>>>>> http://lists.squeakfoundation.org/mailman/listinfo/seaside-dev
> >>>>>>>>
> >>>>>>> _______________________________________________
> >>>>>>> seaside-dev mailing list
> >>>>>>> seaside-dev at lists.squeakfoundation.org
> >>>>>>> http://lists.squeakfoundation.org/mailman/listinfo/seaside-dev
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>> _______________________________________________
> >>>>>> seaside-dev mailing list
> >>>>>> seaside-dev at lists.squeakfoundation.org
> >>>>>> http://lists.squeakfoundation.org/mailman/listinfo/seaside-dev
> >>>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> ------------------------------------------------------------------------
> >>>>>
> >>>>> _______________________________________________
> >>>>> seaside-dev mailing list
> >>>>> seaside-dev at lists.squeakfoundation.org
> >>>>> http://lists.squeakfoundation.org/mailman/listinfo/seaside-dev
> >>>> _______________________________________________
> >>>> seaside-dev mailing list
> >>>> seaside-dev at lists.squeakfoundation.org
> >>>> http://lists.squeakfoundation.org/mailman/listinfo/seaside-dev
> >>>>
> >>> _______________________________________________
> >>> seaside-dev mailing list
> >>> seaside-dev at lists.squeakfoundation.org
> >>> http://lists.squeakfoundation.org/mailman/listinfo/seaside-dev
> >>>
> >>>
> >>>
> >>>
> >> _______________________________________________
> >> seaside-dev mailing list
> >> seaside-dev at lists.squeakfoundation.org
> >> http://lists.squeakfoundation.org/mailman/listinfo/seaside-dev
> >>
> > _______________________________________________
> > seaside-dev mailing list
> > seaside-dev at lists.squeakfoundation.org
> > http://lists.squeakfoundation.org/mailman/listinfo/seaside-dev
> >
> >
> >
> >
> _______________________________________________
> seaside-dev mailing list
> seaside-dev at lists.squeakfoundation.org
> http://lists.squeakfoundation.org/mailman/listinfo/seaside-dev
>

More information about the seaside-dev mailing list