Hi Tobias,

Sorry, User error!  I surrounded it with single quotes and it started
working again!  I'd pasted it and hit inspect to see what it was.  Silly
mistake.

Ok so now this is what actually blew up on me.

(160 asCharacter asString, 'abc') withBlanksTrimmed  ' abc'

Shouldn't nbsp be considered a blank character?

All the best,

Ron

On Tue, Sep 11, 2018 at 2:13 PM Tobias Pape <Das.Linux at gmx.de> wrote:

> Hi Ron
>
>
> On 11.09.2018, at 17:38, Ron Teitelbaum <ron at usmedrec.com> wrote:
>
> Hi All,
>
> I ran into this problem.  Has anyone seen this before?
>
> I was importing a file that contained some sort of char code 160.
> http://www.adamkoch.com/2009/07/25/white-space-and-character-160/ says
> this is a non-breaking space.
>
> I pasted the character into Squeak. When trying to inspect it in squeak I
> get illegal character.
>
>
> Can you get me the char before the 160?
>
> I see that the ahead char is 30, which makes things very strange.
>
> First this does not look like Latin-1, where 160/0xa0 would be nbsp,
> because the ahead is 30/1e, a control char, and not defined in Latin-1.
> It is in ascii (record separator RS), but there 160/0xa0 is not defined.
> Windows CP 1252 would have both, but I am a bit unsure as to whether you'd
> actually find a NBSP+RS combo just like that in smalltalk data…
>
> Leaves, eg, MacRoman (I _think_ stuff used to be coded in macroman in
> Squeak in the 90s), and
> there 30/0x1e ist still RS (strange) but 160/0xA0 is Dagger (†) which is
> indeed illegal.
>
> So could you give us a bit content around the char?
>
> Best regards
> -Tobias
>
>
> PS: EBCDIC would make no sense at all…
> PPS: Interestingly, 160/0xA0 is actually defined #xBinary…
>
>
>
> Illegal character (char code 160 16r16rA0) ->
>
> The 16r16r seems to be an error in the method and not a real number
>
> xIllegal
> "An illegal character was encountered"
> self halt.
> self notify: 'Illegal character (char code ' , hereChar charCode , '
> 16r' , hereChar charCode hex , ')' at: mark
>
> But if I inspect Character nbsp I get a character 160 that seems to work
> fine.
>
> Here is the stack.  I added a halt in xIllegal.
> '11 September 2018 11:30:40.486 am
>
> VM: Win32 - Smalltalk
> Image: Squeak4.1 [latest update: #9957]
>
> Parser(Object)>>halt
> Receiver: a Parser
> Arguments and temporary variables:
>
> Receiver''s instance variables:
> source:  a ReadWriteStream
> mark:  22
> hereChar:  $
> aheadChar:  Character value: 30
> token:  nil
> tokenType:  #xIllegal
> currentComment:  nil
> buffer:  a WriteStream ''''
> typeTable:  #(#xIllegal #xIllegal #xIllegal #xIllegal #xIllegal #xIllegal
> #xIllegal #xIllegal #xDelimiter #xDelimiter #xIllegal #xDelimiter
> #xDelimiter #xIllegal #xIllegal #xIllega...etc...
> here:  nil
> hereType:  nil
> hereMark:  nil
> hereEnd:  nil
> prevMark:  nil
> prevEnd:  nil
> encoder:  {an EncoderForV3PlusClosures}
> requestor:  a SmalltalkEditor
> parseNode:  nil
> failBlock:  [closure] in
> Parser>>parse:class:category:noPattern:context:notifying:ifFail:
> requestorOffset:  0
> tempsMark:  nil
> doitFlag:  nil
> properties:  nil
> category:  nil
>
> Parser(Scanner)>>xIllegal
> Receiver: a Parser
> Arguments and temporary variables:
>
> Receiver''s instance variables:
> source:  a ReadWriteStream
> mark:  22
> hereChar:  $
> aheadChar:  Character value: 30
> token:  nil
> tokenType:  #xIllegal
> currentComment:  nil
> buffer:  a WriteStream ''''
> typeTable:  #(#xIllegal #xIllegal #xIllegal #xIllegal #xIllegal #xIllegal
> #xIllegal #xIllegal #xDelimiter #xDelimiter #xIllegal #xDelimiter
> #xDelimiter #xIllegal #xIllegal #xIllega...etc...
> here:  nil
> hereType:  nil
> hereMark:  nil
> hereEnd:  nil
> prevMark:  nil
> prevEnd:  nil
> encoder:  {an EncoderForV3PlusClosures}
> requestor:  a SmalltalkEditor
> parseNode:  nil
> failBlock:  [closure] in
> Parser>>parse:class:category:noPattern:context:notifying:ifFail:
> requestorOffset:  0
> tempsMark:  nil
> doitFlag:  nil
> properties:  nil
> category:  nil
>
> Parser(Scanner)>>scanToken
> Receiver: a Parser
> Arguments and temporary variables:
>
> Receiver''s instance variables:
> source:  a ReadWriteStream
> mark:  22
> hereChar:  $
> aheadChar:  Character value: 30
> token:  nil
> tokenType:  #xIllegal
> currentComment:  nil
> buffer:  a WriteStream ''''
> typeTable:  #(#xIllegal #xIllegal #xIllegal #xIllegal #xIllegal #xIllegal
> #xIllegal #xIllegal #xDelimiter #xDelimiter #xIllegal #xDelimiter
> #xDelimiter #xIllegal #xIllegal #xIllega...etc...
> here:  nil
> hereType:  nil
> hereMark:  nil
> hereEnd:  nil
> prevMark:  nil
> prevEnd:  nil
> encoder:  {an EncoderForV3PlusClosures}
> requestor:  a SmalltalkEditor
> parseNode:  nil
> failBlock:  [closure] in
> Parser>>parse:class:category:noPattern:context:notifying:ifFail:
> requestorOffset:  0
> tempsMark:  nil
> doitFlag:  nil
> properties:  nil
> category:  nil
>
> Parser(Scanner)>>scan:
> Receiver: a Parser
> Arguments and temporary variables:
> inputStream:  a ReadWriteStream
>
> Receiver''s instance variables:
> source:  a ReadWriteStream
> mark:  22
> hereChar:  $
> aheadChar:  Character value: 30
> token:  nil
> tokenType:  #xIllegal
> currentComment:  nil
> buffer:  a WriteStream ''''
> typeTable:  #(#xIllegal #xIllegal #xIllegal #xIllegal #xIllegal #xIllegal
> #xIllegal #xIllegal #xDelimiter #xDelimiter #xIllegal #xDelimiter
> #xDelimiter #xIllegal #xIllegal #xIllega...etc...
> here:  nil
> hereType:  nil
> hereMark:  nil
> hereEnd:  nil
> prevMark:  nil
> prevEnd:  nil
> encoder:  {an EncoderForV3PlusClosures}
> requestor:  a SmalltalkEditor
> parseNode:  nil
> failBlock:  [closure] in
> Parser>>parse:class:category:noPattern:context:notifying:ifFail:
> requestorOffset:  0
> tempsMark:  nil
> doitFlag:  nil
> properties:  nil
> category:  nil
>
>
> --- The full stack ---
> Parser(Object)>>halt
> Parser(Scanner)>>xIllegal
> Parser(Scanner)>>scanToken
> Parser(Scanner)>>scan:
>  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
> Parser>>init:notifying:failBlock:
> Parser>>parse:class:category:noPattern:context:notifying:ifFail:
> Compiler>>translate:noPattern:ifFail:
> Compiler>>evaluate:in:to:notifying:ifFail:logged:
> [] in SmalltalkEditor(TextEditor)>>evaluateSelection
> BlockClosure>>on:do:
> SmalltalkEditor(TextEditor)>>evaluateSelection
> [] in PluggableTextMorphPlus(PluggableTextMorph)>>inspectIt
> ...etc...
>
> And to top it off if I inspect hereChar on xIllegal in the debugger I get
> a char 160 that works fine!
>
> I'm not sure how to determine what exactly what is the difference between
> the two characters.  Any suggestions?
>
> Thanks!
>
> All the best,
>
> Ron Teitelbaum
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squeakfoundation.org/pipermail/squeak-dev/attachments/20180911/d1fcd99b/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Bildschirmfoto 2018-09-11 um 20.13.03.PNG
Type: image/png
Size: 46225 bytes
Desc: not available
URL: <http://lists.squeakfoundation.org/pipermail/squeak-dev/attachments/20180911/d1fcd99b/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Bildschirmfoto 2018-09-11 um 20.13.03.PNG
Type: image/png
Size: 46225 bytes
Desc: not available
URL: <http://lists.squeakfoundation.org/pipermail/squeak-dev/attachments/20180911/d1fcd99b/attachment-0003.png>