Daniel,

Not knowing much about RBScanner let me just say that the major change in
the default Squeak Scanner was to defer to the actual characters when
determining what is a letter and what not. In other words, the
initialization of Scanner used to look like:

	newTable atAll: ($A asciiValue to: $Z asciiValue) put: #xLetter.
	newTable atAll: ($a asciiValue to: $z asciiValue) put: #xLetter.

and this was changed into

	1 to: 255 do:[:i|
		(Character value: i) isLetter
			ifTrue:[newTable at: i put: #xLetter]].

That's really all there is to it - I figure that something similar can be
found in RBScanner.

Cheers,
  - Andreas

> -----Original Message-----
> From: squeak-dev-admin at lists.squeakfoundation.org
> [mailto:squeak-dev-admin at lists.squeakfoundation.org]On Behalf Of
> danielv at netvision.net.il
> Sent: Sunday, October 14, 2001 3:37 PM
> To: squeak-dev at lists.squeakfoundation.org
> Cc: raymondasselin at sympatico.ca
> Subject: Re: Internationalization of the Squeak RB release
>
>
> Hi Raymond.
>
> Hmm, at first I didn't understand where the RB might care, I see it's
> the RBScanner...
>
> Truth is, I don't know. I was surprised to know how many characters
> Squeak can show as it is...
>
> Maybe I can look into it this weekend, if no one more handy with this
> sort of thing gets it by then.
>
> Daniel
>
> raymondasselin at sympatico.ca wrote:
> >
> > --Boundary_(ID_XPlMhx0IZretB1WqTghwHQ)
> > Content-type: TEXT/PLAIN
> > Content-transfer-encoding: 8BIT
> >
> > Oops, something wrong with my last message.
> >
> > Daniel,  i use heavily the recent change set from Andreas Raab (see
> > attachment) which is marvelous for people ou use accent's
> characters in
> > their code. This change set is a subtitution for the
> ClassificationTable
> > found in the Character class. As I see the Refactoring
> Browser use it's
> > own version of ClassificationTable. I tried to change it  without
> > success...my Squeak level skills are'nt yet 'à la hauteur'.
>  So I ask
> > you, is it difficult for you to use the Andreas Raab's
> > ClassificationTable in the RB?
> >
> > By the way...a big thank to Andreas for this change set.
> >
> > Raymond.
> >
> > --Boundary_(ID_XPlMhx0IZretB1WqTghwHQ)
> > Content-type: application/octet-stream; NAME=IntlChars-ar.2.cs
> > Content-transfer-encoding: base64
> > Content-disposition: attachment; filename=IntlChars-ar.2.cs
> >
> >
> J0Zyb20gU3F1ZWFrMy4xYWxwaGEgb2YgMjggRmVicnVhcnkgMjAwMSBbbGF0ZX
> N0IHVwZGF0
> >
> ZTogIzQyNjFdIG9uIDE4IEF1Z3VzdCAyMDAxIGF0IDU6MjE6MjcgcG0nIQ0iQ2
> hhbmdlIFNl
> >
> dDoJCUludGxDaGFycy1hcg1EYXRlOgkJCTE4IEF1Z3VzdCAyMDAxDUF1dGhvcj
> oJCQlBbmRy
> >
> ZWFzIFJhYWINDUVuYWJsZSB0aGUgdXNlIG9mIGludGVybmF0aW9uYWwgY2hhcm
> FjdGVycyBz
> >
> dWNoIGFzIFVtbGF1dHMuDVdBUk5JTkc6IENoYW5nZSBzZXQgaGFzIGJlZW4gbW
> FudWFsbHkg
> >
> cmUtYXJyYW5nZWQuDVRha2UgY2FyZSB3aGVuIHRyeWluZyB0byBmaWxlIGl0IG
> 91dCBhZ2Fp
> >
> bi4iIQ0NTWFnbml0dWRlIHN1YmNsYXNzOiAjQ2hhcmFjdGVyDQlpbnN0YW5jZV
> ZhcmlhYmxl
> >
> TmFtZXM6ICd2YWx1ZSAnDQljbGFzc1ZhcmlhYmxlTmFtZXM6ICdDaGFyYWN0ZX
> JUYWJsZSBD
> >
> bGFzc2lmaWNhdGlvblRhYmxlIExldHRlckJpdHMgTG93ZXJjYXNlQml0IFVwcG
> VyY2FzZUJp
> >
> dCAnDQlwb29sRGljdGlvbmFyaWVzOiAnJw0JY2F0ZWdvcnk6ICdDb2xsZWN0aW
> 9ucy1UZXh0
> >
> JyENDSFDaGFyYWN0ZXIgY2xhc3MgbWV0aG9kc0ZvcjogJ2NsYXNzIGluaXRpYW
> xpemF0aW9u
> >
> JyBzdGFtcDogJ2FyIDgvMTgvMjAwMSAxNjoyMCchDWluaXRpYWxpemUNCSJDcm
> VhdGUgdGhl
> >
> IHRhYmxlIG9mIHVuaXF1ZSBDaGFyYWN0ZXJzLiBUaGlzIGNvZGUgaXMgbm90IH
> Nob3duIHNv
> >
> IHRoYXQgdGhlDQl1c2VyIGNhbiBub3QgZGVzdHJveSB0aGUgc3lzdGVtIGJ5IH
> RyeWluZyB0
> >
> byByZWNyZWF0ZSB0aGUgdGFibGUuIg0NCXNlbGYgaW5pdGlhbGl6ZUNsYXNzaW
> ZpY2F0aW9u
> >
> VGFibGUuISAhDQ0hQ2hhcmFjdGVyIGNsYXNzIG1ldGhvZHNGb3I6ICdjbGFzcy
> Bpbml0aWFs
> >
> aXphdGlvbicgc3RhbXA6ICdhciA4LzE4LzIwMDEgMTY6NTUnIQ1pbml0aWFsaX
> plQ2xhc3Np
> >
> ZmljYXRpb25UYWJsZSAJIkNoYXJhY3RlciBpbml0aWFsaXplIg0JIkluaXRpYW
> xpemUgdGhl
> >
> IGNsYXNzaWZpY2F0aW9uIHRhYmxlLiBUaGUgY2xhc3NpZmljYXRpb24gdGFibG
> UgaXMgYSBj
> >
> b21wYWN0IGVuY29kaW5nIG9mIHVwcGVyIGFuZCBsb3dlciBjYXNlcyBvZiBjaG
> FyYWN0ZXJz
> >
> IHdpdGgNCQktIGJpdHMgMC03OiBUaGUgbG93ZXIgY2FzZSB2YWx1ZSBvZiB0aG
> lzIGNoYXJh
> >
> Y3Rlci4NCQktIGJpdHMgOC0xNTogVGhlIHVwcGVyIGNhc2UgdmFsdWUgb2YgdG
> hpcyBjaGFy
> >
> YWN0ZXIuDQkJLSBiaXQgMTY6IGxvd2VyY2FzZSBiaXQgKGUuZy4sIGlzTG93ZX
> JjYXNlID09
> >
> IHRydWUpDQkJLSBiaXQgMTc6IHVwcGVyY2FzZSBiaXQgKGUuZy4sIGlzVXBwZX
> JjYXNlID09
> >
> IHRydWUpDQkiDQl8IGNoMSBjaDIgfA0JTG93ZXJjYXNlQml0IF8gMSBiaXRTaG
> lmdDogMTYu
> >
> DQlVcHBlcmNhc2VCaXQgXyAxIGJpdFNoaWZ0OiAxNy4NDQkiSW5pdGlhbGl6ZS
> B0aGUgbGV0
> >
> dGVyIGJpdHMgKGUuZy4sIGlzTGV0dGVyID09IHRydWUpIg0JTGV0dGVyQml0cy
> BfIExvd2Vy
> >
> Y2FzZUJpdCBiaXRPcjogVXBwZXJjYXNlQml0Lg0NCUNsYXNzaWZpY2F0aW9uVG
> FibGUgXyBB
> >
> cnJheSBuZXc6IDI1Ni4NCSJJbml0aWFsaXplIHRoZSBkZWZhdWx0cyAobmVpdG
> hlciBsb3dl
> >
> ciBub3IgdXBwZXIgY2FzZSkiDQkwIHRvOiAyNTUgZG86WzppfA0JCUNsYXNzaW
> ZpY2F0aW9u
> >
> VGFibGUgYXQ6IGkrMSBwdXQ6IChpIGJpdFNoaWZ0OiA4KSArIGkuDQldLg0NCS
> JJbml0aWFs
> >
> aXplIGNoYXJhY3RlciBwYWlycyAodXBwZXItbG93ZXIgY2FzZSkiDQkjKA0JCS
> JCYXNpYyBy
> >
> b21hbiINCQkoJEEgJGEpIAkoJEIgJGIpIAkoJEMgJGMpIAkoJEQgJGQpIA0JCS
> gkRSAkZSkg
> >
> CSgkRiAkZikgCSgkRyAkZykgCSgkSCAkaCkgDQkJKCRJICRpKSAJKCRKICRqKS
> AJKCRLICRr
> >
> KSAJKCRMICRsKSANCQkoJE0gJG0pCSgkTiAkbikJKCRPICRvKQkoJFAgJHApIA
> 0JCSgkUSAk
> >
> cSkgCSgkUiAkcikgCSgkUyAkcykgCSgkVCAkdCkgDQkJKCRVICR1KQkoJFYgJH
> YpCSgkVyAk
> >
> dykJKCRYICR4KQ0JCSgkWSAkeSkJKCRaICR6KQ0JCSJJbnRlcm5hdGlvbmFsIg
> 0JCSgkgCAk
> >
> iikJKCSBICSMKQkoJIIgJI0pCSgkgyAkjikNCQkoJIQgJJYpCSgkhSAkmikJKC
> SGICSfKQko
> >
> JMsgJIgpDQkJKCTMICSLKQkoJM0gJJspCSgkziAkzykJKCSuICS+KQ0JKSBkbz
> pbOnBhaXJ8
> >
> DQkJY2gxIF8gcGFpciBmaXJzdCBhc2NpaVZhbHVlLg0JCWNoMiBfIHBhaXIgbG
> FzdCBhc2Np
> >
> aVZhbHVlLg0JCUNsYXNzaWZpY2F0aW9uVGFibGUgYXQ6IGNoMSsxIHB1dDogKG
> NoMSBiaXRT
> >
> aGlmdDogOCkgKyBjaDIgKyBVcHBlcmNhc2VCaXQuDQkJQ2xhc3NpZmljYXRpb2
> 5UYWJsZSBh
> >
> dDogY2gyKzEgcHV0OiAoY2gxIGJpdFNoaWZ0OiA4KSArIGNoMiArIExvd2VyY2
> FzZUJpdC4N
> >
> CV0uDQ0JIkluaXRpYWxpemUgYSBmZXcgb3RoZXJzIGZvciB3aGljaCB3ZSBvbm
> x5IGhhdmUg
> >
> bG93ZXIgY2FzZSB2ZXJzaW9ucy4NCVRoaXMgbWF5IGJlIGVpdGhlciBiZWNhdX
> NlIFNxdWVh
> >
> ayBkb2Vzbid0IGhhdmUgYW4gZW5jb2RpbmcgZm9yIHRoZQ0JdXBwZXIgY2FzZS
> B2ZXJzaW9u
> >
> cyBvciBiZWNhdXNlIHRoZSBjaGFyYWN0ZXIgZXhpc3RzIG9ubHkgaW4gbG93ZX
> JjYXNlDQl2
> >
> ZXJzaW9uIChzdWNoIGFzIHRoZSBnZXJtYW4gpyAocy16KSB3aGljaCByZWFsbH
> kgaXMgYSBs
> >
> aWdhdHVyZSBhbmQgbm90IGENCXNlcGFyYXRlIGNoYXJhY3RlcikiDQkjKCSHIC
> SJICSPICSQ
> >
> ICSRICSSICSTICSUICSVICSXICSYICSZICScICSdICSeICSnICSvICS/ICTYKS
> BkbzpbOmNo
> >
> YXJ8DQkJY2gxIF8gY2hhciBhc2NpaVZhbHVlLg0JCUNsYXNzaWZpY2F0aW9uVG
> FibGUgYXQ6
> >
> IGNoMSsxIHB1dDogKGNoMSBiaXRTaGlmdDogOCkgKyBjaDEgKyBMb3dlcmNhc2
> VCaXQuDQld
> >
> Lg0hICENDUNoYXJhY3RlciBpbml0aWFsaXplIQ0NIUNoYXJhY3RlciBtZXRob2
> RzRm9yOiAn
> >
> dGVzdGluZycgc3RhbXA6ICdhciA4LzE4LzIwMDEgMTc6MDInIQ1pc0xldHRlcg
> 0JIkFuc3dl
> >
> ciB3aGV0aGVyIHRoZSByZWNlaXZlciBpcyBhIGxldHRlci4iDQleKENsYXNzaW
> ZpY2F0aW9u
> >
> VGFibGUgYXQ6IHZhbHVlKzEpIGFueU1hc2s6IExldHRlckJpdHMhICENDSFDaG
> FyYWN0ZXIg
> >
> bWV0aG9kc0ZvcjogJ3Rlc3RpbmcnIHN0YW1wOiAnYXIgOC8xOC8yMDAxIDE3Oj
> AyJyENaXNM
> >
> b3dlcmNhc2UNCSJBbnN3ZXIgd2hldGhlciB0aGUgcmVjZWl2ZXIgaXMgYSBsb3
> dlcmNhc2Ug
> >
> bGV0dGVyLiINCV4oKENsYXNzaWZpY2F0aW9uVGFibGUgYXQ6IHZhbHVlKzEpIG
> JpdEFuZDog
> >
> TG93ZXJjYXNlQml0KSA9IExvd2VyY2FzZUJpdCEgIQ0NIUNoYXJhY3RlciBtZX
> Rob2RzRm9y
> >
> OiAndGVzdGluZycgc3RhbXA6ICdhciA4LzE4LzIwMDEgMTY6NDcnIQ1pc1NhZm
> VGb3JIVFRQ
> >
> DQkid2hldGhlciBhIGNoYXJhY3RlciBpcyAnc2FmZScsIG9yIG5lZWRzIHRvIG
> JlIGVzY2Fw
> >
> ZWQgd2hlbiB1c2VkLCBlZywgaW4gYSBVUkwiDQledmFsdWUgPCAxMjggYW5kOl
> tzZWxmIGlz
> >
> QWxwaGFOdW1lcmljIG9yOiBbICcufi1fJyBpbmNsdWRlczogc2VsZiBdXSEgIQ
> 0NIUNoYXJh
> >
> Y3RlciBtZXRob2RzRm9yOiAndGVzdGluZycgc3RhbXA6ICdhciA4LzE4LzIwMD
> EgMTc6MDIn
> >
> IQ1pc1VwcGVyY2FzZQ0JIkFuc3dlciB3aGV0aGVyIHRoZSByZWNlaXZlciBpcy
> BhIHVwcGVy
> >
> Y2FzZSBsZXR0ZXIuIg0JXigoQ2xhc3NpZmljYXRpb25UYWJsZSBhdDogdmFsdW
> UrMSkgYml0
> >
> QW5kOiBVcHBlcmNhc2VCaXQpID0gVXBwZXJjYXNlQml0ISAhDQ0hQ2hhcmFjdG
> VyIG1ldGhv
> >
> ZHNGb3I6ICdjb252ZXJ0aW5nJyBzdGFtcDogJ2FyIDgvMTgvMjAwMSAxNzowMS
> chDWFzTG93
> >
> ZXJjYXNlDQkiSWYgdGhlIHJlY2VpdmVyIGlzIGxvd2VyY2FzZSwgYW5zd2VyIG
> l0cyBtYXRj
> >
> aGluZyB1cHBlcmNhc2UgQ2hhcmFjdGVyLiINCV5DaGFyYWN0ZXIgdmFsdWU6IC
> goQ2xhc3Np
> >
> ZmljYXRpb25UYWJsZSBhdDogdmFsdWUrMSkgYml0QW5kOiAyNTUpLiEgIQ0NIU
> NoYXJhY3Rl
> >
> ciBtZXRob2RzRm9yOiAnY29udmVydGluZycgc3RhbXA6ICdhciA4LzE4LzIwMD
> EgMTc6MDEn
> >
> IQ1hc1VwcGVyY2FzZQ0JIklmIHRoZSByZWNlaXZlciBpcyBsb3dlcmNhc2UsIG
> Fuc3dlciBp
> >
> dHMgbWF0Y2hpbmcgdXBwZXJjYXNlIENoYXJhY3Rlci4iDQleQ2hhcmFjdGVyIH
> ZhbHVlOiAo
> >
> KChDbGFzc2lmaWNhdGlvblRhYmxlIGF0OiB2YWx1ZSsxKSBiaXRTaGlmdDogLT
> gpIGJpdEFu
> >
> ZDogMjU1KS4hICENDQ0hU2Nhbm5lciBjbGFzcyBtZXRob2RzRm9yOiAnY2xhc3
> MgaW5pdGlh
> >
> bGl6YXRpb24nIHN0YW1wOiAnYXIgOC8xOC8yMDAxIDE3OjE4JyENaW5pdGlhbG
> l6ZQ0JfCBu
> >
> ZXdUYWJsZSB8DQluZXdUYWJsZSBfIEFycmF5IG5ldzogMjU2IHdpdGhBbGw6IC
> N4QmluYXJ5
> >
> LiAiZGVmYXVsdCINCW5ld1RhYmxlIGF0QWxsOiAjKDkgMTAgMTIgMTMgMzIgKS
> BwdXQ6ICN4
> >
> RGVsaW1pdGVyLiAidGFiIGxmIGZmIGNyIHNwYWNlIg0JbmV3VGFibGUgYXRBbG
> w6ICgkMCBh
> >
> c2NpaVZhbHVlIHRvOiAkOSBhc2NpaVZhbHVlKSBwdXQ6ICN4RGlnaXQuDQkxIH
> RvOiAyNTUg
> >
> ZG86WzppfCAoQ2hhcmFjdGVyIHZhbHVlOiBpKSBpc0xldHRlciBpZlRydWU6W2
> 5ld1RhYmxl
> >
> IGF0OiBpIHB1dDogI3hMZXR0ZXJdXS4NCW5ld1RhYmxlIGF0OiAzMCBwdXQ6IC
> Nkb0l0Lg0J
> >
> bmV3VGFibGUgYXQ6ICQiIGFzY2lpVmFsdWUgcHV0OiAjeERvdWJsZVF1b3RlLg
> 0JbmV3VGFi
> >
> bGUgYXQ6ICQjIGFzY2lpVmFsdWUgcHV0OiAjeExpdFF1b3RlLg0JbmV3VGFibG
> UgYXQ6ICQk
> >
> IGFzY2lpVmFsdWUgcHV0OiAjeERvbGxhci4NCW5ld1RhYmxlIGF0OiAkJyBhc2
> NpaVZhbHVl
> >
> IHB1dDogI3hTaW5nbGVRdW90ZS4NCW5ld1RhYmxlIGF0OiAkOiBhc2NpaVZhbH
> VlIHB1dDog
> >
> I3hDb2xvbi4NCW5ld1RhYmxlIGF0OiAkKCBhc2NpaVZhbHVlIHB1dDogI2xlZn
> RQYXJlbnRo
> >
> ZXNpcy4NCW5ld1RhYmxlIGF0OiAkKSBhc2NpaVZhbHVlIHB1dDogI3JpZ2h0UG
> FyZW50aGVz
> >
> aXMuDQluZXdUYWJsZSBhdDogJC4gYXNjaWlWYWx1ZSBwdXQ6ICNwZXJpb2QuDQ
> luZXdUYWJs
> >
> ZSBhdDogJDsgYXNjaWlWYWx1ZSBwdXQ6ICNzZW1pY29sb24uDQluZXdUYWJsZS
> BhdDogJFsg
> >
> YXNjaWlWYWx1ZSBwdXQ6ICNsZWZ0QnJhY2tldC4NCW5ld1RhYmxlIGF0OiAkXS
> Bhc2NpaVZh
> >
> bHVlIHB1dDogI3JpZ2h0QnJhY2tldC4NCW5ld1RhYmxlIGF0OiAkeyBhc2NpaV
> ZhbHVlIHB1
> >
> dDogI2xlZnRCcmFjZS4NCW5ld1RhYmxlIGF0OiAkfSBhc2NpaVZhbHVlIHB1dD
> ogI3JpZ2h0
> >
> QnJhY2UuDQluZXdUYWJsZSBhdDogJF4gYXNjaWlWYWx1ZSBwdXQ6ICN1cEFycm
> 93Lg0JbmV3
> >
> VGFibGUgYXQ6ICRfIGFzY2lpVmFsdWUgcHV0OiAjbGVmdEFycm93Lg0JbmV3VG
> FibGUgYXQ6
> >
> ICR8IGFzY2lpVmFsdWUgcHV0OiAjdmVydGljYWxCYXIuDQlUeXBlVGFibGUgXy
> BuZXdUYWJs
> >
> ZSAiYm9uIHZveWFnZSEhIg0NCSJTY2FubmVyIGluaXRpYWxpemUiISAhDQ1TY2
> FubmVyIGlu
> > aXRpYWxpemUhDQ0=
> >
> > --Boundary_(ID_XPlMhx0IZretB1WqTghwHQ)--
>
>