[Challenge] large files smart compare (was: Re: Squeak for I/O and Memory Intensive tasks )

Yoel Jacobsen yoel at emet.co.il
Tue Jan 29 15:00:51 UTC 2002


Jon,
   
    My problem is not reading the file by the object collection 
persistence. Using memory for 500000 of my objects isn't practical. I 
think I only need a good persistence manager (Objectivity for Squeak 
anyone?)

    Yoel

Jon Hylands wrote:

>On Tue, 29 Jan 2002 15:57:39 +0200, Yoel Jacobsen <yoel at emet.co.il> wrote:
>
>>    I have no problem on small tasks but on very large tasks. Try to do 
>>it on 500000 entries and report your finding (if you'll have a valid 
>>image after that...
>>
>
>Well, there are much better ways to do text processing that reading the
>entire file into memory.
>
>If you look at FileStream, you will see that there are easy ways to read in
>a file line-by-line...
>
>You could set up a very simple finite state machine to handle parsing each
>block of lines in the file. That way, the performance would remain pretty
>much constant, regardless of the size of the file.
>
>Later,
>Jon
>
>--------------------------------------------------------------
>   Jon Hylands      Jon at huv.com      http://www.huv.com/jon
>
>  Project: Micro Seeker (Micro Autonomous Underwater Vehicle)
>           http://www.huv.com
>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.squeakfoundation.org/pipermail/squeak-dev/attachments/20020129/c2daf077/attachment.htm


More information about the Squeak-dev mailing list