[Challenge] large files smart compare (was: Re: Squeak for I/O and Memory Intensive tasks )
Yoel Jacobsen
yoel at emet.co.il
Tue Jan 29 15:00:51 UTC 2002
Jon,
My problem is not reading the file by the object collection
persistence. Using memory for 500000 of my objects isn't practical. I
think I only need a good persistence manager (Objectivity for Squeak
anyone?)
Yoel
Jon Hylands wrote:
>On Tue, 29 Jan 2002 15:57:39 +0200, Yoel Jacobsen <yoel at emet.co.il> wrote:
>
>> I have no problem on small tasks but on very large tasks. Try to do
>>it on 500000 entries and report your finding (if you'll have a valid
>>image after that...
>>
>
>Well, there are much better ways to do text processing that reading the
>entire file into memory.
>
>If you look at FileStream, you will see that there are easy ways to read in
>a file line-by-line...
>
>You could set up a very simple finite state machine to handle parsing each
>block of lines in the file. That way, the performance would remain pretty
>much constant, regardless of the size of the file.
>
>Later,
>Jon
>
>--------------------------------------------------------------
> Jon Hylands Jon at huv.com http://www.huv.com/jon
>
> Project: Micro Seeker (Micro Autonomous Underwater Vehicle)
> http://www.huv.com
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.squeakfoundation.org/pipermail/squeak-dev/attachments/20020129/c2daf077/attachment.htm
More information about the Squeak-dev
mailing list
|