<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"><html><head><meta content="text/html;charset=UTF-8" http-equiv="Content-Type"></head><body ><div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;"><div>Hi Folks,<br></div><div><br></div><div>Because of FileSystem incompats, I am attempting a SAXParser parse of a 73Gb file by running this on pharo:<br></div><div><br></div><blockquote style="border: 1px solid rgb(204, 204, 204); padding: 7px; background-color: rgb(245, 245, 245);"><div><div>|t|<br></div><div>t := [[(DocDemoSaxHandler on:('/bulkstorage/enwiki-20200501-pages-articles-multistream.xml' asFileReference)) optimizeForLargeDocuments;parseDocument] forkAt:Processor lowIOPriority named:'SAX'] timeToRun.<br></div><div>t inspect.<br></div></div></blockquote><div>I am posting here as I am betting that this sort of thing can be common to any platform.<br></div><div><br></div><div>My goal is to see how long this parse will take.<br></div><div>I do not need the data in-image.<br></div><div><br></div><div>During the SAXParse, when I hit a certain Element (or two) , I will be taking those element contents and sending them via network connection to a PEGParser running on Squeak with XTreams.<br></div><div><br></div><div>So, on the SAXParser side, I just need...<br></div><div><br></div><blockquote style="border: 1px solid rgb(204, 204, 204); padding: 7px; background-color: rgb(245, 245, 245);"><div><div>stream from 1 to X<br></div><div>send a portion of 1 to X Squeak on another image.<br></div><div>dispose of 1 to X.<br></div><div><br></div></div></blockquote><div><br></div><div>Any pointers on how to approach this sort of problem are greatly appreciated.<br></div><div><br></div><div>Linux has the concept of routing to /dev/null to make stuff disappear.<br></div><div><br></div><div>I have never seen that concept in Smalltalk.</div><div><br></div><div>cheers,<br></div><div><br></div><div>t</div></div><br></body></html>