Name: Big data CSV parser plugin<br>Level: Intermediate<br>Possible mentor: ?<br>Possible second mentor: ?<br><br>Description<br><br>With the advent of inexpensive DNA microarray technology, big data is now available to many small and medium laboratories which performs statistical analysis based in microarray experiments. Most of the times the data produced by genotyping services is delivered in CSV format, as it represents a currently cross-platform "standard" which is easily readable, and still used in hundreds of business applications. In Smalltalk we have several CSV parsers but the performance is far from being competitive with libraries implemented in other languages. The goal of this project is to measure time execution and build a plugin to access CSV data in a fast and competitive way.<br>
<br>Technical Details<br>Currently exists several open source projects which implements C functions to access CSV data. The challenge of this project is to learn tools like VMMaker and Interpreter Plugin classes to develop a Squeak/Pharo internal or external plugin.<br>
<br>Benefits to the Student<br>The student will learn about interfacing highly efficient libraries to Smalltalk.<br><br>Benefits to the Community<br>The Smalltalk community will gain a winning library for a extremely common task like dealing with CSV files.<br>
<br><br>Name: HDF5 support (<a href="http://www.hdfgroup.org/HDF5/">http://www.hdfgroup.org/HDF5/</a>)<br>Level: Intermediate<br>Possible mentor: ?<br>Possible second mentor: ?<br><br>Description<br><br>Hierarchical Data File 5 is a new (1998) format capable of storing large and complex amount of data, and it is used in Gravitational and Plasma Physics, Earth Science research, Weather Services, Software Engineering, Biomedical Informatics, etc. As new data adquisition hardware is providing bigger datasets (for example, sequencing data) the need to query and access metadata, partial and full datasets in an efficient way (parallel I/O) is more important. In this format data are stored in a hierarchical format similar to the UNIX file system, and the data model supports a rich variety of data types and data space organizations. Currently exists APIs and wrappers for Java, .NET, Python, C and FORTRAN.<br>
<br>The goal of this project is to build a wrapper to enable to access HDF5 data in Smalltalk. This binding could open Smalltalk to a lot of science domains and users in which currently pure object technology is unknown.<br>
<br>Technical Details<br>The student will need to learn details about the HDF format as data sets and composite data types.<br><br>Benefits to the Student<br>The student would learn about efficient data systems, implement an API, and experiment with large scientific data in Smalltalk.<br>
<br>Benefits to the Community<br>The Smalltalk community will attract more users by keeping in touch with big data analytics, by providing access to an efficient data format used currently in research and business.<br><br>
<div class="gmail_quote">2012/3/5 Janko Mivšek <span dir="ltr"><<a href="mailto:janko.mivsek@eranova.si">janko.mivsek@eranova.si</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hernán and Karl, can you or someone else develop your ideas a bit<br>
furher, by answering the questions:<br>
<br>
description<br>
technical details<br>
benefif for student<br>
benefit for community<br>
<br>
while potential mentor can be choosen later<br>
<br>
Thanks!<br>
Janko<br>
<br>
Dne 02. 03. 2012 21:38, piše karl ramberg:<br>
<div class="HOEnZb"><div class="h5">> Make web browser plugin of Squeak work better on all platforms.<br>
> Get Etoys image to run on CogVM.<br>
><br>
> Karl<br>
><br>
><br>
> On Fri, Mar 2, 2012 at 9:36 PM, karl ramberg <<a href="mailto:karlramberg@gmail.com">karlramberg@gmail.com</a>> wrote:<br>
>> Port OpenQwaq video to Etoys<br>
>><br>
>> Karl<br>
>><br>
>><br>
>> On Fri, Mar 2, 2012 at 9:17 PM, Hernán Morales Durand<br>
>> <<a href="mailto:hernan.morales@gmail.com">hernan.morales@gmail.com</a>> wrote:<br>
>>> To dream is easy:<br>
>>><br>
>>> -HDF5 (<a href="http://www.hdfgroup.org/HDF5/" target="_blank">http://www.hdfgroup.org/HDF5/</a>) support like PyTables or h5py for<br>
>>> Python<br>
>>> -Information Retrieval/Full Text Search package like Lucene<br>
>>> (<a href="http://lucene.apache.org/" target="_blank">http://lucene.apache.org/</a>)<br>
>>> -A binding to R or SAS or SPSS<br>
>>> -Better or more semantic web support (see<br>
>>> <a href="http://en.wikipedia.org/wiki/Web_Services_Resource_Framework#Implementations" target="_blank">http://en.wikipedia.org/wiki/Web_Services_Resource_Framework#Implementations</a>)<br>
>>> -An omnibrowser for OWL ontologies<br>
>>> -CSS template system<br>
>>> -Support of a Distributed Hash Table protocol like Pastry<br>
>>> (<a href="http://www.freepastry.org/" target="_blank">http://www.freepastry.org/</a>)<br>
>>> -Workflow system with designer and plug-in architecture (see<br>
>>> <a href="http://www.taverna.org.uk/" target="_blank">http://www.taverna.org.uk/</a>)<br>
>>> -Big data CSV parser plugin<br>
>>> -Plugin for fast approximate search in strings<br>
>>><br>
>>> cheers,<br>
>>><br>
>>><br>
>>><br>
>>> 2012/3/2 Janko Mivšek <<a href="mailto:janko.mivsek@eranova.si">janko.mivsek@eranova.si</a>><br>
>>>><br>
>>>> Hi everyone,<br>
>>>><br>
>>>> 7 days to deadline for ideas of this year GSoC! Please think about what<br>
>>>> would be a nice project for students to work and that way join our<br>
>>>> community. And yes, students are welcome to propose projects too!<br>
>>>><br>
>>>> Let we "recycle" past project ideas too! Please review them and propose<br>
>>>> those still valuable. Or change the proposal to suit better. Here they<br>
>>>> are: <a href="http://gsoc2010.esug.org/ideas" target="_blank">http://gsoc2010.esug.org/ideas</a> .<br>
>>>><br>
>>>> Let me and Carla post GSoC related stuff only on Pharo, Squeak and VWNC<br>
>>>> mailing lists while for other let someone forward those mails there<br>
>>>> please. It is just too hard to post on 10+ mailing lists, you know...<br>
>>>><br>
>>>> Past GSoC mentors please join the debate on special Smalltalk GSoC<br>
>>>> mentors list: <a href="http://groups.google.com/group/smalltalk-gsoc-mentors" target="_blank">http://groups.google.com/group/smalltalk-gsoc-mentors</a>. If<br>
>>>> you want to be mentor this year you are welcome to join that list too.<br>
>>>><br>
>>>> Best regards<br>
>>>> Janko<br>
>>>><br>
>>>> S, Janko Mivšek piše:<br>
>>>>> Dear Smalltalkers,<br>
>>>>><br>
>>>>> Let we apply this year again for the Google Summer of Code, which as you<br>
>>>>> know is a Google's stipendium program for students to encourage them<br>
>>>>> working on open-source projects [1].<br>
>>>>><br>
>>>>> Ok, our first step as community is to collect ideas for possible<br>
>>>>> projects and to apply to the GSoC as an organization. Deadline is next<br>
>>>>> Friday, so please hurry on with ideas. Just put them as reply to this<br>
>>>>> email or to admins directly and we will put them on our website [2].<br>
>>>>><br>
>>>>> Your project idea should be written as answers to these questions:<br>
>>>>><br>
>>>>> Name<br>
>>>>> Level (Beginner, Intermediate, Advanced)<br>
>>>>> Possible mentor<br>
>>>>> Possible second mentor<br>
>>>>><br>
>>>>> Description<br>
>>>>> Technical Details<br>
>>>>> Benefits to the Student<br>
>>>>> Benefits to the Community<br>
>>>>><br>
>>>>><br>
>>>>> See how such ideas look like in past: <a href="http://gsoc2010.esug.org/ideas" target="_blank">http://gsoc2010.esug.org/ideas</a>.<br>
>>>>><br>
>>>>> Waiting for your ideas<br>
>>>>> Carla and Janko, your GSoC Admin team<br>
>>>>><br>
>>>>> [1] <a href="http://www.google-melange.com/gsoc/homepage/google/gsoc2012" target="_blank">http://www.google-melange.com/gsoc/homepage/google/gsoc2012</a><br>
>>>>> [2] <a href="http://gsoc2012.esug.org" target="_blank">http://gsoc2012.esug.org</a><br>
>>>>><br>
>>> --<br>
</div></div><div class="im HOEnZb">>>> Hernán Morales<br>
>>> Information Technology Manager,<br>
>>> Institute of Veterinary Genetics.<br>
>>> National Scientific and Technical Research Council (CONICET).<br>
>>> La Plata (1900), Buenos Aires, Argentina.<br>
>>> Telephone: +54 (0221) 421-1799.<br>
>>> Internal: 422<br>
>>> Fax: 425-7980 or 421-1799.<br>
>>><br>
>>><br>
>>><br>
>>><br>
><br>
><br>
<br>
</div><div class="HOEnZb"><div class="h5">--<br>
Janko Mivšek<br>
Smalltalk GSoC Admin Team<br>
<a href="http://gsoc2012.esug.org" target="_blank">http://gsoc2012.esug.org</a><br>
<br>
</div></div></blockquote></div><br><br>