<br><font size=2 face="sans-serif">Hi Brad & Everyone,</font>
<br>
<br><font size=2 face="sans-serif">My areas of interest are (in no special order - this is just logically grouped):</font>
<br>
<br><font size=2 face="sans-serif">1. Audio</font>
<br><font size=2 face="sans-serif"> A. MIDI</font>
<br><font size=2 face="sans-serif"> B. Synthesis</font>
<br><font size=2 face="sans-serif"> 1) FM</font>
<br><font size=2 face="sans-serif"> 2) Subtractive</font>
<br><font size=2 face="sans-serif"> 3) Additive</font>
<br><font size=2 face="sans-serif"> 4) Voice/Speech</font>
<br>
<br><font size=2 face="sans-serif"> C. Recording/Editing</font>
<br><font size=2 face="sans-serif"> 1) Filtering (Simple and Adaptive)</font>
<br><font size=2 face="sans-serif"> 2) Sample Rate Conversion</font>
<br><font size=2 face="sans-serif"> 3) Effects (i.e. Reverb, Delay, Phasing, Flanging, Dynamics,</font>
<br><font size=2 face="sans-serif"> Pitch Modification, Time Stretching, etc.)</font>
<br>
<br><font size=2 face="sans-serif">2. Video</font>
<br><font size=2 face="sans-serif"> A. Compression</font>
<br><font size=2 face="sans-serif"> 1) Vector Quantization</font>
<br><font size=2 face="sans-serif"> B. Streaming</font>
<br><font size=2 face="sans-serif"> C. Editing</font>
<br><font size=2 face="sans-serif"> 1) Colorspace Conversion</font>
<br><font size=2 face="sans-serif"> 2) Scaling</font>
<br><font size=2 face="sans-serif"> 3) Compositing</font>
<br>
<br><font size=2 face="sans-serif">The majority of my experience is with audio DSP and anything related, so that's where I can probably contribute the most. I may or may not be able to offer finished code, but certainly I can offer algrorithms as pseudo code or working Smalltalk when I have time, and references. If I don't know how to do something with audio DSP, or don't have time to do it, I almost certainly can point you to resources that can tell you how. In some cases, I may have to decline to participate if there is a conflict of interest with my day job (i.e. I really can't talk about echo cancellation, voice/audio over packet networks, or acoustic beamforming).</font>
<br>
<br><font size=2 face="sans-serif">Vector Quantization is something I have explored quite extensively on my own, so I don't know if it's something anyone else is interested in, but I can be a resource on that topic.</font>
<br>
<br><font size=2 face="sans-serif"> -Dean</font>
<br>
<br>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td>
<td><font size=1 face="sans-serif"><b>Brad Fuller <brad@sonaural.com></b></font>
<br><font size=1 face="sans-serif">Sent by: squeak-dev-bounces@lists.squeakfoundation.org</font>
<p><font size=1 face="sans-serif">02/22/2005 03:35 PM</font>
<br><font size=1 face="sans-serif">Please respond to The general-purpose Squeak developers list</font>
<br>
<td><font size=1 face="Arial"> </font>
<br><font size=1 face="sans-serif"> To: The general-purpose Squeak developers list <squeak-dev@lists.squeakfoundation.org></font>
<br><font size=1 face="sans-serif"> cc: </font>
<br><font size=1 face="sans-serif"> Subject: Improving Squeak's Multimedia - Part 2</font></table>
<br>
<br>
<br><font size=2 face="Courier New">Hi All,<br>
<br>
<br>
<br>
Fantastic, we have several people who are interested and I hope willing <br>
to play a part in improving Squeak's Multimedia capabilities:<br>
<br>
<br>
<br>
Blake (Blake: what's your last name?)<br>
<br>
Dean Swan<br>
<br>
Craig Latta<br>
<br>
Russell Penney<br>
<br>
Steve Elkins<br>
<br>
Martin Kuball<br>
<br>
Yoshiki Ohshima<br>
<br>
Mark McCahill<br>
<br>
Juan Vuletich<br>
<br>
Cornelius Huber<br>
<br>
Brad Fuller<br>
<br>
<br>
<br>
I hope I didn't misspell or miss someone. If so, apologies.<br>
<br>
<br>
<br>
Let me start off the discussion by asking some hi-level questions. And, <br>
by all means, please chime in. I present only one slanted POV --- your <br>
views will be valuable to provide a robust analysis of the situation.<br>
<br>
<br>
<br>
=== Multimedia Definition<br>
<br>
<br>
<br>
Maybe the first order of business is to achieve agreement on what we <br>
mean by "Multimedia".<br>
<br>
I looked it up after Martin's email and he's right - multimedia includes <br>
a variety of media such as the real-time areas (e.g. film/video, music) <br>
as well as static media (e.g. text, graphics.)<br>
<br>
<br>
<br>
Russell provided another interesting POV that containers could hold a <br>
multitude of multimedia assets. and that these basic frameworks could <br>
provide easy re-use.<br>
<br>
<br>
<br>
My 2cents: I was only thinking of "real-time" assets such as audio, <br>
music, video, etc.<br>
<br>
<br>
<br>
What are your thoughts on the definition of Multimedia?<br>
<br>
<br>
<br>
<br>
<br>
=== Hi Level Interests?<br>
<br>
<br>
<br>
Furthermore, our definition of Multimedia may be a clear superset of <br>
what we want to tackle. For instance, it might turn out that we have <br>
just enough hands, or interest, to look at the audio classes; or maybe <br>
just video; or maybe the majority is only interested in adding MPEG4 to <br>
Squeak.<br>
<br>
<br>
<br>
For me, I'm obviously interested in only audio and video. I know this is <br>
broad, but I just want to get the top level issues out of the way. As an <br>
example of elimination, I am not interested in graphics or text.<br>
<br>
<br>
<br>
What are your interests?<br>
<br>
<br>
<br>
<br>
<br>
==== Attack Plan<br>
<br>
<br>
<br>
Finally, I propose that we decide on what to tackle and how to do it.<br>
<br>
From a bird's eye view, we might look at 3 distinct phases (not <br>
necessarily linear in order - can be approached simultaneously):<br>
</font>
<br><font size=2 face="Courier New"> <br>
<br>
* Review/Discuss/Plan/Fix existing classes (which hopefully fix<br>
existing tools/apps)<br>
* Discuss-Design/Plan/Enhance existing classes<br>
* Discuss-Design/Plan/Add new capabilities: new classes, tools and<br>
end-user applications.<br>
<br>
(That's a lot, right there.)<br>
<br>
<br>
I'm willing to put in time, at the very least, toward fixing and <br>
enhancing the audio/music side of MM. I'm also interested in helping to <br>
test and use any video functionality - especially audio-video <br>
synchronization issues. Lastly, I would like to begin discussing new <br>
real-time capabilities for Squeak -- sort of plan while we get the house <br>
in order (the discussions might circumvent fixes, who knows.)<br>
<br>
<br>
<br>
What areas interest you?<br>
<br>
<br>
And, are you interested in helping?<br>
<br>
<br>
<br>
===== Is This A Team?<br>
<br>
<br>
<br>
Finally, Finally,<br>
<br>
In light of the current squeak-dev traffic: Does this look like a team <br>
to propose? It seems orthogonal to the team proposals from the castaways.<br>
<br>
<br>
What do you think about MM as a team? Is it a sub-team?<br>
How does the rest of the Squeak community feel?<br>
<br>
<br>
<br>
<br>
<br>
brad<br>
<br>
<br>
BTW: Are there any related on-going projects that should be incorporated?<br>
<br>
<br>
<br>
<br>
</font>
<br>
<br>