Golan Levin and Collaborators

• Peer-Reviewed Publications
• Essays and Statements
• Interviews and Dialogues
• Catalogues and Lists
• Project Reports
• Press Clippings
• Lectures
• Code
• Misc.

• 11 2006. The Table is The Score: An Augmented-Reality Interface for Real-Time, Tangible, Spectrographic Performance
  
• 05 2005. Sounds from Shapes: Audiovisual Performance with Hand Silhouette Contours in The Manual Input Sessions
  
• 05 2005. A Personal Chronology of Audiovisual Systems Research
  
• 06 2004. In-Situ Speech Visualization in Real-Time Interactive Installation and Performance
  
• 09 2000. Painterly Interfaces for Audiovisual Performance (MS Thesis, MIT)
  
• 06 2000. Instruments for Dynamic Abstraction
  
• 04 2000. Tagged Handles: Merging Discrete and Continuous Control
  
• 04 1999. Bringing Sketching Tools to Keychain Computers with an Acceleration-Based Interface
  
• 06 1998. Image-Based Modeling and Rendering of Architecture with Interactive Photogrammetry and View-Dependent Texture Mapping
  

In-Situ Speech Visualization in Real-Time Interactive Installation and Performance

Reference
Levin, G. and Lieberman, Z. "In-Situ Speech Visualization in Real-Time Interactive Installation and Performance." Proceedings of The 3rd International Symposium on Non-Photorealistic Animation and Rendering, June 7-9 2004, Annecy, France.

Abstract
Although we can sense someone’s vocalizations with our ears, nose, and haptic sense, speech is invisible to us without the help of technical aids. In this paper, we present three interactive artworks which explore the question: “if we could see our speech, what might it look like?” The artworks we present are concerned with the aesthetic implications of making the human voice visible, and were created with a particular emphasis on interaction designs that support the perception of tight spatio-temporal relationships between sound, image, and the body. We coin the term in-situ speech visualization to describe a variety of augmented-reality techniques by which graphic representations of speech can be made to appear coincident with their apparent point of origination.

Downloads
 [1.95 MB pdf, 150dpi]
 [16.1 MB pdf, 300dpi]