Golan Levin and Collaborators

• Peer-Reviewed Publications
• Essays and Statements
• Interviews and Dialogues
• Catalogues and Lists
• Project Reports
• Press Clippings
• Lectures
• Code
• Misc.

• 11 2006. The Table is The Score: An Augmented-Reality Interface for Real-Time, Tangible, Spectrographic Performance
  
• 05 2005. Sounds from Shapes: Audiovisual Performance with Hand Silhouette Contours in The Manual Input Sessions
  
• 05 2005. A Personal Chronology of Audiovisual Systems Research
  
• 06 2004. In-Situ Speech Visualization in Real-Time Interactive Installation and Performance
  
• 09 2000. Painterly Interfaces for Audiovisual Performance (MS Thesis, MIT)
  
• 06 2000. Instruments for Dynamic Abstraction
  
• 04 2000. Tagged Handles: Merging Discrete and Continuous Control
  
• 04 1999. Bringing Sketching Tools to Keychain Computers with an Acceleration-Based Interface
  
• 06 1998. Image-Based Modeling and Rendering of Architecture with Interactive Photogrammetry and View-Dependent Texture Mapping
  

The Table is The Score: An Augmented-Reality Interface for Real-Time, Tangible, Spectrographic Performance

Reference
Levin, G. "The Table is The Score: An Augmented-Reality Interface for Real-Time, Tangible, Spectrographic Performance." Proceedings of the International Conference on Computer Music 2006 (ICMC'06). New Orleans, November 6-11, 2006.

Abstract
Real-time performance instruments for creating and sonifying spectrographic images have generally taken the form of stylus-based drawing interfaces, or camera-based systems which treat a live video image as a spectrogram. Drawing-based approaches afford great precision in specifying the temporal and pitch structures of spectral events, but can be cumbersome, as they only accept input from a single point; camera-based approaches offer quick flexibility in all-around image improvisation, but poor compositional precision because of inadequate visual feedback to the user. In this paper, I present a camera-based spectrographic performance instrument which affords both compositional precision and improvisatory flexibility. This is made possible through an augmented reality (AR) projection overlaid onto and carefully aligned with a dry-erase performance surface.

Download
 [3.7 MB pdf, 1200dpi]