Text size
  • Small
  • Medium
  • Large
  • Standard
  • Blue text on blue
  • High contrast (Yellow text on black)
  • Blue text on beige

    From Seeing to Feeling Sound: A Multimodal Interface for Trans-Domain Mapping of Sound

    Electronic Visualisation and the Arts (EVA 2013)

    London, UK, 29 - 31 July 2013


    Rebecca Carter, Thomas McKenzie, Lawrence Sarkar & Kia Ng


    Despite its aural focus, sound can encompass both visual and somatic stimulation. This project aims to develop a system to enhance the multimodality of sound using additional visual and haptic feedback techniques. This paper presents a prototype to demonstrate the concept, in the context of technology-enhanced learning for music. With a brief summary of related background literature survey, the paper describes design and development aspects of the system. It discusses software visual interface designs as well as hardware interfaces for vibrotactile feedback to augment an interactive system. The paper concludes with validations and discusses several plausible future directions.


    PDF file PDF Version of this Paper 309(kb)

    EVA 2013: Electronic Visualisation and the Arts cover

    Print copies of EVA 2013
    ISBN 978-1-780172-15-6
    RRP £85

    Available from the BCS bookshop