Text size
  • Small
  • Medium
  • Large
Contrast
  • Standard
  • Blue text on blue
  • High contrast (Yellow text on black)
  • Blue text on beige

    Making music with images: interactive audiovisual performance systems for the deaf

    Electronic Visualisation and the Arts (EVA 2008)

    London, UK, 22 - 24 July

    AUTHORS

    Mick Grierson

    ABSTRACT

    This paper describes the technical and aesthetic approach utilized for the development of an interactive audiovisual performance system designed specifically for use by children with multiple learning difficulties, including deafness and autism. Sound is transformed in real-time through the implementation of a Fast Fourier Transform (FFT) and translated into a moving image. This image is adapted so that relevant information can be understood and manipulated visually. Finally, the image is turned back into sound. The translation process is based on research in computer music, neuroscience, perception and abstract film studies, supported by the Arts and Humanities Research Council (AHRC).

    FORMATS

    PDF filePDF Version of this Paper (314kb)