The Synesthetic Music Experience Communicator combines research in the areas of human computer interaction, music technology, and human perception to illustrate the experience of synesthesian mental imagery in response to musical sound. Synesthesian musicians have reported positive benefits from the augmented awareness of sound in the areas of pitch identification, memorization, composition, and improvisation.

This project attempts to communicate both the experience and performance benefits associated with this cognitive phenomenon. Several virtual worlds have been developed to facilitate group education, rehearsal, and the artistic transformation of live performances into informative and entertaining visual presentations.

Disssertation Personnel

Lewis Hill II (PI) - Professor James Oliver (Advisor)

This application has been developed in collaboration with: (2000-present) - (2003-2006) - (2012-present)

+ ---- Book Cover Image ---- +

Purchase or Download from:
Create Space - Printed Edition - Kindle Edition

+ ---- YouTube Videos ----+

+ ---- DOCUMENTS ---- +

SMEC Defense Presentation (pdf)
SMEC Dissertation (pdf)

SMEC Preliminary Presentation (pdf) - HCI Open Forum PDF Presentation (pdf)
HCI SMEC Poster (tiff) - SMEC Short Paper (pdf in review)

Source Code

+ ---- MEDIA ---- +

Screen Captures (html)
Des Moines WHO Channel 13 TV Interview (mov)
HCI Spring Forum 2004 (mov)
Assisted Living Dance Performance (mp4)

+ ---- PROTOTYPES ---- +

Midi Viz Application - Illuminator!

+ ---- SYNESTHESIA ---- +

synesthesia links at