Nexus
A sensorial device that brings the experience of interacting with paintings to the visually impaired.
Timeline
October - December, 2019
Role
Individual Project
BDes, Dubai Institute of Design & Innovation
Mentored by
Gionatta Gatto
Process
Conceptualization, Electronics, Fabrication, Prototyping, Project Documentation
Extending how we experience art
Paintings are primarily visual, limiting how visually impaired audiences can engage with them. Inspired by synesthesia, Nexus explores how color can be translated into sound, using audio as an alternate interface to experience visual art.
Rethinking access to visual art
Museums and galleries largely rely on sight, offering limited ways for visually impaired audiences to engage with paintings. Inspired by Kandinsky’s association between color and sound, this project explores whether technology can simulate synesthesia.
Translating visual information into auditory experiences to enable more inclusive participation.
Inspired by synesthesia
Kandinsky’s principles of associating color and sound guided the mapping of visual tones to auditory responses. Each color was treated as an emotional signal rather than a visual input.
The goal was to communicate emotion through audio, allowing sound to carry the same intensity, calmness, or tension that color evokes visually.
Trumpet
Intense
Brass
Radiant
Violin
Passion
Clarinet
Stable
Organ
Expansive
Harp
Melancholic
Flute
Calm
Bass
Closure
From concept to device
The color–sound mapping was translated into a handheld system that reads color and plays sound in real time. The hourglass form reflects the conversion of color into sound, input at one end, output at the other.
Reading color, playing sound
A color sensor detects the colors on the surface of a painting as the device hovers over it. Each color triggers a corresponding sound, creating a continuous audio experience.
Designed for intuitive exploration
Pointing and hovering the device reveals changing soundscapes, allowing users to explore paintings through movement. A wooden grip creates a warm, tactile interface, contrasting with the precision of the 3D printed enclosure.
Designed for Disassembly
Snap-fit lids allowed for quick access to internal components, supporting assembly, disassembly, and debugging.
Integrated mounting system
Custom mounts position components precisely within the enclosure for efficient layout and stability.
Optimized component placement
Angled mounts enable compact assembly while avoiding interference between internal components.
Nexus
Experiencing art through a sensorial device
Nexus translates visual information into sound, creating a new way for visually impaired audiences to engage with paintings. It demonstrates how technology can extend access to visual art beyond sight.
The project opens up future possibilities for collaboration between artists and musicians, where color and sound are designed together to create shared, multi-sensory experiences.