Karmo Järv

VoiceToy

Information

Discipline
Object. Research.
Project
BA graduation work
School
Estonian Academy of Arts, Graphic Design BA
Tutor
Norman Orro
Function
Mimics vocal performance, recorded with face tracking
Medium
3D, physical prototype
Materials
Silicone, SLA resin, PLA, titanium wire, LEDs, elastic strap
Year
2021

Description

From prehistoric roars to intellectual conversations, speech has been our most important means of communication. It lets us form connections, motivate change and influence decisions.

Speech also has a limit: how do you convey emotions and experiences through words alone? Hand gestures add emphasis and structure and give clues about how we feel, but they fall short in complex situations. Adding sound cues gives us room to speculate, because most of us already carry a universal set of samples in our heads. Layered over a story as samples, tunes and sound effects, sound creates tension, changes how we perceive the story and binds us to it.

VoiceToy is a speculative tool, a voice synthesis prosthetic. It extracts a cinematic layer of audio from the storyteller’s mind and adds it on top of their voice. Sensors embedded in the silicone band link VoiceToy to the auditory cortex, which passes the audio data to the tips of 30 transceivers placed around the band. The transceivers vibrate to produce near-field surround sound. The design moves away from the expectation that assistive technology should be concealed, and celebrates its appearance instead.