ESSV Konferenz Elektronische Sprachsignalverarbeitung

Title: A Hearing Aid to Visualize the Direction of Sound

Authors: Udo Gebelein, Stefan Rapp


Loss of directional hearing is not only related to one-sided deafness, but may also occur when using hearing aids or cochlear implants. Loss of directional hearing does not only mean a significant reduction in quality of life. It becomes a risk factor when it prevents, for example, reacting quickly to a potentially dangerous situation in traffic. The aim of the project is to process auditory signals so that they are suitable for visual sensory perception in order to help hearing impaired people. Two prototypes are presented to graphically display sound. Despite their limited functionality, they demonstrate the technical feasibility of such a device consisting of commercially available components at a reasonable price. The first prototype is based on a Raspberry Pi with a 3.2 inch display. The sound acquisition is done with 4 lavalier microphones and USB sound cards. The second prototype is also based on a Raspberry Pi. However, sound processing is moved to an enhanced computing platform with an array of 8 SMD microphones, to ensure a synchronous sound sampling, and a sound source location framework is used. Visualization options based on the requirements of hearing impaired people are introduced. Lessons learned are discussed and future work is presented.

Year: 2020
In session: (Speech) Signal Processing in Medical Applications
Pages: 69 to 76