SoundNarratives: Rich Auditory Scene Descriptions to Support Deaf and Hard of Hearing People

Copyright © 2025 The Regents of the University of Michigan

System

Frontend

Start UI

npm install
HTTPS=true SSL_CRT_FILE=../cert.pem SSL_KEY_FILE=../key.pem PORT=2000 npm start

Backend

Build python environment:

python -m venv s2t_env
source s2t_env/bin/activate
pip install -r backend/requirements.txt

Start backend

cd backend
python server.py

Trouble shooting

• Use incognito mode with Google Chrome browser

Codebook

The codebooks for the formative study and the user study.

Support

• Developed with Dhruv Jain and collaborators at The Soundability Lab
• Contact Leo Wu @SoundabilityLab through email lyuanwu at umich.edu

Citation

Please use the following citation for SoundNarratives.

@inproceedings{wu2025soundnarratives,
  title={SoundNarratives: Rich Auditory Scene Descriptions to Support Deaf and Hard of Hearing People},
  author={Wu, Liang-Yuan and Jain, Dhruv},
  booktitle={Proceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility},
  pages={1--15},
  year={2025}
}