Understanding ASL Learners’ Preferences for a Sign Language Recording and Automatic Feedback System to Support Self-Study

Abstract

Advancements in AI will soon enable tools for providing automatic feedback to American Sign Language (ASL) learners on some aspects of their signing, but there is a need to understand their preferences for submitting videos and receiving feedback. Ten participants in our study were asked to record a few sentences in ASL using software we designed, and we provided manually curated feedback on one sentence in a manner that simulates the output of a future automatic feedback system. Participants responded to interview questions and a questionnaire eliciting their impressions of the prototype. Our initial findings provide guidance to future designers of automatic feedback systems for ASL learners.

Publication
In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2022)
Saad Hassan
Saad Hassan
Assistant Professor

My research interests include human-computer interaction (HCI), accessibility, and computational social science.

Sooyeon Lee
Sooyeon Lee
Assistant Professor at NJIT
Dimitris N. Metaxas
Dimitris N. Metaxas
Professor at Rutgers University
Carol Neidle
Carol Neidle
Professor at Boston University
Matt Huenerfauth
Matt Huenerfauth
Professor and Dean at RIT