Create Your First Project
Start adding your projects to your portfolio. Click on "Manage Projects" to get started
Tabletop Interactive Play System
Background
More than 90% percent of Deaf and Hard of Hearing (DHH) infants in the US are born to hearing parents. Many hearing parents struggle to use American Sign Language (ASL) fluently during everyday interaction, increasing the risk of language deprivation. Existing technologies focus on vocabulary learning but do not support real-time communication during parent-child interaction.
Goal
Design and evaluate a real-time communication assistive system that supports hearing parents in communicating with their DHH children using ASL.
My Role
· Designed and implemented a real-time multimodal ASL recommendation system
· Led studies with 10 stakeholder (hearing/deaf parents, deaf children, and professionals)
· Prototyped and evaluated various display form factors (tablet, projection, smart glasses) for assistive communication
· Published at
IDC '25 https://dl.acm.org/doi/full/10.1145/3713043.3727054 ;
ASSETS '23 https://dl.acm.org/doi/abs/10.1145/3597638.3614511 ;
Submitting to IDC '26
