Best Poster Award, in the context of HCI International 2019, 16-31 July 2019, Orlando, FL, USA
Certificate for Best Poster Extended Abstract
Yaohao Chen, Junjian Zhang (University of Tsukuba, Japan),
Yizhi Zhang (Columbia University, USA)
and Yoichi Ochiai (University of Tsukuba, Japan)
for the poster entitled
"LipSpeaker: Helping Acquired Voice Disorders People Speak Again"
Presented in the context of
HCI International 2019
16-31 July 2019, Orlando, FL, USA
"In this paper, we designed a system called LipSpeaker to help acquired voice disorder people to communicate in daily life. Acquired voice disorder users only need to face the camera on their smartphones, and then use their lips to imitate the pronunciation of the words. Lip-Speaker can recognize the movements of the lips and convert them to texts, and then it generates audio to play. Compared to texts, mel-spectrogram is more emotionally informative. In order to generate smoother and more emotional audio, we also use the method of predicting mel-spectrogram instead of texts through recognizing users' lip movements and expression together."
The full poster will be available through SpringerLink, provided that you have proper access rights.