Ph.D. Dissertation Defense - Wei Li

Event Details
  • Date/Time:
    • Wednesday October 9, 2019
      12:30 pm - 2:30 pm
  • Location: Room 5126, Centergy
  • Phone:
  • URL:
  • Email:
  • Fee(s):
  • Extras:
No contact information submitted.

Summary Sentence: Improving Mispronunciation Detection And Enriching Diagnostic Feedback For Non-Native Learners Of Mandarin

Full Summary: No summary paragraph submitted.

TitleImproving Mispronunciation Detection And Enriching Diagnostic Feedback For Non-Native Learners Of Mandarin


Dr. Chin-Hui Lee, ECE, Chair , Advisor

Dr. David Anderson, ECE

Dr. Elliot Moore, ECE

Dr. Marco Siniscalchi, Univ of Enna

Dr. Jin Liu, Modern Languages


The objective of the proposed research is to improve mispronunciation detection of Mandarin and enrich diagnostic feedback for second language learners. The problem is tackled from the perspective of acoustic modeling and verification of phones and tones. For the acoustic modeling part, speech attributes and soft targets are respectively proposed to help resolve phone and tone's hard-assignments labels, which are not optimal for describing irregular non-native pronunciations. Subsequently, multi-source information or better trained acoustic model can provide more accurate features for mispronunciation detectors. For the verification part, pronunciation representation, usually calculated by frame-level averaging in a DNN, is now learned by BLSTM, which directly uses sequential context information to embed a sequence of pronunciation scores into a pronunciation vector to improve the performance of mispronunciation detectors. Finally, with the help of posterior scores generated by different classifiers and interpretable decision trees, we can visualize non-native mispronunciations and provide comprehensive feedback, including articulation manner, place, and pitch contour-related diagnostic information, to help non-native learners improve their pronunciation quality.

Additional Information

In Campus Calendar

ECE Ph.D. Dissertation Defenses

Invited Audience
Phd Defense, graduate students
  • Created By: Daniela Staiculescu
  • Workflow Status: Published
  • Created On: Sep 19, 2019 - 5:50pm
  • Last Updated: Sep 19, 2019 - 5:59pm