一种音视结合的发音质量评估方法及系统
By combining visual and auditory modalities to assess facial movements and tongue position, this approach addresses the problem in existing technologies where pronunciation quality assessments cannot identify the underlying causes, thus enabling effective pronunciation correction guidance.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- INST OF COMPUTING TECH CHINESE ACAD OF SCI
- Filing Date
- 2023-04-28
- Publication Date
- 2026-07-17
AI Technical Summary
Existing pronunciation quality assessment methods mainly rely on audio modalities, which cannot effectively identify the causes of pronunciation non-standardities and lack visual modal information, thus failing to provide effective pronunciation correction suggestions.
By combining visual and auditory modalities, and measuring the standard of facial movements and tongue positions, this study assesses pronunciation quality and provides corrective suggestions using visual position indicators and audio formant frequency mapping.
It provides a comprehensive pronunciation quality assessment, can identify facial muscle movement and tongue position problems, and gives clear correction guidance to improve pronunciation accuracy.
Smart Images

Figure CN116649896B_ABST