Foreign Language Shadowing With Non-Verbal Skill Evaluation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional shadowing apparatuses primarily focus on improving verbal skills for foreign language learning, neglecting the development of non-verbal communication skills, which are crucial for effective cross-cultural communication.
Innovation Solution
A system that includes a device for capturing a user's non-verbal communication during conversation, evaluates these skills using a trained evaluation model, and provides feedback to enhance non-verbal communication abilities through personalized learning materials.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional shadowing apparatuses are used to improve verbal skills, then verbal communication ability is enhanced, but non-verbal communication skills remain undeveloped
Solution Approach 1:
The patent combines verbal skill evaluation (traditional shadowing) with non-verbal skill evaluation (body language, gestures, facial expressions) into a single integrated system. The evaluation apparatus simultaneously assesses both verbal and non-verbal communication skills, allowing users to improve both aspects together rather than separately.
Solution Approach 2:
The system serves multiple functions: it evaluates verbal skills, evaluates non-verbal skills, provides feedback on body language, and generates comprehensive learning reports. This multi-functional approach ensures that users receive holistic feedback covering both verbal and non-verbal communication dimensions.
2Device complexity
If only verbal skills are evaluated during shadowing, then evaluation simplicity is maintained, but communication effectiveness is reduced
Solution Approach 1:
The patent introduces an intermediary evaluation model that bridges verbal and non-verbal communication assessment. This model processes both audio (verbal) and video (non-verbal) data through a unified evaluation framework, making the system capable of comprehensive assessment without excessive complexity.
Solution Approach 2:
The system replaces manual evaluation methods with automated computer-based assessment using image processing and audio analysis technologies. This substitution enables objective, simultaneous evaluation of both verbal and non-verbal skills without requiring complex manual intervention.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
A system (100) for assisting a user to learn foreign languages includes a first device (145) for taking a picture of the user pronouncing in accordance with audio of a moving picture, a first memory (132D) storing therein exemplary non-verbal communication skills to be demonstrated by a speaker during conversation, a second memory (132F) storing therein a trained evaluation model for evaluating non-verbal communication skills of a speaker during conversation, a second device (131D) for comparing the exemplary non-verbal communication skills stored in the first memory (132D) to non-verbal communication skills of the user having been acquired by the first device (145), by means of the trained evaluation model (210B) stored in the second memory (132E), to thereby evaluate non-verbal communication skills of the user, and a third device (131E, 142) for displaying evaluation made by the second device (131D).