Prosody Analysis Visualization for Scalable Reading Instruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current online prosody instruction methods are limited in scale and effectiveness, as teachers can only provide feedback to one student at a time, leading to embarrassment and inefficiency in virtual classrooms, and lack visual aids to improve reading rhythm, tone, pitch, and stress.

Innovation Solution

A software solution that captures and analyzes audio recordings of students reading aloud, providing data on prosody and comparing it to a reference standard, allowing for real-time visualization of improvements through graphical displays, enabling multiple students to learn simultaneously and independently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a teacher provides individual feedback to each student through video conference calls, then the quality of prosody instruction is maintained, but the scalability and efficiency of instruction deteriorates

Engineering Contradiction:
Improveprosody feedback qualityVSAvoidinstruction scalability
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system creates a copy of the teacher's prosody performance as a reference model, which is then used to automatically evaluate and provide feedback on student readings. This allows the teacher's expertise to be replicated and distributed to multiple students simultaneously without requiring the teacher's direct time and attention for each student.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system introduces an intermediary automated evaluation component that mediates between the teacher's reference performance and the student's reading. This intermediary analyzes audio recordings, compares them against the reference prosody, and provides automated feedback, freeing the teacher from direct involvement in each evaluation while maintaining consistent quality standards.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If multiple students read aloud simultaneously in a virtual classroom, then the scalability of instruction is improved, but the embarrassment and social pressure on students increases

Engineering Contradiction:
Improveinstruction scalabilityVSAvoidstudent embarrassment
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The system enables students to independently record and evaluate their own reading performances using the automated prosody analysis tool. Students can review their recordings, compare them against the reference prosody, and receive immediate feedback without requiring live teacher attention or exposing them to peer judgment, thereby eliminating embarrassment while maintaining scalable instruction.

Inventive Principle:
Principle #25Self-service

3Device complexity

If traditional online prosody instruction is used without visual aids, then the simplicity of the system is maintained, but the effectiveness of teaching rhythm, tone, pitch, and stress deteriorates

Engineering Contradiction:
Improvesystem simplicityVSAvoidprosody instruction effectiveness
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system uses visual color coding to represent different prosody dimensions such as pitch, stress, and rhythm. The interface displays visual indicators that change based on how well the student's reading matches the reference prosody, providing intuitive feedback on specific prosody elements without complicating the underlying system architecture.

Inventive Principle:
Principle #32Color changes

Data Source

PatentUS20230274732A1Applications and services for enhanced prosody instruction
Publication Date: 2023.08.31 MICROSOFT TECHNOLOGY LICENSING LLC
  • US20230274732A1 patent drawing
  • US20230274732A1 patent drawing
  • US20230274732A1 patent drawing

AI summary

Systems, methods, and software are disclosed herein that improve the instruction of prosody in the context of software applications and services. In various implementations, a service analyzes an audio recording of a user reading text aloud to determine the prosody of the reading. The service provides data to an application indicative the prosody, as well as a reference prosody for the text. The application may then display of a visualization of a comparison of the user prosody for the text to the reference prosody for the text for consumption by users, e.g., a teacher or the reader.