Speech-Responsive Digital Media for Personalized Literacy Learning

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing educational technologies fail to effectively engage young learners, particularly those who struggle with reading fluency, in interactive and personalized learning experiences that enhance vocabulary comprehension and literacy skills.

Innovation Solution

An AI-powered interactive digital media system that uses speech recognition to generate customized interactions, animations, and comparisons to enhance learning experiences, supported by a pipeline that includes media creation, distribution, and analysis for continuous improvement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional educational media is used, then content delivery is simple, but student engagement and comprehension are insufficient

Engineering Contradiction:

Improvestory comprehensionVSAvoidinteractive system complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system implements contingent interactions where the media responds to student speech inputs in real-time. Speech recognition technology detects student utterances and triggers appropriate responses such as animations, audio feedback, or narrative adjustments, creating a closed-loop feedback system that enhances comprehension while managing complexity through automated response selection

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent replaces traditional mechanical interaction methods (buttons, switches, physical manipulatives) with voice-based speech recognition and synthesis. This substitution allows students with attention issues or reading difficulties to interact naturally through speech, improving engagement and comprehension without requiring complex physical interfaces

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If interactive elements are added to engage students, then comprehension improves, but system complexity increases

Engineering Contradiction:

Improvevocabulary comprehensionVSAvoidmedia interaction complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system employs a multi-functional speech recognition engine that handles multiple interaction types (narrative control, vocabulary reinforcement, comprehension checking, animated character interaction) through a single unified interface. This universal approach improves vocabulary comprehension across different media types while avoiding the complexity of separate interaction systems for each function

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary layer of natural language processing between the student's speech and the media response system. This intermediary translates diverse student utterances into standardized commands or thematic responses, enabling rich interactive vocabulary learning without requiring the system to directly parse and respond to every possible student input variation

Inventive Principle:

Principle #24Intermediary (Mediator)

3Reliability

If personalized interactions are implemented, then learning effectiveness increases, but manufacturing and deployment complexity increases

Engineering Contradiction:

Improveliteracy skill improvementVSAvoidsystem deployment ease

Core Design Contradiction:

ReliabilityVSEase of manufacture

Solution Approach 1:

The system personalizes literacy learning by dynamically adjusting narrative parameters (difficulty level, vocabulary complexity, story pace, interaction frequency) based on student performance metrics and engagement patterns. These parameter changes are implemented through configuration files and algorithmic adjustments rather than physical customization, enabling scalable deployment while maintaining personalized effectiveness

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The patent implements preliminary personalization through pre-configured student profiles and adaptive algorithms that anticipate learning needs before formal instruction begins. Baseline assessments and initial interaction patterns are analyzed in advance to customize the media narrative and interaction style, allowing personalized literacy improvement to be deployed efficiently across multiple students without extensive individual setup

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS12444415B2Interactive system using speech recognition and digital media

Publication Date: 2025.10.14 CARNEGIE MELLON UNIV

AI summary

A system for interactive system using speech recognition and digital media is described. The system uses automated speech recognition and recognizes interactions from users to execute digital media items. The interactions are based on behavior of the user. The user is given a prompt. If the student responds to a prompt correctly, the student is rewarded with an animation. Otherwise the user experience continues without a reward. The system recognizes natural language responses for interactions of the user. The media item is dynamically generated as the user interacts with the digital media item.