Read-Along Synchronization and Highlighting System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies fail to provide a holistic read-along experience that synchronizes text with media files, including image and PDF files, and offers effective closed captioning and highlighting, particularly for individuals with hearing impairments, as they do not accurately reflect natural reading setups and often lack features like customizable font sizes and colors.
Innovation Solution
A system and method that includes an input unit for receiving media and text files, an extracting unit for generating target text and audio with speech marks, a mapping unit for coordinating text and audio, an image resizing unit for dynamic text adjustment, and a processing unit for synchronizing and highlighting text based on audio, providing closed captions and customizable display preferences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If speech-to-text analysis is used in online read-along programs, then text can be generated from audio files, but the speech and text do not synchronize well and do not reflect natural reading setups
Solution Approach 1:
The patent introduces an intermediary processing layer between speech-to-text analysis and display that includes timing analysis and synchronization modules. This intermediary component analyzes the temporal relationships between speech events and text segments, adjusting the synchronization to match natural reading patterns rather than raw speech timing.
Solution Approach 2:
The system dynamically adjusts multiple parameters including text display timing, highlighting duration, font size, and color based on the analyzed speech patterns. By changing these display parameters to match natural reading tempos and pauses, the system achieves better synchronization accuracy while maintaining automated operation.
2Adaptability or versatility
If closed captions are provided for individuals with hearing impairments, then audio content becomes accessible, but the captions are not highlighted to stand distinct and timed accurately
Solution Approach 1:
The patent applies local quality by making specific portions of the closed captions visually distinct through highlighting at different times and with different intensities. Individual words or phrases are highlighted based on their importance and timing in the audio content, creating local visual variations that guide the viewer's attention to the currently spoken content.
Solution Approach 2:
The caption highlighting system is dynamic, automatically adjusting which text elements are highlighted, their duration, color intensity, and position based on the real-time audio content. This dynamic adaptation ensures accurate timing synchronization while maintaining high accessibility for hearing-impaired users.
3Reliability
If traditional Read-Along programs group students by reading proficiency, then reading intervention becomes effective, but students feel left out and not all become proficient readers
Solution Approach 1:
The patent creates a universal read-along system that serves multiple functions simultaneously: it provides reading intervention for struggling students while also engaging advanced readers. The system adapts to individual reading levels automatically through technology, allowing all students to participate together without feeling left out, thus maintaining both effectiveness and inclusivity.
4Adaptability or versatility
If customizable display preferences are added for font size and color, then readability improves for individuals with disabilities, but system complexity increases
Solution Approach 1:
The patent implements self-service by allowing users to automatically adjust display preferences based on their needs. The system provides default customizable settings for font size, color, and highlighting that users can modify without technical assistance. This self-service approach improves accessibility while minimizing the complexity burden on users.
Data Source
AI summary
The present invention relates to a system and method for synchronizing and highlighting a target text and audio associated with a reference document. The system and method may comprise one or more of an input unit, an extracting unit, a mapping unit, a processing unit, and an image resizing unit. The system and method may synchronize the target text and audio in order to provide a user with a Read Along. The invention further synchronizes and highlights closed captions and audio that helps people with hearing impairment to comprehend better while watching a movie or listening to songs.