Eye Tracking Closed Captioning Dynamics
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional closed captioning technologies obstruct visual content and are cumbersome for users, especially non-native speakers, as they require frequent activation and deactivation, which can disrupt the viewing experience and comprehension of media.
Innovation Solution
A system using an eye tracking device to detect gaze patterns and control closed captioning, allowing the system to temporarily deemphasize or reemphasize the display of closed captioning text based on user interaction, such as gaze direction and reading speed, thereby enhancing the viewing experience without the need for remote control intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If closed captioning is displayed continuously, then hearing impaired users can understand dialogue, but visual content is occluded and user experience deteriorates
Solution Approach 1:
The closed captioning display transitions from a static continuous state to a dynamic state that automatically adjusts visibility based on real-time eye tracking data. When the system detects the user is looking at the screen, captions are displayed; when the user looks away, captions are hidden. This dynamic adaptation resolves the contradiction by making the display state contingent on actual user needs rather than remaining constantly visible.
2Object-affected harmful factors
If closed captioning is turned off, then visual content is fully visible, but users must frequently use remote control to reactivate captions when encountering unfamiliar language passages
Solution Approach 1:
The system employs eye tracking technology to automatically detect when a user needs captions and activates them without manual intervention. When the system detects the user looking at the screen followed by indicators of comprehension difficulty (such as prolonged fixation or repeated viewing of the same passage), it automatically displays captions. This self-service mechanism eliminates the need for users to manually operate the remote control to toggle captions on and off.
3Reliability
If closed captioning is activated manually, then users can understand dialogue, but the process of turning captions on and off disrupts media playback and comprehension
Solution Approach 1:
The system continuously monitors user behavior through eye tracking and provides real-time feedback to automatically adjust caption display. By detecting patterns such as prolonged fixation on specific areas, repeated viewing of the same passage, or indicators of comprehension difficulty, the system feedback-drivenly activates captions only when needed. This eliminates manual interruptions and maintains continuous, seamless media playback while ensuring comprehension support is available precisely when required.
Data Source
AI summary
Systems and methods for controlling closed captioning using an eye tracking device are provided. The system for controlling closed captioning may comprise a display device, a closed captioning controller configured to display closed captioning text for a media item during playback on the display device, and an eye tracking device configured to detect a location of a user's gaze relative to the display device and send the location to the closed captioning controller. The closed captioning controller may be configured to recognize a predetermined gaze pattern of the user's gaze and, upon detecting the predetermined gaze pattern, partially or completely deemphasize the display of the closed captioning text.