Eye Gaze Reading Order for Screen Reader Accessibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic content playback systems, such as screen readers, often present digital information in a linear and disorganized manner, leading to confusion and reduced comprehension for visually impaired users and those distracted, as they fail to accurately represent the spatial layout of documents, resulting in a disjointed listening experience.
Innovation Solution
A system that utilizes eye gaze data to detect fixation clusters and generate a user attention sequence, which is then used to calculate a more natural and intuitive reading order for audio playback, aligning with how sighted users naturally navigate electronic content, thereby enhancing the listening experience by maintaining the spatial structure and continuity of document information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional linear playback order is used for screen readers, then the system is simple to implement, but the listening experience becomes disjointed and comprehension is reduced
Solution Approach 1:
The system performs preliminary analysis of eye gaze data from multiple users before audio playback to determine the optimal reading order. By pre-processing gaze data to identify fixation clusters and determine content importance and spatial relationships, the system prepares the best playback sequence in advance, resolving the contradiction between simple implementation and improved listening experience.
Solution Approach 2:
The system introduces eye gaze data as an intermediary element between the electronic content and the playback order determination. This intermediary data captures natural reading patterns and spatial awareness, allowing the system to translate visual inspection behavior into optimized audio playback sequences without requiring complex rule-based systems.
2Loss of information
If spatial layout information is ignored in audio playback, then the playback process is simple, but continuity of document information is lost
Solution Approach 1:
The system uses eye gaze data as feedback to understand how users naturally perceive spatial relationships in electronic content. By analyzing where users fixate and how they move between content regions, the system learns spatial structure importance and incorporates it into playback order determination, maintaining continuity without requiring explicit spatial annotation of the content.
Solution Approach 2:
The system copies natural reading patterns captured from sighted users' eye gaze behavior and applies them to guide audio playback order for visually impaired users. This copying of behavioral patterns preserves spatial structure continuity by replicating the natural sequence in which users encounter and process content spatially organized information.
3Measurement precision
If eye gaze data collection is implemented, then reading order accuracy is improved, but the system requires additional hardware and data processing
Solution Approach 1:
The system designs the eye tracking capability to serve multiple functions: determining reading order, analyzing content importance, understanding user attention patterns, and capturing spatial relationships. By making the eye tracking system multi-functional, the patent justifies the added complexity through broad applicability across different content types and user needs.
Solution Approach 2:
The system uses eye gaze data collected from sighted users to automatically train and improve its own playback order determination algorithms. The accumulated gaze data becomes a self-improving resource that refines the system's understanding of natural reading patterns over time, reducing the need for manual configuration and external intervention.
Data Source
AI summary
A reading order extrapolation and management system and process for facilitating auditory comprehension of electronic documents. As an example, a user may access contents of an electronic document via an application and request a speech-synthesized recitation of any media in the electronic document. The application may make use of a reading order that has been specifically generated and improved by reference to eye tracking data from users reading the document. A reading order can be assigned to a document and implemented when, for example, a screen reader is engaged for use with the document. Such systems can be of great benefit to users with visually impairments and/or distracted users seeking a meaningful audio presentation of textual content.