Screen Reader Layout Table Detection Heuristic
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Screen readers face significant cognitive load for users when reading content that includes layout tables, as they must announce irrelevant table metadata, which is not only distracting but also consumes computer resources and bandwidth.
Innovation Solution
A system that determines whether a table is a data table or a layout table using a rule-based heuristic, allowing the screen reader to skip over presentation information associated with layout tables and focus on reading cell data content, thereby reducing the reading of table-related information and improving user experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the screen reader reads all table metadata including layout tables, then complete information is provided to the user, but cognitive load increases and user experience deteriorates
Solution Approach 1:
The patent segments tables into two distinct types: data tables and layout tables. This segmentation allows the screen reader to apply different reading strategies to each type, reading metadata for data tables while skipping it for layout tables, thereby reducing cognitive load without losing important information.
Solution Approach 2:
The patent extracts and removes irrelevant table metadata from layout tables before presenting it to the user. By identifying layout tables through heuristic analysis and extracting their metadata, the system eliminates distracting information while preserving essential content, improving user experience without sacrificing information completeness.
2Loss of information
If the screen reader processes and announces all table metadata, then comprehensive content coverage is achieved, but computer resources and bandwidth are consumed
Solution Approach 1:
The system segments tables into data tables and layout tables, enabling selective processing. By identifying layout tables through structural analysis and metadata examination, the screen reader processes only data tables in full detail, significantly reducing computational resources and bandwidth consumption while maintaining comprehensive coverage of meaningful content.
Solution Approach 2:
The patent applies partial action by reading only the necessary portion of table metadata - specifically, it reads metadata for data tables while skipping metadata for layout tables. This selective approach reduces resource consumption and bandwidth usage while still providing complete coverage of relevant information.
3Loss of information
If the screen reader reads presentation information from layout tables, then all displayed information is conveyed, but cognitive load increases for users
Solution Approach 1:
The patent segments tables into data tables and layout tables based on their structural characteristics and metadata. This segmentation enables the screen reader to convey complete information from data tables while filtering out presentation information from layout tables, thereby maintaining information completeness while reducing cognitive load for visually impaired users.
Solution Approach 2:
The system extracts and removes presentation information from layout tables before presenting content to the user. By identifying layout tables through heuristic analysis of their structure and metadata, the screen reader extracts only the essential content while eliminating distracting presentation details, reducing cognitive complexity without losing important information.
Data Source
AI summary
Described herein is a system and method for detecting a layout table by a screen reader. Information regarding a document being displayed by an application is received from an application programming interface of a user interface automation system that provides information regarding user interface elements of application and/or the application. The information includes an indication that the document comprises a table. A determination is made as to whether the table is a data table or a layout table based upon the received information using a rule-based heuristic. When it is determined that the table is a layout table, presentation information associated with the layout table can be skipped over, and, cell data content within the layout table provided. Thus, for a determined layout table, the system and method allow the screen reader to act as if the containing table doesn't exist, but still read the content.