Widget Grid Keystroke Accessibility via Assistive Translation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users with impairments, such as low-vision or blindness, face challenges in selecting information from grid representations on computer screens using assistive technologies, as traditional methods require mouse interactions that are difficult for these users.
Innovation Solution
The system enables selection of items in widgets, such as a calendar grid, by receiving code to display a grid, sending information to assistive systems, and configuring the device for keystroke operations, allowing users to select cells using arrow keys and enter keystrokes, thereby facilitating non-sighted usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional mouse-based point-and-click interface is used for grid selection, then the interface is simple and direct for able-bodied users, but it becomes inaccessible and difficult for users with visual or motor impairments
Solution Approach 1:
The patent introduces an assistive technology intermediary layer that translates keystroke inputs into grid cell selections. The system includes an accessibility module that receives keyboard inputs, determines the current grid context, calculates target cell positions based on arrow key presses, and simulates mouse click events on the appropriate cells. This intermediary translation layer enables users with motor impairments to interact with grid widgets using only keyboard inputs.
Solution Approach 2:
The patent replaces the mechanical mouse-based point-and-click interaction with a keyboard-based keystroke system. Instead of requiring physical mouse movement and clicking, the system uses virtual cursor navigation through arrow keys and cell selection through Enter key presses. This substitution of interaction mechanism makes the interface accessible to users who cannot use a mouse due to motor impairments.
2Loss of information
If screen-reader software reads out every date in the grid, then all information is provided to the user, but the user cannot efficiently locate and select the desired information
Solution Approach 1:
The patent implements preliminary action by pre-calculating and pre-positioning the virtual cursor at relevant grid cells based on user input patterns. When a user navigates through the grid using arrow keys, the system anticipates the user's selection intent and prepares the selection state in advance. This allows the user to simply press Enter to confirm the pre-positioned selection, rather than having to manually navigate to each cell and confirm individually.
Solution Approach 2:
The patent incorporates feedback mechanisms where the assistive technology provides auditory or tactile feedback about the current grid cell position, highlighted cell, and available navigation options. This feedback loop allows users with visual impairments to understand their current position in the grid and make informed selection decisions without having to mentally track their position through multiple rows and columns.
3Illumination intensity
If a magnifier is used to enlarge the grid cells, then visual clarity is improved, but users with motor impairments still cannot easily select cells without a mouse
Solution Approach 1:
The patent implements universality by designing the grid selection system to support multiple input modalities simultaneously. The same grid widget can be operated using mouse clicks for able-bodied users, keyboard arrow keys for users with motor impairments, or voice commands through integrated speech-to-text. This multi-functional input support ensures that users with different abilities can all access and interact with the same interface elements.
Data Source
AI summary
Methods and systems are disclosed for enabling item selection in a widget. An example method comprises receiving at an electronic device, from a server, code instructing the electronic device to display a widget having a grid comprising one or more cells configured for point-and-click selection. The method further comprises displaying the grid in accordance with the received code and sending information associated with a currently selected cell to an assistive system on the electronic device. The method further comprises configuring the electronic device for keystroke operation of the widget. The method further comprises identifying a non-entry keystroke, and in response, determining a new cell associated with the grid, selecting the new cell, and sending information associated with the new cell to the assistive system for output to the user. The method further comprises identifying an entry keystroke and, responsive thereto, sending information associated with the new cell to the server.