User Interface Visual Feedback for Accessibility Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Vision-impaired users face difficulties in tracking cursor movements and collaborating with others in navigating user interfaces, as existing accessibility technologies do not adequately provide visual feedback to enhance interaction visibility and assistive navigation.

Innovation Solution

The system enhances visual feedback in user interfaces by visually highlighting interacted items at conspicuous locations, using caption panels to display feedback, and altering the interface for improved visibility, allowing items to be interacted with from within an interaction panel, and providing enhanced feedback for interaction events.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If an accessibility cursor is used to navigate the user interface, then navigation capability is improved, but visual tracking difficulty persists for vision-impaired users

Engineering Contradiction:
Improvenavigation capabilityVSAvoidvisual tracking difficulty
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent creates a visual copy or representation of the accessibility cursor's location and interactions in the form of captions. These captions provide a parallel visual track of cursor movements and interface interactions, allowing vision-impaired users to follow along without directly tracking the physical cursor. The captions serve as an informational duplicate that is easier to perceive and process.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces captions as an intermediary element between the accessibility cursor and the user. Instead of requiring direct visual tracking of the cursor, the captions mediate the information transfer by converting cursor actions into readable text descriptions, thereby reducing the visual tracking burden while maintaining navigation awareness.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Stability of the object's composition

If traditional user interface elements are displayed at their original locations, then interface layout is maintained, but interaction visibility is reduced for accessibility users

Engineering Contradiction:
Improveinterface layoutVSAvoidinteraction visibility
Core Design Contradiction:
Stability of the object's compositionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies local quality by providing enhanced visual information (captions) specifically at locations where interaction information is needed, rather than uniformly modifying the entire interface. The captions are strategically positioned to provide localized enhancement of interaction visibility without disrupting the overall interface layout or requiring global redesign.

Inventive Principle:
Principle #3Local quality

3Difficulty of detecting and measuring

If visual enhancement is applied to interacted items, then interaction visibility is improved, but interface complexity increases

Engineering Contradiction:
Improveinteraction visibilityVSAvoidinterface complexity
Core Design Contradiction:
Difficulty of detecting and measuringVSDevice complexity

Solution Approach 1:

The patent extracts interaction information from the original interface elements and presents it separately in captions. This separation allows the enhanced visual feedback to be provided without adding visual clutter or complexity to the original interface elements themselves. The interaction details are taken out and displayed in a dedicated caption format, maintaining interface simplicity while improving visibility.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS8060821B2Enhanced visual feedback of interactions with user interface
Publication Date: 2011.11.15 APPLE INC
  • US8060821B2 patent drawing
  • US8060821B2 patent drawing
  • US8060821B2 patent drawing

AI summary

An item in a user interface is visually enhanced in response to an interaction with the item or in response to a request. In some implementations, the item (e.g., an icon, button, text, etc.) is visually enhanced and displayed in the user interface at a conspicuous location (e.g., the center of the user interface). Optionally, the user interface can be altered (e.g., darkened) to improve the visibility of the enhanced item. In some implementations, visual enhancement includes displaying enhanced feedback (e.g., text, data, graphical objects or images, etc.) associated with the item in a caption panel. The caption panel can display enhanced feedback associated with any items in the user interface and not just the item associated with a current user interaction. In some implementations, the user can interact with items (e.g., launch an application) from within an interaction panel.