Accessibility Testing System for Mobile User Interfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users with disabilities face difficulties accessing computer programs due to user interfaces primarily designed for sighted, hearing, and keyboard-mouse users, lacking accessibility for those with disabilities.

Innovation Solution

A system generates an indication of appropriate tests to ensure user interfaces are accessible, including keyboard, gesture, and audio tests, using screen readers and haptic outputs to provide information to users with disabilities, categorizing user interface elements and providing presentations before release.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If user interfaces are designed for traditional keyboard and mouse users, then ease of operation is improved for able-bodied users, but accessibility deteriorates for users with disabilities

Engineering Contradiction:
Improveease of operationVSAvoidadaptability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system implements a universal accessibility testing framework that evaluates user interfaces against multiple accessibility criteria and provides tailored test indications for different disability types (visual, auditory, motor). The framework generates comprehensive test plans that cover keyboard navigation, screen reader compatibility, gesture recognition, and haptic feedback, enabling a single interface design to be validated across multiple accessibility dimensions simultaneously.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adjusts testing parameters based on the specific disability being evaluated. For visual impairments, it focuses on screen reader compatibility and audio cues; for auditory impairments, it emphasizes visual indicators and haptic feedback; for motor impairments, it tests keyboard and gesture alternatives. This parameter adaptation allows the same testing system to effectively assess different accessibility requirements without redesigning the entire evaluation framework.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If comprehensive accessibility tests are implemented, then accessibility for users with disabilities is improved, but device complexity increases

Engineering Contradiction:
ImproveaccessibilityVSAvoidcomplexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The accessibility testing system is segmented into distinct testing modules, each dedicated to specific accessibility aspects: keyboard navigation testing, screen reader compatibility testing, gesture recognition testing, and haptic feedback testing. The system further divides these into sub-tests based on specific disability types and interface elements. This segmentation allows the comprehensive accessibility evaluation to be broken down into manageable, independent test units that can be executed systematically without overwhelming complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary testing framework that acts as a mediator between the user interface and the accessibility evaluation process. This framework includes automated testing tools that simulate different user scenarios and generate structured test indications. The intermediary layer translates complex accessibility requirements into standardized test protocols, reducing the complexity of implementing comprehensive accessibility testing while maintaining thorough evaluation coverage.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If multiple types of tests (keyboard, gesture, audio) are provided, then completeness of accessibility testing is improved, but time required for testing increases

Engineering Contradiction:
ImprovecompletenessVSAvoidtime
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of the user interface to automatically generate prioritized test indications before actual testing begins. By pre-identifying critical accessibility barriers and generating optimized test plans based on the interface structure and target user population, the system eliminates redundant testing and focuses resources on the most impactful accessibility checks. This preliminary action significantly reduces the time required for comprehensive accessibility testing while maintaining high reliability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements partial testing strategies that select the most relevant accessibility tests based on the specific interface elements and target disabilities. Rather than always executing every possible test, the framework dynamically determines the minimum sufficient test set that provides reliable accessibility verification for the given context. This partial action approach maintains testing completeness for critical accessibility aspects while reducing overall testing time by excluding irrelevant tests.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11860767B2Testing computer program accessibility for users with disabilities, such as for use with mobile phones
Publication Date: 2024.01.02 T MOBILE US INC
  • US11860767B2 patent drawing
  • US11860767B2 patent drawing
  • US11860767B2 patent drawing

AI summary

Disclosed here is a system to enable interaction between a user with a disability and a computer program. The system can obtain a representation of a user interface to present to a user. The system can determine an element associated with the user interface, where the element is configured to provide information to the user, however, the user interface presentation of the element at least partially fails to provide the information to the user. Based on the element, the system can determine an appropriate test to perform. The appropriate test indicates at least two of: a test to perform with a keyboard, a gesture test to perform with a mobile screen reader, and an audio test to perform with a screen reader. The system can generate an indication of the appropriate test. The system can provide the indication of the appropriate test prior to releasing the user interface to the user.