Touch Region Audio Feedback for Visually Impaired Screen Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users with visual impairments face inefficiencies in interacting with mobile devices due to their inability to see screen content and accurately tap locations, relying heavily on screen reading services to navigate and select functions.

Innovation Solution

A terminal device that receives a location signal to determine if a touch point is within a target area, providing feedback to introduce the corresponding function, enabling various instructions to interact with the device more efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If screen reading service traverses all content to help users find functions, then users with visual impairments can access all functions, but interaction efficiency is low and time consumption is high

Engineering Contradiction:
ImproveAccessibility for visually impaired usersVSAvoidInteraction efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system provides audio feedback that announces function names when users touch specific regions on the screen. This feedback mechanism allows users to identify functions without traversing all content sequentially, significantly improving interaction efficiency while maintaining accessibility for visually impaired users.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The screen is divided into multiple touch regions, each corresponding to a specific function. This segmentation allows users to directly access functions by touching the corresponding region rather than traversing through all content, resolving the contradiction between accessibility and interaction efficiency.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If focus traverses all functions on the page, then users can select any function, but the process is time-consuming and inefficient

Engineering Contradiction:
ImproveFunction selection capabilityVSAvoidTime to locate and select function
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

Function names are pre-configured and associated with specific touch regions on the screen. When users touch these regions, the corresponding function names are immediately announced through audio feedback. This preliminary arrangement eliminates the need for sequential traversal, allowing users to quickly locate and select desired functions without time loss.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12619348B2Interaction method of a terminal device for a user with visual impairment
Publication Date: 2026.05.05 HUAWEI TECH CO LTD
  • US12619348B2 patent drawing
  • US12619348B2 patent drawing
  • US12619348B2 patent drawing

AI summary

An interaction method and a terminal device. The terminal device receives a first location signal through a screen. An interface displayed on the screen includes an operation area and a display area, the operation area includes a first target area, and a page displayed in the display area includes a first target function. The terminal device determines, based on the first location signal, that a location of a touch point is in the first target area, and then the terminal device provides a first feedback used to introduce the first target function.