Virtual Key Vibration Feedback for Visually Impaired Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Visually impaired users, such as the blind, face challenges in interacting with user interfaces on terminals as they cannot accurately locate and respond to visual feedback, making it difficult to engage with interfaces designed for visual interaction.

Innovation Solution

A method and apparatus for setting virtual keys on a user interface that determines operation position information from touch operations, generates virtual keys based on user-specific physiological characteristics and touch habits, and uses differentiated vibration effects to assist tactile perception and feedback identification, enabling interaction without visual intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If visual feedback and visual interaction methods are used, then interaction precision is improved for visually able users, but visually impaired users cannot accurately locate and view feedback

Engineering Contradiction:
Improveinteraction precisionVSAvoidaccessibility for visually impaired users
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent replaces visual feedback mechanisms with tactile feedback mechanisms. Specifically, it substitutes visual display elements with haptic feedback elements such as vibration patterns, tactile sensations, and force feedback that can be perceived through touch, enabling visually impaired users to interact with the interface accurately without relying on visual cues

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces tactile feedback as an intermediary between the user and the interface. By using haptic actuators, vibration motors, and tactile display elements as mediators, the system translates interface interactions into tangible sensations that visually impaired users can detect and respond to, bridging the gap between visual interface design and tactile user capabilities

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If virtual keys are generated based on user touch operations, then ease of operation is improved for visually impaired users, but device complexity increases due to vibration effect calculation and waveform comparison

Engineering Contradiction:
Improvetactile interaction easeVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent performs preliminary analysis of user touch operations to identify patterns and characteristics before generating virtual keys. By pre-processing touch data, analyzing finger differences, and predicting intended key locations based on touch patterns, the system simplifies the subsequent key generation process and reduces real-time computational complexity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent transforms complex vibration waveform comparison into simplified parameter-based differentiation. By extracting key parameters from vibration waveforms (such as frequency, amplitude, duration) and comparing these parameters rather than full waveforms, the system reduces computational complexity while maintaining the ability to provide differentiated tactile feedback for virtual keys

Inventive Principle:
Principle #35Parameter changes

3Reliability

If differentiated vibration effects are adapted for different virtual keys, then feedback distinguishability is improved, but processing time increases due to waveform similarity calculation

Engineering Contradiction:
Improvefeedback identification reliabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies differentiated vibration characteristics to specific virtual keys based on their location and function. By assigning unique vibration patterns, frequencies, or intensities to specific key regions, the system enables visually impaired users to distinguish between different keys through localized tactile feedback without requiring comprehensive waveform analysis for every interaction

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent uses partial waveform comparison rather than complete waveform analysis. By comparing only critical segments or key parameters of vibration waveforms rather than entire waveforms, the system achieves sufficient discrimination between different virtual keys while significantly reducing processing time and computational resources required

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables visually impaired users to interact with user interfaces quickly and accurately through tactile means, improving interaction reliability and accessibility by generating virtual keys and adapting vibration effects for distinct feedback.

Implementation Method 1

a vibration module, configured to determine, in response to touch regions on the user interface being provided with other virtual keys, a vibration effect for the virtual key to obtain a target vibration waveform corresponding to the vibration effect

Methodology Applied
Scientific EffectVibration: Vibration

Data Source

PatentUS11681434B2Method and apparatus for setting virtual keys, medium, and electronic device
Publication Date: 2023.06.20 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US11681434B2 patent drawing
  • US11681434B2 patent drawing
  • US11681434B2 patent drawing

AI summary

The present disclosure relates to the technical field of computers, and provides a method and apparatus for setting virtual keys on a user interface performed by an electronic device. The method includes: determining, in response to at least two touch operations acting on a user interface, at least two pieces of operation position information of the at least two touch operations; identifying, according to the at least two pieces of operation position information, a target virtual key on the user interface; obtaining a target vibration waveform corresponding to the target vibration key, and performing waveform similarity calculation on the target vibration waveform and other vibration waveforms adapted to at least one other virtual key on the user interface to obtain a waveform difference value; and when the waveform difference value is greater than a predefined threshold, determining that the target vibration waveform is associated with the target virtual key.