Non-Physical Control Feedback via Distance-Dependent Audio and Haptic Signals

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users face difficulties in operating devices with non-physical controls when they cannot or do not want to use visual feedback, such as in dark environments or when visually impaired, as non-physical controls cannot be detected by touch alone and require visual attention.

Innovation Solution

Devices provide non-visual feedback, such as audio or tactile cues, that change based on the distance between user input and the control location, allowing users to locate and interact with non-physical controls without relying on sight, including audio feedback that increases in volume as the user approaches the control and vibrates upon activation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If non-physical controls are used on a device, then the device interface can be more flexible and integrated, but the controls cannot be detected by touch alone and require visual feedback

Engineering Contradiction:

Improveinterface flexibilityVSAvoidcontrol detectability

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces an intermediary feedback mechanism (haptic feedback, audio feedback, or thermal feedback) that mediates between the user's touch and the non-physical control element. This intermediary provides detectable signals at the control location without requiring visual feedback, resolving the contradiction by making invisible controls detectable through alternative sensory channels.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the visual feedback mechanism with alternative feedback mechanisms such as haptic feedback, audio feedback, or thermal feedback. This substitution allows users to detect non-physical controls through touch, sound, or temperature changes rather than sight, maintaining interface flexibility while improving control detectability.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If visual feedback is required to locate non-physical controls, then controls can be precisely positioned, but users cannot operate the device when vision is unavailable or when they need to maintain focus elsewhere

Engineering Contradiction:

Improvecontrol location precisionVSAvoidoperability without vision

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent implements a feedback loop where the device provides real-time non-visual feedback (haptic, audio, or thermal) in response to user proximity and interaction with control elements. This feedback enables users to locate and operate controls precisely without vision by providing continuous sensory information about their finger's position relative to the control location.

Inventive Principle:

Principle #23Feedback

3Ease of operation

If the device provides visual depictions of non-physical controls, then users can easily locate controls, but the device cannot operate when visual display is broken or unavailable

Engineering Contradiction:

Improvecontrol locatabilityVSAvoidoperability under failure conditions

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The patent implements multiple feedback mechanisms (visual, haptic, audio, thermal) that can serve the same function of controlling the device. This multi-functionality ensures that if one feedback channel fails (such as visual display), other channels remain available to maintain control locatability and device operability, thereby improving reliability.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent changes the feedback parameter from visual only to include alternative parameters such as haptic feedback, audio feedback, or thermal feedback. This parameter diversification allows the device to maintain control locatability under various failure conditions by switching to available feedback modalities, improving overall system reliability.

Inventive Principle:

Principle #35Parameter changes

4Measurement precision

If users must look at the screen to locate controls, then precise control selection is possible, but users cannot maintain focus on other tasks simultaneously

Engineering Contradiction:

Improvecontrol selection accuracyVSAvoidmulti-task efficiency

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the visual feedback mechanism with alternative feedback mechanisms such as haptic feedback, audio feedback, or thermal feedback. This substitution allows users to locate and select controls precisely through non-visual senses while maintaining visual focus on other tasks, thereby improving multi-task efficiency without sacrificing control selection accuracy.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9977502B2Providing non-visual feedback for non-physical controls

Publication Date: 2018.05.22 APPLE INC

AI summary

Techniques are described herein to assist users to operate non-physical controls in situations where the users are unable to visually locate the controls. According to one embodiment, the device containing the non-physical controls is designed to give non-visual feedback to the user based, at least on part, on the distance between (a) the current position of user input, and (b) the location of the non-physical control. At least one characteristic of the non-visual feedback changes as that distance changes.