Stylus Hover Controls and Pose Feedback for Lower-Power Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic devices face inefficiencies in user interaction methods, particularly with input devices like styluses, leading to increased cognitive burden and unnecessary processor and battery usage due to redundant inputs.

Innovation Solution

Implementing systems that provide additional controls and feedback when a stylus hovers over a user interface, perform contextual actions based on input, and convert handwritten input into font-based text, enhancing interaction efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the electronic device continuously monitors and processes all input device interactions, then the responsiveness and accuracy of input processing is improved, but the processor power consumption and battery drain increase

Engineering Contradiction:
Improveinput processing accuracyVSAvoidprocessor power consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary actions by detecting stylus hover events and pre-rendering contextual controls before the user actually interacts with the interface. This allows the system to prepare responses in advance, reducing the need for continuous high-power processing during actual user interaction.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system transitions from continuous monitoring to periodic monitoring by only activating full processing when specific trigger events occur (such as stylus hover detection or input gestures). This periodic activation maintains input accuracy while significantly reducing average power consumption compared to continuous processing.

Inventive Principle:
Principle #19Periodic action

2Ease of operation

If the electronic device provides detailed contextual feedback and additional controls for hover states, then the ease of operation and user experience is improved, but the device complexity increases

Engineering Contradiction:
Improveuser interaction efficiencyVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The interface dynamically adapts its complexity based on the interaction state. When the stylus hovers over a UI element, the system temporarily introduces additional contextual controls and feedback. When the stylus moves away or completes an action, the interface returns to its simpler default state. This dynamic adjustment maintains ease of operation during needed interactions while avoiding permanent complexity.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system segments the user interface into base elements and contextual overlays. The base UI remains simple and stable, while additional contextual controls are segmented as temporary overlays that appear only when needed. This segmentation allows the system to provide detailed feedback without permanently increasing the base interface complexity.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If the electronic device processes all input gestures and hover states, then the adaptability and contextual responsiveness is improved, but the loss of time for processing and rendering increases

Engineering Contradiction:
Improvecontextual action varietyVSAvoidprocessing and rendering time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary rendering of contextual controls and feedback visualizations before the user completes their input gesture. By pre-computing and displaying these elements in advance, the system reduces the processing time required during actual interaction, making the adaptability response feel more immediate despite the variety of contextual actions available.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250238124A1Interactions between an input device and an electronic device
Publication Date: 2025.07.24 APPLE INC
  • US20250238124A1 patent drawing
  • US20250238124A1 patent drawing
  • US20250238124A1 patent drawing

AI summary

Some embodiments described in this disclosure are directed to displaying additional controls and/or information when an input device such as a stylus is hovering over a user interface displayed by an electronic device. Some embodiments described in this disclosure are directed to providing feedback about the pose of an input device relative to a surface. Some embodiments of the disclosure are directed to performing contextual actions in response to input provided from an input device. Some embodiments of the disclosure are directed to providing handwritten input for conversion into font-based text using an input device.