Optical Sensor Stylus Tracking on Touch and Passive Surfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing input devices, particularly styli, require a touch-sensitive surface to function effectively, limiting their usability on devices without such surfaces and necessitating improvements for enhanced precision and versatility.

Innovation Solution

Incorporating an optical flow sensor, ultrasonic sensors, and an inertial measurement unit into an input device to detect two- and three-dimensional movements, orientations, and distances, enabling accurate tracking on both touch-sensitive and passive surfaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If an active stylus is used to improve precision of stylus input, then measurement precision is improved, but the device requires a touch-sensitive surface which limits versatility

Engineering Contradiction:
Improveprecision of stylus inputVSAvoidusability on devices without touch-sensitive surfaces
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The input device integrates multiple sensing capabilities (optical flow sensor for 2D movement, ultrasonic sensor for distance, IMU for orientation) into a single device that can function on both touch-sensitive surfaces and passive surfaces, making it universally applicable across different device types without requiring specialized touch-sensitive infrastructure

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces reliance on touch-sensitive surface infrastructure with self-contained sensing mechanisms (optical flow sensor, ultrasonic sensor, IMU) that actively measure position and movement, substituting passive surface detection with active sensing that works on any surface

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If multiple sensors are integrated into the input device to enable tracking on various surfaces, then adaptability is improved, but device complexity increases

Engineering Contradiction:
Improvetracking capability on different surfacesVSAvoidnumber of sensors and components
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple sensing functions (2D movement detection, distance measurement, orientation sensing) into a single integrated input device housing, merging separate sensing systems into one unified device that operates协同 to provide comprehensive tracking capability across diverse surfaces

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The input device is divided into functionally distinct sensing components (optical flow sensor, ultrasonic sensor, IMU) each responsible for specific measurement tasks, allowing independent optimization of each sensor while maintaining overall system integration and manageable complexity

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution provides improved spatial tracking and command fidelity by combining sensor data, allowing precise input on a variety of surfaces, including those without touch sensitivity, enhancing user interface capabilities.

Implementation Method 1

an optical flow sensor disposed in the tip portion. The optical flow sensor can be configured to detect two-dimensional movement of the input device relative to a surface

Methodology Applied
Scientific EffectOptical flow detection: Photoelectric Effect

Implementation Method 2

an ultrasonic sensor configured to detect a distance between the input device and an object

Methodology Applied
Scientific EffectUltrasonic detection: Ultrasound

Implementation Method 3

an inertial measurement unit (IMU) configured to detect an orientation of the input device

Methodology Applied
Scientific EffectInertial measurement: Accelerometer

Data Source

PatentUS12578809B2Input device including optical sensor
Publication Date: 2026.03.17 APPLE INC
  • US12578809B2 patent drawing
  • US12578809B2 patent drawing
  • US12578809B2 patent drawing

AI summary

Input devices for electronic devices and systems that include input devices in communication with electronic devices are disclosed. In an example, an input device includes a housing that includes an elongate body and a tip coupled with the elongate body. The input device further includes an optical flow sensor disposed in the tip of the housing. The optical flow sensor is configured to detect two-dimensional movement of the input device relative to a surface. Additional information about the position of the input device can be determined using various sensors and emitters of the input device and a computing system connected to the input device.