Pointing Device Sensor Array for Gesture Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic devices with input-output capabilities, such as computer mice and trackpads, are limited in their ability to gather user input, making it difficult for users to supply desired input to systems or receive appropriate output.

Innovation Solution

The implementation of an electronic device equipped with a variety of sensors, including device position sensors, optical sensors, capacitive sensors, and image sensors, to gather user input from pointing devices, finger movements, gestures, and other interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional pointing devices like computer mice are used, then basic cursor positioning is achieved, but input-output capabilities are limited

Engineering Contradiction:
Improveinput-output capabilitiesVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements multiple sensor types (optical sensors, capacitive sensors, image sensors, accelerometers) within a single pointing device to enable diverse input modalities including finger tracking, gesture recognition, and motion detection. This allows the device to perform multiple functions beyond basic cursor positioning, such as detecting finger position on adjacent surfaces, recognizing three-dimensional gestures, and providing haptic feedback, thereby achieving universality without requiring multiple separate devices

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines previously separate input devices and functionalities into a single integrated pointing device. By merging optical sensing, capacitive sensing, image sensing, and haptic output capabilities into one device, the patent achieves enhanced input-output versatility while consolidating device complexity into a unified system rather than requiring multiple separate components

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If multiple sensor types are added to enhance input capabilities, then user interaction comprehensiveness is improved, but device complexity increases

Engineering Contradiction:
Improveuser interaction capabilitiesVSAvoidsensor array complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the sensing functions by assigning different sensor types to detect different aspects of user interaction: optical sensors track finger position on adjacent surfaces, capacitive sensors detect proximity and touch gestures, image sensors capture three-dimensional hand gestures, and accelerometers measure device motion. This segmentation allows each sensor type to specialize in specific detection tasks, improving overall interaction capabilities while organizing complexity into manageable functional modules

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses an adjacent surface (such as a table or desk) as an intermediary medium that extends the input capabilities of the pointing device. By detecting finger position and gestures on this external surface through optical and capacitive sensors, the device gains enhanced interaction capabilities without adding complex internal components, effectively using the environment as part of the input interface

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances the input-output capabilities of electronic devices, allowing for more comprehensive user interaction, including three-dimensional gestures and haptic feedback, thereby improving user engagement and system control.

Implementation Method 1

a device position sensor having a light source that illuminates a portion of a surface that is overlapped by the mouse and having an image sensor configured to determine a location of the electronic pointing device on the surface and/or to measure movement of the electronic device relative to the surface based on captured images of the illuminated portion

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

The sensors may be optical sensors based on light-sources such as light-emitting diodes or lasers and light detectors

Methodology Applied
Scientific EffectLight emission: Light Emitting Diode

Implementation Method 3

optical sensors based on light-sources such as light-emitting diodes or lasers and light detectors

Methodology Applied
Scientific EffectLight detection: Photoelectric Effect

Implementation Method 4

Accelerometers may measure user finger input vibrations that are conveyed to an electronic device through the surface

Methodology Applied
Scientific EffectVibration detection: Accelerometer

Implementation Method 5

Haptic output devices may be used in providing haptic feedback through the surface

Methodology Applied
Scientific EffectHaptic feedback: Vibration

Data Source

PatentUS12293028B1Electronic devices with extended input-output capabilities
Publication Date: 2025.05.06 APPLE INC
  • US12293028B1 patent drawing
  • US12293028B1 patent drawing
  • US12293028B1 patent drawing

AI summary

An electronic pointing device such as a computer mouse may be used in gathering user input from a user. The electronic pointing device may be provided with a light source that illuminates a portion of a surface that is overlapped by the mouse and a light sensor configured to monitor movement of the electronic pointing device across the surface based on reflected light from the illuminated portion. The electronic pointing device may have an array of sensors on a housing sidewall configured to gather information on the location of a finger of the user in an area that is laterally adjacent to the electronic pointing device. The sensors may be optical sensors based on light-sources such as light-emitting diodes or lasers and light detectors. Capacitive sensors may also be used in gathering user finger input in the area laterally adjacent to the electronic pointing device.