Handheld Controller Haptics and Sensor Fusion for VR Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing input devices for computer systems, such as computer mice and force-feedback gloves, are often cumbersome, uncomfortable, or provide inadequate feedback, making them inconvenient for users.

Innovation Solution

A handheld controller with a housing featuring an elongated shaft, touch sensors, rotating scroll wheels, force-sensitive tips, and haptic output devices, along with a head-mounted device for tracking and providing haptic feedback, is designed to enhance user interaction and feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional input devices like computer mice or force-feedback gloves are used, then basic input functionality is achieved, but user comfort and feedback quality deteriorate due to cumbersome design and inadequate feedback

Engineering Contradiction:
Improveuser comfortVSAvoiddevice design
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The handheld controller is divided into multiple separable components including a main body housing, removable tip portions, and interchangeable input elements. This segmentation allows users to customize the controller for different tasks while maintaining a comfortable ergonomic form factor, resolving the contradiction between ease of operation and device complexity by making the complex aspects modular and interchangeable rather than fixed

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The controller integrates multiple input modalities (touch sensors, force-sensitive tips, rotating scroll wheels, buttons) and output modalities (haptic feedback, visual feedback through LED markers) into a single universal device. This multi-functionality eliminates the need for multiple specialized devices, improving ease of operation while the integrated design manages complexity through unified architecture

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If traditional input devices are used, then input functionality is provided, but feedback quality deteriorates due to inadequate haptic and sensory response

Engineering Contradiction:
Improvefeedback qualityVSAvoidsensor integration
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The controller merges multiple sensing technologies (touch sensors, force sensors, inertial measurement units, optical tracking markers) and actuation mechanisms (haptic output devices, vibrators) into a single integrated unit. This consolidation improves feedback quality by coordinating multiple sensory channels while managing complexity through unified control circuitry that processes inputs from all sensors and coordinates outputs to all actuators

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The controller implements closed-loop feedback by continuously monitoring inputs from multiple sensors (touch, force, motion, position) and immediately responding through haptic output devices and visual feedback markers. This real-time feedback loop enhances reliability of interaction by providing consistent sensory response, while the integrated feedback processing manages complexity through centralized control algorithms

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If the controller housing is made as a single piece, then manufacturing is simplified, but adaptability deteriorates because the controller cannot be customized or reconfigured

Engineering Contradiction:
Improvecontroller configurationVSAvoidhousing production
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The housing is segmented into modular components (main body, tip portions, input element housings) that can be manufactured separately and assembled in different configurations. This modular segmentation enables customization and reconfiguration for different applications while each individual component remains relatively simple to manufacture using standard molding or machining processes

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The controller transitions from a static fixed design to a dynamic reconfigurable system where components can be added, removed, or interchanged based on user needs. This dynamic adaptability is achieved through standardized connection interfaces that maintain manufacturing simplicity while enabling versatile configuration changes

Inventive Principle:
Principle #15Dynamics

4Measurement precision

If multiple sensors and input devices are integrated into the controller, then measurement precision and control capability improve, but device complexity increases

Engineering Contradiction:
Improveinput detection accuracyVSAvoidcontroller structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Multiple sensing functions (touch detection, force measurement, acceleration sensing, optical tracking) are merged into a single integrated controller unit with unified control circuitry. This consolidation improves measurement precision by coordinating data from all sensors and reducing integration errors, while managing structural complexity through a compact modular architecture that groups related components together

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The handheld controller provides intuitive and comfortable user input and output, allowing for precise control and immersive interaction with virtual reality systems through advanced sensor integration and haptic feedback.

Implementation Method 1

A touch sensor may be located on the curved surface and may be configured to gather touch input such as swipe input, tap input, multitouch input

Methodology Applied
Scientific EffectCapacitive sensing: Capacitance

Implementation Method 2

one of the tip portions may have a force sensor and may be force-sensitive

Methodology Applied
Scientific EffectPiezoresistive effect: Piezoresistive Effect

Implementation Method 3

The handheld controller may include an inertial measurement unit such as one or more accelerometers, gyroscopes, and/or compasses

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Implementation Method 4

One or more haptic output devices such as an actuator may be mounted in the housing. Control circuitry in the handheld controller may use the haptic output device to provide haptic output

Methodology Applied
Scientific EffectVibration: Vibration

Data Source

PatentUS12524088B2Computer systems with handheld controllers
Publication Date: 2026.01.13 APPLE INC
  • US12524088B2 patent drawing
  • US12524088B2 patent drawing
  • US12524088B2 patent drawing

AI summary

A system may include an electronic device such as a head-mounted device and a handheld controller for controlling the electronic device. The handheld controller may have a housing with an elongated shaft extending between first and second tip portions. The handheld controller may include a touch sensor for gathering touch input, a button, rotating scroll wheel, or other input device for gathering other user input, a force sensor for gathering force input, an inertial measurement unit for gathering motion data, a camera for capturing images of the environment, and/or one or more haptic output devices such as an actuator for providing haptic output. The control circuitry may send control signals to the head-mounted device based on the sensor data and user input (e.g., force input, touch input, motion input, voice input, etc.) gathered with the handheld controller.