Handheld Controller with Removable Tip for Surface Marking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing input devices for computer systems, such as mice and force-feedback gloves, can be cumbersome, uncomfortable, and provide inadequate feedback, limiting user interaction and control, especially in virtual reality systems.

Innovation Solution

A handheld controller system that operates in both surface marking mode and air input mode, featuring a removable tip member with integrated sensors for tracking surface markings and interacting with virtual objects, providing enhanced user input and feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional input devices like mice and force-feedback gloves are used, then basic input functionality is provided, but the devices become cumbersome and uncomfortable for users

Engineering Contradiction:
Improveuser comfortVSAvoiddevice structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The controller is divided into a main body housing and a separate removable tip member. The tip member can be detached and replaced, allowing the sensing elements to be segmented from the main control structure. This segmentation reduces the complexity of the main housing while maintaining input functionality through the removable tip.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The controller is designed to operate in multiple modes: surface marking mode for interacting with physical surfaces and air input mode for interacting with virtual objects in augmented reality. The same basic structure supports both functionality types, making the device universal and reducing overall complexity compared to having separate specialized devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If traditional input devices are used, then basic control is achieved, but inadequate feedback is provided to the user

Engineering Contradiction:
Improvefeedback qualityVSAvoidsensor integration
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Multiple sensing capabilities are merged into the removable tip member, including position sensors (optical flow sensor, visual inertial odometry camera, interferometer) and force sensors. This consolidation provides comprehensive feedback for both surface marking and air input modes within a single integrated component, improving reliability without significantly increasing overall device complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The controller incorporates multiple sensors that provide real-time feedback about user interactions. Position sensors track the controller's location and orientation, while force sensors detect contact with surfaces. This multi-sensor feedback system enhances the reliability and accuracy of input detection compared to traditional single-sensor devices.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If a removable tip member with magnetic release is used, then ease of tip replacement is improved, but the mechanism becomes more complex

Engineering Contradiction:
Improvetip replacementVSAvoidattachment mechanism
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The attachment mechanism transitions from a static connection to a dynamic magnetic release system. The spring-loaded member can be compressed to disengage the magnetic hold on the tip member, allowing easy removal and replacement. This dynamic mechanism provides simple user operation while maintaining a relatively compact and integrated structure.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

A spring-loaded member acts as an intermediary between the user's manual compression action and the magnetic release mechanism. Compressing the spring temporarily overcomes the magnetic attraction, allowing the tip member to be removed. This intermediary mechanism simplifies the user interaction compared to directly overcoming magnetic forces.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Adaptability or versatility

If the controller switches between air input mode and surface marking mode, then adaptability is improved, but the switching mechanism becomes more complex

Engineering Contradiction:
Improvemode switchingVSAvoidmode detection system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The controller automatically detects whether it is in contact with a surface or in air space and switches modes accordingly, without requiring manual user input. The force sensor detects contact with surfaces and triggers automatic mode switching, making the system self-adaptive and reducing the complexity of manual mode selection interfaces.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The mode switching mechanism replaces manual mechanical switches or button combinations with an automatic sensor-based detection system. The force sensor electronically detects contact conditions and triggers software-based mode switching, eliminating the need for complex mechanical switching mechanisms and improving adaptability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The handheld controller system offers a more intuitive and comfortable user experience by allowing precise surface marking and seamless interaction with virtual objects, while providing adequate haptic feedback, thus enhancing control and immersion in virtual environments.

Implementation Method 1

The handheld controller may have a spring-loaded member at the first tip portion that retracts into the housing to form an opening that receives a portion of the removable tip member

Methodology Applied
Scientific EffectSpring mechanism: Spring

Implementation Method 2

The removable tip member may be held in place using a friction fit having a magnetic release

Methodology Applied
Scientific EffectMagnetic force: Magnetism

Implementation Method 3

The position sensor may be an optical flow sensor, a visual inertial odometry camera, an interferometer, or other sensor

Methodology Applied
Scientific EffectOptical flow sensing:

Implementation Method 4

A force sensor at the first tip portion may be used to detect when the tip member contacts a surface

Methodology Applied
Scientific EffectForce sensing:

Data Source

PatentUS20250093968A1Handheld Controllers with Surface Marking Capabilities
Publication Date: 2025.03.20 APPLE INC
  • US20250093968A1 patent drawing
  • US20250093968A1 patent drawing
  • US20250093968A1 patent drawing

AI summary

A system may include an electronic device such as a head-mounted device and a handheld controller for controlling the electronic device. The handheld controller may have a housing with an elongated shaft extending between first and second tip portions. A removable tip member may be coupled to the first tip portion. A position sensor may be located in the removable tip member and may be used to track surface markings made with the handheld controller on a surface. The position sensor may be an optical flow sensor, a visual inertial odometry camera, an interferometer, or other sensor. A force sensor at the first tip portion may be used to detect when the tip contacts a surface. The position sensor may switch from air input mode to surface marking mode in response to detecting contact with the surface.