3D Virtual Object Selection With Visual and Haptic Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for interacting with augmented and virtual reality environments are cumbersome, inefficient, and create a significant cognitive burden on users, often requiring multiple inputs and providing insufficient feedback, leading to errors and energy wastage, particularly in battery-operated devices.

Innovation Solution

The implementation of computer systems with improved user interfaces that utilize touch-sensitive displays, eye-tracking, hand-tracking, and tactile output generators to facilitate intuitive interaction, reducing the number and complexity of user inputs by providing enhanced visual and haptic feedback, and allowing operations to be performed with fewer inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional input methods are used for interacting with virtual reality environments, then basic interaction functionality is achieved, but user efficiency deteriorates and cognitive burden increases

Engineering Contradiction:
Improveuser efficiencyVSAvoidcognitive burden
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system provides real-time visual feedback by displaying indicators at the boundary between virtual and physical spaces, showing users exactly where their inputs are being registered and what actions are available. This feedback loop reduces cognitive burden by making the interaction model transparent and intuitive, allowing users to understand system state without mental overhead.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces an intermediary indicator element that mediates between the user's physical input and the virtual environment response. This indicator serves as a visual bridge, showing the connection between physical space interactions and virtual object manipulation, thereby simplifying the interaction model and improving user efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If multiple inputs are required to achieve desired outcomes, then precise control is achieved, but interaction time increases and energy consumption increases

Engineering Contradiction:
Improvecontrol precisionVSAvoidinteraction time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically detecting when a user intends to interact with a virtual object through physical space gestures, and pre-positioning the interaction state before explicit confirmation is needed. This reduces interaction time while maintaining control precision through the visual indicator that confirms system readiness.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The interaction system serves itself by automatically interpreting physical gestures and mapping them to appropriate virtual actions without requiring multiple explicit user commands. The visual indicator provides self-confirmation to the user, eliminating the need for redundant inputs and reducing overall interaction time.

Inventive Principle:
Principle #25Self-service

3Reliability

If multiple inputs are required for virtual object manipulation, then accurate operation is achieved, but energy consumption increases in battery-operated devices

Engineering Contradiction:
Improveoperation accuracyVSAvoidenergy consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system reduces energy consumption by implementing self-service interaction where a single physical gesture is automatically interpreted and executed as a complete interaction sequence. The visual indicator provides self-confirmation, eliminating the need for multiple input commands that would otherwise be required to ensure accurate operation, thereby reducing overall energy usage in battery-operated devices.

Inventive Principle:
Principle #25Self-service

4Reliability

If conventional feedback mechanisms are used, then basic system response is achieved, but user understanding of input-output connection deteriorates

Engineering Contradiction:
Improvesystem responseVSAvoidinput-output connection understanding
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent enhances feedback by providing visual indicators at the boundary between physical and virtual spaces that show users exactly where their inputs are registered and what virtual actions are available. This maintains reliable system response while preventing information loss about the connection between user inputs and system responses, making the interaction model transparent and understandable.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12524977B2Methods for displaying, selecting and moving objects and containers in an environment
Publication Date: 2026.01.13 APPLE INC
  • US12524977B2 patent drawing
  • US12524977B2 patent drawing
  • US12524977B2 patent drawing

AI summary

In some embodiments, a computer system performs different object selection-related operations. In some embodiments, a computer system places objects at locations in a displayed region based on attention of a user. In some embodiments, a computer system displays a container virtual object with curvature in a three-dimensional environment.