3D Event Routing Using Object-Type Rules and Intent Rays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems and methods for user interaction in 3D graphical environments often fail to accurately or efficiently determine the correct virtual object to which a user action should be directed, particularly when the object is outside the user's reach.

Innovation Solution

Implementing a rule-based system that utilizes object types (e.g., 'strong' and 'weak') and proximity to determine the intended virtual object by casting a ray in the direction of intent, considering entry and exit points, and propagating events based on object hierarchies and type-specific rules.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If existing systems use basic input mechanisms for user interaction in 3D graphical environments, then the system structure remains simple, but the accuracy of determining which virtual object the user intends to interact with deteriorates

Engineering Contradiction:
Improveaccuracy of determining intended virtual objectVSAvoidcomplexity of event routing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the determination process into distinct components: detecting direction of intent from user input, casting rays along that direction, identifying intersections with virtual objects, and applying type-specific rules. This segmentation allows each component to be optimized independently while maintaining overall accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary ray-casting mechanism that bridges the gap between user input and virtual object selection. The ray acts as a mediator that translates the direction of intent into a precise identification of the intended object, even when objects are outside arms reach or overlapping.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the system considers multiple virtual objects and their hierarchies to route events accurately, then the precision of event association improves, but the computational time and processing complexity increase

Engineering Contradiction:
Improveprecision of event associationVSAvoidprocessing time for event routing
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-establishing object hierarchies and type classifications before event occurrence. Virtual objects are pre-labeled as containers or elements, and their spatial relationships are pre-computed. When an event occurs, the system only needs to query these pre-organized structures rather than analyzing everything from scratch.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex mechanical analysis of object interactions with a more efficient ray-casting mathematical approach. Instead of simulating physical interactions between objects and user input, the system uses geometric ray intersection calculations, which are computationally faster while maintaining precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If the system uses type-specific rules for different virtual objects (containers vs. elements), then the versatility of interaction handling improves, but the complexity of the routing logic increases

Engineering Contradiction:
Improveversatility of interaction handlingVSAvoidcomplexity of routing logic
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system changes the parameter of object classification by assigning discrete type labels (container vs. element) to virtual objects. This parameter change allows the routing logic to adapt its behavior based on object type without requiring complex conditional structures. The same ray-casting mechanism works for all objects, but the interpretation of results varies by type.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent creates a universal ray-casting and intersection-detection mechanism that serves multiple functions: identifying objects in the direction of intent, determining which objects are candidates for interaction, and providing data for type-specific routing decisions. This single mechanism handles all virtual objects regardless of their specific type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Measurement precision

If the system limits the direction of intent to a particular line segment, then the accuracy of identifying the intended object improves, but the risk of missing objects due to convergence issues increases

Engineering Contradiction:
Improveaccuracy of direction of intentVSAvoidreliability of object identification
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system dynamically adjusts the direction of intent representation based on the input mechanism. For gaze-based input, it uses eye convergence to determine a dynamic focal point. For pointing gestures, it adjusts the ray origin and direction based on hand position and orientation. This dynamic adaptation maintains accuracy while avoiding fixed limitations that could cause convergence issues.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12602864B2Event routing in 3D graphical environments
Publication Date: 2026.04.14 APPLE INC
  • US12602864B2 patent drawing
  • US12602864B2 patent drawing
  • US12602864B2 patent drawing

AI summary

Various implementations disclosed herein more accurately or efficiently determine to which of multiple potential virtual objects user input should be directed in a 3D graphical environment. In some implementations, this involves using a rule that accounts for the types of the virtual objects to which a particular event may correspond. For example, a direction of intent may be identified and a rule used to determine to which of multiple potential virtual objects to associate an event.