3D Virtual Object Interaction With Input Guidance in AR Interfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for interacting with virtual objects in augmented reality environments are cumbersome, inefficient, and require excessive user input, leading to cognitive burden and energy wastage, particularly in battery-operated devices.

Innovation Solution

Improved methods and interfaces for interacting with virtual objects using electronic devices with display generation components, input devices, and cameras, allowing for intuitive manipulation and adjustment of virtual objects based on user inputs, reducing the need for multiple inputs and conserving power.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If 2D images are used to represent 3D objects, then device complexity is reduced, but measurement precision and spatial understanding are degraded

Engineering Contradiction:
Improvecomplexity of representing 3D objectsVSAvoidprecision of spatial representation
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent transitions from 2D image representations to 3D visualizations by mapping geospatial data onto three-dimensional virtual objects. This dimensionality change allows users to perceive spatial relationships, distances, and orientations more accurately while maintaining manageable system complexity through software-based rendering.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent creates virtual copies of physical objects and environments in a three-dimensional digital space. These virtual representations replicate the geometric and spatial properties of real-world objects, enabling precise measurement and analysis without requiring physical models or complex hardware.

Inventive Principle:
Principle #26Copying

2Ease of operation

If traditional 2D maps are used for geospatial data, then ease of operation is maintained, but productivity and analytical capability are reduced

Engineering Contradiction:
Improveease of using geospatial toolsVSAvoidefficiency of geospatial analysis
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system enhances traditional 2D map interfaces by overlaying and integrating 3D visualizations, allowing users to maintain familiar interaction patterns while gaining access to advanced analytical capabilities through three-dimensional representations of geospatial data.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent creates a multi-functional platform that combines traditional 2D mapping operations with advanced 3D visualization and analysis tools. Users can perform both basic map operations and complex spatial analyses within the same interface, eliminating the need for separate specialized tools.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If 3D visualizations are implemented, then measurement precision and spatial understanding are improved, but device complexity and computational requirements increase

Engineering Contradiction:
Improveprecision of spatial measurementVSAvoidcomplexity of 3D visualization system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical or hardware-based 3D visualization systems with software-based rendering and processing. By using computational algorithms to generate and manipulate three-dimensional graphics, the system achieves high measurement precision without requiring complex physical equipment.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system uses virtual copies and digital models to represent physical objects and environments. These digital representations can be manipulated, measured, and analyzed with high precision through software, avoiding the need for complex physical modeling equipment or hardware systems.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP3959585B1Devices, methods, and graphical user interfaces for displaying objects in 3D contexts
Publication Date: 2026.05.06 APPLE INC
  • EP3959585B1 patent drawingFigure 1A
  • EP3959585B1 patent drawingFigure 1B
  • EP3959585B1 patent drawingFigure 1C

AI summary

An electronic device displays an environment that includes a virtual object that is associated with a first action that is triggered based on satisfaction of a first set of criteria. In response to a first input detected while the environment is displayed: the first action is performed in accordance with a determination that the first input satisfies the first set of criteria, and, in accordance with a determination that the first input does not satisfy the first set of criteria but instead satisfies a second set of criteria, the first action is not performed and instead a first visual indication of one or more inputs that if performed would cause the first set of criteria to be satisfied is displayed.