Virtual Object Orientation by User Viewpoint in 3D Environments

Solution Overview

Problem

Existing methods for interacting with augmented and virtual reality environments are cumbersome, inefficient, and place a significant cognitive burden on users, requiring multiple inputs and manual adjustments to orient virtual objects, which wastes energy and detracts from the user experience.

Innovation Solution

The system automatically updates the orientation of virtual objects in three-dimensional environments based on user viewpoints, modifies the appearance of real objects between virtual objects, and selects user locations to enhance natural and efficient interaction, reducing the need for manual adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual adjustment methods are used to orient virtual objects, then users have precise control over object orientation, but the cognitive burden and number of inputs increase significantly

Engineering Contradiction:

Improveease of interactionVSAvoidcomplexity of interaction steps

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically orients virtual objects toward the user's viewpoint without requiring manual adjustment. The electronic device detects the user's position and orientation in the environment and autonomously updates the virtual object's orientation to face the user, eliminating the need for users to perform complex manual orientation operations.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system pre-calculates and applies the appropriate orientation for virtual objects based on predicted user movement and viewpoint. By anticipating user actions and pre-adjusting object orientations, the system reduces the cognitive burden and number of inputs required while maintaining precise control.

Inventive Principle:

Principle #10Preliminary action

2Productivity

If multiple inputs are required to achieve desired outcomes in augmented reality environments, then precise control is maintained, but energy consumption increases

Engineering Contradiction:

Improveefficiency of interactionVSAvoidenergy consumption

Core Design Contradiction:

ProductivityVSUse of energy by moving object

Solution Approach 1:

The electronic device autonomously manages virtual object orientation by detecting user viewpoint and automatically updating object orientations. This self-service approach eliminates the need for users to provide multiple inputs, thereby reducing energy consumption while maintaining interaction efficiency.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system continuously tracks user movement and maintains appropriate virtual object orientation without interruption. By keeping the orientation update process continuous and automatic rather than requiring discrete user inputs, the system improves productivity while minimizing energy consumption associated with multiple input operations.

Inventive Principle:

Principle #20Continuity of useful action

3Ease of operation

If virtual objects require manual orientation adjustments, then precise control over object placement is achieved, but the number of inputs and time required increase

Engineering Contradiction:

Improvenaturalness of interactionVSAvoidtime for orientation adjustments

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The system automatically orients virtual objects toward the user's viewpoint without requiring manual adjustment. The electronic device detects the user's position and orientation in the environment and autonomously updates the virtual object's orientation to face the user, eliminating the need for users to perform complex manual orientation operations.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system pre-calculates and applies the appropriate orientation for virtual objects based on predicted user movement and viewpoint. By anticipating user actions and pre-adjusting object orientations, the system reduces the cognitive burden and number of inputs required while maintaining precise control.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentEP4718404A2Methods for manipulating objects in an environment

Publication Date: 2026.04.01 APPLE INC

Figure 1
Figure 2
Figure 3

AI summary

In some embodiments, an electronic device automatically updates the orientation of a virtual object in a three-dimensional environment based on a viewpoint of a user in the three-dimensional environment. In some embodiments, an electronic device automatically updates the orientation of a virtual object in a three-dimensional environment based on viewpoints of a plurality of users in the three-dimensional environment. In some embodiments, the electronic device modifies an appearance of a real object that is between a virtual object and the viewpoint of a user in a three-dimensional environment. In some embodiments, the electronic device automatically selects a location for a user in a three-dimensional environment that includes one or more virtual objects and/or other users.