3D Media Display With Playback-Location Scaling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for interacting with virtual and augmented reality environments are cumbersome, inefficient, and place a significant cognitive burden on users, often requiring multiple inputs and providing insufficient feedback, leading to errors and energy wastage, particularly in battery-operated devices.

Innovation Solution

The system employs improved user interfaces that reduce the number and complexity of user inputs by using eye-tracking, hand-tracking, and tactile feedback, adjusting virtual object sizes based on playback location changes, and optimizing display generation components to enhance interaction efficiency and reduce power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional user interfaces are used in XR environments, then users can interact with virtual objects, but the interaction becomes cumbersome and requires multiple inputs

Engineering Contradiction:
Improveease of interactionVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system provides continuous visual feedback by displaying a representation of media (such as a video player or image viewer) at the current playback location within the 3D environment. This feedback mechanism allows users to see the media content directly at its spatial location, eliminating the need for multiple navigation steps and complex interface interactions to access or control the media.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The media representation automatically adjusts its size based on the playback location and maintains itself within the field of view. The system self-regulates the display parameters without requiring manual user input, reducing the cognitive burden and interaction complexity while maintaining ease of operation.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If multiple inputs are required to achieve desired outcomes, then system functionality is comprehensive, but user cognitive burden increases

Engineering Contradiction:
Improvesystem functionalityVSAvoidcognitive burden
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent extracts the media representation and displays it directly within the 3D environment at the playback location, rather than requiring users to navigate through separate menus or interfaces. This extraction of the media view from traditional hierarchical interfaces reduces cognitive burden while preserving full system functionality for media control and interaction.

Inventive Principle:
Principle #2Taking out (Extraction)

3Stability of the object's composition

If media representation size is fixed, then display consistency is maintained, but media may not remain within field of view during playback

Engineering Contradiction:
Improvedisplay consistencyVSAvoidmedia visibility
Core Design Contradiction:
Stability of the object's compositionVSEase of operation

Solution Approach 1:

The media representation dynamically adjusts its size based on the playback location and field of view parameters. As the media plays back along its trajectory, the representation automatically scales to ensure it remains visible within the user's field of view, maintaining both display consistency and media visibility throughout the playback sequence.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250308187A1Methods of displaying media in a three-dimensional environment
Publication Date: 2025.10.02 APPLE INC
  • US20250308187A1 patent drawing
  • US20250308187A1 patent drawing
  • US20250308187A1 patent drawing

AI summary

In some embodiments, while displaying a representation of respective media in a three-dimensional environment with a first size relative to the three-dimensional environment, in response to detecting a change in playback location of the respective media, a computer system updates the representation of the respective media to have a second size relative to the three-dimensional environment.