3D Content Sharing Interfaces for Low-Input AR/VR Collaboration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for interacting with augmented and virtual reality environments are cumbersome, inefficient, and complex, leading to a significant cognitive burden on users and inefficient use of computer resources, particularly in battery-operated devices.

Innovation Solution

The implementation of computer systems with improved user interfaces that utilize touchpads, cameras, eye-tracking, and hand-tracking components, along with display generation components, to facilitate efficient and intuitive interactions, including sharing of virtual content and initiation of real-time communication sessions in three-dimensional environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional methods for interacting with augmented and virtual reality environments are used, then users can perform basic interactions, but the user interface becomes cumbersome and creates significant cognitive burden

Engineering Contradiction:
Improveuser interface efficiencyVSAvoidcomplexity of interaction methods
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system segments the user interface into multiple input modalities (touchpad, camera-based tracking, eye-tracking, hand-tracking) that can be used independently or in combination. Each input method handles specific types of interactions, dividing the complex task of VR/AR interaction into manageable segments that reduce cognitive burden.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces intermediary components (touchpad, camera, eye-tracking sensors, hand-tracking sensors) that mediate between the user and the virtual/augmented reality environment. These intermediaries translate natural user actions into digital commands, simplifying the interaction process and reducing the cognitive load on users.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If conventional interaction methods are used, then basic functionality is achieved, but computer resources are used inefficiently and battery life is reduced

Engineering Contradiction:
Improvecomputer resource efficiencyVSAvoidbattery consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system employs periodic action by updating the virtual environment and user interface elements only when necessary based on detected user inputs. Rather than continuous rendering and processing, the system refreshes content in response to specific events (eye movements, hand gestures, touchpad interactions), reducing overall computational resource consumption and battery usage.

Inventive Principle:
Principle #19Periodic action

3Loss of information

If detailed feedback systems are implemented to improve user understanding, then user experience is enhanced, but the number of inputs and system complexity increases

Engineering Contradiction:
Improvefeedback to userVSAvoidnumber of inputs required
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system implements feedback mechanisms that provide users with information about their interactions with the virtual/augmented reality environment. The feedback is integrated into the existing input methods rather than requiring additional separate controls, allowing the system to enhance user understanding without increasing the number of physical inputs required.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20260004531A1Methods of facilitating real-time communication sessions for co-located users
Publication Date: 2026.01.01 APPLE INC
  • US20260004531A1 patent drawing
  • US20260004531A1 patent drawing
  • US20260004531A1 patent drawing

AI summary

A computer facilitates display of content, and when criteria are satisfied, displays an option for initiating a process to display the content at a location by a second computer, facilitates initiation of a spatial real-time communication session with user(s) in a 3D environment, shares content with a second computer in response to selection of an element, in response to different inputs directed to a user of the second computer and to the content, and/or in response to movement of the content to an element, displays a sharing user interface for selecting content to share with a user in response to selection of an element displayed when the user is in a viewport of the computer, initiates a process to present a visual indication on a second computer in response to criteria being satisfied, and/or adds a user to a communication session in response to input directed at a user interface.