3D Virtual Environment Viewpoint Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for presenting virtual three-dimensional environments lack effective methods to display immersive and interactive models that include user viewpoints and virtual objects, particularly in mixed reality scenarios where seamless integration with physical environments is desired.

Innovation Solution

The system displays three-dimensional models of virtual environments that include representations of virtual objects, user viewpoints, and second user viewpoints, allowing for interactive navigation and rendering options such as full-size display, preview, and orientation adjustments based on user inputs and device movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a three-dimensional model of a virtual environment is displayed to show multiple user viewpoints and virtual objects, then the immersion and interactivity are improved, but the device complexity and computational resources required increase

Engineering Contradiction:
Improveimmersion and interactivityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system creates simplified representations (avatars) of users and their viewpoints within the three-dimensional model. Instead of processing multiple complex camera feeds simultaneously, the system uses avatar-based representations that capture essential viewpoint information in a computationally efficient manner, allowing the display device to render the shared virtual environment with reduced computational overhead while maintaining immersion and interactivity.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system introduces an intermediary processing layer that receives viewpoint data from multiple users, processes it through a coordination server, and transforms it into a unified three-dimensional model suitable for display. This intermediary layer abstracts the complexity of managing multiple viewpoints, allowing the display device to work with a pre-processed model rather than raw viewpoint data from all users.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the three-dimensional environment is displayed at full size for immersive viewing, then the user experience is improved, but the ability to show multiple users and objects simultaneously deteriorates

Engineering Contradiction:
Improveuser experienceVSAvoidnumber of users and objects visible
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The system transitions from two-dimensional screen display to three-dimensional spatial representation, allowing multiple users and objects to be positioned in different spatial locations within the virtual environment. This dimensional expansion enables full-size immersive viewing while simultaneously accommodating multiple users and objects by distributing them across the three-dimensional space rather than competing for limited two-dimensional screen real estate.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The three-dimensional virtual environment is divided into distinct spatial regions where different users and objects can be positioned. Each user's viewpoint and associated objects occupy specific segments of the three-dimensional space, allowing the system to maintain full-size display quality while showing multiple users and objects simultaneously by allocating them to different spatial segments.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If multiple user viewpoints are tracked and represented in the model, then the collaboration and interaction between users are improved, but the measurement precision and computational overhead increase

Engineering Contradiction:
Improvecollaboration and interactionVSAvoidviewpoint tracking precision
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

Instead of tracking and processing the complete high-precision viewpoint data from multiple users simultaneously, the system creates simplified avatar representations that capture the essential positional and orientational information needed for collaboration. These avatar copies maintain sufficient precision for collaborative interactions while reducing the computational overhead of processing multiple high-fidelity viewpoint streams.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20250104335A1Systems and methods of layout and presentation for creative workflows
Publication Date: 2025.03.27 APPLE INC
  • US20250104335A1 patent drawing
  • US20250104335A1 patent drawing
  • US20250104335A1 patent drawing

AI summary

Some examples of the disclosure are directed to systems and methods for displaying three-dimensional models of virtual three-dimensional environments. In some examples, the three-dimensional model includes representations of the virtual object(s) included in the environment, a representation of a viewpoint of a user of the electronic device in the environment, and a representation of a viewpoint of a second user of a different electronic device in the environment. In some examples, in response to receiving an input requesting to display the virtual three-dimensional environment (e.g., at full size), the electronic device displays the virtual three-dimensional environment from the viewpoint of the user of the electronic device indicated in the model.