3D Photo Gallery Rendering with Dynamic Viewpoint Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing VR technologies face limitations in presenting user-generated 3D photos due to their optimal viewing regions, leading to quality degradation when viewed from non-capture points, especially in multi-photo experiences where each photo has a different optimal viewing point, making it difficult for users to simultaneously occupy all optimal viewing positions.

Innovation Solution

A technique that positions and orients 3D photos within planar frames, allowing them to rotate, translate, and non-uniformly scale to track the viewer's position, while using hysteresis for motion parallax and clamping to maintain rendering quality, enabling the creation of 3D photo galleries with arbitrary layouts and full stereoscopic parallax.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If 3D photos are displayed with fixed optimal viewing points, then rendering quality is maintained at the capture point, but quality degrades when viewed from other positions in multi-photo galleries

Engineering Contradiction:
Improverendering qualityVSAvoidviewing position flexibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic transformation of 3D photos by continuously adjusting their position, orientation, and scale based on the viewer's current location. Each 3D photo transforms dynamically to ensure its optimal viewing point aligns with the viewer's position, maintaining high rendering quality across multiple viewing positions in the gallery.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes multiple parameters simultaneously including position coordinates, rotation angles, and scale factors of each 3D photo. These parameter transformations are calculated based on the viewer's position and the photo's original capture point, enabling quality preservation through coordinated parameter adjustments.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If 3D photos are transformed to track viewer position, then viewing quality is maintained across different positions, but computational complexity and transformation operations increase

Engineering Contradiction:
Improveviewing quality consistencyVSAvoidtransformation operations
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical transformation systems with direct mathematical calculations. Instead of using intricate mechanical devices to physically move and orient photos, the system uses coordinate geometry and transformation matrices to compute the new positions and orientations, significantly reducing system complexity while maintaining transformation accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

Each 3D photo automatically performs its own transformation based on its stored capture point information and the current viewer position. The photos self-adjust their position, orientation, and scale without requiring centralized control or complex coordination, simplifying the overall system architecture.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If arbitrary layouts are implemented in 3D photo galleries, then design flexibility and user experience are improved, but maintaining optimal viewing points for all photos becomes more difficult

Engineering Contradiction:
Improvelayout flexibilityVSAvoidoptimal viewing point alignment
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system dynamically adapts to any arbitrary layout configuration by continuously calculating and adjusting each photo's transformation based on the viewer's position. Whether photos are arranged in linear sequences, grid patterns, or scattered configurations, the dynamic transformation ensures each photo maintains its optimal viewing point alignment regardless of its position in the arbitrary layout.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This method ensures that 3D photos adapt to user motion, provide comfortable head motion parallax, and maintain strict quality guarantees by limiting distortions, allowing for immersive and high-quality 3D photo galleries in VR with arbitrary arrangements.

Implementation Method 1

We achieve motion parallax using hysteresis, which is designed so it provides stability for small user motion as well as strictly limited distortion for larger user motion.

Methodology Applied
Scientific EffectHysteresis: Hysteresis

Implementation Method 2

VR headsets provide separate images for each eye for stereographic display (stereopsis) as well as real-time positional and rotational head tracking for instant visual feedback (motion parallax).

Methodology Applied
Scientific EffectStereopsis: Parallax

Implementation Method 3

VR headsets provide separate images for each eye for stereographic display (stereopsis) as well as real-time positional and rotational head tracking for instant visual feedback (motion parallax).

Methodology Applied
Scientific EffectMotion parallax: Parallax

Data Source

PatentUS11961201B2Viewing 3D photo galleries in VR
Publication Date: 2024.04.16 META PLATFORMS TECHNOLOGIES LLC
  • US11961201B2 patent drawing
  • US11961201B2 patent drawing
  • US11961201B2 patent drawing

AI summary

In one embodiment, a method includes accessing multiple 3D photos to be concurrently displayed through multiple frames positioned in a virtual space, each of the of 3D photos having an optimal viewing point in the virtual space and determining a reference point based on a head pose of a viewer within the virtual space. The method may further include adjusting each 3D photo by rotating the 3D photo so that the optimal viewing point of the 3D photo points at the reference point, translating the rotated 3D photo toward the reference point, and non-uniformly scaling the rotated and translated 3D photo based on a scaling factor determined using the reference point and a position of the frame through which the 3D photo is to be viewed. The method may further include rendering an image comprising the adjusted multiple 3D photos as seen through the multiple frames.