VR Walkthrough View Generation Using 3D Model Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality (VR) technologies allow only three-degree of freedom walkthroughs, where users can change viewing angles but not positions, resulting in distorted and deformed walkthrough views when the viewing position is changed.

Innovation Solution

A method and apparatus for generating walkthrough views that fuse initial and repaired three-dimensional models based on depth differences between intersection-points, enabling six-degree of freedom walkthroughs by combining initial and repaired three-dimensional models to render accurate and non-distorted views.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a 360-degree panoramic image is used for virtual scenario walkthrough, then users can view the environment in three-degree of freedom by changing viewing angle, but the walkthrough view becomes deformed and distorted when the user changes the viewing position

Engineering Contradiction:
Improveviewing freedomVSAvoidimage distortion
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent transitions from two-dimensional panoramic images to three-dimensional models, adding a spatial dimension that enables accurate representation of the environment from multiple viewing positions and angles, thereby eliminating distortion while maintaining versatility

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the fundamental parameters of the representation from fixed panoramic coordinates to dynamic three-dimensional spatial coordinates, allowing the model to adapt to different viewing positions and angles without distortion by recalculating based on the new viewpoint

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20240037856A1Walkthrough view generation method, apparatus and device, and storage medium
Publication Date: 2024.02.01 DOUYIN VISION CO LTD
  • US20240037856A1 patent drawing
  • US20240037856A1 patent drawing
  • US20240037856A1 patent drawing

AI summary

Provided a walkthrough view generation method, apparatus and device, and a storage medium. The method includes acquiring an initial three-dimensional model and a repaired three-dimensional model corresponding to the initial three-dimensional model in the same spatial region, and the repaired three-dimensional model is obtained by repairing the spatial information in the initial three-dimensional model; determining a first intersection-point set between walkthrough light rays corresponding to current walkthrough parameters and the initial three-dimensional model and a second intersection-point set between the walkthrough light rays and the repaired three-dimensional model respectively, the current walkthrough parameters include a walkthrough viewing position after moving and a walkthrough viewing angle after moving; and fusing the initial three-dimensional model and the repaired three-dimensional model according to the depth differences between intersection-points of the first intersection-point set and corresponding intersection-points of the second intersection-point set and rendering the fused result to obtain the current walkthrough view.