Virtual Environment Rendering Using 3D Geometry and 2D Appearance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for rendering realistic three-dimensional virtual objects in virtual environments are time-consuming and often result in objects that lack realism, due to the need for photogrammetry and careful modeling and texturing.

Innovation Solution

The system utilizes a 3D-representation of a physical object to capture its geometry and a 2D-image to capture its appearance, allowing for the rendering of a highly realistic 3D virtual object by using the 3D-representation as a non-visible constraint for the action figure's path and providing occlusion effects, while the 2D-image enables detailed rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If photogrammetry and careful modeling and texturing are used to create 3D virtual objects, then the objects achieve realistic appearance, but the process becomes time-consuming

Engineering Contradiction:
Improverealism of 3D virtual objectsVSAvoidtime required to create 3D virtual objects
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent segments the object creation process into two independent components: geometry capture (using 3D scanning or procedural generation) and appearance capture (using 2D image processing). This segmentation allows each component to be optimized separately and applied independently to virtual objects, dramatically reducing the time required while maintaining realism.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses 2D images as direct copies of real object appearances and applies them to 3D geometric models. This copying approach preserves the realistic visual properties of original objects without requiring time-consuming manual texturing, as the appearance is transferred directly from reference images through automated processing.

Inventive Principle:
Principle #26Copying

2Reliability

If conventional rendering techniques are used for 3D objects in virtual environments, then the objects can be displayed, but they lack realism despite time investment in modeling

Engineering Contradiction:
Improverealism of rendered 3D objectsVSAvoidefficiency of virtual environment creation
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent replaces manual mechanical processes (hand modeling and texturing) with automated computational systems. The appearance transfer mechanism automatically maps 2D image features onto 3D models using image processing algorithms, eliminating the need for manual texturing work while producing more realistic results.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transforms the appearance parameters of 2D images into applicable parameters for 3D model rendering. By extracting color, texture, and surface properties from 2D images and applying them as rendering parameters to 3D objects, the system achieves realistic appearance without manual intervention in each parameter adjustment.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10304234B2Virtual environment rendering
Publication Date: 2019.05.28 DISNEY ENTERPRISES INC
  • US10304234B2 patent drawing
  • US10304234B2 patent drawing
  • US10304234B2 patent drawing

AI summary

A system for rendering a virtual environment includes a hardware processor, a memory, and a simulation generator software code stored in the memory. The hardware processor is configured to execute the simulation generator software code to receive a three-dimensional-representation (3D-representation) of a physical object, and to receive a two-dimensional-image (2D-image) of the physical object. The hardware processor is also configured to execute the simulation generator software code to compose a simulation of the virtual environment using the 3D-representation and the 2D-image, in which the 3D-representation of the physical object is situated between the 2D-image of the physical object and a predetermined viewpoint of the virtual environment. The hardware processor further executes the simulation generator software code to render the virtual environment such that the 2D-image of the physical object, but not the 3D-representation of the physical object, is visibly rendered.