3D Model Light Field and Perspective Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating 3D models of objects from images lack the ability to accurately determine applicable light fields and viewing perspectives, which are crucial for realistic rendering and visualization.

Innovation Solution

A system and method that receives a search query for an object, determines a 3D model, and identifies applicable light fields and viewing perspectives from a plurality of stored images, allowing for the transmission of these details as a search query result to enable accurate rendering and visualization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If 3D models are generated from stored images, then visualization capabilities are enhanced, but accuracy of light fields and viewing perspectives is insufficient

Engineering Contradiction:
Improveaccuracy of light field determinationVSAvoidloss of lighting and perspective information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system pre-processes stored images to extract and catalog light field parameters and viewing perspective information before 3D model generation. This preliminary extraction and organization of lighting and perspective data enables accurate retrieval and application during rendering, resolving the contradiction between enhancing visualization and maintaining information accuracy.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If multiple stored images are processed to determine light fields and viewing perspectives, then rendering fidelity is improved, but computational complexity increases

Engineering Contradiction:
Improvefidelity of rendered imagesVSAvoidcomplexity of image processing system
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The image processing system divides the complex task of analyzing multiple stored images into separate modular components: one module extracts light field parameters while another extracts viewing perspective information. This segmentation allows independent optimization of each extraction process and simplifies the overall system architecture, maintaining high rendering fidelity while managing computational complexity.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If detailed 3D model information including light fields and viewing perspectives is transmitted, then visualization quality is enhanced, but data transmission volume increases

Engineering Contradiction:
Improveprecision of 3D model informationVSAvoidvolume of transmitted data
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The system extracts only the essential light field parameters and viewing perspective information needed for accurate 3D visualization, separating these critical elements from the complete image data. This extraction approach transmits precisely the necessary 3D model information with high precision while minimizing data transmission volume by excluding redundant information.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP2807587B1Determining 3D model information from stored images
Publication Date: 2017.05.17 GOOGLE LLC
  • EP2807587B1 patent drawingFigure 1A
  • EP2807587B1 patent drawingFigure 1B
  • EP2807587B1 patent drawingFigure 1C~1D

AI summary

Methods and systems are provided for determining and transmitting applicable lighting information, applicable viewing perspective, and a 3D model for an object in response to a search query. An example method includes receiving, at a server, a search query regarding an object, A 3D model for the object is determined. The 3D model includes three-dimensional shape information about the object. The method also includes determining, based on a plurality of stored images of the object, at least one applicable light field and at least one applicable viewing perspective. A search query result is transmitted from the server. The search query result may include the 3D model, the applicable light field(s), and the applicable viewing perspective(s). A server and a non-transitory computer readable medium are also disclosed that could perform a similar method.