Camera-Flash 3D Reconstruction for Geometry and Surface Reflection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image-based inverse rendering technologies require a special light dome and numerous data captures to accurately reproduce three-dimensional geometry and surface reflection properties, necessitating a more efficient method to obtain accurate 3D content with minimal data.

Innovation Solution

An electronic device equipped with a camera, camera flash, and processor captures natural and artificial light images, along with depth images, to generate depth and cluster mask images, and calculates optimization parameters to derive 3D geometry and surface reflection information using image pyramids and clustering techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image-based inverse rendering technology is used to accurately reproduce 3D geometry and surface reflection properties, then measurement precision is improved, but device complexity and data requirements increase significantly

Engineering Contradiction:

Improveaccuracy of 3D geometry and surface reflection reproductionVSAvoidcomplexity of light dome and data capture system

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and removes the complex light dome structure from the system, replacing it with a simplified setup using only a camera and flash. The invention extracts only the essential components needed for 3D reconstruction while eliminating unnecessary complexity, achieving accurate geometry and SVBRDF reproduction without requiring a special light dome environment.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses image copying and processing techniques to reconstruct 3D geometry and surface properties from multiple 2D images. By capturing images from different angles and using computational algorithms to synthesize depth information and surface reflection properties, the system creates accurate 3D representations without needing complex physical measurement devices.

Inventive Principle:

Principle #26Copying

2Measurement precision

If special light dome and hundreds of fields of data are used for capturing, then measurement precision is improved, but loss of time and productivity deteriorate

Engineering Contradiction:

Improveaccuracy of geometry and SVBRDF captureVSAvoidtime required for data capture

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by pre-processing images to extract depth information and generate depth masks before the main reconstruction process. By preparing depth maps and segmenting objects in advance, the system reduces the computational burden during real-time processing, enabling faster 3D reconstruction from fewer captured images.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent uses partial action by capturing only the essential number of images needed for accurate reconstruction rather than requiring hundreds of fields of data. The system processes a limited set of images with enhanced algorithms to achieve complete 3D geometry and surface reflection information, significantly reducing capture time while maintaining measurement precision.

Inventive Principle:

Principle #16Partial or excessive action

3Manufacturing precision

If multiple images and complex processing are used to obtain 3D content, then manufacturing precision is improved, but productivity deteriorates

Engineering Contradiction:

Improveprecision of 3D content generationVSAvoidefficiency of 3D content creation

Core Design Contradiction:

Manufacturing precisionVSProductivity

Solution Approach 1:

The patent replaces complex mechanical capture systems with computational methods. Instead of using mechanical devices to physically measure and map 3D geometry, the system uses image processing algorithms and computational geometry to reconstruct 3D content from 2D images, significantly improving processing efficiency while maintaining high precision in 3D model generation.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes processing parameters by using optimized algorithms that process image data more efficiently. By adjusting computational parameters and using simplified mathematical models for surface reflection and geometry reconstruction, the system achieves high manufacturing precision in 3D content generation while reducing processing time and improving overall productivity.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS12361639B2Electronic device and control method thereof

Publication Date: 2025.07.15 SAMSUNG ELECTRONICS CO LTD

AI summary

An electronic device and a control method thereof are provided. The electronic device includes a camera, a camera flash, and at least one processor configured to control the camera to capture a natural light image and a depth image of an object, control the camera and the camera flash to capture an artificial light image of the object, obtain distance information from the depth image to generate a depth mask image, create a cluster mask image from the natural light image, obtain a flash image in which the illuminance of the natural light image has been removed from the illuminance of the artificial light image, obtain an optimization parameter based on the distance information, the depth mask image, the cluster mask image, and the flash image, and obtain three-dimensional topographic information and surface reflection information about the object based on the obtained optimization parameter.