svBRDF Capture Using Mobile Phone Flash and Fiducial Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for capturing and representing the reflectance behavior of real-world materials are cumbersome, requiring specialized equipment and expertise, and often result in high-quality representations that are excessive for visually plausible images, especially for simple materials.

Innovation Solution

A technique using simple printed fiducial markers and a mobile phone with continuous flash to capture and model nearly-flat surfaces' reflectance and normal displacement, allowing for the creation of physically plausible parametric svBRDF representations without specialized equipment, using a simple capture process and standard rendering software.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If direct measurement using gonioreflectometer is used, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
ImprovesvBRDF measurement accuracyVSAvoidspecialized equipment requirement
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a mobile phone camera to capture images of the material surface under controlled lighting, creating a digital copy of the visual appearance rather than requiring direct physical measurement with specialized equipment. This copying approach achieves sufficient visual fidelity for rendering applications without the complexity of gonioreflectometers.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The invention replaces expensive, complex measurement equipment with inexpensive, widely available mobile phone cameras. The system uses off-the-shelf hardware that can be easily obtained and disposed of, eliminating the need for specialized laboratory equipment while achieving practical rendering quality.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

2Measurement precision

If complete svBRDF sampling is performed, then measurement precision is improved, but loss of time increases

Engineering Contradiction:
Improvereflectance behavior accuracyVSAvoidcapture process duration
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent captures images at multiple discrete lighting angles (e.g., 0°, 45°, 90°) rather than continuously sampling the entire hemisphere. This partial sampling approach provides sufficient information for visual rendering without the time cost of complete svBRDF measurement, achieving a practical balance between accuracy and efficiency.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system pre-defines a set of standard lighting angles and positions before capture begins. By establishing the measurement protocol in advance with fixed angular positions, the capture process becomes systematic and efficient, eliminating the need for continuous or adaptive sampling during the measurement process.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If complete svBRDF sampling is performed, then measurement precision is improved, but use of energy increases

Engineering Contradiction:
Improvesix-dimensional svBRDF coverageVSAvoiddata processing and storage requirements
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts only the essential visual appearance information needed for rendering applications, rather than capturing and processing the complete six-dimensional svBRDF dataset. By selecting and processing only the most relevant lighting and viewing angles, the system reduces data volume and computational requirements while maintaining visual fidelity.

Inventive Principle:
Principle #2Taking out (Extraction)

4Ease of operation

If artist-designed materials are used, then ease of operation is improved, but manufacturing precision worsens

Engineering Contradiction:
Improvematerial creation simplicityVSAvoidreflectance behavior accuracy
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system automatically captures images, processes the data through algorithms, and generates the final material representation without requiring manual artist intervention. This self-service approach eliminates the need for artists to manually tweak parameters while achieving accurate reflectance behavior that mimics real-world materials.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This method delivers high-resolution, realistic material representations suitable for artistic applications, enabling the capture of complex materials with fine-scale specular features and varied lighting environments using off-the-shelf hardware, without the need for radiometric calibration or specific color charts.

Implementation Method 1

a light source to illuminate a surface of an object and a video capture device to capture images of the object

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS11436791B2Methods and systems for acquiring svBRDF measurements
Publication Date: 2022.09.06 RGT UNIV OF CALIFORNIA
  • US11436791B2 patent drawing
  • US11436791B2 patent drawing
  • US11436791B2 patent drawing

AI summary

A method of obtaining a spatially varying bidirectional reflectance distribution function for a flat object can include using a video capture device and a light source to capture a video of an area of interest at a relatively fixed distance over the surface of the object, aligning video frame images from the captured video into a single panorama with observations from multiple light and view locations for a number of pixels, clustering the pixels into clusters by similar appearance, and fitting a bidirectional reflectance distribution function to the clusters to generate a high-resolution spatially varying bidirectional reflectance distribution function.