3D Model Depth Smoothing via Color Gradient Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional three-dimensional scanning systems face difficulties in accurately detecting depth for transparent or semi-transparent materials, resulting in noisy depth data and irregularities, which require manual correction by users, a time-consuming and cumbersome process.

Innovation Solution

The system identifies regions with missing or irregular depth data, converts depth information into a binary mask, compares it with color information to determine smooth regions, and uses a surface-fitting algorithm to fill in depth information by creating a smooth transition of gradients, eliminating the need for manual correction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional three-dimensional scanning systems are used to scan transparent or semi-transparent materials, then color/texture data can be captured, but depth data becomes noisy or missing due to infrared radiation being deflected or prevented from returning

Engineering Contradiction:
Improvedepth detection accuracyVSAvoiddepth data completeness
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent uses color information as an intermediary to infer depth information. By comparing color data from regions with missing depth data against color data from regions with valid depth data, the system indirectly determines depth values for transparent or semi-transparent materials that block infrared radiation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the direct infrared-based depth measurement mechanism with a computational approach using color information and gradient analysis. Instead of relying on infrared reflection, the system uses surface-fitting algorithms and gradient calculations based on color data to reconstruct depth information.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If manual correction tools are used to fill holes and correct geometry irregularities in three-dimensional models, then depth irregularities can be corrected, but the process becomes very time consuming and cumbersome

Engineering Contradiction:
Improvegeometry correction accuracyVSAvoidpost-processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs automatic self-correction of depth irregularities without requiring manual intervention. The algorithm autonomously identifies regions with missing depth data, compares them with surrounding regions using color information, and fills in the missing data automatically through gradient calculation and surface-fitting, eliminating the need for manual post-processing.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent changes the approach from direct depth measurement to indirect depth inference by utilizing color information parameters. By analyzing color gradients and comparing color data across different regions, the system derives depth values that would otherwise be unavailable, automatically correcting geometric irregularities.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If conventional three-dimensional scanning systems process depth data, then depth information can be obtained, but sampling artifacts are introduced in the depth data

Engineering Contradiction:
Improvedepth information accuracyVSAvoidsampling artifacts
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent applies preliminary filtering and validation to depth data before final processing. By pre-identifying regions with missing or noisy depth data and pre-comparing them with color information from surrounding regions, the system prevents sampling artifacts from propagating through the final three-dimensional model.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9818232B2Color-based depth smoothing of scanned 3D model to enhance geometry in 3D printing
Publication Date: 2017.11.14 ADOBE INC
  • US9818232B2 patent drawing
  • US9818232B2 patent drawing
  • US9818232B2 patent drawing

AI summary

Methods and systems for correcting depth irregularities in a three-dimensional scanned model. In particular, one or more embodiments obtain depth data and color data for an object using a depth scanner and a color scanner, respectively. One or more embodiments identify, based on edge information in the color data, regions that have no depth data that are part of the object. One or more embodiments then correct the depth frame by assigning depth data to the identified regions based on a gradient of depth data from areas near the identified regions. The methods and systems use the corrected depth data to generate a corrected three-dimensional model of the object.