3D Model Noise Removal Using Multi-View Stereo Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for generating three-dimensional (3D) images using parallel stereo methods fail to accurately remove noise, resulting in inaccuracies in the generated 3D images of objects.

Innovation Solution

An imaging apparatus and method that includes an imaging unit, a model generator, a noise determining unit, and a noise removing unit to identify and remove noise points from the 3D model, allowing for the generation of accurate 3D images by comparing points across different photographing positions and directions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If parallel stereo method is used to generate 3D images, then the 3D image can be generated based on parallax and base length, but noise cannot be removed from the generated 3D image

Engineering Contradiction:
Improve3D image generation accuracyVSAvoidnoise in 3D image
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent performs preliminary actions by generating multiple 3D models from photographs taken at different positions before final noise removal. The noise determining unit compares corresponding points across these pre-generated models to identify noise, allowing systematic elimination of harmful factors while preserving accurate 3D structure information.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback mechanisms where the noise determining unit continuously compares points across different 3D models and photographing positions. This feedback loop identifies inconsistencies indicating noise and feeds this information back to the noise removing unit for targeted elimination, progressively improving 3D image accuracy.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If multiple photographs are taken at different positions to improve 3D model accuracy, then more information is available for noise removal, but the complexity of processing increases

Engineering Contradiction:
Improve3D model accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the complex processing into distinct functional units: an imaging unit for capturing photographs, a model generator for creating 3D models, a noise determining unit for identifying noise points through comparison, and a noise removing unit for eliminating noise. This segmentation allows each unit to process specific tasks independently, managing overall system complexity while improving accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by treating different points in the 3D model differently. The noise determining unit analyzes corresponding points at different photographing positions to identify local noise regions, and the noise removing unit selectively removes only those specific noise points while preserving accurate information in other regions, thus managing processing complexity through targeted rather than comprehensive processing.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9336626B2Imaging apparatus capable of generating three-dimensional images, three-dimensional image generating method, and recording medium
Publication Date: 2016.05.10 CASIO COMPUTER CO LTD
  • US9336626B2 patent drawing
  • US9336626B2 patent drawing
  • US9336626B2 patent drawing

AI summary

An imaging apparatus generates a 3D model using a photographed image of a subject and generates a 3D image based on the 3D model. When a corresponding point corresponding to a point forming the 3D model does not form a 3D model generated using a photographed image photographed at a different photographing position, the imaging apparatus determines that the point is noise, and removes the point determined as noise from the 3D model. The imaging apparatus generates a 3D image based on the 3D model from which the point determined as noise is removed.