Viewpoint Selection for 3D Model Depth Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing techniques for creating 3D models from depth images lack an effective method for selecting viewpoints, leading to decreased speed and accuracy due to the inclusion of redundant or less important viewpoints.

Innovation Solution

An image processing apparatus and method that determine and select suitable viewpoints for depth images based on the projected 3D model, using a viewpoint determination unit to optimize the selection process, ensuring that only relevant viewpoints are used for creating a 3D model, thereby improving the accuracy and speed of the model creation process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If depth images from all available viewpoints are used to create a 3D model, then the completeness of the model is improved, but the processing time and computational load increase significantly

Engineering Contradiction:
Improvecompleteness of 3D modelVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts and removes redundant depth images from the dataset, keeping only those from viewpoints that contribute meaningfully to the 3D model. The viewpoint determination unit identifies and eliminates depth images from viewpoints that do not provide new information, thereby reducing processing time while maintaining model completeness.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different selection criteria to different viewpoints based on their specific contribution to the 3D model. Rather than uniformly processing all viewpoints, the system evaluates each viewpoint's unique value and selectively retains only those that provide essential geometric information, optimizing the balance between completeness and efficiency.

Inventive Principle:
Principle #3Local quality

2Reliability

If depth images from redundant viewpoints are included in the 3D model creation, then the data coverage is improved, but the processing speed decreases

Engineering Contradiction:
Improvedata coverageVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system extracts and removes redundant depth images that do not contribute to data coverage. The viewpoint determination unit identifies depth images from viewpoints that are duplicates or provide negligible additional information, eliminating them to maintain processing speed while preserving essential data coverage.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by selectively processing only the necessary subset of depth images rather than all available viewpoints. The system determines the minimum required viewpoints needed for adequate data coverage, processing only those essential images to maintain high processing speed.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If depth images from all viewpoints are processed, then the accuracy of the 3D model is improved, but the computational complexity increases

Engineering Contradiction:
Improveaccuracy of 3D modelVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and removes depth images from viewpoints that do not contribute to model accuracy. The viewpoint determination unit identifies and eliminates redundant viewpoints, reducing computational complexity while preserving the accuracy achieved through processing of essential viewpoints.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system applies selective processing quality to different viewpoints, focusing computational resources on viewpoints that provide critical geometric information for accuracy. Rather than uniformly processing all viewpoints with equal computational effort, the system optimizes resource allocation to essential viewpoints only.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11328379B2Image processing apparatus and image processing method
Publication Date: 2022.05.10 SONY GROUP CORP
  • US11328379B2 patent drawing
  • US11328379B2 patent drawing
  • US11328379B2 patent drawing

AI summary

There is provided an image processing apparatus and an image processing method that enable selection of viewpoints of depth images suitable for creation of a 3D model. A viewpoint determination unit determines that a candidate viewpoint be a viewpoint of a depth image of a 3D model on the basis of the 3D model projected on a screen from the candidate viewpoint. The present disclosure can be applied to, for example, an encoding device or the like that generates and encodes color images and depth images from predetermined viewpoints, from color images and depth images from a plurality of viewpoints of a 3D model of a subject.