3D Model Generation Using Downsampled Image Feature Matching

Solution Overview

Problem

Current methods for generating high-resolution three-dimensional models require significant processing power and storage capacity, especially as image resolution increases, making it challenging to efficiently estimate camera parameters and generate models of moving or stationary objects using multi-view images.

Innovation Solution

A three-dimensional model generating device and method that reduces processing requirements by generating converted images with fewer pixels, using filters to restrict the search area for feature detection, and estimating camera parameters based on similar features between converted images, allowing for efficient camera parameter estimation and high-resolution model generation with reduced storage needs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If high-resolution images (4K, 8K or higher) are used to generate three-dimensional models, then the resolution and quality of the three-dimensional model is improved, but the processing time and storage capacity required increase exponentially

Engineering Contradiction:

Improvethree-dimensional model resolutionVSAvoidstorage capacity

Core Design Contradiction:

Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent segments the image processing task into two distinct stages: (1) processing low-resolution images to estimate camera parameters, and (2) processing high-resolution images to generate the three-dimensional model. This segmentation allows the computationally intensive parameter estimation to be performed on smaller data, reducing storage requirements while maintaining the ability to generate high-resolution models.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary action by estimating camera parameters in advance using low-resolution images before generating the three-dimensional model with high-resolution images. This preliminary parameter estimation eliminates the need to store and process high-resolution images for the parameter estimation step, significantly reducing storage capacity requirements while enabling subsequent high-quality model generation.

Inventive Principle:

Principle #10Preliminary action

2Manufacturing precision

If high-resolution images (4K, 8K or higher) are used to generate three-dimensional models, then the resolution and quality of the three-dimensional model is improved, but the processing time required to estimate camera parameters increases

Engineering Contradiction:

Improvethree-dimensional model resolutionVSAvoidcamera parameter estimation time

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent segments the image processing task into two distinct stages: (1) processing low-resolution images to estimate camera parameters, and (2) processing high-resolution images to generate the three-dimensional model. This segmentation allows the computationally intensive parameter estimation to be performed on smaller data, reducing storage requirements while maintaining the ability to generate high-resolution models.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary action by estimating camera parameters in advance using low-resolution images before generating the three-dimensional model with high-resolution images. This preliminary parameter estimation eliminates the need to store and process high-resolution images for the parameter estimation step, significantly reducing storage capacity requirements while enabling subsequent high-quality model generation.

Inventive Principle:

Principle #10Preliminary action

3Quantity of substance

If downsampled low-resolution images are used to calculate distance information, then storage space is reduced, but the processing accuracy for camera parameter estimation deteriorates

Engineering Contradiction:

Improvestorage spaceVSAvoidcamera parameter estimation accuracy

Core Design Contradiction:

Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent segments the image processing task into two distinct stages: (1) processing low-resolution images to estimate camera parameters, and (2) processing high-resolution images to generate the three-dimensional model. This segmentation allows the computationally intensive parameter estimation to be performed on smaller data, reducing storage requirements while maintaining the ability to generate high-resolution models.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent changes the resolution parameter of images used for different processing purposes. Low-resolution images are used specifically for camera parameter estimation where absolute precision is less critical, while high-resolution images are reserved for three-dimensional model generation where precision is paramount. This parameter change optimizes the balance between storage efficiency and processing accuracy.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS10893251B2Three-dimensional model generating device and three-dimensional model generating method

Publication Date: 2021.01.12 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD

AI summary

A three-dimensional model generating device includes: a converted image generating unit that, for each of input images included in one or more items of video data and having mutually different viewpoints, generates a converted image from the input image that includes fewer pixels than the input image; a camera parameter estimating unit that detects features in the converted images and estimates, for each of the input images, a camera parameter at a capture time of the input image, based on a pair of similar features between two of the converted images; and a three-dimensional model generating unit that generates a three-dimensional model using the input images and the camera parameters.