Camera Pose Estimation Using Viewpoint-Based Image Clustering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera pose estimation methods fail to accurately estimate the pose of dynamic scenes with numerous objects, such as downtown or road images, due to the inability to extract feature points effectively, and image retrieval algorithms are inefficient when incorrect images are determined as similar.

Innovation Solution

An apparatus and method that includes a similar image searcher, a clusterer, and an estimator, where the clusterer groups similar images based on viewpoint data to reduce the complexity of feature point extraction and improve pose estimation accuracy by selecting images with shorter distances and forming clusters when a predetermined number of adjacent images is met.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image retrieval algorithm is used to find similar images, then camera pose estimation can be performed, but time and costs increase when incorrect images are determined as similar

Engineering Contradiction:
Improvecamera pose estimation accuracyVSAvoidimage retrieval time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the image retrieval process by introducing viewpoint data (azimuth and elevation angles) as a separate filtering criterion. Instead of relying solely on image similarity algorithms, the patent divides the retrieval process into two stages: first filtering images based on viewpoint distance thresholds, then performing detailed similarity comparison only on pre-filtered candidates. This segmentation reduces the number of images requiring computationally expensive similarity analysis.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary filtering of candidate images using viewpoint data before executing the full image retrieval algorithm. By calculating azimuth and elevation distances in advance and applying threshold-based pre-filtering, the system prepares a reduced set of candidate images that are more likely to be truly similar. This preliminary action prevents the retrieval algorithm from wasting time on obviously dissimilar images.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If feature point extraction is performed on images with numerous dynamic objects, then pose estimation can be attempted, but feature point extraction fails to extract relevant features

Engineering Contradiction:
Improvefeature point extraction accuracyVSAvoidhandling of dynamic scenes
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies local quality by using viewpoint data to selectively process only those images that have similar viewing angles to the query image. Instead of attempting feature extraction from all retrieved images, the system identifies and processes only the local subset of images whose viewpoint distances (azimuth and elevation) fall within predefined thresholds. This localized processing ensures that feature extraction is performed on images with comparable scene geometry and object configurations.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the parameters used for image selection from purely similarity-based metrics to include viewpoint parameters (azimuth angle difference and elevation angle difference). By introducing these angular parameters and setting threshold values, the system transforms the retrieval criterion to better suit dynamic scenes with multiple objects, where viewpoint consistency is more important than overall image similarity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11941845B2Apparatus and method for estimating camera pose
Publication Date: 2024.03.26 MAXST
  • US11941845B2 patent drawing
  • US11941845B2 patent drawing
  • US11941845B2 patent drawing

AI summary

An apparatus for estimating a camera pose according to an embodiment of the present disclosure includes a similar image searcher, a clusterer, and an estimator. The similar image searcher searches for a plurality of images similar to an input image, from among a plurality of previously-stored images, based on the input image. The clusterer creates a cluster including at least some similar images meeting predetermined conditions, from among the plurality of similar images, based on viewpoint data tagged to each of the plurality of similar images. The estimator estimates a pose of a camera that has generated the input image, based on the cluster.