Spherical Photogrammetry with Omnidirectional Imaging for 3D Connectivity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing photogrammetry methods face challenges in ensuring connectivity and efficiency of image data sets for generating three-dimensional models, leading to costly and inefficient recording strategies, particularly in complex environments, and suffer from numerical instabilities due to narrow fields of view.

Innovation Solution

Employing an omnidirectional camera with a spherical field of view and a trajectory planning system to ensure complete environmental coverage and connectivity, using a hyperbolic mirror design to capture images from all directions, simplifying the capture strategy and ensuring successful production of point-based 3D models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If dense photography campaigns are conducted to ensure reconstruction connectivity, then the reliability of 3D model generation is improved, but the quantity of images and recording cost increase significantly

Engineering Contradiction:
Improvereconstruction connectivityVSAvoidnumber of photographs
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent changes the field of view parameter from narrow to wide by using an omnidirectional camera system. This parameter change allows single images to capture much more environmental context, reducing the need for multiple overlapping images while maintaining reconstruction connectivity. The wide field of view enables each image to contribute more effectively to the connection graph, improving reliability without proportionally increasing image quantity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent transitions from traditional planar photography to spherical projection by using omnidirectional cameras. This dimensional change from 2D plane to 3D sphere allows complete environmental coverage in a single capture, fundamentally reducing the number of images needed while ensuring comprehensive connectivity for 3D reconstruction.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If narrow field of view images are used for geometry estimation, then the device complexity is reduced, but numerical instabilities increase and accuracy decreases

Engineering Contradiction:
Improvecamera systemVSAvoidgeometry estimation accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent changes the field of view parameter from narrow to wide by using an omnidirectional camera system. This parameter change allows single images to capture much more environmental context, reducing the need for multiple overlapping images while maintaining reconstruction connectivity. The wide field of view enables each image to contribute more effectively to the connection graph, improving reliability without proportionally increasing image quantity.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If traditional photogrammetry methods are used with normal photography equipment, then the ease of operation is improved, but the ability to ensure image connectivity and produce complete 3D models deteriorates in complex environments

Engineering Contradiction:
Improvephotography equipment usabilityVSAvoidimage connectivity
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent changes the field of view parameter from narrow to wide by using an omnidirectional camera system. This parameter change allows single images to capture much more environmental context, reducing the need for multiple overlapping images while maintaining reconstruction connectivity. The wide field of view enables each image to contribute more effectively to the connection graph, improving reliability without proportionally increasing image quantity.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Guarantees predictable and efficient generation of 3D models by ensuring connectivity and reducing numerical instabilities, allowing for a single pass to capture the entire environment without complex path planning, enhancing accuracy and robustness of geometry estimation.

Implementation Method 1

employing an omnidirectional camera with a spherical field of view and a trajectory planning system to ensure complete environmental coverage and connectivity, using a hyperbolic mirror design to capture images from all directions

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentEP4165597B1Method and system for generating a three-dimensional model based on spherical photogrammetry
Publication Date: 2025.11.05 ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE (EPFL)
  • EP4165597B1 patent drawingFigure 1~3
  • EP4165597B1 patent drawingFigure 4~6
  • EP4165597B1 patent drawingFigure 7~9

AI summary

A computer-implemented method is proposed for creating a three-dimensional model of the environment. The method comprises the steps of planning (105) a trajectory for a moving system carrying an omnidirectional camera comprising a first image sensor facing in a first direction for capturing first images, and a second image sensor facing in a second, different direction for capturing second images; advancing (107) the moving system along the trajectory; triggering (111) the omnidirectional camera at given time instants depending on the speed of the moving system along the trajectory to capture first and second images; obtaining (117) spherical images by selectively combining the first and second images; and creating (119) the three-dimensional model from the spherical images.