Visual SLAM Camera Parameter Adjustment for Photometric Calibration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing Visual SLAM techniques face challenges in performing photometric calibration at a low cost using inexpensive cameras like those in smartphones and webcams, due to low accuracy of photometric sensors and difficulties in acquiring measurement results.

Innovation Solution

An image pick-up apparatus with adjustable camera parameters, a determination unit to assess image suitability for computer vision applications, and a parameter adjustment unit to optimize camera settings for improved photometric calibration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If inexpensive cameras (smartphone/webcam) are used for Visual SLAM, then cost is reduced, but photometric calibration accuracy deteriorates due to low-quality photometric sensors

Engineering Contradiction:
ImprovecostVSAvoidphotometric calibration accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent replaces the traditional photometric sensor-based calibration method with a computational imaging approach. Instead of relying on hardware photometric sensors, the system uses image processing algorithms to analyze captured images and determine camera parameters, thereby substituting a mechanical/sensor-based system with a computational one that works effectively with inexpensive cameras.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the approach from measuring physical photometric parameters to inferring camera parameters through image analysis. The system adjusts camera parameters (focal length, principal point, distortion coefficients) based on computational analysis of image features rather than direct photometric measurement, enabling accurate calibration with low-cost cameras.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If photometric calibration is performed using traditional methods, then calibration accuracy is improved, but device complexity and cost increase due to requirement of industrial cameras with high-quality sensors

Engineering Contradiction:
Improvecalibration accuracyVSAvoidcamera system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex hardware-based photometric measurement systems with a simplified computational approach. Instead of requiring industrial cameras with specialized photometric sensors, the system uses standard image processing techniques to achieve calibration, thereby reducing device complexity while maintaining or improving accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a computational model of the camera's optical characteristics by analyzing image data. Instead of directly measuring physical parameters with complex sensors, the system infers camera parameters by comparing captured images with geometric models, effectively creating a virtual copy of the optical system's behavior through computation.

Inventive Principle:
Principle #26Copying

3Measurement precision

If photometric sensors with high accuracy are used, then photometric calibration quality is improved, but cost and device complexity increase

Engineering Contradiction:
Improvephotometric sensor accuracyVSAvoidcost
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent substitutes expensive photometric sensors with computational image processing. The system achieves accurate photometric calibration by analyzing image data through algorithms that determine camera parameters, replacing the need for costly hardware sensors with software-based solutions that run on inexpensive cameras.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-calibration by analyzing its own captured images. Instead of requiring external photometric measurement equipment, the camera system uses its own image output to determine its parameters, making the calibration process self-contained and eliminating the need for additional expensive measurement devices.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12010435B2Image pick-up apparatus, image pick-up method that picks up images for a visual simultaneous localization and mapping
Publication Date: 2024.06.11 NEC CORP
  • US12010435B2 patent drawing
  • US12010435B2 patent drawing
  • US12010435B2 patent drawing

AI summary

To provide an image pick-up apparatus, an image pick-up method, and a program each of which adapted to perform photometric calibration at a low cost in the application thereof for picking-up images for performing localization. An image pick-up apparatus (500) includes at least one memory (503) configured to store an instruction, and at least one processor (502) configured to execute the instruction, the processor being further configured to: pick-up an image; determine whether the picked-up image data is an image suitable for a computer vision application; and adjust camera parameters based on the determination.