Image Processing Apparatus for Spherical Planar Projection Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

When spherical images and planar images are combined, positional shifts occur due to differences in their projections, leading to misalignment and an unnatural display.

Innovation Solution

An image processing apparatus that transforms and aligns images by extracting feature points, determining corresponding areas, and generating location information to associate points between different projections, ensuring accurate positioning and display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If spherical images and planar images are combined without projection transformation, then the combination process is simple, but positional shifts occur between images leading to misalignment

Engineering Contradiction:
Improveimage combination processVSAvoidimage alignment accuracy
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by performing projection transformation on the spherical image before combining it with the planar image. The image processing apparatus transforms the spherical image from its original projection to a projection that matches the planar image's projection, ensuring proper alignment before the combination step occurs. This preliminary transformation prevents positional shifts and misalignment issues that would otherwise require complex correction procedures later.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If projection transformation is applied to align spherical and planar images, then image alignment accuracy is improved, but the processing complexity increases

Engineering Contradiction:
Improveimage alignment accuracyVSAvoidimage processing system
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent uses an intermediary approach by introducing a projection transformation step that acts as a mediator between the spherical image and the planar image. The image processing apparatus transforms the spherical image into a intermediate projection format that is compatible with the planar image's projection, enabling seamless combination without direct conflict between different projection systems. This intermediary transformation simplifies the overall combination process while maintaining high alignment accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10937134B2Image processing apparatus, image capturing system, image processing method, and recording medium
Publication Date: 2021.03.02 RICOH CO LTD
  • US10937134B2 patent drawing
  • US10937134B2 patent drawing
  • US10937134B2 patent drawing

AI summary

An image processing apparatus, an image capturing system, an image processing method, and a recording medium are provided. The image processing apparatus: obtains a first image in a first projection, and a second image in a second projection; transforms projection of at least a part of the first image corresponding to the second image, from the first projection to the second projection, to generate a third image in the second projection; extracts a plurality of feature points, respectively, from the second image and the third image; determines a corresponding area in the third image that corresponds to the second image, based on the plurality of feature points respectively extracted from the second image and the third image; transforms projection of a plurality of points in the corresponding area of the third image, from the second projection to the first projection, to obtain location information indicating locations of the plurality of points in the first projection in the first image; and stores, in a memory, the location information indicating the locations of the plurality of points in the first projection in the first image, in association with the plurality of points in the second projection in the second image.