Image Processing Apparatus for Spherical Display Distortion Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing large-visual-field video image display systems struggle to maintain image presence when displaying images captured with varying capturing parameters, such as zoom magnification, on complex display surfaces like spherical or curved screens, leading to distortion and an unnatural observer experience.

Innovation Solution

An image processing apparatus that converts captured image data into display image data by setting a display magnification and generating images based on the relationship between the observer's viewpoint direction and the capturing viewpoint direction, maintaining the ratio between elevation and azimuth angles to reduce distortion and enhance presence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If pre-distortion mapping processing is performed to display flat video images on spherical screens, then image distortion is reduced, but the presence effect and naturalness of the displayed image deteriorate when capturing parameters vary

Engineering Contradiction:
Improveimage distortion correctionVSAvoidpresence effect consistency
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent applies parameter changes by dynamically adjusting the mapping relationship between captured image coordinates and display surface coordinates based on capturing parameters (focal length, zoom magnification). Instead of using a fixed pre-distortion mapping, the system calculates appropriate mapping parameters according to the actual capturing conditions, thereby maintaining both distortion correction and presence effect across different capturing scenarios

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements dynamics by making the image mapping process adaptive rather than static. The mapping transformation is dynamically adjusted according to the capturing parameters of the image data, allowing the system to automatically adapt to different focal lengths and zoom levels. This dynamic adjustment ensures that the displayed image maintains natural appearance and presence effect while correcting distortion on the spherical display surface

Inventive Principle:
Principle #15Dynamics

2Ease of manufacture

If fixed pre-distortion mapping is used for spherical display surfaces, then the mapping process is simple, but it cannot adapt to varying capturing parameters like focal length and zoom magnification

Engineering Contradiction:
Improvemapping process simplicityVSAvoidcapturing parameter adaptability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent changes the mapping parameters dynamically based on capturing parameters. The system calculates mapping transformation parameters according to the actual focal length and zoom magnification used during capture, enabling the same simple mapping framework to adapt to various capturing conditions without requiring complex separate processing for each parameter set

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent achieves universality by creating a single adaptive mapping system that can handle multiple capturing parameter combinations (different focal lengths, zoom levels, and display surface configurations). This universal mapping approach replaces the need for multiple fixed mapping tables or processing pipelines, maintaining simplicity while providing broad adaptability

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11115631B2Image processing apparatus, image processing method, and storage medium
Publication Date: 2021.09.07 CANON KK
  • US11115631B2 patent drawing
  • US11115631B2 patent drawing
  • US11115631B2 patent drawing

AI summary

There is provided with an image processing apparatus. A setting unit sets a display magnification on the display surface for the captured image data. A generating unit generates the display image data from the captured image data, based on a relationship between a first direction from an observer viewpoint toward a position on the display surface at which an object is displayed when display is provided based on the captured image data in accordance with the display magnification and a second direction from an capturing viewpoint of the captured image data toward the object, such that an image of the object in the second direction from the capturing viewpoint of the captured image data is displayed at a position on the display surface in the first direction from the observer viewpoint.