Image Processing Apparatus Viewpoint-Aware Display Distortion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional display systems that generate wide-field images often result in unnatural distortion and discomfort for viewers due to insufficient consideration of the viewer's viewpoint position, leading to inadequate adjustment of the image processing to match the display angle.

Innovation Solution

An image processing apparatus that acquires the imaging angle of view and display system information to generate a display image by establishing a correspondence relationship between a projection plane and the display portion in a virtual space, using a display angle parameter to adjust the image accordingly, thereby minimizing distortion and discomfort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If image processing for widening the angle of view is executed without considering the viewpoint position, then the display angle requirement is satisfied, but unnatural distortion occurs and viewer comfort deteriorates

Engineering Contradiction:
Improvedisplay angleVSAvoidimage distortion
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent changes the parameter of viewpoint position from being ignored to being explicitly considered in the image processing. By adjusting the viewpoint position parameter to coincide with the center of the display portion, the system achieves both wide display angle coverage and natural image appearance without distortion

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces a virtual space dimension that incorporates three-dimensional spatial relationships between the display portion and the viewpoint. This allows the system to map the flat captured image to the curved display surface while maintaining proper perspective relationships, resolving the distortion issue

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Area of stationary object

If a flat image is mapped to spherical shape to display on wide viewing angle screen, then the display system can cover the field of vision, but the viewpoint position information is lost causing discomfort

Engineering Contradiction:
Improvedisplay screen coverageVSAvoidviewpoint position
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent performs preliminary action by setting the viewpoint position in advance before generating the display image. The viewpoint position is predetermined to coincide with the center of the display portion, ensuring that perspective information is preserved throughout the mapping process from flat image to spherical display surface

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a virtual copy of the captured image in a virtual space that maintains the original viewpoint information. This virtual image copy is then mapped to the display portion, preserving spatial relationships and avoiding the information loss that occurs with direct flat-to-spherical mapping

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10863154B2Image processing apparatus, image processing method, and storage medium
Publication Date: 2020.12.08 CANON KK
  • US10863154B2 patent drawing
  • US10863154B2 patent drawing
  • US10863154B2 patent drawing

AI summary

An image processing apparatus includes a first acquisition unit configured to acquire an imaging angle of view at which an input image is captured, a second acquisition unit configured to acquire display system information indicating, in a display system including a display portion, a display angle, which is a visual angle at which the display portion is viewed from a viewpoint position, and a generation unit configured to, using a correspondence relationship between a projection plane and the display portion in a virtual space based on the imaging angle of view and the display system information, generate a display image to be displayed on the display portion.