Perspective Projection Imaging for HMD Viewing Angle Confirmation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge lies in converting wide-angle images, such as fisheye images, into perspective projection images suitable for head-mounted displays (HMDs) while ensuring the image region corresponds to the HMD's viewing angle, as traditional methods fail to accurately represent the object's fit within the viewing angle, making it difficult to confirm the perspective projection image on a normal plane display.

Innovation Solution

An image processing apparatus that generates a perspective projection image from a wide-angle image by obtaining parameters related to a predetermined viewing angle, converting the image using central projection methods, and superimposing region information to highlight the image region corresponding to the viewing angle, utilizing a CPU, GPU, and UI units to facilitate display on HMDs or plane displays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a wide-angle image is cut out to create a perspective projection image for HMD display, then the image is suitable for HMD viewing, but it becomes difficult to confirm whether objects fit within the viewing angle on a normal plane display

Engineering Contradiction:
Improveimage suitability for HMD displayVSAvoiddifficulty to confirm object fit within viewing angle
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces region information as an intermediary visual element that is superimposed on the perspective projection image. This region information (such as overlays or annotations) serves as a mediator between the narrow-angle perspective image and the viewer's need to understand the viewing angle boundaries, enabling easy confirmation of whether objects fit within the HMD's viewing angle while maintaining the image's suitability for HMD display

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent adds a visual dimension by superimposing region information onto the perspective projection image. This additional visual layer provides contextual information about the viewing angle boundaries without altering the underlying perspective image, allowing viewers to understand the angular constraints while viewing the image on a normal plane display

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12548108B2Image processing apparatus, image processing method, and storage medium that generate a perspective projection image from a wide-angle image
Publication Date: 2026.02.10 CANON KK
  • US12548108B2 patent drawing
  • US12548108B2 patent drawing
  • US12548108B2 patent drawing

AI summary

An image processing apparatus configured to generate a perspective projection image from a wide-angle image. The image processing apparatus includes one or more memories storing instructions and one or more processors executing the instructions to function as a first generation unit configured to generate the perspective projection image from the wide-angle image based on a first parameter related to a predetermined viewing angle, and an output unit configured to output the generated perspective projection image. The perspective projection image includes region information indicating an image region corresponding to the predetermined viewing angle in the wide-angle image.