Dynamic Thumbnail Viewing for Wider HMD Surroundings

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video see-through head-mounted displays (HMDs) require opening the image file to view the surroundings of the display angle of view, which is inefficient and time-consuming.

Innovation Solution

An image processing apparatus that dynamically changes the thumbnail image angle of view based on the cursor position, allowing the observer to promptly check the surroundings without opening the image file by generating a second thumbnail image with a wider angle of view when the cursor is within a specific area.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the HMD records the display image as a screenshot with display angle of view, then the screenshot function is simple and fast, but the recorded image cannot show the surroundings outside the display angle of view

Engineering Contradiction:
Improvesurroundings informationVSAvoidimage processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the captured image into multiple regions: a first image corresponding to the display angle of view and a second image corresponding to the wider imaging angle of view. By separating these regions, the system can provide both the standard screenshot functionality and the expanded surroundings view without requiring complete reprocessing of the entire image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a dimensional aspect by creating a thumbnail image with a wider angle of view than the main display image. This additional dimensional information allows users to see surroundings outside the display angle of view while maintaining the original screenshot functionality.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If the HMD generates an image with wider angle of view than display image, then the surroundings can be checked, but the processing time and complexity increase

Engineering Contradiction:
Improvesurroundings informationVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by generating the thumbnail image with wider angle of view in advance and storing it separately. When a user wants to view surroundings, the pre-generated thumbnail is readily available, avoiding time-consuming real-time processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a copy of the captured image at different angle of view parameters. The thumbnail image serves as a copy that provides expanded view information without requiring complex real-time transformation of the original display image.

Inventive Principle:
Principle #26Copying

3Ease of operation

If the thumbnail image has the same angle of view as the display image, then the thumbnail generation is simple, but the user cannot check surroundings outside the display angle of view

Engineering Contradiction:
Improvesurroundings checking capabilityVSAvoidthumbnail generation complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements dynamic thumbnail generation where the thumbnail angle of view is adaptable. The system can switch between generating thumbnails with display angle of view and thumbnails with wider imaging angle of view based on user needs, providing flexibility without permanent complexity.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4290348B1Image processing apparatus, image processing method, program, and image display system
Publication Date: 2026.04.22 CANON KK
  • EP4290348B1 patent drawingFigure 1
  • EP4290348B1 patent drawingFigure 2
  • EP4290348B1 patent drawingFigure 3

AI summary

An image processing apparatus for processing a thumbnail image for displaying on a display, the apparatus comprising: an input means for inputting an image file, wherein the image file includes a main image having an angle of view which is wider than an angle of view of the thumbnail image; and a control means for executing control of the display to display the main image on the display as a thumbnail image in a case where a cursor is located in a thumbnail display area on the display.