HMD Image Processing Apparatus Visible Area Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mixed reality (MR) technologies using head-mounted displays (HMDs) face challenges in achieving real-time performance and reducing power consumption due to high image processing loads and data transmission requirements, which limits the use of wireless communication and general-purpose image processors, as they often require dedicated hardware for non-standard image formats.

Innovation Solution

An image processing apparatus that communicates with HMDs, featuring a generating unit for image data and an image processing unit that corrects image quality deterioration within the visible area of the optical system, allowing for reduced processing loads and power consumption without converting to special image formats, enabling the use of general-purpose display panels and processors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image processing is performed to correct deterioration inside the visible area of the optical system, then image quality is improved, but processing load and power consumption increase

Engineering Contradiction:
Improveimage qualityVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by performing image processing only within the visible area of the optical system rather than the entire image. The image processing unit corrects deterioration (distortion, blurring, vignetting) selectively in the region that will actually be visible through the HMD optical system, leaving the invisible regions unprocessed. This localized approach maintains image quality where it matters while significantly reducing processing load and power consumption compared to processing the entire image.

Inventive Principle:
Principle #3Local quality

2Productivity

If dedicated hardware is used for non-standard image formats, then image processing performance is improved, but device complexity and cost increase

Engineering Contradiction:
Improveimage processing performanceVSAvoidhardware complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent achieves universality by designing an image processing system that can handle both standard rectangular image formats and the specific visible area format using the same general-purpose image processor. The image processing unit is configured to receive image data in a standard format, identify the visible area region, and perform correction processing within that region. This eliminates the need for dedicated hardware for non-standard formats, as the same processor can handle multiple formats and processing requirements through software configuration rather than hardware specialization.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11366315B2Image processing apparatus, method for controlling the same, non-transitory computer-readable storage medium, and system
Publication Date: 2022.06.21 CANON KK
  • US11366315B2 patent drawing
  • US11366315B2 patent drawing
  • US11366315B2 patent drawing

AI summary

This invention provides an image processing apparatus configured to communicate with a head mounted display, which comprises a display device and an optical system for imaging an image displayed on the display device in relation to a user's eyes, and to generate image data for displaying on the display device of the head mounted display, wherein the image processing apparatus comprises a generating unit configured to generate image data for displaying on the display device, and an image processing unit configured to, with regard to the image data generated by the generating unit, in relation to inside a visible area of the optical system, perform image processing for correcting a deterioration of image quality by the optical system.