MR Background Camera Mode Switching for Power-Aware Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted displays (HMDs) used for mixed reality (MR) consume excessive power due to high frame rates and resolutions, and existing power-saving techniques are inadequate for dynamic user interactions, leading to a trade-off between power consumption and user experience quality.

Innovation Solution

An information processing apparatus that adapts the drive mode of the background camera based on the size of the virtual space display region, transitioning to power-saving modes when the display region exceeds a preset threshold, thereby reducing power consumption without significantly impacting user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the camera operates at high frame rate and high resolution to capture real space images, then the quality of the background image is improved, but the power consumption increases

Engineering Contradiction:
Improveimage qualityVSAvoidpower consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The camera operates in multiple drive modes (first drive mode with high frame rate and resolution, second drive mode with lower frame rate and resolution) and dynamically switches between them based on the size of the virtual space display region. This dynamic adjustment allows the system to optimize power consumption while maintaining image quality when necessary.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the operational parameters of the camera (frame rate and resolution) based on the display region size. When the virtual space display region is large, the camera switches to the second drive mode with lower frame rate and resolution to reduce power consumption. When the display region is small, it switches to the first drive mode with high frame rate and resolution to ensure image quality.

Inventive Principle:
Principle #35Parameter changes

2Use of energy by moving object

If the camera lowers the frame rate or resolution to reduce power consumption, then the power consumption is reduced, but the quality of the background image deteriorates

Engineering Contradiction:
Improvepower consumptionVSAvoidimage quality
Core Design Contradiction:
Use of energy by moving objectVSManufacturing precision

Solution Approach 1:

The system applies different image quality levels locally based on the display region size. When the virtual space display region is large, the background image quality can be reduced without significantly impacting user experience. When the display region is small, high image quality is maintained. This local quality adjustment allows power consumption to be reduced while preserving image quality where it matters most.

Inventive Principle:
Principle #3Local quality

3Use of energy by moving object

If power saving control is performed at a predetermined angular range, then the power consumption is reduced, but it is difficult to achieve power saving suitable for the display mode of the MR image

Engineering Contradiction:
Improvepower consumptionVSAvoidadaptability to display mode
Core Design Contradiction:
Use of energy by moving objectVSAdaptability or versatility

Solution Approach 1:

The system uses the size of the virtual space display region as a dynamic parameter to determine the appropriate camera drive mode. This parameter-based control approach is more adaptable to different display modes than fixed angular range control, allowing the system to achieve power saving that is suitable for the actual MR image display mode while maintaining flexibility.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20260075312A1Information processing apparatus displaying mixed reality, control method therefor, and storage medium storing control program therefor
Publication Date: 2026.03.12 CANON KK
  • US20260075312A1 patent drawing
  • US20260075312A1 patent drawing
  • US20260075312A1 patent drawing

AI summary

An information processing apparatus capable of adaptively reducing power consumption. The information processing apparatus includes a memory device that stores a set of instructions, and at least one processor that executes the set of instructions to obtain a region of a virtual space to be displayed on a display unit in a manner superimposed on a real space captured by a first camera as a display region, and switch a drive mode of the first camera according to a size of the display region.