Multi-Camera HMD Configuration for Variable Resolution Vision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional mixed-reality (MR) systems, such as VR and AR, face inefficiencies due to the use of expensive cameras with wide fields of view, which result in reduced angular resolution in peripheral areas, wasting high-resolution pixels and compromising situational awareness.

Innovation Solution

An improved head-mounted device (HMD) configuration with a higher resolution camera at the center and lower resolution cameras at the sides, minimizing overlap between camera fields of view, uses planar reprojection and motion models to merge images, providing higher resolution in the central area and lower resolution in peripheral areas, mimicking human vision acuity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of moving object

If cameras with wide fields of view are used to expand the observable area, then the field of view is improved, but the angular resolution is reduced

Engineering Contradiction:
Improvefield of viewVSAvoidangular resolution
Core Design Contradiction:
Area of moving objectVSMeasurement precision

Solution Approach 1:

The field of view is divided into multiple segments, each captured by a separate camera. The HMD uses multiple cameras (e.g., four cameras arranged in a square pattern) to capture different portions of the environment, with each camera responsible for a specific angular range. This segmentation allows each camera to maintain higher angular resolution while collectively providing a wide overall field of view.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the visual field are assigned different quality levels. The patent implements variable resolution rendering where the central field of view (foveal region) receives high-resolution rendering while peripheral regions receive lower-resolution rendering. This local quality differentiation optimizes computational resources by allocating high processing power only where human vision is most acute.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If high-resolution cameras are used to improve image quality, then the angular resolution is improved, but the cost and size of the HMD increase

Engineering Contradiction:
Improveangular resolutionVSAvoidcost and size
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies high-resolution capture only partially, focusing computational and hardware resources on the central field of view where human vision is most sensitive. Peripheral regions use lower-resolution cameras or rendered content, reducing the overall hardware requirements and cost while maintaining perceptual quality where it matters most.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent uses virtual rendering to create synthetic copies of peripheral visual content instead of relying solely on physical camera captures. Virtual reality content or procedurally generated peripheral scenes replace the need for expensive high-resolution peripheral cameras, reducing hardware cost while maintaining visual fidelity.

Inventive Principle:
Principle #26Copying

3Reliability

If overlapping fields of view are used to provide binocular vision, then the depth perception is improved, but the peripheral vision coverage is reduced

Engineering Contradiction:
Improvedepth perceptionVSAvoidperipheral vision coverage
Core Design Contradiction:
ReliabilityVSArea of moving object

Solution Approach 1:

The patent transitions from horizontal camera arrangement to a three-dimensional spatial configuration, placing cameras at different depths and angles (e.g., front, back, left, right positions). This vertical and depth-based dimensionality allows overlapping fields of view for stereoscopic depth perception while simultaneously expanding total peripheral coverage through the multi-axis arrangement.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11206364B1System configuration for peripheral vision with reduced size, weight, and cost
Publication Date: 2021.12.21 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11206364B1 patent drawing
  • US11206364B1 patent drawing
  • US11206364B1 patent drawing

AI summary

Improved HMDs are described. The HMD is configured to provide higher resolution image content within a central area of a display of the HMD and to provide lower resolution image content within peripheral areas of the display. The HMD includes a higher resolution camera, a first lower resolution camera, and a second lower resolution camera. The FOV of the first lower resolution camera minimally overlaps the FOV of the higher resolution camera, and the FOV of the second lower resolution camera minimally overlaps the FOV of the higher resolution camera. The minimal overlap is less than 10 degrees. By structuring the HMD in this manner, the HMD can generate merged images that mimic a user's foveal vision acuity.