Mirror-Based Scene Camera Perspective Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional virtual and mixed reality systems with video see-through devices have scene cameras whose entrance pupil and point of view are substantially offset from the user's eyes, leading to an inaccurate representation of the environment.

Innovation Solution

The use of mirrors and cameras that reflect light to image the entrance pupils of the cameras closer to the user's eyes, allowing for a more accurate representation of the user's perspective by positioning the cameras' optics behind the image planes formed at the camera sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If scene cameras are mounted at the front of the device, then the device structure is simplified, but the entrance pupil is substantially offset from the user's eyes resulting in inaccurate point of view representation

Engineering Contradiction:
Improvedevice structureVSAvoidpoint of view accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces an optical intermediary system consisting of beam splitters and mirrors positioned between the front-mounted cameras and the scene. This intermediary optical path allows the cameras to be physically located at the front of the device (simplifying structure) while optically referencing the entrance pupil to the user's eye position (improving POV accuracy). The beam splitter divides the optical path to enable this virtual positioning of the entrance pupil.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of moving object

If multiple cameras are used to capture a wide field of view, then the field of view coverage is improved, but the number of cameras and system complexity increases

Engineering Contradiction:
Improvefield of view coverageVSAvoidnumber of cameras
Core Design Contradiction:
Area of moving objectVSDevice complexity

Solution Approach 1:

The patent utilizes the optical dimension by introducing beam splitters and mirrors to create multiple optical paths from a single camera position. Instead of placing multiple cameras side-by-side to capture different field of view segments, the system uses optical beam splitting to direct different angular segments of the scene to the same camera sensor through different reflective paths, achieving wide FOV coverage without increasing camera count.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent makes a single camera perform multiple functions by using beam splitters to direct different portions of the wide field of view to the same camera. The camera thus captures multiple angular segments of the scene that would otherwise require multiple separate cameras, reducing the total camera count while maintaining comprehensive FOV coverage.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration provides a more accurate perspective matching the user's point of view, enabling a wider field of view with fewer cameras and potentially reducing the size and complexity of the system while maintaining image quality.

Implementation Method 1

one or more scene cameras may be mounted at the front of the device... By using the mirrors to reflect the light, the cameras' entrance pupils are imaged at a location closer to a user's eyes

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS11187914B2Mirror-based scene cameras
Publication Date: 2021.11.30 APPLE INC
  • US11187914B2 patent drawing
  • US11187914B2 patent drawing
  • US11187914B2 patent drawing

AI summary

A scene camera system that includes two or more mirrors that reflect light from a respective portion of a field of view (FOV) in front of the system and two or more cameras that each capture the light reflected by a respective one of the two or more mirrors. By using the mirrors to reflect the light, the cameras' entrance pupils are imaged to a location closer to a user's eyes to thus achieve a more accurate representation of the perspective of the user.