360-Degree Depth Imaging System Using Reflector Subsystem

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current imaging systems capturing a 360-degree field of view often produce artifacts due to image stitching and require multiple cameras, increasing costs and distorting wide-angle images, especially when using fisheye lenses.

Innovation Solution

A 360-degree audiovisual communications system utilizing a single image sensor with a reflector subsystem and a projector to capture depth images, employing time-of-flight or structured light techniques, and correcting distortion to form a coherent depth map for gesture recognition and environmental tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple cameras are used to capture 360-degree field of view, then the field of view coverage is improved, but the system cost and complexity increase

Engineering Contradiction:
Improvefield of view coverageVSAvoidsystem complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The system divides the 360-degree field of view into multiple sectors, with each camera responsible for capturing a specific angular range. The reflector subsystem segments the incoming light from different directions and directs it to the appropriate camera sensor, enabling comprehensive coverage while maintaining manageable system complexity through modular camera units.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The reflector subsystem acts as an intermediary between the external environment and the camera sensors. It captures light from all directions and redirects it to the appropriate sensors, eliminating the need for cameras to be positioned throughout the entire 360-degree space and reducing overall system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If image stitching is used to combine multiple camera images, then the 360-degree coverage is achieved, but artifacts are introduced in the final image

Engineering Contradiction:
Improvecoverage areaVSAvoidimage quality
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The system dynamically adjusts the angular field of view for each camera based on the desired output resolution and coverage requirements. By optimizing the overlapping regions and angular separation between cameras, the system minimizes stitching artifacts while maintaining complete 360-degree coverage, achieving both coverage area and image quality.

Inventive Principle:
Principle #15Dynamics

3Area of stationary object

If fisheye lenses are used in multiple cameras, then the wide-angle coverage is improved, but distortion in the captured images increases

Engineering Contradiction:
Improveangular coverageVSAvoidimage distortion
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The system changes the optical parameters by using reflectors with specific curvature radii and camera positioning angles to achieve the desired wide-angle coverage without the extreme distortion characteristics of fisheye lenses. The reflector geometry is optimized to provide a corrected projection that maintains straight lines and accurate spatial relationships while capturing the full 360-degree field of view.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate depth imaging and skeletal tracking within a 360-degree field of view, reducing costs and artifacts, allowing for gesture-based control and efficient environmental mapping.

Implementation Method 1

projecting light via the projector onto the reflector subsystem for reflection into the surrounding environment

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

employing time-of-flight or structured light techniques

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 3

receiving at the image sensor, via the reflector subsystem, light from the projector that is reflected by objects within the 360-degree field of view

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentEP3278163B1Depth imaging system
Publication Date: 2023.08.23 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Examples are disclosed herein that are related to depth imaging of a 360-degree field of view. One example provides a depth imaging system comprising an image sensor, a reflector subsystem comprising one or more reflectors arranged to reflect a radial field of view of a surrounding environment toward the image sensor, a projector configured to project light onto the reflector subsystem for reflection into the surrounding environment, and a computing device comprising a logic subsystem and a storage subsystem comprising instructions executable by the logic subsystem to receive image data from the image sensor, and output a depth image based upon the image data.