Directional Optics Camera System for Depth Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current pseudo-lidar systems are computationally intensive and physically large, leading to inefficiencies and delays in estimating depth using data from multiple cameras and sensors, particularly when dealing with moving vehicles and objects, causing frustration in accurately detecting objects and navigating environments.

Innovation Solution

A camera system with directional optics that uses purpose-built hardware to resolve angles of lightwaves by optimizing lens parameters, employing per pixel or area filtering, and resonant waveguide gratings to simplify processing and improve depth estimation, reducing computational load and physical size.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pseudo-lidar systems use multiple cameras and sensors to detect objects, then detection accuracy is improved, but computational complexity and processing time increase significantly

Engineering Contradiction:
Improvedepth estimation accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex computational image processing with optical hardware that directly encodes depth information. Directional optics and resonant waveguide gratings perform the depth encoding function optically rather than computationally, substituting a mechanical/optical system for a computational one.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs preliminary depth encoding through optical filtering before the image reaches the sensor. By resolving angles of light waves through directional optics and RWGs, the depth information is encoded in advance during light capture, rather than requiring intensive post-processing computation.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If pseudo-lidar systems use multiple cameras and sensors to detect objects, then detection accuracy is improved, but processing time and delays increase

Engineering Contradiction:
Improvedepth estimation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces time-consuming computational processing with real-time optical processing. The directional optics and resonant waveguide gratings encode depth information during the light capture process itself, eliminating the time delay associated with subsequent computational analysis of multiple camera images.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If pseudo-lidar systems use multiple sensors to estimate depth, then depth estimation capability is improved, but physical size of the system increases

Engineering Contradiction:
Improvedepth estimation capabilityVSAvoidphysical size
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent merges multiple sensor functions into a single camera system. By integrating directional optics and resonant waveguide gratings with a standard camera sensor, the system combines depth estimation, image capture, and angle resolution into one compact unit, eliminating the need for separate LIDAR or multiple camera systems.

Inventive Principle:
Principle #5Merging (Combining)

4Measurement precision

If pseudo-lidar systems process images from multiple cameras to resolve image overlap, then object detection accuracy is improved, but computational load and time consumption increase

Engineering Contradiction:
Improveobject detection accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces computational image overlap resolution with optical angle encoding. Instead of using algorithms to find corresponding points between multiple camera images, the directional optics system directly encodes the angle of incoming light, providing depth information without requiring computational matching of images from multiple cameras.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The camera system enhances depth estimation efficiency and accuracy by simplifying processing and reducing costs, enabling improved detection of objects and obstacles with reduced image distortion, similar to LIDAR systems but using simpler hardware.

Implementation Method 1

The camera system may use resonant waveguide gratings (RWG) on the light to resolve angles of a lightwave(s). The camera system may use the RWG as a bandpass filter to transmit resolved angles of light at the wavelength to a pixel of the detector array.

Methodology Applied
Scientific EffectResonant waveguide grating: Waveguide (optics)

Implementation Method 2

The camera system may use the RWG as a bandpass filter to transmit resolved angles of light at the wavelength to a pixel of the detector array.

Methodology Applied
Scientific EffectBandpass filtering: Filter (optical)

Implementation Method 3

A camera system with directional optics that uses purpose-built hardware to resolve angles of lightwaves by optimizing lens parameters

Methodology Applied
Scientific EffectLens focusing: Lens

Implementation Method 4

A detector array, operatively connected to the second component, senses the light using a pixel to form an image to estimate depth of the object.

Methodology Applied
Scientific EffectPhotoelectric detection: Photoelectric Effect

Data Source

PatentUS11513266B2Systems and methods for an improved camera system using directional optics to estimate depth
Publication Date: 2022.11.29 TOYOTA JIDOSHA KK
  • US11513266B2 patent drawing
  • US11513266B2 patent drawing
  • US11513266B2 patent drawing

AI summary

System, methods, and other embodiments described herein relate to a camera system. In one embodiment, the camera system includes a lens to receive light associated with an object and a first component, operatively connected to the lens, that inverts the light. The camera system also includes a second component, operatively connected to the first component, that resolves an angle of the light. A detector array, operatively connected to the second component, senses the light using a pixel to form an image to estimate depth of the object.