Camera Module Sensor Segmentation for TOF Depth Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing time-of-flight (TOF) method for acquiring depth information faces challenges in processing speed and accuracy, particularly when measuring distant or moving objects, and requires high processing speed for sorting and correcting depth and color information.

Innovation Solution

A camera module with a filter and sensor configuration that separates optical signals into different wavelength bands, allowing for simultaneous acquisition of depth and color information using distinct sensing areas, and a calculation unit that generates three-dimensional content by processing these signals efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If TOF method is used to acquire depth information, then real-time distance information is quickly provided, but processing speed for sorting and correcting depth and color information is reduced

Engineering Contradiction:
Improveprocessing speedVSAvoidtime for sorting and correcting depth and color information
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The sensor is divided into multiple sensing areas, with specific areas dedicated to depth information acquisition and others to color information acquisition. This segmentation allows parallel processing of depth and color data, eliminating the need for sequential sorting and correction operations, thereby improving processing speed while reducing time loss.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a spatial dimension solution by assigning different sensing areas to different functions (depth vs. color). This dimensional separation in the sensor array enables simultaneous acquisition and processing of both data types without temporal overhead, resolving the speed-time contradiction.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If TOF method is used to measure distant objects, then depth information can be acquired, but accuracy is lowered when distance to object is increased

Engineering Contradiction:
Improvedepth information accuracyVSAvoiddistance to object
Core Design Contradiction:
Measurement precisionVSLength of stationary object

Solution Approach 1:

The patent applies local quality by optimizing specific sensing areas for depth measurement with enhanced characteristics. Certain sensing areas are configured with properties optimized for distant object detection, allowing accurate depth measurement at increased distances while other areas handle color information, thus maintaining measurement precision despite increased distance.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If separate processing of depth and color information is performed, then accurate depth information is acquired, but device complexity increases

Engineering Contradiction:
Improvedepth information accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges depth sensing and color sensing into a single integrated sensor array with spatially separated sensing areas. This combining approach maintains accurate depth information acquisition while simplifying the overall device structure by eliminating the need for separate depth and color camera systems, thus reducing device complexity.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration enables high-speed processing and improved accuracy in generating three-dimensional content, even at increased distances, with reduced data processing and without significantly increasing sensor pixel count.

Implementation Method 1

the filter includes a first filter area through which a first wavelength band as a pass band passes and a second filter area through which a second wavelength band different from the first wavelength band as a pass band passes

Methodology Applied
Scientific EffectOptical filtering by wavelength band: Filter (optical)

Implementation Method 2

a sensor configured to receive the passed optical signal

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Implementation Method 3

a distance to an object is calculated using information about light that is emitted and reflected

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS11863735B2Camera module
Publication Date: 2024.01.02 LG INNOTEK CO LTD
  • US11863735B2 patent drawing
  • US11863735B2 patent drawing
  • US11863735B2 patent drawing

AI summary

According to an embodiment of the present invention, disclosed is a camera module comprising: an optical output unit for outputting an optical signal to an object; an optical unit for transmitting the optical signal reflected from the object; a sensor for receiving the optical signal transmitted through the optical unit; and a control unit for acquiring the depth map of the object by using the optical signal received by the sensor, wherein the sensor includes an effective area in which a light receiving element is arranged and a non-effective area excluding the effective area, and includes a first row area in which the effective area and the non-effective area are alternately arranged in a row direction, and a second row area in which the effective area and the non-effective area are alternately arranged in the row direction, and in which the effective area is arranged in a column direction at a position not overlapping with the effective area of the first row area, light reaching the effective area of the first row area is controlled by means of first shifting control so as to reach the non-effective area of the first row area or the non-effective area of the second row area, and light reaching the effective area of the second row area is controlled by means of the first shifting control so as to reach the non-effective area of the second row area or the non-effective area of the first row area.