ToF Sensor Upsampling via Pixel Block Averaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional distance measurement using Time of Flight (ToF) sensors faces challenges in achieving accurate upsampling due to the assumption of pinpoint measurement, whereas actual pixels have a certain size, resulting in average distance measurement over a region, leading to inaccuracies in high-resolution data generation.
Innovation Solution
A distance measuring device and method that incorporates a continuous light reception unit, an intermittent light reception unit, and a distance measuring unit, which generates high-resolution distance data using average values of continuous and intermittent light reception data, with optional filtering, regression analysis, or energy minimization calculations to improve accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional upsampling is performed using image data as a hint, then high-resolution distance data can be generated, but measurement accuracy deteriorates due to the assumption of pinpoint measurement while actual pixels measure average distance over a region
Solution Approach 1:
The patent changes the fundamental parameter of measurement interpretation by treating each pixel measurement not as a single point but as an average over a region. This is achieved by dividing the image into pixel blocks and calculating average luminance values across multiple pixels, thereby transforming the upsampling approach from point-based to region-based measurement, which resolves the contradiction between achieving high resolution and maintaining measurement accuracy
Solution Approach 2:
The patent segments the image into multiple pixel blocks, where each block corresponds to one pixel in the low-resolution distance map. By dividing the high-resolution image into regions (pixel blocks) and calculating average values within each block, the method creates a correspondence between low-resolution distance measurements and high-resolution image regions, enabling accurate upsampling that respects the actual physical measurement characteristics
2Ease of manufacture
If pixel size is increased to reduce the number of pixels in ToF sensors, then manufacturing complexity is reduced, but measurement precision deteriorates due to average distance measurement over a larger region
Solution Approach 1:
The patent introduces an intermediary processing step that mediates between the low-resolution accurate measurements and high-resolution image data. By using the low-resolution distance map as a guide and transferring its characteristics to the high-resolution image through region-based correspondence, the system achieves high-resolution output without requiring physically small pixels, thus maintaining ease of manufacture while improving measurement precision through clever data processing
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enhances the accuracy of distance measurement by generating high-resolution data based on average values and intermittent light reception data, effectively addressing the limitations of conventional upsampling methods.
Implementation Method 1
Sensors (ToF sensors) that receive light include pixels arranged in a 2-dimensional array form. These respective pixels have light reception elements and can take in light.
Implementation Method 2
a distance measuring device that measures a distance on the basis of a phase difference of light
Data Source
AI summary
Upsampling is performed accurately in a device that measures a distance on the basis of a phase difference of light. A predetermined number of pixel blocks in which a plurality of continuous light pixels that generate continuous light reception data indicating amounts of received continuous light is arranged in a continuous light reception unit. An intermittent light pixel that generates intermittent light reception data indicating an amount of received intermittent light is provided in correlation with each of the predetermined number of pixel blocks in an intermittent light reception unit. A distance measuring unit generates distance data for each of the plurality of continuous light pixels using an average value of the continuous light reception data for each of the pixel blocks, the continuous light reception data, and the intermittent light reception data as high-resolution distance data.