Lensless Camera Image Processing Field of View Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Lensless cameras face challenges in controlling the field of view without reducing resolution or increasing calculation time, particularly when trying to narrow the imaging range or improve resolution.

Innovation Solution

An image processing apparatus that generates a restored image by executing arithmetic processing of observed image signals in a restored region, using an inverse or pseudo-inverse matrix, and includes a signal processing unit that subtracts non-included observed image signals to control the field of view and maintain resolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the number of three-dimensional sampling points P is increased to improve resolution, then the resolution of the restored image is improved, but the reconstruction time increases significantly

Engineering Contradiction:
ImproveresolutionVSAvoidreconstruction time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent divides the captured image region into multiple restored image regions, each corresponding to a specific field of view. By segmenting the reconstruction task into region-specific sub-tasks, the system can process each region independently with optimized sampling points, reducing overall computation time while maintaining resolution quality in each region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing strategies to different regions based on their specific requirements. Each restored image region can have customized sampling point density and reconstruction parameters optimized for its local characteristics, allowing high resolution where needed while reducing computation in less critical areas.

Inventive Principle:
Principle #3Local quality

2Ease of operation

If the field of view is narrowed to limit the imaging range, then the field of view is controlled, but the resolution is reduced when simply cutting out part of the captured image

Engineering Contradiction:
Improvefield of view controlVSAvoidresolution
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent segments the wide field of view into multiple smaller restored image regions, each with its own optimized sampling points and reconstruction parameters. This allows the system to maintain high resolution in each region while collectively covering a controlled field of view, avoiding the resolution loss that would occur with simple cropping.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary calculation of region-specific mask matrices and sampling point configurations before actual image reconstruction. By pre-processing and organizing the data structure for each region in advance, the system enables fast, high-resolution reconstruction when field of view adjustment is needed, without sacrificing quality.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11663708B2Image processing apparatus, imaging apparatus, and image processing method
Publication Date: 2023.05.30 SONY GROUP CORP
  • US11663708B2 patent drawing
  • US11663708B2 patent drawing
  • US11663708B2 patent drawing

AI summary

A field of view of a captured image of a lensless camera can be controlled, and a configuration of generating a restored image including part of an imaging region is realized. Included is a signal processing unit that receives observed image signals as output of an image sensor of a lensless camera to generate a restored image of a restored image region including part of a captured image region of the lensless camera. The signal processing unit includes: a restored image region corresponding mask matrix calculation unit that calculates a restored image region corresponding mask matrix applied to generate the restored image; and an image estimation unit that subtracts observed image signals outside of the restored image region not included in the restored image region from the observation image signals to calculate observed image signals inside of the restored region and that executes arithmetic processing of the observed image signals inside of the restored region and a pseudo-inverse matrix or an inverse matrix of the restored image region corresponding mask matrix to generate the restored image.