OIS Module Super-Resolution Imaging via Subpixel Shifts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image-based applications face limitations due to image quality issues like blur and insufficient resolution, and the inclusion of high-resolution sensors increases camera costs, necessitating a cost-effective solution for obtaining high-resolution images on demand.

Innovation Solution

Utilizing optical image stabilization (OIS) hardware and image processing techniques to capture multiple low-resolution images and process them to produce high-resolution images, with the OIS module moving to specific positions based on resolution requirements and employing algorithms like Fourier transforms and back-projection for de-blurring.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a high resolution sensor is used, then image resolution is improved, but device cost increases

Engineering Contradiction:
Improveimage resolutionVSAvoiddevice cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The imaging process is segmented into multiple low-resolution captures taken at different OIS positions, rather than using a single high-resolution sensor. Each capture contributes partial information that is later combined through image processing to reconstruct a high-resolution image, dividing the resolution achievement across multiple lower-cost components and operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The OIS module serves as an intermediary mechanism that enables super-resolution by capturing multiple images at different positions. Instead of directly using a high-resolution sensor, the system uses the OIS hardware (designed for motion compensation) as a mediator to acquire multiple low-resolution images that are then processed to achieve high resolution, bridging the gap between low-resolution hardware and high-resolution output.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple images are captured and processed, then image resolution is improved, but processing time increases

Engineering Contradiction:
Improveimage resolutionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing multiple images in quick succession with the OIS module positioned at predetermined locations before any processing occurs. The images are captured with proper timing and positioning in advance, preparing the data in a format optimized for subsequent super-resolution processing, which reduces the overall time penalty by having the groundwork ready beforehand.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If OIS module moves to specific positions, then image resolution is improved, but device complexity increases

Engineering Contradiction:
Improveimage resolutionVSAvoidhardware control complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The OIS module, originally designed for a single function of optical image stabilization and motion compensation, is repurposed to perform multiple functions: it stabilizes images during capture and simultaneously enables super-resolution imaging by moving to specific predetermined positions. This multi-functionality allows the existing hardware to achieve enhanced resolution capabilities without adding dedicated super-resolution mechanisms, thereby limiting the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3217353B1An imaging device for producing high resolution images using subpixel shifts and method of using same
Publication Date: 2020.11.18 HAND HELD PRODS INC
  • EP3217353B1 patent drawingFigure 1
  • EP3217353B1 patent drawingFigure 2
  • EP3217353B1 patent drawingFigure 3

AI summary

An imaging device for producing a high resolution image of a target with an imaging sensor and a method using the same is provided. The method is comprised of the steps of: determining, from the target size, resolution requirements of the image to be produced; capturing multiple individual low resolution images of the target, a minimum number of individual images captured being based upon the resolution requirements determined in the determining resolution requirements step; moving the OIS module to specific positions between the capturing of the individual low resolution images in the capturing multiple low resolution images step, the specific positions being based upon the resolution requirements in the determining resolution requirements step; and processing the multiple low resolution images to produce a high resolution image.