Pixel-Shift Image Sensor Driving for High-Resolution Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image pickup techniques require multiple exposures and shifts to achieve high-resolution images, which are inefficient and prone to image blur due to movement of the object or camera, especially when exposure time is not synchronized with image capturing time.

Innovation Solution

An image pickup apparatus and method that uses a pixel-shift driving mechanism to move the image sensor in a predetermined direction with a non-integer multiple of the pixel pitch during exposures, allowing for simultaneous pixel shift and exposure, and combines image data from multiple frames to generate high-resolution images, while maintaining the aperture and shutter open to minimize image blur.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple exposures are performed with pixel shift between frames, then image resolution is improved, but photographing time is extended

Engineering Contradiction:
Improveimage resolutionVSAvoidphotographing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent merges the pixel shift operation with the exposure operation by performing both simultaneously during the same time period. The image sensor shifts to a next pixel shift position while exposure is being performed, eliminating the need for sequential execution of shift and exposure operations. This combining reduces the total photographing time while maintaining the ability to capture multiple frames at different pixel shift positions for high-resolution image generation.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If pixel shift is performed between exposures, then image resolution is enhanced, but image blur increases due to object or camera movement

Engineering Contradiction:
Improveimage resolutionVSAvoidimage quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent implements dynamic pixel shift operation where the image sensor continuously shifts to different positions during the photographing period. Multiple pixel shift positions are utilized to capture image data from different spatial locations, enabling high-resolution reconstruction through image combining. The dynamic shifting is coordinated with exposure timing to capture images at different phases of the shift motion, reducing the impact of object or camera movement on final image quality.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent maintains continuous useful action by performing exposure and pixel shift operations simultaneously without interruption. The image sensor continuously captures image data while shifting positions, ensuring that the photographing process remains productive throughout the entire duration. This continuous operation minimizes the time window during which object or camera movement could cause blur, while still gathering sufficient data from multiple pixel shift positions for high-resolution reconstruction.

Inventive Principle:
Principle #20Continuity of useful action

3Measurement precision

If exposure time is extended to capture multiple frames, then image resolution improves, but susceptibility to movement blur increases

Engineering Contradiction:
Improveimage resolutionVSAvoidmovement blur
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent employs periodic pixel shift operation where the image sensor shifts to predetermined positions at regular intervals during the photographing period. Multiple pixel shift positions are captured in a periodic sequence, allowing the system to gather image data from different spatial locations while maintaining consistent exposure conditions. This periodic shifting pattern enables high-resolution reconstruction while minimizing the impact of continuous movement during the extended photographing duration.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS10187594B2Image pickup apparatus, image pickup method, and non-transitory computer-readable medium storing computer program
Publication Date: 2019.01.22 OLYMPUS CORPORATION(JP)
  • US10187594B2 patent drawing
  • US10187594B2 patent drawing
  • US10187594B2 patent drawing

AI summary

An image pickup apparatus a includes a VCM configured to move relative positions of an image sensor and a light beam such that a movement amount of a frame period is a non-integer multiple of a pixel pitch, a microcomputer configured to cause the image sensor to perform exposures a plurality of times during the movement of the relative positions and acquire a plurality of image data, and a combination processing section configured to generate high-resolution combined image data from the acquired plurality of image data. The VCM sets the movement of the relative positions during the exposures in a same moving direction and a same movement amount in each of the exposures of the plurality of times.