Shutter Time Compensation for Hybrid Imaging Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging devices suffer from shutter lag, causing users to miss capturing high-resolution still images of moments of interest due to delays, leading to blurry up-sampled images when attempting to compensate with lower resolution video.

Innovation Solution

The device generates high-resolution still images by utilizing information from high-frequency texture areas of already captured still images and motion data from lower resolution video frames, applying intelligent up-sampling to create a clearer image corresponding to the missed moment of interest.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If shutter speed is increased to capture fast moving objects, then the moment of interest can be captured, but shutter lag causes the user to miss the actual moment of interest

Engineering Contradiction:
Improveshutter speedVSAvoidshutter lag
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The system performs preliminary capture of high-resolution still images at regular intervals during video recording, so that when a moment of interest is identified, a reference image is already available for processing, eliminating the need to wait for shutter activation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a copy of the moment of interest by applying motion compensation to a reference still image using motion vectors derived from video frames, generating a synthesized high-resolution image that represents the missed moment without requiring direct capture at that exact instant

Inventive Principle:
Principle #26Copying

2Volume of moving object

If conventional up-sampling is applied to lower resolution video to compensate for missed moments, then a high resolution image can be generated, but the image quality is poor with visible up-sampling artifacts

Engineering Contradiction:
Improveimage resolutionVSAvoidimage quality
Core Design Contradiction:
Volume of moving objectVSManufacturing precision

Solution Approach 1:

The system uses a reference high-resolution still image as an intermediary, applying motion compensation techniques to transfer detailed texture information from the reference image to the moment of interest, avoiding direct up-sampling of low-resolution video while still achieving high resolution output

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes the resolution parameter by capturing and processing high-resolution still images at intervals, then uses motion compensation to apply high-resolution texture details to the moment of interest, rather than attempting to up-sample low-resolution video directly

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS7705889B2Shutter time compensation
Publication Date: 2010.04.27 SONY GROUP CORP
  • US7705889B2 patent drawing
  • US7705889B2 patent drawing
  • US7705889B2 patent drawing

AI summary

A hybrid imaging device is configured to capture low resolution video and high resolution still images. The imaging device is configured to apply motion information obtained from the low resolution video to a reference high resolution still image to generate a missing moment of interest high resolution still image. The low-resolution video is captured at a high frame rate in conjunction with a few high-resolution still pictures taken at periodic intervals. A user locates a desired scene of interest, e.g. a moment of interest, from the captured video, and a post-processing technique is used to generate the high resolution still picture corresponding to the selected moment of interest. The high resolution still image is generated using texture information from one or more nearby captured high resolution still images and motion information from the low-resolution video frame corresponding to the selected moment of interest.