Camera Image Processing Buffering for Shutter Lag Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Camera devices experience shutter lag, leading to missed shots due to the delay between triggering the shutter and actual image capture, especially when subjects move or blink during photography.

Innovation Solution

An image processing apparatus and method that buffers and processes camera output images in a time divisional manner, allowing for the selection and encoding of a shutter-lag-compensated capture image by scaling, buffering, and multiplexing viewing and capture images, enabling zero shutter lag by processing images at the correct timing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the camera processes the captured image in real-time, then the image processing speed is improved, but shutter lag occurs due to processing time

Engineering Contradiction:
Improveimage processing speedVSAvoidshutter lag
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent applies preliminary action by capturing and buffering the image data at the moment of shutter trigger, before actual processing occurs. The captured image is stored in a buffer memory, allowing the processing to happen subsequently without delaying the capture timing. This resolves the contradiction by performing the capture action in advance and decoupling it from the processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the image processing workflow into distinct phases: capture phase (buffering image data immediately upon shutter trigger), processing phase (scaling and encoding), and output phase (displaying or storing). By separating these phases, the system can capture images without lag while processing occurs independently in the background, resolving the time delay issue.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If the camera buffers and processes both viewing and capture images, then image quality is improved, but device complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent implements multi-functionality by using a single image processing pipeline that serves dual purposes: generating preview images for real-time display and producing high-quality capture images for storage. The same buffer memory and processing units handle both viewing and capture image streams, reducing the need for separate dedicated systems while maintaining image quality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the viewing image processing and capture image processing into a unified system. Both image streams share common components including the buffer memory, scaling unit, and encoding resources. This consolidation reduces device complexity by eliminating redundant components while still delivering high quality for both preview and final capture images.

Inventive Principle:
Principle #5Merging (Combining)

3Manufacturing precision

If the camera processes high resolution images, then image quality is improved, but processing time increases causing shutter lag

Engineering Contradiction:
Improveimage resolution qualityVSAvoidprocessing delay
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by capturing and buffering the complete high-resolution image data at the moment of capture, before any processing occurs. The full-resolution image is stored in buffer memory immediately, preserving all detail information. Subsequent processing (scaling for preview, encoding for storage) happens after capture, eliminating processing delay from the capture timing while maintaining high resolution quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the high-resolution image processing into separate stages: the capture stage buffers the complete high-resolution data without processing, the preview stage scales down to lower resolution for quick display, and the storage stage encodes the full-resolution image. This segmentation allows high resolution to be maintained in the buffer while processing occurs asynchronously, reducing perceived processing delay.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP2654288B1Image processing apparatus and method of camera
Publication Date: 2021.07.07 SAMSUNG ELECTRONICS CO LTD
  • EP2654288B1 patent drawingFigure 1
  • EP2654288B1 patent drawingFigure 2A
  • EP2654288B1 patent drawingFigure 2B

AI summary

An image processing apparatus and method of a camera is provided for compensating for shutter lag. An image processing apparatus includes an image scaler which scales a camera output image to a viewing image, a buffer which buffers the camera output image, a multiplexer which multiplexes outputs of the image scaler and the buffer, an image processor which processes multiplexed images corresponding to the multiplexed outputs of the image scaler and the buffer, a demultiplexer which demultiplexes an output of the image processor so as to supply the viewing image to a display unit, a codec which encodes the camera output image output by the demultiplexer into a capture image, and a controller which controls the multiplexer and the demultiplexer in a time divisional manner within a frame duration such that the image processor processes the viewing and camera output image sequentially in a capture mode.