Image Processor Time Divisional Motion Still Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Camera devices face challenges in processing both motion and still images simultaneously, leading to shutter lag and inability to maintain motion image output at the input frame rate, due to limited processing capabilities.

Innovation Solution

An image processing apparatus and method that processes motion images first, buffers them, and then processes still images, allowing for output of processed motion images at a predetermined frame period, while buffering and processing still images to ensure zero shutter lag and consistent viewing image output.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the image processor processes both motion and still images simultaneously, then the still image processing can be completed, but the motion image output frame rate cannot be guaranteed

Engineering Contradiction:
Improvestill image processing completionVSAvoidmotion image output frame rate
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The image processor segments the processing of motion images and still images into separate time slots within each frame period. Motion images are processed first during the primary processing window, while still images are processed during the residual part of the frame or the beginning part of the next frame, ensuring both types of images receive dedicated processing resources without interfering with each other's frame rate requirements.

Inventive Principle:
Principle #1Segmentation

2Productivity

If the image processor prioritizes motion image processing, then the motion image output frame rate is maintained, but still image processing may be delayed

Engineering Contradiction:
Improvemotion image output frame rateVSAvoidstill image processing delay
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary buffering of still images during the motion image processing period. The still image buffer stores incoming still images while the image processor is dedicated to motion image processing. This preliminary action ensures that when the residual part of the frame or next frame begins, the still images are already ready for immediate processing, minimizing delay and achieving zero shutter lag.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If the frame period is extended to accommodate still image processing, then still image processing can be completed, but motion image output timing becomes inconsistent

Engineering Contradiction:
Improvestill image processing completionVSAvoidmotion image output timing consistency
Core Design Contradiction:
Manufacturing precisionVSStability of the object's composition

Solution Approach 1:

The system implements periodic action by establishing a fixed frame period structure that repeats consistently. Within each periodic frame period, motion images are processed during a predetermined time slot, and still images are processed during the residual part. This periodic structure ensures that motion images are always output at consistent intervals (maintaining frame rate stability) while still images are processed systematically without extending the overall frame period.

Inventive Principle:
Principle #19Periodic action

4Productivity

If the image processor processes still images during the current frame, then processing efficiency is improved, but motion image processing time is reduced

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidmotion image processing time
Core Design Contradiction:
ProductivityVSDuration of action of moving object

Solution Approach 1:

The system dynamically allocates processing time between motion and still images based on the actual processing requirements. The image processor is configured to process motion images first during the primary processing window, then dynamically transition to processing still images during the residual part of the frame or the beginning part of the next frame. This dynamic time allocation ensures that motion images receive sufficient processing time to maintain output frame rate, while still images are processed efficiently without compromising overall system productivity.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9998670B2Image processing apparatus and method
Publication Date: 2018.06.12 SAMSUNG ELECTRONICS CO LTD
  • US9998670B2 patent drawing
  • US9998670B2 patent drawing
  • US9998670B2 patent drawing

AI summary

An image processing apparatus and method for regulating viewing image output of the image processor which processes motion and still images in a time divisional manner are provided. The image processing apparatus includes an image processor processing the viewing and still images in a time divisional manner, a timing manager storing the viewing image processed by the image processor temporarily and outputting the viewing image at a preset time of a frame period, and a controller controlling, in response to a capture request, the image processor to process the still image at a residual part of a current frame to be at a beginning part of a next frame and to process the buffered viewing image to be at the residual part of the next frame, wherein the residual part of the next frame is a part which remains after processing the still image completely.