Image Synthesis Mask for Slow Shutter Photography Stabilization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for performing slow shutter photography require fixing image pickup apparatuses, such as cameras, using tripods, which is cumbersome and restricts composition, and existing techniques fail to capture object movements naturally.
Innovation Solution
An image processing apparatus that generates a synthesis mask based on the specific direction of a long-exposure image from consecutively photographed images with different exposure times, allowing for the synthesis of images to isolate object movements in slow shutter photography without the need for a tripod.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If a tripod is used to fix the camera for slow shutter photography, then camera stability is improved, but device complexity and ease of operation deteriorate due to carrying and setting requirements
Solution Approach 1:
The patent replaces the mechanical tripod support system with an image processing system that uses software algorithms to stabilize images. The stabilization unit processes consecutively captured images to generate a stabilized image with slow shutter effect, eliminating the need for mechanical tripods while maintaining camera stability.
Solution Approach 2:
The patent captures multiple copies of the same scene at different time points and processes them together. By consecutively capturing images and synthesizing them, the system creates a virtual stabilized image that replicates the effect of a fixed camera without requiring physical fixation.
2Manufacturing precision
If a tripod is used to fix the camera, then image quality is improved, but device complexity worsens due to additional equipment requirements
Solution Approach 1:
The patent substitutes the mechanical tripod system with a computational image processing system. The image processing apparatus uses software-based stabilization algorithms to achieve high-quality images without requiring additional mechanical support equipment, thereby reducing device complexity while maintaining or improving image quality.
Solution Approach 2:
The patent makes the camera itself multi-functional by integrating both capture and stabilization functions into a single device. The same camera that captures images also processes and stabilizes them through the stabilization unit, eliminating the need for separate tripod equipment and reducing overall system complexity.
3Ease of operation
If conventional synthesis methods are used to create slow shutter effect, then ease of operation is improved, but image naturalness deteriorates because object movements cannot be captured
Solution Approach 1:
The patent applies different processing characteristics to different regions of the image. The stabilization unit identifies moving objects and preserves their motion characteristics while stabilizing the background. This local differentiation allows moving objects to maintain their natural movement appearance while the background achieves the slow shutter effect, enhancing overall image naturalness.
Solution Approach 2:
The patent uses feedback from analyzing consecutive images to identify moving objects and adjust the synthesis process accordingly. By detecting object movements across frames and incorporating this information into the stabilization algorithm, the system preserves natural object movements while creating the slow shutter effect, improving image naturalness.
Data Source
AI summary
The present disclosure relates to an image processing apparatus, an image processing method, and a program therefor with which slow shutter photographing can be performed with ease. An image gradient extraction unit extracts image gradient components in an object movement direction from a long-exposure image out of input images. An initial label map generation unit generates an initial label map based on a gradient extraction result from the image gradient extraction unit. A foreground extraction unit extracts a foreground from the input images based on the label map from the initial label map generation unit or label map update unit to generate a synthesis mask. The present disclosure is applicable to, for example, an image pickup apparatus including an image processing function.