Image Processing Device Subject-Background Blur Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies struggle to effectively suppress blur in the background while tracking a subject, as they primarily focus on stabilizing the camera and tracking the subject without adequate background correction.
Innovation Solution
An image processing device that includes a video acquisition unit, a movement amount identification unit, an object detection unit, a motion vector detection unit, a cutout position determination unit, and an image composition unit, which work together to identify camera shake, detect subject movement, and combine image data of the subject and background in a way that corrects for blur caused by camera shake.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the angle-of-view cutout range is moved in accordance with the motion of the subject, then the subject position is stabilized within the angle of view, but background blur occurs
Solution Approach 1:
The patent segments the image into subject area and background area, applying different processing strategies to each. The subject area undergoes tracking-based position stabilization, while the background area receives independent blur correction based on camera movement detection, allowing both requirements to be satisfied simultaneously without interference between the two regions
Solution Approach 2:
Different correction strategies are applied to different regions: the subject region uses motion compensation to maintain position stability, while the background region uses camera shake correction to reduce blur. This local differentiation resolves the contradiction by allowing each region to receive the specific treatment it needs rather than applying a uniform correction approach
2Object-affected harmful factors
If camera shake correction is applied to the entire image, then background blur is reduced, but subject movement tracking is compromised
Solution Approach 1:
The patent divides the image processing into separate channels: one for subject tracking and one for background correction. By segmenting the correction process, camera shake compensation can be applied to the background without interfering with subject tracking, as each region is processed independently with appropriate parameters
Solution Approach 2:
The patent applies local quality differentiation by adjusting correction strength and type for different regions. The background receives strong camera shake correction to eliminate blur, while the subject region receives motion-compensated correction to maintain position stability, resolving the contradiction through localized optimization
3Measurement precision
If subject tracking is performed without background consideration, then subject position is maintained, but naturalness of the image is reduced due to artificial background movement
Solution Approach 1:
The patent segments the image into subject and background regions, applying independent processing to each. The subject region is tracked and stabilized, while the background region is processed separately using camera movement data, allowing the background to move naturally according to camera shake without affecting subject position stability
Solution Approach 2:
The patent introduces camera movement information as an intermediary factor that mediates between subject tracking and background naturalness. This intermediary data allows the system to decouple subject position maintenance from background movement, enabling the background to reflect actual camera motion while the subject remains stable through separate tracking compensation
Data Source
AI summary
An object detection unit detects an object of interest from within frames of video acquired from an image capturing unit. A motion vector detection unit detects a motion vector of the object between the frames of the video. A cutout position determination unit determines a cutout position for cutting out an image of a predetermined size from each frame of the acquired video. A cutout position determination unit determines an object cutout position moved according to a composite vector obtained by combining the motion vector of the object with a correction vector for canceling out a blur caused by vibration applied to the image capturing unit and a background cutout position moved according to a correction vector. An image composition unit combines image data of the object cut out from the object cutout position with image data of a background cut out from the background cutout position excluding the object.