Image Processing Cutout Region Stabilization via Dead Zone Thresholding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies are limited in determining the position of the cutout region for objects, as they often rely on the position of the object after movement, leading to instability and inaccurate cropping, especially when the object's position changes significantly between frames.

Innovation Solution

An image processing device and method that sets a first region based on the detection position of an object in a first frame image and decides the cutout region in subsequent frames based on the positional relation between the first region and the object's detection position, using a dead zone region to stabilize the cropping and account for changes in object position.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the cutout region is decided always on the basis of a position of a person after moving, then the cutout region can be updated in real-time, but the position of the cutout region becomes unstable when the person moves rapidly

Engineering Contradiction:
Improvereal-time update speedVSAvoidcutout region position stability
Core Design Contradiction:
SpeedVSStability of the object's composition

Solution Approach 1:

The patent applies preliminary action by defining a dead zone region in advance around the object's detection position. When the object's movement stays within this pre-defined dead zone, the cutout region position is maintained without updating, thereby preventing instability while still allowing real-time updates when necessary.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the parameter of cutout region position update by introducing a threshold-based decision mechanism. Instead of continuously updating the cutout region position, the system only updates when the object's movement exceeds the dead zone threshold, thus balancing real-time responsiveness with position stability.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the cutout region position is frequently updated to track object movement, then the object visibility is maintained, but vibrations occur in the cropped image when the object moves rapidly

Engineering Contradiction:
Improveobject detection precisionVSAvoidcropped image stability
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The dead zone region is defined in advance as a threshold area around the object's detection position. By checking whether the object's movement exceeds this pre-defined zone before updating the cutout region, the system maintains detection precision while avoiding unnecessary updates that cause vibrations in the cropped image.

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If the cutout region is decided based on object position in each frame independently, then the processing is simple, but the cutout region does not account for changes in object position between frames

Engineering Contradiction:
Improveprocessing complexityVSAvoidcutout region accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent implements feedback by comparing the object's current detection position with the previous position and using this information to decide whether to update the cutout region. This simple feedback mechanism ensures the cutout region accurately reflects object position changes while maintaining processing simplicity through the dead zone threshold.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10607088B2Image processing device, image processing method, and image processing system
Publication Date: 2020.03.31 SONY GROUP CORP
  • US10607088B2 patent drawing
  • US10607088B2 patent drawing
  • US10607088B2 patent drawing

AI summary

The present disclosure provides an image processing device, image processing method, and image processing system that are capable of deciding a cutout region in accordance with change in the detection position of the same object between frame images captured at different times. The image processing device includes: a first region setting unit configured to set a first region including a detection position of an object in a cutout region in a first frame image; and a cutout region deciding unit configured to decide a cutout region in a second frame image subsequent to the first frame image, on the basis of a positional relation between the first region and a detection position of the object in the second frame image.