Image Processing for Subject Cut-Out and Shot Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge lies in efficiently cutting out a specific subject from a captured image and switching between multiple shots including the cut-out image for broadcasting or distribution, especially when resources are limited or personnel lack specialized knowledge.

Innovation Solution

An image processing device equipped with a user interface for cropping and switching functions, allowing for manual, semi-automatic, or automatic modes to facilitate cutting out a portion of a captured image and generating cut-out images for seamless switching in moving image content production.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual cutting-out operation is performed to cut out a specific subject from a captured image, then the precision of cutting-out can be improved, but the operation time and complexity increase

Engineering Contradiction:
Improvecutting-out precisionVSAvoidoperation time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically detecting the subject and generating candidate crop regions before the user makes a final selection. This reduces the time required for manual cutting-out while maintaining precision, as the user only needs to review and confirm pre-prepared options rather than creating crop regions from scratch.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary step where automatically generated candidate crop regions serve as a bridge between fully automatic cutting-out and manual cutting-out. The user interacts with these pre-generated candidates to make the final cutting-out decision, combining the speed of automatic detection with the precision of manual selection.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If fully automatic cutting-out is performed without user intervention, then the operation speed can be improved, but the precision and adaptability to user intention decrease

Engineering Contradiction:
Improveoperation speedVSAvoidcutting-out precision
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system performs partial automatic action by generating multiple candidate crop regions instead of selecting a single automatic result. This provides enough automated processing to maintain speed while giving the user sufficient options to achieve precise cutting-out according to their specific intentions.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system dynamically adapts between automatic and manual modes based on user needs. The user interface allows flexible interaction where users can review automatically generated candidates and make adjustments, creating a dynamic balance between automation speed and precision control.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If multiple shots including cut-out images are switched for moving image production, then the realism and interest of content can be improved, but the device complexity and operational difficulty increase

Engineering Contradiction:
Improvecontent qualityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the complex task of shot switching into manageable components: automatic subject detection, candidate crop region generation, and user confirmation. This segmentation reduces operational difficulty by breaking down the complex process into simpler, more intuitive steps while maintaining the ability to produce high-quality multi-shot content.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs self-service by automatically detecting subjects and generating appropriate crop regions without requiring users to have specialized knowledge of image processing or video production. This enables users with limited expertise to create professional-quality content with minimal effort.

Inventive Principle:
Principle #25Self-service

4Ease of manufacture

If resource constraints are considered in image production, then the cost efficiency can be improved, but the functionality and quality of image processing may be limited

Engineering Contradiction:
Improvecost efficiencyVSAvoidprocessing capability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The system enables cost-efficient image production by performing automatic subject detection and crop region generation without requiring specialized personnel or expensive equipment. This self-service capability allows organizations with limited resources to produce high-quality cut-out images and multi-shot content that previously required professional expertise.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system creates multiple candidate crop regions as copies of the original captured image, allowing users to review and select the best option without needing to perform multiple separate shooting operations. This virtual copying approach maintains processing capability while reducing the need for additional physical resources.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP3923570B1Image processing device, image processing method, and program
Publication Date: 2025.10.15 SONY GROUP CORP
  • EP3923570B1 patent drawingFigure 1
  • EP3923570B1 patent drawingFigure 2
  • EP3923570B1 patent drawingFigure 3

AI summary

Cut-out processing for cutting out a portion of a region of a captured image, display control processing of a first screen including a captured image display region for displaying the captured image and a cut-out image display region for displaying a cut-out image cut out in the cut-out processing, display control processing for making display transition from the first screen to a second screen in which a cut-out region obtained from the captured image is set, processing for receiving a first user operation of designating, in the second screen, at least one set of coordinates and a second user operation of designating a subject, and processing for setting a cut-out region on the basis of the first user operation or the second user operation are performed.