Video Subject Detection for Cropped Distribution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In video distribution systems, the existing methods for adjusting focus and exposure based on detected subjects can result in the subject being excluded from the distributed video, leading to improper focus and exposure adjustments when using the cropping function.

Innovation Solution

A video processing apparatus and method that detects subjects, acquires information on partial areas, and determines a main subject based on priority within those areas, ensuring the subject is included in the distributed video by setting the appropriate focus and exposure settings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the video distribution system uses a cropping function to distribute images from a partial region, then the user can receive video excluding unnecessary areas, but the subject for focus and exposure adjustment may be excluded from the distributed video

Engineering Contradiction:
Improvevideo distribution flexibilityVSAvoidsubject inclusion reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system performs preliminary actions by detecting subjects in the entire video frame before the cropping operation, and determines the main subject in advance. This allows the system to prepare focus and exposure settings based on the main subject's position in the full frame, ensuring the subject will be properly adjusted even after cropping to a partial region.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary determination process that acts as a mediator between subject detection and cropping operations. By determining a main subject based on priority calculations among multiple detected subjects, the system creates an intermediate step that ensures the selected subject aligns with both the cropping region and focus/exposure adjustment requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If the system determines the video recording area based on measurement operations such as photometry, then focus and exposure can be adjusted to the detected subject, but the obtained video may differ from what the user wants to distribute

Engineering Contradiction:
Improvefocus and exposure accuracyVSAvoiduser desired video area
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The system applies local quality by performing subject detection and main subject determination specifically within the partial region that will be distributed, rather than uniformly across the entire frame. This allows focus and exposure adjustments to be precisely targeted at the main subject within the user's desired video area, while maintaining adaptability to different cropping regions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system implements dynamics by making the main subject determination adaptive to the specific cropping region and detected subjects in each video frame. The priority calculation for determining the main subject dynamically adjusts based on the partial area configuration and detected subject positions, allowing the system to flexibly adapt to different distribution scenarios while maintaining precise focus and exposure control.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20240414429A1Video processing apparatus and method, image capturing apparatus, video distribution system, and storage medium
Publication Date: 2024.12.12 CANON KK
  • US20240414429A1 patent drawing
  • US20240414429A1 patent drawing
  • US20240414429A1 patent drawing

AI summary

A video processing apparatus comprising one or more processors and/or circuitry which functions as: a detection unit that detects a predetermined subject or subjects from video obtained from an image capturing unit that repeatedly shoots and outputs video; an acquisition unit that acquires information on at least one partial area set in the video obtained from the image capturing unit; and a determination unit that determines a main subject based on a priority of each subject within the partial area from among the subject or subjects detected by the detection unit.