Virtual Camera Composition Control for Automated Video Production

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video production systems struggle to automatically determine camera composition and switching in a way that ensures main subjects are prominently featured and irrelevant content is minimized, leading to unnatural video output when multiple cameras are used.

Innovation Solution

An information processing apparatus that generates virtual camera videos based on captured videos and performs composition update control using subject determination information, allowing for automatic selection and switching of camera angles and subjects to optimize video content quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If automatic camera composition determination is performed without subject consideration, then automation level is improved, but video content quality deteriorates due to unnatural subject distribution

Engineering Contradiction:
Improveautomatic camera composition determinationVSAvoidvideo content quality
Core Design Contradiction:
Extent of automationVSManufacturing precision

Solution Approach 1:

The system performs subject determination on captured video frames and uses this information as feedback to automatically adjust camera composition. The composition determination unit analyzes subject positions and characteristics to dynamically control camera switching and framing, creating a closed-loop system that adapts to actual video content rather than using fixed or random composition rules.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes composition parameters (such as framing, angle, and camera position) based on subject determination results. By dynamically adjusting these parameters according to the detected subjects and their importance, the system achieves both automation and high video quality, avoiding the monotony of fixed composition while maintaining natural subject distribution.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If multiple cameras are used to capture events, then coverage and perspective are improved, but complexity of automatic composition control increases

Engineering Contradiction:
Improvecamera coverage and perspectiveVSAvoidautomatic composition control system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system divides the complex task of multi-camera composition control into separate functional modules: a composition determination unit that analyzes individual camera feeds, a subject determination unit that identifies important elements, and a control unit that coordinates camera switching. This segmentation allows each module to handle specific aspects of the complex problem independently, reducing overall system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The composition determination unit serves multiple functions: it analyzes subject positions, determines subject importance, selects appropriate camera angles, and coordinates switching between multiple cameras. By making this unit multi-functional, the system reduces the need for separate specialized components, thereby simplifying the overall architecture while maintaining versatile camera control capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20240380967A1Information processing apparatus, information processing method, program, and information processing system
Publication Date: 2024.11.14 SONY SEMICON SOLUTIONS CORP
  • US20240380967A1 patent drawing
  • US20240380967A1 patent drawing
  • US20240380967A1 patent drawing

AI summary

Information processing that accommodates video content production that maintains content quality and automatically determines composition in a camera video or the like is disclosed. In one example, an information processing apparatus includes a video controller that generates a virtual camera video to be used for an output video on the basis of a captured video by a camera, and performs composition update control of the virtual camera video on the basis of determination information regarding a subject in the captured video or the output video.