Virtual Camera Composition Control for Immersive Live Event Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image-capture control technologies focus on improving tracking accuracy but fall short in enhancing the immersive feeling required for capturing events like music live shows.

Innovation Solution

An information processing device that performs image-capture control based on image-capture rendering information and target information, allowing for selective control of real and virtual cameras, including pan, tilt, and zoom, to enhance the immersive experience by focusing on specific subjects or positions, and providing user interface options for rendering effects like gradual zoom and hand-held camera simulation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image-capture control emphasizes tracking accuracy improvement, then subject tracking precision is enhanced, but immersive feeling for captured images deteriorates

Engineering Contradiction:
Improvetracking accuracyVSAvoidimmersive feeling
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by enabling the camera system to switch between different control modes (tracking mode and immersive mode) based on scene requirements. The system dynamically adjusts camera parameters including orientation, zoom, and focal length to either precisely track subjects or create immersive viewing experiences, resolving the contradiction between tracking accuracy and immersive feeling.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The invention utilizes parameter changes by modifying camera settings such as focal length, zoom level, and orientation angles to achieve different capture effects. By adjusting these parameters, the system can transition from high-precision tracking (with fixed focal length and orientation) to immersive capture (with variable focal length and dynamic orientation), thereby resolving the technical contradiction.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If camera orientation is controlled to track detected subject, then subject tracking is improved, but composition flexibility deteriorates

Engineering Contradiction:
Improvesubject trackingVSAvoidcomposition flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system implements dynamics by making the camera orientation and zoom levels adaptable rather than fixed. The control unit dynamically adjusts orientation angles and zoom parameters based on whether the current priority is subject tracking or composition flexibility, allowing the system to serve both purposes effectively through time-varying parameter adjustment.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies universality by designing a camera control system that performs multiple functions: precise subject tracking when needed, and flexible composition control when needed. The system universally handles both tracking-oriented capture and composition-oriented capture by integrating multiple control algorithms and allowing mode switching, thereby resolving the contradiction between specialized tracking and general composition flexibility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If zoom is controlled to make angle of view coincident with preset angle of view, then angle of view accuracy is improved, but scene adaptability deteriorates

Engineering Contradiction:
Improveangle of view accuracyVSAvoidscene adaptability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system applies dynamics by making zoom levels and angle of view parameters dynamic rather than fixed to presets. The control unit adjusts zoom ratios in real-time based on scene requirements, allowing the system to achieve both accurate angle of view control for specific compositions and adaptability for diverse scenes through continuous parameter adjustment.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The invention utilizes parameter changes by modifying zoom ratios and angle of view settings based on detected scene characteristics. The system changes these parameters dynamically to match either preset compositions for accuracy or adaptive compositions for scene versatility, resolving the contradiction between fixed angle of view accuracy and flexible scene adaptability.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20260012699A1Information processing device, information processing method, and program
Publication Date: 2026.01.08 SONY GROUP CORP
  • US20260012699A1 patent drawing
  • US20260012699A1 patent drawing
  • US20260012699A1 patent drawing

AI summary

There is provided an information processing device that includes a control unit configured to perform image-capture control on the basis of image-capture rendering information indicating a change in captured image and image-capture target information indicating an image-capture target. The term “image-capture” used herein means an operation for obtaining an image using a camera, the “camera” being defined as both a real camera and a virtual camera that virtually changes composition by clipping a part of an image obtained as a result of a light-receiving operation of the real camera.