Virtual Camera Configuring via Shape Envelopes for Multi-Subject Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing viewpoint determining systems fail to produce broadcast-quality footage during interactions between multiple subjects in dynamic events, such as sports, due to the complexity of determining optimal camera positions in real-time.
Innovation Solution
A method and system that detect motion attributes of objects, determine interaction points, and configure a virtual camera based on shape envelopes to capture interacting objects, ensuring smooth and engaging coverage by predicting interactions and applying compositional constraints.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a viewpoint determining system uses tracking devices to create a virtual camera tethered to a single subject, then real-time subject tracking is achieved, but broadcast quality footage during interactions between multiple subjects cannot be produced
Solution Approach 1:
The system segments the scene into multiple object detections, tracking each subject independently while maintaining their spatial relationships. This allows the virtual camera to switch between single-subject tracking and multi-subject interaction capture by processing each detected object separately and combining their positions to determine appropriate camera viewpoints.
Solution Approach 2:
The system dynamically adjusts the virtual camera configuration based on real-time detection of object interactions. When interactions between multiple subjects are detected, the camera positioning algorithm transitions from single-subject tethered tracking to multi-subject framing, automatically adapting to the changing scene complexity and interaction states.
2Adaptability or versatility
If considerable flexibility is afforded to the producer for creating optimal viewpoints, then various camera angles can be explored, but timely creation of optimal viewpoints for live events becomes difficult
Solution Approach 1:
The system performs preliminary calculations of optimal camera positions by pre-computing candidate viewpoints based on detected object positions and interactions. This allows the system to have optimal camera configurations ready in advance, eliminating the need for time-consuming manual adjustments during live events while maintaining flexibility in viewpoint selection.
Solution Approach 2:
The system continuously monitors object positions and interaction states, using this feedback to automatically adjust the virtual camera configuration in real-time. This closed-loop control enables timely creation of optimal viewpoints by constantly evaluating scene dynamics and adjusting camera parameters accordingly, eliminating manual intervention delays.
3Stability of the object's composition
If the virtual camera position is determined early based on prediction, then smooth coverage of interaction can be achieved, but rendering may need to be terminated or discarded if interaction fails to eventuate
Solution Approach 1:
The system performs preliminary rendering from the predicted camera position early in the interaction sequence, establishing a stable compositional framework. This early rendering provides smooth camera coverage for anticipated interactions, while the system maintains the ability to terminate or adjust rendering if the predicted interaction does not materialize, optimizing resource usage by avoiding complete re-rendering.
Data Source
AI summary
A computer-implemented method of configuring a virtual camera. A first and second object in a scene are detected, each object having at least one motion attribute. An interaction point in the scene is determined based on the motion attributes of the first and second objects. A shape envelope of the first and second objects is determined, the shape envelope including an area corresponding to the first and second objects at the determined interaction point. The virtual camera is configured based on the determined shape envelope to capture, in a field of view of the virtual camera, the first and second objects.