Virtual Camera Clarity via Real Lens Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-definition displays, such as 4K and 8K, require improved image clarity for virtual camera views created by stitching high-definition images, especially when zooming, as existing methods can result in a lack of clarity due to digital zooming rather than real lens adjustments.
Innovation Solution
A system with remotely controlled cameras, like the Sony BRC-H900, that adjusts pan, tilt, and zoom to provide a super-high resolution image with improved clarity by mapping pixel positions to a virtual plane and using a chromatic aberration corrector, image alignment, and exposure correction, while predicting camera movements to maintain object tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If digital zooming is applied to create virtual camera views from stitched high-definition images, then the ability to provide flexible viewing angles and object tracking is improved, but the image clarity and resolution are degraded
Solution Approach 1:
The system dynamically switches between using pre-recorded camera movement data for accurate tracking and real-time sensor data for adaptive tracking, allowing the virtual camera to maintain both flexibility and image clarity through dynamic adjustment of the tracking method
Solution Approach 2:
The system creates a virtual camera that replicates the behavior of a physical camera by mapping pixel positions to a virtual plane and applying chromatic aberration correction, producing a copy of the camera view that maintains the clarity of the original captured image without digital zoom degradation
2Manufacturing precision
If multiple cameras are used to stitch super-high resolution images, then the image resolution and coverage area are improved, but the system complexity and processing requirements increase
Solution Approach 1:
The system performs image stitching and virtual camera view generation from pre-recorded footage during offline processing, eliminating the need for complex real-time processing of multiple camera feeds and reducing system complexity while maintaining super-high resolution output
Solution Approach 2:
The system introduces a virtual camera as an intermediary layer between the stitched super-high resolution image and the final output, allowing complex multi-camera data to be simplified into a single virtual camera view that maintains resolution while reducing output complexity
3Speed
If real-time object tracking is implemented during fast-moving events, then the ability to follow action is improved, but the accuracy of object position and image clarity may be compromised
Solution Approach 1:
The system pre-records the actual camera movement data during the event and applies it during playback to generate the virtual camera view, ensuring that object tracking maintains the same speed and accuracy as the original camera without the limitations of real-time processing
Solution Approach 2:
The system uses sensor data from the physical camera as feedback to continuously adjust and refine the virtual camera's tracking of moving objects, maintaining measurement precision by comparing predicted object positions with actual sensor-derived positions and correcting deviations in real-time
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
An apparatus for analysing a video recording of a sporting event, comprising: first receiver circuitry operable to receive a plurality of first event records, each first event record indicating a start time, an end time and an identifier of a participant of the sporting event; timeline generator circuitry operable to generate a timeline of the sporting event and to output the timeline for display, wherein the timeline indicates an elapsed time of the video recording of the sporting event along a first axis, the timeline indicates the identifier of the participant of the sporting event of each first event record along a second axis, and the timeline comprises a plurality of first timeline elements each corresponding to a respective first event record, each first timeline element extending along a portion of the first axis defined between the start time and the end time of its corresponding first event record and each first timeline element extending along a portion of the second axis associated with the identifier of the participant of the sporting event of its corresponding first event record; second receiver circuitry operable to receive participant tracking data indicative of a position of each participant of the sporting event identified by the identifier of one of the first event records at each of a plurality of times during the elapsed time of the video recording of the sporting event; input circuitry operable to receive an input to select one of the first timeline elements when the timeline is displayed; and video clip generating circuitry operable to, in response to the selection of one of the first timeline elements, generate a video clip from the video recording of the sporting event and to output the video clip for display, the video clip being a portion of the video recording of the sporting event temporally extending between a first time and a second time, each of the start time and the end time of the first event record corresponding to the selected first timeline element being within the period defined between the first time and the second time, and the video clip comprising one or more cut out portions of the video recording of the sporting event, each cut-out portion being generated on the basis of the participant tracking data of the participant of the sporting event identified by the identifier of the first event record corresponding to the selected first timeline element.