Virtual Camera Synthesizing Multiple Camera Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional real-time broadcasting of events experiences jitter when switching between multiple camera views due to the lack of real-time filler images, leading to disconnects between different views.
Innovation Solution
A method and apparatus that facilitate the receipt and combination of virtual reality (VR) contents from multiple VR cameras and user camera devices, linking their field of views based on a threshold degree of similarity to create seamless transitions between camera streams.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional real-time broadcasting switches between multiple camera views, then multiple perspectives of the event are provided, but jitter occurs and seamless transition is not achieved
Solution Approach 1:
The patent introduces an intermediary mechanism (image synthesis unit and virtual camera) that blends multiple camera views together. Instead of directly switching between discrete camera feeds, the system synthesizes a continuous intermediate view by combining images from multiple physical cameras, thereby eliminating jitter and enabling seamless transitions while maintaining adaptability to multiple perspectives
Solution Approach 2:
The patent transitions from a discrete, multi-dimensional switching approach to a continuous synthesis approach. By creating a virtual camera that operates in a synthesized dimension combining multiple physical camera inputs, the system achieves smooth transitions without the jitter inherent in direct switching between separate camera views
2Reliability
If filler images from the past are used to avoid jitter, then seamless transition between views is achieved, but real-time continuity is lost due to disconnect between different views
Solution Approach 1:
The system performs preliminary synthesis of images from multiple cameras in real-time, creating a continuously updated virtual view before any switching occurs. This pre-synthesized image serves as the foundation for seamless transitions while maintaining real-time continuity, as the synthesis is performed on current rather than past footage
Solution Approach 2:
The patent implements a dynamic image synthesis system that continuously adapts to current camera inputs and viewer position. The virtual camera parameters are dynamically adjusted based on real-time data from multiple physical cameras, ensuring both seamless transitions and real-time continuity by constantly updating the synthesized image rather than relying on static filler images
Data Source
AI summary
In an example embodiment, method, apparatus and computer program product are provided. The method includes facilitating receipt of a plurality of VR contents and a plurality of video contents associated with an event captured by a plurality of VR cameras and a plurality of user camera devices, respectively. Each of the plurality of VR cameras comprises a plurality of camera modules with respective field of views (FOVs) associated with the event. The FOVs of the plurality of user camera devices are linked with respective FOVs of camera modules of the plurality of VR cameras based on at least a threshold degree of similarity between the FOV of the user camera device and the FOV of the camera module. The processor creates an event VR content by combining the plurality of VR contents and the plurality of video contents based on the linking of the FOVs.