Virtual 3D View Synthesis for Eye Contact and Immersive Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing videoconferencing technologies fail to provide direct virtual eye contact and immersive 3D experiences, especially in mobile devices, and lack efficient image capture and display methods for autonomous vehicles.
Innovation Solution
Implement algorithms and systems that utilize multiple cameras to capture and process images, generating synthetic views for direct virtual eye contact and immersive experiences, while adapting to mobile device form factors and network architectures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple cameras are used to capture images for virtual 3D experience, then the visual quality and immersive experience are improved, but the device complexity and manufacturing cost increase
Solution Approach 1:
The patent combines multiple camera feeds into a single synthesized virtual 3D view, merging the functional capabilities of multiple cameras while presenting a unified experience to the user. This reduces the effective complexity by integrating multiple inputs into one coherent output stream.
Solution Approach 2:
The system creates synthetic copies of the scene from multiple camera perspectives, generating virtual views that replicate the appearance of multiple physical cameras. This allows the system to achieve multi-camera quality without requiring all cameras to be simultaneously active or complexly integrated.
2Reliability
If multiple cameras are used to capture images for virtual 3D experience, then the visual quality and immersive experience are improved, but the manufacturing cost increases
Solution Approach 1:
The patent uses software-based image processing and synthesis algorithms that can be implemented as inexpensive digital products rather than requiring expensive hardware modifications. The virtual 3D experience is achieved through computational methods rather than costly optical hardware.
Solution Approach 2:
The system is designed to work with various camera configurations and device types, making the solution universally applicable across different platforms. This multi-functionality reduces manufacturing costs by avoiding the need for specialized hardware designs.
3Reliability
If virtual 3D experience is implemented in videoconferencing, then the immersive experience is improved, but the network bandwidth requirements and processing time increase
Solution Approach 1:
The system pre-processes and synthesizes virtual views in advance, preparing the 3D experience data before it is needed for display. This preliminary action reduces the processing time required during actual videoconferencing operations.
Solution Approach 2:
The patent implements virtual 3D experience selectively, applying the computationally intensive processing only when and where it enhances the user experience, rather than universally across all videoconferencing scenarios. This partial application reduces overall processing time and network bandwidth requirements.
4Reliability
If virtual 3D experience is implemented in videoconferencing, then the immersive experience is improved, but the network bandwidth requirements increase
Solution Approach 1:
The system extracts only the essential visual information needed to create the virtual 3D experience, separating the critical data from redundant information. This extraction approach reduces the amount of data that needs to be transmitted over the network while maintaining the immersive experience.
Data Source
AI summary
Methods, systems and computer program products (“software”) enable a virtual three-dimensional visual experience (referred to herein as “V3D”) in videoconferencing and other applications, and capturing, processing and displaying of images and image streams.