Adaptive Quantization for Uniform Panoramic Video Quality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current telepresence systems fail to provide a 360° view of participants in a conference room, requiring participants to be seated in a specific arrangement and limiting natural interaction, as they cannot capture and display all participants around a round table simultaneously.
Innovation Solution
The system employs panoramic video capture devices and adaptive image processing techniques, including non-uniform compression and perspective-dependent views, to allow participants to sit naturally around a conference table while displaying multiple angles of remote participants, enhancing the interpretation of non-verbal cues.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single camera is used to capture the conference room, then the device complexity is reduced, but the ability to provide a 360° view of all participants is lost
Solution Approach 1:
Multiple cameras capturing different views are merged into a single panoramic video stream through image processing. The system combines footage from multiple camera angles into one cohesive 360-degree view, allowing participants to see all conference attendees regardless of seating position.
Solution Approach 2:
The system transitions from traditional 2D flat video displays to a 360-degree panoramic view that adds a dimensional aspect to video conferencing. This allows participants to look in different directions within the video frame to see different participants, creating a more immersive experience.
2Ease of operation
If participants are arranged in a specific row formation, then the camera can capture all participants, but the ease of operation and natural interaction are reduced
Solution Approach 1:
The system changes the parameter of view presentation by providing perspective-dependent views that adapt to the viewer's position. Remote participants can select different camera angles to see local participants from various perspectives, eliminating the need for fixed seating arrangements while maintaining reliable video capture.
3Device complexity
If uniform compression is applied to the entire video frame, then the processing complexity is reduced, but the quality uniformity across different portions of the panoramic view deteriorates
Solution Approach 1:
The system applies different compression qualities to different portions of the panoramic video frame based on local requirements. Areas with higher importance or greater distortion receive higher quality compression, while less critical areas use lower quality compression, optimizing overall video quality while managing processing complexity.
Data Source
Figure 1
Figure 2a
Figure 2b
AI summary
Systems and methods for image processing, comprising receiving a video frame, coding a first portion of the video frame at a different quality than a second portion of the video frame, based on an optical property, and displaying the video frame.