Visual-Fixation Panoramic Video Filtering for Bandwidth-Adaptive Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current broadcasting and streaming methods for panoramic events require high-capacity networks and intensive processing due to the high bandwidth needs of panoramic video signals, and there is a lack of flexibility in adapting content to different client devices and varying network conditions.
Innovation Solution
A system utilizing a panoramic multimedia source, content controller, and view adaptor to dynamically determine regions of interest and adapt video signals for client-specific filtering and processing, incorporating a method to measure viewer gaze positions to extract relevant segments of panoramic signals for transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If panoramic video signals are transmitted directly from the video source to client devices, then the complete panoramic view is available to clients, but high bandwidth capacity and high-speed processing capability are required
Solution Approach 1:
The patent extracts only the necessary portions of the panoramic video signal based on operator-defined view regions. Instead of transmitting the complete panoramic view, the system identifies and extracts specific segments corresponding to regions of interest, thereby reducing the bandwidth capacity required while still delivering relevant content to client devices.
Solution Approach 2:
The patent applies different quality and transmission priorities to different regions of the panoramic video signal. By dividing the panoramic view into multiple view regions and transmitting only those regions that are currently of interest to specific clients, the system optimizes bandwidth usage by allocating transmission resources locally rather than uniformly across the entire panoramic signal.
2Adaptability or versatility
If multiple cameras are used to capture activities in different parts of a field of events, then comprehensive coverage is achieved, but device complexity and processing requirements increase
Solution Approach 1:
The patent employs a single panoramic camera that performs the function of multiple cameras by capturing a complete 360-degree or near-360-degree view in a single shot. This universal device replaces multiple specialized cameras, thereby achieving comprehensive coverage while reducing device complexity and the coordination requirements between multiple cameras.
Solution Approach 2:
The patent segments the panoramic video signal into multiple view regions that correspond to the coverage areas of multiple cameras. By processing a single panoramic capture and dividing it into selectable regions, the system achieves the functional equivalent of multiple cameras without the complexity of coordinating multiple camera devices, their mounting, and their synchronized operation.
3Adaptability or versatility
If a streaming server performs transcoding functions to adapt data to client devices and network conditions, then signal adaptation is improved, but processing intensity and server complexity increase
Solution Approach 1:
The patent performs preliminary content filtering and view region selection before the video signal reaches the streaming server. By pre-processing the panoramic signal to extract only the necessary view regions based on predicted or known client interests, the system reduces the processing burden on the streaming server, allowing it to focus on format adaptation rather than content selection and region extraction.
4Productivity
If panoramic video signals are streamed to multiple client devices, then content distribution is achieved, but network capacity requirements multiply
Solution Approach 1:
The patent enables each client device to receive a customized version of the panoramic video signal tailored to its specific interests and requirements. By filtering and adapting the content locally for each client based on their profile, device capabilities, and network conditions, the system optimizes network capacity usage by transmitting only the necessary portions to each client rather than sending identical full-resolution panoramic streams to all devices.
Data Source
AI summary
Methods and apparatus for filtering panoramic video signals using visual fixation are disclosed. A panoramic video signal organized into indexed frames is displayed and durations of visual fixations of a viewer of the display are measured by means of detecting the viewer's gaze positions and identifying clusters of adjacent gaze positions. For each visual fixation attaining a prescribed duration threshold, a segment of the panoramic video signal corresponding to a respective view region of prescribed shape and dimensions is extracted to form a filtered video signal. Contents of successive frames of the panoramic signal are cyclically supplied to a bank of content-filtering units operating concurrently to produce individual content-filtered frames which are concatenated for transmission to respective destinations.