Tile Video Stream Switching for Seamless ROI Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for streaming region-of-interest (ROI) in large field-of-view images lack seamless switching between tiled and non-tiled streaming modes, disrupting user experience and requiring unnecessary bandwidth and processing resources.
Innovation Solution
A method that uses ROI position information to determine and request necessary tile video streams for seamless switching between ROI streaming modes, allowing clients to transition smoothly between viewing a single ROI stream and multiple tile streams by providing dynamic ROI coordinates and look-ahead positions within the image region.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If tiled streaming mode is used to allow user interaction with large field-of-view images, then adaptability and user control are improved, but device complexity and processing load increase due to multiple decoder instances
Solution Approach 1:
The patent introduces a switch component as an intermediary that manages the transition between ROI streaming mode and tiled streaming mode. This switch acts as a mediator that receives the high-resolution video stream and selectively outputs either the compressed ROI stream or the decompressed tiled streams based on user interaction state, thereby simplifying the overall system architecture while maintaining both streaming modes' benefits
2Adaptability or versatility
If multiple tile streams are delivered for ROI selection and interaction, then adaptability is improved, but bandwidth consumption increases
Solution Approach 1:
The patent applies preliminary action by pre-compressing the high-resolution video stream into an ROI stream using a first compressor before distribution. This allows users to view and select ROIs from the compressed stream without requiring multiple full-resolution tile streams to be transmitted, significantly reducing bandwidth consumption while maintaining the capability for ROI selection and interaction
Solution Approach 2:
The patent creates a compressed copy of the high-resolution video stream in the form of an ROI stream that can be distributed efficiently. Instead of transmitting multiple full-resolution tile streams, the system transmits a single compressed ROI stream that contains all necessary information for ROI selection, and only decompresses to full resolution when actually needed for interaction
3Ease of operation
If seamless switching between ROI streaming and tiled streaming is implemented, then user experience is improved, but device complexity increases due to mode switching logic
Solution Approach 1:
The switch component serves as an intermediary that automatically manages the complexity of mode switching. It receives inputs from both the ROI compressor and the decompressor, and based on simple control signals indicating user interaction state, it seamlessly transitions between outputting the compressed ROI stream and the decompressed tiled streams, thereby simplifying the switching logic while ensuring smooth user experience
Data Source
AI summary
A method is described for providing one or more tile streams to a client device for rendering a region-of-interest (ROI), wherein said ROI defines a region of a tile representation of a source video and wherein said method comprises: rendering a region-of-interest (ROI) video stream comprising a ROI of said source video; receiving ROI position information of at least one frame of said ROI video stream; and, receiving one or more tile streams that are requested the basis of said ROI position information and a spatial manifest file, said spatial manifest file defining one or more tile representations of said source video, a tile representation comprising one or more tile identifiers for identifying one or more tile streams and a tile position information defining the spatial position of said tile streams.