Immersive Video Object Mapping Across Device Form Factors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge of reproducing high-quality video presentations across devices with different form factors and viewing preferences has not been adequately addressed, leading to degraded efficiency in video content delivery.
Innovation Solution
A system that maps a source video stream to a target device by extracting objects, identifying a presentation area, and creating a target video stream with optimal arrangement based on device form factor, screen resolution, and aspect ratio, using linear and non-linear mapping mechanisms, scene graphs, and templates to enhance the presentation area.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If Full HD videos are converted to vertical mobile formats via direct scaling, then the video can be displayed on mobile devices, but the video quality degrades and appears small
Solution Approach 1:
The patent segments the video content into distinct objects (presenters, slides, background elements) and processes each separately with different scaling factors, rather than uniformly scaling the entire video frame. This allows high-quality preservation of critical elements while adapting to mobile formats.
Solution Approach 2:
Different regions of the video are treated with different quality priorities. The patent applies higher scaling quality to presenters and key presentation elements while using different strategies for background areas, ensuring critical content maintains high quality regardless of format conversion.
2Manufacturing precision
If different scaling factors are applied to different objects, then the presentation area is enhanced on target devices, but the processing complexity increases
Solution Approach 1:
The system performs preliminary scene graph construction and object identification during video processing, creating a structured representation that enables efficient differential scaling. This pre-processing organizes elements by importance and spatial relationship, making subsequent complex scaling operations more manageable.
Solution Approach 2:
The patent implements dynamic scaling factors that adapt based on device characteristics, content type, and presentation context. The system adjusts scaling parameters in real-time based on the target device form factor and the specific objects being displayed, optimizing quality without static rigid rules.
3Manufacturing precision
If immersive video presentations are optimized for desktop formats, then high-quality viewing is achieved on desktop devices, but the content does not adapt well to mobile devices with different aspect ratios
Solution Approach 1:
The patent creates a universal video representation system that can function across multiple device types. By constructing scene graphs that capture essential spatial and semantic relationships, the same processed video can be efficiently adapted to desktop, mobile, and other form factors while maintaining quality.
Solution Approach 2:
The system changes key parameters including scaling factors, arrangement configurations, and rendering priorities based on target device characteristics. This allows the core video content to remain consistent while adapting presentation parameters to optimize quality for each device type's screen size and aspect ratio.
Data Source
AI summary
Mapping a source video stream to a screen of a target device includes extracting separate objects from the source video stream, identifying a subset of the objects that correspond to a presentation area, and creating a target video stream that is displayed on the target device by arranging the separate objects to enhance the presentation area on the screen of the target device based on a form factor, screen resolution, and/or aspect ratio of the target device. The presentation area may include a presenter and presentation materials. Creating the target video stream may include scaling different ones of the objects. Different scaling factors may be applied to different objects to enhance the presentation area on the screen of the target device. A separate video image corresponding to a linear mapping of the source video stream onto a target device may be provided in addition to the target video stream.