Dynamic Picture-in-Picture Video Stream Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional digital video playback systems lack the ability to simultaneously display multiple streams of video and audio, and do not allow for customizable placement, size, aspect ratio, and visual properties of streaming media, limiting user interaction and flexibility in viewing experiences.
Innovation Solution
A system and method for programmatic window control in video playback devices that enable the simultaneous display of multiple media streams, allowing dynamic and independent control of their placement, size, aspect ratio, cropping, scaling, transparency, tint, and contrast, with the option to mix audio between streams, all of which can be adjusted during playback through user input or automated means.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional DVD players display multiple video angles by returning to the main menu, then the user can access different angles, but the user must stop playback and cannot view angles simultaneously
Solution Approach 1:
The display screen is segmented into multiple independent regions, each displaying a different video angle simultaneously. The main display shows the primary video angle while smaller picture-in-picture windows display alternative angles, allowing users to access multiple angles without stopping playback.
Solution Approach 2:
The patent transitions from a single-display-mode to a multi-dimensional display architecture by overlaying multiple video streams at different spatial layers. This allows simultaneous presentation of main video and alternative angles in different picture planes, eliminating the need to return to the main menu.
2Ease of operation
If conventional picture-in-picture displays a fixed rectangular box, then the layout is simple, but the user cannot reposition or resize the box
Solution Approach 1:
The picture-in-picture window transforms from a static fixed-position rectangle to a dynamic element that can be freely repositioned and resized. Users can drag the window to any location on the display and adjust its dimensions, making the display control mechanism adaptive and flexible.
Solution Approach 2:
The patent implements dynamic modification of display parameters including position coordinates, window size dimensions, and aspect ratio. These parameters can be changed in real-time during playback, allowing users to customize the picture-in-picture display according to their viewing preferences.
3Adaptability or versatility
If conventional systems allow only two simultaneous video streams, then the storage requirement is manageable, but the viewing options are limited
Solution Approach 1:
The video data is segmented into multiple independent streams that can be stored and displayed simultaneously. Each video angle or alternative view is stored as a separate stream, allowing the system to manage multiple streams through organized data separation rather than requiring a single large storage block.
Solution Approach 2:
The patent employs a nested structure where multiple video streams are layered within a single display output. Smaller video streams are nested within the main video display area as picture-in-picture elements, allowing multiple streams to coexist in the visual space without requiring proportional increases in storage capacity for each additional stream.
4Ease of operation
If the picture-in-picture box blocks a desirable portion of the first broadcast, then the layout is straightforward, but the user cannot reposition the box
Solution Approach 1:
The picture-in-picture window becomes a dynamic element that users can freely reposition across the display. This dynamic positioning allows users to move the secondary video stream to locations that do not block important content from the main broadcast, optimizing the visibility of both streams simultaneously.
Solution Approach 2:
The system provides visual feedback by displaying the picture-in-picture window at its current position and size, allowing users to see how it affects the main video display. Users can adjust the window position and size based on this feedback to achieve optimal viewing of both streams without blocking important content.
Data Source
AI summary
A media playback device capable of displaying multiple streams simultaneously and with expanded picture-in-picture capabilities is provided. The placement, size, aspect ratio, cropping, scale, transparency, tint, contrast, and cropping of the media can be set or adjusted arbitrarily. Furthermore, the audio may be mixed between separate tracks accompanying the video streams and may also be set or adjusted arbitrarily. Each variable can be dynamically changed during playback through either automated or user-initiated means. A system and method are provided for simultaneously displaying a first video stream and at least a second video stream on a display comprising the steps of feeding the video streams into a video player; providing control of the display of the video streams; displaying a first video stream substantially across the display; and displaying the other video streams in a secondary display.


