Mixed Media Content Display on Non-Standard Video Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current devices, such as the iPhone running iOS, can only display full-screen video, preventing simultaneous viewing of embedded video and other content in a browser, as the video player occupies the entire screen, hiding the browser and making additional content inaccessible.
Innovation Solution
A system comprising a media server, data structure server, and internal server processes that separate audio and visual data from a video stream, transform them into synchronized strings, and package them into a data object for transmission, allowing synchronized playback and display of audio and snapshots in a browser, enabling video and additional media content to be shown concurrently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If full-screen video mode is used on iOS devices, then video playback quality is improved, but access to additional browser content is lost
Solution Approach 1:
The video stream is segmented into individual frames that are transmitted separately to the browser, allowing the video content to be displayed as a sequence of images rather than requiring full-screen mode. This segmentation enables the video to coexist with other browser content on the same screen.
Solution Approach 2:
The patent introduces an intermediary processing system that converts the video stream into a format compatible with browser display capabilities. The system separates video frames from the audio stream and transmits them as image data that can be rendered within the browser window, acting as a mediator between the video source and the browser display.
2Loss of information
If video is embedded in browser content, then access to additional content is maintained, but video playback capability is limited
Solution Approach 1:
The patent changes the parameters of video delivery by transmitting video frames as individual image data packets rather than as a continuous video stream. This parameter change allows the browser to render video content using its existing image display capabilities, thereby maintaining compatibility with devices that have limited video playback functionality.
3Loss of information
If audio and video are separated into different streams, then simultaneous display with other content is enabled, but synchronization complexity increases
Solution Approach 1:
The patent implements a feedback mechanism where the system monitors the playback state and adjusts the transmission of video frames and audio packets to maintain synchronization. The server tracks which frames have been displayed and ensures corresponding audio segments are played at the correct times, providing feedback control to resolve the synchronization complexity.
Data Source
AI summary
Aspects of the invention may involve systems and methods. A method for providing video and mixed media content to a user device may include receiving content data from a content source and broadcasting the state of the content source. The content data may be split into audio data and visual data. Snapshots of the visual data over a length of time may be extracted. The plurality of snapshots and the audio data may be transformed into text strings and packaged into a data object. In response to a request from a user device, the data object and browser executable instructions may be sent to the user device. The instructions may transform the text into sound and into image snapshots to be consecutively displayed in a browser, where the displayed snapshots is synchronized with the sound, and other media content is displayed in the browser.