Gamecasting Compositing for Low-Latency Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional gamecasting platforms suffer from high latency and cluttered video streams, making it difficult for viewers to focus on gameplay, especially on mobile devices, and for broadcasters to navigate and interact effectively.
Innovation Solution
The method involves compositing game content with graphical user interface elements and transmitting the composited frames to both a local and external display, allowing dynamic adjustment of frame rates and selective output of GUI elements, enabling low-latency gamecasting with improved user interface management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional gamecasting platforms transmit live streams via Internet web services, then interactivity is provided through live video feeds and messaging platforms, but latency increases to 1-10 seconds which significantly detracts from the gaming experience
Solution Approach 1:
The system segments the video stream into two separate paths: a low-latency local display path that provides real-time feedback to the player, and a high-latency remote streaming path that provides interactivity to remote viewers. This segmentation allows each path to be optimized independently for its specific purpose.
Solution Approach 2:
The system introduces a local display device as an intermediary between the game application and the remote streaming service. This intermediary receives video frames directly from the game application before they are transmitted to remote viewers, allowing the player to see low-latency gameplay while remote viewers receive the streamed content with inherent latency.
2Loss of information
If gamecast streams include multiple graphical user interface elements, live webcam feeds, and chat windows, then comprehensive information is provided, but the video stream becomes cluttered making it difficult for viewers to focus on gameplay
Solution Approach 1:
The system applies local quality by providing different visual compositions to different viewers: local players receive a clean view focused on gameplay, while remote viewers receive a composited view with additional information elements. Each viewer receives information tailored to their specific needs and context.
Solution Approach 2:
The system adds information elements in a separate compositional layer rather than mixing them with the core gameplay view. GUI elements, chat windows, and webcam feeds are composited as additional layers that can be selectively added or removed, allowing viewers to access comprehensive information without it cluttering the primary gameplay view.
3Loss of information
If gamecast streams include comprehensive GUI elements and additional information, then complete game context is provided, but device complexity and interface clutter increase making navigation difficult on mobile devices
Solution Approach 1:
The system extracts comprehensive game context information from the game application and transmits it separately as metadata alongside the video stream. This allows the information to be provided without requiring complex interface elements to be displayed on the mobile device, separating information delivery from visual display complexity.
Data Source
AI summary
One embodiment of the present invention sets forth a technique for broadcasting composited game content. The technique includes executing an application program to generate a first video frame of game content, and causing the first video frame to be displayed on a primary display device. The technique further includes compositing at least one graphical user interface (GUI) element with the first video frame to generate a composited frame. The technique further includes causing the composited frame to be displayed on an external display device by transmitting the composited frame to the external display device via a local display interface.