Gaming Highlight Enhancement Using Masks for Real-Time Sharing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing content streaming systems require manual user input for enhancing gaming highlights post-session, leading to increased time and computing resources, and are separate from application servers and client devices, limiting real-time sharing and efficiency.
Innovation Solution
Systems and methods for automatic enhancement of highlights during or after sessions using machine learning models to process frames, generate masks, and apply processing effects, integrated with application servers and client devices to reduce time and computing resources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If manual user input is used for enhancing highlights post-session, then enhancement quality can be customized, but time consumption and computing resources increase
Solution Approach 1:
The system performs preliminary actions by pre-processing video content during the gaming session itself, identifying potential highlight moments and preparing enhancement data in advance. This allows the highlights to be ready for immediate sharing without requiring post-session manual enhancement, thus reducing time loss while maintaining enhancement quality through pre-computed processing effects.
2Extent of automation
If manual user input is used for enhancing highlights, then customization is possible, but computing resources are increased
Solution Approach 1:
The system implements self-service by automatically performing enhancement operations without requiring user intervention. The computing system itself services the enhancement need by applying processing effects autonomously based on pre-configured parameters and automated highlight detection, eliminating the need for separate manual enhancement processes and reducing overall computing resource consumption.
3Speed
If highlights are enhanced after gaming sessions, then quality can be improved, but real-time sharing is limited
Solution Approach 1:
The system performs preliminary enhancement processing during the gaming session itself, preparing highlight content in advance before the session ends. This preliminary action enables immediate sharing of enhanced highlights right after the session concludes, achieving real-time sharing capability while maintaining enhancement quality through pre-computed processing effects and automated mask generation.
4Device complexity
If separate systems are used for enhancement, then functionality is specialized, but system complexity and resource requirements increase
Solution Approach 1:
The system merges the highlight enhancement functionality directly into the existing gaming application and content streaming infrastructure. By combining the processing effects application, mask generation, and highlight identification functions within the same system that already handles game rendering and streaming, the patent eliminates the need for separate enhancement systems, thereby reducing overall system complexity and consolidating computing resource usage.
Data Source
AI summary
In various examples, automatic enhancement of highlights for content streaming systems and applications is described herein. Systems and methods are disclosed that automatically enhance highlights associated with applications, such as by using one or more enhancement effects, and then perform different operations using the enhanced highlights. For instance, such as during a session of the application, image data representing one or more frames (e.g., a video) associated with a highlight of the application may be obtained. The image data may then be processed to generate one or more masks associated with the frame(s). Additionally, the mask(s) may be used to add content to the frame(s), remove content from the frame(s), update content associated with the frame(s), replace content associated with the frame(s), and/or perform any other type of enhancement. After enhancing the highlight, one or more operations associated with the enhanced highlight may then be performed.