Real-Time Gameplay Annotation via Event Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for live streaming and playback of video game sessions face challenges due to large media file sizes and difficulties in obtaining relevant information from fast-paced gaming events, leading to delays and maintenance issues, as well as inefficiencies in annotating and sharing gameplay data.
Innovation Solution
A system and method for automatically annotating gameplay in real-time based on triggering events during a session, using a game log to identify and generate annotation items, which can be interactively displayed and shared with viewers, reducing the need for large media files and enhancing data accessibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If conventional methods are used to record and stream gameplay as media files, then complete video playback is available, but storage requirements and network load increase significantly
Solution Approach 1:
The patent extracts only the essential gameplay events and metadata from the complete video stream, separating meaningful information (player actions, objectives, outcomes) from redundant visual data. This allows users to access annotated gameplay summaries without storing or transmitting entire video files, directly reducing storage requirements while maintaining playback availability through event-based reconstruction.
Solution Approach 2:
The gameplay is segmented into discrete annotated events and milestones rather than continuous video streams. Each annotation represents a distinct gameplay moment that can be independently stored, transmitted, and displayed. This segmentation reduces the quantity of data while preserving the essential narrative and statistical information needed for playback analysis.
2Speed
If complete video gameplay is streamed in real-time, then viewers can watch the full action, but network infrastructure load increases causing delays
Solution Approach 1:
The system extracts only critical gameplay events and annotations for real-time transmission rather than streaming complete video. This extraction approach maintains streaming speed by transmitting minimal data (event metadata, player statistics, milestone information) while significantly reducing network infrastructure load compared to full video streaming.
Solution Approach 2:
The system performs preliminary processing of gameplay data to identify and prepare annotations before they need to be transmitted to viewers. By pre-processing and pre-organizing event data in a structured format, the system enables fast real-time transmission without requiring complex network infrastructure, as the data is already optimized for efficient delivery.
3Loss of information
If gameplay is recorded as media files, then complete playback is available, but relevant information about in-game events becomes difficult to obtain
Solution Approach 1:
The patent extracts and emphasizes relevant in-game event information directly from gameplay data, creating annotated versions that highlight objectives, player actions, and outcomes. This extraction process ensures that meaningful information is preserved and easily accessible, while discarding redundant visual data that would increase media file size without adding informational value.
Solution Approach 2:
The gameplay information is segmented into discrete annotated events that can be individually accessed and displayed. This segmentation allows users to obtain specific in-game event information without processing entire media files, reducing the quantity of data while maintaining complete event information availability through structured event records.
4Loss of information
If manual annotation of gameplay is performed, then detailed information can be provided, but time consumption and labor requirements increase
Solution Approach 1:
The system performs self-service annotation by automatically detecting and annotating gameplay events based on predefined criteria and patterns. The annotation system processes gameplay data autonomously, identifying milestones, player actions, and objectives without requiring manual intervention. This self-service approach maintains detailed information accuracy while eliminating the time consumption and labor requirements of manual annotation.
Solution Approach 2:
The patent replaces manual annotation processes with automated computational systems that use algorithms to detect and annotate gameplay events. This substitution of mechanical (manual) systems with automated digital processing maintains the detail information quality while dramatically reducing time consumption, as computational analysis can process entire gameplay sessions instantaneously compared to human annotators.
Data Source
AI summary
A system and method is provided that automatically annotates gameplay based on triggering events that occur during a gameplay session. The system may automatically annotate the gameplay in real-time, such as during a gameplay session associated with an electronic-sports tournament. For example, the system may obtain and parse a game log corresponding to the gameplay session, identify triggering events based on the game log, obtain an annotation rule associated with the triggering event, generate an annotation item based on the annotation rule, and cause the annotation item to be presented in association with video of the gameplay session. An annotation item may be displayed interactively such that, when selected, causes the system to take an action. The action may include obtaining additional information relating to the selected annotation item; saving, sharing, liking/disliking or commenting on the selected annotation item; removing the selected annotation item from a display, and/or other actions.