ML Event Detection in Electronic Game Video Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems lack efficiency in automatically detecting and identifying objects and events in electronic gaming video information, particularly when dealing with multiple game applications, due to variations in art styles, textures, and animations, which hinders efficient querying and editing processes.
Innovation Solution
A machine learning (ML) system integrated with a machine vision system that uses an application module specific to each game application to identify and classify events, including key, popular, and rare events, by analyzing video and audio information, and invoking game engine-specific data to enhance detection accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a machine learning system uses game engine-specific application modules to identify events in video information, then event detection accuracy is improved, but device complexity increases
Solution Approach 1:
The system divides the complex task of event detection into multiple specialized application modules, each dedicated to a specific game engine (e.g., Unity module, Unreal Engine module). Each module contains game engine-specific data and logic tailored to its target engine, allowing the system to handle different engines independently without increasing overall complexity. This segmentation enables accurate event detection for each engine while maintaining manageable system architecture.
Solution Approach 2:
The patent introduces an intermediary layer between the video information input and the event detection logic. This intermediary consists of the application modules that act as mediators, translating raw video data into meaningful events specific to each game engine. The intermediary layer abstracts the complexity of different game engines, allowing the core system to remain simple while achieving high detection accuracy through engine-specific processing.
2Device complexity
If video information from multiple game applications is analyzed without game-specific modules, then device complexity is reduced, but event identification accuracy deteriorates due to variations in art styles, textures, and animations
Solution Approach 1:
The system applies local quality by making each application module specialized for its specific game engine, rather than using a uniform approach for all engines. Each module contains game engine-specific data that captures the unique characteristics (art styles, textures, animations) of its target engine. This localized specialization enables accurate event identification for each engine while keeping the overall system structure simple and manageable.
Solution Approach 2:
The patent utilizes parameter changes by adapting the detection parameters and data structures within each application module to match the specific characteristics of its target game engine. For example, Unity-specific modules use parameters optimized for Unity's rendering pipeline, while Unreal Engine modules use parameters suited to Unreal's systems. This parameter adaptation allows accurate event detection across diverse engines without requiring a single complex universal system.
Data Source
AI summary
A method of presenting video information to a user includes, at a server computer, obtaining video information including a plurality of frame from a real-time video stream of an electronic game and obtaining ML model data. The method includes determining a presence of at least one event in the video information using a ML model and the ML model data to identify the at least one event. Upon receiving a query from a user for the presence of the at least on event in the video information, the method includes denoting a presence of the at least one event in the video information associated with at least one frame of the plurality of frames of the video information and presenting to the user a visual representation of the at least one frame of the plurality of frames of the video information associated with the at least one event.


