Mobile Camera Motion Tracking for Remote Physical Gaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current gaming platforms cannot facilitate interactive play of physical games or activities using only mobile computing devices, due to limitations in processing power and the need for dedicated sensors and accessories.
Innovation Solution
The development of a mobile platform that enables multiplayer interactive physical games using mobile devices with cameras, employing AI-based computer vision techniques for real-time monitoring, analysis, and feedback generation, without the need for dedicated sensors or accessories.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If specialized equipment with dedicated sensors and displays is used for interactive physical gaming, then measurement precision and reliability are improved, but device complexity and cost increase
Solution Approach 1:
The patent uses mobile device cameras to capture visual copies of player movements and game objects, replacing dedicated motion sensors. The camera feeds are processed through computer vision algorithms to extract motion data, achieving sufficient measurement precision without requiring specialized sensing hardware at each player location.
Solution Approach 2:
The mobile computing device serves multiple functions: it acts as a camera for video capture, a processor for analyzing game actions through AI algorithms, a display for showing game content and feedback, and a communication device for multiplayer interaction. This multi-functionality eliminates the need for separate dedicated sensors, controllers, and displays.
2Reliability
If dedicated gaming consoles and accessories are used for home gaming systems, then reliability and measurement precision are improved, but ease of operation and accessibility worsen
Solution Approach 1:
The mobile device's camera automatically captures video of the player and game environment without requiring manual positioning of sensors or calibration of equipment. The AI algorithms automatically process the video feeds to extract motion data and detect game actions, eliminating the need for manual setup and configuration that would otherwise be required for dedicated sensing equipment.
Solution Approach 2:
The patent introduces AI-based computer vision processing as an intermediary between the simple camera input and the complex game analysis requirements. This intermediary layer automatically performs motion tracking and action recognition, maintaining reliability while simplifying the user interface and setup process.
3Ease of operation
If mobile devices with limited computational resources are used for physical gaming, then ease of operation and accessibility are improved, but processing speed and measurement precision worsen
Solution Approach 1:
The patent divides the computational workload into segments: the mobile device performs local processing of camera feeds using optimized AI algorithms for motion detection, while more complex analytics and multiplayer game logic are handled by remote servers. This segmentation allows the mobile device to maintain real-time responsiveness without requiring excessive local computational resources.
Solution Approach 2:
The system processes video frames at optimized intervals rather than continuously analyzing every frame. The AI algorithms detect key motion events and game actions at critical moments, reducing the processing burden on mobile devices while maintaining accurate real-time game state tracking through event-driven updates.
Data Source
AI summary
Methods and systems for remote multiplayer gameplay are disclosed. An example method can include joining a multiplayer interactive physical game including first and second players competing in an activity; capturing a first game video of a first player in a first play of the multiplayer interactive physical game, using a first camera on a first mobile computing device in a first gaming area; determining a first object flow associated with the first player from the first game video, by performing an algorithm on one or more frames of the first game video to detect one or more key points of the first player; generating a first analytic based on the first object flow; receiving a second analytic associated with the second player in a second gaming area; and generating a feedback to the first player based on the first analytic or the second analytic.