Mixed-Reality Object Identification Anchored to a Gaming Device
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed-reality environments struggle to seamlessly integrate virtual and real-world elements, particularly in identifying and interacting with objects in proximity to gaming devices, which are often prone to movement and orientation changes, complicating user experience.
Innovation Solution
A computer-implemented method that identifies a gaming device first in a real-world environment, using techniques like SLAM and neural networks, and then initiates activities based on nearby objects, ensuring a grounded and consistent mixed-reality experience by highlighting or generating virtual images only in close proximity, thus simplifying identification and reducing processing overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the system identifies objects in the mixed-reality environment without prioritizing the gaming device, then object detection coverage is improved, but identification reliability and processing efficiency deteriorate due to movement and orientation changes of gaming devices
Solution Approach 1:
The system performs preliminary identification and tracking of the gaming device before initiating object detection activities. By establishing the gaming device as a fixed reference point in advance, the system creates a stable coordinate system for subsequent object detections, thereby improving identification reliability without reducing detection coverage
Solution Approach 2:
The gaming device serves as an intermediary reference object between the tracking system and other objects in the environment. By using the gaming device as a mediator to establish the mixed-reality coordinate system, the system achieves more reliable and consistent object identification even when devices move or change orientation
2Measurement precision
If the system continuously scans and re-identifies the gaming device at the start of every experience, then identification accuracy is improved, but processing overhead and time consumption increase
Solution Approach 1:
The system performs gaming device identification as a preliminary one-time action before the mixed-reality experience begins. This preliminary identification establishes the reference frame for the entire session, eliminating the need for continuous re-scanning and significantly reducing processing overhead during the experience
Solution Approach 2:
Once the gaming device is identified and the coordinate system is established, the system maintains continuous tracking of the gaming device's position and orientation throughout the experience. This continuous tracking allows the system to update virtual object positions efficiently without performing full re-identification scans, maintaining both accuracy and efficiency
3Adaptability or versatility
If the system initiates activities for all detected objects regardless of proximity to the gaming device, then activity coverage is improved, but user experience consistency and interaction quality deteriorate
Solution Approach 1:
The system applies different activity initiation rules based on the local quality of spatial proximity to the gaming device. Objects within a defined proximity threshold receive full activity initiation and interaction capabilities, while objects beyond this threshold have limited or no activities. This local differentiation ensures that user interactions remain consistent and meaningful within the immediate mixed-reality environment
Data Source
AI summary
A computer-implemented method includes identifying a gaming device in a real-world environment, the gaming device providing a user experience to a user in a mixed-reality setting, identifying an object in the real-world environment in proximity to the gaming device, and initiating an activity relating to the object based on a virtual part of the mixed-reality setting.