Full-Body XR Interaction Plane for Real-Time Motion Scoring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing extended reality (XR) technologies lack immersive and interactive full-body interaction experiences that challenge users physically and mentally, limiting engagement and variety in gameplay.
Innovation Solution
A system and method for providing XR interactions using a motion-tracking sensor, XR display device, and processor to track full-body motion, define an interaction plane, and display obstacle and target elements, determining scores based on user interactions with these elements in a 3D space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If full-body motion tracking is implemented in XR, then user engagement and interaction variety are improved, but device complexity and cost increase
Solution Approach 1:
The motion tracking system is designed to serve multiple functions: it tracks full-body motion for game interaction, monitors position relative to the interaction plane, detects overlap with target and obstacle elements, and enables scoring. This multi-functional approach increases interaction variety while managing system complexity through consolidation.
Solution Approach 2:
The patent introduces an interaction plane as an intermediary concept that simplifies the complexity of full-body tracking. By defining a specific plane in 3D space where interactions are evaluated, the system reduces the complexity of analyzing entire body movements to simpler 2D overlap detection on the interaction plane.
2Adaptability or versatility
If full-body motion tracking is implemented in XR, then user engagement and interaction variety are improved, but hardware cost increases
Solution Approach 1:
The motion tracking hardware is designed to perform multiple functions simultaneously - tracking full-body motion, determining position relative to interaction plane, and detecting overlap with game elements. This multi-functionality reduces the need for separate specialized sensors, thereby managing hardware cost while providing diverse interaction variety.
3Productivity
If real-time full-body tracking and interaction scoring are implemented, then user engagement is improved, but processing requirements and energy consumption increase
Solution Approach 1:
The patent extracts and focuses computational effort only on the interaction plane - a 2D surface in 3D space where interactions occur. By extracting the relevant interaction data from full 3D body tracking and concentrating processing on 2D overlap detection on the interaction plane, the system maintains real-time responsiveness while reducing overall processing requirements and energy consumption.
Solution Approach 2:
The system transitions from tracking full 3D body motion to evaluating 2D overlap on the interaction plane. This dimensionality reduction from 3D to 2D simplifies the computational complexity of real-time interaction detection, enabling responsive gameplay while lowering processing demands and energy consumption.
Data Source
AI summary
Systems and methods for providing extended reality (XR) interactions are provided. A system includes a motion tracker device, an XR display device, and a processor. The processor is configured to execute computer-readable instructions to display XR content in a three-dimensional (3D) space for an interaction session, track the full-body motion of a user relative to the 3D space, and define an interaction plane in the 3D space. The XR content includes obstacle elements and target elements moving toward the interaction plane in the 3D space. The system determines an event score for an interaction event based on checks whether a user body part overlaps the target element in the interaction plane and whether all user body parts avoided overlapping the obstacle element in the interaction plane.