XR Neurocognitive Assessment Using Motion Tracking and Deep Learning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for detecting neurocognitive impairment (NCI) are subjective, time-intensive, and lack objective tools for early detection, particularly for mild traumatic brain injury (mTBI), leading to underdiagnosis and unequal access, especially in vulnerable populations.
Innovation Solution
A self-administered neurocognitive assessment system using mixed reality (MR) on mobile devices, where users track a virtual hummingbird to capture it within a translucent sphere, leveraging machine learning to analyze movement data for objective evaluation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional neuropsychological batteries are used for NCI detection, then diagnostic accuracy is maintained through validated tools, but the assessment process becomes time-intensive and requires healthcare professional administration
Solution Approach 1:
The patent replaces traditional mechanical paper-based neuropsychological testing with a virtual reality-based digital assessment system. The VR environment delivers standardized neuropsychological tasks through immersive 3D scenarios, automatically capturing performance metrics without requiring physical test materials or manual scoring procedures.
Solution Approach 2:
The system enables self-administered neurocognitive assessment where patients independently complete VR-based neuropsychological tasks without requiring a healthcare professional to administer each test. The automated system captures, processes, and analyzes performance data, providing objective measurements that were previously only available through clinician-administered tests.
2Measurement precision
If paper-based neuropsychological tests are administered, then validated diagnostic criteria can be applied, but language and education dependencies create barriers for diverse populations
Solution Approach 1:
The patent transitions from two-dimensional paper-based tests to three-dimensional immersive virtual reality environments. This dimensional shift allows neuropsychological assessment to occur through spatial navigation, object manipulation, and environmental interaction rather than through language-dependent written or verbal tasks, making the assessment accessible to individuals with varying language skills and educational backgrounds.
Solution Approach 2:
The system changes the fundamental parameters of assessment from language-based responses to spatial and motor-based interactions within the VR environment. By measuring performance through navigation accuracy, reaction time, and task completion in three-dimensional space rather than through verbal or written responses, the system eliminates language and education barriers while maintaining diagnostic validity.
3Measurement precision
If advanced imaging techniques are used for mTBI detection, then objective biomarkers can be obtained, but the cost and availability become prohibitive for widespread use
Solution Approach 1:
The patent substitutes expensive medical imaging equipment with a virtual reality-based assessment system that uses standard computing hardware. Instead of requiring MRI, CT, or specialized imaging devices, the system uses off-the-shelf VR headsets and processors to deliver objective neuropsychological measurements through software-based tasks that capture cognitive and motor performance.
Solution Approach 2:
The system replaces costly, complex imaging infrastructure with inexpensive, widely available consumer electronics. Standard VR headsets, smartphones, or computers that consumers already own can run the assessment software, eliminating the need for expensive medical imaging equipment and specialized facilities while providing comparable objective measurement capabilities.
4Productivity
If subjective symptom-based tools are used for concussion evaluation, then immediate assessment is possible, but reliability is reduced due to underreporting and sandbagging
Solution Approach 1:
The system uses self-administered VR-based objective testing that automatically captures performance metrics without requiring patient self-reporting. The software independently measures reaction time, navigation accuracy, and task completion, providing reliable data that cannot be manipulated by patients through underreporting or sandbagging strategies.
Solution Approach 2:
The system provides immediate automated feedback through the VR interface, giving patients real-time performance information while objectively recording all metrics. This immediate feedback loop maintains assessment speed while the automated capture of behavioral data eliminates reliance on subjective patient reporting, ensuring detection reliability.
Data Source
AI summary
Systems and methods of deep-learning neurocognitive impairment evaluation using extended reality. One system includes an electronic processor configured to generate an extended reality user environment (“XR-UX”) for display via a user device, the XR-UX including a first augmented object configured to change position within the XR-UX and a second augmented object configured to dynamically change position within the XR-UX based on a position of the user device. The electronic processor is also configured to control the first augmented object to traverse a path within the XR-UX. The electronic processor is also configured to receive motion data describing movement of the user device. The electronic processor is also configured to determine a medical classification based on the physical movement of the user device in relation to the path. The electronic processor is also configured to generate and transmit an assessment report for display, the assessment report including the medical classification.