Mobile Cognitive State Detection Through AR Tasks and Path Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Detecting cognitive states, particularly health states related to brain diseases or brain damages, is difficult and often subjective and error-prone, requiring specialized medical expertise.
Innovation Solution
An apparatus and computer program that utilizes a mobile device with a second camera to record user features in combination with the device's path, capturing facial features and user interactions in an augmented reality environment to determine cognitive states.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a specialized doctor performs detection, then detection accuracy is improved, but device complexity and cost increase
Solution Approach 1:
The patent replaces the mechanical/subjective human doctor examination system with an automated computer-based detection system that uses mobile device sensors and algorithms to objectively measure and analyze user behavior, thereby maintaining high detection accuracy while eliminating the need for specialized medical professionals
Solution Approach 2:
The system enables users to perform self-detection of cognitive states using their own mobile devices without requiring external medical expertise. The automated algorithms process user interactions and sensor data to provide diagnostic information, allowing individuals to monitor their own cognitive health independently
2Reliability
If human doctors perform detection, then detection is possible, but objectivity and reliability deteriorate due to subjectivity and errors
Solution Approach 1:
The patent replaces subjective human judgment with objective computational algorithms that systematically process sensor data and user interactions. This substitution eliminates human bias, fatigue, and variability, providing consistent and reproducible detection results across different users and time points
Solution Approach 2:
The system incorporates automated feedback loops where detection results are continuously refined based on processed data from multiple sensors and user interactions. This systematic feedback mechanism ensures consistent application of detection criteria and maintains high reliability across different detection instances
3Measurement precision
If only device path data is used, then detection simplicity is improved, but detection quality deteriorates
Solution Approach 1:
The patent merges multiple data sources including device path information, user interaction data from augmented reality tasks, and sensor readings into a unified detection framework. This combination of diverse data types enriches the information available for analysis, significantly improving detection quality beyond what any single data source could provide alone
Solution Approach 2:
The mobile device serves multiple functions simultaneously: it acts as a navigation tool for path tracking, a gaming device for augmented reality interactions, and a sensor platform for collecting physiological and behavioral data. This multi-functionality allows comprehensive data collection without requiring separate specialized equipment
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An apparatus for determining a cognitive state of a user of a mobile device (2) of the apparatus (1), the apparatus (1) comprising: an output means (5) in the mobile device (2) for giving out information to the user, wherein the output means (5) comprises an optical output means (5.1) for optically giving out information to the user; a camera (3) in the mobile device (2) 5for recording images in a first view direction (3.1) of an environment of the mobile device (2);a path means (6) configured to determine a positional path of the mobile device (2) in the environment; a further camera (4) in the mobile device (10) for recording images in a second view direction (4.1) and/or a microphone (13) for recording an audio signal; a task means (7, 7') 10for interacting via the output means (5) with the user to make the user solve a task using an augmented reality environment shown via the optical output means (5.1) and based on the environment of the mobile device (2) captured by the camera (3); a user feature means (8, 8') for detecting and/or tracking at least one feature of the user in the images recorded by 15the further camera (4) while the user solves the task and/or in the audio signal recorded by the microphone (13) while the user solves the task; a cognitive state means (9, 9') for determining the cognitive state of the user based on the positional path of the mobile device determined while the user solves the task and based on the at least one feature of the user.