Cognitive State Monitoring With AR and Machine Response Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cognitive states such as inattentiveness, fatigue, or timidity in individuals within environments can exceed concern thresholds, increasing the likelihood of harmful incidents, particularly in settings like traffic or manufacturing, due to prolonged exposure or unfamiliarity, which existing technologies fail to effectively mitigate.

Innovation Solution

A system comprising a processor and memory with an analysis module and controller module that monitors cognitive states and responds by presenting augmented reality images or adjusting machine operations to reduce cognitive state measures below concern thresholds, using sensors and projectors to intervene when states exceed thresholds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If an individual operates a machine in an unfamiliar environment or for prolonged duration, then productivity is maintained, but cognitive state deteriorates (increased inattentiveness, fatigue, timidity) increasing likelihood of harmful incidents

Engineering Contradiction:
Improvecontinuous operation capabilityVSAvoidsafety against harmful incidents
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system continuously monitors cognitive state parameters (attention level, fatigue indicators, timidity measures) and provides feedback to both the operator through alerts and to the control system for automatic intervention. This closed-loop feedback enables real-time detection of deteriorating cognitive states and triggers appropriate responses before harmful incidents occur.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The control system acts as an intermediary between the operator and the machine operations. When cognitive state deteriorates, the system intermediates by automatically adjusting machine parameters, modifying operational constraints, or presenting augmented reality information to assist the operator, thereby maintaining safety without completely removing the operator from the loop.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the system presents augmented reality images or changes machine operations to reduce cognitive state measures, then safety is improved, but device complexity increases

Engineering Contradiction:
Improvesafety against harmful incidentsVSAvoidsystem components for monitoring and intervention
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The control system is designed with multi-functionality, serving both as the primary controller for machine operations and as the cognitive state monitoring and intervention system. By consolidating these functions into a single control architecture, the patent avoids duplicating hardware and reduces overall system complexity while maintaining comprehensive safety capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system monitors its own operational parameters and operator cognitive state, and autonomously makes adjustments without requiring external intervention. The control system self-manages the entire process from detection through intervention, reducing the need for additional dedicated monitoring equipment and simplifying the overall system architecture.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20240265642A1Reducing a measure of a cognitive state of an individual in an environment to be less than a cause-for-concern threshold
Publication Date: 2024.08.08 TOYOTA MOTOR ENG & MFG NORTH AMERICA INC
  • US20240265642A1 patent drawing
  • US20240265642A1 patent drawing
  • US20240265642A1 patent drawing

AI summary

A system for reducing a measure of a cognitive state of an individual in an environment to be less than a cause-for-concern threshold can include a processor and a memory. The memory can store an analysis module and a controller module. The analysis module can cause the processor to obtain information that the measure of the cognitive state of the individual in the environment is greater than the cause-for-concern threshold. The controller module can cause the processor to cause a response intended to reduce the measure to be less than the cause-for-concern threshold. The response can include one or more of: (1) a presentation of an image to produce an augmented reality for the environment or (2) if the individual is operating a machine, then a change to an operation of: (a) a component of a stationary machine or (b) a movement control component of a machine configured to move.