Robotic Movement Adjustment Based on Human Cognitive State

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Human interactions with robots can be uncomfortable due to unpredictable movements, leading to distress in humans observing robotic actions, especially if they are unfamiliar with the robot's operations and movements.

Innovation Solution

A robotic system that detects human cognitive states through sensors such as speech patterns, facial recognition, biometric sensors, and thermal imaging, adjusting its movements and operations to accommodate the observed emotional state, thereby modifying its behavior to reduce human anxiety.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the robot performs work activities with standard operational speed and movement patterns, then productivity and task completion efficiency are maintained, but human observers experience discomfort and distress due to unpredictable movements

Engineering Contradiction:
Improvetask completion efficiencyVSAvoidhuman distress and discomfort
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The robot dynamically adjusts its movement characteristics based on real-time detection of human cognitive states. The system modifies operational parameters such as movement speed, acceleration profiles, and transition smoothness according to detected human anxiety levels, transforming a static operational system into an adaptive one that responds to environmental feedback

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements a closed-loop feedback mechanism where sensors continuously monitor human physiological and behavioral indicators (speech patterns, facial expressions, biometric data), the processor analyzes these signals to determine cognitive state, and the robot adjusts its movements accordingly. This creates a responsive control system that adapts to human emotional states in real-time

Inventive Principle:
Principle #23Feedback

2Object-affected harmful factors

If the robot slows down movements to reduce human anxiety, then human comfort is improved, but task completion time increases and productivity decreases

Engineering Contradiction:
Improvehuman anxiety reductionVSAvoidtask completion speed
Core Design Contradiction:
Object-affected harmful factorsVSProductivity

Solution Approach 1:

The robot applies movement adjustment selectively rather than uniformly across all operations. It modifies movement characteristics only during specific phases or in proximity to human observers, while maintaining standard operational speeds during isolated or non-interactive tasks. This partial application of speed reduction minimizes impact on overall productivity while still providing anxiety relief when needed

Inventive Principle:
Principle #16Partial or excessive action

3Ease of operation

If the robot implements real-time cognitive state detection and movement adjustment, then human-robot interaction comfort is improved, but device complexity and computational requirements increase

Engineering Contradiction:
Improvehuman-robot interaction comfortVSAvoidsensor and processing system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The robot employs multi-functional sensor systems that serve both primary navigation/obstacle detection functions and secondary human cognitive state detection functions. For example, cameras and microphones used for basic environmental awareness are also utilized for analyzing facial expressions and speech patterns, reducing the need for dedicated specialized sensors and lowering overall system complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system combines multiple detection modalities (visual, auditory, biometric) into a unified cognitive state analysis framework. By merging these sensing functions and processing them through integrated algorithms, the system achieves comprehensive human state monitoring without requiring separate independent subsystems for each function

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11110608B2Robotic physical movement adjustment based on user emotional state
Publication Date: 2021.09.07 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11110608B2 patent drawing
  • US11110608B2 patent drawing
  • US11110608B2 patent drawing

AI summary

A method controls a robot. One or more processors receive sensor readings from one or more sensors that are monitoring a human in real time, where the human is currently observing a robotic action by a robot, and where the robotic action is a physical movement performed by the robot. The processor(s) determine a cognitive state of the human while the human is observing the robotic action by the robot, and then adjust the robotic action being performed by the robot based on the cognitive state of the human.