Robot Eye Contact Management via Dynamic Cancellation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robots lack the ability to dynamically manage eye contact with users based on predefined conditions, potentially leading to uncomfortable interactions by maintaining eye contact beyond what is deemed appropriate or failing to recognize negative user reactions.

Innovation Solution

A robot equipped with a controller, imager, and sensors that check for eye contact and determine whether to cancel it based on predefined conditions, such as proper eye contact time and user reactions like voice and facial expressions, to ensure comfortable interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the robot maintains eye contact with the user, then communication engagement is improved, but user comfort deteriorates when eye contact becomes too prolonged or inappropriate

Engineering Contradiction:
Improvecommunication engagementVSAvoiduser comfort
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The robot dynamically adjusts its eye contact behavior by transitioning between different eye contact states (maintaining, canceling) based on real-time detection of user reactions and predefined conditions. The operation controller dynamically controls the display to adjust eye contact duration and timing, making the system adaptive rather than static.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from the checker that detects user reactions (voice, facial expressions) and from the determiner that evaluates predefined conditions to control the operation controller. This feedback loop allows the robot to monitor user comfort levels and adjust eye contact behavior accordingly, canceling eye contact when negative reactions are detected.

Inventive Principle:
Principle #23Feedback

2Object-affected harmful factors

If the robot uses complex detection and control mechanisms to manage eye contact, then user comfort is improved, but device complexity increases

Engineering Contradiction:
Improveuser comfortVSAvoidcontrol mechanism complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The control system is segmented into distinct functional modules: an operation unit for executing actions, a checker for detecting user reactions, a determiner for evaluating conditions, and an operation controller for coordinating eye contact control. This segmentation allows each component to have a specific, simplified function while collectively achieving complex behavior management.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The operation controller serves multiple functions: it controls the display to maintain or cancel eye contact, coordinates with the checker and determiner, and adapts behavior based on various user reactions. This multi-functionality reduces the need for separate dedicated components for each control aspect.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10836041B2More endearing robot, robot control method, and non-transitory recording medium
Publication Date: 2020.11.17 CASIO COMPUTER CO LTD
  • US10836041B2 patent drawing
  • US10836041B2 patent drawing
  • US10836041B2 patent drawing

AI summary

A robot provided with eyes includes an operation unit that operates a display and a movable member; a checker that checks whether eye contact with a predetermined target is made or not; a determiner that determines whether a predetermined condition regarding the predetermined target is satisfied during the eye contact or not, in a case in which the checker checks that the eye contact with the predetermined target is made; and an operation controller that controls the display and the movable member to cancel the eye contact with the predetermined target, in a case in which the determiner determines that the predetermined condition regarding the predetermined target is satisfied.