Robot Feedback Recognition Using Contact and Non-Contact Cues

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous operating bodies, such as robots, face challenges in accurately recognizing user feedback on their actions, leading to potential misinterpretation and inappropriate subsequent actions due to insufficient reliability in recognizing contact and non-contact feedback.

Innovation Solution

An information processing device with a recognition unit that includes a feedback recognizer, which accurately determines the degree of user feedback based on sensor information from contact and non-contact actions, utilizing a combination of touch sensors, inertial sensors, and voice recognition to comprehensively assess user reactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If autonomous operating bodies use simple recognition processing, then device complexity is reduced, but feedback recognition accuracy deteriorates

Engineering Contradiction:
Improverecognition processing complexityVSAvoidfeedback recognition accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The feedback recognition system is segmented into multiple specialized recognizers: contact action recognizer, non-contact action recognizer, and feedback degree recognizer. Each recognizer handles specific types of user feedback, allowing the system to maintain high accuracy while keeping individual recognizer complexity manageable through division of labor

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The recognition processing unit is designed to handle multiple types of feedback recognition functions simultaneously - contact detection, non-contact detection, and feedback degree assessment - within a single integrated system, improving accuracy without proportionally increasing complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If autonomous operating bodies recognize only contact feedback, then device complexity is reduced, but feedback recognition accuracy deteriorates due to missing non-contact feedback

Engineering Contradiction:
Improvefeedback recognition systemVSAvoiduser feedback recognition accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system merges contact action recognition and non-contact action recognition into a unified feedback recognition framework. By combining multiple recognition modalities (touch sensors for contact, voice/image sensors for non-contact), the system achieves comprehensive feedback accuracy without requiring separate independent systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements feedback loops where recognition results from both contact and non-contact actions are continuously processed to determine overall feedback degree, allowing the autonomous body to adjust its behavior based on comprehensive user reactions

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12128543B2Information processing device and information processing method
Publication Date: 2024.10.29 SONY GROUP CORP
  • US12128543B2 patent drawing
  • US12128543B2 patent drawing
  • US12128543B2 patent drawing

AI summary

An information processing device is provided including a recognition unit that executes recognition processing used to determine an action of an autonomous operating body on the basis of sensor information collected, in which the recognition unit includes a feedback recognizer that recognizes feedback from a user on behavior executed by the autonomous operating body, and the feedback recognizer recognizes a degree of the feedback on the basis of recognition results of a contact action and a non-contact action by the user for the autonomous operating body.