Multi-Robot Camera System for Adaptive Facial Expression Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional robot camera systems struggle to capture engaging facial expressions from subjects, as they operate autonomously without adapting their behavior based on subject attributes or environmental cues.

Innovation Solution

A robot system that includes an imager, detector, selector, transmitter, operator, and outputter, allowing multiple robots to operate in synchronized patterns based on subject attributes, such as age or environmental sounds, to create a pleasant atmosphere and encourage natural facial expressions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If multiple robots operate autonomously without adaptation, then operational simplicity is maintained, but facial expression capture quality deteriorates

Engineering Contradiction:
Improvefacial expression capture qualityVSAvoidrobot operation complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The robot system dynamically adjusts its operation pattern based on detected subject attributes. The controller selects from multiple pre-defined operation patterns (approach, retreat, maintain position, rotate) depending on real-time detection results, enabling adaptive behavior that improves facial expression capture without requiring complex real-time decision-making algorithms

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback loops where the detector continuously monitors subject attributes (age, gender, emotion, gaze direction) and feeds this information back to the controller. The controller then adjusts robot operation accordingly, creating a closed-loop system that progressively optimizes facial expression capture based on subject response

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If robots use fixed operation patterns, then control simplicity is maintained, but adaptability to different subjects deteriorates

Engineering Contradiction:
Improvesubject attribute adaptationVSAvoidcontrol system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Multiple operation patterns are pre-defined and stored in the controller before actual operation. These patterns (approach, retreat, maintain position, rotate) are prepared in advance based on anticipated subject attributes, allowing the robot to quickly switch between predefined behaviors rather than generating complex maneuvers in real-time

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes operational parameters (position, orientation, speed) based on detected subject attributes such as age, gender, emotional state, and gaze direction. The controller selects appropriate operation patterns that adjust these parameters to create optimal conditions for capturing natural facial expressions from diverse subjects

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If robots operate without coordination, then individual operation simplicity is maintained, but overall imaging effectiveness deteriorates

Engineering Contradiction:
Improveimaging effectivenessVSAvoidrobot coordination complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Multiple robot controllers are merged into a coordinated system where one robot's controller can detect subjects and determine operation patterns, then transmit control instructions to other robots. This combining of detection and control functions across multiple robots enables synchronized operation that improves imaging effectiveness without requiring each robot to independently perform all functions

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11991437B2Robot, control processing method, and non-transitory computer readable recording medium storing control processing program
Publication Date: 2024.05.21 PANASONIC INTELLECTUAL PROPERTY CORP OF AMERICA
  • US11991437B2 patent drawing
  • US11991437B2 patent drawing
  • US11991437B2 patent drawing

AI summary

A first camera robot includes: a camera that captures an image of surroundings; an image recognizer that detects one or more subjects from within a captured image; a controller that selects an operation pattern of the first camera robot based on an attribute of one or more subjects detected, and causes the robot to operate according to the selected operation pattern; a communicator that transmits, to another camera robot, instruction information for causing the other robot to operate according to the selected operation pattern; and a shutter that outputs an image obtained by capturing the one or more subjects while the first camera robot and the other robot are operating according to the selected operation pattern.