Robot Joint Angle Mapping for Accurate Human Pose Imitation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies fail to enable robots to learn and imitate human poses effectively, limiting their ability to interact and familiarize with humans.

Innovation Solution

An information processing device and method that includes a joint detection unit, human body joint angle estimation unit, and mapping learning unit to detect and learn the mapping between human and robot joint angles, allowing the robot to imitate human poses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If a robot performs learning from various kinds of information recognized to perform various autonomous behaviors, then the robot's autonomous capability is improved, but the robot cannot learn and imitate human motions

Engineering Contradiction:
Improveautonomous behavior capabilityVSAvoidmotion imitation capability
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

The patent segments the motion imitation task into distinct components: joint detection (identifying human joint positions), angle calculation (computing joint angles from detected positions), and mapping learning (creating correspondence between human and robot joint angles). This segmentation allows the robot to systematically acquire motion imitation capability without compromising its autonomous behavior capabilities.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mapping function that translates human joint angles into robot joint angles. This mapping acts as a mediator between human motion input and robot motion output, enabling the robot to learn and reproduce human motions while maintaining its independent autonomous decision-making capabilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If the robot learns mapping between human joint angles and robot joint angles, then the robot can accurately imitate human poses, but the system complexity increases

Engineering Contradiction:
Improvepose imitation accuracyVSAvoidlearning system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical motion transfer mechanisms with a software-based mapping learning system. Instead of using physical mechanisms to transfer motion from human to robot, the system uses computational algorithms to detect joint positions, calculate angles, and learn the mapping relationship, thereby achieving accurate pose imitation with reduced mechanical complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transforms the pose imitation problem from a spatial coordinate transformation problem into a parameter-based angle mapping problem. By focusing on joint angles as the key parameters and learning the mapping between human and robot joint angles, the system achieves accurate pose imitation while simplifying the computational burden compared to full 3D coordinate transformation.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11986746B2Information processing device and information processing method
Publication Date: 2024.05.21 SONY GROUP CORP
  • US11986746B2 patent drawing
  • US11986746B2 patent drawing
  • US11986746B2 patent drawing

AI summary

An information processing device includes: a joint detection unit that detects a joint of a person striking a pose to imitate a pose of a robot device including a joint; a human body joint angle estimation unit that estimates an angle of the joint of the person; and a mapping learning unit that learns mapping between the angle of the joint of the person and an angle of the joint of the robot device in the pose.