Vision-Based Robot Pose Control for User Movement Imitation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing user-robot interaction systems are complex and limited to industrial automation, lacking suitability for use as games or learning tools for children and disabled individuals with motor and cognitive difficulties, and are not reliable, accurate, or cost-effective.

Innovation Solution

A user-robot interaction system utilizing image detection means, neural networks for keypoint detection, and actuator control to mimic user movements, suitable for children and disabled users, with wireless communication and affordable components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If existing user-robot interaction systems are used, then robot movement control is achieved, but system complexity is high and cost is high

Engineering Contradiction:
Improvesystem complexityVSAvoidinteraction reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system segments the interaction into distinct modules: image capture module, neural network processing module, and actuator control module. This segmentation simplifies each individual component while maintaining overall system reliability, allowing the complex task of user-robot interaction to be divided into manageable, independent functions that can be optimized separately.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent replaces complex mechanical control systems with a vision-based neural network system. Instead of using sophisticated mechanical sensors and actuators to detect and replicate human movement, the system uses image capture devices and neural networks to detect user pose and generate robot movement commands, significantly reducing mechanical complexity while improving reliability through software-based control.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If industrial automation systems are used, then precision control is achieved, but adaptability to different users and contexts is poor

Engineering Contradiction:
Improveuser adaptabilityVSAvoidsystem configuration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The neural network model serves multiple functions: it detects various user poses, adapts to different users automatically, and works across different interaction scenarios. This universal model eliminates the need for separate configuration systems for different users or contexts, achieving high adaptability without increasing system complexity. The same core neural network handles diverse interaction requirements through its inherent generalization capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs self-adaptation through the neural network's automatic learning and generalization capabilities. When a new user interacts with the system, the neural network automatically adjusts to recognize and track that user's pose without requiring manual calibration or configuration. This self-service adaptability reduces the complexity of system setup and makes the system universally applicable to different users.

Inventive Principle:
Principle #25Self-service

3Manufacturing precision

If complex interaction systems are used, then movement accuracy is improved, but cost increases significantly

Engineering Contradiction:
Improvemovement accuracyVSAvoidsystem cost
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The system replaces expensive, precision mechanical components with more affordable electronic and software-based solutions. Instead of using costly mechanical encoders, force sensors, and precision actuators, the system uses standard image capture devices and neural network processing to achieve movement accuracy, significantly reducing manufacturing costs while maintaining acceptable precision for interactive applications.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent substitutes mechanical precision measurement systems with vision-based detection. Rather than relying on expensive mechanical sensors to measure user movement with high precision, the system uses image processing and neural networks to detect pose and calculate movement, achieving comparable accuracy at a fraction of the cost through non-contact optical measurement.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP4682827A1User-robot interaction system
Publication Date: 2026.01.21 CLEMENTONI
  • EP4682827A1 patent drawingFigure 1
  • EP4682827A1 patent drawingFigure 2
  • EP4682827A1 patent drawingFigure 3

AI summary

User-robot interaction system (100) comprising a robot (6), a wireless communication module (5), image detection means (1), and a processing unit (2) configured to implement a user pose algorithm (3) configured to receive the images (I) from the image detection means (1), identify keypoints in the image and calculate a three-dimensional position (P) of said keypoints, and a robot pose algorithm (4) configured to receive the three-dimensional position (P) of the keypoints calculated by the user pose algorithm (3) and process control signals (C) suitable for driving the actuators (A1, ...A6) of the robot in order to move the robot in accordance with the user's movements.