Vision-Based Robot Pose Control for User Movement Imitation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user-robot interaction systems are complex and limited to industrial automation, lacking suitability for use as games or learning tools for children and disabled individuals with motor and cognitive difficulties, and are not reliable, accurate, or cost-effective.
Innovation Solution
A user-robot interaction system utilizing image detection means, neural networks for keypoint detection, and actuator control to mimic user movements, suitable for children and disabled users, with wireless communication and affordable components.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If existing user-robot interaction systems are used, then robot movement control is achieved, but system complexity is high and cost is high
Solution Approach 1:
The system segments the interaction into distinct modules: image capture module, neural network processing module, and actuator control module. This segmentation simplifies each individual component while maintaining overall system reliability, allowing the complex task of user-robot interaction to be divided into manageable, independent functions that can be optimized separately.
Solution Approach 2:
The patent replaces complex mechanical control systems with a vision-based neural network system. Instead of using sophisticated mechanical sensors and actuators to detect and replicate human movement, the system uses image capture devices and neural networks to detect user pose and generate robot movement commands, significantly reducing mechanical complexity while improving reliability through software-based control.
2Adaptability or versatility
If industrial automation systems are used, then precision control is achieved, but adaptability to different users and contexts is poor
Solution Approach 1:
The neural network model serves multiple functions: it detects various user poses, adapts to different users automatically, and works across different interaction scenarios. This universal model eliminates the need for separate configuration systems for different users or contexts, achieving high adaptability without increasing system complexity. The same core neural network handles diverse interaction requirements through its inherent generalization capabilities.
Solution Approach 2:
The system performs self-adaptation through the neural network's automatic learning and generalization capabilities. When a new user interacts with the system, the neural network automatically adjusts to recognize and track that user's pose without requiring manual calibration or configuration. This self-service adaptability reduces the complexity of system setup and makes the system universally applicable to different users.
3Manufacturing precision
If complex interaction systems are used, then movement accuracy is improved, but cost increases significantly
Solution Approach 1:
The system replaces expensive, precision mechanical components with more affordable electronic and software-based solutions. Instead of using costly mechanical encoders, force sensors, and precision actuators, the system uses standard image capture devices and neural network processing to achieve movement accuracy, significantly reducing manufacturing costs while maintaining acceptable precision for interactive applications.
Solution Approach 2:
The patent substitutes mechanical precision measurement systems with vision-based detection. Rather than relying on expensive mechanical sensors to measure user movement with high precision, the system uses image processing and neural networks to detect pose and calculate movement, achieving comparable accuracy at a fraction of the cost through non-contact optical measurement.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
User-robot interaction system (100) comprising a robot (6), a wireless communication module (5), image detection means (1), and a processing unit (2) configured to implement a user pose algorithm (3) configured to receive the images (I) from the image detection means (1), identify keypoints in the image and calculate a three-dimensional position (P) of said keypoints, and a robot pose algorithm (4) configured to receive the three-dimensional position (P) of the keypoints calculated by the user pose algorithm (3) and process control signals (C) suitable for driving the actuators (A1, ...A6) of the robot in order to move the robot in accordance with the user's movements.