Robot Object Interaction Learning for Flexible Assembly Handling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing object handling procedures for robots in automated production and assembly lines are complex, costly, and lack flexibility, requiring continuous reprogramming due to the need for specific programming languages and inadequate adaptation to changes in movements or objects.

Innovation Solution

A process involving a robot with a graphical user interface, sensors, and a control computer that uses learning phases and an action database to enable flexible and efficient interaction with objects, allowing adaptation to changes in movements and objects through a simplified instruction method.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If specific programming languages are used to instruct the robot for each single action, then the robot can perform tasks with high precision, but the management of production processes becomes complex and error-prone

Engineering Contradiction:
Improveprecision of robot actionsVSAvoidcomplexity of production process management
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses video recording to capture the operator's manual handling actions and stores them as instructional data for the robot. This copying approach replaces complex programming languages with intuitive video-based instruction, allowing the robot to learn actions by observing and reproducing human operations, thereby reducing management complexity while maintaining precision

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical programming system (programming languages and manual instruction configuration) with an automated video capture and recognition system. The sensor-equipped camera records actions and automatically converts them into robot instructions, substituting the complex mechanical process of programming with an automated optical and computational system

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If graphical user interfaces are used to program robots, then programming speed is improved, but the procedures remain complex and costly

Engineering Contradiction:
Improveprogramming speedVSAvoidcomplexity of handling procedures
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system enables self-service programming by allowing the robot to automatically learn actions through video recording of operator demonstrations. The robot captures, processes, and stores instructional data without requiring complex GUI programming interfaces, making the system easier to use while maintaining high programming speed

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent introduces video recording and sensor data as an intermediary between the operator's actions and the robot's instruction system. This intermediary layer captures the essence of manual operations and translates them into robot commands, eliminating the need for complex GUI programming while preserving programming efficiency

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If continuous reprogramming is performed to adapt to changes, then the robot can handle different objects and movements, but the process becomes time-consuming and costly

Engineering Contradiction:
Improveadaptability to changes in movements and objectsVSAvoidtime for reprogramming
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent implements preliminary action by recording and storing multiple action patterns in advance through video capture. When adaptation is needed, the system retrieves pre-recorded instructional data corresponding to the new objects or movements, eliminating the need for time-consuming reprogramming while maintaining high adaptability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates copies of action patterns through video recording and stores them in a database. When new objects or movements are encountered, the system copies relevant instructional data from the database rather than creating new programs from scratch, enabling rapid adaptation without significant reprogramming time

Inventive Principle:
Principle #26Copying

Data Source

PatentEP4294607B1Process of interacting with objects
Publication Date: 2026.04.08 UNIV DI PISA
  • EP4294607B1 patent drawingFigure 1
  • EP4294607B1 patent drawingFigure 2a~4

AI summary

A process of interacting with objects(la) is provided comprising a robot (2) with an end effector (21 ), a driver (22) of the end effector (21) and sensors (23) for acquiring at least one environmental or interaction parameter; a computer (5) for controlling the robot (2); an instruction block (3) configured to instruct the robot (2) to move the end effector (21 ) according to instructions defined by the instruction block.