Vision-Guided Robot Placement With Touchscreen Recommendation Regions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robot systems lack intuitive and efficient methods for operating robots, particularly in tasks involving object picking and placement, as they often require complex manual adjustments and struggle with distinguishing overlapping objects or targets, leading to potential errors and increased operation time.

Innovation Solution

A robot system equipped with a vision sensor and a touch screen interface that allows users to input commands for object selection and placement, displaying recommendation regions based on physical properties like inclination, friction coefficient, and area, and generating operation signals to guide the robot's end effector for precise object transfer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If complex manual adjustments are required for robot operation, then the robot can perform precise tasks, but the ease of operation deteriorates

Engineering Contradiction:
Improveplacement precisionVSAvoidoperation complexity
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system enables the robot to automatically identify objects and determine placement positions through the vision sensor and controller, eliminating the need for complex manual adjustments. The robot serves itself by autonomously completing tasks that previously required detailed operator intervention, thereby improving ease of operation while maintaining precision through automated vision-guided positioning.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical adjustment operations with an automated vision-based control system. The vision sensor captures images, the controller processes them to identify objects and determine placement positions, and the robot executes movements automatically. This substitution of manual mechanical operations with automated sensing and control improves ease of operation while maintaining placement precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If the robot struggles to distinguish overlapping objects, then the measurement precision deteriorates, but the device complexity increases to solve it

Engineering Contradiction:
Improveobject distinction accuracyVSAvoidvision processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The controller acts as an intermediary that processes images from the vision sensor and distinguishes overlapping objects by analyzing spatial relationships and positions. Rather than complicating the vision sensor itself, the patent uses the controller's image processing capabilities to resolve overlapping object identification, achieving accurate distinction without excessive device complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If manual operation methods are used, then the operation time increases, but the reliability of object transfer deteriorates due to potential errors

Engineering Contradiction:
Improveobject transfer safetyVSAvoidoperation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The vision sensor provides real-time visual feedback to the controller, which monitors the robot's movements and the positions of objects and targets. This feedback loop enables the system to automatically adjust and verify placement accuracy, improving reliability by reducing human error while maintaining efficient operation speeds through automated real-time monitoring and correction.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary identification of objects and determination of placement positions before the actual transfer operation. The vision sensor and controller prepare the operation plan in advance, identifying target positions and planning movement paths, which streamlines the execution phase and reduces overall operation time while ensuring reliable, error-free transfers through pre-verified positioning.

Inventive Principle:
Principle #10Preliminary action

4Ease of operation

If the touch screen displays all regions equally, then the information presentation is simple, but the ease of operation deteriorates due to lack of guidance

Engineering Contradiction:
Improveinterface guidanceVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The touch screen displays the recommendation region with distinct visual characteristics (such as highlighting or different coloring) to differentiate it from other regions. This local quality enhancement provides intuitive guidance to operators, making it immediately clear which region is the optimal placement position, thereby improving ease of operation without significantly increasing overall interface complexity.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11559902B2Robot system and control method of the same
Publication Date: 2023.01.24 LG ELECTRONICS INC
  • US11559902B2 patent drawing
  • US11559902B2 patent drawing
  • US11559902B2 patent drawing

AI summary

A robot system includes: a robot including an end effector connected to an arm thereof; a vision sensor mounted to the robot; and a controller configured to output an operation signal that enables the robot to operate when an input is generated through a touch screen. Each of an object and a target to which the object is placed is inputted through the touch screen. The touch screen displays a recommendation region of the target in a distinguished manner.