Virtual Robotic Arm Interface for Drag-and-Drop Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current semi-automatic robotic arms require complex manual adjustments and multiple node operations, leading to low operation efficiency and poor user experience.

Innovation Solution

A method and system for controlling robotic arms using human-computer interaction, where a virtual robotic arm with movable nodes is simulated on a screen, allowing users to control the actual arm through drag-and-drop operations, generating controlling signals based on the motion path to synchronize the arm's movement with the virtual arm's motion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional control methods with multiple control strips are used, then each joint can be controlled individually, but the operation becomes complex and efficiency is very low

Engineering Contradiction:
Improvecontrol operation simplicityVSAvoidoperation efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The robotic arm is divided into multiple virtual nodes representing different joints, where each node can be independently controlled. This segmentation allows operators to control specific joints without managing complex multiple control strips, simplifying the operation while maintaining the ability to control each joint individually.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A virtual robotic arm interface is introduced as an intermediary between the operator and the physical robotic arm. This virtual interface provides an intuitive visual representation where operators can drag and drop virtual nodes to control the physical arm, eliminating the need for complex control strip operations and significantly improving operation efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If visual inspection is required for joint adjustment, then precise control can be achieved, but the operation process becomes time-consuming

Engineering Contradiction:
Improvejoint position precisionVSAvoidadjustment time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system provides real-time visual feedback by displaying the virtual robotic arm that mirrors the physical arm's position. Operators can see the current state of each joint through the virtual representation and make adjustments without needing to visually inspect the physical joints, maintaining precision while reducing adjustment time.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

A virtual copy of the robotic arm is created and displayed on the screen, showing the position and state of each joint. This virtual copy allows operators to monitor and control joint positions without physically inspecting the actual arm, eliminating time-consuming visual inspection while maintaining precise control through the intuitive virtual interface.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If multiple sliding blocks need to be controlled simultaneously, then comprehensive control is achieved, but the complexity of operation increases significantly

Engineering Contradiction:
Improvecontrol coverageVSAvoidcontrol interface complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Multiple control functions for different joints are merged into a single unified virtual robotic arm interface. Instead of managing multiple separate control strips and sliding blocks, operators interact with one integrated virtual representation where each joint is depicted as a virtual node, reducing control interface complexity while maintaining comprehensive control coverage.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The virtual robotic arm interface serves multiple control functions simultaneously - it displays the state of all joints, allows selection of different joints for control, and provides drag-and-drop manipulation capability. This multi-functional interface replaces multiple specialized control elements, reducing overall system complexity while maintaining the ability to control all joints comprehensively.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10513032B2Method of controlling robotic arm with human computer interaction, and terminal and system for same
Publication Date: 2019.12.24 SHENZHEN XIAO R GEEK TECH CO LTD
  • US10513032B2 patent drawing
  • US10513032B2 patent drawing
  • US10513032B2 patent drawing

AI summary

A method of controlling a robotic arm with human-computer interaction, and terminal and system for the same are provided. The method of controlling the robotic arm with human-computer interaction includes: virtualizing a robotic arm to provide a virtual robotic arm having at least two movable nodes on a screen, and designating a distal movable node of the at least two movable nodes as a target node; when the target node is triggered, responding to a drag-and-drop operation by a user and generating a moving path according to a path of the drag-and-drop operation on the target node; and generating a controlling signal for controlling a motion of the robotic arm based on the moving path, and controlling the robotic arm to move according to a motion of the virtual robotic arm based on control of the controlling signal.