Surgical Robotic Arm Vision-Based Path Planning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing surgical robotic arms require multiple sensors and complex manual corrections to achieve automatic movement and obstacle avoidance, complicating their use in surgical environments.

Innovation Solution

A surgical robotic arm control system that integrates an image capturing unit and a processor to generate environment information images, allowing for automatic path calculation and obstacle avoidance through computer vision technology, enabling the robotic arm to move autonomously.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If multiple sensors and manual correction operations are used to achieve automatic control function, then the surgical robotic arm can avoid obstacles and achieve accurate automatic movement, but the device complexity and ease of operation deteriorate

Engineering Contradiction:
Improveautomatic control functionVSAvoiddevice complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The patent replaces multiple physical sensors with a camera-based vision system. Instead of using complex sensor arrays to detect obstacles and environment, the system uses image capturing units to obtain visual information, which is then processed to generate environment information images, direction information images, and depth information images. This substitutes mechanical/sensor-based detection with optical-based detection, reducing device complexity while maintaining automatic control functionality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates virtual copies of the physical environment through image processing. It generates environment information images, direction information images, and depth information images that are digital representations of the actual surgical environment. These image-based copies allow the robotic arm to navigate and avoid obstacles without needing physical sensors to directly interact with the environment, simplifying the hardware while achieving accurate automatic movement.

Inventive Principle:
Principle #26Copying

2Extent of automation

If multiple sensors and manual correction operations are used to achieve automatic control function, then the surgical robotic arm can avoid obstacles and achieve accurate automatic movement, but the ease of operation worsens

Engineering Contradiction:
Improveautomatic control functionVSAvoidease of operation
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The patent enables the robotic arm to perform self-navigation and self-correction through vision-based autonomous control. The system automatically captures images, processes them to extract environment and depth information, calculates paths, and adjusts movement without requiring manual correction operations. The robotic arm serves itself by using its own vision system to detect obstacles and autonomously navigate, eliminating the need for user intervention and improving ease of operation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements a closed-loop feedback system where the camera continuously captures images of the environment, the processor analyzes these images to generate depth and direction information, and the robotic arm adjusts its movement based on this feedback. This real-time feedback mechanism allows the system to automatically correct its path and avoid obstacles without manual intervention, enhancing both automation and ease of operation.

Inventive Principle:
Principle #23Feedback

3Productivity

If computer vision image technology is used to automatically control the surgical robotic arm to move, then the productivity and ease of operation improve, but the measurement precision requirements increase

Engineering Contradiction:
Improvesurgical efficiencyVSAvoidmeasurement precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent transitions from 2D image capture to 3D spatial understanding by generating depth information images. The system processes 2D images from the camera to create depth maps that represent the third dimension, enabling the robotic arm to perceive and navigate the surgical environment in three dimensions. This dimensional transformation allows accurate automatic movement and obstacle avoidance while maintaining high productivity, as the vision system can process spatial information more efficiently than traditional sensor arrays.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12102393B2Surgical robotic arm control system and control method thereof
Publication Date: 2024.10.01 METAL INDS RES & DEV CENT
  • US12102393B2 patent drawing
  • US12102393B2 patent drawing
  • US12102393B2 patent drawing

AI summary

A surgical robotic arm control system and a control method thereof are provided. The surgical robotic arm control system includes a surgical robotic arm, an image capturing unit, and a processor. The surgical robotic arm has multiple joint axes. The image capturing unit obtains a first image. The processor executes a spatial environment recognition module to generate a first environment information image, a first direction information image, and a first depth information image according to the first image. The processor executes a spatial environment image processing module to calculate path information according to the first environment information image, the first direction information image, and the first depth information image. The processor executes a robotic arm motion feedback module to operate the surgical robotic arm to move according to the path information.