Robotic Tool Selection via Stereo Vision Measurement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Robotic systems face delays due to subjective selection of tools based on inaccurate visual estimates of work site dimensions, leading to frequent tool replacements when work site geometry changes.

Innovation Solution

A robotic system equipped with a high-definition digital stereo camera and processor that captures stereo images, processes them to determine precise work site dimensions, and selects the most geometrically appropriate tool from a variety of candidates using reference frame transformations and user interaction tools.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If visual estimate is used to select tool, then selection process is simple and fast, but measurement precision is poor leading to frequent tool replacements

Engineering Contradiction:
Improvework site dimension measurement precisionVSAvoidtool selection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical/visual estimation method with an optical measurement system using a digital camera and image processing algorithms. The camera captures images of the work site, and computational algorithms automatically measure dimensions and determine appropriate tool geometries, eliminating subjective visual estimation while providing precise, objective measurements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates a digital copy (image) of the work site environment and performs measurements on this digital representation rather than physically measuring or relying on visual estimation. The image serves as a data copy that can be processed algorithmically to extract precise dimensional information about the work site geometry.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If tool is selected based on initial work site conditions, then initial productivity is maintained, but adaptability to changes is poor causing additional delays

Engineering Contradiction:
Improvetool adaptability to work site changesVSAvoidtool replacement time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system continuously monitors work site conditions through the camera and compares current measurements against the geometry of the mounted tool. When changes are detected that make the current tool suboptimal, the system provides feedback by identifying appropriate tool replacements and can automatically execute the swap, enabling real-time adaptation to changing work site conditions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The tool selection system transitions from a static initial selection to a dynamic, continuously updated selection based on real-time work site condition changes. The system adapts tool choices as work site dimensions change during operation, maintaining optimal tool geometry throughout the task rather than relying on an initial fixed selection.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If multiple tools of varying geometries are available, then adaptability to different work sites is improved, but device complexity increases

Engineering Contradiction:
Improvetool geometry adaptabilityVSAvoidtool library management complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically manages the tool library by using image processing algorithms to measure work site dimensions and algorithmically determine the optimal tool geometry. Rather than requiring manual assessment or complex user interfaces to select from multiple tools, the system self-services the selection process by autonomously analyzing work site conditions and identifying appropriate tools from the available library.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Ensures accurate and efficient tool selection, minimizing delays by providing a method for determining optimal tool geometry based on precise measurements, adapting to changes in the work site environment.

Implementation Method 1

A robotic system equipped with a high-definition digital stereo camera and processor that captures stereo images, processes them to determine precise work site dimensions

Methodology Applied
Scientific EffectStereo vision: Parallax

Data Source

PatentUS11639000B2Geometrically appropriate tool selection assistance for determined work site dimensions
Publication Date: 2023.05.02 INTUITIVE SURGICAL OPERATIONS INC
  • US11639000B2 patent drawing
  • US11639000B2 patent drawing
  • US11639000B2 patent drawing

AI summary

A robotic system includes a processor that is programmed to determine and cause work site measurements for user specified points in the work site to be graphically displayed in order to provide geometrically appropriate tool selection assistance to the user. The processor is also programmed to determine an optimal one of a plurality of tools of varying geometries for use at the work site and to cause graphical representations of at least the optimal tool to be displayed along with the work site measurements.