Optics-Based Tactile Sensor for High-Resolution Robotic Manipulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional tactile sensors for robotic manipulation face challenges in achieving high localization accuracy and sensitivity on non-planar surfaces, particularly due to complexity in fabrication, adaptability to irregular geometries, and integration within robotic hands, where they must be small, robust, and functional in uncontrolled environments.

Innovation Solution

The development of optics-based tactile sensors using a transparent elastomer volume with embedded light emitting diodes and photodetectors, which measure light transport changes to estimate indentation location and depth, operating in two modes for sensitivity across a wide range of indentation depths, and employing data-driven methods for high accuracy and low-cost manufacturing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a matrix of miniaturized individual sensors is used to achieve high localization accuracy, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvelocalization accuracyVSAvoidcomplexity in fabrication and circuitry
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The sensor surface is divided into a matrix of taxels (tactile elements), where each taxel is a miniaturized sensing unit. This segmentation allows high localization accuracy through precise contact detection at multiple discrete locations while managing complexity through modular design and systematic signal processing across the taxel array.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from traditional planar sensor arrays to a compliant three-dimensional structure that can conform to non-planar surfaces. This dimensional change allows the sensor to maintain high measurement precision on curved surfaces while reducing fabrication complexity by using a single continuous compliant substrate instead of assembling multiple rigid sensor elements.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If traditional tactile sensors are designed to be flexible and conformable, then adaptability to non-planar geometries is improved, but ease of operation deteriorates due to wiring and power consumption constraints

Engineering Contradiction:
Improveadaptability to non-planar geometriesVSAvoidease of use in robotic hand integration
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent employs a compliant substrate that acts as a flexible shell, allowing the sensor array to conform to non-planar surfaces such as robotic fingers. This flexible foundation enables adaptability to various geometries while the overall sensor design integrates wiring and power delivery within the compliant structure, improving ease of operation in robotic hand applications.

Inventive Principle:
Principle #30Flexible shells and thin films

Solution Approach 2:

The compliant sensor array is designed to serve multiple functions: it provides tactile sensing across non-planar surfaces, maintains structural integrity under deformation, and facilitates integration into robotic hands. This multi-functionality improves ease of operation by reducing the need for separate components and simplifying system integration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If sensors are miniaturized for integration inside robotic hands, then adaptability is improved, but measurement precision deteriorates due to size constraints

Engineering Contradiction:
Improveintegration capability inside robotic handVSAvoidsensitivity and localization accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The sensor is divided into numerous miniaturized taxels that can be densely packed within the limited space of a robotic hand. This segmentation enables high measurement precision by providing fine spatial resolution despite the small overall size, allowing accurate contact localization even with miniaturized individual sensing elements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a nested structure where the compliant sensor array is integrated within the robotic hand geometry. The sensor conformally wraps around or integrates with the hand structure, allowing miniaturization while maintaining measurement precision through the dense arrangement of taxels within the available space.

Inventive Principle:
Principle #7Nested doll (Nesting)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

These sensors achieve sub-millimeter accuracy in localization and depth prediction, are easy to manufacture, and can be integrated into robotic skin applications, providing high sensitivity and robustness on non-planar surfaces while reducing unwanted phenomena like drift and hysteresis.

Implementation Method 1

one or more light emitting diodes configured to emit light into the transparent material

Methodology Applied
Scientific EffectLight emitting diode: Light Emitting Diode

Implementation Method 2

one or more photodetectors configured to receive emitted light from the one or more light emitting diodes

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Implementation Method 3

measure light transport changes to estimate indentation location and depth

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 4

receive second light from the at least one light emitting diode thought an indirect path, where the second light has been reflected at the light reflective surface

Methodology Applied
Scientific EffectTotal internal reflection: Total Internal Reflection

Data Source

PatentUS10663361B2Systems and methods for tactile sensing
Publication Date: 2020.05.26 THE TRUSTEES OF COLUMBIA UNIV IN THE CITY OF NEW YORK
  • US10663361B2 patent drawing
  • US10663361B2 patent drawing
  • US10663361B2 patent drawing

AI summary

Achieving high spatial resolution in contact sensing for robotic manipulation often comes at the price of increased complexity in fabrication and integration. One traditional approach is to fabricate a large number of taxels, each delivering an individual, isolated response to a stimulus. The proposed sensors include a continuous volume of soft material, e.g., a transparent polymer, and light emitting diodes configured to emit light into the transparent volume that can be received by photodetectors. The location and depth of indentations can be measured between all pairs of light emitting diodes and photodetectors in the set, and this rich signal set can contain the information needed to pinpoint contact location with high accuracy using regression algorithms.