Vision-Based Tactile Sensor Using Compound-Eye Optical Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vision-based tactile sensors are not utilized in state-of-the-art industrial and medical robotics due to their bulky size, high cost, and repeatability issues, limiting their ability to perform high-resolution spatial mapping and three-dimensional measuring.

Innovation Solution

The development of miniaturized, low-cost, and adaptable vision-based tactile sensors with a compound-eye inspired structure, comprising an elastomer layer coated with a flexible reflective film, pinhole-based structures, and CMOS sensors, which capture high spatial-density tactile mapping functions for surface deformation and contact force through optical imaging.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If vision-based tactile sensors are implemented, then high-resolution spatial mapping capability is improved, but device size becomes bulky

Engineering Contradiction:
Improvespatial mapping resolutionVSAvoidsensor size
Core Design Contradiction:
Measurement precisionVSVolume of moving object

Solution Approach 1:

The patent replaces complex mechanical sensor structures with an optical imaging system. A camera captures images of markers attached to the sensing surface, and image processing algorithms compute spatial mapping information. This substitution of mechanical sensing with optical measurement achieves high-resolution spatial mapping while significantly reducing device volume and complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent uses visual markers (patterns or features) attached to the sensing surface that can be captured by a camera. Instead of directly measuring physical deformation with complex sensors, the system creates a visual copy of the surface deformation through marker displacement in images, then processes this visual information to obtain precise spatial mapping data.

Inventive Principle:
Principle #26Copying

2Measurement precision

If advanced vision-based tactile sensors are used, then measurement capability is improved, but manufacturing cost increases

Engineering Contradiction:
Improvetactile sensing accuracyVSAvoidsensor cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent employs inexpensive components: standard digital cameras or image sensors, simple printed or painted markers, and basic optical elements. These components are significantly cheaper than specialized tactile sensors while providing sufficient measurement precision for many applications, thereby reducing manufacturing cost.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent uses a camera, which is a multi-functional device already widely available in robotics and imaging applications. By repurposing this existing component for tactile sensing rather than designing a dedicated sensor, the system reduces development and manufacturing costs while maintaining measurement capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If complex sensor structures are implemented, then sensing precision is improved, but device complexity increases

Engineering Contradiction:
Improvecontact force measurement accuracyVSAvoidsensor structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical force sensors with an optical measurement system. Markers attached to the sensing surface deform with the surface, and their displacement is captured by a camera. Image processing algorithms then compute contact force information from these displacements, achieving accurate force measurement without complex mechanical sensor structures.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces visual markers as an intermediary between the physical deformation and the measurement system. Instead of directly measuring force with complex sensors, the markers serve as intermediaries that translate physical deformation into visual information that can be easily captured and processed by standard imaging equipment.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Measurement precision

If high-density spatial mapping is achieved, then measurement resolution is improved, but repeatability deteriorates

Engineering Contradiction:
Improvespatial mapping densityVSAvoidmeasurement repeatability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent employs image processing feedback loops that continuously capture marker positions, compute displacements, and refine spatial mapping results. This feedback mechanism ensures consistent and repeatable measurements by systematically processing visual information through standardized algorithms, reducing variability in high-density spatial mapping results.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables high-resolution, three-dimensional contact information capture with improved repeatability and cost-effectiveness, facilitating their integration into industrial and medical robotics for precise tactile sensing.

Implementation Method 1

vision-based tactile sensors with a compound-eye inspired structure, comprising an elastomer layer coated with a flexible reflective film, pinhole-based structures, and CMOS sensors, which capture high spatial-density tactile mapping functions for surface deformation and contact force through optical imaging

Methodology Applied
Scientific EffectOptical imaging: Photography

Implementation Method 2

an elastomer layer coated with a flexible reflective film

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS11604108B2Tactile sensors and methods
Publication Date: 2023.03.14 THE HONG KONG UNIV OF SCI & TECH
  • US11604108B2 patent drawing
  • US11604108B2 patent drawing
  • US11604108B2 patent drawing

AI summary

Various tactile sensors and associated methods are enabled. For instance, a sensing apparatus comprises a photosensitive sensor. A compound-eye structure is on the photosensitive sensor and an elastomer layer is on the compound-eye structure. A reflective layer is on the elastomer layer, opposite the compound-eye structure and a light source emits light between the reflective layer and the compound-eye structure.