Optical Tactile Sensor Marker Tracking for Contact Shape Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing optical tactile sensors require complex photometric stereo approaches that involve exacting sensor fabrication, lighting control, and expensive network training, limiting their applicability and efficiency in object shape estimation.
Innovation Solution
A shape-from-texture inspired method using visually distinct markers on a membrane surface, allowing for real-time contact surface shape estimation without complex lighting assumptions or network training, by analyzing marker deformations under a perspective camera model.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If photometric stereo approach is used for shape estimation, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent replaces complex photometric stereo systems with inexpensive marker patterns printed on the membrane. These markers are simple visual features that can be detected by standard cameras, eliminating the need for complex lighting setups and precise sensor fabrication while maintaining shape estimation capability
Solution Approach 2:
The patent changes the approach from measuring light intensity variations under controlled lighting (photometric stereo) to detecting geometric deformations of marker patterns. This parameter change from photometric measurements to geometric feature tracking simplifies the system requirements while preserving measurement accuracy
2Measurement precision
If photometric stereo approach is used for shape estimation, then measurement precision is improved, but loss of time increases
Solution Approach 1:
The marker-based system is self-calibrating and does not require external training data or complex calibration procedures. The markers provide inherent geometric references that automatically define the coordinate system and scale, allowing the system to begin measurements immediately without time-consuming setup
Solution Approach 2:
The marker patterns are pre-designed with known geometric configurations that encode spatial information. This preliminary encoding of measurement references in the marker geometry eliminates the need for runtime calibration or training, enabling immediate shape estimation
3Measurement precision
If photometric stereo approach is used for shape estimation, then measurement precision is improved, but ease of operation deteriorates
Solution Approach 1:
The patent extracts the essential measurement information from complex photometric stereo by focusing only on marker pattern deformations. This extraction eliminates the need for controlled lighting conditions and complex calibration procedures, allowing operation under natural or ambient lighting while maintaining accuracy
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and efficient estimation of contact surface shape across various lighting conditions, reducing the need for precise sensor calibration and training, and is compatible with existing tactile sensors.
Implementation Method 1
a camera; measuring a plurality of relations between the optical tactile sensor and an object; detecting a plurality of markers on the membrane
Data Source
AI summary
A method performed by an optical tactile sensor comprising a camera, includes: measuring a plurality of relations between the optical tactile sensor and an object; detecting a contact of a membrane on the object; detecting a plurality of markers on the membrane; performing a plurality of first operations by using a tactile perception module; and performing a second operation by using a three-dimensional (3D) perception module, based on a result of the performing of the plurality of first operations.