Mesh Sensor Protrusions for High-Resolution Gesture Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies, such as range imaging cameras and optically sensitive pixel approaches, fail to accurately capture time-varying pressure distributions over large surfaces and cannot seamlessly tile to form arbitrarily large sensing surfaces, lacking the necessary resolution and fidelity for applications like gesture recognition and pressure-sensitive displays.
Innovation Solution
A sensor system comprising a grid of wires with protrusions and a mechanical layer that reconstructs continuous force positions through interpolation across physically distinct tiles, combining 2D and 3D data to provide high-quality hand and finger gesture recognition and pressure imaging over large surfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If range imaging cameras are used for gesture sensing, then 3D spatial information and hand tracking are provided, but frame rate is too slow (30 fps) to properly sample finger pressing and releasing movements
Solution Approach 1:
The system divides the sensing surface into multiple independently controllable regions or zones. Each region can be scanned at high speed while the overall system maintains comprehensive coverage. This segmentation allows the sensor array to capture rapid finger movements with high frame rates while preserving the 3D spatial information needed for accurate gesture recognition.
Solution Approach 2:
The sensor system employs periodic scanning of the sensor array at high frequencies. By systematically cycling through different regions of the sensor surface in rapid succession, the system achieves high frame rates (greater than 30 fps) that can properly sample the dynamic movements of fingers pressing and releasing keys, while still providing complete spatial coverage for gesture analysis.
2Measurement precision
If purely surface-based touch devices are used, then 2D pressure sensing is provided, but little or no information is provided about finger and hand position in the space above the surface
Solution Approach 1:
The sensor system adds a third dimension by incorporating vertical height sensing capability. By measuring not only the 2D pressure distribution on the surface but also the height or depth information of contacting objects, the system provides complete spatial position data for fingers and hands both above and on the surface. This dimensional expansion resolves the information loss while maintaining accurate pressure measurement.
Solution Approach 2:
The sensor array is designed to serve multiple functions simultaneously: it measures 2D pressure distribution, detects 3D spatial position, and tracks object height. This multi-functionality allows a single sensor system to provide both pressure accuracy and complete spatial information, eliminating the need for separate sensing systems and resolving the information loss problem.
3Measurement precision
If very finely spaced 2D sensing element array is used, then continuous pressure image capture is approximated, but device complexity and manufacturing difficulty increase
Solution Approach 1:
The system extracts only the essential measurement points from a potentially continuous dense array. By strategically placing sensing elements at critical locations and using interpolation algorithms to reconstruct the continuous pressure image, the system achieves high measurement precision without requiring a very finely spaced physical array, thereby reducing device complexity and manufacturing difficulty.
Solution Approach 2:
Instead of using a physically dense array of sensing elements, the system creates a virtual high-resolution pressure image by copying and interpolating data from a sparser physical sensor array. This digital copying approach allows the system to achieve continuous pressure image capture at high resolution while maintaining a simpler, less complex physical sensor structure that is easier to manufacture.
4Adaptability or versatility
If optically sensitive pixel approaches are used, then both touch and hovering sensing is enabled, but cost per unit area is intrinsically far higher
Solution Approach 1:
The system uses inexpensive, mass-producible sensing elements that can be easily manufactured at low cost per unit area. These simpler, cheaper sensing elements replace expensive optically sensitive pixels while still providing the necessary touch and hovering detection capabilities through a different mechanical sensing mechanism that is more economical to produce at scale.
Solution Approach 2:
The system replaces the optical sensing mechanism with a mechanical pressure-sensitive element array. This substitution uses simpler mechanical components that are cheaper to manufacture while achieving the same functional goals of detecting both touch and hovering. The mechanical approach eliminates the need for expensive optical components and enables cost-effective mass production.
Data Source
AI summary
A sensor having a set of grid of bars that are in contact from their bottom at the corners with a set of protrusions that are in contact from above with a plurality of intersections, each having a sensing element, of a grid of wires disposed on a base, and a top surface layer that is disposed atop the grid of bars, so that force imparted from above onto the top surface layer is transmitted to the grid of bars and thence to the protrusions, and thence to the intersections of the grid of wires which are thereby compressed between the base and protrusions; and that the protrusions above thereby focus the imparted force directly onto the intersections. A sensor includes a computer in communication with the grid of wires which causes prompting signals to be sent to the grid of wires and reconstructs a continuous position of force on the surface from interpolation based on data signals received from the grid of wires. A method for sensing.