3D Gesture Detection via Touch and Imaging Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional touch panel devices can only detect a limited number of operations such as tap, flick, and swipe, limiting the variety of interactions users can have with electronic devices.
Innovation Solution
An electronic device with a display unit capable of showing three-dimensional objects and a detection system that tracks the displacement of a second object in three-dimensional space, allowing for various operations to be performed on these objects, including tapping, moving, and pushing, by using a combination of touch sensors and imaging units to detect movements in multiple axes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional touch panel operations are used, then the device structure remains simple, but the variety of user interactions is limited
Solution Approach 1:
The patent combines multiple detection technologies (touch panel sensors and imaging unit) into a unified detection system that works together to recognize various user operations. The touch panel detects contact points while the imaging unit captures hand gestures, and their data is integrated to enable diverse interaction modes including typing, swiping, and gesture recognition.
Solution Approach 2:
The detection system is designed to perform multiple functions: it can detect simple taps, complex gestures, hand movements, and typing patterns using the same hardware components. The imaging unit and touch panel work together to provide universal detection capabilities across different operation types, eliminating the need for separate detection systems for each interaction mode.
2Adaptability or versatility
If only two-dimensional touch panel operations are supported, then the device complexity remains low, but the functionality and user engagement are limited
Solution Approach 1:
The patent transitions from two-dimensional touch panel detection to three-dimensional gesture recognition by incorporating an imaging unit that captures hand movements in space. This adds a temporal and spatial dimension to operation detection, enabling recognition of gestures like pinching, rotating, and waving that cannot be detected by traditional 2D touch panels alone.
Solution Approach 2:
The system dynamically adapts its detection capabilities by switching between touch panel-only mode for simple interactions and combined imaging-unit-plus-touch-panel mode for complex gestures. The detection system adjusts its sensitivity and processing based on the detected operation type, providing optimized performance for each interaction mode.
Data Source
AI summary
According to an aspect, an electronic device includes: a display unit for three-dimensionally displaying a first object; a detecting unit for detecting a displacement of a second object in three-dimensional space where the first object is displayed; and a control unit for performing an operation related to the first object according to the displacement of the second object detected by the detecting unit.