Smartphone Gesture Control for Markerless 3D Device Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing home automation techniques rely on cumbersome markers or sensors, and complex equipment, making them expensive and inefficient for real-time motion capture in pervasive computing environments, limiting their deployment and user experience.
Innovation Solution
A smartphone with a motion sensory control device detects gestures in a 3D space, allowing selection and control of devices without markers or sensors, and switches operation modes to conserve power, enabling intuitive gestural interaction and ambient intelligence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Difficulty of detecting and measuring
If conventional motion capture approaches using markers or sensors are employed, then motion detection capability is achieved, but device complexity and cost increase significantly
Solution Approach 1:
The patent extracts the motion detection functionality from complex dedicated motion capture systems and relocates it to a smartphone device. The smartphone's existing camera and processor are utilized to perform gesture recognition, eliminating the need for specialized markers, sensors, or bulky equipment while maintaining motion detection capability.
Solution Approach 2:
The smartphone serves multiple functions: it acts as both the motion detection device and the control interface for the target device. The single device performs gesture recognition, wireless communication, and control signal generation, replacing the need for separate specialized equipment for each function.
2Area of stationary object
If multiple cameras are deployed for motion capture, then measurement coverage is improved, but real-time operation becomes difficult due to data volume
Solution Approach 1:
The patent segments the motion detection task into distinct phases: video capture, gesture identification, and control signal generation. By processing only relevant portions of the video data (specifically identifying gesture patterns rather than analyzing all pixel data), the system maintains real-time operation while achieving effective motion detection coverage.
3Speed
If continuous motion monitoring is performed, then gesture detection responsiveness is improved, but power consumption increases
Solution Approach 1:
The system employs periodic action by activating the camera and processing video data only when motion or potential gestures are detected, rather than continuously monitoring. This allows the system to maintain responsiveness to gestures while significantly reducing power consumption during idle periods when no interaction is occurring.
Data Source
AI summary
The technology disclosed relates to selecting among devices room to interact with. It also relates operating a smart phone with reduced power consumption. It further relates to gesturally interacting with devices that lack gestural responsiveness. The technology disclosed also relates to distinguishing control gestures from proximate non-control gestures in a pervasive three dimensional (3D) sensory space. The technology disclosed further relates to selecting among virtual interaction modalities to interact with.