3D Sensor Panel Gesture Cycle Direction Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users navigating media content in virtual or augmented reality environments face challenges in interacting with media players due to the lack of a natural user interface for recognizing repetitive 3D-gestures, particularly when these gestures are continuous, making it difficult to perform actions like fast-forwarding or flipping through content without visual feedback.
Innovation Solution
A method and system for detecting repetitive 3D-gestures using a computing device with a 3D-gesture sensor that captures finger movements, determines gesture cycles, and sends corresponding records to a media player to apply actions to media content, such as changing playback speed or zooming, based on gesture types, orientations, and durations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If HMD devices use handheld controllers or touch pads for interaction, then users can control media content playback, but users cannot see their hands or controller making it difficult to locate and press the right button
Solution Approach 1:
The patent replaces mechanical button pressing and touch pad interaction with a 3D gesture recognition system using depth sensors. The system captures hand movements in three-dimensional space and translates them into media control commands, eliminating the need for physical controllers or touch pads that require visual feedback.
Solution Approach 2:
The patent introduces a 3D gesture recognition system as an intermediary between the user and media content. The depth sensor captures hand movements, the processor interprets gesture patterns, and the system executes corresponding media controls, providing a natural interface that doesn't require visual feedback.
2Adaptability or versatility
If HoloLens uses free hand gesture technology, then users can interact spatially with objects, but it becomes challenging to point correctly to small buttons among many control buttons in the HoloLens view
Solution Approach 1:
The patent segments the gesture recognition process into distinct phases: capturing 3D hand positions, identifying gesture cycles through pattern matching, and executing corresponding media controls. This segmentation allows the system to handle complex spatial gestures with high precision by processing them in manageable stages.
Solution Approach 2:
The patent implements dynamic gesture cycle detection that adapts to different gesture types and speeds. The system continuously monitors hand movements and dynamically adjusts recognition parameters to accurately identify gesture cycles regardless of their duration or complexity, maintaining high precision across various interaction scenarios.
3Productivity
If users use handheld controllers to flip through e-book pages, then page turning is possible, but users must find and press proper buttons or swipe multiple times without seeing fingers or controller
Solution Approach 1:
The patent replaces mechanical button pressing and repeated swiping with natural hand gesture recognition. A single continuous hand movement through space can trigger multiple page turns, eliminating the need for repeated discrete actions and providing intuitive control without visual feedback.
4Adaptability or versatility
If the device recognizes repetitive 3D gestures without visual feedback, then natural user interface is improved, but the system must accurately detect and interpret continuous gestures without visual confirmation
Solution Approach 1:
The patent implements an internal feedback mechanism where the system continuously monitors hand position data and provides real-time gesture cycle detection. By analyzing the continuity and pattern of hand movements in 3D space, the system confirms gesture execution without requiring visual feedback from the user, maintaining high detection accuracy through computational feedback.
Data Source
AI summary
A system includes a 3D sensor panel for detecting a plurality of 3D positions corresponding to a finger movement and a controller. The controller determines that the plurality of 3D positions contain a gesture cycle by comparing a first set of positions in the plurality of 3D positions that includes at least two non-adjacent positions in the plurality of 3D positions and, upon determining that the first set of positions in the plurality of 3D positions match, determining that the plurality of positions contain the gesture cycle. the controller determines a direction of the gesture cycle based on a second set of positions in the plurality of 3D positions, where the direction is relative to the 3D sensor panel, and creates a gesture cycle record for the gesture cycle, the gesture cycle record comprising the plurality of 3D positions and the direction.