3D Light Field Gesture Mapping for Precise Spatial Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D light field displays lack an effective interactive solution that allows users to accurately and efficiently perform operations on stereoscopic interactive interfaces, limiting the user's interaction experience.
Innovation Solution
An interactive method and device for light field displays that create virtual objects on a stereoscopic interface, map user gestures to these objects using convex hull and joint detection algorithms, and adjust display content based on these gestures, employing image acquisition devices positioned optimally for accurate coordinate mapping.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional 2D interaction methods are used on light field displays, then the display technology is simple, but the interactive experience is poor and inaccurate
Solution Approach 1:
The patent transitions from 2D interaction to 3D spatial interaction by introducing depth information and stereoscopic display. Users interact with virtual objects in three-dimensional space rather than on a flat screen, enabling more natural and intuitive gestures that match the spatial nature of light field displays.
Solution Approach 2:
The patent introduces an image acquisition device as an intermediary to capture user gestures and a processing system that converts these gestures into corresponding virtual object operations. This intermediary layer bridges the physical gesture space and the virtual interaction space, enabling accurate gesture recognition and mapping.
2Measurement precision
If gesture recognition is added to light field displays, then interaction accuracy improves, but system complexity increases
Solution Approach 1:
The patent replaces complex mechanical gesture detection systems with vision-based detection using image acquisition devices. Optical fields capture hand gestures and the processing system extracts gesture information through image analysis, avoiding the need for mechanical sensors while achieving high precision gesture recognition.
Solution Approach 2:
The patent creates a virtual copy of the user's hand gestures in the three-dimensional display space. The image acquisition device captures the gesture, the processing system analyzes it, and a corresponding virtual gesture is generated in the light field, enabling accurate mapping between physical and virtual interaction spaces.
3Ease of operation
If spatial interaction is implemented, then user engagement improves, but operation complexity increases
Solution Approach 1:
The patent enables the system to automatically establish coordinate mappings between the physical gesture space and the virtual display space. The processing system self-adapts to different viewing positions and automatically calibrates the coordinate transformation, eliminating the need for manual configuration and reducing operational complexity for users.
Solution Approach 2:
The patent dynamically adjusts interaction parameters such as virtual object size, position, and depth based on the user's viewing distance and angle. The system monitors spatial parameters and automatically modifies interaction characteristics to maintain optimal usability across different viewing conditions, making the interaction intuitive without requiring user awareness of underlying complexity.
Data Source
AI summary
Provided in the present invention are an interaction method and apparatus for a light field display, and a light field display system. The method includes: establishing a virtual object on a three-dimensional interaction interface, which is displayed by a target light field display, so as to map an interaction gesture of a user for the three-dimensional interaction interface; identifying the interaction gesture of the user for the three-dimensional interaction interface, and mapping the interaction gesture to the virtual object, so as to perform, on a target object in the three-dimensional interaction interface, an interaction operation corresponding to the interaction gesture; and adjusting the display content of the three-dimensional interaction interface on the basis of the interaction operation.