3D Display Hand Mapping Using Head and Motion Controller Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D display technologies, particularly non-glasses type displays, face challenges in accurately mapping user interactions and hand movements within virtual reality content without the need for additional hardware like glasses, limiting the immersive experience.
Innovation Solution
A display apparatus equipped with cameras and motion controllers that identify user hand positions and movements, adjusting virtual representations based on head and hand coordinates, and utilizing light field technology for 3D imaging, enabling accurate mapping of user interactions in virtual reality without glasses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If non-glasses type 3D display is used, then user convenience is improved, but interaction accuracy deteriorates
Solution Approach 1:
The patent introduces motion controllers as intermediary devices that users grip to enable precise interaction. These controllers serve as mediators between the user's physical movements and the virtual reality environment, allowing accurate hand position and movement tracking without requiring special glasses or head-mounted displays. The controllers transmit motion information back to the display apparatus, enabling precise mapping of user interactions.
Solution Approach 2:
The patent replaces traditional mechanical 3D display methods (such as stereoscopic glasses or complex optical systems) with an electronic and optical sensing system. Instead of using mechanical means to create 3D effects, the system uses cameras and motion sensors to detect user positions and movements, then renders 3D content accordingly. This substitution enables both convenience and precision by using electronic sensing rather than mechanical optical components.
2Measurement precision
If head and hand position tracking is implemented, then interaction precision is improved, but device complexity increases
Solution Approach 1:
The patent makes the display apparatus multi-functional by integrating multiple capabilities into a single system. The display apparatus simultaneously performs display functions, camera-based head position tracking, and motion controller interaction tracking. By making the system universal and multi-functional, the patent avoids the need for separate dedicated devices for each function, thereby managing complexity while achieving high interaction precision.
Solution Approach 2:
The system employs self-service mechanisms where the display apparatus automatically tracks and processes user position and movement data without requiring external processing equipment. The apparatus captures images, identifies head positions, receives motion information from controllers, and maps these to virtual representations automatically. This self-service approach reduces the need for additional external devices and simplifies the overall system architecture.
3Adaptability or versatility
If virtual representation mapping is enhanced, then user engagement is improved, but processing requirements increase
Solution Approach 1:
The patent implements partial mapping where virtual representations of hands and motion controllers are displayed selectively rather than comprehensively mapping all physical elements. The system focuses on mapping critical interaction elements (hands and controllers) while potentially omitting less critical body parts or environmental elements. This partial action approach maintains high user engagement through accurate hand tracking while reducing overall processing requirements compared to complete full-body tracking and environmental mapping.
Data Source
AI summary
A display apparatus, includes: a display; a communication interface; a camera; a processor; and memory storing instructions that, when executed by the processor, cause the display apparatus to: display a motion guide including a pre-set pose through the display; identify a position of a head of a user based on an image obtained through the camera; identify a first distance from the display apparatus to the position of the head; identify a pre-set point of a spine based on a pre-set second distance in a downward direction from the position of the head; identify a first position of both hands of the user corresponding to the pre-set pose based on distance information from at least one from among a plurality of motion controllers gripped by both of the hands through the communication interface; and display representations of both of the hands based on the first position.