3D Interaction System Using Eye and Joint Tracking for Spatial Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current somatosensory interaction technologies are primarily limited to two-dimensional displays, and there is a need to integrate three-dimensional display technology with somatosensory interaction to enhance user interaction experiences in three-dimensional spaces.
Innovation Solution
An interaction system comprising an eye positioning device, a space positioning device, and a master control device that determines eye position, joint positions, and visual field spaces to generate corresponding three-dimensional image display signals, allowing users to interact with virtual objects in a three-dimensional environment through precise action recognition and spatial division.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If three-dimensional display technology is integrated with somatosensory interaction, then user immersion and interaction capability are improved, but system complexity increases
Solution Approach 1:
The system divides the three-dimensional space into multiple functional regions including visual field space, interaction space, absolute interaction space, and relative interaction space. This spatial segmentation allows different interaction modes to be applied to different regions, enabling complex 3D interaction capabilities while managing system complexity through modular spatial organization.
Solution Approach 2:
The patent extends traditional two-dimensional somatosensory interaction into three-dimensional space by adding depth and spatial positioning dimensions. Eye positioning devices and space positioning devices track user position in 3D space, enabling natural hand and body interactions with virtual objects in a three-dimensional environment, thereby significantly improving interaction capability.
2Measurement precision
If eye positioning and space positioning devices are used to determine visual field and interaction spaces, then interaction precision is improved, but device complexity increases
Solution Approach 1:
The master control device serves as an intermediary that receives positioning data from eye positioning devices and space positioning devices, then processes this information to determine visual field space and interaction space. This intermediary processing approach enables precise spatial measurement and interaction region determination while managing device complexity through centralized coordination.
Solution Approach 2:
The system replaces complex mechanical positioning systems with optical and electromagnetic sensing technologies. Eye positioning devices use optical methods to track eye position and determine visual field space, while space positioning devices use electromagnetic fields or optical fields to track joint positions in three-dimensional space, achieving high measurement precision with reduced mechanical complexity.
Data Source
AI summary
The present disclosure provides an interaction system of three-dimensional space and a method for operating the same, comprising: determining visual field space according to an eye position of an operator and an angle at which the eye is watching, and determining absolute interaction space and relative interaction space according to respective joint positions of the operator and the visual field space, thereby achieving dividing of areas of the space; determining an operation that matches a current action and needs to be performed by the operator on a selected virtual object according to a relationship among the current action of the operator, the virtual object viewed by the operator and the absolute interaction space, such that when the operator makes the corresponding action, the operation matching the action of the operator is performed on the virtual object; outputting the generated corresponding three-dimensional image display signal to a three-dimensional image display device to complete somatosensory interaction of the three-dimensional space.