Head-Mounted Display Gaze-Based Effects With 3D Spatial Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable devices, such as smart glasses, lack the ability to provide personalized and interactive augmented or virtual reality experiences based on user gaze points and spatial positioning, limiting their effectiveness in providing relevant visual content.
Innovation Solution
A head-mounted display device equipped with a gaze sensor, position sensor, camera, and communication circuitry that acquires 3D segmentation information and gaze point-based interest data to display personalized visual effects on a display, adjusting content based on user gaze points and spatial positioning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If wearable devices provide basic display functions, then device simplicity is maintained, but user engagement and interaction effectiveness are insufficient
Solution Approach 1:
The display content dynamically changes based on real-time gaze direction and spatial position data. The system transitions from static display to dynamic adaptive display by continuously updating visual information according to user gaze points and spatial context, thereby improving user engagement without requiring complex manual controls
Solution Approach 2:
The system automatically adjusts display content based on gaze tracking and position sensing without requiring user input. The gaze sensor and position sensor autonomously collect data, process it through the processor, and generate appropriate visual effects, enabling the device to serve itself and reducing operational complexity
2Adaptability or versatility
If devices provide personalized content based on gaze points, then user interaction improves, but data processing complexity increases
Solution Approach 1:
The system segments the spatial environment into multiple regions using 3D segmentation algorithms. By dividing the space around the user into distinct zones based on gaze direction and position data, the system can provide personalized content to specific regions without processing the entire environment, thus reducing overall data processing complexity while maintaining personalization capability
Solution Approach 2:
Different visual effects are applied to different spatial regions based on local characteristics and user gaze patterns. The system analyzes local gaze distribution and spatial properties to generate region-specific content, providing personalized experience only where needed rather than uniformly throughout the entire display space
3Measurement precision
If multiple sensors are integrated for gaze and position detection, then interaction precision improves, but device complexity increases
Solution Approach 1:
The gaze sensor and position sensor data are merged and processed together by the processor to generate comprehensive spatial understanding. By combining multiple sensor inputs into a unified representation of user attention and location, the system achieves high measurement precision while managing complexity through integrated processing rather than separate independent systems
Data Source
AI summary
A head mounted display (HMD) device is provided. The HMD includes a display, a gaze sensor configured to detect a gaze direction of a user of the HMD device, a camera, a position sensor configured to detect a position of the HMD device, communication circuitry, memory storing one or more computer programs, and one or more processors communicatively coupled to the display, the gaze sensor, the camera, the position sensor, the communication circuitry, and the memory, wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the HMD device to, based on the position of the HMD device, acquire three-dimensional (3D) segmentation information for a space corresponding to the position of the HMD device, acquire gaze point-based interest information corresponding to a profile of the user, the gaze point-based interest information including interest information generated based on gaze points of a plurality of users, display, on the display, a first visual effect for a plurality of regions in the space based on the 3D segmentation information and the interest information, and display, on the display, a second visual effect for a plurality of objects in a first region among the plurality of regions based on the 3D segmentation information and the interest information when the position of the HMD device corresponds to the first region.