VR Headset Eye Tracking Voice Tagging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality (VR) products primarily focus on visual experiences, neglecting audio and voice interaction, which limits the immersive experience and fails to effectively track user pupil movement.
Innovation Solution
An eye tracking virtual reality device that incorporates both voice and eye tracking technology, using cameras both inside and outside the headset to track user movement and focus points, allowing for audio tagging of objects in the virtual environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If cameras are used to track user movement in VR headsets, then visual immersion is improved, but audio and voice interaction are neglected
Solution Approach 1:
The patent combines visual tracking (cameras), audio tracking (microphones), and eye tracking (pupil detection) into a unified system. The processing unit integrates data from multiple sensors to simultaneously track user gaze, audio signals, and spatial position, enabling both visual immersion and audio-voice interaction to coexist without compromising either aspect.
2Ease of operation
If controllers are used to move around the virtual world, then navigation is achieved, but hand handling is required which limits accessibility
Solution Approach 1:
The patent replaces the mechanical controller system with a non-contactless interaction system based on eye tracking and audio recognition. The processing unit detects pupil convergence points to determine focus of attention and uses audio signals to identify intended actions, eliminating the need for physical hand handling while maintaining navigation capability and improving accessibility.
3Device complexity
If only one type of tracking is used, then device complexity is reduced, but measurement precision of user focus point is insufficient
Solution Approach 1:
The patent merges multiple tracking technologies (eye tracking via pupil detection, audio tracking via microphone arrays, and positional tracking via cameras) into an integrated system. The processing unit fuses data from all sensors to calculate the user's focus point with high precision, achieving more accurate results than any single tracking method could provide alone.
4Adaptability or versatility
If audio recording is added to VR experience, then voice interaction capability is improved, but system complexity increases
Solution Approach 1:
The patent integrates audio tracking components (microphones) with existing visual tracking systems (cameras and processing units). The processing unit handles both audio signal processing and visual data processing through a unified architecture, managing the increased complexity through efficient multi-sensor data fusion rather than adding separate independent systems.
Data Source
AI summary
The invention relates to a virtual reality device (1) for including voice as a tool to add value and extra layer of information to the virtual environment comprises at least one image acquisition unit (1.1) for recording the environment and for augmenting into the virtual world and the real-world environment in the outside of the device (1), at least one speaker (1.6) for listening the tagged items, at least one strap (1.8) in the predetermined length and thickness and at least one sensor (1.9) for calculating distance from the device (1) to the object user is looking at and focusing on, at least one inner image acquisition unit (1.1) for recording the eye movement and determine the convergence and meiosis of the object captured by the said outer image acquisition unit (1.1), at least one inner voice acquisition unit (1.2) for recording the audio in stereo from the user while tagging the object on the focus, at least one user interface (1.5) is controlled and navigated through voice mainly as well as a set of control element (1.7) to navigate the augmented environment, at least one control/calculating unit (1.3) for controlling and navigating through an user interface (1.5), at least one peripheral display (1.4.1) for maintaining the stereoscopic illusion connected with at least one display adapter (1.4) is responsible for 0 displaying all the graphics and calculating the geometries and it communicate with the central processing unit (1.3.3) through the system bus and then output to the displays (1.4.1) of the device (1) which there is two of to create a stereoscopic image view of the world and also relates to an operating method (100).