AR Gaze Detection via Pupil Sensing and Image Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality technologies lack the ability to accurately detect and display information related to objects or text a user is gazing at, and fail to share this information seamlessly with other devices, limiting their utility and user satisfaction.
Innovation Solution
A device and system that incorporates a display module, sensing module, biosensors, and a control module to detect a user's gaze coordinates, extract and display relevant information as AR content, and share it with other devices, using image processing and wireless communication to enhance user interaction with the real world.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If augmented reality technology is implemented without accurate gaze detection, then the system structure remains simple, but the ability to detect and display information related to user gaze is poor
Solution Approach 1:
The patent combines multiple sensing modules (pupil sensing module, motion sensing module, image sensing module) and processing modules (gaze coordinate generator, gaze duration detector, image processing controller, divided block processor) into an integrated AR device system. This merging enables accurate gaze detection by coordinating multiple sensors and processors working together, resolving the contradiction between measurement precision and device complexity.
Solution Approach 2:
The AR device is designed with multi-functional capabilities including gaze detection, motion detection, image capture, image processing, and AR content display. The control module coordinates multiple sensing and processing functions within a single device, allowing the system to perform various tasks (detection, processing, display, sharing) without requiring separate dedicated devices, thus managing complexity while enhancing gaze detection accuracy.
2Adaptability or versatility
If gaze detection and AR content display functionality is added, then user interaction capability is improved, but the device complexity increases
Solution Approach 1:
The AR device integrates multiple functions including gaze detection via pupil sensing, motion detection for interaction control, image capture, image processing to extract objects and text, and AR content display. This multi-functional design enhances user interaction capability while consolidating components into a single device rather than requiring multiple separate systems.
Solution Approach 2:
The device functionality is segmented into distinct modules: pupil sensing module for gaze detection, motion sensing module for interaction control, image sensing module for capturing scenes, gaze coordinate generator for processing gaze data, gaze duration detector for determining gaze stability, image processing controller for extracting objects and text, divided block processor for analyzing image blocks, and display module for showing AR content. This segmentation allows each module to be optimized independently while working together to provide versatile user interaction.
3Adaptability or versatility
If information sharing with other devices is implemented, then the utility and user satisfaction are improved, but the device complexity and communication requirements increase
Solution Approach 1:
The patent introduces a communication module that acts as an intermediary for information sharing between the AR device and other devices. This module handles the complexity of wireless communication protocols and data transmission, allowing the AR device to share detected information (objects, text, gaze data) and receive information from external devices without requiring the main processing systems to directly manage communication complexity.
4Measurement precision
If multiple sensing modules and processing controllers are added for accurate gaze detection, then gaze detection accuracy is improved, but the device complexity increases
Solution Approach 1:
The patent merges multiple sensing functions (pupil sensing, motion sensing, image sensing) and processing functions (gaze coordinate generation, gaze duration detection, image processing, block division) into an integrated AR device system. This consolidation enables accurate gaze detection through coordinated operation of multiple sensors and processors while managing system complexity through unified control architecture.
Solution Approach 2:
The sensing and processing system is divided into specialized modules: pupil sensing module for detecting pupil position, motion sensing module for detecting head and eye movements, image sensing module for capturing visual scenes, gaze coordinate generator for converting pupil data to gaze coordinates, gaze duration detector for determining how long the user gazes at a target, image processing controller for extracting objects and text from images, and divided block processor for analyzing image blocks. This segmentation allows each module to be optimized for its specific function while working together to achieve high gaze detection accuracy.
Data Source
AI summary
A device for providing augmented reality (AR) that can accurately detect an object or a text at which a user gazes, and can display an image associated with the detected object or text, and a system for providing AR using the same, and may include at least one display module configured to display an AR content image through a transparent lens, a sensing module configured to generate signals indicative of movement in left, right, up, and down directions, and to generate image data corresponding to a user's gaze direction, a biosensor configured to detect a user's pupil to output a pupil sensing signal, and a control module configured to detect gaze coordinate information based on the pupil sensing signal, and to extract an object or a text corresponding to the gaze coordinate information from the image data to generate AR content data including the extracted object or text.