AR Headset Pen Motion Tracking via Integrated Sensing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality technologies lack the ability to accurately recognize and integrate motion information from writing tools like electronic pens, limiting their usability and display quality in real-world applications.
Innovation Solution
An augmented reality device comprising a transparent lens, a support frame, a display module, a sensing module, and a control module that detects motion information from an electronic pen, superimposes it onto augmented reality content, and synchronizes with user gaze points to provide accurate and reliable motion tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional augmented reality display technology is used, then basic AR display function is achieved, but the ability to accurately recognize and integrate motion information from writing tools is lacking
Solution Approach 1:
The AR device integrates multiple sensing capabilities (image sensor, depth sensor, biosensor) into a unified system that can detect various types of input including writing tool motion, gaze direction, and hand gestures. The control module processes diverse data types (image data, depth data, biosensor data) through a common architecture, enabling the system to adapt to different interaction modes while maintaining high measurement precision for each specific input type.
2Ease of operation
If motion information from electronic pen is integrated into AR content, then usability is enhanced, but system complexity increases due to multiple sensing and processing requirements
Solution Approach 1:
The patent combines multiple sensing functions into an integrated sensing module that includes image sensors, depth sensors, and biosensors working together. The control module merges data from these different sensors with AR content data, processing them through a unified control architecture. This merging approach enhances usability by providing comprehensive motion tracking while managing system complexity through integrated design rather than separate independent systems.
Solution Approach 2:
The control module acts as an intermediary that receives data from multiple sensing modules, processes this information, and integrates it with AR content. It mediates between the raw sensor data (image data, depth data, biosensor data) and the final AR display output, coordinating the interaction between writing tool motion detection and AR content modification without requiring direct complex connections between all components.
3Measurement precision
If multiple sensing modules are added to detect writing tool motion, then measurement precision improves, but device complexity and cost increase
Solution Approach 1:
The sensing system is segmented into specialized modules: image sensors for visual detection, depth sensors for spatial measurement, and biosensors for gaze tracking. Each segment is optimized for its specific function, allowing high measurement precision in motion detection while managing overall device complexity through modular architecture. The control module coordinates these segmented sensing functions without requiring a fully integrated monolithic system.
Data Source
AI summary
The present disclosure relates to a device for providing augmented reality that can accurately recognize a writing tool such as an electronic pen to realize motion information of the writing tool over augmented reality contents, and a method for providing augmented reality using the same. According to some embodiments of the disclosure, an augmented reality device includes at least one transparent lens, a support frame supporting the at least one transparent lens, at least one display module configured to display augmented reality contents through the at least one transparent lens, a sensing module at a front of the support frame, and configured to generate image data, and a control module configured to receive motion-sensing signals of an electronic pen to detect motion information of the electronic pen, and configured to modulate the augmented reality contents so that the motion information of the electronic pen is includes therein.