Augmented Reality Writing System Using Optical Sensor Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for capturing and recording handwriting or drawing input require expensive digitized pens or touch-enabled displays, which limit user interaction and privacy, and often modify the physical surface with ink, while failing to provide an augmented reality experience.
Innovation Solution
A system and method for augmented reality writing that uses a handheld transparent display with an optical sensor and processing unit to recognize handwriting or drawing motions, rendering the input digitally on the display without ink, allowing writing on any surface while maintaining the physical integrity of the surface and providing an augmented reality experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If expensive digitized pens or touch-enabled displays are used to capture handwriting input, then handwriting recognition capability is improved, but device cost and complexity increase
Solution Approach 1:
The patent uses a camera to capture images of the writing surface and creates a digital copy of the handwriting. Instead of requiring specialized digitized pens or touch displays, the system photographs the physical writing and uses image processing to recognize and digitize the handwriting, thereby achieving handwriting recognition without complex specialized input devices
Solution Approach 2:
The patent replaces the mechanical system of digitized pens with sensors, capacitive sensors, or optical sensors with a camera-based imaging system. The camera captures visual information of the handwriting on the surface, and image processing algorithms extract handwriting features, substituting complex mechanical input devices with simpler optical capture and computational processing
2Loss of information
If ink is used to write on physical surfaces, then handwriting input is captured, but the physical surface is modified and privacy is compromised
Solution Approach 1:
The system creates a digital copy of the handwriting through camera imaging rather than requiring permanent ink marks. The captured images can be processed, stored, and transmitted without permanently altering the physical surface, and the digital copies can be selectively shared or kept private
Solution Approach 2:
The patent enables temporary handwriting input where the physical surface remains unmodified. The handwriting is captured through imaging, processed into digital form, and then the physical surface can be easily cleaned or reused without permanent marks, while the digital information is preserved for storage or transmission
3Adaptability or versatility
If traditional handwriting methods are used, then writing on any surface is possible, but augmented reality experience and immediate digital visualization are not provided
Solution Approach 1:
The patent merges the physical writing experience with digital augmented reality visualization. The camera captures the physical writing surface, and the processed handwriting information is overlaid or displayed digitally through the device's display, creating an augmented reality experience that combines physical adaptability with digital enhancement
Solution Approach 2:
The patent introduces a camera and processing system as an intermediary between the physical writing surface and the digital display. This intermediary captures the physical handwriting, processes it through image recognition, and generates the augmented reality digital visualization, enabling both physical surface flexibility and digital enhancement
Data Source
AI summary
Embodiments of the present invention disclose an augmented reality writing system and method thereof. According to one example embodiment, the system includes a handheld writing tool having an end portion and a display device for displaying digital content for viewing by an operating user. An optical sensor is coupled to the display device and includes a field of view facing away from the operating user. Furthermore, coupled to the optical sensor is a processing unit configured to detect and track the position of the end portion of the handwriting tool. In accordance therewith, handwritten content is digitally rendered on the display device to correspond with the handwriting motion of the writing tool within the field of view of the optical sensor.