Digital Handwriting Device Using Projection and IMU Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional electronic input systems for mobile devices, such as touch-sensitive screens and transducer systems, often provide an inconvenient and inefficient experience for extended note-taking and drawing due to screen size limitations and other user interface restrictions, leading users to prefer traditional handwriting methods.
Innovation Solution
A digital handwriting system using an electronic device equipped with a projector and sensors that projects content onto a surface, captures touch events with an accessory, and updates the projected content in real-time based on movement tracking data, allowing for a more comfortable and efficient note-taking and drawing experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a touch-sensitive screen is used for note-taking, then digital functionality is provided, but screen size limitations reduce user comfort and efficiency
Solution Approach 1:
The patent transitions from two-dimensional screen interaction to three-dimensional spatial interaction by projecting the interface onto a vertical surface (whiteboard, wall, or table). This dimensional change allows users to write and interact at a comfortable distance, eliminating the confinement of small screen boundaries while maintaining full digital functionality.
Solution Approach 2:
The patent introduces a camera as an intermediary device that captures images of handwriting on the projected surface and converts it into digital signals. This mediator enables the translation of physical handwriting movements into digital format without requiring direct contact with the screen, thus preserving the natural handwriting experience while providing digital capabilities.
2Ease of operation
If a traditional pen and paper method is used, then user comfort is improved, but digital functionality and flexibility are lost
Solution Approach 1:
The patent uses the camera to capture an optical copy of the handwriting performed on the projected surface. This copying mechanism replicates the physical writing action in digital form, allowing users to enjoy the comfort of traditional handwriting while simultaneously creating editable, searchable, and shareable digital content.
Solution Approach 2:
The system enables the writing surface to serve multiple functions: it acts as both a physical surface for comfortable handwriting and a digital interface for electronic interaction. The projected content can be annotated, edited, saved, and shared digitally, while the physical surface provides the familiar handwriting experience.
3Ease of operation
If the writing surface is extended beyond the screen, then note-taking comfort is improved, but positioning accuracy becomes difficult to maintain
Solution Approach 1:
The system employs real-time feedback by capturing images of the projected surface with the camera, analyzing the handwriting position and movement, and mapping it back to the corresponding digital coordinates. This continuous feedback loop ensures that even as the writing surface extends beyond the screen boundaries, the system maintains accurate positioning and responsiveness of the digital content.
4Area of stationary object
If screen size is increased to improve note-taking experience, then user comfort is improved, but device portability and compactness are reduced
Solution Approach 1:
The patent extracts the writing surface from the physical device boundaries by projecting it onto external surfaces such as whiteboards, walls, or tables. This extraction allows the writing area to extend indefinitely without increasing the device size, maintaining portability while providing a large-format writing experience.
Data Source
AI summary
A digital handwriting system that includes an electronic device and a method of using the same. The present disclosure teaches a method that includes identifying content stored on the electronic device to be projected onto a surface; identifying occurrence of a touch event of an accessory; capturing an image of the touch event to determine initial position data indicating an initial position of the accessory relative to the projected content; receiving movement tracking data indicating movement of the accessory; and updating the content using the initial position data and the movement tracking data. Various embodiments may further include using an inertial movement unit (IMU) disposed in an electronic accessory for determining movement tracking data of the accessory. Moreover, updating the content may include updating the projected content in real-time.