3D Input System Using Tracking Marks for Mid-Air Drawing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional digital pens require a touch-sensitive surface to track user hand movements, limiting their ability to create large or three-dimensional drawings, as they are not suitable for drawing on any surface or in three-dimensional spaces without a large and expensive touch-sensitive surface.
Innovation Solution
A 3D input system comprising a pen with distinct tracking marks, a digital video camera, and a computer algorithm that calculates the pen's three-dimensional positions and orientations in real-time, allowing users to draw on any surface or in three-dimensional space by processing images of the pen's tracking marks to determine its position and generate drawing strokes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a touch-sensitive surface is used to track digital pen movements, then tracking accuracy is improved, but the device becomes limited to drawing only on the surface area and requires expensive large surfaces for large drawings
Solution Approach 1:
The patent replaces the mechanical touch-sensitive surface system with an optical tracking system. Instead of requiring physical contact with a specialized surface, the system uses a camera to capture images of tracking marks on the pen and calculates 3D position through image processing and geometric algorithms, enabling drawing in mid-air and on any surface without physical contact constraints
Solution Approach 2:
The patent transitions from 2D touch surface tracking to 3D spatial tracking by adding depth information through stereoscopic camera techniques. The system calculates three-dimensional coordinates (X, Y, Z) of the pen tip by processing images from multiple camera viewpoints, enabling drawings in three-dimensional space rather than confined to a flat surface
2Area of stationary object
If a large touch-sensitive surface is used for large drawings, then drawing area is increased, but device cost and complexity increase significantly
Solution Approach 1:
The patent makes the drawing system universal by removing the requirement for a specialized large touch surface. The same camera-based tracking system works for both small and large drawings, and supports drawing on any surface or in mid-air, eliminating the need to scale up hardware infrastructure with drawing size requirements
Solution Approach 2:
The patent uses optical copying techniques where the camera captures images of the tracking marks on the pen, and the system reconstructs the 3D position and drawing trajectory from these optical copies. This allows the system to track pen movements over large spatial ranges without requiring physically large tracking surfaces
3Device complexity
If conventional digital pens are used without tracking marks, then device simplicity is maintained, but 3D position calculation becomes impossible
Solution Approach 1:
The patent uses distinct colored or patterned tracking marks on the pen that are easily distinguishable by the camera system. These high-contrast visual features enable accurate detection and identification of the pen's tracking marks in images, providing reliable reference points for 3D position calculation without significantly complicating the pen structure
Data Source
AI summary
The present disclosure generally relates to a new computer input and tracking device, and method of using, more particularly, a new type of digital pen which tracks user hand movements to generate series of point coordinates that represent a drawing or hand writing. Unlike prior digital pens such as the Apple Pencil™ or the Microsoft Surface Pen™, the new system does not require users to write on a touch-sensitive surface. Users can write on any surface such as a notebook, a table, a board, or even in mid air. Users can draw two-dimensional or three-dimensional drawings. The new method utilizes a pen marked with one or more groups of distinct tracking marks or tracking patterns and a camera to track the pen in real-time. A computer running a 3D algorithm processes the camera images, detects and distinguishes the tracking marks, and uses the tracking marks to calculate the positions of the tip of the pen in three-dimensional space. The positions of the tips of the pen are then sent to a drawing application to generate a drawing or hand writing.