Hand Cueing Input System for Intuitive Digital Drawing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Artists and hobbyists face challenges using software drawing programs on computers, as they require advanced training, expensive hardware, and often produce lower quality work compared to traditional hand-drawn art, while also finding it difficult to input drawings and text efficiently on small portable devices.
Innovation Solution
A hand cueing input system that allows users to input drawings and text directly onto a computer display, enabling real-time, intuitive interaction by matching hand movements with on-screen cues, providing an ergonomic and enjoyable experience through a combination of physical and virtual interfaces, including video cameras, mirrors, and tactile feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If artists use software drawing programs on computers, then digital drawings can be created and stored, but the learning curve is steep requiring advanced training and the hardware is expensive
Solution Approach 1:
The patent creates a visual copy of the artist's hands and drawing tools on the computer display, allowing artists to see their physical drawing actions replicated digitally. This copying approach eliminates the need to learn complex software interfaces while maintaining digital drawing capabilities, as artists simply draw on the display surface itself rather than learning software commands.
Solution Approach 2:
The patent replaces complex software mechanical systems with direct optical-mechanical interaction. Instead of using software programs that require learning curves, the system uses a camera to capture hand movements and a display to show real-time feedback, substituting software complexity with straightforward optical capture and display mechanisms.
2Ease of operation
If artists use traditional drawing methods on paper, then drawing quality and intuitiveness are maintained, but digital transmission and storage become difficult
Solution Approach 1:
The patent merges traditional paper drawing with digital technology by placing the display surface directly where the artist draws. The drawing surface combines the tactile experience of traditional drawing with digital capture capabilities, merging the physical act of drawing with immediate digital transmission and storage without requiring separate scanning or photographing steps.
Solution Approach 2:
The patent introduces a camera as an intermediary device that captures the drawing process in real-time. This intermediary automatically transmits the visual information to the display, eliminating the manual step of digitizing traditional drawings while maintaining the natural drawing experience on paper-like surfaces.
3Weight of moving object
If portable devices have small keyboards, then device portability is improved, but text input becomes inefficient requiring hunt and peck method
Solution Approach 1:
The patent transitions from one-dimensional keyboard typing to two-dimensional direct writing on the display surface. Instead of pressing keys in a limited keyboard layout, users can write text naturally in any direction and size on the full display area, converting the constrained keyboard interaction into open-space digital ink interaction that maintains portability while dramatically improving text input efficiency.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables efficient, accurate, and ergonomic input of drawings and text on computers, allowing users to see their hands and tools on the screen, improving performance and reducing cognitive load, while maintaining a comfortable and intuitive drawing experience similar to traditional methods.
Implementation Method 1
a video camera aimed and focused over the drawing tablet so that a relative locations of the drawing, the user's hands
Data Source
AI summary
An input cueing system and method that allows a user to manually draw an image, input text, interface and gesture on an input surface, which is then brought into a computer such that the visual output from the computer is combined in an overlapping manner with the visual imagery of the user's hands, and then shown on a display. Located above the drawing surface is an image capturing device that captures live video images of the user's hands or other objects placed on the drawing surface. One or more reflectors and/or image repeating devices are disposed between the input surface and the image capturing device to effectively reduce the height and/or focal length so that the visual image is properly aligned and oriented to provide a real ‘live’ view of the users hands and/or action on the display. A combiner module combine the visual action on and/or about the input surface with the visual output from a computer or computing device, so that the resulting combined visual imagery may be simultaneously transmitted and on a display, with the users hands, fingers and/or tools shown in a semi-transparent and/or opaque manner.