Hand-Drawn Query Recognition in Head-Mounted Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face difficulties in efficiently searching and sharing hand-drawn information stored on digital devices, as existing digital devices lack effective methods to recognize and process partial hand-drawn data for retrieving complete information.
Innovation Solution
A digital image processing apparatus and system that includes an image sensor unit to sense hand-drawn information, a display unit to show complete information, and a communication unit to transmit selected information with a sharing attribute marker, allowing users to search and share complete information by linking hand-drawn markers with stored data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users search for complete information stored in digital devices using remembered partial information, then information sharing becomes possible, but the search process requires a lot of time and is inconvenient
Solution Approach 1:
The system performs preliminary actions by automatically extracting features from complete stored information and creating searchable indexes in advance. When users provide partial hand-drawn queries, the system uses these pre-processed indexes to rapidly match and retrieve complete information, eliminating the need for time-consuming manual search through all stored data.
Solution Approach 2:
The patent introduces an intermediary feature extraction and matching mechanism that translates hand-drawn partial information into digital feature representations. This intermediary layer enables automatic comparison between user queries and stored information, significantly reducing search time and improving ease of operation.
2Adaptability or versatility
If digital devices store hand-drawn information to provide portability and easier correction, then information can be stored and corrected, but users still prefer hand-drawn information from notebooks for sense of writing that digital devices cannot provide
Solution Approach 1:
The system merges the advantages of digital storage with the tactile satisfaction of hand-drawing by capturing hand-drawn input through image sensors, processing it to retrieve complete digital information, and displaying results that combine both the original hand-drawn query and the retrieved complete information. This integration allows users to maintain the writing experience while gaining digital portability benefits.
3Productivity
If the system senses hand-drawn partial information and searches for complete information, then information retrieval efficiency improves, but the system complexity increases
Solution Approach 1:
The system segments the complex information retrieval task into distinct modular components: image sensing module for capturing hand-drawn input, feature extraction module for processing visual data, information matching module for retrieving complete data, and display module for presenting results. This segmentation allows each component to be optimized independently and simplifies overall system maintenance.
Data Source
AI summary
A head mounted display (HMD) can include a memory, a camera, an image sensor unit configured to sense hand-drawn information via the camera, a display unit configured to display the sensed hand-drawn information or at least one of complete information including the sensed hand-drawn information, the sensed hand-drawn information being partial information, a communication unit, and a controller configured to display the at least one of complete information including the sensed hand-drawn information by accessing the memory or a server.