AR Memo Overlay for Accurate Object Identification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional paper-based note taking methods face issues such as environmental damage, accuracy problems due to indoor GPS limitations, and risk of information leakage, and are unable to accurately identify objects for note-taking regardless of environment.
Innovation Solution
A memo processing device and system using augmented reality, equipped with a camera, keypoint extraction and matching algorithms, and a remote server for image captioning and storage, allowing users to film, attach, and view notes as overlays on specific subjects, reducing the need for physical notepads and enhancing security and accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If paper-based notepads are used for note taking, then notes can be attached to specific objects, but the notepad may cover parts of the object or damage the object
Solution Approach 1:
The patent uses augmented reality to create a digital copy of the note that is projected onto the object through the camera viewfinder, eliminating the need for physical notepads. The note is displayed as an overlay on the captured image, allowing users to attach notes to objects without physical contact that could cause coverage or damage.
2Ease of operation
If paper-based notepads are used for note taking, then notes can be created and viewed, but there is risk of information leakage to unspecified people
Solution Approach 1:
The note is displayed as a digital overlay only in the camera viewfinder of the specific device, creating a private viewing experience. The note content is not physically exposed and can only be viewed by the device holder, eliminating information leakage risks associated with physical notepads that can be seen by anyone nearby.
3Measurement precision
If GPS sensor data is used to identify location for note taking, then outdoor location can be identified, but the error range is around 10 meters making it difficult to identify specific objects
Solution Approach 1:
The patent replaces GPS-based location identification with camera-based visual recognition. Instead of relying on imprecise satellite positioning, the system uses the camera to capture images and identify specific objects through visual features, achieving precise object-level location identification regardless of whether the environment is indoor or outdoor.
4Productivity
If paper-based notepads are used, then notes can be taken, but environmental damage occurs due to paper consumption
Solution Approach 1:
The system creates digital copies of notes displayed through augmented reality overlay on the camera viewfinder, completely eliminating the need for physical paper notepads. Users can take, store, and view notes digitally without any paper consumption, thereby preventing environmental damage associated with paper production and disposal.
Data Source
AI summary
The disclosure relates to a memo processing device is configured to include a camera for filming videos, a memo acquisition unit for specifying a subject to which a memo is to be attached in the filmed video and storing the subject and the memo in a memory, and a memo presentation unit for displaying a memo stored in the memory as an overlay on a screen when the camera faces the subject. The memo processing device may be appropriately adopted by a portable terminal device such as a smartphone, or a mobile device of various kinds, such as Google Glass or a head-mounted display that is worn on the body, such as the head, as appropriate.