Wearable AR Form Completion via Hover Input

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The process of filling out physical documents is inefficient due to the need to manually retrieve and enter data from various sources, lacking effective assistance for users, especially those with vision impairments.

Innovation Solution

A wearable electronic device with augmented reality (AR) capabilities, including a camera and output sources, captures images of physical forms, analyzes fields, retrieves information, and provides auditory and visual cues to assist users in completing the forms, using hover inputs and tracking data to guide users through the form-filling process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a user manually retrieves and enters data from various sources to complete a physical form, then the form can be filled out, but the process is inefficient and time-consuming

Engineering Contradiction:

Improveform completion efficiencyVSAvoidtime required for data entry

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing images of the physical form and pre-retrieving relevant information from various data sources before the user needs to enter data. The wearable device stores this information and makes it readily available when the user hovers over form fields, eliminating the need for manual data retrieval during the filling process.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The wearable electronic device acts as an intermediary between the user and the data entry process. It captures form images, retrieves information from multiple sources, and presents the relevant data to the user through audio and visual outputs, mediating the complex process of data gathering and form completion.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If a user manually fills out a physical form without assistance, then the form can be completed, but users with vision impairments face significant difficulties

Engineering Contradiction:

Improveaccessibility for vision-impaired usersVSAvoidability to locate and read form fields

Core Design Contradiction:

Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The system replaces the mechanical visual process of reading form fields with acoustic and haptic feedback mechanisms. The wearable device uses audio outputs to read form field labels and provide navigation guidance, and haptic feedback to indicate when a user is hovering over the correct field, substituting visual detection with non-visual sensing methods.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system implements continuous feedback to guide users with vision impairments. The wearable device provides audio feedback reading form field labels, haptic feedback when hovering over fields, and directional feedback to guide users to the next field to complete, creating a closed-loop system that adapts to the user's progress and needs.

Inventive Principle:

Principle #23Feedback

3Ease of operation

If a wearable device provides comprehensive audio and visual cues for form filling, then accessibility is improved, but device complexity increases

Engineering Contradiction:

Improveuser guidance and assistanceVSAvoidsystem components and processing requirements

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The wearable electronic device performs multiple functions within a single integrated system: capturing form images, retrieving information from data sources, generating audio outputs, providing haptic feedback, and tracking user interactions. This multi-functionality reduces the need for separate devices and simplifies the overall system architecture while maintaining comprehensive assistance capabilities.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS20220121808A1Augmented reality assisted physical form completion

Publication Date: 2022.04.21 GOOGLE LLC

AI summary

Systems and methods are described for receiving, at a wearable electronic device, a cue to trigger a form-filling mode in which the wearable electronic device includes memory, at least one camera and the at least one processing device. Responsive to receiving the cue, the systems and methods may trigger the at least one camera to capture an image of a physical form where the physical form includes a plurality of fields, and wherein the wearable electronic device uses the image to analyze the plurality of fields, obtain information to complete said fields. The systems and methods may also include detecting a hover input over a respective blank field in the plurality of fields, retrieving, based on the respective blank field and the stored information, a portion of the stored information to fill in the respective blank field, and providing, by the wearable device, the retrieved portion.