AR Auto-Complete Engine Scanning Document Views

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality devices face challenges in processing and rendering views that include computing devices, leading to inadequate auto-complete functionality, security concerns with system-level software, and limited functionality in mixed-media applications, which hinders meaningful interaction with other computing systems.

Innovation Solution

The augmented-reality auto-complete engine (ARACE) scans a real-world environment, transfers the view to a secondary computing device for processing, and provides auto-complete suggestions without modifying underlying code, ensuring consistency and increased privacy by leveraging image processing and natural language analysis to identify and complete document segments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If augmented reality device processes and renders views including computing devices, then auto-complete functionality is provided, but device complexity and processing requirements increase

Engineering Contradiction:
Improveauto-complete functionalityVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary processing system that acts as a mediator between the augmented reality device and the computing device. The intermediary captures images from the AR device, processes them to identify document content and incomplete portions, and generates auto-complete suggestions. This separates the complex processing tasks from the AR device itself, reducing its computational burden while maintaining the auto-complete functionality.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If system-level software is used for auto-complete, then functionality is integrated, but security risks increase in public computing environments

Engineering Contradiction:
Improveintegration capabilityVSAvoidsecurity risks
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent employs a copying mechanism where the system captures an image of the document displayed on the computing device screen and processes this visual copy rather than directly accessing or storing the underlying data. The auto-complete suggestions are generated based on analyzing the visual representation of the text, not by reading or storing the actual document files. This approach provides functionality while maintaining security, as no sensitive data is extracted or stored from the public computing device.

Inventive Principle:
Principle #26Copying

3Productivity

If augmented reality device provides auto-complete suggestions, then productivity is improved, but loss of information privacy increases

Engineering Contradiction:
Improvedocument completion speedVSAvoiduser data privacy
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The intermediary processing system serves as a privacy-protecting mediator that temporarily holds and processes only the visual information needed for auto-complete suggestions. The system analyzes the captured image to identify incomplete document portions and generate suggestions, then immediately discards the processed information. No user data, documents, or personal information are stored or transmitted to external systems, thus maintaining privacy while improving productivity through rapid document completion.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11574467B2Document augmented auto complete
Publication Date: 2023.02.07 KYNDRYL INC
  • US11574467B2 patent drawing
  • US11574467B2 patent drawing
  • US11574467B2 patent drawing

AI summary

A field-of-view of a scene is scanned by an augmented reality device. The scene includes one or more objects including a first computing device. A portion of an electronic document is detected based on the scanned field-of-view. The portion of the electronic document is rendered on a display of the first computing device. A content element of the electronic document that is rendered on the display is captured. A second computing device determines an incomplete portion of the content element. A suggestion to complete the incomplete portion is provided by the augmented reality device.