Augmented Reality Dynamic Plot Annotation System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional computing equipment is not suitable for worksites due to size constraints and limited usability, leading to inefficient paper plot management and data capture processes, which require frequent trips between work locations and temporary offices, resulting in inconvenience, labor intensity, and potential loss of information.

Innovation Solution

A dynamic paper plot with embedded metadata is created, allowing field workers to use a mobile appliance with a camera and display to capture and decode identifiers, overlay additional information using augmented reality, and annotate plots, enabling real-time data capture and sharing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional computing equipment (desktop/notebook computers) is used at worksites, then information access and processing capability is improved, but portability and ease of operation deteriorates due to size and environmental requirements

Engineering Contradiction:
Improveinformation access capabilityVSAvoidportability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system enables multiple functions to be performed using a single mobile computing device. The mobile device serves as both a display for paper plots and an interactive interface for accessing additional information, capturing field data, and updating CAD files, replacing the need for separate desktop computers and peripherals at the worksite.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system creates a digital copy of the paper plot information that can be accessed interactively on mobile devices. By linking paper plots to electronic CAD files and database records, the system allows workers to view and interact with digital representations of project data directly at the worksite location.

Inventive Principle:
Principle #26Copying

2Ease of operation

If paper plots are printed and carried to work locations, then information accessibility is improved, but efficiency deteriorates due to frequent trips to temporary office for additional information

Engineering Contradiction:
Improveinformation accessibilityVSAvoidwork efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system provides immediate feedback when workers interact with paper plots through mobile devices. By scanning barcodes or RFID tags on paper plots, workers instantly access additional information, project data, and CAD files without needing to return to the temporary office, creating a continuous information loop that eliminates unnecessary trips.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The mobile computing device acts as an intermediary between the paper plots and the comprehensive project information stored in CAD files and databases. It mediates the information gap by providing on-site access to detailed project data, eliminating the need for workers to travel between the worksite and temporary office for information retrieval.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If field data is captured manually (annotations, photographs, notes), then data collection capability is improved, but accuracy and reliability deteriorates due to manual transcription errors

Engineering Contradiction:
Improvedata collection capabilityVSAvoiddata accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system replaces manual mechanical processes (handwriting annotations, physical note-taking) with electronic data capture methods. Mobile devices with cameras, microphones, and digital annotation tools allow workers to capture field data electronically, which is then automatically stored and linked to the corresponding paper plots and CAD files, eliminating transcription errors.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service data capture where the mobile device automatically manages field data collection, storage, and linkage to project files. The device handles data organization, metadata association, and synchronization with CAD files automatically, reducing reliance on manual data management processes and improving data accuracy.

Inventive Principle:
Principle #25Self-service

4Loss of information

If paper plots with embedded identifiers are used, then information tracking is improved, but device complexity increases due to integration of metadata system

Engineering Contradiction:
Improveinformation trackingVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system segments information tracking into distinct layers: paper plots with embedded identifiers (barcodes, RFID tags), mobile computing devices for interaction, and backend CAD files/databases for storage. Each component handles a specific aspect of information tracking, simplifying the overall system architecture while maintaining comprehensive tracking capability.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS8405871B2Augmented reality dynamic plots techniques for producing and interacting in Augmented Reality with paper plots for which accompanying metadata is accessible
Publication Date: 2013.03.26 BENTLEY SYSTEMS INC
  • US8405871B2 patent drawing
  • US8405871B2 patent drawing
  • US8405871B2 patent drawing

AI summary

In one embodiment, a special paper plot (referred to herein as a dynamic plot) for which corresponding metadata is maintained is printed. A mobile appliance obtains corresponding metadata for the dynamic plot. A camera of the mobile appliance computes an image of the dynamic plot. A position of the camera of the mobile appliance with respect to the dynamic plot is calculated from the image of the dynamic plot. Using the calculated position, information or icons are overlaid at particular locations in the image captured by the camera of the dynamic plot. The image captured by the camera of the dynamic with the overlaid information or icons is then displayed on a display screen of the mobile appliance. A user may add annotations beyond what is printed on the dynamic plot. This information may subsequently be shared with other users involved in the project.