AR Operation Support Device with Feedback-Driven Image Selection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional augmented reality (AR) operation support technologies fail to effectively measure the contribution of displayed information to actual operation efficiency and often do not provide appropriate support information.

Innovation Solution

An operation support device that includes an acceptor to record operation results, a storing unit to associate support image candidates with operation results, and a decider to select the most appropriate support image based on the operation results, enhancing the efficiency of AR display operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If support image candidates are displayed on AR display device, then operation support is provided to operator, but it is unclear how much contribution is given to support of actual operation and appropriate information is not always displayed

Engineering Contradiction:

Improveaccuracy of operation supportVSAvoidlack of operation result feedback

Core Design Contradiction:

ReliabilityVSLoss of information

Solution Approach 1:

The system implements feedback by recording operation results (success or failure) and using them to determine which support image candidates to display. The decider component selects support images based on recorded operation results, creating a closed-loop system where display content is adjusted according to actual operation outcomes, thereby improving reliability and ensuring appropriate information is displayed.

Inventive Principle:

Principle #23Feedback

2Ease of operation

If multiple support image candidates are displayed, then comprehensive operation guidance is provided, but operation efficiency decreases due to information overload

Engineering Contradiction:

Improveoperation guidance qualityVSAvoidoperation efficiency

Core Design Contradiction:

Ease of operationVSProductivity

Solution Approach 1:

The system applies partial action by displaying only the necessary subset of support image candidates based on recorded operation results. Instead of showing all possible support images simultaneously, the decider component selectively displays relevant candidates based on operation success/failure data, reducing information overload while maintaining comprehensive guidance quality.

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The system implements local quality by providing different support image candidates tailored to specific operation contexts and outcomes. Rather than uniform display of all support images, the system adjusts display content locally based on recorded operation results, ensuring appropriate information is presented for each operational scenario.

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS10311617B2Operation support device, operation support method, and non-transitory computer readable recording medium

Publication Date: 2019.06.04 NS SOLUTIONS CORPORATION

AI summary

Included are: an acceptor configured to accept an operation result of success or failure of an operation by an operator, the operation result being obtained in a case where an optical see-through displayer worn by the operator displays a support image candidate for the operation by the operator superimposed on a reality space; a storing unit configured to store each support image candidate out of a plurality of the support image candidates for the operation and the operation result in a memory, associating the support image candidate with the operation result being in a case where the support image is displayed; and a selector configured to select the support image candidate to be set as the support image of the operation from among the plurality of the support image candidates, based on the operation result.