AR Content Display Device for Skill-Based Operator Guidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing AR content display technologies are inefficient as they do not account for the operator's skill level, leading to increased time in performing operations and learning skills.

Innovation Solution

An AR content display device that includes an operation information generator, skill calculator, augmented reality marker determiner, and outputter, which assesses the operator's skill level by comparing their actions to those of a model operator and adjusts the AR content displayed accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If AR content is displayed independently of operator skill level, then the system is simple to operate, but the time taken to perform operations and learn skills increases

Engineering Contradiction:
Improvesimplicity of AR content display systemVSAvoidtime taken to perform operations and learn skills
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The AR content display system dynamically adjusts the type and amount of content displayed based on the operator's skill level. The skill level is calculated by comparing the operator's actions with model operator actions, and the system automatically modifies AR content delivery accordingly. This dynamic adaptation resolves the contradiction by making the system both simple to operate (automatic adjustment) and time-efficient (optimized content for skill level).

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameters of AR content display based on the calculated skill level. For operators with lower skill levels, more detailed guidance and instructional content are displayed. For higher skill levels, less intrusive and more concise information is provided. This parameter adjustment resolves the contradiction by optimizing both operational simplicity and learning efficiency.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If AR content is customized based on operator skill level, then the efficiency of performing operations and learning skills improves, but the device complexity increases

Engineering Contradiction:
Improveefficiency of performing operations and learning skillsVSAvoidcomplexity of AR content display system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs self-service by automatically calculating the operator's skill level through comparison with model operations and autonomously selecting appropriate AR content without requiring manual intervention or complex configuration. This self-service mechanism resolves the contradiction by achieving high productivity through automated skill-based adaptation while keeping the system relatively simple in operation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback by continuously monitoring operator actions, comparing them with model operations, and using this feedback to adjust AR content delivery in real-time. This closed-loop feedback mechanism enables the system to adapt to skill levels dynamically, improving productivity while managing complexity through automated feedback processing rather than complex manual control systems.

Inventive Principle:
Principle #23Feedback

3Reliability

If detailed AR content is displayed for all operators, then skill training completeness is ensured, but the time taken to perform operations increases

Engineering Contradiction:
Improvecompleteness of skill trainingVSAvoidtime taken to perform operations
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system applies local quality by providing different levels of AR content detail to different operators based on their skill levels. Rather than uniformly displaying detailed content for all operators, the system locally adapts the content quality to match individual needs. This resolves the contradiction by ensuring complete training for those who need it while allowing faster operations for those who have already mastered the skills.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system applies partial action by displaying only the necessary amount of AR content for each operator's current skill level. For experienced operators, minimal AR content is displayed, while for beginners, more comprehensive content is provided. This partial application of content based on need resolves the contradiction between training completeness and operational speed.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240071245A1Ar content display device, ar content display system, ar content display method and program
Publication Date: 2024.02.29 MITSUBISHI ELECTRIC CORP
  • US20240071245A1 patent drawing
  • US20240071245A1 patent drawing
  • US20240071245A1 patent drawing

AI summary

An augmented reality (AR) content display device includes operation information generating circuitry to generate operation information indicating an operator action performed by an operator based on acquired image data, a storage device to store a variety of information, skill calculating circuitry to calculate, as a skill level of the operator, based on the latest operation information and the model operation information about a process including the operator action indicated by the operation information, a difference in the operator action between the operator and the model operator, AR marker determining circuitry to determine an AR marker to be assigned to each operation task in the process based on information indicating the skill level, and AR marker outputting circuitry to output AR marker information indicating the determined AR marker to a wearable device that displays AR content.