Wearable Terminal Visual Instruction System for Noisy Environments

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In noisy work environments, such as factory sites, it is challenging for workers wearing wearable terminals to receive remote work support through voice instructions due to high noise levels, limiting the effectiveness of traditional voice-based remote work support systems.

Innovation Solution

A remote work supporting system that shares images between wearable and remote terminals, using an image acquiring unit, screen sharing, and virtual objects to convey instructions, allowing workers to respond with gestures while displaying recognized states, enabling effective remote work support even in noisy conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If voice-based remote work support is used, then workers can receive instructions hands-free, but the system becomes ineffective in high noise environments

Engineering Contradiction:
Improvehands-free operationVSAvoidinstruction reception reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces visual displays (head-mounted display and remote terminal screen) as intermediary devices between the instructor and worker. Instead of relying solely on voice transmission, the system uses visual objects and text displays to convey instructions, allowing the worker to see instructions while keeping hands free for work tasks.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the acoustic communication channel (voice) with a visual communication channel (display screens and visual objects). This substitution allows instructions to be transmitted through light rather than sound waves, making the system effective in high noise environments where acoustic transmission is compromised.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If visual displays are added to convey instructions, then instruction reliability improves in noisy environments, but device complexity increases

Engineering Contradiction:
Improveinstruction reception reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent makes the wearable terminal serve multiple functions: it acts as both a camera for capturing the work environment and a display device for showing instructions. The remote terminal similarly functions as both a control interface and a display device. This multi-functionality reduces the need for separate dedicated devices, thereby limiting the increase in system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent creates visual copies of instructions as graphical objects that are displayed on both the remote terminal and wearable terminal. These visual objects serve as replicas of the instructional information, allowing the same instruction to be viewed from multiple locations without requiring additional complex communication infrastructure.

Inventive Principle:
Principle #26Copying

3Loss of information

If screen sharing is implemented between terminals, then communication effectiveness improves, but data transmission requirements and system complexity increase

Engineering Contradiction:
Improveinformation transmission completenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the information transmission into different components: visual objects for instructions, text for supplementary information, and image data for context. This segmentation allows the system to transmit only the necessary information elements rather than complete screen captures, reducing data transmission requirements while maintaining communication effectiveness.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10591986B2Remote work supporting system, remote work supporting method, and program
Publication Date: 2020.03.17 OPTIM
  • US10591986B2 patent drawing
  • US10591986B2 patent drawing
  • US10591986B2 patent drawing

AI summary

A remote work supporting system shares an image 200 photographed by a wearable terminal between the wearable terminal and a remote terminal in order to support remote work. An image acquiring unit acquires the image 200 photographed by the wearable terminal. A screen sharing unit screen-shares the image 200 between the wearable terminal and the remote terminal. An accepting unit accepts an input of instruction information for the image 200 from the remote terminal. A first display unit superimposes and displays the image 200 and a virtual object 201 corresponding to the instruction information on the wearable terminal. A second display unit superimposes and displays the image 200 and the virtual object 201 on the remote terminal. An image recognizing unit analyzes the image 200 to recognize a state of a body part. A changing unit changes a display of the virtual object 210 by the first display unit and the second display unit based on the recognized state.