Transmissive HMD Multi-Worker Task Coordination via Image Sharing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing transmissive head-mounted display systems lack effective operation support mechanisms for multiple workers collaborating in real-time, particularly in environments like restaurants where multiple staff members need to coordinate their tasks efficiently.

Innovation Solution

A transmissive head-mounted display apparatus equipped with an image display unit, imaging unit, target identifying unit, task occurrence determination unit, and display controller that identifies tasks and shares relevant information among users, allowing for real-time task management and coordination among restaurant staff.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a transmissive head mounted display apparatus is used for operation support, then operation support for single worker is achieved, but operation support for multiple workers collaborating is not provided

Engineering Contradiction:
Improveoperation support for multiple workersVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges multiple HMDs into a coordinated system where each device performs the same basic functions (image display, imaging, target identification) but the results are shared across all users. The display controller of one HMD transmits captured images and task information to other HMDs, combining individual capabilities into a collective multi-worker operation support system.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a communication interface as an intermediary between HMDs. This intermediary enables the transmission of images and task information from one HMD to others, facilitating coordination among multiple workers without requiring direct visual contact or complex inter-device integration.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If multiple workers use HMDs independently, then each worker can perform tasks autonomously, but task coordination and mutual awareness is lacking

Engineering Contradiction:
Improvetask coordinationVSAvoidtask information sharing
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent implements feedback mechanisms where each HMD continuously captures images of the workspace and transmits them to other HMDs. This feedback loop ensures that all workers are aware of task status, object locations, and colleague positions in real-time, enabling coordinated operation without information loss.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent makes the HMD system universal by enabling any worker to perform any task by sharing the same visual and spatial information. The imaging unit and display controller function universally across all HMDs, allowing flexible task allocation and coordination among multiple workers based on real-time situational awareness.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11215831B2Transmissive head mounted display apparatus, support system, display control method, and computer program
Publication Date: 2022.01.04 SEIKO EPSON CORP
  • US11215831B2 patent drawing
  • US11215831B2 patent drawing
  • US11215831B2 patent drawing

AI summary

A transmissive head mounted display apparatus includes an image display unit configured to transmit an external scene and display an image of a display target viewable with the external scene, an imaging unit, a target identifying unit configured to identify, from a captured image captured by the imaging unit, a target of a task predetermined as a task that a user of the transmissive head mounted display apparatus needs to perform, a task occurrence determination unit configured to determine, based on a state of the target in the captured image, whether the task has occurred or not, and a display controller configured to cause the image display unit to display related information relating to the task when the task is determined to have occurred.