Mixed Reality Task Coordination for Multi-Worker Assembly

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mixed reality systems lack efficient methods to coordinate tasks performed by multiple workers using mixed reality devices, particularly in scenarios requiring simultaneous or alternating actions at multiple fastening locations.

Innovation Solution

A control method that utilizes multiple mixed reality devices to display virtual objects at specific fastening locations, allowing workers to perform tasks in synchrony or alternation by determining screw turning actions and updating virtual object displays accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If multiple workers use mixed reality devices independently to perform tasks, then each worker can access information efficiently, but coordination between workers becomes difficult and error-prone

Engineering Contradiction:
ImproveInformation access efficiencyVSAvoidTask coordination accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent merges the task management systems of multiple mixed reality devices into a unified coordination framework. The server consolidates task information from multiple workers and synchronizes virtual object displays across devices, enabling coordinated actions while maintaining individual information access efficiency.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements feedback mechanisms where the server receives task completion status from multiple workers and adjusts virtual object displays accordingly. When one worker completes a task, the system provides feedback to other workers' devices to update their displayed tasks, ensuring accurate coordination.

Inventive Principle:
Principle #23Feedback

2Loss of information

If virtual objects are displayed at all fastening locations simultaneously, then workers can see all possible tasks, but it becomes difficult to determine which task to perform next

Engineering Contradiction:
ImproveTask information visibilityVSAvoidTask selection clarity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent applies local quality by displaying different virtual objects at different fastening locations based on each worker's role and task assignment. Instead of uniform display across all locations, the system tailors the displayed information to the specific context and user, making task selection clear while maintaining comprehensive information availability.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The virtual object displays are dynamic rather than static. The system updates which virtual objects are displayed based on real-time task completion status, worker position, and coordination requirements. This dynamic adjustment ensures workers see relevant next tasks without being overwhelmed by all possible tasks simultaneously.

Inventive Principle:
Principle #15Dynamics

3Productivity

If workers perform tasks in different sequences at different fastening locations, then work parallelism increases, but task completion consistency becomes difficult to maintain

Engineering Contradiction:
ImproveWork parallelismVSAvoidTask completion consistency
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system performs preliminary actions by pre-planning and assigning specific task sequences to different workers before they begin work. The server determines the optimal task sequence for each worker based on the overall assembly requirements, allowing parallel execution while ensuring final consistency through pre-coordinated task assignments.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The server acts as a universal coordination hub that manages task sequences for multiple workers simultaneously. It performs multiple functions including task assignment, progress tracking, and synchronization, enabling different workers to follow different sequences while maintaining overall task completion consistency through centralized management.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250124672A1Control method, mixed reality system, mixed reality device, and storage medium
Publication Date: 2025.04.17 KK TOSHIBA
  • US20250124672A1 patent drawing
  • US20250124672A1 patent drawing
  • US20250124672A1 patent drawing

AI summary

According to one embodiment, a control method includes causing a first mixed reality device to display a first virtual object at a first fastening location. The control method includes causing a second mixed reality device to display a second virtual object at a second fastening location. The control method includes, when a screw is determined to have been turned at the first fastening location and a screw is determined to have been turned at the second fastening location, causing the first mixed reality device to display a third virtual object at a third fastening location, and causing the second mixed reality device to display a fourth virtual object at a fourth fastening location.