Head Mounted Display Event-Driven Imaging Data Association

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted displays and imaging systems lack the capability to effectively associate and reproduce content images with specific events or actions during work processes, making it difficult to provide relevant information to users unfamiliar with the work being performed.

Innovation Solution

A head-mounted display system that includes an image presentation unit, an imaging unit, an event acquisition unit, a storage control unit, and an association registration unit, which captures and stores imaging data and associates presentation identification information with specific event features, allowing for the reproduction of relevant content images and sounds during specific work actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If imaging data is continuously recorded during work processes, then complete work documentation is achieved, but data storage requirements and processing complexity increase

Engineering Contradiction:
Improvework documentation completenessVSAvoiddata processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system extracts only the necessary imaging data segments corresponding to specific manual pages and event timings, rather than processing all continuous imaging data. The event determination unit identifies key moments, and the first specification unit extracts only the relevant time position information, reducing processing complexity while maintaining documentation completeness.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary association registration between presentation identification information and time position information during the work process. This pre-organization of data relationships allows for efficient retrieval and reproduction later, reducing the complexity of post-processing while ensuring complete documentation.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If content images are presented sequentially with detailed work instructions, then work procedure clarity is improved, but information delivery efficiency to unfamiliar users decreases

Engineering Contradiction:
Improvework procedure information completenessVSAvoidinformation delivery time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system uses event acquisition to detect user actions or system events, and based on this feedback, determines whether to reproduce imaging data and sounds. This event-driven approach ensures information is delivered at appropriate moments, maintaining completeness while improving efficiency by avoiding unnecessary presentations.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically adjusts the presentation of content images and imaging data reproduction based on detected events and timing information. Rather than static sequential presentation, the system adapts information delivery to actual work process timing, improving both completeness and efficiency.

Inventive Principle:
Principle #15Dynamics

3Reliability

If imaging data and sounds are reproduced at all work steps, then complete work process visualization is achieved, but user attention and cognitive load increase

Engineering Contradiction:
Improvework process documentation accuracyVSAvoiduser cognitive load
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The system applies different qualities of information presentation to different work steps based on event determination. Imaging data and sounds are reproduced only at specific locations in the work process where events are detected, rather than uniformly at all steps. This localized approach maintains documentation accuracy while reducing unnecessary cognitive load.

Inventive Principle:
Principle #3Local quality

4Ease of operation

If manual content is enhanced with imaging data for each page, then work explanation effectiveness is improved, but system complexity and data management burden increase

Engineering Contradiction:
Improvework explanation effectivenessVSAvoiddata management complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system merges manual content with imaging data through association registration, combining presentation identification information with time position information. This integration enhances work explanation effectiveness by linking textual instructions with visual documentation, while the unified data structure manages complexity through systematic organization.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS8654038B2Head mounted display and imaging data usage system including the same
Publication Date: 2014.02.18 BROTHER KOGYO KK
  • US8654038B2 patent drawing
  • US8654038B2 patent drawing
  • US8654038B2 patent drawing

AI summary

A head mounted display includes: an image presentation portion that sequentially presents each of content images to a user's eye; an imaging portion that images an object when the content images are presented; an event acquisition portion that acquires an event occurring outside; a storage control unit that stores imaging data including the imaged object and imaging time position information regarding an imaging time; an event determination unit that determines whether the acquired event has a specific feature; a first specification unit that specifies first time position information regarding a timing when the event having the specific feature is occurred; and a first association registration unit, which, when the event has the specific feature, associates presentation identification information for identifying the presented content images with the first time position information, and which registers the presentation identification information and the first time position information.