Head-Mounted Display Visual Field Sharing via Data Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted display systems for assisting workers lack an efficient means to convey and share large amounts of information in a understandable manner, particularly in real-time, between workers and administrators, limiting effective collaboration and task management.

Innovation Solution

A system comprising head-mounted display apparatus with integrated imaging, communication, evaluation, and control sections that capture and transmit visual field data and notification information, allowing multiple users to share visual fields and inputs, enabling real-time feedback and guidance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If visual field data and notification data are transmitted between multiple head-mounted display apparatus, then information sharing and collaboration are improved, but communication bandwidth consumption and system complexity increase

Engineering Contradiction:
Improveinformation sharingVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The notification data is segmented into multiple packets for transmission. Each packet contains a portion of the notification information along with routing identifiers, allowing the system to transmit large amounts of information in manageable units that can be reassembled at the receiving end, thereby reducing the burden on communication bandwidth while maintaining complete information sharing

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A data transmission control section is introduced as an intermediary component that manages the segmentation, routing, and reassembly of notification data packets. This mediator coordinates communication between multiple head-mounted display apparatus, reducing system complexity by centralizing the management of data flow and eliminating the need for complex peer-to-peer coordination protocols

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If evaluation of user state is performed to determine notification timing, then information conveyance effectiveness is improved, but processing time and computational load increase

Engineering Contradiction:
Improveinformation conveyance effectivenessVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system performs preliminary evaluation of user state by analyzing visual field data and notification data in advance of actual notification transmission. The data evaluation section pre-processed incoming data streams to identify key events and user states, creating a ready-to-use assessment that enables immediate notification delivery when appropriate conditions are met, thereby reducing real-time processing delays

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The head-mounted display apparatus evaluates its own user state autonomously using onboard sensors and processing capabilities. The device self-monitors visual field information, user attention state, and contextual data without requiring external evaluation systems, eliminating communication overhead and processing delays associated with external evaluation while maintaining accurate timing determination

Inventive Principle:
Principle #25Self-service

3Productivity

If multiple users share visual fields and inputs in real-time, then collaboration efficiency is improved, but data transmission volume and network load increase

Engineering Contradiction:
Improvecollaboration efficiencyVSAvoiddata transmission volume
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The system extracts only the essential and relevant portions of visual field data and notification data for transmission between users. Rather than transmitting complete data streams, the data transmission control section identifies and extracts key information elements such as critical visual events, important notification contents, and relevant user inputs, significantly reducing data transmission volume while preserving collaboration effectiveness

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The notification data is structured with differentiated quality levels where different portions of the data receive different transmission priorities and processing intensities. Critical notification elements are transmitted with high priority and complete detail, while less critical information is transmitted with lower priority or in compressed form, allowing the system to optimize network resource allocation based on local data importance rather than treating all data uniformly

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10564919B2Display system, display apparatus, method for controlling display apparatus, and program
Publication Date: 2020.02.18 SEIKO EPSON CORP
  • US10564919B2 patent drawing
  • US10564919B2 patent drawing
  • US10564919B2 patent drawing

AI summary

An HMD includes an image display section that allows a user to view an image and transmits an outside scene, an evaluation section that evaluates the state of the user, and a communication section that communicates with another HMD. A control section transmits visual field data on the basis of images captured with a right camera and a left camera to the other HMD, causes the communication section to transmit notification data on the basis of a result of the evaluation performed by the evaluation section to the other HMD, and causes the image display section to perform display on the basis of data transmitted from the other HMD.