Gaze-Controlled HMD Display for Past Data Sharing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies do not facilitate the sharing of past memories or data between individuals during meetings or video conferences, hindering effective discussions by not allowing users to easily recall and share relevant past interactions.

Innovation Solution

An information processing system that includes a head-mounted display (HMD) and user terminal, connected to a cloud storage, which allows users to visually share past data with an interlocutor by detecting gaze movements to trigger the display of relevant information and enabling sharing settings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If past data is displayed on a display unit before the user's eyes, then the user can easily recall and share past memories with the interlocutor, but the device complexity increases due to the need for gaze detection and display control mechanisms

Engineering Contradiction:
Improveease of recalling and sharing past dataVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a display unit as an intermediary between the user's memory and the interlocutor, allowing past data to be visually presented without requiring complex direct brain-computer interface technology. The display unit acts as a mediator that translates internal recall processes into external visible information

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical or manual methods of retrieving and sharing past data (such as typing or verbal description) with an automated optical display system that presents information visually based on detected gaze patterns, substituting manual operations with automated visual presentation

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If the display unit continuously shows past data, then the user can maintain context awareness during conversation, but the information overload occurs and distracts from the current interaction

Engineering Contradiction:
Improvecontext awareness during conversationVSAvoidinformation overload and distraction
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent implements dynamic control of the display unit, adjusting its operation based on detected gaze patterns. The display activates or deactivates according to real-time user attention states, transforming a static continuous display into a dynamic responsive system that adapts to conversation flow

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The display unit operates periodically based on gaze detection cycles, activating to show past data when gaze patterns indicate recall intent and remaining inactive otherwise. This periodic activation pattern prevents continuous information presentation while maintaining context awareness when needed

Inventive Principle:
Principle #19Periodic action

3Productivity

If the system automatically detects and displays past data based on conversation, then the sharing efficiency improves, but the measurement precision of interlocutor recognition and intent detection must be very high

Engineering Contradiction:
Improvesharing efficiency of past dataVSAvoidprecision of interlocutor recognition and intent detection
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent implements feedback mechanisms where the system monitors gaze patterns and conversation context, adjusts display based on detected intent, and allows user confirmation or correction. This feedback loop enables the system to learn and improve its recognition accuracy over time while maintaining efficient data sharing

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent employs partial action by displaying only selectively relevant past data rather than all available information. The system presents a subset of past data that appears most relevant based on gaze detection and conversation context, reducing the measurement burden while maintaining sharing efficiency

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9992451B2Information processing device, control method, and system
Publication Date: 2018.06.05 SONY GROUP CORP
  • US9992451B2 patent drawing
  • US9992451B2 patent drawing
  • US9992451B2 patent drawing

AI summary

An information processing device including a display control unit configured to carry out control in a manner that a display unit disposed before eyes of a user displays past data relating to a recognized interlocutor, and a sharing setting control unit configured to carry out control in a manner that sharing of the past data with another person is set.