Head Mount Display OSD Screen Highlighting for Accurate Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of immersive head mount displays face difficulties in operating controls with their eyes covered, leading to potential incorrect button presses and challenging menu selection due to the lack of visual feedback.

Innovation Solution

Incorporating a touch-sensitive user operation section with a coordinate input function that superposes an OSD screen on the video display, allowing users to determine the touched location and highlight corresponding menu buttons or switches, enabling accurate menu selection and control operations even with eyes covered.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the head mount display is configured to completely shield the user against the external world, then the virtual reality is increased, but the user cannot visually confirm button presses and menu selections

Engineering Contradiction:
Improvevirtual realityVSAvoidoperation accuracy
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system provides visual feedback by displaying an OSD screen that shows menu items and their selection states. When a user presses a button, the corresponding menu item is highlighted or selected on the screen, allowing the user to confirm their input without removing the head mount display. This feedback mechanism resolves the contradiction by maintaining immersion while enabling accurate operation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The OSD screen acts as an intermediary between the user's physical button presses and the system's response. Instead of directly seeing the physical buttons being pressed, the user sees the effect of their presses reflected in the menu selection state on the screen, providing indirect visual confirmation that maintains both immersion and operational accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the head mount display directly covers the eyes of the user, then the user can immerse himself or herself into a displayed video picture, but the user operates the controller incorrectly due to lack of visual feedback

Engineering Contradiction:
ImproveimmersionVSAvoidoperation precision
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The OSD display provides real-time visual feedback showing which menu item is currently selected or focused. This allows the user to precisely control their input by observing the menu state changes on screen, ensuring accurate operation while maintaining full eye coverage and immersion in the displayed content.

Inventive Principle:
Principle #23Feedback

3Reliability

If the user operates the controller with eyes covered by the head mount display, then the immersive experience is maintained, but the user is required to operate the controller with difficulty

Engineering Contradiction:
Improveimmersive experienceVSAvoidoperation ease
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system displays visual feedback on the OSD screen that corresponds to controller operations. This feedback mechanism makes operation easier by allowing the user to see the results of their inputs without breaking immersion, resolving the contradiction between maintaining immersive experience and ease of operation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP2587300B1Head mount display and display control method
Publication Date: 2021.05.19 SONY GROUP CORP
  • EP2587300B1 patent drawingFigure 1
  • EP2587300B1 patent drawingFigure 2
  • EP2587300B1 patent drawingFigure 3A

AI summary

Disclosed is a head mount display including: a user operation section configured to determine one or more coordinates based on a first operation performed by a user via the user operation section while receiving content via the head-mount device; and a controller configured to: superpose, in response to detection of the first operation by the user, upon at least one of one or more display sections of the head-mount device, a screen including one or more items, each of the one or more items of the superposed screen being selectable by the user to control the content being received by the user; and highlight, based on the one or more coordinates determined upon detection of the first operation, at least one of the one or more selectable items of the superposed screen in comparison to other selectable items of the superposed screen.