Notification Assimilation in Transmissive HMDs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In transmissive head-mounted displays, traditional graphical user interface methods for push notifications can obstruct the user's view and disrupt their behavior by displaying information directly in front of their eyes, failing to integrate with the surrounding environment.

Innovation Solution

An information processing apparatus that determines an output explicitness level for notification information and controls its output mode to assimilate into the display environment, using a combination of sensors and processing units to adjust the method, style, and position of notifications based on importance, urgency, and user context.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If notification information is displayed using traditional graphical user interface methods in front of the user's eyes, then the information is clearly visible and easily perceived, but the user's view is obstructed and their behavior may be inhibited

Engineering Contradiction:
Improvenotification information visibilityVSAvoiduser behavior freedom
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent transitions notification display from the traditional 2D screen space to 3D spatial space by projecting notifications at various positions in the user's field of view. Notifications can be displayed at different depths, angles, and locations (e.g., upper periphery, lower periphery, side areas) rather than being confined to a flat display surface, thereby providing clear visibility while avoiding obstruction of the user's natural view and behavior.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent applies different display characteristics to different regions of the user's field of view. Important notifications are displayed in areas with higher attention probability (e.g., upper periphery), while less important ones are placed in lower priority areas. The display parameters (brightness, size, position) are locally adjusted based on the specific notification content and user context, optimizing both visibility and minimal intrusion.

Inventive Principle:
Principle #3Local quality

2Loss of information

If notification information is displayed prominently in front of the user's eyes, then the information is easily noticed, but it does not fit into the surrounding environment and may harm the world view of running applications

Engineering Contradiction:
Improvenotification information noticeabilityVSAvoidenvironmental integration
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic adaptation of notification display parameters based on real-time detection of user state (through sensors detecting gaze direction, head position, movement) and environment (lighting conditions, surrounding objects). The notification position, size, brightness, and persistence are continuously adjusted to match the current context, ensuring environmental harmony while maintaining noticeability. For example, notifications automatically adjust to avoid obscuring important real-world views or interfering with ongoing activities.

Inventive Principle:
Principle #15Dynamics

3Device complexity

If notification information is displayed using fixed methods, then the implementation is simple, but the system cannot adapt to different user contexts and environments

Engineering Contradiction:
Improvenotification system complexityVSAvoidoutput style adaptability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent employs multiple adjustable parameters for notification output including display position (x, y coordinates in 3D space), size, brightness, duration, and presentation format. These parameters are dynamically modified based on detected user state and environmental conditions. The system maintains a library of different notification templates and selectively applies parameter adjustments to match contextual requirements, achieving high adaptability through parameter variation rather than through complex architectural changes.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11037532B2Information processing apparatus and information processing method
Publication Date: 2021.06.15 SONY GROUP CORP
  • US11037532B2 patent drawing
  • US11037532B2 patent drawing
  • US11037532B2 patent drawing

AI summary

An information processing apparatus includes a determination unit configured to determine an output explicitness level of notification information to a user, and an output control unit configured to perform control such that the notification information is output in an output mode according to the determined output explicitness level. The output control unit performs control such that the notification information is output in a display mode of assimilating the notification information into a display environment in accordance with the output explicitness level.