HMD Composite Video Controller for Dynamic Source Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users wearing head-mountable displays (HMDs) can be overwhelmed by excessive information from multiple video sources, leading to reduced attention and discomfort due to the inability to effectively manage the presentation of composite video representations.

Innovation Solution

A data processing apparatus and method that generates composite video representations for HMDs, using a controller to selectively vary the contribution of each video source, allowing for threshold-based adjustments in the number and prominence of displayed sources based on user attention, viewing direction, and profile data, to optimize information presentation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If multiple video sources are displayed simultaneously in a composite representation, then the user is provided with significant amounts of material to provide interest and information, but the user can be overwhelmed by excessive information leading to reduced attention and discomfort

Engineering Contradiction:
Improveamount of video materialVSAvoiduser overload and discomfort
Core Design Contradiction:
Quantity of substanceVSObject-affected harmful factors

Solution Approach 1:

The system dynamically adjusts the contribution of each video source to the composite representation based on user attention metrics. The controller continuously monitors user attention and modifies which video sources are displayed and their prominence levels in real-time, transforming a static multi-source display into a dynamic adaptive system that responds to user state.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameter of video source contribution levels, selectively varying which sources are included and their relative prominence in the composite representation. This parameter adjustment based on user attention allows the system to optimize information density and prevent user overload while maintaining comprehensive content availability.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If the system displays all video sources with equal prominence, then all information is presented, but the user cannot effectively manage the presentation leading to reduced attention

Engineering Contradiction:
Improveinformation completenessVSAvoiduser attention management
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system applies different prominence levels to different video sources within the composite representation based on user attention. Instead of uniform treatment, each video source receives a customized level of display prominence, allowing important content to stand out while less relevant content is de-emphasized, making information management easier for the user.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses user attention metrics as feedback to control which video sources are displayed and their prominence. The controller receives feedback about user attention state and adjusts the composite representation accordingly, creating a closed-loop system that continuously optimizes information presentation based on actual user engagement.

Inventive Principle:
Principle #23Feedback

3Object-affected harmful factors

If the system dynamically adjusts video source contribution based on user attention, then user overload is alleviated and attention is enhanced, but the system complexity increases

Engineering Contradiction:
Improveuser overloadVSAvoidcontrol system complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The controller acts as an intermediary between the multiple video sources and the display system, managing the complexity of dynamically adjusting video source contribution. By centralizing the control logic in a dedicated controller that processes user attention metrics and determines optimal display configurations, the system manages complexity rather than distributing it across multiple components.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP4231649A1Apparatus and method for displaying a composite video by a head-mounted display
Publication Date: 2023.08.23 SONY INTERACTIVE ENTERTAINMENT LLC

AI summary

Data processing apparatus comprises a video generator to generate video images for display to a user by a head mountable display, HMD; in which the video generator is responsive to a set of two or more video sources to generate a composite video representation of the set of two or more video sources for display; and a controller to control operation of the video generator; in which the controller is configured to control the video generator to selectively vary a contribution of each of the set of two or more video sources to the composite video representation.