Wearable Display Location Selection via Visual Scene Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted and wearable displays struggle to dynamically determine optimal display locations for graphical elements on a user's field of view, often overlaying important visual information on complex or bright areas, leading to user distraction and reduced usability.

Innovation Solution

A wearable computing device equipped with cameras, sensors, and image analysis modules that capture and analyze the user's field of view to determine appropriate locations for graphical elements based on context, user preferences, and environmental factors, using modules for color compatibility, complexity analysis, brightness assessment, and object detection to select suitable display positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If graphical elements are always projected to the same portion of the display, then device complexity is reduced, but visual interference with important field of view information increases

Engineering Contradiction:
Improvedisplay control complexityVSAvoidvisual interference
Core Design Contradiction:
Device complexityVSObject-affected harmful factors

Solution Approach 1:

The display location for graphical elements is made dynamic rather than fixed. The system continuously analyzes the user's field of view using camera feeds and adjusts the graphical element positions in real-time based on detected important objects, ensuring optimal placement that avoids visual interference while maintaining manageable system complexity through automated analysis.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback loops where camera feeds continuously monitor the user's field of view, detect important objects, and feed this information back to the display control module. This feedback mechanism enables automatic adjustment of graphical element positions without requiring complex manual configuration, resolving the contradiction between simplicity and effectiveness.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If graphical elements are displayed in fixed positions, then ease of operation is maintained, but usability is reduced due to user distraction

Engineering Contradiction:
Improvedisplay operation simplicityVSAvoidusability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system performs self-service by automatically analyzing the user's field of view, detecting important objects, and autonomously determining optimal display locations for graphical elements. This eliminates the need for manual user configuration while adapting to changing environmental conditions, thereby maintaining ease of operation without compromising usability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary analysis of the field of view to identify important objects before displaying graphical elements. By pre-processing the visual information and determining appropriate display locations in advance, the system avoids last-minute adjustments and ensures that graphical elements are always placed optimally without requiring complex real-time user intervention.

Inventive Principle:
Principle #10Preliminary action

3Area of stationary object

If graphical elements overlay complex or bright areas, then display area utilization is maximized, but visual interference increases

Engineering Contradiction:
Improvedisplay area utilizationVSAvoidvisual interference
Core Design Contradiction:
Area of stationary objectVSObject-affected harmful factors

Solution Approach 1:

The system applies local quality analysis by evaluating different regions of the user's field of view and identifying areas with important objects. Based on this localized analysis, the system determines appropriate display locations for graphical elements that avoid important regions while utilizing available display space effectively, thereby maximizing display area utilization without causing visual interference.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3047361B1A method and device for displaying a graphical user interface
Publication Date: 2019.04.24 INTEL CORP
  • EP3047361B1 patent drawingFigure 1
  • EP3047361B1 patent drawingFigure 2
  • EP3047361B1 patent drawingFigure 3

AI summary

Technologies for displaying graphical elements on a graphical user interface include a wearable computing device to generate a captured image. The wearable computing device analyzes the captured image to generate image location metric data for one or more prospective locations on the graphical user interface at which to place a graphical element. The image location metric data indicates one or more image characteristics of the corresponding prospective location. The wearable computing device determines appropriateness data for each prospective location based on the corresponding image location metric data. The appropriate data indicates a relative suitability of the corresponding location for display of the graphical element. The wearable computing device selects one of the prospective locations based on the appropriateness data and displays the graphical element on the graphical user interface at the selected prospective location.