Gaze-Based Content Expansion for AR Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality content delivery systems fail to efficiently provide secondary visual content to users based on their gaze direction, leading to suboptimal user experience as they often require manual interaction or lack intelligent content expansion.

Innovation Solution

A method and apparatus that monitor a viewer's gaze direction towards a first display showing primary and secondary visual content, determining when the viewer's attention is focused on the secondary content, and automatically expand it on a second display, such as an augmented reality display, to provide further information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If secondary visual content is automatically expanded based on gaze direction, then user experience is enhanced and relevant information is provided efficiently, but system complexity increases due to gaze monitoring and content expansion control mechanisms

Engineering Contradiction:
Improveuser experienceVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically monitors viewer gaze direction and expands secondary visual content without requiring manual interaction. The apparatus detects when a viewer is looking at secondary content and autonomously expands it on the augmented reality display, allowing the system to serve itself rather than requiring user commands.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements a feedback loop by monitoring the viewer's gaze direction in real-time and using this information to control content expansion. The gaze monitoring provides continuous feedback about viewer attention, which the system uses to dynamically adjust the display state of secondary visual content.

Inventive Principle:
Principle #23Feedback

2Productivity

If gaze monitoring is implemented to detect viewer attention, then content delivery becomes intelligent and efficient, but measurement and detection difficulty increases

Engineering Contradiction:
Improvecontent delivery efficiencyVSAvoidgaze detection difficulty
Core Design Contradiction:
ProductivityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent replaces manual or mechanical methods of detecting viewer attention with an automated optical/electronic gaze monitoring system. The apparatus uses cameras and image processing to track eye movements and determine gaze direction, substituting mechanical detection with optical sensing and computational analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10928893B2Content delivery
Publication Date: 2021.02.23 NOKIA TECHNOLOGIES OY
  • US10928893B2 patent drawing
  • US10928893B2 patent drawing
  • US10928893B2 patent drawing

AI summary

A method, apparatus and computer program code are provided. The method comprises: monitoring a viewer's gaze direction towards a first display while the first display is displaying primary visual content and secondary visual content; determining that the viewer's gaze is directed towards the secondary visual content displayed by the first display; and causing the secondary visual content to be expanded by a second display, different from the first display.