AR Object Content Persistence via Field of View Recording

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems fail to effectively address the issue of displaying content to users when objects of interest disappear due to unintentional or intentional movements, obstructions, or changes in visibility, without user control, and do not consider the complexity of content or the user's interest in maintaining visibility over time.

Innovation Solution

A computer-implemented method and system for an augmented reality device that captures and analyzes the user's field of view, tracks eye and head movements, and determines the object of interest, identifying frames of disappearance, generating data to display relevant content based on analyzed frames, even when the object is no longer in view due to obstructions or lack of user interest.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the AR device displays content only when the object is within the user's field of view, then the device complexity is reduced, but the user cannot access information about objects that have disappeared from view due to obstructions or movement

Engineering Contradiction:
Improveinformation about disappeared objectsVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system captures and records the field of view and object information in advance before the object disappears. By preliminarily recording the visual information and metadata about objects while they are visible, the system enables later retrieval and display of content about disappeared objects without requiring continuous tracking infrastructure

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a digital copy of the field of view and object information through recording. This copy is stored and can be retrieved later to display content about objects even after they disappear from the live field of view, eliminating the need for complex continuous tracking systems

Inventive Principle:
Principle #26Copying

2Loss of information

If the AR device continuously tracks and records the user's field of view to capture disappearing objects, then the information availability is improved, but the use of energy increases due to continuous operation of cameras and processors

Engineering Contradiction:
Improvecontent availability for disappeared objectsVSAvoidenergy consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The system applies partial action by selectively recording only when specific conditions are met (object disappearance detection, obstruction detection, or user request) rather than continuous recording. This reduces energy consumption while still capturing necessary information about disappeared objects

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system uses feedback mechanisms where the detection of object disappearance, obstruction, or user gaze triggers the recording and content display functions. This event-driven approach ensures energy is consumed only when necessary to maintain information about disappeared objects

Inventive Principle:
Principle #23Feedback

3Ease of operation

If the AR device displays content for objects that disappeared due to user lack of interest, then the user experience is improved, but the loss of time increases due to displaying irrelevant content

Engineering Contradiction:
Improveuser experienceVSAvoidtime for displaying irrelevant content
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system dynamically adjusts content display based on real-time analysis of user behavior patterns. By continuously monitoring gaze duration, repeated viewing, and interaction patterns, the system adapts its content recommendations to match actual user interest, displaying content only when likelihood of user engagement is high

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameter of content display timing and selection based on analyzed user interest metrics. By using thresholds for gaze duration and patterns of repeated viewing, the system optimizes which content to display and when, reducing display of irrelevant content while maintaining user experience

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11580701B2Apparatus and method for displaying contents on an augmented reality device
Publication Date: 2023.02.14 SAMSUNG ELECTRONICS CO LTD
  • US11580701B2 patent drawing
  • US11580701B2 patent drawing
  • US11580701B2 patent drawing

AI summary

A system for displaying contents on an augmented reality (AR) device comprises a capturing module configured to capture a field of view of a user, a recording module configured to record the captured field of view, a user input controller configured to track a vision of the user towards one or more objects and a server. The server comprises a determination module, an identifier, and an analyser. The determination module is configured to determine at least one object of interest. The identifier is configured to identify a frame containing disappearance of the determined object of interest. The analyser is configured to analyse the identified frame based on at least one disappearance of the object of interest, and generate analysed data. The display module is configured to display a content of the object of interest on the AR device.