AR Object Placement via Movement Context Ranking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality systems face challenges in effectively displaying supplementary information to users by determining the most visible and relevant objects in their field of view, as existing methods often rely on direct association with real-life objects or floating information, which can be distracting and less natural for users.

Innovation Solution

An apparatus and method that obtain a user's movement context to rank objects based on visibility, selecting a placement object for augmented reality information elements, and adjust camera settings to optimize the display of information, considering factors like navigation route, past gaze direction, and object type, to enhance message visibility and relevance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If augmented reality information is displayed by directly associating it with real-life objects or using floating information, then the information can be conveyed to users, but the display becomes distracting and less natural for users

Engineering Contradiction:
Improvenaturalness of information displayVSAvoiddistractiveness to user
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by differentiating the display strategy based on object characteristics. Instead of uniform information placement, the system analyzes individual object properties (size, motion, user interaction frequency) and selectively places information on objects with appropriate qualities for information承载, such as stationary objects or objects that are already central to user attention, thereby making the display more natural and less distracting.

Inventive Principle:
Principle #3Local quality

2Reliability

If augmented reality information is placed on multiple objects to increase visibility, then more users can see the information, but the selection of appropriate placement objects becomes more complex

Engineering Contradiction:
Improvevisibility of informationVSAvoidcomplexity of object selection process
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary analysis of the environment and user context before information placement. By pre-processing sensor data, identifying candidate objects, and evaluating their suitability for information display based on predetermined criteria (stationary nature, visibility, relevance to user task), the system reduces the complexity of real-time decision-making while ensuring reliable information visibility.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system incorporates feedback mechanisms where the placement effectiveness is continuously monitored and used to refine future placement decisions. By tracking which objects successfully convey information and which cause distraction, the system learns and adapts its object selection strategy, simplifying the overall process while improving reliability.

Inventive Principle:
Principle #23Feedback

3Productivity

If the system captures fleeting objects for photography, then more dynamic scenes can be documented, but the camera settings cannot be adjusted in time without prediction

Engineering Contradiction:
Improvecapability to capture dynamic scenesVSAvoidtime for camera adjustment
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary identification and tracking of potential photographable objects, predicting their future positions and characteristics before they become optimal shooting targets. By pre-processing sensor data to identify objects of interest and anticipating their movement trajectories, the system prepares camera settings in advance, enabling capture of dynamic scenes without losing time on adjustments.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adapts camera settings based on real-time object motion and user behavior patterns. By continuously monitoring object velocity, direction, and predicted trajectory, the system adjusts shutter speed, aperture, and focus settings dynamically to match the fleeting nature of moving objects, thereby capturing dynamic scenes effectively without time loss.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4130938A1Augmented reality
Publication Date: 2023.02.08 NOKIA TECHNOLOGIES OY
  • EP4130938A1 patent drawingFigure 1
  • EP4130938A1 patent drawingFigure 2
  • EP4130938A1 patent drawingFigure 3

AI summary

In accordance with an example aspect, there is provided an apparatus comprising at least one processing core and at least one memory including computer program code, the at least one memory and the computer program code being configured to, with the at least one processing core, cause the apparatus at least to obtain a movement context of a user, rank, based at least in part on the movement contest, at least two objects based on their visibility to the user, and determine, based at least in part on the ranking, at least one of the at least two objects as a placement object for an augmented reality information element.