Augmented Reality Step-Location Control for Safer User Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) systems face challenges in enabling efficient and safe user control inputs while users are in motion, as complex gestures or device interactions can be distracting or unsafe, especially when hands are occupied.

Innovation Solution

An AR system that determines future step locations based on user motion and displays interactive items associated with these locations, allowing control inputs via intuitive gestures, voice commands, or hardware inputs when the user reaches specific selection areas, optimizing interaction safety and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If complex gestures or device interactions are used for control inputs, then control functionality is comprehensive, but user safety and ease of operation deteriorate due to distractions especially when hands are occupied

Engineering Contradiction:
Improveease of control inputVSAvoiduser safety
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system automatically detects user motion and determines future step locations without requiring manual input. Interactive items are automatically presented at appropriate future locations based on the user's current motion state, eliminating the need for complex manual control gestures while maintaining safety

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary action by predicting future step locations in advance and pre-positioning interactive items at these locations. This allows the user to simply continue their natural motion and automatically encounter the appropriate control options at the predicted future position, rather than having to manually search or gesture for controls

Inventive Principle:
Principle #10Preliminary action

2Productivity

If interactive items are displayed at future step locations based on motion prediction, then user safety and interaction efficiency improve, but system complexity increases due to motion tracking and prediction requirements

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The AR display device performs multiple functions: it displays augmented reality content, tracks user motion, predicts future step locations, and presents interactive items - all within a single integrated system. This multi-functionality reduces the need for separate specialized devices while maintaining interaction efficiency

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If control inputs are detected based on reaching selection areas, then ease of operation improves by allowing natural motion-based interaction, but measurement precision requirements increase for accurately detecting user position and motion

Engineering Contradiction:
Improveease of control inputVSAvoidposition detection precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system performs preliminary motion analysis to predict future step locations before the user actually reaches them. By anticipating where the user will be, the system can prepare and present interactive items at these future locations, reducing the precision needed for real-time position detection while maintaining ease of operation

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12372788B2User control in augmented reality
Publication Date: 2025.07.29 NOKIA TECHNOLOGIES OY
  • US12372788B2 patent drawing
  • US12372788B2 patent drawing
  • US12372788B2 patent drawing

AI summary

An apparatus, method and computer-program is described relating to user control in augmented reality (AR). For example, the method may comprise determining, based on motion of a user, one or more future step locations along a path. The method may also comprise displaying, via an augmented reality display device associated with the user, one or more interactive items. Each of the one or more interactive items may be associated with a respective one of the future step locations and is displayed so as to be perceived at a respective display position which is at or near said associated respective future step location. The method may also comprise detecting a control input associated with a particular interactive item, based at least in part on the user having reached a selection area which is at or near said associated future step location along the path.