Spatial Motion Control for Augmented Reality Map Interfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional methods of manipulating maps on mobile devices, such as using touchscreen interfaces, can be difficult for new users, especially those unfamiliar with complex gestures required for rotating, zooming, and interacting with three-dimensional maps.

Innovation Solution

Implementing a movement-controlled user interface that allows users to interact with maps by physically moving their mobile devices, using sensors and camera analysis to translate device movements into virtual camera controls, enabling intuitive zooming, rotating, and shifting of map views without requiring fingertip manipulation on the screen.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touchscreen interface gestures are used to control virtual camera position, then map interaction functionality is achieved, but user operation difficulty increases especially for new users

Engineering Contradiction:
Improveease of map interactionVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical touchscreen gesture system with a spatial motion control system. Instead of requiring users to perform complex finger gestures on the screen, the system detects the mobile device's physical movements in three-dimensional space (tilting, rotating, translating) and automatically translates these movements into corresponding virtual camera position changes. This substitution of mechanical gesture input with spatial motion sensing directly reduces operational difficulty while maintaining full map interaction functionality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service operation where the mobile device's own motion sensors and camera automatically track and interpret user movements without requiring explicit gesture commands. The device serves itself by using its built-in sensors to detect orientation changes and translate them into map navigation actions, eliminating the need for users to learn complex touchscreen gesture languages.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If traditional touchscreen gestures are required for rotating and zooming maps, then precise control is achieved, but ease of operation deteriorates

Engineering Contradiction:
Improveease of map navigationVSAvoidcontrol precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent substitutes precise touchscreen gesture recognition with spatial motion tracking using the device's camera and motion sensors. The system captures sequential images, detects feature point movements between frames, and calculates precise virtual camera position changes based on these optical flow measurements. This approach maintains measurement precision through computational image analysis while dramatically improving ease of operation by allowing natural hand-held device movements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary computational layer that translates physical device movements into precise virtual camera controls. The motion detection engine acts as a mediator, capturing raw sensor data and image sequences, processing them through feature tracking algorithms, and generating precise control commands for the virtual camera. This intermediary processing ensures that even small physical movements are accurately translated into precise map navigation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If touchscreen interface is used for three-dimensional map interaction, then map functionality is maintained, but user accessibility decreases for users unfamiliar with complex gestures

Engineering Contradiction:
Improveuser accessibilityVSAvoidinterface complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces the complex touchscreen gesture interface with a universal spatial motion interface that works intuitively for all users regardless of technical familiarity. By substituting gesture-based control with natural device movement detection, the system becomes accessible to users who may struggle with learning curves associated with swipe, pinch, and rotate gestures, while maintaining full three-dimensional map interaction functionality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The spatial motion control system serves multiple user groups universally - whether users are familiar with touchscreen gestures or not, the system adapts to their physical movements naturally. The same motion detection mechanism works for all users across different device types and operating systems, providing a universal interface that eliminates the need for user-specific gesture training while maintaining comprehensive map navigation capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach provides an intuitive and easy-to-use interface for interacting with three-dimensional maps, making it accessible to users who may struggle with traditional touchscreen manipulations, enhancing user experience and usability, especially for navigating unfamiliar areas.

Implementation Method 1

detected based on analysis of changes of size and relative placement of physical objects in images of a camera of the mobile device

Methodology Applied
Scientific EffectImage analysis: Image Processing

Data Source

PatentEP3616035B1Augmented reality interface for interacting with displayed maps
Publication Date: 2024.04.24 APPLE INC
  • EP3616035B1 patent drawingFigure 1
  • EP3616035B1 patent drawingFigure 2A
  • EP3616035B1 patent drawingFigure 2B

AI summary

Various embodiments of the disclosure pertain to an augmented or virtual reality interface for interacting with maps displayed from a virtual camera perspective on a mobile device. Instead of manipulating the position of the virtual camera using a touchscreen interface, some embodiments allow a spatial location of the mobile device to control the position of the virtual camera. For example, a user can tilt the mobile device to obtain different angles of the virtual camera. As another example, the user can move the mobile device vertically to change the height of the virtual camera, e.g., a higher altitude above the ground.