Interactive AR Overlay Alignment on Touch Displays in Motion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) systems are complex and expensive, making them unsuitable for general consumer use.

Innovation Solution

A device capable of receiving live video of a real-world environment, identifying objects, generating information layers, and synchronizing these layers with motion sensors to overlay computer-generated imagery, allowing for interactive AR displays on touch-sensitive surfaces and sharing between devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If existing AR systems are implemented, then augmented reality functionality is achieved, but device complexity and cost increase

Engineering Contradiction:
ImproveAR functionalityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies multi-functionality by enabling standard mobile devices with existing cameras, processors, and displays to perform AR functions without requiring specialized hardware. The system uses the device's built-in video camera, motion sensors, and display screen to achieve AR capabilities that were previously only available in complex dedicated AR systems

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses copying by creating a virtual information layer that overlays computer-generated imagery onto the real-world view captured by the device camera. This allows the system to replicate complex AR visualizations using software-based image processing and display composition rather than requiring specialized optical hardware

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If existing AR systems are implemented, then augmented reality functionality is achieved, but cost increases

Engineering Contradiction:
ImproveAR functionalityVSAvoidcost
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent enables AR functionality on standard mobile devices that consumers already own, eliminating the need to manufacture and distribute expensive dedicated AR hardware. By utilizing existing device components (camera, processor, display, motion sensors), the system achieves AR capabilities at zero additional hardware cost for the end user

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent employs software-based AR solutions that can be distributed digitally and updated remotely, replacing the need for expensive physical AR hardware. The virtual information layer and processing algorithms can be delivered as software updates, making the system economically accessible to consumers

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Reliability

If motion sensors are used for synchronization, then AR display synchronization is improved, but device complexity increases

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidsensor integration
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies self-service by utilizing motion sensors that are already built into standard mobile devices for AR synchronization purposes. The system repurposes existing device components (accelerometers, gyroscopes) to track device motion and synchronize the virtual information layer with the user's perspective, eliminating the need for additional specialized sensors

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12494026B1Synchronized, interactive augmented reality displays for multifunction devices
Publication Date: 2025.12.09 APPLE INC
  • US12494026B1 patent drawing
  • US12494026B1 patent drawing
  • US12494026B1 patent drawing

AI summary

A device can receive live video of a real-world, physical environment on a touch sensitive surface. One or more objects can be identified in the live video. An information layer can be generated related to the objects. In some implementations, the information layer can include annotations made by a user through the touch sensitive surface. The information layer and live video can be combined in a display of the device. Data can be received from one or more onboard sensors indicating that the device is in motion. The sensor data can be used to synchronize the live video and the information layer as the perspective of video camera view changes due to the motion. The live video and information layer can be shared with other devices over a communication link.