Markerless AR Content Superimposition on Flat Surfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing markerless augmented reality systems face limitations due to inaccurate GPS devices, inability to function indoors or underground, and the need for network connectivity, as well as the barrier of requiring specialized equipment like head-mounted displays for users to engage with ads in an AR space.

Innovation Solution

A markerless augmented reality system that injects ads into the AR space by detecting feature-rich flat surfaces using a mobile device's camera, allowing for the superimposition of digital content such as text, graphics, and video, and enabling user interaction through touch, voice, or gestures, with personalized ad selection based on user profiles and behavior.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If GPS-based markerless AR is used to deliver location-based ads, then users can access digital content at physical locations, but the system fails indoors or underground and requires network connectivity

Engineering Contradiction:
Improvelocation-based ad deliveryVSAvoidindoor/underground functionality
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces visual feature detection and surface recognition as intermediary mechanisms between the user device and the physical environment. Instead of relying solely on GPS coordinates, the system uses camera-based feature detection to identify and track real-world surfaces, serving as a mediator that enables AR functionality in environments where GPS is unavailable.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the GPS-based mechanical positioning system with a vision-based system using camera feeds and image processing. This substitution allows the system to determine device position and orientation relative to physical surfaces through visual features rather than satellite signals, enabling operation indoors and underground.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If head-mounted displays are used for AR ad engagement, then users can experience immersive AR content, but users must acquire specialized equipment creating a barrier to access

Engineering Contradiction:
ImproveAR ad engagementVSAvoidspecialized equipment requirement
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent makes the AR system universal by designing it to work with standard mobile devices that most users already possess. The system leverages the camera, processor, and display of common smartphones and tablets, eliminating the need for specialized head-mounted displays while maintaining effective AR ad engagement capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent creates a simplified version of the AR experience that runs on existing mobile devices rather than requiring dedicated hardware. By copying and adapting AR technologies to work on standard smartphones and tablets, the system provides accessible AR functionality without needing specialized equipment.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If GPS devices with limited accuracy are used for AR content delivery, then location-based advertising can be implemented, but the positioning precision is insufficient for accurate ad placement

Engineering Contradiction:
Improvelocation-based advertisingVSAvoidpositioning accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent merges GPS location data with visual feature detection and surface recognition technologies. By combining these multiple positioning methods, the system achieves higher measurement precision than GPS alone could provide, enabling accurate ad placement by correlating geographic coordinates with visually identified physical surfaces.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10055894B2Markerless superimposition of content in augmented reality systems
Publication Date: 2018.08.21 INSIGHT TERRA INC
  • US10055894B2 patent drawing
  • US10055894B2 patent drawing
  • US10055894B2 patent drawing

AI summary

A method is provided for markerless injection of content into an augmented reality scene by use of a mobile device. Through the mobile device, a camera feed of a scene is acquired, which includes a flat surface. A key frame of the flat surface is selected from the feed. After determining that the flat surface in the key frame meets a predetermined level of feature richness, digital content is injected by superimposing text, graphics, video content over at least a part of the key frame. The digital content can be viewed and interacted with by the user of the mobile device. In one embodiment, the digital content is an advertisement.