Geospatial Image Selection Through Location-Aware See-Through Overlays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mobile devices struggle to effectively present images and audio content based on the physical location and orientation of the user, limiting the ability to view obstructed content and providing immersive visual experiences.

Innovation Solution

A mobile device, such as smart glasses, equipped with a visible light camera, GPS, and eye movement tracking, captures images and audio, adds location coordinates and timestamps, and overlays relevant content on the user's field of view through see-through displays, allowing selection and presentation of nearby captured images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If mobile devices present images based on physical location and orientation, then users can view obstructed content and experience immersive visuals, but device complexity increases due to integration of multiple sensors and processing requirements

Engineering Contradiction:
ImproveAbility to present location-based contentVSAvoidIntegration of sensors and processing systems
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple sensors (GPS, accelerometer, gyroscope, magnetometer) and processing functions into a unified location-based image presentation system. The mobile device integrates these components to automatically determine physical location, calculate bearing to image locations, and present relevant images without requiring separate systems for each function.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The mobile device performs multiple functions using a single integrated system: it captures images, determines physical location, calculates bearings to image locations, retrieves stored images based on location data, and presents them through the display. This multi-functional approach reduces the need for separate dedicated systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If the device processes and presents multiple location-based images, then content selection capability improves, but processing time and computational resources increase

Engineering Contradiction:
ImproveContent selection capabilityVSAvoidProcessing time for image retrieval and presentation
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system pre-calculates and stores image location data, including geographic coordinates and bearing information, before they are needed for presentation. When the user is at a location, the device quickly retrieves pre-processed image data based on the current physical location and calculated bearing, rather than processing raw data in real-time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex real-time image processing and matching algorithms with a simpler system that uses pre-stored location data and bearing calculations. The device substitutes computational image analysis with geometric calculations based on GPS coordinates and sensor data, significantly reducing processing time.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20250218138A1Geospatial image surfacing and selection
Publication Date: 2025.07.03 SNAP INC
  • US20250218138A1 patent drawing
  • US20250218138A1 patent drawing
  • US20250218138A1 patent drawing

AI summary

System, method, and non-transitory computer readable medium for presenting images on a mobile device. Images are presented by monitoring the location and the orientation of the mobile device, requesting previously captured images corresponding to where the previously captured images were captured in relation to the location from a server, receiving the requested previously captured images from the server, selecting images from the requested previously captured images responsive to the location and the orientation of the mobile device, generating overlay images from the selected images including image icons associated with the selected images, presenting the overlay images on an optical assembly, receiving an image selection identifying one of the image icons in the presented overlay images, and display the selected image associated with the identified image icon on the viewing area of the optical assembly.