Progressive Street View Image Retrieval on Mobile Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing online mapping applications face challenges in providing high-quality street view images on mobile devices due to limited communication bandwidth, leading to delays in image retrieval and navigation limitations.

Innovation Solution

Implement intuitive user interface techniques and optimization methods such as gesture-based navigation, scheduling image requests, and using textual representations to mitigate delays, allowing users to view different angles and segments of street level images efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If high quality street view images are retrieved on mobile devices, then image quality is improved, but communication bandwidth is exceeded causing delays

Engineering Contradiction:
Improveimage qualityVSAvoidretrieval delay
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent segments the street view image into multiple priority levels (first priority, second priority, third priority segments). The mobile device first retrieves and displays the first priority segment containing the viewpoint location, then progressively retrieves lower priority segments as bandwidth becomes available. This segmentation allows the system to provide acceptable image quality quickly while managing bandwidth constraints.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary action by pre-determining the priority segmentation of street view images based on their spatial relationship to the viewpoint location before retrieval. This pre-established priority structure enables the mobile device to efficiently retrieve and display the most important image segments first without requiring complex real-time decisions during the retrieval process.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If complete street view images are displayed, then viewing completeness is improved, but bandwidth consumption increases causing delays

Engineering Contradiction:
Improveviewing completenessVSAvoidretrieval delay
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent implements partial action by retrieving and displaying only the necessary portions of the street view image at different priority levels. Instead of retrieving the complete image all at once, the system first retrieves the essential first priority segment, then progressively adds second and third priority segments as bandwidth permits, providing a progressively complete view without the initial delay of downloading the entire image.

Inventive Principle:
Principle #16Partial or excessive action

3Area of stationary object

If multiple buildings and angles are shown, then view coverage is improved, but image retrieval complexity increases

Engineering Contradiction:
Improveview coverageVSAvoidretrieval complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent applies local quality by assigning different priority levels to different spatial regions of the street view image based on their importance to the user experience. The first priority segment focuses on the viewpoint location and immediate surroundings, while lower priority segments cover peripheral areas. This allows the system to manage retrieval complexity by handling the most important local area first, then progressively adding coverage of additional buildings and angles.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP2577440B1Adjustable and progressive mobile device street view
Publication Date: 2015.04.01 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP2577440B1 patent drawingFigure 1
  • EP2577440B1 patent drawingFigure 2
  • EP2577440B1 patent drawingFigure 3A

AI summary

Intuitive and user-friendly user interface (UI) techniques are provided for navigating street view applications on a mobile device enabling users to view different angles and segments of available street level images. Additionally, retrieval and presentation of street view images are managed to mitigate delays in retrieval of desired images from a server over wireless connections through techniques such as textual representations, replacement views, scheduling image requests, and comparable ones.