Hybrid Visual Location Search System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current search systems are inadequate in providing relevant information to users who want to know details about locations they are currently at, as they require text-based queries and cannot efficiently utilize visual data from the user's surroundings.

Innovation Solution

A system that processes visual queries by receiving images from a client device, combines them with location information from GPS, cell towers, or local wireless networks, and sends them to a visual query search system, which enhances the location data and returns relevant local listings to the user.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If text-based queries are used for searching, then search systems can provide relevant results, but users cannot efficiently search for locations using visual data from their surroundings

Engineering Contradiction:
Improveease of useVSAvoidsearch capability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent combines visual query processing with location-based search to create a hybrid search system. The system merges image recognition results with geographic location data from GPS, cell towers, and wireless networks to provide comprehensive local listings that respond to both visual and spatial context, enabling users to search by taking pictures of locations rather than typing text queries

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The search system is enhanced to handle multiple types of queries simultaneously - visual queries through image recognition, location-based queries through GPS and network data, and text-based queries. This multi-functional capability allows the same system to serve diverse search needs across different contexts and user scenarios

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If location information is enhanced and combined with visual queries, then more accurate local listings are returned, but system complexity increases

Engineering Contradiction:
Improvelocation accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the search process into distinct functional modules: visual query processing, location information gathering from multiple sources (GPS, cell towers, wireless networks), location enhancement through visual context, and result generation. This modular segmentation manages complexity by organizing complex functions into separate, manageable components that can be developed and maintained independently

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary enhancement layer that processes raw location data and visual query results before generating final search results. This intermediary component enriches basic location coordinates with visual context from the captured image, such as identifying buildings, landmarks, or specific features in the photograph, thereby improving location accuracy without requiring complete system redesign

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10346463B2Hybrid use of location sensor data and visual query to return local listings for visual query
Publication Date: 2019.07.09 GOOGLE LLC
  • US10346463B2 patent drawing
  • US10346463B2 patent drawing
  • US10346463B2 patent drawing

AI summary

A visual query is received from a client system, along with location information for the client system, and processed by a server system. The server system sends the visual query and the location information to a visual query search system, and receives from the visual query search system enhanced location information based on the visual query and the location information. The server system then sends a search query, including the enhanced location information, to a location-based search system. The search system receives and provides to the client one or more search results to the client system.