Query Modification Using Non-Textual Context for Relevant Search

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing search systems struggle to modify queries based on the context of non-textual resources displayed on user devices, leading to potential topic drift and irrelevant search results.

Innovation Solution

A system that modifies search queries based on active non-textual data, such as images or videos, by determining modification data, generating candidate queries, scoring them, and selecting the highest-scoring query to provide relevant search results.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If query modification based on non-textual resource context is implemented, then search result relevance is improved, but system complexity increases

Engineering Contradiction:
Improvesearch result relevanceVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The query processing system is divided into distinct modules: a non-textual resource context analyzer that extracts context from images/videos, a query modifier that generates candidate queries, and a scorer that ranks candidates. This segmentation allows each component to specialize in one task, improving overall relevance while managing complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

An intermediary query modification system is introduced between the user's original query and the search engine. This intermediary analyzes non-textual context, generates multiple candidate queries, scores them, and selects the best match, thereby improving result relevance without requiring the search engine itself to become more complex.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple candidate queries are generated and scored, then query accuracy is improved, but processing time increases

Engineering Contradiction:
Improvequery accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Instead of generating and scoring all possible query variations, the system generates a limited set of candidate queries (e.g., 3-5 top candidates) based on the most relevant non-textual context features. This partial action approach achieves sufficient query accuracy without the exponential time cost of exhaustive enumeration.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system performs preliminary filtering of non-textual context features before query generation, identifying only the most salient context elements that are likely to improve query accuracy. This preliminary action reduces the search space and accelerates the overall processing time while maintaining query precision.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If query modification is always performed, then search completeness is improved, but user experience deteriorates due to unnecessary modifications

Engineering Contradiction:
Improvesearch completenessVSAvoiduser experience
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system dynamically adjusts the query modification parameter based on the quality and relevance of detected non-textual context. When high-quality context is detected, modification is enabled to improve completeness; when context is absent or low-quality, modification is disabled to preserve user experience. This parameter change approach balances adaptability with ease of operation.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12499152B1Query modification based on non-textual resource context
Publication Date: 2025.12.16 GOOGLE LLC
  • US12499152B1 patent drawing
  • US12499152B1 patent drawing
  • US12499152B1 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, modifying queries based on non-textual content. In one aspect, a method includes receiving, from a user device, a query including a plurality of terms; determining active non-textual data displayed in an application environment on the user device; determining, from the non-textual textual data, modification data for the query; generating a set of modified queries based on the query and the modification parameters; scoring the modified queries according to one or more scoring criteria; selecting one of the modified queries based on the scoring; and providing, to the user device, search results responsive to the selected modified query.