Multimedia Query Generation for Search Precision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Web search engines face challenges in providing relevant search results due to language differences and users' inability to accurately express their queries using textual searches, especially when seeking information through multimedia content.

Innovation Solution

A method and system that generate textual search queries from multimedia elements by analyzing and creating signatures, which are then used to search multiple information sources, allowing for the display of relevant search results on user devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If users enter textual search queries, then the search process is simple and fast, but the search precision deteriorates due to language differences and inability to accurately express search objectives

Engineering Contradiction:
Improvesearch process simplicityVSAvoidsearch precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces multimedia content as an intermediary between the user and the search engine. Instead of directly entering text queries, users submit multimedia content (images, audio, video) that serves as a mediator to convey search intent more accurately, overcoming language barriers and expression limitations while maintaining ease of use

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical text-input system with an automated multimedia analysis system. The search engine automatically extracts features and generates text queries from submitted multimedia content, substituting the manual text-entry mechanism with an automated content-based approach that improves precision without sacrificing user convenience

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If web search engines use textual queries, then the system complexity remains low, but the ability to handle language differences and diverse user expressions deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidlanguage adaptability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent makes the search engine universal by enabling it to process multiple types of input (multimedia content in various languages and formats) and convert them into standardized text queries. This multi-functional capability allows the system to handle diverse user expressions and language differences while maintaining a unified search processing framework

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent changes the input parameters from text-only to multimedia-based inputs. By accepting images, audio, and video as search queries and transforming them into text through automated analysis, the system adapts to diverse user expressions and language differences without requiring complex multilingual text processing capabilities

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11537636B2System and method for using multimedia content as search queries
Publication Date: 2022.12.27 CORTICA LTD
  • US11537636B2 patent drawing
  • US11537636B2 patent drawing
  • US11537636B2 patent drawing

AI summary

There is provided a method for searching a plurality of information sources using a multimedia element, the method may include receiving at least one multimedia element; generating, by a signature generator, for the at least one multimedia element at least one signature that is unidirectional, and yields compression; generating at least one textual search query using the at least one signature; wherein the generating of the textual search query comprises: (a) searching for at least one matching stored signature that matches one or more of the at least one signature; and (b) using a mapping between stored signatures and textual search queries, selecting at least one textual search query mapped to at least one matching stored signature; searching the plurality of information sources using the at least one textual search query; and causing a display of search results retrieved from the plurality of information sources.