Visual Search Interface with Cascading Layout and Structured Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current search engines fail to provide images with associated structured data, leading to incomplete results for users seeking to complete tasks, as they often display images without relevant details or lists of results without images, making it difficult for users to find suitable ideas or projects.

Innovation Solution

A system that presents search engine results with a cascading waterfall layout of images and corresponding structured data, allowing users to select images to view detailed information such as ingredients, materials, and steps, while adjusting the layout based on user interactions without requiring new searches.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If search engines display only images without structured data, then visual exploration is improved, but task completion information is lost

Engineering Contradiction:
Improvetask completion informationVSAvoidvisual exploration
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent combines image results with structured data (recipes, materials, steps) into a unified search result display. The system merges visual content with task completion information by presenting both together in the search results, allowing users to see images alongside associated structured data without needing to click through to separate webpages.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent segments the search result into distinct components: image thumbnails, structured data elements (ingredients, materials, steps), and interaction options. This segmentation allows users to quickly scan visual content while having immediate access to detailed task information, resolving the contradiction between visual exploration and information completeness.

Inventive Principle:
Principle #1Segmentation

2Loss of time

If search engines redirect users to separate webpages for detailed information, then information completeness is improved, but user time and navigation complexity increase

Engineering Contradiction:
Improveuser search timeVSAvoiddetailed task information
Core Design Contradiction:
Loss of timeVSLoss of information

Solution Approach 1:

The patent merges detailed task information directly into the search result page, eliminating the need for users to navigate to separate webpages. Structured data including recipes, materials lists, and step-by-step instructions are presented alongside image results, allowing users to access complete information immediately without additional navigation steps.

Inventive Principle:
Principle #5Merging (Combining)

3Adaptability or versatility

If search engines present comprehensive structured data with images, then task completion capability is improved, but interface complexity increases

Engineering Contradiction:
Improvetask completion capabilityVSAvoidinterface complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments structured data into distinct, organized elements (images, titles, ingredients/materials, steps) that are clearly separated and labeled. This segmentation makes the comprehensive information easier to navigate and understand, reducing perceived interface complexity while maintaining full task completion capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by presenting different types of information with appropriate visual treatments - images for visual exploration, structured text for task details, and interactive elements for user engagement. Each element is optimized for its specific function, making the overall interface more usable despite the comprehensive information provided.

Inventive Principle:
Principle #3Local quality

4Productivity

If search engines allow multiple images with structured data in a single view, then user efficiency is improved, but layout management becomes complex

Engineering Contradiction:
Improveuser search efficiencyVSAvoidlayout management
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the search result page into organized sections with multiple images and their corresponding structured data. Each image is paired with its associated structured information in a consistent layout pattern, allowing users to efficiently compare multiple options while the system manages the complex layout through standardized segmentation.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11797632B2Image reranking and presentation for visual exploration
Publication Date: 2023.10.24 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11797632B2 patent drawing
  • US11797632B2 patent drawing
  • US11797632B2 patent drawing

AI summary

The present disclosure relates to systems, devices, and methods for a visual exploration of search engine results. The systems, devices, and methods may present, in response to receiving the search engine results for a query to perform a task, a search result webpage with a cascading waterfall layout that includes a plurality of images from a plurality of webpages included in the search results. The search result webpage may also present, adjacent to the plurality of images, structured data corresponding to a selected image from the plurality of images where the structured data includes details from the webpage to complete the task.