Unified Image and 3D Model Search with Orientation Sync

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems require separate search queries for obtaining image and 3D model results, and users must manually interact with 3D models to match corresponding images, which is inefficient and lacks seamless integration.

Innovation Solution

A method and system that allow users to enter a single search query to obtain both image and 3D model results, with the ability to dynamically manipulate 3D models and automatically update image results to match the viewed orientation, using view selection data to rotate, translate, or zoom the 3D model, thereby synchronizing the image and 3D model views.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If users perform separate search queries for images and 3D models, then search results can be obtained independently for each type, but the user must manually interact with 3D models to match corresponding images, which is inefficient and lacks seamless integration

Engineering Contradiction:
Improvesearch operation efficiencyVSAvoidtime for manual matching
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent combines image search and 3D model search into a single unified search operation. The system processes one search query to simultaneously retrieve both image results and 3D model results, eliminating the need for separate search queries and manual matching operations. This merging of search functions directly addresses the contradiction by improving operational efficiency while reducing the time required for manual matching.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements automatic feedback mechanisms where the viewed orientation of the 3D model is continuously monitored and used to automatically update and synchronize the corresponding image results. This feedback loop eliminates manual matching by automatically adjusting image display based on the current 3D model view state, thereby reducing user effort and time investment.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If users manually manipulate 3D models to match corresponding images, then precise alignment can be achieved, but the process is inefficient and requires additional user effort

Engineering Contradiction:
Improvealignment precisionVSAvoidsearch processing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary actions by pre-processing and organizing both image and 3D model data with associated orientation information before the user interaction begins. When a user views a 3D model from a specific orientation, the corresponding image is already prepared and can be immediately synchronized, eliminating the need for manual manipulation while maintaining precise alignment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables self-service functionality where the synchronization between 3D model views and corresponding images occurs automatically without user intervention. The system autonomously monitors 3D model orientation changes and retrieves/matches the appropriate images based on predefined associations, achieving both precise alignment and high processing speed through automated operations.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If the system provides both image and 3D model results simultaneously, then user experience is enhanced with synchronized views, but the system complexity increases

Engineering Contradiction:
Improvesearch result integrationVSAvoidsystem architecture complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal search system that handles both image and 3D model queries through a single unified interface and processing pipeline. The system is designed to be multi-functional, accommodating different result types (images, 3D models, and their synchronized combinations) without requiring separate dedicated systems for each function. This universality achieves enhanced adaptability while managing system complexity through consolidation rather than proliferation of components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9372871B2Combining unstructured image and 3D search results for interactive search and exploration
Publication Date: 2016.06.21 GOOGLE LLC
  • US9372871B2 patent drawing
  • US9372871B2 patent drawing
  • US9372871B2 patent drawing

AI summary

Implementations relate to presenting search results to a user. In particular, disclosed techniques include presenting both image search results and 3D model search results to a user. The user can manipulate the 3D model depicted in the 3D model search results by rotating, translating or zooming. Implementations thus provide a rich synergistic exploration experience to the user.