3D Object Browsing in Documents via 2D Image Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of electronic devices often seek visual experiences when searching for items or places, but existing technologies lack the ability to provide interactive, three-dimensional representations of images, limiting the sensory engagement and information accessibility.

Innovation Solution

A system that uses processors and computer-readable storage media to obtain query results, match two-dimensional images with three-dimensional models stored in a database, and initiate 3D rendering of selected image portions, allowing users to manipulate and interact with 3D objects, which can include community annotations and sponsored content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If two-dimensional images are used in search results, then the system remains simple and easy to implement, but user visual engagement and information accessibility are limited

Engineering Contradiction:
Improvevisual engagementVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transitions from two-dimensional images to three-dimensional models, adding a new dimension of interaction. Users can rotate, zoom, and manipulate 3D objects to view items from multiple angles, significantly enhancing visual engagement and information accessibility while maintaining a unified search interface.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system introduces an intermediary layer between the user and the object by using 3D models as a bridge. This intermediary provides rich visual information and interactive capabilities without requiring direct access to complex underlying data structures, thus improving user experience while managing system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If three-dimensional models are integrated into search results, then interactive viewing and information accessibility improve, but the system complexity and data processing requirements increase

Engineering Contradiction:
Improveinformation accessibilityVSAvoiddata processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-processing and indexing 3D model data before user queries are received. This includes extracting features, creating representations, and organizing data in advance, so that when users search, the system can quickly retrieve and display relevant 3D models without complex real-time processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses 2D image representations as copies or projections of 3D models. These 2D representations serve as accessible intermediaries that convey essential visual information while the full 3D models remain available for detailed interaction, thus balancing information accessibility with processing requirements.

Inventive Principle:
Principle #26Copying

3Ease of operation

If multiple viewing angles and interactive manipulation are enabled, then user experience and product evaluation improve, but the computational resources and rendering time increase

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidcomputational resource consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The system implements dynamic rendering capabilities that adapt to user interactions. When users rotate or zoom 3D models, the system dynamically adjusts rendering parameters to provide smooth, responsive views. This dynamic approach enhances ease of operation while optimizing computational resource consumption by only rendering what the user needs at each moment.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9025860B2Three-dimensional object browsing in documents
Publication Date: 2015.05.05 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9025860B2 patent drawing
  • US9025860B2 patent drawing
  • US9025860B2 patent drawing

AI summary

A document that includes a representation of a two-dimensional (2-D) image may be obtained. A selection indicator indicating a selection of at least a portion of the 2-D image may be obtained. A match correspondence may be determined between the selected portion of the 2-D image and a three-dimensional (3-D) image object stored in an object database, the match correspondence based on a web crawler analysis result. A 3-D rendering of the 3-D image object that corresponds to the selected portion of the 2-D image may be initiated.