Rotational Gesture Image Search Using 3D Orientation Axes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image search engines do not allow users to specify a particular viewing angle for 2D images, limiting the ability to view objects from different angles, as they are not conducive to being represented by 3D image models.
Innovation Solution
A method that identifies objects in 2D images, determines a three-dimensional reference orientation axis, and allows users to input changes in perspective, searching for and displaying 2D images that match the new orientation, with a system that crowdsources missing viewpoints based on user demand.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If 2D images are used for display, then the display simplicity is maintained, but the ability to view objects from different angular perspectives is lost
Solution Approach 1:
The patent applies dimensionality change by introducing a 3D orientation axis concept to 2D image search. The system determines a three-dimensional reference orientation axis for objects in 2D images and uses this axis to enable rotational gesture-based searching. This allows 2D images to be searched and displayed from different angular perspectives without converting them to actual 3D models, effectively adding dimensional capability to 2D data.
2Adaptability or versatility
If 3D models are used to enable rotational viewing, then viewing angle flexibility is improved, but the complexity of information processing increases
Solution Approach 1:
The patent extracts only the essential orientation information (three-dimensional reference orientation axis) from 2D images rather than creating complete 3D models. This extraction approach captures the necessary data for rotational viewing while avoiding the complexity of full 3D reconstruction, processing, and storage.
Solution Approach 2:
The system creates a simplified representation (copy) of the orientation axis information from 2D images. Instead of working with complex 3D model data, the patent uses this copied orientation axis information to enable rotational searching and perspective changes, significantly reducing processing complexity while maintaining viewing flexibility.
3Ease of operation
If rotational gestures are applied to 2D images, then user input for perspective change is enabled, but the ability to generate different viewing angles is limited
Solution Approach 1:
The patent introduces a search engine as an intermediary between the user's rotational gesture input and the image database. The search engine uses the determined orientation axis and rotational gesture to query and retrieve 2D images that match the desired perspective. This intermediary system enables perspective change capability without requiring the original 2D images to actually contain 3D rotational data.
Data Source
AI summary
A method is provided to search for images. The method includes identifying an object in a two-dimensional reference image. The method includes determining a three-dimensional reference orientation axis of the object based on at least one attribute of the object. The method includes receiving an input that requests a change in a three-dimensional perspective of the object. The method further includes determining a new orientation axis based on the input and the reference orientation axis. The method includes executing a search query on a set of two-dimensional images, where the search query is based on the new orientation axis and at least one attribute of the object. The method also includes displaying image search results that are ranked based on correlations with the new orientation axis and the attribute of the object.