Image Segmentation and Silhouette Links for Automatic In-App Search
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods require users to manually search for information related to images using multiple keywords in online environments, which is inefficient and cumbersome.
Innovation Solution
An apparatus and method that segments images into objects, extracts context and keywords, generates hyperlinks, and maps silhouettes to these objects, enabling automatic keyword-based online searches.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If users manually search for information related to images using multiple keywords in online environments, then search information can be obtained, but the process is inefficient and cumbersome
Solution Approach 1:
The system performs automatic image segmentation, object recognition, and keyword extraction without requiring user intervention. The terminal device autonomously generates search keywords and retrieves information based on the uploaded image, eliminating the need for manual keyword input and multiple search attempts by users.
Solution Approach 2:
The patent replaces the manual mechanical process of keyword input and search execution with an automated computer vision system. The system uses image segmentation algorithms, object recognition models, and natural language processing to automatically generate search queries and retrieve information, substituting human manual operations with automated computational processes.
2Adaptability or versatility
If users switch between gallery application and browser application to search for photo information, then online information can be accessed, but the operation becomes complex and inconvenient
Solution Approach 1:
The patent merges the functionality of the gallery application and browser application into a single integrated system. The terminal device combines offline image storage and display capabilities with online information retrieval functions, allowing users to upload images from the gallery and automatically obtain related online information within the same application environment, eliminating the need to switch between applications.
Solution Approach 2:
The terminal device is designed with multi-functional capabilities, serving both as a local image gallery and an online information search platform. The system can perform local image display, automatic keyword extraction, web search, and information presentation within a single application, providing universal access to both offline and online services without requiring separate applications.
3Measurement precision
If users attempt multiple searches by combining appropriate search keywords to obtain optimal search information, then search accuracy can be improved, but the process becomes time-consuming and complex
Solution Approach 1:
The system segments the image into multiple objects or regions of interest, extracting features from each segment independently. This segmentation allows the system to generate multiple relevant keywords automatically from different parts of the image, improving search accuracy by capturing diverse information aspects without requiring users to manually combine multiple search terms.
Solution Approach 2:
The patent introduces an intermediary layer consisting of automatic keyword extraction and search query generation modules between the user and the search engine. This intermediary system analyzes the uploaded image, extracts relevant objects and features, generates appropriate search keywords, and formulates search queries automatically, thereby improving search accuracy while keeping the user interface simple and the search process transparent.
Data Source
AI summary
A method and apparatus for providing information are provided, and the method may include receiving an image from a terminal, obtaining coordinate information on objects included in the image from the image, extracting contexts including the objects included in the image and intentions of the objects from the image, obtaining at least one segmented image based on the image and the contexts, obtaining at least one keyword related to at least one of the objects based on the contexts, generating a hyperlink based on the at least one segmented image and the at least one keyword, generating a silhouette based on the hyperlink and the coordinate information, mapping the hyperlink to the silhouette, and transmitting the silhouette to which the hyperlink is mapped to the terminal.