Structured Social Data Aggregator for Search Results
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current search engines and social networking services are inefficient in providing structured product information, as they often return unorganized and biased results, requiring users to perform multiple searches and manually sort through irrelevant data.
Innovation Solution
A structured and social data aggregator system that crawls web pages and social networks to extract, normalize, and classify data, merging structured product information with social networking information to provide a comprehensive and accurate data store, allowing users to perform a single query for highly relevant results.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If search engines crawl and index web pages to provide search results, then the quantity of information available increases, but the organization and structure of the information deteriorates
Solution Approach 1:
The patent segments information into structured categories (product information, specifications, pricing, reviews) and unstructured data (social media posts, forum discussions). Structured data is extracted and organized into standardized fields, while unstructured data is processed separately, allowing the system to maintain organization while incorporating diverse information sources.
Solution Approach 2:
The patent introduces an intermediary processing layer between data collection and presentation. This layer includes data extraction modules, normalization engines, and aggregation services that transform raw web data into structured formats, mediating between the unorganized nature of web content and the need for organized information delivery.
2Quantity of substance
If search engines return comprehensive search results, then the completeness of information improves, but the time required to sort through results increases
Solution Approach 1:
The patent performs preliminary actions by pre-processing and structuring data during the crawling and indexing phase. Information is extracted, normalized, and organized into structured formats before user queries are submitted. This preliminary structuring enables rapid filtering and presentation of relevant results without requiring users to manually sort through unorganized data.
Solution Approach 2:
The patent changes parameters by transforming unstructured web data into structured formats with defined schemas. Product information is converted into standardized fields (price, specifications, availability), and search results are ranked using multiple parameters including relevance, recency, and user preferences, enabling efficient result presentation.
3Measurement precision
If shopping search engines search by category or specification attributes, then the precision of product information extraction improves, but the extent of websites included in the index deteriorates
Solution Approach 1:
The patent creates a universal data extraction framework that can handle multiple website formats and structures through a single system. The extraction engine adapts to different website templates and data formats while maintaining consistent output schemas, enabling the system to process information from diverse sources including retail websites, manufacturer pages, and third-party sellers.
Data Source
AI summary
Information is obtained from the Internet is combined with processed and rated information from social networking services by a structured and social data aggregator providing highly relevant search results. In accordance with an embodiment of the present invention, there is provided a product information crawler, which crawls the Internet in search of web pages relevant to a requested subject or product. The product information crawler conveys captured web pages to a structured data extractor, which extracts product information. A social networking crawler crawls social networking services in search of social network information to the requested subject or product. The processed product information and processed social network information is conveyed to an information aggregator, which merges the information and stores it in a data store that can be queried by a user. A user would then be able conduct a single search about a subject or product, and retrieve highly relevant structured product information enhanced by social networking information.