AR Object Filtering via Image Recognition and Tagging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face inefficiencies in identifying and selecting specific products within a scene, such as a grocery store, due to the need for repetitive and tedious searches, and difficulty in keeping track of product preferences.

Innovation Solution

A computing system that processes image data from a mobile device to recognize objects in a scene, generate tags associated with these objects, filter objects based on user selections, and provide object-specific information overlaid on the image data through an augmented reality interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If users manually search for products in a scene, then they can identify product information, but the process is repetitive and time-consuming

Engineering Contradiction:
Improveproduct identification accuracyVSAvoidsearch time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical searching with automated optical recognition. Image capture devices and processing systems automatically detect, identify, and filter products in scenes, substituting human visual search with computational image analysis. This resolves the contradiction by maintaining accurate product identification while eliminating repetitive manual search time.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs preliminary actions by pre-processing and indexing product information before user queries. Image data is captured and analyzed in advance, product databases are pre-organized with filters and attributes, enabling rapid retrieval and comparison without requiring users to manually search through products during shopping.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If users track multiple product preferences, then they can make informed selections, but it becomes difficult to keep track of preferences

Engineering Contradiction:
Improveproduct preference trackingVSAvoidinformation management complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary computing system that manages product preference information between the user and the vast product database. This intermediary automatically stores, organizes, and retrieves preference data, filtering products based on user criteria without requiring users to manually track multiple preferences. The system handles the complexity of information management while users benefit from simplified product selection.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If comprehensive product information is provided, then users can make better decisions, but information overload occurs

Engineering Contradiction:
Improveproduct information completenessVSAvoidinformation processing ease
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent applies local quality by providing different levels of information detail to different users based on their specific needs and preferences. The system filters and prioritizes product information, presenting only relevant attributes and details to each user. This ensures comprehensive information is available in the database while users receive customized, manageable information sets that are easy to process and compare.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system initially provides comprehensive product information (excessive action) but then filters and prioritizes based on user preferences and behavior. By offering complete information upfront and then selectively presenting relevant portions, the system ensures no important information is lost while making the actual user experience manageable and easy to operate.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20250148782A1Object Filtering and Information Display in an Augmented-Reality Experience
Publication Date: 2025.05.08 GOOGLE LLC
  • US20250148782A1 patent drawing
  • US20250148782A1 patent drawing
  • US20250148782A1 patent drawing

AI summary

Systems and methods for providing scene understanding can include obtaining a plurality of images, stitching images associated with the scene, detecting objects in the scene, and providing information associated with the objects in the scene. The systems and methods can include determining filter tags or query tags that can be selected to filter the plurality of objects, which can then be provided as information to the user to provide further insight on the scene. The information may be provided in an augmented-reality experience via text or other user-interface elements anchored to objects in the images.