Personalized AR Overlay via Preference-Based Image Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality services often provide limited and repetitive information, leading to user disinterest due to the lack of personalization based on user preferences and location-specific content.

Innovation Solution

An electronic device equipped with a camera, display, memory, and processor that captures images, determines user preferences, and overlays relevant additional information based on captured images and live views, providing personalized AR experiences by associating images with categories and preferences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If the same additional information is provided to all electronic devices at the same location, then the service is easy to implement, but the user interest is lost due to lack of personalization

Engineering Contradiction:
Improveease of service implementationVSAvoidpersonalization capability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent segments the additional information into multiple categories (e.g., first category and second category) and selectively provides different categories to different users based on their preferences. This allows the service to be personalized without requiring complete customization of all information, balancing ease of implementation with personalization capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary action by pre-collecting user preference information and pre-categorizing additional information before providing the AR service. This allows the system to quickly retrieve and display personalized information without complex real-time processing, maintaining ease of implementation while achieving personalization.

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If limited additional information is provided based on location, then the service is simple to provide, but the variety and relevance of information is limited

Engineering Contradiction:
Improveservice complexityVSAvoidvariety of information
Core Design Contradiction:
Device complexityVSQuantity of substance

Solution Approach 1:

The patent segments additional information into multiple categories and selectively provides relevant categories to users based on their preferences. This approach increases the variety of information provided without requiring the system to manage and process all possible information types simultaneously, thus maintaining service simplicity while expanding information variety.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by providing different types of additional information to different users at the same location based on their individual preferences. Each user receives information tailored to their specific interests, increasing the relevance and variety of information without requiring a complete overhaul of the service structure.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If personalized additional information is provided based on user preferences, then user engagement is enhanced, but the processing complexity increases

Engineering Contradiction:
Improvepersonalization levelVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent reduces processing complexity by performing preliminary actions: collecting user preference information and categorizing additional information in advance. This pre-processing allows the system to quickly retrieve and display personalized information without complex real-time analysis, maintaining high personalization levels while keeping processing requirements manageable.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments both user preferences and additional information into discrete categories, making it easier to match and retrieve relevant information. This segmentation simplifies the processing logic compared to handling unstructured data, thereby reducing processing complexity while maintaining adaptability.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11308653B2Electronic device and method for providing augmented reality service based on a user of electronic device
Publication Date: 2022.04.19 SAMSUNG ELECTRONICS CO LTD
  • US11308653B2 patent drawing
  • US11308653B2 patent drawing
  • US11308653B2 patent drawing

AI summary

An electronic device is disclosed. The electronic device according to an embodiment disclosed in the disclosure includes a camera, a display, a memory storing a plurality of captured images and preference information for each captured image, and a processor operatively connected to the camera, the display, and the memory, wherein the processor obtains a live view image using the camera, determines at least one image of which a preference is relatively high among the plurality of captured images as additional information of an augmented reality service based on at least one of the preference information or an object included in the live view image, and displays the additional information and the live view image on the display.