Augmented Shopping Overlay for Mobile Terminals

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing shopping systems fail to effectively provide augmented reality-based information to users in physical stores, limiting the ability to efficiently locate items and receive relevant shopping information on mobile devices.

Innovation Solution

A method and system that uses a mobile terminal with a camera, location determination module, and wireless communication circuit to establish the user's location within a store, overlaying graphic indications of item locations and supplemental information, such as pricing, onto a real-time image of the store environment, utilizing NFC or WLAN triangulation and user profiles for personalized shopping experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a mobile terminal with camera and location determination is used to provide augmented shopping information, then the user shopping experience is enhanced with real-time location-specific information, but the device complexity increases

Engineering Contradiction:
Improveshopping experience enhancementVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The mobile terminal is designed to perform multiple functions: capturing real-time images via camera, determining location using NFC/WLAN triangulation, processing augmented reality overlay, and displaying information. This multi-functional approach allows a single device to provide comprehensive shopping assistance without requiring separate specialized equipment for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an augmented reality overlay as an intermediary layer between the user and the physical store environment. This virtual information layer mediates the interaction by providing location-specific shopping information without requiring direct modification of the physical store or the mobile terminal hardware.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If real-time image processing and augmented reality overlay are implemented, then location-specific shopping information is provided effectively, but the processing time and energy consumption increase

Engineering Contradiction:
Improveinformation delivery effectivenessVSAvoidenergy consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The system pre-loads product location data and store layout information into the mobile terminal before the user enters the store. This preliminary preparation reduces the amount of real-time processing required during shopping, as the device only needs to overlay pre-prepared information on the live camera feed rather than processing all information from scratch.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The augmented reality overlay is applied selectively only to regions of the image where relevant shopping information exists. Rather than processing the entire image uniformly, the system identifies and enhances only the specific areas containing products of interest, reducing overall processing requirements while maintaining information effectiveness.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If multiple wireless transmitters (NFC, WLAN) are used for location determination, then location accuracy is improved, but the device complexity and energy consumption increase

Engineering Contradiction:
Improvelocation accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple location determination technologies (NFC and WLAN triangulation) into a unified location system. By merging these technologies, the system achieves higher location accuracy through cross-validation and complementary data, while managing complexity through integrated processing that handles both signal types through a single location determination algorithm.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances the user's shopping experience by providing real-time, location-specific information on item locations and promotions, improving navigation and decision-making within the store.

Implementation Method 1

the known physical location wireless transmitter may be a near field communication (NFC) transmitter

Methodology Applied
Scientific EffectNear field communication:

Implementation Method 2

Establishing the location includes determining the location based on triangulation using signals received from the plurality of wireless local area network transmitters

Methodology Applied
Scientific EffectTriangulation:

Data Source

PatentEP2281274B1Systems methods and computer program products for providing augmented shopping information
Publication Date: 2019.06.05 SONY ERICSSON MOBILE COMMUNICATIONS AB
  • EP2281274B1 patent drawingFigure 1
  • EP2281274B1 patent drawingFigure 2
  • EP2281274B1 patent drawingFigure 3

AI summary

Methods for providing augmented shopping information to a user of a mobile terminal in a store include providing a shopping list identifying a plurality of items and obtaining information regarding physical locations of respective ones of the items in the store. The location of the mobile terminal in the store is established. An image of a view from the location is obtained. At least one of the items having an associated location in the obtained image is identified based on the obtained information regarding physical locations. A position within the image corresponding to the respective physical location of the identified at least one of the items is determined. A graphic indication of the identified at least one of the items is added to the obtained image at the determined position within the image to provide an augmented image of the view. The augmented image of the view is displayed to the user on a display of the mobile terminal.