Context-Aware Action Filtering for Retail Video Object Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Retail information processing systems face challenges in efficiently providing relevant actions to administrators for recognized objects in video feeds, as existing systems often present unnecessary actions that are not context-specific, leading to confusion and inefficiency in data collection and management.

Innovation Solution

A system that recognizes objects in a retail environment and provides context-specific actions to administrators, using a processor circuit to analyze video data, determine object contexts, and limit displayed actions to only those relevant to the recognized object, with optional AI-driven evolution of action sets based on data and environmental changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If all possible actions are presented to administrators regardless of context, then administrators have comprehensive options, but administrators experience confusion and inefficiency due to irrelevant actions

Engineering Contradiction:
Improvecomprehensive action optionsVSAvoidadministrative efficiency
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system applies local quality by customizing the set of presented actions based on the specific context of each recognized object. Instead of presenting a uniform set of all possible actions to all administrators, the system dynamically filters and presents only those actions that are relevant to the current object context (e.g., shopping cart context, checkout context), thereby maintaining comprehensiveness where needed while eliminating irrelevance in specific situations.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system employs dynamics by making the action set adaptive and changeable based on real-time context. The presented actions are not static but dynamically adjusted according to the recognized object, environmental conditions, and operational state, allowing the interface to evolve from presenting all possible actions to presenting only contextually relevant actions as the system gains understanding of the situation.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If context-specific actions are filtered and presented, then administrative efficiency improves, but system complexity increases due to context determination requirements

Engineering Contradiction:
Improveadministrative efficiencyVSAvoidcontext analysis system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system applies universality by implementing a multi-functional processor that performs both object recognition and context determination using the same hardware infrastructure. The processor circuit is designed to handle multiple functions (video analysis, object identification, context inference, action filtering) within a single integrated system, reducing the need for separate specialized components and thereby mitigating the increase in overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Speed

If video data is analyzed in real-time to recognize objects and determine context, then relevant actions can be provided promptly, but data processing time and computational resources increase

Engineering Contradiction:
Improveaction provision speedVSAvoidcomputational resource consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system applies partial action by performing selective analysis of video data rather than processing every frame or every pixel uniformly. The processor focuses computational resources on identifying key objects and determining their context only when necessary, rather than continuously analyzing all visual information. This approach provides timely context-specific actions while reducing overall computational burden and energy consumption.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10997414B2Methods and systems providing actions related to recognized objects in video data to administrators of a retail information processing system and related articles of manufacture
Publication Date: 2021.05.04 TOSHIBA GLOBAL COMMERCE SOLUTIONS HLDG
  • US10997414B2 patent drawing
  • US10997414B2 patent drawing
  • US10997414B2 patent drawing

AI summary

Method of processing video data in a retail information processing system can include recognizing an object within a video data feed to provide a recognized object within a retail environment. A context for the recognized object can be determined and a plurality of possible actions can be provided on an electronic display to an administrator of the retail information processing system, where the plurality of possible actions limited to only actions taken in the context for the recognized object. A selection from among the plurality of possible actions to be taken in the context for the recognized object can be received to provide a selected action relative to the recognized object.