Object Recognition State Indicators for User Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Object recognition software often results in imperfect or incorrect identification of objects in images due to a lack of user feedback and visual indicators, making it difficult for users to understand and assist the recognition process.

Innovation Solution

The implementation of object recognition state indicators that visually represent the recognition process on a user device, providing distinct visual cues for precursor and identification states, allowing users to provide feedback and improve the recognition process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If object recognition software operates without user feedback during the identification process, then the software can run autonomously in the background, but the object recognition accuracy deteriorates due to lack of user input and understanding

Engineering Contradiction:
Improveautonomous operationVSAvoidobject recognition accuracy
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The patent implements visual feedback by displaying state indicators that show users the current stage of object recognition processing. This allows users to understand what the software is doing and provide timely feedback, resolving the contradiction between autonomous operation and recognition accuracy by maintaining automation while adding user awareness and input capability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces state indicators as an intermediary between the autonomous object recognition software and the user. These indicators mediate the communication by translating internal software states into visible cues, enabling users to understand and interact with the autonomous process without disrupting its operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If no visual indicators are displayed during object recognition, then the interface remains simple and uncluttered, but user understanding of the recognition process deteriorates

Engineering Contradiction:
Improveinterface simplicityVSAvoiduser understanding
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent uses color changes in state indicators to convey different recognition stages and object states. By using distinct colors for different states (e.g., precursor states vs. identification state), the system provides rich information feedback while maintaining interface simplicity through a consistent visual language that doesn't require complex UI elements.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent segments the object recognition process into distinct states (precursor states and identification state), with each state having its own visual indicator. This segmentation allows the system to provide detailed process information without overwhelming the user, as each indicator represents a specific, manageable aspect of the recognition process.

Inventive Principle:
Principle #1Segmentation

3Reliability

If data logging is used to track object recognition process events, then process information can be recorded for analysis, but the system complexity and resource usage increase

Engineering Contradiction:
Improveprocess trackingVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent creates visual copies (state indicators) of the internal recognition process states that are displayed to users in real-time. These visual indicators serve as a lightweight alternative to comprehensive data logging, providing essential process tracking information for troubleshooting and understanding without requiring complex logging infrastructure or post-processing analysis.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10685256B2Object recognition state indicators
Publication Date: 2020.06.16 GOOGLE LLC
  • US10685256B2 patent drawing
  • US10685256B2 patent drawing
  • US10685256B2 patent drawing

AI summary

Methods and systems including computer programs encoded on a computer storage medium, for generating and displaying object recognition state indicators during object recognition processing of an image. In one aspect, a method includes performing object recognition on an image displayed in an application environment of an application on a user device using an object recognition model having multiple object recognition states including an identification state, where a candidate object in the image is positively identified, and one or more precursor states to the identification state, and where each of the precursor states has a different respective indicator for display within the image during the respective precursor state that visually emphasizes the candidate object and the identification state has a different respective indicator for display within the image during the identification state that visually emphasizes the positively identified object as being positively identified.