Hierarchical Sensorimotor Inference for Position-Invariant Object Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional object detection systems face challenges in recognizing objects when they are placed in different locations and orientations, particularly with tactile sensors, as they often require significant training data and struggle with ambiguity in spatial features.

Innovation Solution

The system generates input representations of location and feature pairs, using feedback signals to refine these representations and determine candidate objects associated with the pairs, allowing for improved recognition across varying positions and orientations through parallel processing and multi-layer inference systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional object detection systems use traditional models like CNN to recognize objects in different locations and orientations, then they can handle some spatial variations, but they require significant amounts of training data and still struggle with ambiguity

Engineering Contradiction:
ImproveRecognition accuracy across different locations and orientationsVSAvoidTraining data requirements
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The system segments the object recognition problem into location identification and feature identification components. Location cells identify potential object locations while feature cells identify spatial features at those locations. This segmentation allows the system to handle spatial variations without requiring extensive training data, as each component focuses on a specific aspect of the recognition task.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimension to traditional object detection by incorporating explicit location information as a separate processing dimension. Instead of relying solely on spatial coordinates in the image plane, the system adds a location dimension that tracks potential object positions independently, enabling better generalization to different orientations and positions with less training data.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If the system uses tactile sensors to recognize objects, then it can obtain spatial information, but the same object in different locations and orientations is recognized as different objects due to ambiguity in spatial features

Engineering Contradiction:
ImproveSpatial feature detection accuracyVSAvoidObject recognition consistency
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary location identification before feature identification. Location cells first identify potential object locations, and then feature cells identify spatial features at those pre-determined locations. This preliminary action ensures that the same object is consistently recognized regardless of its position or orientation, as the location context is established before feature analysis.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback loops where output representations from location and feature processing are fed back to refine the recognition. The output processor receives location information and spatial features, generates candidate objects, and uses feedback to update and refine the recognition results, improving reliability by continuously validating and adjusting the identification based on multiple cues.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240404269A1Inferencing and Learning Based on Sensorimotor Input Data
Publication Date: 2024.12.05 NUMENTA INC
  • US20240404269A1 patent drawing
  • US20240404269A1 patent drawing
  • US20240404269A1 patent drawing

AI summary

One or more multi-layer systems are used to perform inference. A multi-layer system may correspond to a node that receives a set of sensory input data for hierarchical processing, and may be grouped to perform processing for sensory input data. Inference systems at lower layers of a multi-layer system pass representation of objects to inference systems at higher layers. Each inference system can perform inference and form their own versions of representations of objects, regardless of the level and layer of the inference systems. The set of candidate objects for each inference system is updated to those consistent with feature-location representations for the sensors as well as object representations at lower layers. The set of candidate objects is also updated to those consistent with candidate objects from other inference systems, such as inference systems at other layers of the hierarchy or inference systems included in other multi-layer systems.