Systems and methods for machine vision based object recognition

Abstract

The present disclosure is related to object recognition and tracking using multi-camera driven machine vision. In one aspect, a method includes capturing, via a multi-camera system, a plurality of images of a user, each of the plurality of images representing the user from a unique angle; identifying, using the plurality of images, the user; detecting, throughout a facility, an item selected by the user; creating a visual model of the item to track movement of the item throughout the facility; determining, using the visual model, whether the item is selected for purchase; and detecting that the user is leaving the facility; and processing a transaction for the item when the item is selected for purchase and when the user has left the facility.

Description

CROSS REFERENCE TO RELATED APPLICATIONS[0001]This application claims priority to U.S. Provisional Application 62 / 965,367 filed on Jan. 24, 2020, the entire content of which is incorporated herein by reference.BACKGROUNDField of the Disclosure[0002]The present disclosure relates to object recognition and tracking using machine vision and more specifically, to a secure system that performs object recognition and tracking using multi-camera driven machine vision.Description of the Related Art[0003]Object recognition and tracking has many use cases including the ever expanding application of shopping experience for end users where end users visit a facility such as a convenient or a retail store, select items for purchase and exit the facility with the selected items through self-checkout / mobile point of sale (POS) devices. This may be referred to as a grab-and-go process.[0004]The predominant approach currently utilized for a grab-and-go process involves installation of expensive hardw...

AI Technical Summary

Benefits of technology

The present disclosure provides novel systems and methods for scalable and cost-effective object identification and tracking systems. The systems rely on low-cost cameras for user identification and tracking, and use machine learning and computer vision techniques to create visual models of items selected for purchase. This approach eliminates the need for expensive hardware equipment such as weight sensors and RFID tags. The systems also support seamless cardless payment transactions, without the user having to confirm the total cost of the transaction. The technical effects of this patent include scalable and cost-effective object identification and tracking systems, and seamless cardless payment transactions.

Problems solved by technology

As businesses grow, deployment of such expensive systems and hardware equipment become cost prohibitive because as number of objects and items to be identified and tracked grows, so do the number of deployed systems and equipment needed to perform the identification and tracking.

Images