3D Product Counting Beyond Camera Field of View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing cycle counting methods using computer vision are limited by the field of view of the image capturing device, leading to inaccurate counts when products are outside the view, necessitating human intervention that introduces errors and reduces efficiency.
Innovation Solution
A method that utilizes a computing device to identify visible surfaces of products in a captured image, generate image and base coordinates, associate these surfaces with virtual products, and classify them as horizontal or vertical to determine an accurate product count, including obscured products, using computer vision models trained on baseline data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If standard computer vision techniques are used for cycle counting, then the counting process is automated and efficiency is improved, but the field of view limitation causes inaccurate counts when products are outside the view
Solution Approach 1:
The patent transitions from 2D image analysis to 3D spatial reasoning by generating a three-dimensional point cloud representation of products. This dimensional transformation allows the system to infer the presence and positions of obscured products that extend beyond the camera's field of view, resolving the contradiction between automation efficiency and counting accuracy.
Solution Approach 2:
The system performs preliminary actions by generating virtual models of products and their expected positions before conducting the actual count. By pre-establishing the three-dimensional spatial relationships and product configurations, the system can accurately determine total product counts even when some products are not visible in the captured image.
2Measurement precision
If human-based counting is used to supplement computer-based count for products outside field of view, then count accuracy is improved, but human interaction decreases efficiency and introduces human-related errors
Solution Approach 1:
The patent replaces the mechanical human counting process with an automated computer vision system that generates three-dimensional point clouds. This substitution eliminates human-related errors while maintaining high efficiency, as the system can process spatial data and infer obscured product positions without requiring physical human intervention or manual supplementation.
Solution Approach 2:
The system performs self-service by autonomously determining the presence and positions of obscured products through three-dimensional spatial analysis. The computer vision system independently completes the counting task without requiring human supplementation, thereby maintaining both high accuracy and efficiency simultaneously.
3Measurement precision
If human-based counting is used to supplement computer-based count, then products outside field of view are accounted for, but the complexity of the counting process increases
Solution Approach 1:
The patent extracts and processes only the essential spatial features needed for counting by generating three-dimensional point clouds from image data. This extraction approach simplifies the overall process by focusing on critical geometric relationships rather than requiring complex human judgment and manual counting procedures for obscured products.
Data Source
AI summary
A product count of a number of physical products within a physical grouping of a plurality of the physical products is determined based on an image of the physical grouping. A cycle counter generates image coordinates for visible product surfaces within the image. The cycle counter generates three-dimensional virtual base coordinates for the expected locations of the plurality of the physical products within the physical grouping. The cycle counter determines the actual locations of the visible product surfaces within three-dimensional space based on a comparison of the image coordinates and the virtual base coordinates. The cycle counter determines the product count of the number of physical products within the physical grouping based on the actual locations.