Multi-view Stereo Tube Inventory Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional robotic arms in laboratory automation, particularly in healthcare diagnostics, rely on 'seeing by touching' to locate tubes, which is time-consuming and less accurate compared to image-based methods, and there is a lack of effective multi-view machine vision systems for tube inventory management.
Innovation Solution
Implementing a multi-view stereo system using calibrated cameras to capture images from different poses, applying homography transformation and normalized cross-correlation to determine the presence or absence of tubes in a rack, enabling efficient and accurate tube inventory management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If mechanical sensor is used to detect tube presence, then the robotic arm can determine tube presence, but the total time for locating a tube increases
Solution Approach 1:
The patent replaces the mechanical sensor system with an optical vision system. Instead of using a mechanical sensor that physically touches or scans for tubes, the system uses calibrated cameras to capture images from multiple positions and processes these images through homography transformations and cross-correlation algorithms to detect tube presence. This substitution eliminates the mechanical scanning step and enables rapid, non-contact tube detection.
Solution Approach 2:
The patent performs preliminary actions by capturing images from multiple camera positions before the robotic arm needs to locate a tube. The system pre-processes these images by computing homographies and generating cross-correlation maps, so that when tube location is needed, the processed image data is immediately available for rapid detection without requiring time-consuming real-time mechanical scanning.
2Device complexity
If single image is used for tube detection, then the detection process is simple, but the accuracy and reliability of tube presence determination is insufficient
Solution Approach 1:
The patent transitions from two-dimensional single-image analysis to multi-dimensional multi-view analysis. Instead of relying on a single camera image, the system captures images from multiple camera positions (first position, second position, and third position) and processes them through homography transformations that map between different view spaces. This dimensional expansion provides redundant information that significantly improves detection reliability through cross-correlation comparison.
Solution Approach 2:
The patent creates multiple copies of the tube rack scene from different camera perspectives. By capturing images at different positions and computing homographies between them, the system generates transformed copies of the same scene that can be cross-correlated to verify tube presence. This copying approach provides verification through multiple independent observations of the same physical state.
Data Source
AI summary
A multi-view stereo approach generates an inventory of objects located on an object holder. An object may be a sample tube and an object holder may be a tube rack as used in lab automation for healthcare diagnostics. A processor performs 3D tracking of the object holder and the geometric analysis of multiple images generated by a calibrated camera. A homography mapping between images is utilized to warp a second image to a viewpoint of a first image. Plane induced parallax causes a normalized cross-correlation score between the first image and the warped second image of a location on the holder that has an object that is significantly different from a normalized cross-correlation score of a location that has not an object and enables the processor to infer tube inventory and absence or presence of a tube at a location in a rack.