Laboratory Workstation Image Verification for Automated Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Automated laboratory systems face challenges in accurately detecting and verifying the arrangement of laboratory items on workstations due to incorrect placement or orientation of microplates and other items, leading to procedural errors and potential diagnostic inaccuracies.
Innovation Solution
A method utilizing digital cameras and an interactive user interface to capture and compare reference and current images of the workstation, allowing users to select and mark specific features, and generate reference image parameters for reliable evaluation and real-time checking of item arrangements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If deadbolt navigation is used to control robot arm movements based on software model distances, then automation is improved, but reliability deteriorates due to inability to detect incorrect placement of laboratory articles
Solution Approach 1:
The system performs preliminary action by capturing a reference image of the correct arrangement of laboratory articles before the robot arm executes its workflow. This reference image is stored and used for subsequent comparison with current images to verify that articles remain in their correct positions throughout the automated process, enabling detection of any misplaced items.
Solution Approach 2:
The system implements feedback by continuously capturing current images of the work area during robot arm operations and comparing them against the stored reference image. This feedback mechanism allows the system to detect deviations from the correct arrangement and alert operators to potential errors in article placement or orientation.
2Productivity
If automated systems operate without human intervention for extended periods, then productivity is improved, but reliability deteriorates due to undetected procedural errors from incorrect article placement
Solution Approach 1:
The system maintains reliability during extended automated operation by implementing continuous feedback through periodic image capture and comparison. The image capture device takes current images at intervals during the workflow and compares them with the reference image, enabling automatic detection of any article misplacement that could lead to diagnostic errors, even when no human operators are present.
Solution Approach 2:
The system performs self-service by automatically monitoring its own work area for errors without requiring human intervention. The image capture device and comparison algorithm enable the system to self-verify the correct arrangement of laboratory articles throughout the workflow, automatically detecting and reporting placement errors that could affect diagnostic accuracy.
3Device complexity
If deepwell plates or other items are incorrectly placed on the work area, then device complexity is reduced, but harmful factors increase due to collisions with robot arm attachments
Solution Approach 1:
The system applies preliminary action by capturing and storing a reference image of the correct article arrangement before the robot arm begins its workflow. This pre-established reference enables the system to detect incorrect placements such as deepwell plates in standard microplate positions, allowing preventive action to avoid collisions with robot arm attachments like pipettes.
Solution Approach 2:
The system implements preliminary anti-action by using image comparison to detect potential collision risks before they occur. By continuously comparing current images with the reference image, the system can identify incorrectly placed articles that would interfere with robot arm movements and alert operators to correct the arrangement before collisions happen.
Data Source
Figure 1~3
Figure 4A~8
Figure 9
AI summary
The original arrangement of laboratory items (1) on a work area (2) of a laboratory workstation (3) is captured using reference digital images (6) taken with a digital camera (5) and stored. According to the invention, when such a reference digital image (6) is displayed, areas on the work area (2) of the laboratory workstation (3) with characteristic features (10) visible on the at least one reference digital image (6) are selected and marked by a user with an input device (11). Subsequently, reference image sections (12) and their reference image parameter files (13) are generated and stored.A verification procedure compares the current arrangement of laboratory articles (1) on this work area (2) with a previously recorded, original arrangement of laboratory articles (1) and includes capturing this current arrangement by means of current digital images (6') taken with a digital camera (5), as well as loading processed reference image sections (12') and loading the corresponding reference image parameter files (13) into the memory (7) of a computer (8) and creating current image sections (14) defined by X/Y parameters of the reference image parameter files (13) from the current digital images (6').The verification procedure preferably also includes a computer-based comparison of the processed current image sections 14' with the processed reference image sections 12', an analysis of this comparison and the display of similarities, deviations and errors of the current arrangement compared to the original arrangement of laboratory articles 1 on the work area 2 of the laboratory workstation 3.