Pipette Motion Capture for Faster Lab Automation Programming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The programming of laboratory automation devices is complex and requires special skills, limiting laboratory assistants from automating tasks with multiple samples due to the need for scripting languages and manual movement of robot arms, which is time-consuming and inefficient.
Innovation Solution
A method using a camera to record and evaluate video data of a laboratory assistant's movements, employing object recognition and tracking to generate a control program for the automation device, allowing the robot pipette to mimic the assistant's actions and adapt to different container arrangements for efficient operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual movement of robot arm in teach mode is used to program laboratory automation device, then ease of operation is improved, but loss of time increases due to time-consuming manual positioning and teachpoint setting
Solution Approach 1:
The system captures the laboratory assistant's manual pipetting actions through video recording and automatically generates control programs by copying the demonstrated movements. This eliminates the need for time-consuming manual teachpoint setting while preserving ease of operation, as the assistant simply demonstrates the desired procedure naturally.
Solution Approach 2:
The patent replaces the mechanical manual positioning process with an optical system (camera) that automatically tracks and records the assistant's hand movements. This substitution captures the actual movement trajectories and converts them into automated control instructions, significantly reducing programming time while maintaining operational simplicity.
2Adaptability or versatility
If scripting language is required for complex procedures, then device complexity increases, but ease of operation deteriorates due to need for special programming knowledge
Solution Approach 1:
The system enables the laboratory assistant to program complex procedures themselves by demonstrating the actions manually. The automatic program generation technology empowers non-programmers to create sophisticated automation sequences without needing scripting knowledge, making the system self-programmable by its end users.
Solution Approach 2:
The patent introduces an intermediary automatic program generation system that translates the assistant's natural manual operations into automated control code. This intermediary layer eliminates the need for direct interaction with complex scripting languages while preserving the ability to execute sophisticated procedures.
3Ease of operation
If graphical interface with movable pipette is used, then ease of operation is improved, but device complexity increases due to additional software layers
Solution Approach 1:
The patent extracts the essential programming function from complex graphical interfaces and consolidates it into simple video recording and playback. By removing unnecessary graphical manipulation layers and keeping only the core demonstration-recognition-execution functionality, the system maintains ease of operation while reducing overall software complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Simplifies the programming process by allowing laboratory assistants to create control programs through manual demonstration, enabling the automation device to perform complex tasks with multiple samples efficiently and accurately, reducing the need for specialized programming knowledge.
Implementation Method 1
the video data generated by the camera are evaluated, for example with object recognition and objected tracking, to determine the steps of a control program
Implementation Method 2
the video data generated by the camera are evaluated, for example with object recognition and objected tracking, to determine the steps of a control program
Data Source
AI summary
A method for generating a control program for a laboratory automation device includes: receiving video data displaying a work area of a laboratory assistant, the work area containing a hand-held pipette and containers for receiving a liquid; detecting openings of the containers in the video data and determining positions of the openings; detecting a pipette tip of the hand-held pipette in the video data and determining a movement of the tip; and generating the control program for the laboratory automation device from the movement of the pipette tip with respect to the positions of the openings, wherein the control program is adapted for moving a pipetting arm with a robot pipette of the laboratory automation device with respect to containers of the laboratory automation device accordingly to the movement of the hand-held pipette in the work area.