Virtual Pipetting in 3D Lab Models for Easier Automation Programming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The programming of laboratory automation devices is complex and requires specialized skills, limiting laboratory assistants from automating tasks efficiently, as existing methods rely on graphical tools and scripting languages that are difficult to use.
Innovation Solution
A method using a virtual reality headset and motion sensing controller to generate a control program for laboratory automation devices by manipulating a virtual pipette within a three-dimensional model, allowing users to record and replicate tasks in reality, simplifying the programming process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If traditional programming methods using scripting languages are used, then automation capability is achieved, but programming complexity and skill requirements increase
Solution Approach 1:
The patent creates a virtual copy of the laboratory automation device and its operational environment. Users interact with this virtual replica through a graphical interface, performing tasks with virtual pipettes and samples. The system records these interactions and automatically generates control programs, eliminating the need for users to directly write complex scripting code while still achieving full automation capability.
2Ease of operation
If graphical tools are used for programming, then ease of operation improves, but functionality and precision are limited
Solution Approach 1:
The patent merges the advantages of graphical interfaces with the capabilities of scripting languages. The virtual reality environment provides intuitive graphical interaction for ease of operation, while the underlying system captures these interactions and translates them into full-featured control programs with complete procedural functionality, including conditional logic, loops, and complex task sequences.
3Loss of time
If manual teaching mode is used to program robot arms, then programming time is reduced, but precision and repeatability are compromised
Solution Approach 1:
Instead of manually teaching robot arm positions, the system creates a virtual copy of the entire operational environment including precise spatial relationships. Users program tasks in this virtual environment using intuitive graphical methods, and the system automatically generates precise control programs that maintain both speed of programming and positioning precision, eliminating the trade-off present in manual teaching modes.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
A method for generating a control program (54) for a laboratory automation device (12) comprises: receiving configuration data (46) of the laboratory automation device (12), the configuration data (46) encoding positions of components (22) in the laboratory automation device (12); generating a three-dimensional model (58) of the components (22) of the laboratory automation device (12) from the configuration data (46), the three-dimensional model (22) additionally including a virtual pipette (60); displaying the three-dimensional model (58) with a virtual reality headset (14); receiving movement data (50) of a motion sensing controller (16) controlled by a user wearing the virtual reality headset (14), the movement data (50) indicating a three-dimensional movement of the motion sensing controller (16) in space; determining a movement of the virtual pipette (60) from the movement data (50) in the three-dimensional model (58) and updating the three-dimensional model (58) according to the movement of the virtual pipette (60); and generating a control program (54) for the laboratory automation device (12) from the movement data (50), wherein the control program (54) is adapted for moving a pipetting arm (30) with a pipette (32) of the laboratory automation device (12) with respect to the components (22) accordingly to the movement of the virtual pipette (60) in the three-dimensional model (58).