Virtual Pipette Control in VR for Easier Lab Automation Programming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The programming of laboratory automation devices is complex and requires specialized skills, limiting laboratory assistants from automating tasks efficiently, as existing methods often rely on graphical tools or scripting languages that are difficult to use.
Innovation Solution
A method using a virtual reality headset and motion sensing controller to generate a control program for laboratory automation devices by manipulating a virtual pipette within a three-dimensional model, allowing users to record and replicate tasks in reality, simplifying the programming process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional programming methods using scripting languages or graphical tools are used, then the control program can be generated, but the programming process becomes complex and requires specialized skills
Solution Approach 1:
The patent creates a virtual copy of the laboratory automation device and its work area in a three-dimensional virtual environment. Users interact with this virtual copy to program the system, avoiding the need to directly program the complex physical device. The virtual model includes all relevant components, containers, and tools, allowing intuitive drag-and-drop programming without specialized scripting knowledge.
Solution Approach 2:
The patent replaces traditional text-based scripting interfaces with a graphical user interface in virtual reality. Instead of writing code or configuring complex graphical parameters, users physically manipulate virtual objects using hand controllers, making the programming process as intuitive as performing the actual laboratory tasks manually.
2Productivity
If laboratory assistants perform procedures manually, then no specialized programming knowledge is needed, but automation efficiency and productivity are limited
Solution Approach 1:
The system allows laboratory assistants to program the automation device themselves by interacting with the virtual model. The virtual environment provides immediate visual feedback and intuitive controls, enabling non-programmers to create automation programs independently without requiring specialized training or assistance from programmers.
Solution Approach 2:
The patent adds a virtual reality dimension to the programming interface, transforming the traditional two-dimensional graphical or text-based interface into an immersive three-dimensional environment. This allows users to interact with the program structure spatially, manipulating virtual objects in 3D space to define automation procedures, making the process more intuitive and accessible.
3Measurement precision
If detailed control programs are created for complex procedures, then measurement precision and control accuracy are improved, but the time and effort required for programming increases
Solution Approach 1:
The system pre-configures the virtual environment with accurate three-dimensional models of all device components, containers, and tools, including their spatial relationships and operational parameters. This preliminary setup eliminates the need for users to manually configure each parameter, as the system already contains the precise geometric and functional data needed for accurate control.
Solution Approach 2:
The virtual model serves as an intermediary between the user's intentions and the physical device's execution. Users program by manipulating virtual objects in the three-dimensional environment, and the system automatically translates these virtual actions into precise control commands for the physical automation device, maintaining measurement precision while simplifying the programming process.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
A method for generating a control program (54) for a laboratory automation device (12) comprises: receiving configuration data (46) of the laboratory automation device (12), the configuration data (46) encoding positions and/or orientations of components (22) in the laboratory automation device (12); generating a three-dimensional model (58) of the components (22) of the laboratory automation device (12) from the configuration data (46), the three-dimensional model (22) additionally including a virtual pipette (60); displaying the three-dimensional model (58) with a virtual reality headset (14); receiving movement data (50) of a motion sensing controller (16) controlled by a user wearing the virtual reality headset (14), the movement data (50) indicating a three-dimensional movement of the motion sensing controller (16) in space; determining a movement of the virtual pipette (60) in the three-dimensional model (58) from the movement data (50) and updating the three-dimensional model (58) according to the movement of the virtual pipette (60); and generating a control program (54) for the laboratory automation device (12) from the movement data (50), wherein the control program (54) is adapted for moving a pipetting arm (30) with a pipette (32) of the laboratory automation device (12) with respect to the components (22) accordingly to the movement of the virtual pipette (60) in the three-dimensional model (58).