Virtual Character Guidance for Time-Critical Dialysis Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Complex medical devices like dialysis machines require extensive user training and manual consultation for operation, which can be time-consuming and risky in critical situations, especially when immediate assistance is needed.
Innovation Solution
An augmented reality (AR) system is used to provide real-time, situation-based assistance through a virtual character or avatar, guided by a large language model, to assist users in operating medical devices by generating optical, acoustic, and haptic outputs based on input data from the device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the user reads the manual or contacts another person for assistance, then the user can learn to operate the device, but it requires additional time which is problematic in time-critical conditions
Solution Approach 1:
The system pre-processes input data from the dialysis device to generate predictive information and virtual character responses before the user actually needs assistance. This allows the assistance system to be ready immediately when the user queries, eliminating waiting time while ensuring reliable operational guidance.
Solution Approach 2:
A virtual character acts as an intermediary between the user and the device manual or trainer. The virtual character processes user questions, retrieves relevant information from the device data, and provides contextualized assistance, eliminating the need for the user to physically search manuals or contact other persons.
2Reliability
If the device provides comprehensive operational guidance, then the user can operate the device safely, but the device complexity increases
Solution Approach 1:
The dialysis device automatically monitors its own operational state through input data sensors and generates contextual assistance information without external intervention. The virtual character serves itself by autonomously processing device data and providing guidance, reducing the need for complex external assistance systems.
Solution Approach 2:
The virtual character serves multiple functions: it acts as a trainer, a manual, a safety monitor, and a troubleshooting assistant all in one interface. This multi-functionality provides comprehensive operational guidance without proportionally increasing system complexity, as a single virtual character module handles diverse assistance needs.
3Ease of operation
If another person or trainer is available to assist the user, then the user receives personalized guidance, but this resource may not be available in time
Solution Approach 1:
The system creates a virtual copy of a trainer or experienced operator that is always available. This virtual character replicates the knowledge and guidance capabilities of a human trainer without being subject to availability constraints, providing personalized instruction exactly when needed.
Solution Approach 2:
The system pre-loads operational procedures, troubleshooting steps, and guidance scenarios into the virtual character based on predicted user needs. This preliminary preparation ensures that personalized guidance is instantly available without waiting for human trainer availability.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
The present invention relates a system for an automated generation and provision of assistance when operating a medical device such as a dialysis device. In particular, the present invention provides an automated computation of a virtual assistant in form of a person or character. The virtual assistant is provided to the user by means of an augmented reality device.