Method and medical system for assisting a user

Abstract

The invention relates to assistance to a user when handling a medical device, such as a dialysis device. To this end, it is proposed to provide assistance to the user by means of an augmented reality device. Assistance can be provided by analyzing the current situation and the needs of the user. The operational settings of the dialysis device are detected to provide automatic assistance to the user. In a further embodiment, the user can be assisted by an expert, wherein the user can be assisted to fully or partially automatically select an appropriate expert.

Description

Background Technology

[0001] This invention relates to a method for providing assistance in operating medical devices, particularly dialysis devices, using augmented reality devices. The invention also relates to medical systems comprising medical devices and augmented reality devices. Furthermore, the invention relates to augmented reality devices. In particular, the invention relates to providing assistance in operating or handling dialysis devices.

[0002] Although the invention has been described exemplarily below with reference to dialysis devices, the general concept can also be applied to other devices, particularly other medical devices, especially blood therapy devices.

[0003] More and more medical devices are becoming increasingly complex. An example of such complex medical equipment is dialysis equipment. Such equipment requires complex operations and configurations that must be performed by the user. Furthermore, many accessories and consumables must be considered when operating medical devices.

[0004] Because improper operation can be dangerous for patients, it is crucial that users (such as nurses or doctors) are familiar with the device. In uncertain situations, the expectation is that the device can guide users quickly, safely, and reliably to complete tasks.

[0005] Currently, users must read the manual for the corresponding equipment to learn how to operate it. Furthermore, even if a user can be trained by one or more human trainers, for the purpose of training, the user and trainer must be in the same position. In unusual tasks or equipment malfunctions, users may easily become stressed or anxious. This could lead to situations where the user may not react quickly enough or even make mistakes.

[0006] Therefore, there is a need for systems that provide improved assistance to users when operating complex medical devices such as dialysis equipment. In particular, there is a need for methods and systems for controlling components that can assist users in operating medical devices. Summary of the Invention

[0007] This invention provides a method and medical system for assisting a user on a dialysis device, having the features of the independent claim. Further advantageous embodiments are the subject of the dependent claims.

[0008] According to a first aspect, a method is provided for technically providing assistance when operating a medical device, particularly a dialysis device. The method includes capturing data. The captured data may be related to the medical device or to the user's activities while interacting with the medical device. The data may be captured by at least one sensor component. The method also includes identifying the operating settings of the medical device. The operating settings may be determined based on the data captured by the at least one sensor component. Furthermore, the method includes determining a task to be performed by the user on the medical device. The method also includes monitoring the user's activities. The user's activities may be monitored based on the data captured by the at least one sensor component. Furthermore, the method includes determining an assistance scheme for providing assistance to the user. The method may also include determining assistance based on the determined assistance scheme. The method also includes providing assistance based on the determined assistance scheme. The assistance scheme and assistance itself may be specifically determined for the user to perform the determined task. In particular, the assistance scheme may be determined by considering the identified operating settings of the medical device, the determined task to be performed, and the monitored user activities. Providing assistance to the user according to the determined assistance scheme includes outputting instructions on the output component of the AR device. The term "assisted user" refers to providing assistance through technical means, particularly by controlling the AR device.

[0009] The first aspect relates to the claimed method. Features, advantages, or alternative implementations described or claimed with respect to the method can also be transferred or assigned to other claimed objects (e.g., systems, augmented reality devices, computer programs), and vice versa. In other words, features described or claimed in the context of the method can be used to improve the device, and vice versa. In this case, the functional features of the method are implemented by structural units of the apparatus or device or system, and vice versa. Generally, in computer science, software implementations and corresponding hardware implementations (e.g., as embedded systems) are equivalent. Thus, for example, method steps for “storing” data can be performed using storage units and corresponding instructions for writing data to storage devices. To avoid redundancy, although the device can also be used in alternative implementations described with reference to the method, these implementations are no longer explicitly described with respect to the device. In principle, the claimed device or apparatus claims are suitable for performing the claimed method.

[0010] According to another aspect, a medical system is provided. The medical system is configured to provide assistance on an AR device, particularly when operating the medical device. The medical system is configured to perform the methods or any implementations or alternatives mentioned above. The medical system includes a medical device (particularly a dialysis device), an augmented reality device, a control device, and sensor components. The sensor components are configured to capture data. The captured data may relate to the activities of the medical device and / or the user when interacting with or operating the medical device. The control device may be a control device integrated into the medical device. For example, the control device may be implemented by a component of the medical device. Alternatively, the control device may also be implemented by a separate device disposed outside the medical device. Furthermore, the control device may also be implemented by a combination of components included in the medical device and components external to the medical device. The control device is configured to identify the operating settings of the medical device. In particular, the operating settings may be identified based on data captured by at least one sensor component. The control device may also be configured to determine or receive tasks to be performed by the user on the medical device. Furthermore, the control device is configured to monitor the user's activities. In particular, the activities may be monitored based on data captured by at least one sensor component. The control device is also configured to determine an assistance scheme for providing assistance to the user, particularly for performing a determined task. The assistance scheme can be determined based on the identified operating settings of the medical device, the determined task to be performed, and the monitored user activities. The control device can be configured to determine assistance. The control device can also be configured to provide (particularly the determined) assistance on the (user-related) AR device according to the determined assistance scheme, including controlling the output of indications on the output components of the AR device.

[0011] In implementation, more than one AR device is used, particularly a first AR device used by the user of the dialysis device and a second AR device used by a human expert.

[0012] Assistance can be provided on the first and second devices to simulate the real operating conditions of the dialysis equipment as closely as possible for the human experts providing assistance.

[0013] An assistance scheme can define the type, form, and / or manner of assistance to be provided. For example, an assistance scheme can define when, for how long (time interval), at what frequency (number of iterations), and / or in what form (e.g., an optical representation to be output on an augmented reality device, and / or an acoustic format and / or in a haptic form) assistance is provided. Furthermore, the skill level of the experts used to provide the assistance can be selected.

[0014] This invention is based on the finding that operating complex medical devices such as dialysis machines places high demands on users. Users must study manuals and undergo extensive training to use such devices. In particular, there may be many exceptions that must be handled by the user. Since some operational errors can lead to health risks, users must operate the device with extreme care to avoid such mistakes. This can be a real challenge, especially under time pressure.

[0015] Therefore, this invention takes into account this finding and aims to provide a method for assisting and / or teaching users when operating complex medical devices such as dialysis machines. In particular, this invention aims to provide a method and system that can assist users in real-world situations when operating the device. For this purpose, various types of assistance can be provided to users by means of augmented reality (AR) devices.

[0016] In the context of this invention, an AR device can be understood as any type of device that provides AR features. For example, such an AR device could be an AR or mixed reality (XR) headset, such as the Microsoft HoloLense. However, any other type of AR or XR device is also possible. An AR device can also be any other type of device that provides AR features. For example, a smartphone, tablet computer, or any other type of device with a camera and display can be used as an AR device. Generally, any type of device with the ability to provide a real scene overlaid with additional (artificial) elements can be used as an AR device. In the context of this document, "augmentation" refers to the fact that a real or physical scene can be enhanced or enriched with additional information, which can be provided as virtual instructions.

[0017] In the context of this invention, the output component can be any type of component for outputting optical, tactile, and / or acoustic indications. The output component can be implemented at least partially by the aforementioned AR device. In particular, the output component can be part of the AR device. For example, the output component can include a display for providing optical information or indications. Specifically, the output component can include a display device for overlaying a real scene with additional virtual elements / indications. For this purpose, a semi-transparent display can be used to provide additional indications on the real scene pointed to by the display. Alternatively, the scene can be captured by a camera device, and image data from the camera device can be overlaid with additional virtual indications on the display. Alternatively or additionally, the output component can be implemented on another device, particularly a mobile device and / or a medical device, although it is referred to as an "output component of an AR device." In the latter case, the output component can be externalized from the AR device or transferred to an external AR device.

[0018] Typically, indications can be any type of information provided or represented on the output component. Indications can be provided in different forms, particularly optical, acoustic, tactile, or other forms. The output component is selected accordingly (optical output, speaker output, vibration output, etc.).

[0019] Optical indicators can be any type of graphical representation that can be used in the context of operating a medical device. For example, optical indicators can be graphical elements, icons, images (e.g., photographs or drawings of parts of the medical device), lines, arrows, boxes, circles or any other geometric elements, text boxes with text and / or other information, video sequences, and avatars, etc. Graphical representations can be static and / or dynamic, such as video sequences, moving or rotating graphical elements, etc.

[0020] Acoustic indications can be, for example, sounds such as beeps or warning tones, sound sequences, melodies, or spoken text. Spoken text can be artificially generated text messages or text messages recorded by humans. However, any other type of acoustic indication is also possible.

[0021] Tactile cues can be, for example, vibration, shaking, and / or any other tactile output.

[0022] In the context of this invention, the sensor component can be any type of input component, particularly any type of component for sensing environmental characteristics and / or for receiving user input, such as a user interface (UI), graphical user interface (GUI), etc. For example, the sensor component may include optical sensor elements, such as at least one camera device, at least one laser scanner, etc. Alternatively or additionally, the sensor component may also include acoustic sensor elements such as a microphone, which can be used, for example, to record the user's voice commands. Alternatively or additionally, the sensor component may also include sensor elements such as a gyroscope, an accelerometer (for one or more dimensions), and / or a distance sensor, or any other type of sensor for sensing the user's position, posture, and / or movement. Alternatively or additionally, the sensor element may also include one or more communication modules. For example, such a communication module may be a Wi-Fi interface, a Bluetooth interface, an RFID reader, or any other wireless or wired communication module. However, it should be understood that the sensor component may also include any other type of sensor element. The sensor component or a component thereof may be part of an augmented reality device. Alternatively or additionally, the sensor component may be provided as an external device, particularly external to medical devices and / or external to augmented reality devices. Sensor components can be part of mobile devices (e.g., smartphones, tablets, etc.).

[0023] One or more optical sensor elements of the sensor component can be used to capture images of the user's environment. Specifically, the optical sensor can capture image data of the environment the user is currently viewing. The image data captured by the optical sensor can be used, for example, to identify a medical device currently being operated by the user. In particular, the image data can be used to identify attachments and / or accessories mounted on the medical device or available in the environment of the medical device. For example, medical devices, attachments, or accessories can be identified based on pattern recognition methods using characteristic elements for identifying the respective elements. Scanning codes such as QR codes can also be used to identify elements. However, any other methods for identifying devices or other components are also possible.

[0024] Data captured from sensor components (e.g., data captured by one or more optical sensors) can also be used, for example, to identify the operational settings of a medical device. Operational settings can refer to the current configuration and / or state of the medical device and / or characteristics of the medical device, such as the location of equipment, device components, and / or disposable items and / or accessories to be used for device operation. For example, image data can be analyzed to identify the current settings of control elements and / or the output of displays on the medical device can be analyzed.

[0025] Furthermore, data from sensor components can be used to monitor and / or assess user activity. For example, optical sensors can capture image data of the user's hand or parts thereof (fingers, etc.). Such data can be used to analyze current actions, such as movement toward control elements, actions of attaching or removing accessories, patient-related movements, or any other manual actions by the user.

[0026] Data captured by sensor components can relate to: 1. the medical device and / or related components and / or their operating conditions; and / or to 2. the user's activities when interacting with or operating the medical device.

[0027] Image data, for example, from one or more optical sensors, can also be used to assess the available space around the user and / or medical device. For instance, the dimensions of the room where the user and medical device are located can be determined. Therefore, spatial constraints can be considered in situations where space is limited due to small rooms or other equipment in the environment.

[0028] Furthermore, the spatial location of the user and / or medical device can be determined as an operational setting based on image data and / or other available data. For example, it can be determined whether the user and medical device are located at a hospital, a medical facility, a patient's home, etc. Additionally, the available and / or additional infrastructure required to operate the medical device can be determined as an operational setting.

[0029] The interface or communication module can be used for any type of communication purpose. Communication can be performed wirelessly or via wired connection. For example, communication can be established with a medical device. This communication can be used to determine the type of medical device, its current configuration, its status, and to obtain error messages. Furthermore, communication can be established with one or more databases. For example, a database can be referenced to obtain additional information about the medical device, user information (e.g., user preferences, training status), patient information, operational information related to the medical device, receive updates (e.g., from the manufacturer), and receive supplementary information to assist the user. However, it should be understood that any other type of information can also be obtained from one or more databases.

[0030] Interfaces or communication modules can also be used to establish any type of communication with human or artificial experts. In the case of human experts, information for assisting the user can be obtained from local or remote computing devices. In the case of human experts, a communication channel can be established with such human experts to obtain further assistance from the expert and / or provide the expert with information about the medical device and / or the current user. In such cases, the human expert can be located close to the medical device and the user. For example, the expert and the user can be located in the same room. Alternatively, the expert can be spatially separated and located in another room, another building, another city, country, or continent. In the case of spatially separated human experts, any type of appropriate information can be provided to the remote expert, such as the configuration of the medical device, the status / fault messages of the medical device, attached or available accessories, user preferences, etc. Additional real-time information can also be provided to the human expert, such as images captured by camera devices, voice communication with the user, etc. Such information can be provided to the human expert, for example, through any type of output device such as a speaker, headset, smartphone or tablet computer, monitor, VR, AR, or XR device, etc.

[0031] Alternatively or additionally, a human expert may use a second AR device that provides the same or similar indications as the AR device being used by the user who made the assistance request. In this way, the outputs of the AR device being used by the user and the second AR device being used by the human expert are comparable, enabling a simulation of the user's situation at the medical device as realistically as possible.

[0032] In the context of this invention, the task to be performed can be any type of operation or action related to the relevant medical device. The task may require at least one activity, and in particular a set or series of activities to be performed manually by the user or automatically via instructions.

[0033] Such tasks may include, for example, preparing medical equipment for a desired task / work (e.g., setting up medical equipment, particularly a dialysis machine, especially before commissioning the equipment). For this, the user may have to install one or more attachments or accessories on the medical equipment, insert or connect one or more consumables, perform specific setups on the medical equipment, or perform any other required operations. Patient-specific data must be considered if necessary.

[0034] Tasks may include, for example, monitoring medical devices during operation. To do this, the user may need to monitor the status messages of the medical device, monitor the fill level of consumables, and / or monitor the flow rate, etc. If any parameter exceeds tolerance, the user must take appropriate action to ensure safe operation.

[0035] In another example, a task could be to react to, for instance, a malfunction or error message. For example, if a medical device detects a malfunction or problem, the user must take the necessary steps (activities) to eliminate the cause of such a problem. However, it should be understood that a task can include any other type of operation related to the relevant medical device, such as maintenance, normal operation, testing, or training.

[0036] Tasks can be specified or selected by the user, for example, through user input. Alternatively, tasks can be determined entirely or at least partially automatically. For this purpose, additional information, such as data from medical devices, patient databases, or other sources / databases, can be considered to determine the desired task. Furthermore, another person (e.g., a trainer or instructor) can also select the task that should be performed by the user.

[0037] An assistance scheme defines a scheme or mode for providing assistance. An assistance scheme can define how, where (particularly where or on which device) the output component is implemented and indicated to provide indication, and / or in what form the assistance is technically provided in the form of an output indication, particularly regarding determining the appropriate output component, time interval, duration, output format (optical, acoustic, and / or haptic, etc.), and / or intensity (brightness of an optical indication or volume of an acoustic indication, etc.). An assistance scheme may include or refer to optical, acoustic, or haptic indications. For example, an assistance scheme may refer to or include haptic indications, such as shaking or vibration, to attract the user's attention. An assistance scheme may refer to or include acoustic indications, such as beeps, warning sounds, melodies, any other type of sound, or even spoken text messages. An assistance scheme may also refer to or include optical indications, such as arrows, lines, circles, boxes, icons, images, text messages, video sequences, etc., to guide the user through a related task. Indications may be provided on the output component of the AR device. However, it should be understood that any other type of assistance scheme may be used to provide appropriate assistance to the user to perform the desired task.

[0038] In the context of this invention, assistance can be any type of assistance that can be used to help a user operate a medical device. For example, such assistance may include information for guiding the user to complete a desired task (having a series of activities ordered in time), such as configuring the medical device, attaching accessories, adapting the medical device to a specific patient, operating the medical device, performing steps in response to warnings or error messages, refilling consumables, performing maintenance operations, etc.

[0039] The method according to the invention may include algorithmically calculating or determining assistance. The algorithmic determination of assistance may define the content of the assistance in the form of, for example, instructive messages or instructions. The determined assistance is provided according to the determined assistance scheme. Assistance is provided on an output component, which may be implemented at least partially on an AR device and optionally on an associated device, such as a mobile device and / or medical device and / or components thereof assigned to a user. Assistance may include instructive outputs, such as a description of a single step or sequence of steps within an activity that should be performed by the user to perform a desired task. Assistance may include, for example, information on appropriate settings for the medical device, information on required additional components or consumables, etc. Assistance may also include, for example, instructions on one or more specific locations on the medical device or associated components, instructions on how to operate control elements of the medical device, specifications on how to manipulate or grasp specific components, or any other information related to the desired task to be performed.

[0040] Assistance can be provided to the user in any suitable manner according to the assistance scheme. In particular, assistance can be provided to the user through suitable output components. Output components may include, for example, optical devices, such as one or more displays for providing optical indication. Output components may also include acoustic elements such as speakers, headphones, etc., to provide acoustic information. In addition, output components may include any other type of suitable output element, such as for providing tactile output.

[0041] AR devices may include at least a portion of output components. For example, optical indication may be provided by means of the AR device's display. Additionally, acoustic indication may be provided by means of the AR device's acoustic output element. However, the AR device may also be connected to one or more additional output elements, such that at least a portion of the desired indication may also be provided by such external output elements not included in the AR device itself, for example, in medical devices and / or mobile devices that can be registered in the system.

[0042] The functions of identifying the operating settings of the dialysis device, determining the tasks to be performed by the user, monitoring the user's activities, and determining actions to assist the user can be performed, for example, by a suitable control device. Such a control device can be implemented, for example, by a processor and a memory communicatively coupled to the processor. The memory can be configured to store program code that can be read by the processor. When executed by the processor, the program code causes the control device to perform appropriate operations, particularly for performing at least a portion of the operations for assisting the user on a medical device. The control device may include additional components, such as interfaces for receiving and / or outputting data. In particular, the control device may include interfaces for any type of wireless or wired communication. Furthermore, the control device may include elements such as any type of suitable input and / or output devices, for example, a user interface for interacting with the user. However, it should be understood that the control device may also include any other type of suitable components if desired.

[0043] User activity can refer to any action a user is performing relative to the medical device, such as manipulating, operating, or moving the device or its parts or accessories, or taking actions that affect the medical device, such as clicking a button on the device or user interface.

[0044] The control device can be located separately from the medical device, particularly from the dialysis device. However, the control device can also be at least partially integrated into the medical device. In particular, the control device can be implemented, for example, through appropriate components of the dialysis device. In this way, the control device can be wholly or at least partially implemented by components of the medical device.

[0045] In possible implementations, the step of capturing data related to a medical device may include: capturing images by sensor components, scanning optical tags and / or RF tags on the medical device and / or accessory components of the medical device. Furthermore, the method, particularly identifying the operational settings of the medical device, may include identifying the medical device, detecting at least one accessory component of the medical device, and / or determining the spatial location and / or spatial orientation of the medical device.

[0046] For example, image data can be captured by the camera device of an AR device. The image data can be processed, for example, based on appropriate image processing algorithms, to identify specific medical devices, classify the type of medical devices, determine the configuration of medical devices, such as identifying accessories or attachments to medical devices. Furthermore, optical codes, such as Quick Response (QR) codes on medical devices or their accessories, can also be recognized. Therefore, medical devices or accessories can be identified based on such codes. However, any other type of suitable device can also be used to scan and / or identify medical devices or their attachments / accessories. For example, barcode readers, NFC readers, etc., can be used to read appropriate tags on medical devices or accessories. In this way, medical devices and their configurations can be easily determined in an automated manner.

[0047] In a possible implementation, the method may include the step of obtaining at least one relevant reference operation for the determined task. The relevant reference operation may be obtained, for example, from a reference database. Therefore, assistance programs and / or aids can be determined based on a comparison between the monitored user's activities and the relevant reference operations obtained from the reference database. The relevant reference operations may be stored, for example, in any suitable manner, such as a reference database. The reference database may be provided locally in the medical device. However, the relevant reference operations may also be obtained from remote devices such as remote servers, particularly the cloud. The reference operation may specify, for example, one or more operations that should be performed by the user to complete the desired task. The reference operation may include, for example, information related to the user's manual actions, such as "connecting a specific component to a relevant terminal of the device," "inserting a specific amount of consumable into a specific storage device of the device," "entering a specific setting on an input terminal of the device," "verifying that a specific component has been securely installed," etc. The reference operation may also include information related to the required order of performing the operations. In this way, all necessary operations that the user must perform can be specified to perform the operation correctly and completely.

[0048] In possible implementations, the tasks to be performed by the user may include: configuring or operating the medical device, monitoring the medical device during operation, and / or maintaining and / or repairing or servicing the medical device. However, it may also be any other suitable task that can be performed in conjunction with the medical device. Therefore, every action or activity that must be performed relative to the medical device can be part of a task. A task can be a general operation related to the medical device.

[0049] However, tasks may also involve specific desired goals to be achieved through the use of medical devices, such as specific treatments for patients. Therefore, tasks can also be patient-related. For this purpose, patient-related data can be referenced. For example, such patient-related data can be read from storage devices (e.g., a patient database on a remote server or in the cloud). Furthermore, tasks can also be user-specific (the user operating the medical device). For example, different types of tasks can be selected based on the current user's knowledge or abilities. For instance, the user's skill level can be considered when selecting an appropriate task. For this purpose, user-specific data can be received, for example, from a user-specific database on a remote server or in the cloud.

[0050] Additionally or alternatively, users can input user-specific information using appropriate input terminals, particularly those of medical devices. The task may also take into account the current configuration of the medical / dialysis equipment. For example, device-specific information may be received from the medical device via a wired or wireless interface. Information from connected or available accessories may be received and taken into consideration to select the appropriate task to perform. Furthermore, specific settings, such as the fill levels of one or more consumables, may be considered when determining the task. For example, if the fill level is below a predetermined threshold, the task may involve refilling consumables.

[0051] In addition, status messages and / or fault messages can be received from the medical device. Therefore, tasks for resolving current problems such as faults can be identified. For example, a task might involve cleaning a filter when the flow rate or pressure level deviates from a predetermined range. A task might also involve maintenance operations that should be performed in the event of a specific fault or at a specific maintenance interval.

[0052] In possible implementations, assistance programs and / or aids can be determined based on a user's preset or predetermined skill level. Alternatively or additionally, assistance programs and / or aids can be determined based on one or more rules. In particular, such rules can be pre-stored and / or obtained from a rule database. The rule database can be any type of local or remote storage device, such as a remote server or the cloud. Skill levels can be determined, for example, based on any type of user input. For this purpose, the user can input their skill level using an appropriate input device (e.g., a user interface). Alternatively or additionally, skill levels can also be determined at least partially automatically. For this purpose, user actions can be monitored. Furthermore, any type of appropriate rules for determining assistance programs can be possible. Such rules can specify, for example, the configuration and / or characteristics of medical devices, the tasks to be performed, and relationships between information related to the patient and / or the user of the medical devices.

[0053] In a possible implementation, the method may further include a step of calculating an assessment of the user's skill level. The user's skill level can be calculated based on monitored user activities and / or relevant reference actions for the determined task. For this purpose, user activities can be monitored / sensed using any type of suitable device. For example, sensor components such as camera devices, lidar sensors, motion sensors, ultrasonic-based sensors, and / or accelerometers can be received and processed to monitor user activities or actions. The monitored activities can be compared with, for example, relevant reference actions to determine deviations and / or identification errors during the user's actions or activities. Therefore, the user's skill level can be determined based on the degree of deviation and / or the number of errors. This degree of deviation can be compared with a preset threshold, and if the threshold is not met, it can be determined according to rules whether assistance should be provided or enhanced.

[0054] Furthermore, the time period used to perform a specific task / operation can be considered to determine the user's skill level. For example, a real time period can be compared with one or more reference values ​​to assess the user's skill level. However, any other schemes for assessing the user's training level and determining the user's skill level are also possible.

[0055] In a possible implementation, assistance schemes and / or aids can be determined based on the difference between the monitored user activity and the relevant reference operation. In this way, the number of instructions to assist the user can be limited. Therefore, the amount of interference to the user during operation can be minimized. For example, instructions can only be provided on the output component if the difference between the monitored user activity and the relevant reference operation has been determined.

[0056] In this way, as long as the user's operation matches the relevant reference operation, the user can operate the medical device with little or no assistance. If the user's operation deviates from the reference operation, appropriate instructions can be provided to the user, allowing the user to promptly identify potential errors. Furthermore, the instructions can be adjusted based on the degree of deviation between the user's current operation and the relevant reference operation. For example, in the case of a minor deviation, only small instructions such as lines, arrows, or other symbols can be displayed on the screen. In the case of a larger deviation, the instructions may include larger graphic elements, flashing graphic elements, acoustic signal output, or tactile indications.

[0057] The approach described in one aspect mentioned above can include the use of Large Language Models (LLMs). Specifically, LLMs can be used to provide assistance to users, for example, in the form of computational instructions. The aforementioned capabilities can be acquired by training the LLM to learn statistical relationships from text documents or other information sources or files during computationally intensive self-supervised and semi-supervised training processes. LLMs can be constructed using a decoder-only Transformer-based architecture. Alternatively or additionally, other architectures such as recurrent neural network variants and Mamba (state-space models) can be used. In particular, LLMs can be used to obtain answers to questions related to dialysis equipment. Answers can be provided on the output of an AR device or on the output of the dialysis equipment or a user (e.g., mobile) device. Users can use LLMs to query the system, for example: which part of the machine is currently in front of them, where disposable items are placed, where a certain part of the machine (e.g., a blood pump) is located, or request further assistance. The system, aided by AR sensors and / or at least one sensor component, identifies the situation in the room, accordingly evaluates the user's verbal interactions using an LLM (Local Language Management) system, and provides appropriate information, such as AR highlights, text, arrows, and / or prepared videos and / or graphics, to answer the user's verbal inquiries. This can be accomplished in any language if the LLM has adequate language capabilities. The system can respond automatically in the language of the request (inquiry).

[0058] In possible implementations, the method may include the step of providing real-time support for operating the device. Specifically, support may be provided by a human expert. Alternatively or additionally, support may be provided by a human expert. Real-time support may be provided on output components, particularly output components that provide assistance via instructions according to a determined assistance scheme. Specifically, real-time support may be provided on the output components of an AR device.

[0059] To provide support from human experts, particularly real-time support, any type of suitable technological system can be used. For example, computing devices can generate data to be provided to the user to achieve the desired outcome. For this purpose, support can include data used to provide any type of instruction, such as text or graphic elements on a display, video sequences, sound signals, or spoken text messages. For example, human support can be generated based on any data related to the user's current actions. For instance, a system for generating human assistance can receive information from medical devices or one or more additional sensor components that monitor, for example, the user's actions. Therefore, such a system of human experts can provide appropriate assistance based on the current situation.

[0060] Alternatively or concurrently, real-time support from a human expert (i.e., a real person) can be provided to the user. For this purpose, any type of communication link can be established between the human expert and the user. For example, voice signals from the human expert can be provided to the user. Furthermore, graphical information, such as video from the human expert and / or video from another (same or similar) medical device operated by the human expert, can be provided to the user. However, any other means of providing real-time support may also be possible.

[0061] In a possible implementation, the method may include the step of receiving a user request for (or provision of) real-time support. Thus, the user request reflects the user's intention and instruction to obtain real-time support. Specifically, the user request can be received by sensor components, particularly sensor components for monitoring user activity. The user request can be received in any suitable manner. For example, user activity can be monitored to identify specific gestures of the user, such as a predetermined movement of the user's fingers or hand. However, any other type of gesture is also possible. The user request can also be triggered based on acoustic input (e.g., based on speech recognition, etc.). Therefore, assistance from human or expert personnel can be initiated and controlled based on the received user request. The provision of real-time support can be controlled based on parameters of the received user request. Parameters may refer to the timing, duration, and / or intensity of real-time support, and the determination of the output component (i.e., an indication of where to provide assistance). This has a technical advantage, as it can avoid unnecessary real-time support.

[0062] In possible implementations, experts, particularly human experts, can be identified using an identification algorithm based on predetermined selection rules. The identification algorithm can be configured to select or determine human experts from a set of human experts typically registered in the system. The identification algorithm can process personal information. Additionally or alternatively, the identification algorithm can be based on pre-storeable personal information associated with the human expert. For example, the personal information of one or more human experts can be stored in a suitable storage device, such as a database. The database can be local or remote, such as a database in the cloud. The information associated with the human expert can specify, for example, specific expertise, such as knowledge related to one or more types of medical devices, expertise related to specific treatment methods or diseases, and can also specify language skills, the availability schedule of the expert, geographical information about the expert's location, evaluations associated with a specific user or user category, or any other characteristics that may be suitable for selecting a particular expert.

[0063] Alternatively or additionally, experts, particularly human experts, are assigned or matched to user requests or medical devices that the user is operating, using an allocation algorithm. The allocation algorithm can read and process personal information related to the human expert and / or the operating settings of the identified medical device and / or the determined task and / or the monitored user activity, performing these operations to calculate the allocation for the human expert in response to the assistance request. The assistance request can be received on sensor components (such as a UI), which can be implemented on the medical device or at least partially on an AR device.

[0064] In possible implementations, the method may include determining the personal information of a human expert. Specifically, personal information may be determined by: receiving input from the human expert, analyzing data from the human expert's electronic devices, particularly scheduling data, detecting the presence of the human expert at a predetermined spatial location, receiving a rating from the human expert based on user input, or any other method for automatically determining the human expert's personal information. For example, the availability of a human expert may be determined by detecting the presence of a user in a specific room or building, analyzing the expert's electronic calendar, etc. For example, the determination may be performed by establishing a connection to a device or server storing the expert's relevant personal information and receiving information from that device or server. Information from the expert may also be received via an input terminal or user interface, where the expert manually enters their personal information. Furthermore, additional information about the expert may be specified by ratings received from one or more users. For example, a user may provide such a rating after the assistance of the corresponding human expert has been completed. Information about at least one human expert may include: skills, preferences, scheduling data, location data, ratings, and / or additional data related to the corresponding human expert. The method may also include the step of storing the determined personal information in a database. For example, the personal information may be stored in a local or remote storage device, such as a remote server or the cloud.

[0065] Furthermore, the method may include a step of determining the user's need for operating the medical device. Therefore, the method may also include a step of identifying a human expert based on a match between information stored in a database and the user's needs. In this way, an appropriate human expert can be selected automatically within a very short timeframe. This can be highly advantageous for time-critical operations related to the operation of medical devices.

[0066] In possible implementations, user needs can be determined based on user input. Specifically, user input can be received by sensor components and / or input data can be received from the medical device. Additionally or alternatively, patient information can be received. In particular, patient data can be obtained from a patient database, especially a remote database, such as a remote server or the cloud.

[0067] In possible implementations, the method may include the step of storing user activity. User activity can be determined in any suitable manner. For example, one or more sensor components used to monitor user activity can be received and processed to determine the corresponding user activity. For example, image data captured by one or more camera devices can be processed, data from a data interface of a medical device can be received, or any other method for identifying user activity can be performed. User activity can be stored in a local or remote storage device in a suitable manner. For example, a suitable encoding scheme can be used to characterize individual user activity. For example, if two or more possible solutions exist for solving a specific task or problem, the corresponding user-preferred solutions can be stored in a corresponding database. Therefore, appropriate human experts can be identified based on previously stored user activity. In this way, the user can be assisted by a matched human expert who matches the user's preferences.

[0068] In a possible implementation, human experts are selected based on a machine learning module configured to implement artificial intelligence methods. The machine learning module can be implemented as a neural network architecture, particularly a deep neural network (DNN). For example, a neural network can be used to analyze any type of available information from human experts and / or from users operating the medical device. Furthermore, the neural network can be used to analyze user preferences and / or the current status or needs of the medical device to be operated by the user. Specifically, the neural network can be trained using training data, including the operating settings of the medical device, monitored user activities, and associated assistance. The neural network is trained to provide assistance in response to corresponding assistance requests, i.e., to new, unseen input data, including the operating settings of the medical device as mentioned above.

[0069] On the other hand, AR devices are provided for use in the medical systems described above.

[0070] In the following detailed description of the accompanying drawings, non-limiting examples of embodiments, their features, and further advantages are discussed with reference to the drawings. Attached Figure Description

[0071] Figure 1 A schematic diagram of a medical system according to an embodiment is shown;

[0072] Figure 2 This is a schematic diagram of a user with an AR device according to an implementation method;

[0073] Figure 3 A schematic diagram depicting a user with another AR device according to an embodiment is shown;

[0074] Figure 4 A schematic diagram of a flowchart on which the method according to an embodiment is based is shown; and

[0075] Figure 5 This is a schematic diagram of an AR scene generated by an AR device according to an implementation method. Detailed Implementation

[0076] The invention will now be described in more detail below with reference to the accompanying drawings and embodiments.

[0077] Figure 1 A schematic diagram of a configuration of a medical system according to an embodiment is shown. The medical system includes a medical device 1, particularly a dialysis device or another blood treatment device. The medical device 1 can be operated by a user 2.

[0078] Blood therapy devices, particularly dialysis devices, are medical devices that typically treat a patient's blood outside the body. For example, medications can be added to or removed from the blood, and blood can be heated or cooled. These processes are usually monitored by sensors. Blood therapy devices have various devices for these purposes, such as pumps, valves, sensors, clamps, etc. In addition, disposable medical supplies are commonly used in blood therapy. For hygiene reasons, such disposable supplies are usually discarded after treatment. Disposable medical supplies, or so-called disposable items, include, for example, tubing kits for delivering medical fluids such as blood or medications, filters such as adsorber filters or dialysis filters, pouches for storing medications, etc. These disposable supplies are typically inserted into or connected to the blood therapy device by the user and removed from or detached from the blood therapy device after treatment.

[0079] exist Figure 1 In the example shown, a medical device 1 (hereinafter referred to as the device) is illustrated, wherein the device 1 includes an input / output component 11 and at least one accessory component 12 representing any type of attachment, accessory, etc., and a canister component 13 for containing (liquid) consumables.

[0080] The high complexity of such medical device 1 poses a considerable challenge to its users. Therefore, user 2 must be properly trained before use. Furthermore, monitoring user 2 during device operation is desirable to identify potential malfunctions in the early stages. Additionally, providing guided support to user 2 during operation is highly beneficial.

[0081] In such Figure 1In the illustrated medical system, augmented reality (AR) device 3 can be used in conjunction with the operation of medical device 1 to assist, monitor, and / or train user 2. Any type of suitable device suitable for AR purposes can be used. For example, the AR device can be any type of AR headset or AR glasses.

[0082] Furthermore, any other type of device that can provide AR capabilities (such as tablets, smartphones, etc.) is also possible.

[0083] AR device 3 may include, or may specifically include, a (wireless) data connection to one or more output components. For example, the output components may provide optical / graphical output. Such optical / graphical output may be provided, for example, on a display. The display may be a non-transparent display on which an image of the environment, particularly an image of medical device 1 or at least a portion thereof, is overlaid with additional graphic elements. The display may also be a semi-transparent display, allowing user 2 to view through it to recognize the real environment. Furthermore, additional graphic elements may be provided by the semi-transparent display, such that graphic instructions on the semi-transparent display can assist user 2 during operation of medical device 1.

[0084] AR device 3 may also include one or more additional output components, such as speakers, headphones, or another device for outputting signals (particularly acoustic signals). In this way, acoustic signals such as sound or melody or spoken text messages can be provided to user 2. In addition, any other suitable type of output component may also be included in or connected to AR device 3. For example, AR device 3 may also include or be connected to an output component for providing tactile signals such as vibration, shaking, etc.

[0085] AR device 3 may also include, or (preferably) wirelessly data-connected to one or more sensor components for sensing the user 3's environment and / or operation and / or receiving user requests or input data. For example, the AR device may include one or more image sensing elements, such as a camera for capturing image data. AR device 3 may also include any other type of sensor component for sensing the user 2's movement, such as a gyroscope, accelerometer, velocity sensor, etc. However, any other suitable type of sensing component may also be possible. For example, the sensor component may also be a scanner, particularly a scanner for reading QR codes or barcodes, an RFID reader, etc. Alternatively or additionally, one or more sensor components may be provided separately from AR device 3, for example as a room sensor, a sensor for a mobile device, or other sensor components in a data connection.

[0086] Preferably, all or at least some of the output components and sensor components can be implemented in the AR device 3. However, as mentioned above, external output components and / or input components not implemented in the AR device 3 can also be used.

[0087] When using medical device 1, the user can also benefit from the support of a large language model (LLM), such as the well-known ChatGPT. The user can verbally interact with such an LLM. For example, verbal requests such as phrases or questions can be received (e.g., on sensor components) and provided to the LLM. For this purpose, the request can be received by an input device, particularly the input device of AR device 3 (such as a microphone), converted into text by a speech-to-text module, and provided to the LLM. However, any other type of input, such as text input via an input terminal (e.g., using a keyboard), is also possible. The LLM can provide an appropriate response to the user's input. This response can be provided to the user via acoustic output (e.g., synthesized speech output), by providing text messages, or by providing any other type of indication (such as lines, arrows, symbols, icons, images, and / or video clips). For this purpose, an appropriate output component of AR device 3 can be used. The output can involve dynamically generated output by the LLM in response to the user's request. However, the output can also include, for example, pre-generated and pre-stored elements. For example, the output may include pre-stored images, such as images of medical device 1 in a specific configuration, images of specific parts of medical device 1, video clips illustrating specific operations, or any other type of data that has been prepared in advance.

[0088] When generating output, the LLM can take the user's language into account. Therefore, the LLM can provide a response in the same language the user used when making the request. For example, if the user asks a question in English, the LLM can provide a response in English; if the user asks a question in German, the LLM can provide a response in German. However, the processing and / or generation of responses can also be restricted to one or more specific languages. Furthermore, the LLM's responses can be provided in a specific language, regardless of the language in which the input is expressed. For example, the LLM can always provide a response in the language corresponding to the language set in medical device 1.

[0089] The dialogue with the LLM can be used for any type of interaction, especially for any type of assistance that helps the user operate the medical device 1. For example, the user can ask which part or component of the medical device 1 is currently in front of them. Additional information can also be considered for this purpose.

[0090] For example, input components, particularly those of AR device 3, can detect the user's viewing direction and / or the user's environment, specifically detecting / identifying elements or objects in the user's environment. Therefore, this information can also be considered when the LLM generates a response to a user's request.

[0091] Users can also inquire about how to perform a desired operation, such as how to attach accessories or disposable items, or how to perform the next step of the desired operation. Users may also inquire about the location of specific components of the medical device. To generate a response to such requests, any type of additional information can be considered, such as information acquired by sensor components, particularly those of AR device 3. For example, image data of the environment can be captured by optical sensor components such as a camera device. Image data can be processed to identify medical device 1, its configuration, accessories, the spatial relationship between the user and medical device 1, the user's current operation, or to detect the spatial location of a part of the user's body, such as the current position of the user's hand. Furthermore, supplementary information can be received from any other type of data source. For example, information about the current configuration of medical device 1, its current state, operating parameters, or any other characteristics of medical device 1 can be received via wired or wireless communication links.

[0092] Therefore, users can receive assistance through verbal interaction with the LLM to perform desired tasks and / or obtain more information about medical device 1. The information provided by the LLM does not necessarily refer only to the task the user is currently performing. Users can also interact with the LLM to obtain any other type of information, such as general information related to medical device 1.

[0093] Below (in) Figure 3 (Then) a more detailed description Figure 1 Other components depicted in the text.

[0094] Figure 2A schematic diagram of an AR device 3a used when a user handles or operates medical device 1 is shown, wherein AR device 3a includes a head-mounted device or AR glasses. In such an embodiment, AR device 3a can be positioned on the head of user 2. User 2 can view it through a semi-transparent display. Therefore, user 2 can still perceive the environment. In addition, graphic elements can be provided by the semi-transparent display, so that additional graphic elements can be displayed at locations related to elements in the real world. In addition, AR device 3a may also include additional output elements such as speakers to provide acoustic output. Furthermore, AR device 3a may include a camera device 31 to capture image data, particularly image data in the direction that user 2 is currently viewing. In addition, AR device 3a may include any other type of sensor component for monitoring the movement of AR device 3a and the corresponding movement of user 2 or for acquiring any other type of appropriate sensor data. AR device 3a may also include any other type of sensor, such as a microphone for receiving voice commands from the user. Alternatively or additionally, sensor components (e.g., in the form of camera device 31) may be provided externally to AR device 3a.

[0095] Figure 3 A schematic diagram of another type of AR device 3b is shown. In this configuration, the AR device 3b can be implemented by a handheld device such as a tablet computer or smartphone. The handheld AR device 3b may include a camera device 31 for capturing image data, particularly during operation of the medical device 1. Furthermore, the handheld AR device 3b may include a display for providing the captured image data in conjunction with additional graphic elements. In this way, image data of the real environment can be overlaid with additional graphic elements. Alternatively, the handheld AR device 3b may include a semi-transparent display through which the user 2 can view the image. In such a configuration, additional graphic elements can be provided on the semi-transparent display to provide additional information, particularly information related to one or more elements that the user 2 is viewing through the semi-transparent display. In any case, the handheld AR device 3b may also include output components for providing acoustic and / or tactile output. Furthermore, the handheld AR device 3b may include or be connected to any type of sensor component, such as a microphone for sensing acoustic signals (particularly user voice commands), or a sensor for monitoring the movement of the handheld AR device 3b.

[0096] AR devices 3, 3a, and 3b can be controlled, for example, by means of control device 4.

[0097] exist Figure 1In this diagram, the control device 4 is shown as a separate component disposed outside the medical device 1. However, the control device 4 can also be implemented within the medical device 1. In particular, the function of the control device 4 can even be implemented through components of the medical device 1.

[0098] Control device 4 can receive sensor data from one or more sensor components, particularly sensor components of AR device 3 or external sensor components, or from another device associated with AR device 3. Furthermore, control device 4 can also receive additional information or data from medical device 1. For example, control device 4 can receive data related to the configuration of medical device 1, the current settings of medical device 1, data specifying the fill level of consumables in medical device 1, operational data such as flow rate, pressure values, status or error messages, or any other information related to medical device 1.

[0099] The control device 4 can also establish communication links with one or more external storage devices, particularly one or more databases 5. For example, such a database 5 can provide any type of information related to the medical device 1. This information may include, for example, any type of data used to identify the medical device 1. For instance, the control device 4 can receive the serial number of the medical device 1 and refer to the database 5 to obtain additional information associated with that serial number. Image data, particularly image data captured by the sensor components of the AR device 3, can also be used to identify the medical device 1 or its attachments / accessories. For example, a QR code or barcode can be scanned, and the control device 4 can refer to the database 5 to identify the medical device 1 based on that code. Alternatively, any suitable features representing the medical device 1 can be identified, and the database 5 can be referenced to identify the medical device 1 based on those features. However, any other method for identifying the medical device 1, its attachments or accessories, or retrieving any other information related to the medical device 1 may also be possible.

[0100] Database 5 may also provide additional relevant information, such as recommended settings, consumable fill levels, predefined operations for users operating medical device 1, and any other appropriate information related to medical device 1.

[0101] Database 5 can also provide any type of information for specifying operations to perform specific tasks related to medical device 1. Such specific tasks could be, for example: configuring medical device 1, operating or monitoring medical device 1 during operation, resolving warnings or malfunctions of medical device 1, maintaining medical device 1, or even repairing medical device 1. However, any other type of task can also be specified.

[0102] Database 5 may also include additional information related to one or more users 2. For example, database 5 may store and provide any type of preference of user 2. Such preferences may include, for example, specific configurations, particularly those provided by AR device 3, such as color schemes, specifications of the level of detail that support / assistance should provide for the corresponding user 2, the knowledge or skill level of the corresponding user 2, language skills, physical limitations of user 2, or any other data related to user 2.

[0103] In addition, database 5 can provide any type of information related to the patient to be treated by medical device 1. Such information may include, for example, the patient's physical characteristics, expected therapy / treatment, the patient's medications, or any other relevant data related to the patient.

[0104] In addition, database 5 can provide any other type of relevant information that may be useful in relation to the operation of medical device 1.

[0105] Despite Figure 1 Database 5 is shown as a single database 5, but it should be understood that database 5 can also be implemented by multiple separate databases. For example, separate databases can be provided for the characteristics of medical device 1, data related to the operation of medical device 1, patient-related data, user preferences, etc. The various databases 5 can also be located in different spatial locations. In addition, at least some data can be stored in a local database within control device 4.

[0106] As in Figure 1 As can be further seen, connections can also be established with other experts, particularly another human expert 6. This other human expert 6 can be located near user 2 and / or medical device 1. For example, expert 6 and user 1 can be in the same room. However, expert 6 can also be located remotely. For example, expert 6 can be in a separate room within the same building or in any other location. For example, expert 6 can be located in another city, country, or even continent.

[0107] Specifically, if expert 6 is located somewhere outside the room where user 2 and medical device 1 are located, any type of appropriate information related to medical device 1 can be provided to expert 6. For example, expert 6 can receive information about the current status, operating characteristics, warnings, malfunctions, etc., of medical device 1. Furthermore, expert 6 can also receive information related to the expected task related to medical device 1 that is currently to be performed. Expert 6 can also receive information related to user 2 and / or the patient to be treated. However, any other type of information can also be provided to expert 6. For example, expert 6 can receive image data captured by one or more camera devices, particularly one or more camera devices of AR device 3. Information can be provided to expert 6 in any suitable manner, such as by means of a display, like a monitor or virtual reality (VR) or AR device.

[0108] Figure 4 A flowchart is shown of a method for assisting a user 2 on or at a dialysis device 1 according to an embodiment.

[0109] The term "on or at" refers to the fact that assistive methods can be used while or during the use of a medical device. This can support all tasks or functions and / or actions to be performed in this regard. Direct operation of the medical device by the user is not necessarily required, but rather operation of accessory devices, such as disposable items or related equipment, can be performed, for example, in the context of (intended) treatment using the medical device. Furthermore, assistance may also be available during the setup or configuration phase of the medical device before its actual operation.

[0110] Typically, this method can be implemented, for example, in the medical system described above. Therefore, embodiments involving systems, devices, or apparatus may include any type of device, component, or unit for implementing the features of the embodiments involving the method. Thus, embodiments involving the method may include any suitable method steps for implementing the features as described in conjunction with embodiments involving systems, devices, or apparatus.

[0111] A method for assisting user 2 on dialysis device 1 includes step S1 for capturing data related to dialysis device 1. The data can be captured, for example, by at least one sensor component. The at least one sensor component can be, for example, a sensor component of an AR device 3. As mentioned above, the sensor component can be, for example, an image capture device such as a camera. For example, such an image capture device can capture image data in the direction in which user 2 is currently viewing or in the direction in which the AR device 3 is being guided. Data can also be captured, for example, by means of a microphone for acquiring acoustic signals. For example, the sensor component can receive voice commands from user 2. Furthermore, the sensor component can read QR codes, barcodes, and RFID tags, etc. In addition, the sensor component can be used to detect the user's position and / or movement. For this purpose, suitable sensors such as gyroscopes, accelerometers, etc., can be used. Furthermore, data related to dialysis device 1 can also be received, for example, through a suitable interface such as a wired or wireless communication channel.

[0112] Data relating to dialysis device 1 can be any type of data relating to dialysis device 1. For example, the data can be used to: identify dialysis device 1, detect any type of attachments or accessories to dialysis device 1, determine a specific configuration of dialysis device 1, identify the settings of dialysis device 1, detect the fill level of consumables in dialysis device 1, or determine any other appropriate data relating to dialysis device 1.

[0113] In step S2, the operational settings of dialysis device 1 can be identified. For example, the operational settings can be identified based on captured data, particularly the data captured in step S1. Operational settings may include, for example, identifying the configuration of dialysis device 1 (such as configuration including specific attachments or accessories), determining the fill level of consumables in dialysis device 1, a specific state of dialysis device 1, or any other characteristic used to characterize dialysis device 1. Operational settings can be determined, for example, by processing image data captured by an image capture sensor component. For example, images of dialysis device 1 can be processed to identify attachments or accessories, identify and evaluate control lights on dialysis device 1, detect and evaluate control panels (particularly output messages displayed on such control panels), or any other appropriate operation used to determine the settings of dialysis device 1. Furthermore, any type of data can be received from dialysis device 1 via a wireless or wired communication channel to determine the operational settings of dialysis device 1. QR codes, barcodes, or RFID tags, such as those on dialysis device 1 or attachments or accessories on dialysis device 1, can also be detected, and the corresponding attachments or accessories can be identified based on such elements.

[0114] Identifying the operational settings of dialysis device 1 may also include determining the spatial location of dialysis device 1 or any other components associated with it. For example, the relative position of dialysis device 1 with respect to user 2 and / or patient can be determined by processing appropriate image data or any other type of information. Furthermore, the environment of dialysis device 1 can also be considered. For example, the available space around dialysis device 1 can be determined. To this end, the dimensions of the room where dialysis device 1 is located can be determined, or any other characteristics related to the available space and / or spatial location of dialysis device 1 can be identified.

[0115] In a further step S3, the task to be performed can be determined. Specifically, the task to be performed can be a task to be performed by user 2 on dialysis device 1. Such a task could be, for example, preparing or configuring dialysis device 1, particularly configuring dialysis device 1 for subsequent treatment of the patient. The task can also involve activities to be performed during patient treatment. For example, such a task could include monitoring the relevant operation of dialysis device 1, handling any type of messages, warnings, or malfunctions during patient treatment. Furthermore, the task can also involve any type of activity after the patient's treatment has been completed, such as removing attachments, cleaning dialysis device 1, etc. The task can also involve maintenance operations, such as periodic maintenance operations that must be performed after predetermined time intervals. The task can also involve servicing, such as operations performed by maintenance personnel to repair dialysis device 1. However, any other type of task related to dialysis device 1 that will be performed is also possible.

[0116] The task to be performed by user 2 can be determined, for example, by receiving manual input from user 2. For instance, user 2 can enter specifications for a specific task on a user interface or input terminal, or select from multiple available tasks. However, the appropriate task can also be determined automatically. For example, the task to be performed can be automatically determined based on the current (identified) operating settings of dialysis device 1. For example, if a specific status, warning, malfunction, etc., is identified, an appropriate task can be determined in response. For example, if the consumable fill level is detected to be below a predetermined limit, the task could be to fill / refill the consumable in the tank of dialysis device 1. If the flow rate is detected to be below a predetermined threshold, the task could involve operations to overcome the problem, such as cleaning or replacing the filter element.

[0117] Tasks can also be determined automatically, for example, by referring to other information. For instance, patient-related information can be received. Such information can be received, for example, from a local or remote patient database. Therefore, considering the specific needs of such patients, patient data can be analyzed to determine the appropriate treatment or specific configuration of the dialysis device 1.

[0118] The task can also be determined by any other suitable means, such as a combination of automated and manual methods. For example, a first step can be performed, including analyzing dialysis device 1, its operating settings, and other characteristics such as patient data, data related to user 2, and / or any other suitable data, to determine a set of possible tasks. Therefore, such a set of determined possible tasks can be provided to user 2, for example, through a user interface, and user 2 can select one task from the provided set. For this purpose, any type of interaction with user 2, such as by means of a user interface or by receiving voice commands from user 2, is possible.

[0119] In step S4, the activities of user 2 can be monitored. Specifically, user 2's activities can be monitored based on data captured by one or more sensor components (such as sensor components of AR device 3). For example, user 2's movement can be monitored by appropriate sensors such as gyroscopes, accelerometers, etc. Furthermore, image data from one or more image sensors (such as camera devices) can be analyzed to assess the user's actions. For example, the camera device can capture images of user 2's hand or another feature related to user 2's actions. Image data can be processed and analyzed to identify any type of action performed by the user. For example, pattern recognition, feature extraction, etc., can be performed to determine user 2's actions. Neural networks, etc., can also be used to process image data to identify user 2's actions. In addition, any other type of data can be received. For example, data can also be received from dialysis device 1 or another data source, which can also be considered for monitoring user 2's activities.

[0120] When user 2 operates dialysis device 1, user 2 can be assisted by any type of appropriate output provided on the output component (such as the output component of AR device 3), especially by indicated output. To this end, an appropriate assistance scheme can be determined in step S5.

[0121] Assistance schemes can define and determine how to provide assistance to users. Assistance can be provided, for example, on different devices (e.g., output components of AR devices or other devices), multiple times (iterative mode), through different signals (acoustic, optical and / or tactile and / or other signals or combinations thereof), for different time periods (only very short times such as alarm tones or continuous provision, etc.), and / or in different formats (text messages, optical images, etc.).

[0122] The assistance itself can include any type of information that can be used to assist user 2 in operating dialysis device 1 and / or to guide user 2 in completing a desired task. For example, the assistance can include text messages that can be provided to user 2 on a display (particularly the display of AR device 3), or as spoken text messages via a speaker, etc. The assistance can also include, for example, static or dynamic indicators that can be used to indicate the location of specific components, such as control elements, attachments, openings for filling consumables, etc. The assistance can also include images of a specific configuration, images of attachments or accessories, images of how attachments or accessories should be installed into dialysis device 1, or any other relevant image information. The assistance can also include, for example, video sequences illustrating how a specific task or part of a task should / can be performed. However, anything else that might be useful to user 2 when performing the desired task can also be included in such assistance.

[0123] The auxiliary scheme and / or assistance (meaning: the content of the assistance) can be determined, for example, by the control device 4, particularly through calculation. For instance, the auxiliary scheme and / or assistance can be determined by an appropriate method (such as an algorithm) taking into account the current operating configuration of the dialysis device 1. Furthermore, the task to be performed can also be considered in determining the auxiliary scheme and / or assistance. Additionally, the auxiliary scheme and / or assistance can be determined based on any type of information related to monitoring the activities of the user 2. Besides this, any other relevant information that may be useful in this context can also be considered.

[0124] To determine assistive measures and / or aids, machine learning modules, such as any suitable type of neural network, can also be used. In this way, the neural network can receive relevant information, such as the operating settings of the dialysis device, the tasks to be performed, the monitored user activities, and / or other relevant information. Based on this information, the neural network can provide data to specify appropriate assistive measures and / or aids.

[0125] To determine the auxiliary scheme and / or assistance, additional data may be obtained from local or remote storage devices such as databases. For example, the storage device may store and provide data such as text, audio sequences, graphic elements, and images (which are sequences). Data may be stored in a manner that specifies the relationship between the corresponding data and other characteristics such as the relevant task, the configuration of dialysis device 1, or other relevant features. In possible implementations, data, particularly raw data, may also be obtained from the storage device and further processed to adapt the data to an appropriate auxiliary scheme and / or assistance based on the received raw data, or to calculate an appropriate auxiliary scheme and / or assistance. For example, further processing of the obtained raw data may be necessary to adjust the auxiliary scheme and / or assistance according to the current configuration of dialysis device 1 and / or the current activity of user 2. However, any other type of processing of the obtained data used to generate or adjust the auxiliary scheme and / or assistance may also be possible.

[0126] The assistive scheme and / or aids can also be adjusted based on the current user 2. For example, user 2's physical constraints or limitations, such as user 2's body size, can be considered. For instance, a shorter person may not be able to reach everything that a taller person can. In addition, whether user 2 is left-handed or right-handed can be considered. However, any other characteristics of user 2 can also be considered.

[0127] Furthermore, the knowledge level or skill level of user 2 can be considered. For example, inexperienced user 2 can be provided with a large amount of information and / or a high level of detail. More experienced user 2 can be provided with a small amount of information and / or a lower level of detail. For this purpose, user 2 can manually input his skill level using any suitable input device. Additionally or alternatively, the skill level can also be determined completely or at least partially automatically. For example, the skill level can be determined based on the time period during which user 2 has operated dialysis equipment 1 of the same or similar type. In addition, the skill level can be evaluated, for example, by comparing the user's activities with relevant predefined reference operations. Such reference operations can be provided, for example, by any type of local or remote storage device (e.g., a reference database). Therefore, any type of suitable scheme for evaluating user 2's skill level can be applied, particularly a scheme that compares user 2's operations with relevant reference operations. Furthermore, user 2's skill level can also be assigned by a rating from another person (e.g., a trainer or another expert such as expert 6). For example, expert 6 can supervise user 2's operations and give a rating based on that supervision.

[0128] The assistance scheme and / or aids can also be determined and / or adjusted based on any type of user preference. For this purpose, User 2 can input their preferences. For example, User 2 can specify their preferences using a user interface. Furthermore, User 2's preferences can be received by any type of suitable sensor component, particularly the sensor component of AR device 3. User 2's preferences can specify, for example, the level of detail of the assistance provided during operation, any type of specification of the graphic scheme, such as color schemes, the size of graphic elements, the volume of sound or spoken text, or any other user-relevant characteristics. User preferences can be stored, for example, in local or remote memory.

[0129] The assistance scheme and / or aids can be further determined by considering the current activity of User 2. For example, User 2's current activity can be compared with a relevant reference operation used to perform the desired task. As mentioned above, such a reference operation can be obtained, for example, from a local or remote storage device (such as a reference database). As long as User 2's operation corresponds to the relevant reference operation, no aids or only reduced aids may be provided to User 2. If User 2's operation differs from the relevant reference operation, the aids can include any type of assistance to correctly perform the desired task. For example, the degree of deviation between User 2's current operation and the relevant reference operation can be determined, and the aids can be adjusted according to the degree of deviation. If only a slight deviation is detected, or the detected deviation has little or no effect on the outcome of the operation, the aids may include only a small amount of assistance. For example, only text with prompts, graphical elements such as icons, or any other minor indications may be provided to the user. However, if a large deviation is detected, or the detected deviation will have a significant impact on the outcome of the operation, the aids may include any type of element suitable for alerting the user to the deviation relative to the reference operation. For example, a larger indication may be provided on a display and / or acoustic signaling may be provided. It should be understood that several levels of deviation between the user's current operation and the relevant reference operation may be considered to adjust the auxiliary and / or its scheme.

[0130] To determine appropriate assistance schemes and / or aids, any type of processing can be applied. For example, rules or a set of rules can be used to determine, generate, or select appropriate assistance schemes. For instance, one or more rules for determining assistance schemes and / or aids can be obtained from local or remote storage (e.g., a rules database). In this context, rules can be any type of appropriate specification for determining, selecting, or generating assistance schemes and / or their corresponding content that can be used to assist user 2 in performing a desired task or operation. Rules can specify the association between a user's assistance request and the assistance scheme and / or aid.

[0131] The determined auxiliary scheme can be used in step S6 to provide appropriate instructions to the user when operating the dialysis device. In particular, appropriate instructions can be provided to the user by means of the output component, especially on the output component of AR device 3.

[0132] For example, graphical indicators can be provided to user 2 to indicate the spatial location of relevant components of the dialysis device 1 or related parts that need to be activated or operated next. For example, indicators can be provided on the display to indicate the location of relevant control elements, the location for filling consumables, the location for attaching accessories or attachments, etc.

[0133] The indication can be a static or dynamic indication for indicating a specific location. For example, a dynamic indication can be used to indicate the movement of a control element, such as moving a switch to a desired position or rotating a controller. The indication can be provided, for example, by means of a semi-transparent display, where the provided graphic indication is displayed at the location, allowing the user to identify the relevant location when viewing through the semi-transparent display. Alternatively, an image of the environment can be captured by a camera device, and the graphic elements and the captured image data can be overlaid on the display.

[0134] When providing, for example, audio or video sequences, the speed of such sequences can be adjusted according to the speed at which the user performs an action. In this way, a good correlation can be achieved between the provided instructions and the user's actions.

[0135] Figure 5 A schematic representation of scene 100 that may be visible when using AR device 3 during the operation, configuration, or setup of dialysis device 1 is shown. Figure 5 In the representation, the dialysis device 1 is shown as an object 200 represented by dashed lines. Dashed lines represent objects that exist in the real environment. Such objects can be perceived by viewing them through a semi-transparent display.

[0136] Alternatively, it can capture image data of the environment and display the image data on a non-transparent display.

[0137] As in Figure 5 As can be further seen, additional elements 110, 111, 120, and 130 may be provided. It should be noted that these elements 110, 111, 120, and 130 are for illustrative purposes only and do not limit the scope of the invention. Furthermore, any other type of graphic representation and any other number of graphic elements may also be possible.

[0138] For example, a line or arrow 110 can be used as an element to assist the user. Such a line or arrow 110 can be used to indicate a position, particularly the position at the dialysis device 1. In addition, arrow 111 or another suitable graphic element can be used to indicate the direction of movement of control elements such as switches, knobs, rotary controllers, etc.

[0139] like Figure 5 As further shown, any type of text or other reasonable information can be provided, for example, by means of a text box 120.

[0140] Instructions used to assist users can also include any other type of representation, such as graphic elements, especially geometric elements like circles and rectangles, icons, images, etc. Instructions can include static or dynamic elements. For example, dynamic elements can be any type of graphic element used to indicate, for example, movement direction or sequence of operations.

[0141] Indications can be provided in conjunction with dialysis device 1 or its display 200, such as those indicated by elements 110, 111, or 120. Furthermore, any type of indication not (directly) related to dialysis device 1 can be provided, such as those indicated by indicator 130. Such indications can be provided, for example, at predetermined locations, such as in the upper or lower region, or in a predetermined area, particularly in a corner of the display used to provide the indication. However, the positions can also be dynamically adjusted to provide indications 110, 111, 120, or 130. For example, the positions of indications 110, 111, 120, or 130 can be automatically determined by ensuring that the indications do not cover the display 200 of dialysis device 1 or only minimally cover it. Furthermore, the positions of relevant elements or locations of dialysis device 1 can be determined, and the positions of indications 110, 111, 120, or 130 can be adjusted such that the relevant elements are not covered or are only minimally covered. However, it is also possible to provide the representation using any other suitable method for adjusting its position, size, and / or style. For example, if the representation does not cover the relevant elements of the dialysis device 1, the representation of indications 110, 111, 120, or 130 can be provided as a solid representation. Where the representation of indications 110, 111, 120, or 130 will cover the relevant portion of the dialysis device 1, the corresponding representation of indications 110, 111, 120, or 130 can be provided in a semi-transparent style. Alternatively, the size of the corresponding representation of indications 110, 111, 120, or 130 can be adjusted, particularly reduced. However, any other suitable scheme for adjusting the characteristics of the representation of indications 110, 111, 120, or 130 can also be possible.

[0142] To further assist user 2 during the operation of medical device 1, user 2 can receive additional information from human or artificial expert 6, or even interact with such human or artificial expert 6.

[0143] For example, human assistance can be calculated in an automated manner. The output of such human assistance can resemble that of a human expert, however, where the output is generated by appropriate computing devices. For example, the desired task to be performed, the monitored activities of user 2, any appropriate information of any kind from dialysis device 1, and (if available) additional information can be considered to determine the appropriate assistance that can be provided to user 2 using expert information. Such information can be provided to the user in the form of a (virtual) expert. User 2 can express their request or need in any appropriate manner, and an automated response to the request is generated and provided to user 2 in the form of a reply or prompt from the expert. For example, user 2 can express their need in the form of spoken text, which is analyzed and processed through speech recognition. However, any other scheme, such as specific gestures or manual input, may also be possible.

[0144] Alternatively, User 2 can connect to Human Expert 6 (e.g., using digital and computer-based means, such as a digital conferencing platform). Human Expert 6 can be located in the same room as User 2 and dialysis device 1. However, Human Expert 6 can also be spatially separated and located in different rooms or even different locations (cities, countries, etc.). In particular, Human Expert 6 can be located in different rooms within the same building, in different buildings, or even in different cities, different countries, or even on different continents. Human Expert 6 can be connected to User 2 and / or Control Device 4 via any suitable communication connection.

[0145] For example, human experts can connect via the Internet, especially via secure communication channels such as VPN channels.

[0146] Any type of relevant information, such as information related to dialysis device 1, can be provided to human expert 6. For example, the operating settings of the identified dialysis device 1 can be provided to human expert 6. In addition, information including the current status of dialysis device 1 can be provided to human expert 6, such as the current flow rate, consumable fill level, status or error message, or any other relevant information related to dialysis device 1.

[0147] Additional relevant information can also be provided to human expert 6, such as the task to be performed, information about the patient, and constraints of the treatment location. For example, such information may include details about available accessories, attachments, consumables, etc.

[0148] In addition, information about user 2 can be provided to human expert 6. For example, information about user 2's knowledge or skill level or any other additional needs, requirements, or desires of user 2 can be provided to human expert 6. Such information can be, for example, pre-specified by user 2 and / or obtained from an appropriate user database.

[0149] For communication between human expert 6 and user 2, any suitable communication channel can be established. Such a communication channel can be used for, for example, voice or video communication. Additionally, human expert 6 can specify further assistance that can be provided to user 2 via output components (specifically, the output components of AR device 3). In this way, human expert 6 can provide user 2 with graphical indications of specific locations on dialysis device 1 or prompts for operating dialysis device 1. Such indications can be provided to user 2 in the same or similar manner as the instructions in the assistance program.

[0150] If the same or similar dialysis equipment is available at the location of human expert 6, static or dynamic images of the equipment can also be captured and the image data transmitted to user 2, so that the image data can be displayed on user 2's display, for example, by means of AR device 3.

[0151] To provide additional information to human expert 6, any type of information captured at user 2's location by sensor components, particularly by the sensor components of AR device 3, can be transmitted to human expert 6. For example, human expert 6 can use VR and / or AR devices to view / analyze data from user 2 and / or dialysis device 1. In this way, a virtual environment very similar to the configuration at user 2's location is provided to human expert 6.

[0152] Human expert 6 can connect to user 2 from the start of operating dialysis device 1. Alternatively, human expert 6 can also establish a connection solely based on a request, at predefined time intervals (e.g., every 10 minutes), or based on events (in the preparation phase, events that trigger the connection to human expert can be defined based on certain events such as a fault state, operation lasting too long, etc.). For example, user 2 can request assistance from human expert 6 in cases of specific needs. For example, user 2 can request a connection to human expert 6 in the event of a specific event (e.g., a fault or problem related to dialysis device 1). To do this, a connection to human expert 6 can be requested through any type of user action, such as voice commands, predefined gestures, or any other type of user input. Alternatively, or in addition, a connection to human expert 6 can also be automatically established in the event of a specific event, problem, fault, or any other triggering problem.

[0153] To obtain assistance from human expert 6, user 2 can manually specify or select the desired human expert. For example, user 2 can specify human expert 6 through appropriate input (e.g., input on a user interface). For instance, user 2 can select human expert 6 from a list of available human experts. Such a list can be a static list of available human experts or a list that is dynamically modified based on the current state of each expert, taking into account multiple human experts. However, any other suitable scheme for specifying or selecting human expert 6 may also be possible.

[0154] Alternatively or additionally, human experts can be assigned to a specific medical device 1 and / or a user operating the medical device using an allocation algorithm. The allocation algorithm is configured to provide a mapping or matching between human experts and medical device 1 and / or users requesting such assistance. The allocation algorithm can be based on predefined matching criteria. Matching criteria can be selected from a group consisting of: - Availability of human experts related to the time stage of needing or requesting assistance. - Geographical location, especially the geographical proximity of the requested medical equipment and human specialists. - The skill level of the human specialist and / or knowledge of the specific medical equipment for which assistance has been requested. - Historical matching data allows those requesting assistance and experts to understand each other, and - User-defined matching criteria.

[0155] To identify and determine suitable human experts, various methods can be considered. In particular, an identification algorithm can be executed, configured to select or determine a specific human expert from a pool or set of human experts. For example, the identification algorithm analyzes the individual needs and / or constraints of the user 2, the dialysis device 1, the desired task to be performed, and / or the needs of the patient to be treated, etc. Therefore, all relevant information that should be considered when identifying one or more suitable human experts 6 can be received, for example, read from and processed from appropriate storage components, to match the needs with the corresponding characteristics of available human experts.

[0156] For such identification of a suitable human expert, the necessary information relating to the human expert must be obtained and provided to the identification algorithm. The identification algorithm is used to determine a suitable human expert assisted by at least one AR device. For this purpose, the human expert can manually input the relevant information, for example, using a suitable input terminal, user interface, etc. However, all or at least some of the relevant information about the human expert can also be obtained automatically. For example, the available time period of the expert can be determined by referring to the expert's electronic calendar. For example, a data connection can be established for the expert's calendar data to a database or another storage device, accessing the calendar of a personal digital assistant such as a smartphone, or accessing any other database or storage device to obtain the relevant information. Furthermore, the availability of expert 6 can be detected, for example, by detecting whether expert 6 is currently logged in or registered in a technical system, particularly a system that can be used to connect human expert 6 with user 2. However, any other method, fully or partially automated, can also be possible to determine the availability of an expert. For example, the human expert's usual working hours in their current country can also be considered.

[0157] In addition, users can specify their preferences for desired experts or a set of experts. Such preferences can be input by, for example, user 2. For instance, user 2 can specify an evaluation or assessment of human expert 6 after a session with the corresponding human expert 6 has ended. Therefore, the ranking and / or assignment algorithms for human experts can also take into account the preferences of a specific user 2 for one or more human experts.

[0158] When matching User 2's needs with the characteristics of available experts, the allocation algorithm may also consider the experts' skills. Such skills may include, for example, language skills, skills related to a specific disease or treatment, skills related to a specific medical device, such as skills related to a specific type of dialysis equipment, or any other relevant skills. For example, such skills can be determined by receiving manual input from the corresponding expert. However, at least some skills can also be determined automatically. For example, language skills can be determined based on the settings of the technology system the expert is currently using, or the level of skill related to a specific device can be determined based on the fact that such a device is available at the expert's current location. However, any other scheme for identifying one or more characteristics of human experts may also be possible. The relevant characteristics or features of human experts can be predetermined and stored in a suitable storage device, such as an expert database. Therefore, when identifying one or more human experts matching User 2's needs, the appropriate expert can be automatically identified by referring to this expert database, which can be accessed by the allocation algorithm.

[0159] To identify an appropriate human expert 6, for example, to match the needs of user 2 with the characteristics of available human experts 6, a selection scheme based on pre-stored rules can be applied. Specifically, one or more selection schemes and / or rules can be specified in an appropriate storage medium, such as a selection database, and this storage medium is referenced when selecting an appropriate human expert 6 for user 2. In this way, by applying technical assistance for selecting a human expert, the identification of an appropriate human expert 6 can be simplified and accelerated. Therefore, user 2 can connect to an appropriate human expert 6 within a very short time. Thus, user 2 will quickly receive appropriate assistance if needed. Therefore, user 2 can be guided to complete the necessary tasks to resolve the problem very quickly. In this way, health damage during patient treatment can be avoided.

[0160] The method may include: alternative or additional land. - Store the identified personal information in an expert database; and - Determine the user's needs for operating the medical device. The determined needs can be stored in a needs storage device.

[0161] Human experts can be assigned to the requesting user and / or the medical device being operated by the user, based on a match between information stored in an expert database and the identified user's needs.

[0162] In summary, this invention relates to user assistance when using medical devices such as dialysis equipment. To this end, it proposes providing user assistance using augmented reality devices. Assistance can be provided by analyzing the current situation and the user's needs. The operating settings of the dialysis equipment are detected to provide automatic assistance to the user. In another embodiment, the user can be assisted by an expert, wherein the user can be assisted in selecting an appropriate expert fully or partially automatically.

Claims

1. A method for providing assistance in operating medical devices, particularly dialysis equipment (1), on an augmented reality (AR) device (3), comprising: - Data is captured by at least one sensor component (S1); - Identify (S2) the operating settings of the medical device based on data captured by the at least one sensor component; - Determine (S3) the task to be performed on the medical device; - Monitor (S4) the activities of user (2) based at least on data captured by the at least one sensor component; - Based on the identified operating settings of the medical device, the determined task to be performed, and the monitored activities of the user (2), determine (S5) an assistance plan to provide assistance for performing the determined task; - Provide assistance according to the determined assistance scheme, including outputting instructions on the output component of the AR device (3).

2. The method according to claim 1, wherein, Capturing (S1) data related to the medical device includes: capturing images by the sensor components; scanning optical tags and / or RF tags on the medical device and / or accessory components of the medical device; and / or The operation settings for identifying (S2) the medical device include: identifying the medical device, detecting at least one accessory component of the medical device, and / or determining the spatial position and / or spatial orientation of the medical device.

3. The method according to claim 1 or 2, comprising: Obtain at least one relevant reference operation from the reference database for the identified task; The assistance scheme and / or the assistance are determined based on a comparison between the monitored user's (2) activities and relevant reference operations obtained from the reference database.

4. The method according to any one of claims 1 to 3, wherein, The tasks are to be performed by the user (2) and include: configuring or operating the medical device, monitoring the medical device during operation, and / or maintaining the medical device and / or repairing or servicing the medical device.

5. The method according to any one of claims 1 to 4, wherein, The assistance scheme and / or assistance is determined based on the user's (2) preset or predetermined skill level and / or rules, particularly pre-stored rules obtained from a rule database.

6. The method according to any one of claims 1 to 5, comprising the following steps: An assessment of the skill level of the user (2) is calculated based on the monitored activities of the user (2) and the relevant reference operations for the identified task.

7. The method according to any one of claims 3 to 6, wherein, The assistance scheme and / or the assistance are determined based on the difference between the monitored user (2)’s activity and the relevant reference operation, and in particular, the indication is provided on the output component only if the difference between the monitored user (2)’s activity and the relevant reference operation is determined to be higher than a predefined threshold.

8. The method according to any one of claims 1 to 7, comprising the step of providing real-time support from artificial experts and / or human experts (6) for operating the device. in, The real-time support is provided on the output component of the AR device (3).

9. The method according to claim 8, further comprising the step of receiving a user request for providing real-time support via at least one sensor component. in, The real-time support is controlled based on the parameters of the received user request.

10. The method according to claim 8 or 9, wherein, Human experts are identified from the set of human experts (6) by performing an identification algorithm, and / or the human experts (6) are assigned to a specific user (2) or a specific medical device by performing an assignment algorithm.

11. The method according to claim 10, wherein, The identification algorithm and / or the allocation algorithm process personal information related to human experts, wherein the personal information is determined in the following ways: - Receive input from the human expert. - Analyze data from the electronic devices of the human experts, particularly scheduling data. - Detect the presence of the human expert at the predetermined spatial location. - Receive the rating from the human expert based on the user's input, and / or - Receive information about the human expert, including skills, preferences, scheduling data, ratings and / or other data related to the corresponding human expert; And / or wherein the method may include: - Store the identified personal information in an expert database; - Determine the user's (2) need for operating the medical device; The allocation algorithm is configured to allocate the human expert (6) based on the matching between information stored in the expert database and the determined needs of the user (2).

12. The method according to claim 11, wherein, The needs of the user (2) are determined based on at least one of the following: user input, particularly user input received by the sensor component; input data and / or patient information received from the medical device, particularly patient data obtained from a patient database.

13. The method according to any one of claims 8 to 12, comprising storing the monitored activities of the user (2), wherein, The human expert (6) is identified based on the previously stored activities of the monitored user (2).

14. The method according to any one of claims 8 to 13, wherein, The human experts are selected based on the machine learning module (6).

15. A medical system configured to provide assistance on an augmented reality (AR) device (3), and the medical system configured to perform the method according to any one of the preceding method claims, comprising: - Medical equipment, especially dialysis equipment (1); - A sensor component configured to capture data; - The AR device (3), the AR device having an output component, and - Control device (4), the control device being configured to: - Identify the operating settings of the medical device based on data captured by at least one sensor component. - Determine the task to be performed by the user (2) on the medical device. - To monitor the activities of the user (2) based on data captured by the at least one sensor component, and - Based on the identified operating settings of the medical device, the determined task to be performed, and the monitored activities of the user (2), an assistance program is determined to provide assistance to the user (2) in performing the determined task. - Provide assistance according to the determined assistance scheme, including outputting instructions on the output component of the AR device (3).

16. An augmented reality (AR) device (3) for use in the medical system according to claim 15, comprising: An output device configured to provide instructions based on a determined support protocol when operating the medical device, particularly the dialysis device (1).

17. The AR device (3) according to claim 16, comprising a sensor component configured to capture data related to the medical device, particularly the dialysis device (1).

Images