EXTRACORPOREAL BLOOD TREATMENT SYSTEM WITH AUGMENTED REALITY ASSEMBLY VERIFICATION AND FUNCTIONAL TESTING DEVICE

Description

Technical area

[0001] The disclosure relates to a method and a device for functional testing of medical devices. Background of the Revelation

[0002] Augmented reality (AR) is the computer-assisted enhancement of the perception of reality. This information can address all human sensory modalities. However, augmented reality is often understood only as the visual representation of information, i.e., the supplementation of images or videos with computer-generated additional information or virtual objects by means of overlay. In soccer broadcasts, for example, augmented reality is the display of distances for free kicks using a circle or line.

[0003] A dialysis machine enables the patient-specific removal of dissolved substances (e.g., urea, creatinine, vitamin B12, or β2-microglobulin) and, if necessary, a defined proportion of water from the blood during renal replacement therapy. Dialysis machines are used for both hemodialysis and hemodiafiltration. Dialysis machines can generally be divided into the following modules: extracorporeal blood circuit, dialysis fluid circuit, disinfection unit, control unit, and power supply. In addition, consumables, so-called disposables, are used during treatment. These disposables include dialysis fluid cannulas, blood tubing systems, dialyzers, dialysis concentrates, etc.

[0004] One disadvantage of the current technology is that nurses require special user training to operate dialysis machines and properly attach disposables to the dialysis machine. This user training is required for every new generation of dialysis machine.

[0005] Augmented reality support during dialysis treatment is known from US 2019 / 0064520 A1.

[0006] Description of the invention The object of the disclosure is to enable a quick, efficient and error-free application of the disposables as well as a quick and safe self-test using internal and external information.

[0007] This object is achieved by the features of claims 1 and 7. Advantageous embodiments or further developments are claimed in the subclaims. In addition to this claimed invention, the present document describes in a more general way (without, however, claiming it in this more general way): a method for activating a function of a device, preferably a medical device, comprising the steps: Capturing the actual state of the device by means of a camera, preferably on an AR device, in particular AR glasses or an AR privacy screen, comparing the actual state of the device with a target state of the device by at least one CPU that is connected to the camera, sending a command for starting a function, preferably a functional test, from the CPU to the device based on the comparison, activating a function, preferably a functional test, of the device based on the command.

[0008] In other words, the at least one CPU / processing unit that receives the images from the camera detects the state / structure / setting / assembly stage of a medical device, preferably a dialysis machine. The camera and, if applicable, the CPU / processing unit can be housed in or integrated into the AR device, preferably on a pair of smart glasses.

[0009] The at least one CPU / processing unit displays the steps required to be performed by the user, e.g. for correctly connecting disposables to the medical device, in a field of view of the AR device, in particular smart glass glasses (preferably a projector connected to the CPU displays the information).

[0010] When the CPU detects via the camera mounted on the AR device that a setup has been completed correctly, the CPU starts the device for a functional test via a preferably wireless connection, preferably via Bluetooth or WLAN (ZigBee, NFC, mobile communications).

[0011] Alternatively or additionally, the CPU or a data transmission device on the AR device is provided and adapted to send the camera images to another, second or stationary CPU. This is preferably located in a / the medical device, but it can also be external to the AR device and / or the medical device, e.g. in the form of a PC connected to the medical device. This second or stationary CPU preferably has greater computing power than the first CPU, which may be arranged on the AR device. The second CPU processes the received data and sends the processed data back to the first CPU of the data transmission device on the AR device, which then causes the information to be displayed in the field of view of the AR device.In other words, the first CPU on the AR device is used to transmit the data and controls the display of information, whereas the second external or stationary CPU serves as a data processing unit and a computing unit for processing the recorded images and, for example, deriving action steps from them, which it returns to the first CPU as concrete information to be displayed, as just described.

[0012] Preferably, the device is a medical device and particularly preferably a dialysis device, a dialysis machine, a syringe pump or the like.

[0013] The AR device is preferably a product from the class of wearables (wearable computing). A wearable / wearable computer is attached to the user's body or integrated into clothing during use. According to the disclosure, the AR device preferably has an optical display integrated into the user's field of vision, as well as a CPU and / or a data transmission unit. The AR device is particularly preferably AR glasses, smart glasses, data glasses, or a head-up display. Smart glasses or smart glasses (or colloquially: data glasses) are preferably a wearable computer attached to glasses that adds information to the user's field of vision. Furthermore, the glasses preferably also have the camera. Additionally or alternatively, the glasses can also have a data transmission unit. The glasses enable augmented reality or mixed reality.

[0014] The camera is preferably a digital camera. In addition to discreetly displaying information on the AR device's screen, information can also be combined with the image captured by the integrated digital camera. For this purpose, data can be directly retrieved and sent from the internet.

[0015] The camera is preferably in data communication with the first (AR device-integrated) CPU and / or the second stationary or separate CPU, preferably wirelessly, e.g. via Bluetooth, Wi-Fi or the like. Alternatively or additionally, the first CPU on the AR device can be in data communication with a second external CPU, preferably wirelessly, e.g. via Bluetooth, Wi-Fi or the like. The CPU on the AR device is preferably in data communication with the medical device, preferably wirelessly, e.g. via Bluetooth, Wi-Fi or the like. The second CPU is preferably a computing unit / CPU already present in the medical device for control purposes thereof.

[0016] Preferably, the comparison of the actual state of the device with a desired state of the device takes place using an image recognition algorithm stored on a storage medium of the CPU. This can be the first CPU on the AR device, or at least an optional second CPU in the medical device or external to the AR device and / or the medical device.

[0017] Preferably, the device performs a self-test / functional test / pressure self-test or the like in response to the camera input. The functional test can be activated after a manual confirmation on the medical device itself, or by means of a gesture recognized by the camera and the CPU, or simply after a predetermined time. For example, a pressure self-test can be started after the pressure sensors are connected. During the pressure self-test, the connected / mounted disposables on the medical device are preferably pressurized by the device. If a predetermined pressure drop is detected by the pressure sensors, a leak or a faulty connection exists, and the medical device issues an error message / signal.

[0018] The actual state refers to the current state of the disposables installed in the medical device at a first time T1. The target state refers to the finished and correct state of the disposables in the medical device. Preferably, the setup process, in which the disposables are installed in the medical device, is broken down into various sub-steps. These are guided, monitored (comparison between the current actual state and the target state of the sub-step), and then tested, preferably individually or as a whole.

[0019] Sending a command to start a function, preferably a functional test, from the CPU to the device based on the comparison (or following the comparison) preferably occurs in the case of a positive comparison, i.e., when the actual state corresponds to the desired state. In the case of a negative comparison, i.e., when the actual state does not correspond to the desired state, a corresponding function is activated in response to the command, preferably an error message in the AR device or medical device.

[0020] Preferably, the method is characterized in that it further comprises the step of displaying the functional result in the AR device. In other words, the individual installation steps of the disposables are displayed in the AR device, depending on the comparison of the actual state with the desired state. Alternatively or additionally, a result of the functional test, for example, the prevailing pressure in the connected disposables, can be displayed.

[0021] Preferably, the method is characterized in that the method further comprises the step of sending a functional test result to the CPU and / or displaying the required steps, preferably in the form of markers, animations, and / or messages, to achieve the desired state of the device in the AR device. In other words, the medical device, in which, for example, the second or separate or stationary CPU and / or a data transmission unit is present, sends a signal to the first CPU or data transmission unit in the AR device. Analogously, as already explained above, the result of the function (functional result / functional outcome) is then displayed in response to the signal from the medical device.

[0022] Preferably, the method is characterized in that it further comprises the step of blocking further functions in the event of a negative function (negative functional test). In other words, if the actual state does not match the desired state, the medical device blocks further functions until the comparison is positive.

[0023] Preferably, the method is characterized in that a functional test is a pressure test that measures a (line) pressure built up in disposables for test purposes.

[0024] Preferably, the steps are represented graphically on a display. Preferably, the required steps are presented in the AR device using images, which may be fully or partially animated, and / or text in the user's field of vision. In other words, markers, animations, and / or messages can be projected into the field of vision.

[0025] Preferably, the medical device is in data communication with the CPU, which may be located in the AR device, the medical device, a PC, or otherwise externally.

[0026] The disclosure further relates to a system for activating a device function, preferably a functional test, comprising at least one camera, at least one CPU which is in data connection with the camera, and preferably at least one device, for example a medical device, in particular a dialysis machine, which in turn is in data connection with the CPU or can be brought into data connection with the CPU, wherein the CPU has a storage medium or can be connected to an external CPU in data connection, on which the following steps are stored: Detecting an actual state of the device by means of the camera, which is preferably arranged on an AR device, comparing the actual state of the device with a target state of the device by the CPU, which is connected to the camera, sending a command for starting a device function, preferably a device function test, (from the CPU) to the device if the actual state corresponds to a predetermined target state, activating the device function, preferably the device function test, of the device based on the command.

[0027] Preferably, the camera is mounted on / in an AR device that is designed and adapted to display the results of the functional test and / or installation instructions, preferably based on the display principle of a head-up display.

[0028] The disclosure further preferably relates to a method and a device for activating a function of a device, preferably a medical device, comprising the steps of: detecting the actual state of the device by means of a camera, which is preferably arranged on an AR device. Comparing the actual state of the device with a desired state of the device by a CPU that is connected to the camera. Sending a command for starting a device function, preferably a device function test, (from the CPU) to the device if the actual state corresponds or appears to correspond to a predetermined desired state according to visual recognition. Activating a device function, preferably a device function test, in response to the command.

[0029] In summary, the disclosure relates to a method for activating or performing a functional test of a blood treatment device, preferably a dialysis machine, comprising the steps of: capturing an actual state of the blood treatment device by means of a camera, which is preferably provided or attached in / on an augmented reality device, preferably augmented reality glasses; comparing the actual state of the blood treatment device with a desired state of the blood treatment device by a control unit (CPU) that is connected to the camera; sending a command for starting the functional test from the control unit (CPU) to the blood treatment device based on the comparison; and activating the functional test of the blood treatment device based on the command.

[0030] Preferably, the method further comprises the steps of: sending a functional test result to the control unit (CPU); and displaying the functional test result in an augmented reality device.

[0031] More preferably, the method further comprises the step of displaying steps still required to be carried out in order to achieve the desired state of the blood treatment device in the augmented reality device, preferably in the form of markings, animations and / or messages.

[0032] It is advantageous if the procedure also includes the step of blocking further functional tests in case of a negative functional test result.

[0033] Advantageously, the functional test is a, preferably automated, self-test of the blood treatment device for checking upgrade actions performed by a user when upgrading the blood treatment device.

[0034] Preferably, the functional test is a pressure test that measures a pressure temporarily built up for test purposes in disposable products, in particular fluid lines that are attached or provided on / in the blood treatment device.

[0035] Furthermore, the disclosure relates in summary to a system comprising at least one camera, at least one control unit (CPU) which is or can be brought into data connection with the camera, and at least one blood treatment device, in particular a dialysis machine, which in turn is or can be brought into data connection with the control unit (CPU), wherein the control unit (CPU) is set up to display an actual state of the blood treatment device (8) by means of the camera (4), which is preferably provided or mounted in / on an augmented reality device (2), in particular augmented reality glasses or an augmented reality viewing screen.is arranged to detect, compare the actual state of the blood treatment device (8) with a desired state of the blood treatment device (8), send a command for starting a functional test to the blood treatment device (8) on the basis of the comparison, and activate the functional test of the blood treatment device (8) on the basis of the command.

[0036] Preferably, the camera is attached or provided on / in an augmented reality device, wherein the augmented reality device is configured to display a functional test result and / or further steps to be performed by a user.

[0037] Further preferably, the functional test is a, preferably automated, self-test of the blood treatment device for checking upgrade actions performed by a user when upgrading the blood treatment device.

[0038] It is advantageous if the functional test is a pressure test that measures a pressure temporarily built up for test purposes in disposable products, in particular fluid lines that are attached to or provided on / in the blood treatment device.

[0039] In the following, the present disclosure is explained in more detail using a preferred embodiment with reference to the accompanying figures. Short description of the characters

[0040] Figure 1 shows the system for activating a function of a device according to the disclosure in a schematic representation. Figure 2 shows the method for activating a function of a device. Figure 3 shows the system for activating a function of a device according to the disclosure in a schematic representation with an augmented reality guide. Figure 4shows a schematic representation of a possible interaction between the AR device, the user and the CPU. Description of the embodiment

[0041] Figure 1shows a system 1 for activating a function or a functional test of a medical device according to the disclosure in a schematic representation. A camera 4 comprising a defined field of view 6 is attached to / in AR glasses (AR device) 2. The field of view 6 comprises, for example, a dialysis machine 8, as a medical device, with disposables 10 attached thereto, which in this case are the lines intended for replacement (blood lines, dialysis fluid lines) and a dialyzer of the dialysis machine 8. Furthermore, at least one CPU is provided, which is connected to the camera 4. This CPU can be a stationary computing unit, possibly device-specific, or a mobile computing unit, specific to the AR glasses; in the case of a stationary computing unit, the AR glasses can only have a data transmission unit.The CPU (not shown), preferably in the dialysis machine 8 and / or on the AR glasses 2, detects the actual arrangement (actual state) of the disposables 10 and, using an image recognition algorithm, compares it with a desired arrangement (desired state) stored in a storage medium of the CPU or retrieved via Wi-Fi. If the algorithm detects that the disposables 10 are incorrectly / incompletely attached, a correction step is displayed in the AR glasses 2 in the user's field of view, which corresponds to the field of view 6 of the camera 4. If the algorithm detects that the disposables 10 are correctly attached, the CPU, preferably via Wi-Fi or Bluetooth or the like, sends a command to the dialysis machine 8 to perform a function or a functional test. If the functional test is positive, this is displayed on the AR glasses 2. If the functional test is negative, a correspondingly required correction step is displayed on the AR glasses 2.

[0042] Figure 2 shows the method for activating a function / functional test of a device (dialysis machine 8) using the above system 1.

[0043] In step 112, the camera 4 detects the actual state of the dialysis machine 8. In other words, the camera 4 takes one or more images that represent / document the current actual state.

[0044] In step 114, the CPU compares the actual state of the dialysis machine 8 with a desired state of the dialysis machine 8. In other words, the image from camera 4 from step 112 is compared with a stored image on the CPU, and pattern recognition is used to determine whether the actual state corresponds to the desired state. If such a comparison is not possible, for example due to an unsuitable image, step 112 is executed again until an image is obtained that shows the actual state and can be compared with a desired state. This repetition process or the presence of an unsuitable image can be displayed on the AR device, for example with a preferred message / correction instruction that indicates, for example, that the viewing angle must be changed. If a comparison of the actual state with the desired state is successful, the next step follows.

[0045] In step 116, the CPU sends a command to start a functional test to the dialysis machine 8. In other words, as soon as the CPU has positively compared and determined the actual state with the desired state, a command is sent to the medical device / dialysis machine to execute a function / functional test to check whether the assembly was carried out functionally correctly.

[0046] In step 118, the dialysis machine 8 performs the function or functional test. In other words, a corresponding action is performed on the dialysis machine 8 in response to the CPU command.

[0047] In step 120, the dialysis machine 8 sends the result of the functional test to the CPU, or the CPU measures the test result, which then graphically displays the result on the AR glasses 2. Preferably, the result is the pressure / pressure curve that prevails in the disposables / lines / was induced for testing purposes.

[0048] Figure 3 shows the system 1 for activating a function or a functional test of a medical device according to the disclosure in a schematic representation with an augmented reality guide based on Figure 2 . The camera 4 is attached to the AR glasses 2 and covers the defined field of view 6. The field of view 6 (corresponds to the representation in Figure 3) includes, for example, the dialysis machine 8 (medical device) with the disposables 10 attached to it (e.g., fluid lines, tubes, dialyzer, etc.). The windows 122, 124, and 126 are displayed in the field of view, along with arrows representing instructions for handling (e.g., the straight arrow next to window 122 and the semicircular arrow next to window 124). The first window 122 can contain instructions such as, for example, "Guide the tube through the connector." The second window 124 can contain instructions such as, for example, "Insert the blood tube into the blood pump as shown in the video." The third window 126 at the bottom can have a different size than one of the other windows, for example, larger, and a video, for example, a YouTube video, can be shown in this window.

[0049] Figure 4shows a schematic representation of a possible interaction between the AR device, the user, and the CPU. In Figure 4 the procedure is divided into the procedural steps carried out by the AR device (see column 128), the procedural steps carried out by the user (see column 130) and the procedural steps carried out by the medical device (see column 132).

[0050] In step 134, the AR device or the CPU attached to it detects that the task of connecting the disposables has been recognized.

[0051] In step 136, the medical device is informed that the task of connecting the disposables has been recognized.

[0052] In step 138, the medical device prepares for a functional test.

[0053] In step 140, the user then installs the cables.

[0054] In step 142, the AR device detects that the lines have been connected and can additionally or alternatively check for incorrectly connected lines.

[0055] In step 144, the medical device is informed that the disposables have been installed.

[0056] The medical device performs a functional test of the leads in step 146.

[0057] In step 148, the medical device informs the AR device about the positive test or result.

[0058] In step 150, the result is displayed on the AR device. If the result is negative, the steps from step 142 are repeated.

[0059] If everything is OK, the next step is displayed in step 152 in the AR device.

Claims

1. A method for activating or performing a function test of a blood treatment device (8), comprising the following steps: • detecting an actual state of the blood treatment device (8) by means of a camera (4), which is provided or attached in / to an augmented reality device, • comparing the actual state of the blood treatment device (8) with a target state of the blood treatment device (8) by means of a control unit (CPU) connected to the camera (4), • transmitting, on the basis of the comparison, a command for starting the function test to the blood treatment device (8) by the control unit (CPU), • activating the function test of the blood treatment device (8) on the basis of the command.

2. The method according to claim 1, further characterized by the steps of: • transmitting a function test result to the control unit (CPU), • displaying the function test result in the augmented reality device (2).

3. The method according to claim 1 or 2, further characterized by the step of: • overlaying, in the augmented reality device (2), of still necessary steps to be performed in order to achieve the target state of the blood treatment device (8).

4. The method according to one of claims 1 to 3, further characterized by the step of: • blocking further function tests in the case of a negative function test result.

5. The method according to one of claims 1 to 4, characterized in that the function test is a self-test of the blood treatment device (8) for checking setting-up actions performed by a user during a set-up of the blood treatment device (8).

6. The method according to one of claims 1 to 5, characterized in that the function test is a pressure test measuring a pressure temporarily built up for test purposes in disposable products, which are attached or provided to / in the blood treatment device (8).

7. A system comprising at least one camera (4), at least one control unit (CPU) which is or can be brought in data connection with the camera (4), and at least one blood treatment device (8), which in turn is or can be brought in data connection with the control unit (CPU), characterized in that the control unit (CPU) is configured • to detect an actual state of the blood treatment device (8) by means of the camera (4), which is provided or arranged in / on an augmented reality device (2), • to compare the actual state of the blood treatment device (8) with a target state of the blood treatment device (8), • to transmit, on the basis of the comparison, a command for starting a function test to the blood treatment device (8), and • to activate the function test of the blood treatment device (8) on the basis of the command.

8. The system according to claim 7, characterized in that the camera (4) is attached or provided to / in the augmented reality device (2), the augmented reality device (2) being configured to display a function test result and / or further steps to be performed by a user.

9. The system according to claim 7 or 8, characterized in that the function test is a self-test of the blood treatment device (8) for checking setting-up actions performed by a user when setting-up the blood treatment device (8).

10. The system according to one of claims 7 to 9, characterized in that the function test is a pressure test measuring a pressure temporarily built up for test purposes in disposable products, which are attached or provided to / in the blood treatment device (8).