Extracorporeal blood processing system with an augmented reality device for checking assembly and functional testing

Abstract

The present invention relates to a method and a device for activating a function of a device, preferably a medical device, comprising the following steps: detecting an actual state of the device using a camera, preferably an AR device, preferably AR glasses; comparing the actual state of the device with a desired state of the device using a CPU connected to the camera; based on the comparison, sending a command from the CPU to the device to initiate the function or functional test of the device, preferably a functional test; and based on this command, activating the function or functional test of the device.

Description

[Technical field]

[0001] The present disclosure relates to a method and device for checking the functionality of a medical device. [Background technology]

[0002] Augmented reality (abbreviated AR) is a computer-assisted extension of the perception of reality. This information can address all human sensory modalities. However, augmented reality is often understood to mean only the visual display of information, i.e. the addition of computer-generated captured information or virtual objects to an image or video using superimposition / overlay. In soccer broadcasts, augmented reality is for example the superimposition of distances in case of free kicks, using circles or lines.

[0003] Dialysis machines / dialysis equipment allow individualized removal of dissolved substances (e.g. urea, creatinine, vitamin B12 or β2-microglobulin) and, if necessary, a defined water content from the blood in a kidney replacement process. Dialysis machines are used for both hemodialysis and hemodiafiltration. Basically, a dialysis machine can be divided into the following modules: external blood circulation, dialysate circulation, disinfection unit, operation unit and power supply unit. Furthermore, consumable materials, so-called consumables, are used during the process. These consumables are, for example, dialysate cannulas, blood tubing systems, dialyzers, dialysis concentrates, etc.

[0004] A disadvantage of the prior art is that caregivers require special user training to use the dialysis machine or to properly install consumables on the dialysis machine. This user training is required for each new generation of dialysis machine. Summary of the Invention

[0005] An objective of the present disclosure is to enable fast, highly efficient and error-free application of consumables, as well as fast and safe self-testing with internal and external information.

[0006] This object is achieved by the features of claims 1 and 7. Advantageous embodiments or further developments are claimed in the dependent claims and / or are explained below.

[0007] The present disclosure provides a method for actuating a function of a device, preferably a medical device, comprising: - detecting the actual state of the device using a camera, preferably an AR device, preferably AR glasses or AR vision protection glasses; Comparing the actual state of the device with a desired / target state of the device using at least one CPU connected to the camera; sending a command from said CPU to said device to initiate a function, preferably a functional test, based on said comparison; activating a function, preferably a functional test, of said device based on said command.

[0008] In other words, the at least one CPU / computing unit receiving the images from the camera identifies the state / setup / setting / assembly stage of the medical device, preferably the dialysis machine. In this regard, the camera and, if applicable, also the CPU / computing unit may be housed or integrated in the AR device, preferably the smart glasses. The at least one CPU / computing unit superimposes the necessary steps to be taken by the user, for example to correctly connect a consumable to the medical device, onto the field of view of the AR device, in particular the smart glasses (preferably a projector connected to the CPU and superimposing the information).

[0009] If the CPU identifies, via a camera located on the AR device, that the setup is properly completed, the CPU starts the device for functional testing, preferably via a wireless connection, preferably using Bluetooth or WLAN (ZigBee, NFC, Mobile Radio).

[0010] Alternatively or additionally, a CPU or data transmission device in the AR device is provided and adapted to transmit the image of the camera to another second or fixed CPU. Preferably, this CPU is located in the medical device, but can also be external to the AR device and / or the medical device, for example in the form of a PC connected to the medical device. This second or fixed CPU preferably has a higher computing power than the first CPU located in the AR device, if applicable. The second CPU processes the received data and sends the processed data back to the first CPU of the data transmission device to the AR device, which then causes the information to be displayed in the field of view of the AR device. In other words, the first CPU in the AR device is used to transmit data and control the display of information, while the second, external or fixed CPU is used as a data processing unit and a computing unit to process the captured image and from them, for example, direct the operation steps of returning it to the first CPU as specific information to be displayed as described above.

[0011] Preferably, the device is a medical device, more preferably a display device, a dialysis machine, a syringe pump, or the like.

[0012] The AR device is preferably a wearable class product (wearable computing). The wearable / wearable computer is attached to the user's body or integrated into the clothing during use. Preferably, the AR device according to the present disclosure has an optical display integrated into the user's field of view, as well as a CPU and / or a data transmission unit. More preferably, the AR device is a pair of AR glasses, smart glasses, smartglasses, data glasses or a head-up display. In this context, smart glasses or smartglasses (or colloquially data glasses) are preferably a wearable computer in a pair of glasses that adds information to the user's field of view. More preferably, the glasses also include a camera. Additionally or alternatively, the glasses can also have a data transmission unit. The glasses enable augmented or mixed reality.

[0013] Preferably, the camera is a digital camera. In addition to the individual display of the information on the display of the AR device, the information can also be combined with the captured image of the integrated digital camera. For this purpose, data can be obtained and transmitted directly from the Internet.

[0014] Preferably, the camera is in data connection with a first (integrated in the AR device) CPU and / or a second, fixed or separate CPU, preferably in a wireless manner, e.g., via Bluetooth, W-LAN, etc. Alternatively or additionally, the first CPU in the AR device may be in data connection with a second external CPU, preferably in a wireless manner, e.g., via Bluetooth, W-LAN, etc. Preferably, the CPU in the AR device is in data connection with the medical device, preferably in a wireless manner, e.g., via Bluetooth, W-LAN, etc. The second CPU is preferably a computing unit / CPU already present in the medical device for the purpose of its control.

[0015] Preferably, the comparison of the actual state of the device with the desired state of the device is performed using an image analysis algorithm stored in a storage medium of a CPU, which may be a first CPU in the AR device or which may be at least one optional second CPU in the medical device or external to the AR device and / or the medical device.

[0016] Preferably, the device performs a self-test / functional test / pressure self-test etc. in response to the camera input. Here, the functional test can be activated after manual checking of the medical device itself, or with a gesture recognized by the camera and CPU, or simply after a predefined time. For example, a pressure self-test can be started after connecting a pressure sensor. During the pressure self-test, preferably connected / on-board consumables in the medical device are pressurized by the medical device. When a predefined pressure loss is determined by the pressure sensor, a leak or incomplete connection exists, and the medical device outputs an error message / signal.

[0017] The actual state represents the current state of how the consumable is attached to the medical device at a first time T1. The desired state represents the complete and accurate state of the consumable in the medical device. Preferably, the set-up process in which the consumable is attached to the medical device is decomposed into different sub-steps, which are preferably guided, monitored (comparison between the current actual state and the desired state of the sub-steps) and then "tested", each individually or as a whole.

[0018] Based on (or following) the comparison, a function, preferably a command to initiate a function test, is preferably sent from the CPU to the device in case of a positive comparison, i.e., when the actual state matches the desired state. In case of a negative comparison, i.e., when the actual state does not match the desired state, a corresponding function is responsive to the command, preferably activating an error message in the AR device or the medical device.

[0019] Preferably, the method is characterized in that it further comprises a step of displaying the functional results in the AR device. In other words, the individual installation steps of the consumables are displayed in the AR device depending on the comparison between the actual state and the desired state. Alternatively or additionally, the results of the functional test can be displayed, for example the pressure used in the connected consumables.

[0020] Preferably, the method is characterized in that it further comprises a step of transmitting the result of the function test to the CPU and / or the necessary step of superimposing, preferably in the form of marking, animation and / or message, in order to achieve the desired state of the device in the AR device. In other words, for example, the medical device, in which there is a second or separate or fixed CPU and / or data transmission unit, transmits a signal to the first CPU or data transmission unit in the AR device. Similarly, as already explained above, the result of the function (function result / function outcome) is then displayed in response to the signal of the medical device.

[0021] Preferably, the method is characterized in that it further comprises a step of blocking further functions in case of a negative function (in case of a functional test which proves negative), in other words, if the actual state does not match the desired state, the medical device blocks further functions until the comparison is positive.

[0022] The method is preferably characterized in that the functional test is a pressure test, measuring an increased (line) pressure in the consumable for the purpose of the test.

[0023] Preferably, the steps are shown graphically on the display. In the AR device, it is preferred to show the necessary steps using pictorial descriptions, which may be fully or partly animated, and / or using text in the user's field of view. In other words, markings, animations and / or messages can be projected into the field of view.

[0024] Preferably, the medical device is in data connection with a CPU, which may be located in the AR device, the medical device, a PC or otherwise external.

[0025] The present disclosure relates to a system for operating a function, preferably a functional test, of a device, comprising at least one camera, at least one CPU in data connection with said camera, and preferably at least one device, e.g. a medical device, in particular a dialysis machine, which in turn is in data connection with said CPU or can provide it, said system comprising the following steps: - identifying the actual state of the device, preferably by means of a camera arranged in the AR device; - comparing, by the CPU connected to the camera, the actual state of the device with a desired / target state of the device; if the actual state matches a predetermined desired state, sending (from the CPU) a command to the device to initiate a device function, preferably a functional test of the device; - activating said device functionality of said device, preferably a functional test of said device, based on said command; The present invention further relates to a system including a storage medium for storing the above-mentioned information or being data-connected to an external CPU.

[0026] Preferably, a camera is mounted / arranged in the AR device and is provided and adapted to display the results of the functional tests and / or mounting instructions, preferably according to the display principle of a head-up display.

[0027] The present disclosure further preferably relates to a method and device for activating a function of a device, preferably a medical device, comprising the steps of identifying an actual state of the device by means of a camera, preferably arranged in an AR device, comparing said actual state of the device with a desired state of the device by a CPU connected to said camera, sending a command to said device (from said CPU) to initiate a device function, preferably a device functional test, if said actual state matches or appears to match a predetermined desired state according to the visual identification, and activating the device function, preferably a device functional test, in response to said command.

[0028] That is, the present invention relates to a method for operating or performing a functional test of a blood processing device, preferably a dialysis machine, comprising the following steps: detecting an actual state of the blood processing device using a camera, preferably augmented reality glasses, preferably provided or attached in / to an augmented reality device; comparing the actual state of the blood processing device with a desired / target state of the blood processing device using a control unit connected to the camera; based on the comparison, sending a command from the control unit (CPU) to the blood processing device to start the functional test; and based on the command, operating the functional test of the blood processing device.

[0029] Preferably, the method further comprises the steps of transmitting the result of the functional test to a control unit (CPU) and displaying the result of the functional test on an augmented reality device.

[0030] Further preferably, the above method further comprises the step of superimposing on the augmented reality device the necessary steps to be performed to achieve the target state of the blood treatment device, preferably in the form of markings, animations and / or messages.

[0031] Advantageously, it further comprises the step of blocking further functional tests in case of a negative functional test result.

[0032] Advantageously, the functional test is preferably an automated self-test of the blood treatment device for checking the set-up actions performed by a user during set-up of the blood treatment device.

[0033] Preferably, the functional test is a pressure test which measures a temporarily increased pressure for test purposes in consumables, particularly fluid lines, installed or provided in / on the blood processing device.

[0034] Furthermore, the present disclosure relates to a system comprising at least one camera, at least one control unit (CPU) in or capable of being data connected to the camera, and at least one blood processing device, in particular a dialysis machine, which in turn is in or capable of being data connected to said control unit (CPU), wherein the control unit (CPU) is configured to detect an actual state of the blood processing device by means of a camera, preferably a camera provided or placed in / on an augmented reality device, in particular augmented reality glasses or augmented reality vision protection glasses, compare the actual state of the blood processing device with a desired / target state of the blood processing device, and based on the comparison, send a command to the blood processing device to initiate a functional test, and based on the command, activate the functional test of the blood processing device.

[0035] Preferably, a camera is mounted or provided on / in an augmented reality device, the augmented reality device being configured to display the results of the functional test and / or further steps to be performed by a user.

[0036] More preferably, the functional test is an automated self-test of the blood processing device, preferably to check the set-up actions performed by a user when setting up the blood processing device.

[0037] The functional test is advantageously a pressure test which measures a temporarily increased pressure for test purposes in consumables, particularly fluid lines, installed or provided in / on the blood processing device.

[0038] The present disclosure will be explained in more detail below based on preferred exemplary embodiments with reference to the accompanying drawings. [Brief description of the drawings]

[0039] [Figure 1] 1 shows in a schematic diagram a system for operating the functions of a device according to the present disclosure. [Diagram 2] A method for activating a function of the device is shown. [Diagram 3] 1 shows a system for operating the functionality of a device according to the present disclosure in a schematic diagram with an augmented reality guide. [Figure 4] 1 shows a schematic diagram of possible interactions between an AR device, a user and a CPU. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0040] FIG. 1 shows a system 1 for operating a function or a function test of a medical device according to the present disclosure in a schematic diagram. A camera 4 is attached / arranged in AR glasses (AR device) 2 and has a defined field of view 6. The field of view 6 comprises, for example, a dialysis machine 8 as a medical device, which is attached and includes a consumable 10, which in this case is a replacement for the dialysis machine 8 and a line (blood line, dialysate line) intended for the dialyzer. Furthermore, at least one CPU is provided, connected to the camera 4. This CPU may be a fixed, possibly device-specific computing unit, or a mobile AR-glasses-specific computing unit, which is possible in the case of a fixed computing unit in which the AR glasses only have a data transmission unit. Preferably, the CPU (not shown) of the dialysis machine 8 and / or the AR glasses 2 identifies the actual position (actual state) of the consumable 10 and compares it with the desired position (desired state) by means of an image analysis algorithm stored in a recording medium of the CPU or retrieved via W-LAN. If the algorithm identifies that the consumable 10 is incorrectly / incompletely installed, it superimposes corrective steps on the AR glasses 2 in the user's field of view, which corresponds to the field of view 6 of the camera 4. If the algorithm identifies that the consumable 10 is correctly installed, the CPU issues a command, preferably using W-LAN or Bluetooth etc., to the dialysis machine 8 to perform a function or a function test. If the function test is positive, this is displayed on the AR glasses 2. If the function test is negative, the corresponding necessary correction steps are displayed on the AR glasses 2.

[0041] FIG. 2 shows a method for operating the function / functional test of a device (dialysis machine 8) taking into account the system 1 described above.

[0042] In step 112, the camera 4 identifies the actual state of the dialysis machine 8. In other words, the camera 4 captures one or more images that display / document the current actual state.

[0043] In step 114, the CPU compares the actual state of the dialysis machine 8 with the desired state of the dialysis machine 8. In other words, the image of the camera 4 from step 112 is compared with the image stored in the CPU, and pattern recognition is used to determine whether the actual state matches the desired state. If such a comparison is not possible, for example due to an inappropriate image, step 112 is performed again until an image is obtained that shows the actual state and can be compared with the desired state. This iterative process or the presence of an inappropriate image can be displayed, for example, on the AR device, together with a suitable message / correction instruction, for example indicating that the viewing angle needs to be changed. Once a comparison between the actual state and the desired state is achieved, the next step is followed.

[0044] In step 116, the CPU sends a command to the dialysis machine 8 to start a functional test. In other words, once the CPU compares and evaluates in the positive the actual and desired state, it issues a command to the medical device / dialysis machine to perform a function / functional test to check if the assembly has been performed in a functionally correct manner.

[0045] In step 118, the dialysis machine 8 performs a function or a function test. In other words, a corresponding action is performed in the dialysis machine 8 in response to a command from the CPU.

[0046] In step 120, the dialysis machine 8 sends the results of the functional test to the CPU or the CPU measures the test results, which then graphically displays the results on the AR glasses 2. Here, the results are preferably pressures / pressure curves used / derived for testing purposes on consumables / lines.

[0047] FIG. 3 shows a system 1 for operating a function or a functional test of a medical device according to the present disclosure in a schematic diagram with an augmented reality guide based on FIG. 2. A camera 4 is attached to the AR glasses 2 and has a defined field of view 6. The field of view 6 (corresponding to the view in FIG. 3) comprises, for example, a dialysis machine 8 (medical device) and consumables 10 attached thereto (for example, liquid lines, tubes, dialyzer, etc.). Windows 122, 124 and 126 are not only superimposed in the field of view, but also superimposed arrows representing instructions for handling (for example, a straight arrow next to window 122 and a semicircular arrow next to window 124). The first window 122 may contain instructions such as "Thread the tube into the connector". The second window 124 may contain instructions such as "Insert the blood tube into the blood pump as shown in the video". The lower third window 126 may have a different size than one of the other windows, for example it may be larger, and a video may be shown in this window, for example a YouTube® video.

[0048] Figure 4 shows a schematic diagram of possible intercommunications between the AR device, the user and the CPU. In Figure 4, the method is divided into method steps performed by the AR device (see column 128), method steps performed by the user (see column 130) and method steps performed by the medical device (see column 132).

[0049] In step 134, the AR device or a CPU attached thereto identifies that the task "connect consumable" has been identified.

[0050] In step 136, the medical device is informed that the task "connect consumable" has been identified.

[0051] In step 138, the medical device is prepared for functional testing.

[0052] In step 140, the user then attaches the lines.

[0053] In step 142, the AR device identifies that the line is connected and may additionally or alternatively check for incorrectly connected lines.

[0054] In step 144, the medical device is reported as having the consumable installed.

[0055] In step 146, the medical device performs a functional test of the line.

[0056] In step 148, the medical device informs the AR device of the positive test or result.

[0057] The result is displayed on the AR device in step 150. If the result is negative, the steps from step 142 are repeated.

[0058] If all is well, in step 152 the next step is displayed on the AR device. Items related to the technology described in this specification are listed below. (Item 1) A method for operating or performing a functional test of a blood processing device (8), preferably a dialysis machine, comprising the following steps: detecting the actual state of said blood treatment device (8) by means of a camera (4), preferably a camera (4) provided in / on or attached to an augmented reality device, preferably augmented reality glasses (2); comparing the actual state of the blood treatment device (8) with a target state of the blood treatment device (8) by means of a control unit (CPU) connected to the camera (4); - sending, by the control unit (CPU) based on the comparison, a command to start the functional test to the blood processing device (8); - activating the functional test of the blood processing device (8) based on the command; A method comprising: (Item 2) transmitting the results of the functional test to the control unit (CPU); displaying the results of the functional tests on an augmented reality device (2); The method according to item 1, further characterized by: (Item 3) superimposing, preferably in the form of markings, animations and / or messages, on the augmented reality device (2) the necessary steps to be performed in order to achieve the target state of the blood treatment device (8). 3. The method according to claim 1 or 2, further characterized by: (Item 4) Blocking further functional tests in case of a negative functional test result 4. The method according to any one of items 1 to 3, further characterized by: (Item 5) The method according to any one of items 1 to 4, characterized in that the functional test is an automated self-test of the blood processing device (8), preferably for checking set-up actions performed by a user during set-up of the blood processing device (8). (Item 6) The method according to any one of items 1 to 5, characterized in that the functional test is a pressure test in which a pressure temporarily increased for test purposes is measured in a consumable, in particular a fluid line, attached to or provided in / in the blood processing device (8). (Item 7) A system comprising at least one camera (4), at least one control unit (CPU) in or connectable to a data connection with said camera (4), and at least one blood treatment device (8), in particular a dialysis machine, in turn in or connectable to said control unit (CPU), said control unit (CPU) comprising: detecting the actual state of the blood processing device (8) by means of a camera (4), preferably a camera (4) provided or arranged in / on an augmented reality device (2), in particular augmented reality glasses (2) or augmented reality vision protection glasses, comparing the actual state of the blood treatment device (8) with a target state of the blood treatment device (8); sending a command to the blood processing device (8) to initiate a functional test based on the comparison; The system is configured to activate the functional test of the blood processing device (8) based on the command. (Item 8) 8. The system according to item 7, characterized in that the camera (4) is mounted or provided on / in an augmented reality device (2), the augmented reality device (2) being configured to display the results of the functional test and / or further steps to be performed by a user. (Item 9) The system according to item 7 or 8, characterized in that the functional test is preferably an automated self-test of the blood processing device (8) for checking the set-up actions performed by a user when setting up the blood processing device (8). (Item 10) The system according to any one of items 7 to 9, characterized in that the functional test is a pressure test in which a temporarily increased pressure is measured for test purposes in consumables, in particular fluid lines, attached to or provided in / in the blood processing device (8).

Claims

1. A method for operating and performing a functional test of a blood processing device (8), comprising the following steps: - detecting the actual state of the blood treatment device (8) by means of a camera (4); - comparing the actual state of the blood treatment device (8) with a target state of the blood treatment device (8) using a control unit (CPU) connected to the camera (4); - sending, based on the comparison, by the control unit (CPU) a command to start the functional test to the blood processing device (8); - activating and carrying out the functional tests of the blood processing device (8) based on said commands; A method comprising:

2. - transmitting the results of the functional test to the control unit (CPU); - displaying the results of the functional tests in an augmented reality device (2); The method of claim 1 further characterized by:

3. - superimposing in the augmented reality device (2) the necessary steps to be performed in order to achieve the target state of the blood treatment device (8); The method of claim 2 further characterized by:

4. - blocking further functional tests in case of a negative result of said functional test The method according to any one of claims 1 to 3, further characterized by:

5. The method according to any one of claims 1 to 4, characterized in that the functional test is a self-test of the blood treatment device (8) for checking set-up actions performed by a user during set-up of the blood treatment device (8).

6. The method according to any one of claims 1 to 5, characterized in that the functional test is a pressure test, measuring a pressure temporarily increased for test purposes in a consumable attached to or provided in the blood processing device (8).

7. 2. The method according to claim 1, characterized in that the camera is provided in or attached to an augmented reality device (2).

8. A system comprising at least one camera (4), at least one control unit (CPU) in or connectable to a data connection with said camera (4), and at least one blood treatment device (8) in or connectable to said control unit (CPU), said control unit (CPU) being in data connection with: - detecting the actual state of the blood treatment device (8) by means of the camera (4); comparing the actual state of the blood treatment device (8) with a target state of the blood treatment device (8); - sending a command to the blood processing device (8) to initiate a functional test based on the comparison; A system configured to activate the functional test of the blood processing device (8) based on said command.

9. The system according to claim 8, characterized in that the camera (4) is attached to or provided with an augmented reality device (2), the augmented reality device (2) being configured to display the results of the functional test and / or further steps to be performed by a user.

10. The system according to claim 8 or 9, characterized in that the functional test is a self-test of the blood treatment device (8) for checking the set-up actions performed by a user when setting up the blood treatment device (8).

11. The system according to any one of claims 8 to 10, characterized in that the functional test is a pressure test in which a temporarily increased pressure is measured for test purposes in a consumable in a fluid line attached or provided to the blood processing device (8).

12. 9. The system according to claim 8, characterized in that the camera is provided in or attached to an augmented reality device (2).

Images